News

The MCL joined a collaborative project to build a large-scale subjective video quality database. The database was proposed to boost a major breakthrough in video coding and processing. On one hand, revolutionary ideas rather than fine-tuning patches are highly expected to accommodate increasing video traffic. On the other hand, PSNR has been the dominant distortion metric for many years, but it has also been criticized for not correlating well with perceptual quality. With this database, perceptual coding is promising to lead to numerous R&D opportunities and revolutionary research with machine learning tools.

The database consists of 200 raw sequences with a duration of 5 seconds, encoded by H.264/AVC with fixed QP as bit rate control method. They are available in 5 resolutions from 3840×2160 to 540×360. Around 1000 students participated in the subjective test and it took around 7000 hours to get sufficient samples about 3 JND points. The database will be freely available for downloading for scientific purposes.

The projected was supported by 4 major multimedia companies, Netflix, Huawei, MediaTek, and Samsung. Meanwhile, 6 universities at Shenzhen joined the project, Shenzhen Institutes of Advanced Technology (Chinese Academy of Science), Shenzhen University, Graduate School at Shenzhen (Tsinghua University), Peking University Shenzhen Graduate School, The Chinese University of Hong Kong (Shenzhen), City University of Hong Kong.

We would like to give special thanks to the participating companies, institutes and universities.

Convolutional neural networks (CNNs) have received a lot of attention in recent years due to their superior performance in computer vision benchmarking datasets. Yet, little theory has been developed to explain the underlying principle of CNNs.

Professor C.-C. Jay Kuo, Director of the Media Communication Lab, has recently published important theoretical results about two CNN fundamental properties. They are: 1) why a non-linear activation function is essential at the filter output of every intermediate layer? and 2) what is the advantage of the two-layer cascade system over the one-layer system? To answer these two questions, he developed a mathematical model called the “REctified-COrrelations on a Sphere” (RECOS).

Professor Kuo said, “CNNs need to store the knowledge learned from a large amount training data somewhere. The only places to store the knowledge are the converged filter weights. They must play a critical role in CNN understanding.” Professor Kuo coined a new term “anchor vectors” for the converged filter weights since they serve as a set of vectors for an arbitrary input vector to project onto at one layer. The projected values are the response from the previous layer while their rectified values serve as the input to the next layer. In his paper entitled with “Understanding Convolutional Neural Networks with A Mathematical Model”, Professor Kuo used the anchor vector concept to explain the necessity of nonlinear activation, analyze the behavior of a two-layer RECOS system, and compare it with its one-layer counterpart. He used the LeNet-5 applied to the MNIST dataset as an illustration example throughout the paper.

Professor Kuo emphasized that the new “anchor vector” viewpoint will lead to more interesting research in the near future. His paper has recently been accepted for publication [...]

Professor Jay Kuo, MCL Director, received the IEEE Circuits and Systems Society John Choma Education Award in the dinner banquet of the Asia Pacific Conference on Circuits and Systems (APCCAS) held in Jeju, Korea, on October 27. It was awarded by the President of the CAS Society, Professor Franco Maloberti (see the photos). Professor Kuo was cited “for excellence in inspirational guidance of graduate students and curriculum development in the field of multimedia technologies and systems.”

“This award has a special meaning to me,” said Professor Kuo, “since Professor John Choma was my colleague in the same Department at the USC. Professor Choma served as an excellent role model for all educators for his dedication and care to his students. I do miss him a lot.”

We are so happy to welcome a new undergraduate student, Beatriz Sousa, in Fall 2016. Let us hear what she said about research and MCL.

1. Could you briefly introduce yourself and your research interests?

My name is Beatriz Sousa, and I am a freshman at USC pursuing a BS degree in Electrical Engineering. I am very interested in expanding my knowledge in the programming side of electrical engineering so that I can better apply my knowledge toward making electronic circuits in various gaming systems in the future. I am also interested in better understanding how programming and circuit systems work together to create such a dynamic environment for the gamer, and thus problem solving to better develop such an environment.

2. What is your impression about MCL and USC?

USC is a supportive community that is always looking for new ways to expand and improve current technologies. MCL provides me with the same impression as every member is interested and passionate about what they are doing and are very friendly and willing to help.

3. What is your future expectation and plan in MCL?

My future expectation is to learn a lot about programming, especially in games, and how different aspects of the program interact with the systems present in the console to create an effect on the user that I would have not expected otherwise. I hope to create strong connections that will not only help me in my work in MCL but outside of it as well.

We are so happy to welcome a new visiting scholar, Professor Hongjie He, in fall 2016. Professor He is Professor at the School of Information Science and Technology, University of Southwest Jiaotong University of China. We are so glad that Professor He generously spent time answering some questions to share her research and her future expectation.

1. Could you briefly introduce yourself and your research interests?

I received my Ph.D. degree from Southwest Jiaotong University, Chengdu, China, in 2009. I am currently a professor at the School of Information Science and Technology, University of Southwest Jiaotong University of China. My research interests are in the areas of information security, image processing and image forensics.

2. What is your impression about MCL and USC?

USC is a great University. Students come from different countries with various cultures and background. People in MCL are all very nice and helpful, and I have received a lot of help from them. Moreover, MCL members work hard and share experience and finding.

3. What is your future expectation and plan in MCL?

I hope to know about the training model and teaching method for undergraduate and postgraduate in USC, and make a certain research progress in image forensics based on deep learning.