ZhiruoZhou

Welcome MCL New Member Zhanxuan Mei

Could you briefly introduce yourself and your research interests?

My name is Zhanxuan Mei, a graduate student of Electrical and Engineering at USC. I got my bachelor’s degree in Electrical Engineering from Beijing Institute of Technology. I like playing goes, reading and traveling. After taking many courses in USC, I found my research interests in video compression and machine learning. I am very excited to do some research and projects about my interests in MCL.

What is your impression about MCL and USC?

I like the beautiful campus and kindly people of USC. My life at USC was funny and everyday I spent was unforgettable. MCL is a big and effective community. Everyone is willing to help others and teamwork is important here. The weekly report and weekly meeting practice my writing and speaking skills and weekly seminar let me learn a lot.

What is your future expectation and plan in MCL?

I will definitely work hard and stay hungry for my research and projects under supervision of professor and mentors. I will take advantage of the chance to improve my professional skills and explore more interesting topics. Helping and learning from other people is also important for me. I believe the experience in MCL will be valuable for my future.

By |July 26th, 2020|News|Comments Off on Welcome MCL New Member Zhanxuan Mei|

Welcome MCL New Member Zhiyao Luo

Could you briefly introduce yourself and your research interests?

My name is Zhiyao Luo. I am a 1st year M.S. student in the program of EE general and join the MCL lab at USC for summer intern. I received my bachelor’s degree of engineering in Xi’an Jiaotong University of China. I have the background of machine learning and signal processing theory and I have some research background on classification and optimization problems. I have a passion for understanding models and algorithms in the field of computer vision by applying them to solve realistic problems.

What is your impression about MCL and USC?

I was deeply impressed by the school’s full consideration of students from different cultural backgrounds and I believe that USC can offer me plenty opportunities and  resource that I need. The first time I know about MCL is in EE569 course because most of TAs and graders in that course are members in MCL and the professionalism and rigor of MCL have been widely recognized in our class since then. It is my first week in MCL, I find that all the works are organized well and efficient, it makes me believe that I will gain a lot from MCL.

What is your future expectation and plan in MCL?

I hope I can help to finish some meaningful work in this summer and learn from other outstanding members in MCL. For my own career planning, I want to get familiar with the pace of academic research in MCL. If I think this kind of work is suitable for me and I believe that I will be able to achieve valuable result, I will try to get a chance to continue my academic career in [...]

By |July 19th, 2020|News|Comments Off on Welcome MCL New Member Zhiyao Luo|
  • Permalink Gallery

    Saak transform paper received 2020 JVCI best paper runner-up (2nd place) award

Saak transform paper received 2020 JVCI best paper runner-up (2nd place) award

The Journal of Visual Communication and Image Representation has just announced the 2020 best paper award winner and runner-up:

Winner: A robust technique for copy-move forgery detection and localization in digital images via stationary wavelet and discrete cosine transform, Mahmood, T., Mehmood, Z., Shah, M., Saba, T.
Runner-up: On data-driven Saak transform, Jay Kuo, C.-C., Chen, Y.

According to the EiC of the journal, the selection process is outlined below:

The committee members checked all papers in 2018 and 2019 and nominated 13 papers.

Each of the 13 papers were evaluated and scored by three committee members on a scale of 1 to 10.
There were 4 papers with approximately similar score. All committee members were given the opportunity to vote for the top.
After voting, the best paper and runner up were selected.
All members supported the above winner and runner-up.

 

It is a great honor that MCL received the JVCI best paper and runner-up awards in three years in a row.

The 2020 Best Paper Award Runner-up for the Journal of Visual Communication and Image Representation.
C.-C. Jay Kuo and Yueru Chen, “On data-driven Saak transform,” the Journal of Visual Communication and Image Representation, Vol. 50, pp. 237-246, January 2018.

The 2019 Best Paper Award Runner-up for the Journal of Visual Communication and Image Representation.
Ronald Salloum, Yuzhou Ren and C.-C. Jay Kuo, “Image splicing localization using a multi-task fully convolutional network (MFCN),” the Journal of Visual Communication and Image Representation, Vol. 51, pp. 201-209, February 2018.

The 2018 Best Paper Award from the Journal of Visual Communications and Image Representation.
C.-C. Jay Kuo, “Understanding convolutional neural networks with a mathematical model,” the Journal of Visual Communication and [...]

By |July 11th, 2020|News|Comments Off on Saak transform paper received 2020 JVCI best paper runner-up (2nd place) award|

Welcome MCL New Member Jiesi Hu

Could you briefly introduce yourself and your research interests?

I am an EE master student in Viterbi. I just finished my first year of master’s. I get my bachelor’s degree from the electronic college in Nanjing University of Posts and Telecommunications. I like playing tennis, badminton, table tennis and jogging. I also joined the tennis club at USC. My area of interest is machine learning and signal processing. The topic I want to study is video tracking which I think is a very useful technique.

What is your impression about MCL and USC?

I think the members of MCL is very kind. They are always willing to help me when I have questions about the course. They spend lots of time explaining until I fully understand. Besides, I think Professor Kuo is a good manager. Professor Kuo personally guides everyone, and all members of MCL has clear goals and tasks.

What is your future expectation and plan in MCL?

I hope I can work hard and learn more about video tracking and machine learning. I want to have a deeper insight into them. I know I am too naïve now both in experience and knowledge, so I want to learn how to do research and academic report. If possible, I also want to make some contribution to MCL. In the future, I would like to become a PhD student.

By |July 5th, 2020|News|Comments Off on Welcome MCL New Member Jiesi Hu|

Welcome MCL New Member Ganning Zhao

Could you briefly introduce yourself and your research interests?

My name is Ganning Zhao. I was born in Weifang, China. This is my first semester here in USC, pursuing master’s degree on Electrical Engineering. I graduated from Guangdong University of Technology, majoring in automation. In my undergraduate, I did a project about audio signal processing using convolutional neural network with my friends and I became interested in signal processing and machine learning since then. My current research interest is image processing and computer vision.

What is your impression about MCL and USC?

I like the campus of USC, because the buildings are beautiful. Particularly, there are many libraries in USC and many of them are exquisite. People in MCL are intelligent and work very hard. I’m also impressed that they are very nice and always willing to help with each other. Professor Kuo is also very nice and caring about everyone in lab. I like the atmosphere here in MCL.

What is your future expectation and plan in MCL?

My research topic in this summer is texture synthesis. I hope I can do a good job in this topic. More importantly, because everyone in MCL are intelligent, I hope I can learn a lot from them during communication and improve my research ability. Also, I want to make more friends here in MCL.

By |June 28th, 2020|News|Comments Off on Welcome MCL New Member Ganning Zhao|

Welcome MCL New Member Jiamian Wang

Could you briefly introduce yourself and your research interests?

I’m Jiamian Wang, a graduate student of USC Ming Hsieh Department of Electrical and Computer Engineering. I got my bachelor’s degree at Tianjin University, China. My research interests are computer vision and image processing. I participated in the projects of doing image semantic segmentation, doing outlier-detection using CNNs and creating the image generating models. I’m interested in exploring the mathematical logits behind different algorithms.

What is your impression about MCL and USC?

USC provides many high-quality courses for us, from which I got a solid basis and rich experience.  Also, the community provides us with many chances and platforms, through which we share information and communicate with each other effectively. Because of this I know MCL, in which a new theory about computer vision has been proposed and explored. I’m honored to join the MCL and work with the excellent students and professors here.

What is your future expectation and plan in MCL?

Computer vision and image processing is my long-time interest and MCL is the excellent lab specialized for this. For this reason, I want to take this chance and devote as much time and effort onto my work as I can. Hopefully, summer intern is a good start for me and in the future, I want to be one of the formal members of MCL as a PhD student.

By |June 21st, 2020|News|Comments Off on Welcome MCL New Member Jiamian Wang|

Welcome MCL New Member Zheng Wen

Could you briefly introduce yourself and your research interests?

My name is Zheng Wen, I’m currently pursuing my Master’s degree at USC in Electrical Engineering. I received my Bachelor’s degree in Beihang University, Beijing, China. I’m very curious in math and programming. I found it interesting to do something related matrix and machine learning, so I’m very glad that I Professor Kuo could give me this opportunity to join MCL and dive deeper in image processing, computer vision and machine learning.

What is your impression about MCL and USC?

This is my first year in USC, I found the campus is very beautiful even though kind of small. Leavey Library is a good place to study when we are struggling for the final exams of a semester. I really enjoy the American Chinese cuisine offered by the canteen. MCL is a big family. I get to know the members in MCL by EE569, Professor Kuo is an expert in multimedia, and his understanding in deep learning impressed me a lot. TAs are very experience in image processing and willing to help us.

What is your future expectation and plan in MCL?

In MCL, I want to do some project in image forensics with the help of Yao, learn more about image processing and machine learning, also sharpen my programming skills and make some progress to the domain. I will try my best to get involved in MCL and make friends with everyone.

By |June 14th, 2020|News|Comments Off on Welcome MCL New Member Zheng Wen|

Welcome MCL New Member Zhiwei Deng

Could you briefly introduce yourself and your research interests?

My name is Zhiwei Deng, I am a first year MSEE student at USC. I came from Anhui, China. I received my bachelor’s degree from Shanghai University in 2019. I had some experience in computer vision and machine learning fields during my undergraduate years. In this summer, I will continue to work on these areas, specifically on the topic of 3D point cloud classification and segmentation.

What is your impression about MCL and USC?

USC has a beautiful campus and serious research environment. I really enjoy both the natural views of the campus and the historical buildings with red bricks. I think MCL is a lab with creativity and courage. Old things are challenged, and new things are created here. I think mathematics and logics are quite important for the members of MCL. Also, I feel very honored and motivated to work new things out with these excellent people.

What is your future expectation and plan in MCL?

The most important thing of this summer for me is to have a clearer view in this field and have a deeper understand in certain topics in image processing. Also, I hope I can contribute to some projects during the internship. For the future career plan, I want to dig deeper in these areas in the future and pursue a higher level of academic degree.

By |June 7th, 2020|News|Comments Off on Welcome MCL New Member Zhiwei Deng|

Congratulations to Heming Zhang for passing her defense!

Let us hear what she wants to say about her defense and an abstract of her thesis.

Deep learning techniques utilize networks with multiple layers cascaded to map the inputs to desired outputs. To map the entire inputs to desired outputs, useful information should be extracted through the layers. During the mapping, feature extraction and prediction are jointly performed. We do not have direct control for feature extraction. Consequently, some useful information, especially local information, is also discarded in the process.

In this thesis, we specifically study local-aware deep learning techniques from four different aspects: 1) Local-aware network architecture 2) Local-aware proposal generation 3) Local-aware region analysis 4) Local-aware supervision

Specifically, we design a multi-modal attention mechanism for generative visual dialogue system, which simultaneously attends to multi-modal inputs and utilizes extracted local information to generate dialogue responses. We propose a proposal network for fast face detection system for mobile devices, which detects salient facial parts and uses them as local cues for detection of entire faces. We extract representative fashion features by analyzing local regions, which contain local fashion details of humans’ interests. We develop a fashion outfit compatibility learning method, which models each outfit as a graph and learns outfit compatibility using both global and local supervisions on the graphs.

I would like to thank Prof. Kuo and all the lab members for their help. I have learned a lot through my PhD journey and I want to share some feelings and experiences. One essential part of the doctoral training is mental training, from which I have become more persistent, self-disciplined and motivated. As this journey may take several years, maintaining a balanced life is very important. I wish the best to all the lab members and [...]

By |January 26th, 2020|News|Comments Off on Congratulations to Heming Zhang for passing her defense!|

MCL Research on Behavior Analysis of Stressed CNNs

CNNs have demonstrated effectiveness in many applications. However, few efforts have been made to understand CNNs. To better explain the behaviors of convolutional neural networks (CNNs), we adopt an experimental methodology with simple datasets and networks in this research. Our study includes three steps: 1) design a sequence of experiments; 2) observe and analyze network behaviors; and 3) present conjectures as learned lessons from the study. In particular, we wish to examine the behaviors under limited resources, including limited amount of labeled data and limited network size. First, we examine the effect of limited labeled data. Semi-supervised learning deals with the case where limited labeled data and abundant unlabeled data are available. Co-training is one of the techniques. In this part, we also focus on how CNNs behave under co-training. Second, to facilitate easier analysis of the roles of individual layers, we adopt a very simple LeNet-5-like network in our experiments. We adjust the number of filters in each layer and analyze the effect. In particular, we wish to show how differently networks with limited resources (i.e., when the number of filters is very small) and networks with rich resources behave in the following four aspects of CNNs:

Scalability: How does the network respond to datasets of different sizes?
Non-convexity: Is the performance of a network stable against different initializations of the network parameters?
Overfit: Is there a big gap between training and test accuracies?
Robustness: Is the classification result sensitive to small perturbation to the input?

 

An important contribution of our work is the investigation into the resource-sparse networks. Most works on CNN adopted networks with very rich resources. In our work, we also look into how the networks behave under [...]

By |January 12th, 2020|News|Comments Off on MCL Research on Behavior Analysis of Stressed CNNs|