yiyuezhang

Welcome Summer Intern Student Zhichao Huang

We are so happy to welcome a new summer intern student, Zhichao Huang, in Summer 2017. Let us hear what he said about his research and MCL.

1. Could you briefly introduce yourself? (Previous research experience, project experience, research interest and expertise)

I’m Zhichao Huang, a junior student from Tsinghua University, majoring Electronic Engineering. Although I came from EE department, the research that I have done is mainly in the field computer science. I have been working on the area of computer vision for about one year, focusing on face recognition, person identification and something like that. In addition to computer vision, I also worked on some small project in the course that I took like web scrapping, digital circuits etc.

2. What’s your first impression of USC and MCL?

This is the first time that I came to USC and I’m deeply impressed by its architecture, atmosphere and people. The buildings have a very different style from those in the campus of China, seems to tell a long story about the school. People here are very friendly. They give us a warm welcome, leading us around campus, treating us with delicious food and answering every question patiently.

MCL is a great lab with wonderful atmosphere. Professor Kuo treat us with a wonderful meal and ask our interest specifically. And everyone is willing to help each other, discussing the project, answering every quesion when we are in need. I do have a great time in MCL.

3. What’s your future expectation for MCL?

I hope to make progess in the current project that I am working on and learn more about computer vision.

By |July 17th, 2017|News|Comments Off on Welcome Summer Intern Student Zhichao Huang|

Welcome Summer Intern Student Po-Cheng Tseng

We are so happy to welcome a new summer intern student, Po-Cheng Tseng, in Summer 2017. Let us hear what he said about his research and MCL.

1. Could you briefly introduce yourself? (Previous research experience, project experience, research interest and expertise)

My name is Tseng, Po-Cheng , and I am currently a sophomore majoring in computer science in The Chinese University of Hong Kong. As a computer science student, I have had some internship experiences , which include, but not limited to ,web-scraping and writing websites, etc. Even though I currently only know very little about the field of artificial intelligence, I have been enamoured by the potential and the change that this field will bring about to the world, and it is always enjoyable to build something from scratch!

2. What’s your first impression of USC and MCL?

From the very moment that I stepped into the campus of USC, I have always felt an aura of perseverance and confidence around. Although USC does not boast the most beautiful buildings in the world, but everyone here is feverishly and relentlessly pursuing his or her goal, whether it be in the labs , on the track field or in the swimming pool.

MCL has always given me a vibe of friendliness and peacefulness, where everybody is willing to help each other when one encounters a problem. I love the symbiotic atmosphere created here!! I would like to give my special thanks to Eric, Sreedhar ,Alshivar and many others (I am not sure if I have spelt your names wrong haha) for showing me around upon my arrival here in the USC, and also Haqiang Wang , Wang Ye , for your generous help [...]

By |July 2nd, 2017|News|Comments Off on Welcome Summer Intern Student Po-Cheng Tseng|

Welcome Summer Intern Student Jeffrey Maierhofer

We are so happy to welcome a new summer intern student, Jeffrey Maierhofer, in Summer 2017. Let us hear what he said about his research and MCL.

1. Could you briefly introduce yourself? (Previous research experience, project experience, research interest and expertise)

My name is Jeffrey “Matt” Maierhofer. I am currently an undergraduate student at the University of Colorado Boulder studying Applied Mathematics and Computer Science. In the past I have done some research in numerical solvers for complex differential equations. I am also interested in applications of mathematics that involve a heavy combination of computer science and mathematics.

2. What’s your first impression of USC and MCL?

My first impression of USC was how beautiful the campus was. The weather has been wonderful, and the campus itself is really pleasing to walk through. MCL is by far the largest research group that I’ve ever been a part of, and i really like how it promotes collaboration within the lab.

3. What’s your future expectation for MCL?

I hope to learn as much as possible during my summer in MCL and hope to get to know a lot of cool people!

By |June 25th, 2017|News|Comments Off on Welcome Summer Intern Student Jeffrey Maierhofer|

Welcome Summer Intern Student Derenik Haghverdian

We are so happy to welcome a new summer intern student, Derenik Haghverdian, in Summer 2017. Let us hear what he said about his research and MCL.

1. Could you briefly introduce yourself? (Previous research experience, project experience, research interest and expertise)

My name is Derenik Haghverdian. I am a rising senior at University of California, Los Angeles (UCLA) majoring in Applied Mathematics with a minor in Statistics. I am interested in the application of mathematics in solving ambitious questions and challenges. I have recently been engaged with machine learning and neural networks, and I see a great growth potential in this field.
I am also very passionate about photography, and I am a professional Flamenco guitar player.

2. What’s your first impression of USC and MCL?

People at MCL were very welcoming and supportive of their new lab members. MCL is full of talented and ambitious individuals with strong academic and research backgrounds. I am honored to be a part of this great team and have the chance to learn and collaborate with them.

3. What’s your future expectation for MCL?

I want to develop a solid foundation in deep learning in my experience at MCL, so I can apply my knowledge and expertise to future projects in this field. I am confident that under the supervision of Professor Kuo and his amazing and professional team I will gain valuable experience in this field.

By |June 18th, 2017|News|Comments Off on Welcome Summer Intern Student Derenik Haghverdian|

Welcome Summer Intern Student Sreedhar Radhakrishnan

We are so happy to welcome a new summer intern student, Sreedhar Radhakrishnan, in Summer 2017. Let us hear what he said about his research and MCL.

1. Could you briefly introduce yourself? (Previous research experience, project experience, research interest and expertise)

Hi, I am Sreedhar, I am currently an undergrad senior in Computer Science and Engineering at PES University,Bangalore,India and Data Science excites me. After my freshman year I interned at a research centre at my university where I was introduced to methodologies of research and I worked in the area of Computer Vision. The following year I had coursework in Design and Analysis of Algorithms and Linear Algebra which I fell in love with as I was able to get a perspective of how they are used in real world problems based on my research after my freshman year. The summer after sophomore year I worked on data analysis applied in the sport of Cricket and developed a player evaluation metric through the same. This really got me interested in leveraging the power of data in numerous applications. I then had course work in Data Analytics, Natural Language Processing, Digital Image Processing and Big Data which are some of my favorite courses. I am currently interested in Machine Learning and Deep Learning and their applications in various fields such as Computer Vision and NLP. I am currently working on Deep Learning for Computer Vision and learning a lot under the guidance of Dr. Kuo and fellow MCL members.

2. What’s your first impression of USC and MCL?

I just completed my first week of the summer internship here and I love the environment. Members of MCL are truly very hard working and dedicated in their [...]

By |June 11th, 2017|News|Comments Off on Welcome Summer Intern Student Sreedhar Radhakrishnan|
  • Permalink Gallery

    Professor Kuo Talked about Deep Learning in MHI Emerging Trends Series

Professor Kuo Talked about Deep Learning in MHI Emerging Trends Series

Professor Kuo Gave a Talk on Deep Learning at Ming Hsieh Institute

The Ming Hsieh Institute has launched an MHI Emerging Trends Series. MCL Director, Professor C.-C. Jay Kuo, was the first speaker in this series. Professor Kuo gave his talk on deep learning on April 10 (Monday), 2017.

There is a resurging interest in developing a neural-network-based solution to supervised machine learning in the last 5 years. However, little theoretical work was reported in this area. In his talk, Professor Kuo attempted to provide some theoretical foundation to the working principle of the convolutional neural network (CNN) from a signal processing viewpoint. First, he introduced the RECOS transform as a basic building block for CNNs. The term “RECOS” is an acronym for “REctified-COrrelations on a Sphere”. It consists of two main concepts: data clustering on a sphere and rectification. Then, a CNN is interpreted as a network that implements the guided multi-layer RECOS transform. Along this line, he also compared the traditional single-layer and modern multi-layer signal analysis approaches. Furthermore, he discussed how guidance can be provided by data labels through backpropagation in the training with an attempt to offer a smooth transition from weakly to heavily supervised learning. Finally, he pointed out several future research directions at the end.

There were about 80 people attending Professor Kuo’s seminar. Many questions were asked after his talk. Professor Kuo said that he enjoyed the interaction with the audience very much and it demonstrated the strong interest of the audience on this topic.

By |April 17th, 2017|News|Comments Off on Professor Kuo Talked about Deep Learning in MHI Emerging Trends Series|

MCL works on Interactive Advisement for Smart TV

When watching images/videos on a TV, we often have many questions about the image/video. What is the name of the beautiful places? What is the name of the actors? Which store sell the actor’s car at big discounts? Imagine one day we have a smart TV which can interactively answer your questions, and recommend relevant shopping/travel advertisements. We will enjoy more convenience and have more funs on watching TV.

MCL members, Bing Li, Zhehang Ding and Yuhang Su are collaborating with Samsung Company on Interactive Advisement for Smart TV. At the first year, we focus on automatic image/video caption. Image/video caption is to describe an image/video by a sentence instead of detecting objects.

Currently, we propose three pipelines for this project. The first pipeline is general image caption. The second and third pipeline are respectively place aware caption and face aware caption, such that our system can achieve better performance in vertical industrials such as travel, entertainment, sport and etc. For general image caption, we develop a detection method which achieves 84% mAP. For place-ware annotation, since no image datasets is for world-wide famous places, we collect images from 118 famous places in 21 countries to construct a landmark dataset. For face aware annotation, we construct a celebrity dataset, and face detection and face recognition method based on CNN.

In our future work, we will put more efforts into video caption.

By |April 11th, 2017|News|Comments Off on MCL works on Interactive Advisement for Smart TV|
  • Permalink Gallery

    MCL Members Chi-Hao Wu and Siyang Li Presented Their Research Work at WACV 2017

MCL Members Chi-Hao Wu and Siyang Li Presented Their Research Work at WACV 2017

MCL members, Chi-Hao (Eddy) Wu and Siyang Li presented their papers at Winter Conference on Applications of Computer Vision (WACV) 2017, Santa Rosa, CA, USA

The title of Eddy’s paper is “Boosted Convolutional Neural Networks (BCNN) for Pedestrian Detection”, with Weihao Gan, De Lan and C.-C. Jay Kuo as the co-authors. Here is a brief summary:

“In this work, a boosted convolutional neural network (BCNN) system is proposed to enhance the pedestrian detection performance. Being inspired by the classic boosting idea, we develop a weighted loss function that emphasizes challenging samples in training a convolutional neural network (CNN). Two types of samples are considered challenging: 1) samples with detection scores falling in the decision boundary, and 2) temporally associated samples with inconsistent scores. A weighting scheme is designed for each of them. Finally, we train a boosted fusion layer to benefit from the integration of these two weighting schemes. We use the Fast-RCNN as the baseline, and test the corresponding BCNN on the Caltech pedestrian dataset in the experiment, and show a significant performance gain of the BCNN over its baseline.” 

Siyang’s paper is entitled “Box Refinement: Object Proposal Enhancement and Pruning”, co-authored with Heming Zhang, Junting Zhang, Yuzhuo Ren and C.-C. Jay Kuo. The summary goes as followed:

“Object proposal generation has been an important preprocessing step for object detectors in general and the convolutional neural network (CNN) detectors in particular. Recently, people start to use the CNN to generate object proposals but most of these methods suffer from the localization bias problem, like other objectness-based methods. Since contours offer a powerful cue for accurate localization, we propose a box refinement method by searching for the optimal contour for each initial bounding box that minimizes the contour cost. [...]

By |April 5th, 2017|News|Comments Off on MCL Members Chi-Hao Wu and Siyang Li Presented Their Research Work at WACV 2017|

MCL Works on Text Localization

Spotting text in a natural scene image is a challenging task. It involves text localization in the image and text recognition given these localized text image patches. To tackle this problem, traditional optical character recognition (OCR) techniques – which are designed specifically for black and white text contents – give way to more sophisticated methods like neural networks.

Yuanhang Su, one MCL member, is now collaborating with Inha University, Korean Airline and Pratt & Whitney institute for collaborative engineering (PWICE) to build a text spotting system. Our lab has developed a comprehensive text spotting system that can localize and recognize text in natural scene images by using combined convolutional neural network (CNN) and recurrent neural network (RNN) architecture. Our system is able to deal with English and Korean text contents.

By |April 2nd, 2017|News|Comments Off on MCL Works on Text Localization|

MCL Works on Deep Learning based Fashion Fingerprinting

Fashion fingerprint is a compact feature vector for fashion items that can be used for tasks such as recognition, clustering, and retrieval of similar items. It is equally useful for both online fashion retailers as well as for physical apparel stores (with or without their online extensions). A related problem is understanding the apparel preferences of an individual from the dresses that they wear while visiting the physical store. One of the challenges of fashion study different from others is lack of enough accurate annotation. Available datasets have either limited number of images or very noisy annotation.

Currently we have successfully trained a fashion item localization model based on SSD[1]. The model is able to localize upper clothes, bottom clothes and one-pieces and has been tested on the Clothing Parsing dataset[2]. It achieves an F-score of 0.887 on upper clothes localization. For other clothing items, errors occur because the model may focus on too local regions and thus gets confused between skirt and dress. Prior location of human body will be incorporated in our model to solve this problem.

In the future we will further refine our localization model and also work on two directions. One is to recognize the garments based on our localization. The other one is to automatically label more images to enlarge the size of datasets.

[1] Liu, Wei, et al. “SSD: Single shot multibox detector.” European Conference on Computer Vision. Springer International Publishing, 2016.
[2] Liang, Xiaodan, et al. “Deep human parsing with active template regression.” IEEE transactions on pattern analysis and machine intelligence 37.12 (2015): 2402-2414.

By |March 26th, 2017|News|Comments Off on MCL Works on Deep Learning based Fashion Fingerprinting|