News

  • Permalink Gallery

    Professor Kuo Delivered Keynote at 5G/B5G Mobile Broadband Com Forum in KaoHsiung, Taiwan

Professor Kuo Delivered Keynote at 5G/B5G Mobile Broadband Com Forum in KaoHsiung, Taiwan

MCL Director, Professor Kuo, gave a keynote speech at 5the G/B5G Mobile Broadband Communication Forum in KaoHsiung, Taiwan, on December 14, 2019. The title of his keynote was “On Efficient and Explainable AI/ML Techniques for 5G/B5G Broadband Communication Systems”.  Here is the abstract of his speech.

“There have been many successful artificial intelligence and machine learning (AI/ML) stories in the last decade due to the resurgence of neural-network-based deep learning. We may ask whether the amazing success is primarily attributed to “deep learning” or “big data”. If it is attributed to deep learning, we need to understand these tools fully and open the black-box for further advancement. If it is attributed to big data, we need to find a way to position ourselves since data collection and labeling are expensive. With respect to the first question, I argue that AI is not necessarily dependent upon deep learning. We are working on an alternative approach, called Successive Subspace Learning (SSL), to solve the big data problem at USC. SSL is mathematically transparent and expandable depending on the training data sizes and classes. It has great potential. With respect to the second question, my view is that big data is helpful but not sufficient by itself. It is essential to integrate the “rule-based” and the “data-driven” approaches for generalizability and robustness. It leads to the conclusion that AI/ML is not about competing with humans in terms of intelligence but an advanced form of “automation”, which leverages both data and domain knowledge to achieve domain-specific tasks more effectively. Finally, I will give a couple of examples on how to apply AI/ML techniques to 5G/B5G broadband communication systems.”

By |December 15th, 2019|News|Comments Off on Professor Kuo Delivered Keynote at 5G/B5G Mobile Broadband Com Forum in KaoHsiung, Taiwan|
  • Permalink Gallery

    Professor Kuo Delivered Keynote at Grand Cloud Conference in Seoul

Professor Kuo Delivered Keynote at Grand Cloud Conference in Seoul

MCL Director, Professor Kuo, was invited by Korean National IT Industry Promotion Agency (NIPA) to deliver a keynote speech at the Grand Cloud Conference, Seoul, Korea on Dec. 3, 2019. The title of Professor Kuo’s talk was “AI Cloud Strategy for Government and Industry”. Here is the abstract.

There have been many successful artificial intelligence (AI) stories in the last decade due to big data analytics and the resurgence of neural-network-based deep learning. For clarity, I would like to give my own definition about AI. That is, AI is not about competing with humans in terms of intelligence but an advanced form of “automation”, which leverages both data and domain knowledge to achieve domain-specific tasks more effectively. Then, I will discuss the AI deployment strategy. It is centered around “smart environments” such as smart homes, smart cities, etc. We can leverage sensors, Internet of Things (IoT) and 5G infrastructures to acquire a large amount of data for better decision making. After that, I will mention three R&D opportunities: 1) explainable AI, 2) integrated rule-based/data-driven methodology and 3) federated learning. For the first topic, AI is not necessarily dependent upon deep learning, which is a black box. We are working on an alternative approach, called Successive Subspace Learning (SSL), to solve the big data problem at USC. SSL is mathematically transparent and expandable depending on the training data sizes and classes. It has great potential. For the second topic, I want to emphasize that big data is helpful but not sufficient by itself alone. It is more powerful to have an integration of the “rule-based” and the “data-driven” approaches. The integration allows better generalizability and robustness. The third topic is concerned with data-driven model training without [...]

By |December 8th, 2019|News|Comments Off on Professor Kuo Delivered Keynote at Grand Cloud Conference in Seoul|

MCL’s Thanksgiving Luncheon

MCL had the annual Thanksgiving Luncheon at Kirin Buffet on November 28, 2019. The Thanksgiving Luncheon has been a tradition of MCL for about 20 years. It’s a good chance for the whole group to gather and have a lunch together as a warm and happy family. All of us enjoyed the dilicious food and the wonderful time chatting with each other. It’s also a good opportunity to have a rest after a busy semester. Thank Professor Kuo for holding this event and thank Bin for organizing it.

Happy Thanksgiving to everyone!

By |November 28th, 2019|News|Comments Off on MCL’s Thanksgiving Luncheon|

MCL Work Won APSIPA Sadaoki Furui Paper Award

Dr. Sachin Chachada, a former MCL alumnus, and Professor C.-C. Jay Kuo received the 2019 Sadaoki Furui Paper Award at the open ceremony of the 2019 APSIPA ASC held in Lanzhou, China, on November 19 for their paper below:
Sachin Chachada and C.-C. Jay Kuo, “Environmental sound recognition: a survey,” Published online: 15 December 2014, e14, APSIPA Trans. on Signal and Information Processing.
The paper has been cited by 107 in Google Scholar, the number of downloads in 2019 (to end of Sept.) is 1523. The abstract of the paper is given below.
Although research in audio recognition has traditionally focused on speech and music signals, the problem of environmental sound recognition (ESR) has received more attention in recent years. Research on ESR has significantly increased in the past decade. Recent work has focused on the appraisal of non-stationary aspects of environmental sounds, and several new features predicated on non-stationary characteristics have been proposed. These features strive to maximize their information content pertaining to signal’s temporal and spectral characteristics. Furthermore, sequential learning methods have been used to capture the long-term variation of environmental sounds. In this survey, we will offer a qualitative and elucidatory survey on recent developments. It includes four parts: (i) basic environmental sound-processing schemes, (ii) stationary ESR techniques, (iii) non-stationary ESR techniques, and (iv) performance comparison of selected methods. Finally, concluding remarks and future research and development trends in the ESR field will be given.

By |November 24th, 2019|News|Comments Off on MCL Work Won APSIPA Sadaoki Furui Paper Award|

Congratulations to Ye Wang for Passing His PhD Defense

Congratulations to Ye Wang for passing his defense on November 12, 2019. His Ph.D. thesis is entitled “Video Object Segmentation and Tracking with Deep Learning Techniques”.

Abstract of the thesis:

Video object segmentation (VOS) aims to segment foreground objects from complex background scenes in video sequences. It is a challenging problem because of the complex nature of videos: occlusions, motion blur, deforming shapes and truncations etc. There are two main categories in existing VOS methods: semi-supervised and unsupervised. Semi-supervised VOS algorithms require manually annotated object regions in the first frame and then automatically segment the specified object in the remaining frames throughout the video sequence. Unsupervised VOS algorithms segment the most conspicuous and eye-attracting objects without prior knowledge of these objects in the video.

This thesis describes how we build an intelligent system to perform video object segmentation and tracking. We discuss the challenges in this field and then propose deep learning algorithms to significantly improve the performances in this thesis. First, this thesis addresses unsupervised video object segmentation by designing pseudo ground truth and online adaptation. Second, a novel unsupervised video object segmentation approach via distractor-aware online adaptation is proposed to deal with challenging videos when multiple objects occur and interact in a given video clip. Finally, this thesis also presents a two-stage approach, track and then segment, to perform semi-supervised video object segmentation with only bounding box annotations. Besides, we provide some interesting problems which can be addressed in the future.

Ph.D. experience:

I am very fortunate to join Media Communications Lab (MCL) led by Professor C.-C. Jay Kuo in Fall 2015, who gave me the chance and inspiration to explore the new direction and guided me through my whole PhD study. His immense knowledge has greatly [...]

By |November 17th, 2019|News|Comments Off on Congratulations to Ye Wang for Passing His PhD Defense|

MCL Research on Point Cloud Classification and Segmentation

Recently, Professor Kuo and his students at MCL proposed a new machine learning methodology called successive subspace learning (SSL). The methodology has been widely adopted in MCL to solve image processing and computer vision problems. In 3D domain, we have observed a great success in point cloud classification task. In the PointHop paper, we develop an explainable machine learning method for point cloud classification. The classification baseline is composed by four PointHop units, we construct the local-to-global attribute building process and use saab transform to control the dimension growth in each unit. We compare the test performance on ModelNet40 with the state-of-the-art methods, our method obtains comparable performance with the others while demands much less training time. For instance, PointNet costs about 5 hours to train, while ours only takes 20 minutes to train on the same dataset. The advantages of the methodology are very clear: interpretable and much less computation complexity.

The success in point cloud classification encourages us to go deeper in 3D domain. Therefore, we further look at the segmentation task which needs to assign label to each point in the point cloud. Referring to the common image segmentation network, we use the point cloud classification baseline as an encoder and add a decoder to complete segmentation. After building local neighboring regions and extracting local attributes from neighboring points in the encoder, the features are interpolated back to finest scale layer by layer with skip connections between same scales in the decoder. Also, saab transform is adopted between layers as feedfoward convolution to control the rapid growth of the feature dimension.

Our method also has the advantage of task-agnostic ability. Specifically, by learning the parameters in a one-pass manner, our [...]

By |November 11th, 2019|News|Comments Off on MCL Research on Point Cloud Classification and Segmentation|

MCL Research on Successive Subspace Learning

Subspace methods have been widely used in signal/image processing, pattern recognition, computer vision, etc.   One may use a subspace to denote the feature space of a certain object class, (e.g., the subspace of the dog object class) or the dominant feature space by dropping less important features (e.g., the subspace obtained via principal component analysis or PCA). The subspace representation offers a powerful tool for signal analysis, modeling and processing. Subspace learning is to find subspace models for concise data representation and accurate decision making based on training samples.

Most existing subspace methods are conducted in a single stage. We may ask whether there is an advantage to perform subspace learning in multiple stages. Research on generalizing from one-stage subspace learning to multi-stage subspace learning is rare. Two PCA stages are cascaded in the PCAnet, which provides an empirical solution to multi-stage subspace learning. Little research on this topic may be attributed to the fact that a straightforward cascade of linear multi-stage subspace methods, which can be expressed as the product of a sequence of matrices, is equivalent to a linear one-stage subspace method. The advantage of linear multi-stage subspace methods may not be obvious from this viewpoint.

Yet, multi-stage subspace learning may be worthwhile under the following two conditions. First, the input subspace is not fixed but growing from one stage to the other. For example, we can take the union of a pixel and its eight nearest neighbors to form an input space in the first stage. Afterward, we enlarge the neighborhood of the center pixel from 3×3 to 5×5 in the second stage.  Clearly, the first input space is a proper subset of the second input space. By generalizing it to multiple stages, [...]

By |November 3rd, 2019|News|Comments Off on MCL Research on Successive Subspace Learning|

Welcome New MCL Member – Eric Huang

We are so happy to welcome a new undergraduate member of MCL, Eric Huang. Here is an interview with Eric:

Could you briefly introduce yourself and your research interests?

Hi, my name is Eric Huang and I’m a current senior studying computer science at USC. I’ve been interested in research ever since I started college and the MCL is a lab I’m honored to have been able to join. I previously worked in biomedical and mechanical engineering labs, but machine learning is the field I am most interested in. My research focus is on facial classification and verification, particularly in studying how to streamline the training process. But I think that every new development in AI is incredible and I hope to be able to learn and understand the many aspects.

What is your impression about MCL and USC?

My impression of USC after three years is that the school is amazing. There are countless intelligent students and professors that form a productive and supportive network. I see the MCL as the pinnacle of what USC can achieve. Everyone in the MCL is highly driven, intelligent, and passionate and I hope to live up to the same standard.

What is your future expectation and plan in MCL?

My expectation and plan in the MCL are to learn, grow, and hopefully contribute. I plan to study hard and learn everything I can in order to be able to meaningfully help out. I expect to learn a lot from the lab members and to work hard supporting them. And I hope that I am able to form lasting connections with all the talented people I get to work with.

By |October 27th, 2019|News|Comments Off on Welcome New MCL Member – Eric Huang|

Professor Kuo visited Nanjing, Hefei and Zhuzhou

MCL Director, Professor C.-C. Jay Kuo, visited Nanjing, Hefei and Zhuzhou in the week of October 7-13.

Professor Kuo’s visit to Nanjing University on October 8 (Tuesday) was invited and hosted by Professor Zhi-Hua Zhou, Dean of School of Artificial Intelligence and Head of Department of Computer Science and Technology, Nanjing University. Professor Kuo delivered a seminar on “From Feedforward-Designed Convolutional Neural Networks (FF-CNNs) to Successive Subspace Learning (SSL)” as part of the CSAI Distinguished Lecture Series of Nanjing University. A photo of Professor Kuo and Professor Zhou is provided.

Professor Kuo’s visit to University of Science and Technology of China on October 9 (Wednesday) was invited and co-hosted by Professor Feng Wu, Professor Houqiang Li and Professor Qibin Sun. Professor Kuo delivered a seminar on his recent work on Success Subspace Learning (SSL) to faculty and students.

At the last stop of his trip, Professor Kuo attended the Chinese Conference on Biometric Recognition (CCBR) from October 12 and 13 in Zhuzhou, Hunan, China. He was a keynote speaker of this conference and delivered a lecture on “Towards Effective and Explainable Biometrics”. The abstract of his keynote is given below.

“Deep learning provides state-of-the-art biometrics solutions when training and testing data share similar distributions and the number of training samples is sufficiently larger. The deep-learning-based solutions are mathematically intractable due to the non-convex optimization nature. Furthermore, their robustness is a main concern. To search for effective and explainable biometrics solutions is challenging yet essential. In this talk, I will present a path towards this direction and provide preliminary results using face recognition as an example. Instead of treating computational neurons as hidden units whose parameters are determined by end-to-end optimization, we interpret computational neurons as dimension reduction units, [...]

By |October 20th, 2019|News|Comments Off on Professor Kuo visited Nanjing, Hefei and Zhuzhou|

Welcome New MCL Member Xiou Ge

We are so happy to welcome a new graduate member of MCL, Xiou Ge. Here is an interview with Xiou:

Could you briefly introduce yourself and your research interests?

My name is Xiou Ge. I’m a first year PhD student in Electrical Engineering. I’m from Harbin, China. After completing my middle school education in China, I was awarded a scholarship and spend my high school years in Singapore. I obtained my bachelor’s degree with highest honors and the master’s degree, both in Electrical Engineering from the University of Illinois at Urbana-Champaign. Previously, I interned at Apple in Cupertino and worked on EDA tool development, and IBM T.J. Watson Research Center in Yorktown Heights and did computational creativity research. My current research interests include artificial intelligence, machine learning, and computer vision.

What is your impression about MCL and USC?

Everyone I met in MCL has been very nice and willing to help each other. The atmosphere is very relaxed and people interact with each other just like family members. Yet everybody works very hard and I can feel the energy which motivates me to work harder. I think MCL has the conducive environment for me to become a successful graduate student. USC offers a very different college experience from my previous one. Located in the middle of downtown LA, the school offers plenty of opportunities for students to experience and learn from the outside world. Collaborations with researchers from other institutions and other parts of the world are frequent and convenient. The school also makes substantial investment in education and allows students to learn from and do research with world-class faculty and experts in different research fields. 

What is your future expectation and plan in [...]

By |October 13th, 2019|News|Comments Off on Welcome New MCL Member Xiou Ge|