Faculty Candidate Seminar
AI Seminar

Sight and Sound

Andrew Owens

Postdoctoral Scholar
UC Berkeley
Wednesday, March 20, 2019
09:00am - 10:00am
1005 EECS

Add to Google Calendar

About the Event

Today's visual learning methods require extensive supervision from human teachers. A major goal of the research community has been to remove the need for this supervision by creating methods that, instead, teach themselves by analyzing unlabeled images. In this talk, I will argue that this focus on learning from vision alone, without the use of other sensory modalities, is making the perception problem unnecessarily difficult. To demonstrate this, I will present unsupervised computer vision methods for learning from co-occurring audio and visual signals. First, I will show that visual models of materials and objects emerge from predicting soundtracks for silent videos. Then, I will present a multimodal video representation that fuses information from both the visual and audio components of a video signal when solving tasks. Finally, I will show applications for these methods in object recognition and audio-visual source separation.


Andrew Owens is a postdoctoral scholar at UC Berkeley. He received a Ph.D. in Electrical Engineering and Computer Science from MIT in 2016. He is a recipient of a Computer Vision and Pattern Recognition (CVPR) Best Paper Honorable Mention Award, a Microsoft Research Ph.D. Fellowship, and an NDSEG Graduate Fellowship.

Additional Information

Contact: Linda Scovel


Sponsor(s): ECE

Faculty Sponsor: Jason Corso

Open to: UM Only

Slides/PDF: View