Schedule



Lecture Date Topic Lecturer Materials Assignments
Lec. 1 Mon, Aug. 25 Introduction
Introduction
    Bernadette
ps1 out (filtering)
Lec. 2 Wed, Aug. 27 Filtering
Convolution and cross-correlation
Edge detection
Nonlinear filtering
    Bernadette
Sec. 1 Fri, Aug. 29 Linear algebra and filtering
    Seung and Sydney
Mon, Sep 1 No class - Labor Day
Lec. 3 Wed, Sep. 3 Image pyramids
More filtering
Gaussian pyramid
Laplacian pyramid
Image statistics (optional)
    Bernadette
Sec. 2 Fri, Sep. 5 Fourier Transform
    Apu and Sydney
Lec. 4 Mon, Sep. 8 Frequency
Image bases
Fourier transform
    Bernadette
Lec. 5 Wed, Sep. 10 Image formation
Camera models
Projection
Plenoptic function
    Bernadette
  • Slides
  • Reminder: recording can be found in the lecture capture system.
ps 1 due
ps2 out (frequency)
Sec. 3 Fri, Sep. 12 Pyramids and Fourier Transform
    Apu and Sydney
Lec. 6 Mon, Sep. 15 Multi-view geometry
Epipolar geometry
Stereo vision
Homographies
    Bernadette
  • Slides
  • Reminder: recording can be found in the lecture capture system.
Lec. 7 Wed, Sep. 17 Fitting geometric models
Finding correspondences
Fitting a homography
RANSAC
Triangulation
    Bernadette
  • Slides
  • Reminder: recording can be found in the lecture capture system.
ps2 due
ps3 out (panorama stiching)
Sec. 4 Fri, Sep. 19 Geometry
    Yen-Cheng and Drew
Lec. 8 Mon, Sep. 22 Structure from motion
Structure from motion
Multi-view stereo
Visual SLAM
    Bernadette
Lec. 9 Wed, Sep. 24 Motion estimation
Optical flow
Aperture problem
Keypoints
    Bernadette
  • Slides
  • Reminder: recording can be found in the lecture capture system.
Proposal info out
Sec. 5 Fri, Sep. 26 Project office hours
    Apu and Sydney
    Lec. 10 Mon, Sep. 29 Machine learning
    Nearest neighbor
    Linear regression
    Overfitting
      Jun
    Lec. 11 Wed, Oct. 1 Linear classifiers
    Logistic regression
    Stochastic gradient descent
      Jun
    • Slides
    • Reminder: recording can be found in the lecture capture system.
    ps3 due
    ps4 out (intro to ML)
    Sec. 6 Fri, Oct. 3 Machine learning tutorial
      Yen-Cheng and Sydney
    Lec. 12 Mon, Oct. 6 Neural networks
    Nonlinearities
    Network structure
    Regularization
      Bernadette
    • Slides
    • Reminder: recording can be found in the lecture capture system.
    Lec. 13 Wed, Oct. 8 Optimization
    Computation graphs
    Backpropagation
    Momentum
      Bernadette
    ps 4 due
    ps 5 out (backprop)
    Sec. 7 Fri, Oct. 10 Backpropagation
      Yen-Cheng and Sydney
    Mon, Oct 13 No class - Fall Break
    Lec. 14 Wed, Oct. 15 Convolutional networks
    Convolution layers
    Pooling
    Normalization
      Bernadette
    ps5 due
    ps6 out (scene recognition)
    Sec. 8 Fri, Oct. 17 PyTorch tutorial
      Sydney and Apu
    Lec. 15 Mon, Oct. 20 Object detection
    Sliding window
    Region-based CNNs
    Instance segmentation
      Bernadette
    Lec. 16 Wed, Oct. 22 Representation learning and language
    Autoencoders
    Self-supervision
    Contrastive learning
    Vision and language
      Bernadette
    ps6 due
    ps7 out (image synthesis)
    Sec. 9 Fri, Oct. 24 Project office hours
      Apu and Aditya
      Lec. 17 Mon, Oct. 27 Image Synthesis with GANs
      Texture synthesis
      GANs
      Conditional GANs
        Bernadette
      Lec. 18 Wed, Oct. 29 Transformer
        Bernadette

      Proposal due
      ps8 out (diffusion models)
      Sec. 10 Fri, Oct. 31 GANs
        Apu and Drew
      Lec. 19 Mon, Nov. 4 Diffusion Models (I)
      Diffusion models for image synthesis
      DDPM
      Latent diffusion models
      Applications
        Bernadette
      Lec. 20 Wed, Nov. 5 VAEs and Diffusion Models (II)
        Bernadette
      ps7 due
      Sec. 11 Fri, Nov. 7 Exam reviews
        Yen-Cheng, Sydney, Apu, Drew, Aditya
      Lec. 21 Mon, Nov. 10 Take home exam
          Wed, Nov. 12 No class
          Sec. 12 Fri, Nov. 14 ARC Tutorial (11:30 - 12:30 only)
              Lec. 22 Mon, Nov. 17 Video and recurrent networks
              3D convolutions
              Recurrent networks
              LSTMs
                Bernadette
              ps8 due
              Lec. 23 Wed, Nov. 19 Bias + image forensics
              Fake images
              Anomaly detection
              Supervised detection
              Datasets
              Algorithmic fairness
                Bernadette
              projet guidelines
              Sec. 13 Fri, Nov. 21 Project office hours
                Apu and Aditya
                Lec. 24 Mon, Nov. 24 Light, shading, and color
                Shape from shading
                Intrinsic images
                Color perception
                Neural radiance fields
                  Bernadette
                Wed, Nov 26 No class - Thanksgiving
                Fri, Nov 28 No class - Thanksgiving
                Lec. 25 Mon, Dec. 1 Vision in Robotics
                  Bernadette
                  Lec. 26 Wed, Dec. 3 Generative AI
                    Jun
                    Lec. 27 Fri, Dec. 5 Final presentations
                        Lec. 28 Mon, Dec 8 Final presentations


                            Staff & Office Hours



                            Office Hours

                            Day Time Name Location
                            Monday 12:30pm-1:30pm GSI/IA EECS 1222, Zoom
                            Tuesday 6:30pm - 7:30pm GSI/IA EECS 1222
                            Thursday 2:30pm - 3:30pm Bernadette Bucher FRB 2240
                            1:30pm-2:30pm GSIs/IAs FRB 3310, Zoom

                            Office hours will be offered in person.