Fall 2024 • CSCI8945 Advanced Representation Learning • Schedule
Date | Lecture | Info |
---|---|---|
Introduction and background | ||
8/14 | Introduction and overview [slides] | |
8/15 | Data and dimensionality [slides] [whiteboard] | References:
|
Data representation space and structures | ||
8/20 | Dimension reduction, metric learning, PCA, MDS [Linear transforms and basis] [PCA and MDS] | |
8/21 | Deep learning workflow and useful programming tools [Notebook (zip)] | |
8/22 | Structures in data spaces, manifolds, subspaces, sparse coding [slides] | |
Visual representations | ||
8/27 | Pixels, 3D points, and cameras [slides] | |
8/28 | Image operations | |
8/29 | Semantics | |
9/3 | Videos | |
9/4 | Project and research discussion, how to do research? | |
9/5 | Image subspaces and manipulations | |
Language representations | ||
9/10 | Representing words and sentences | |
9/11 | Project and research discussion, how to read a paper? | |
9/12 | Language model pretraining | |
9/17 | NLP tasks | |
9/18 | Project and research discussion, how to write a paper? | |
9/19 | Zero-shot and in-context learning | |
Audio representations | ||
9/24 | Representing sound | |
9/25 | Project and research discussion | |
9/26 | Audio generation and editing | |
Graphs | ||
10/1 | Graphs and neural networks | |
10/2 | Project and research discussion | |
10/3 | GNN applications | |
Multi-modal representations | ||
10/8 | Midterm | |
10/9 | Project and research discussion | |
10/10 | Overview of multi-modal learning | |
10/15 | Multimodal representation alignment | |
10/16 | Project and research discussion | |
10/17 | Multimodal reasoning | |
Advanced Topics -- Implicit representations | ||
10/22 | Implicit Neural Reprsentations | References: |
10/23 | Project and research discussion | |
10/24 | Deep implicit layers | References: |
Advanced Topics -- Meta-learning and domain adaptation | ||
10/29 | Meta-learning | References: |
10/30 | Project and research discussion | |
10/31 | Domain adaptation, transfer learning, life-long learning | References: |
Advanced Topics -- Unsupervised and self-supervised learning | ||
11/5 | Unsupervised learning and discovery | References: |
11/6 | Project and research discussion | |
11/7 | Self-supervised learning | References: |
Advanced Topics -- Beyond perception | ||
11/12 | AI Agent | |
11/13 | Project and research discussion | |
11/14 | Embodied intelligence | References: |
Final project presentations | ||
11/19 | Class review and discussion | |
11/20 | Group presentations 1 | References:
|
11/21 | Group presentations 2 | References:
|
11/26 | Group presentations 3 | References:
|
11/27 | No class (Thanksgiving) | |
11/28 | No class (Thanksgiving) | |
12/3 | No class (Friday Class Schedule) |