-
Lecture
08/27/2024
Tuesday
Building blocks of modern LLMs
-
Assignment
08/27/2024
Tuesday
Assignment #1 released
-
Lecture
08/29/2024
Thursday
Transformer architecture and pre-training learning objectives
-
Lecture
09/03/2024
Tuesday
Pre-training data curation and tokenization
-
Lecture
09/05/2024
Thursday
Architecture advancements since 2019: mixture-of-experts, layer norms, relative attention, RoPE embeddings
-
Due
09/05/2024
14:00
Thursday
Assignment #1 due
-
Lecture
09/10/2024
Tuesday
Automatic evaluation of LLMs
-
Lecture
09/12/2024
Thursday
Task-oriented finetuning and parameter-efficient tuning methods
-
Assignment
09/12/2024
Thursday
Assignment #2 released
-
Lecture
09/17/2024
Tuesday
Instruction tuning and chain-of-thought reasoning
-
Lecture
09/19/2024
Thursday
Alignment, RLHF, jail-breaking
-
Lecture
09/24/2024
Tuesday
Retrieval-augmented generation
-
Due
09/24/2024
14:00
Tuesday
Assignment #2 due
-
Lecture
09/26/2024
Thursday
-
Assignment
09/26/2024
Thursday
Assignment #3 released
-
Lecture
10/01/2024
Tuesday
-
Lecture
10/03/2024
Thursday
Popular benchmarks and their brittleness
-
Lecture
10/08/2024
Tuesday
-
Due
10/08/2024
14:00
Tuesday
Assignment #3 due
-
Lecture
10/10/2024
Thursday
-
10/15/2024
00:00
Tuesday
Fall break - no class
-
10/17/2024
00:00
Thursday
Fall break - no class
-
Exam
10/22/2024
00:00
Tuesday
-
Assignment
10/22/2024
Tuesday
Assignment #4 released
-
Lecture
10/24/2024
Thursday
-
Lecture
10/29/2024
Tuesday
-
Lecture
10/31/2024
Thursday
Optimization and parallel training
-
Assignment
10/31/2024
Thursday
Assignment #5 released
-
Due
10/31/2024
14:00
Thursday
Assignment #4 due
-
Lecture
11/05/2024
Tuesday
-
Lecture
11/07/2024
Thursday
-
Lecture
11/12/2024
Tuesday
Flash attention and sparse models
-
Lecture
11/14/2024
Thursday
-
Assignment
11/14/2024
Thursday
Assignment #6 released
-
Due
11/14/2024
14:00
Thursday
Assignment #5 due
-
Lecture
11/19/2024
Tuesday
-
Lecture
11/21/2024
Thursday
Synthetic data generation, self-play, models teaching models
-
Lecture
11/26/2024
Tuesday
-
11/28/2024
00:00
Thursday
Thanksgiving - no class
-
Lecture
12/03/2024
Tuesday
-
Lecture
12/05/2024
Thursday
-
Due
12/05/2024
14:00
Thursday
Assignment #6 due