Carnegie Mellon University
Large Language Models: Methods and Applications
Fall 2024

Main Navigation

  • Home
  • Syllabus
  • Schedule
  • Assignments
  • Useful Links

Assignments

The homeworks will be made available here. Click on each homework page for additional info.

  • Assignment #1 - Preparing and Exploring Pre-Training Data  
  • Assignment #2 - Implementing a Transformer from scratch and doing inference with the HuggingFace API  
  • Assignment #3 - Retrieval-augmented generation and tool-use  
  • Assignment #4 - Comparing models and mitigating bias  
  • Assignment #5 - Improving training efficiency  
  • Assignment #6 - Mini-project

5000 Forbes Ave
Pittsburgh, PA 15213

  • lti.cs.cmu.edu/