In this homework, you will learn how to tokenize data. Then, you will implement a basic Transformer architecture and experiment with training. Finally, you will use perplexity to evaluate an open-source model available in the HuggingFace library.

If you wish to use late days, please fill out this form.