Assignment #2 - Implementing a Transformer from scratch and doing inference with the HuggingFace API
Due Date: 02:00 PM, Tuesday, Oct 01
Download [questions] [starter code] [submission template]
In this homework, you will learn how to tokenize data, Then you will implement a basic Transformer architecture and experiment with training. Finally, you will experiment with generation and perplexity evaluation using an open-source model available in the HuggingFace library.