Episode 70

Build a Tiny GPT from Scratch, Part 2

Training, learning-rate schedules and generating text.

• Training loop
• LR schedule
• Sampling: temperature & top-k
• Evaluating loss

Notes for this episode are coming soon.