Episode 69

Build a Tiny GPT from Scratch, Part 1

Data, tokenizer and the model architecture.

• Dataset & tokenizer
• Batches of context
• Model definition
• Parameter count

Notes for this episode are coming soon.