Episode 42

Gradient Descent & Optimizers

SGD, mini-batches, momentum and Adam.

• Batch vs mini-batch vs SGD
• Momentum
• Adam
• Learning rate choice

Notes for this episode are coming soon.