Episode 40

Multi-Layer Perceptrons & Activation Functions

Stacking neurons into layers, and why non-linearity matters.

• Hidden layers
• ReLU / sigmoid / tanh
• Softmax
• Universal approximation idea

Notes for this episode are coming soon.