Episode 75

LoRA & Adapters (PEFT)

Fine-tuning a fraction of the parameters for a fraction of the cost.

• Why full fine-tuning is expensive
• Low-rank idea
• LoRA with PEFT
• Merging adapters

Notes for this episode are coming soon.