prefill vs decode, TTFT, ITL, throughput, goodput
Used in: Day 1 · Step 1 Day 1 · Step 3 (rewatch)
Every video, in the order the course plays them. Each one plays inside its step; here you can find one again.
prefill vs decode, TTFT, ITL, throughput, goodput
Used in: Day 1 · Step 1 Day 1 · Step 3 (rewatch)
what an inference server does, containers, key flags
Used in: Day 2 · Step 1 Day 9 · Step 3 (rewatch)
continuous batching, chunked prefill, speculation
Used in: Day 3 · Step 1 Day 9 · Step 2 (rewatch)
roofline, decode ceiling = bandwidth ÷ bytes
Used in: Day 3 · Step 1 Day 4 · Step 1 (rewatch)
serving layers, capacity modes, maturity curve
Used in: Day 6 · Step 2 Day 10 · Step 1 (rewatch)
4-bit base + adapter on your own box
Used in: Day 7 · Step 2 Day 8 · Step 1 (optional)
training loop, 16 bytes/param, ZeRO/FSDP, when full FT pays
Used in: Day 11 · Step 1
Parameter-Efficient Fine-Tuning
LoRA maths, QLoRA, DoRA, adapters, IA³, multi-LoRA
Used in: Day 11 · Step 1
Direct Preference Optimization
the DPO loss, a worked step, pairs from product data
Used in: Day 12 · Step 2