Stanford CME 295 Transformers & LLMs | Fall 2026 | Lecture 3 - LLM training
The lecture details the full LLM lifecycle, covering pre-training (next token prediction), SFT (behavior alignment), and advanced alignment techniques like DPO and RLHF. Key engineering concepts include LoRA for parameter efficiency and RoPE interpolation for long context handling.
Read article