Stanford CME295 Transformers & LLMs | Autumn 2026 | Lecture 5 - LLM Systems
Learn how to scale LLMs by mastering FlashAttention, ZeRO, and advanced parallelism techniques. We cover GPU memory bottlenecks, Paged Attention, and Speculative Decoding for high-speed inference.
Read article