Build A Reasoning Model From Scratch 4: Inference Scaling 1 (Temperature, Top-p, Self-Consistency)
This deep dive explores inference-time scaling techniques for LLMs, covering Chain-of-Thought prompting, Temperature Scaling, Top-p filtering, and Self-Consistency. Learn how to boost model accuracy by managing compute trade-offs.
Read article