Stanford CME295 Transformers & LLMs | Autumn 2026 | Lecture 7 - LLM Evaluation
We dive into LLM evaluation, covering metrics like Pass@k and LLM-as-a-Judge. We also analyze the failure modes of AI agents and the risks of 'Benchmaxxing.'
Read articleTopic
Independent digests of CME295 Syllabus talks — key takeaways, technical details, and related reading.
Suggested route
Move from earlier context through the available material to the newest signals. This route is a reading aid, not a difficulty ranking.
We dive into LLM evaluation, covering metrics like Pass@k and LLM-as-a-Judge. We also analyze the failure modes of AI agents and the risks of 'Benchmaxxing.'
Read article