Stanford Online

Stanford CS329Z Introduction — What Are Agentic Systems?

Published 2026-11-09 · Duration 1:09:36

Summary

This lecture provides a comprehensive introduction to agentic AI systems, defining them as complex systems built upon Large Language Models (LLMs) that can perceive, reason, plan, and take actions in an environment. The architecture of an agent is detailed, comprising an LLM core, planning/reasoning modules, memory systems (episodic, semantic, procedural), and external tools. The discussion contrasts traditional fixed-step workflows with flexible, self-directing agents, emphasizing that while LLMs show rapid capability improvements, key challenges remain in reliability, safety, and robust evaluation.

Download summary

Key takeaways

  1. Agent Architecture Components 23:20

    An agent is conceptually composed of an LLM core, planning/reasoning capabilities (e.g., Chain of Thought), memory (episodic, semantic, procedural), tool use, and an environment for action/observation. The system must manage these components in a continuous loop.

  2. Workflow vs. Agentic Systems 31:00

    A 'workflow' follows a fixed, predefined sequence of steps (e.g., a script), whereas an 'agent' uses the LLM to autonomously decide the next steps, making it more flexible and responsible.

  3. The Agent Loop (ReAct) 25:39

    The ReAct framework formalizes the agent loop: the model must cycle through thinking (reasoning), taking an action, observing the result, and then using that observation to inform the next thought, enabling self-correction.

  4. Key Challenges in Agent Development 33:30

    Despite impressive capabilities, agents face critical challenges, including reliability (gap between capability and reliability), safety (e.g., unauthorized actions), and privacy (handling sensitive personal information).

More digests on Agentic AI

Technical details

  • Agent Memory Types 1352s

    Memory systems are crucial for long-horizon tasks. Types include: Episodic (storing all raw logs/events), Semantic (synthesizing key events into summaries), and Procedural (storing abstract skills or procedures, like in a skill library).

  • Tool Use Protocols 1630s

    Tool use allows agents to interact with external APIs. Early methods included Toolformer, while Gorilla demonstrated training LLMs on a vast set of APIs (over 1,600) to enable complex, factual generation by delegating tasks to external tools.

  • Model Context Protocol (MCP) 1821s

    MCP is presented as a standard protocol designed to facilitate scalable connections between diverse AI applications (e.g., IDEs, code editors) and various data sources/tools (e.g., databases, Google Drive).

  • Advanced Reasoning Techniques 1579s

    Techniques like Chain of Thought (CoT) and Reflexion improve reasoning. CoT prompts the model to reason step-by-step, while Reflexion allows the agent to self-reflect on its own trajectory using natural language feedback, significantly reducing errors and hallucination.

Mentioned resources

Channel & topics

Watch on YouTube · Back to latest

This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.