Stanford Online

Multi-Agent Systems: When More Agents Help or Hurt | Stanford CS329Z Lecture 8 with Michael Ryan

Published 2026-11-16 · Duration 1:18:56

Summary

This lecture provides a comprehensive overview of Multi-Agent Systems (MAS), detailing when and how they should be used compared to single-agent architectures. MAS are defined as collections of multiple agents solving a shared task, offering benefits like parallel execution and specialization. However, they introduce significant complexity, including coordination overhead, information loss, and failure modes (e.g., conformity, incompatible goals). Successful implementation requires careful selection of the orchestration pattern (Independent, Centralized, Decentralized, or Hybrid) and robust coordination infrastructure (Task Ledgers, Shared Memory, or Work Tree Isolation).

Download summary

Key takeaways

  1. MAS vs. Single Agent Systems 16:43

    Single-agent systems are preferred when tasks are highly dependent and sequential. Multi-agent systems are best when subtasks can be parallelized and information can be divided into focused contexts. The recommendation is to start with a strong single-agent baseline and measure the value of adding complexity.

  2. MAS Cost and Performance Trade-offs 25:32

    MAS typically cost more than single-agent systems due to messaging and context reloading. While complex hybrid systems can achieve high performance, this represents a significant trade-off between cost and capability.

  3. Coordination Failure Modes 38:20

    MAS can fail due to system design issues, inter-agent misalignment (e.g., expectation mismatch, commitment failure), or task verification errors. Behavioral issues include 'conformity' (agents behaving similarly) and 'incompatible goals' (agents having conflicting objectives).

More digests on Multi-Agent Systems

Technical details

  • Orchestration Patterns 1650s

    Four primary patterns govern MAS: **Independent** (agents work in parallel with no communication, requiring final aggregation); **Centralized** (an orchestrator divides tasks and maintains control flow); **Decentralized Swarm** (agents pull work from a shared state/task ledger and communicate via an all-to-all message board); and **Hybrid** (combines global oversight with local, direct message passing between workers).

  • Coordination Infrastructure 1950s

    Mechanisms for managing interdependent work include: **Task Ledger** (an explicit, to-do list for tracking tasks and progress, supporting recovery); **Shared Memory** (a global memory system that uses multiple knowledge graphs—Insight, Query, and Interaction—to maintain retrievable context); and **Work Tree Isolation** (using separate workspaces, similar to Git branches, to prevent interference and manage merge conflicts).

  • Communication Protocols 1200s

    Communication can occur via **Handoff** (transferring full conversation history and control to a new specialist agent) or **Agent as Tool** (where an orchestrator calls a colleague agent as a specialized tool). For large swarms, communication can be managed by **Message Boards** (allowing all agents to write to and subscribe from a shared message pool) or formalized via the **Agent-to-Agent Protocol** (a structured protocol defining agent capabilities via 'agent cards' for traceable, push-notification communication).

Mentioned resources

  • Agent-to-Agent Protocol (Protocol)
  • AutoGen (Framework)
  • MetaGPT (Paper/Architecture)

Channel & topics

Watch on YouTube · Back to latest

This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.