Building Jarvis: JPMC’s Agent Building Assembly Line
Summary
JPMorgan Chase introduced 'Jarvis,' an agent-building assembly line, which fundamentally shifts the process of developing complex AI agents. The system standardizes agent creation, reducing development time from months to minutes. Jarvis is grounded on three principles: speed, standardization, and governance. It manages the entire lifecycle—from Software Development Life Cycle (SDLC) to Agentic Development Life Cycle (ADLC) and Production Development Life Cycle (PDLC)—by making all components (skills, agents, UIs) composable, while maintaining rigorous governance through continuous offline and online evaluations.
Key takeaways
-
From Months to Minutes
The team demonstrated that the time required to build a complex agent has been drastically reduced from months to minutes by implementing a standardized assembly line approach.
-
The Assembly Line Model
2:17
Jarvis treats agent development not as custom software, but as a composable assembly line, ensuring standardization and speed across the entire development process.
-
Three Pillars of Jarvis
4:18
The assembly line is built on three principles: 1) Speed (concept to production in days), 2) Standardization (one common framework), and 3) Evaluations and Governance (incorporating governance early).
-
Continuous Trust and Governance
Trust is maintained through two continuous disciplines: Offline evals (using positive and negative test cases) and Online evals (real-time monitoring for hallucination and relevancy checks).
-
The Human Core
Human Subject Matter Experts (SMEs) remain central. They are promoted to 'agent team leads' to provide crucial orchestration and collaboration skills, ensuring the team works cohesively.
More digests on Agentic Development
Technical details
-
Agent Development Life Cycles
310s
The system covers three distinct life cycles: Software Development Life Cycle (SDLC), Agentic Development Life Cycle (ADLC), and Production Development Life Cycle (PDLC).
-
System Architecture and Composability
445s
The design emphasizes composability, allowing skills, agents, and UIs to be replaced or swapped out (e.g., switching between private/public cloud or different deep agent stacks).
-
Enterprise Integration and Security
310s
Implementation requires an enterprise-level harness that addresses security, memory management (long/short memory), inter-agent communication, and sandboxing.
-
Evaluation Frameworks
Evaluation includes: 1) Offline evals (defining positive and negative boundaries); 2) Online evals (measuring hallucination rate and relevancy check in real-time); 3) Ongoing Performance Monitoring (OPM).
-
Skill Abstraction
The system differentiates between reusable 'engineering skills' (the common pipeline) and unique 'business skills' (the domain-specific differentiator provided by human expertise).
Mentioned resources
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.