What Happens When Engineers Stop Reading Their Own Code?
Summary
The discussion explores the evolution of software development into 'AI software factories,' where AI agents automate core engineering tasks like model routing, code review, and issue management. Key architectural patterns include the AI Gateway, which manages multi-cloud, multi-regional model calls and aggregates rate limits. Furthermore, advanced agent stacks (like Cloudflare's) are being built on frameworks such as Flue, enabling sophisticated, context-aware code reviewers and internal office suites (Cloudflare OS). The trend suggests a shift in engineering value from writing code to understanding high-level concepts and system architecture (the 'scholarly engineer').
Key takeaways
-
AI Gateways manage complex model routing and rate limits.
1:48
AI Gateways (used by Miro) are necessary to handle model calling across multiple regions and clouds (e.g., AWS, Azure, GCP, Anthropic Direct). They aggregate rate limits and define business logic, such as enforcing EU-only models for specific customers, making the model call layer highly self-contained and routable.
-
Agent-powered code review focuses on human behavior, not just code fixes.
2:20
Advanced internal AI code reviewers (built on Flue) analyze not only suggested fixes but also the historical data on how many Pull Requests (PRs) are opened, merged, and closed. This feedback loop helps the system understand what is 'important to people,' moving beyond simple syntax checks.
-
Agent stacks are becoming full-featured, open-source office suites.
3:30
Cloudflare developed Cloudflare OS, an open-source agent office suite that allows users to build applications, dashboards, and blueprints. This system is built on the Agents SDK and Flue, enabling agents to interact with specific applications within the internal network.
-
The value shifts to conceptual understanding ('Scholarly Engineer').
11:10
As LLMs generate vast amounts of code, the skill set is moving up the abstraction layer. The 'scholarly engineer' is defined as someone who understands the underlying concepts and ideas of an industry, rather than needing to read every line of code.
More digests on AI Engineering
Technical details
-
AI Gateway Architecture
108s
A centralized layer responsible for model calling, handling self-hosted and external LLM calls, and managing complex routing decisions across multi-regional and multi-cloud providers (e.g., AWS, Azure, GCP).
-
Agent Frameworks and Control Flow
220s
Flue is a JavaScript framework (from the makers of Astro) designed for building agent control flow. It allows applications to deploy anywhere JavaScript runs (Node.js, Vercel, Cloudflare Workers), providing advanced capabilities like lazy loading of tools.
-
Code Review Automation
140s
Miro uses Easel bot, which reads production logs overnight to proactively open fix PRs. Cloudflare uses an internal AI reviewer built on Flue that analyzes PRs based on company context and human approval/rejection patterns.
-
Security and Compliance
350s
Oplane is a security check tool for PRs that provides a comprehensive review of compliance, secret exposure, and data redaction recommendations, ensuring merges are secure.
Mentioned resources
- Cloudflare
- Miro
- Flue
- Astro
- Cloudflare OS
- Oplane
Channel & topics
Watch on YouTube · Back to latest
This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.