AI Native Dev

Edith Harbaugh: Code Is Cheap. The Last Mile Isn't.

Published 2026-11-10 · Duration 49:30

Summary

The discussion explores the massive acceleration of software delivery, noting the shift from quarterly releases to organizations deploying tens of thousands of changes daily (e.g., Anthropic's jump from 2,500 to 30,000 changes/day). The core argument is that while automated delivery and autonomous rollback are necessary, the bottleneck has moved to the 'last mile'—the ability to ensure a feature has a productive, positive impact on the end-user or business metrics, which requires human judgment and careful definition of success for AI agents.

Download summary

Key takeaways

  1. The Pace of Modern Delivery 1:50

    The current pace of application delivery requires workflows far beyond traditional methods. The ability to roll back a deployment within seconds is necessary, but insufficient, given the volume of changes.

  2. Autonomous Rollback is Critical 2:20

    For high-volume deployments, autonomous rollback mechanisms are needed, as human intervention in a 2:00 a.m. incident is too slow. AI is positioned as key to achieving this autonomous fail-safe.

  3. The Bottleneck Shifts to the Last Mile 48:22

    As code generation becomes cheap (e.g., using LLMs), the primary bottleneck shifts from writing code or even code review to determining if the implemented feature has a genuinely productive impact on the end-user or business metrics.

  4. Defining Success for Agents

    AI agents cannot understand abstract concepts like 'good' or 'bad.' To succeed, work must be decomposed into smaller, atomic units, and the desired outcome (success criteria) must be explicitly defined and measurable for the agent.

More digests on Software Delivery

Technical details

  • Feature Flags and Release Management 1642s

    Feature flags are a technique (not proprietary to LaunchDarkly) used to manage behavior and allow for gradual, controlled rollouts. A 'good' feature flag is one that is fully understood by the team, preventing 'stale flags' that can cause unexpected issues.

  • Autonomous Rollback Systems 140s

    Advanced systems can monitor telemetry (error rate, operational metrics, ticket uptick) and automatically trigger a rollback without human intervention. This capability is crucial for high-velocity CI/CD.

  • Agentic Coding and Workflow

    The 'one-shot coding agent' dream is limited. Effective agent use requires decomposing complex tasks into smaller, atomic units and providing explicit guardrails and success metrics. The engineer's role shifts toward architecting and reviewing the agent's work (e.g., reviewing PRs generated by a fleet of agents).

  • Runtime Controls for AI Agents

    The concept of 'Agent Control' involves applying feature flag principles to AI models themselves. This allows developers to control an agent's behavior at runtime by switching models or adjusting prompts (e.g., if a chatbot starts generating excessive customer complaints or burning too many tokens).

Mentioned resources

  • LaunchDarkly (Product/Company)
  • Tessl (Product/Service)

Channel & topics

Watch on YouTube · Back to latest

This independent, AI-assisted summary is provided for commentary and informational purposes. It may contain errors or omit important context. Please watch the original video for the creator's complete presentation. Video, thumbnail, and related copyrights belong to their respective owners.