Don't build more AI agents until you watch this

The video argues that AI agents become more effective not by continuously adding tools but by focusing on real workflows and maintaining a carefully managed “harness” of tools, prompts, and processes that evolve alongside AI models and business needs. It emphasizes the critical importance of ongoing maintenance to prevent agents from producing harmful outputs, advocating for regular evaluation and pruning of capabilities to ensure reliability and value.

The video challenges the common belief that AI agents improve by continuously adding more tools, integrations, and capabilities. Using Vercel’s experience as a case study, it highlights that their AI agent actually became more effective after removing 80% of its tools. Instead of piling on features, Vercel carefully studied the workflow of their best sales representative and built the agent around the real, observed process, focusing on filtering messages, qualifying leads, researching companies, drafting responses, and routing support queries. Importantly, a human still reviewed the agent’s work, emphasizing that the goal was to automate repeatable tasks rather than fully replace human judgment.

A key insight from the video is that AI agents require ongoing maintenance, not just initial construction. Unlike traditional software, agents can break not only when the model degrades but also when the underlying AI model improves. Improvements in the model can render existing workflows, rules, and tool integrations obsolete or even harmful, creating a unique challenge for maintaining the “harness”—the system of tools, prompts, permissions, and workflows that surround and support the agent. This harness must evolve alongside both the AI model and the changing business environment to keep the agent reliable and useful.

The video stresses that agents inherit all the imperfections of the systems they interact with, such as outdated wikis, stale processes, and obsolete documentation. These issues, common in many organizations, become far more problematic when an AI agent relies on them to produce work autonomously. The analogy of a sailboat is used to illustrate that agents, like complex machines, require continuous upkeep to remain functional and safe. This maintenance mindset is crucial for preventing agents from producing misleading or harmful outputs as both the external environment and internal AI capabilities shift.

The speaker also highlights the strategic importance of the “harness” in the AI ecosystem, pointing to companies like OpenAI and Anthropic that invest heavily in evolving their agent workbenches. These harnesses include tools like terminals, browsers, plugins, memory, and approval systems that enable agents to perform complex tasks safely and effectively. The interplay between improving models and evolving harnesses creates a positive feedback loop, accelerating agent capabilities while raising the bar for maintenance and operational discipline across the industry.

Finally, the video offers practical advice for anyone deploying AI agents: regularly evaluate what the agent reads, what it can do, its assigned tasks, the evidence it provides for its outputs, and its overall value to the organization. It emphasizes that maintenance involves not only adding new capabilities but also pruning unnecessary or harmful elements to keep the system healthy. The speaker recommends reading Stewart Brand’s book “Maintenance of Everything” to better understand the philosophy and practicalities of maintaining complex technical systems, underscoring that the future of AI agents lies in well-maintained, adaptable systems rather than unchecked expansion.