From pilots to powerhouses: AI agents take over the enterprise—but governance lags behind

Lenny's Podcast

The gist

AI agents are powering unprecedented productivity gains across enterprises—but most organizations are stumbling over governance and scaling roadblocks as the agentic era arrives faster than they can adapt.

What to know

  • Companies like Atlan, Block, and Zuora have embedded fleets of specialized AI agents, slashing multi-hour workflows to minutes and saving employees 8–10 hours weekly.
  • Despite vertical AI platforms like Harvey and Casca automating up to 90% of manual work and boosting productivity by 50–80%, only 21% of enterprises have mature governance for agentic AI.
  • Most organizations remain stuck in pilot mode due to fragmented data, legacy security models, and cultural inertia—meaning the full promise of AI-native operations is still out of reach for the majority.

AI-Native Workforces Emerge

Companies like Atlan and Block are restructuring roles and culture so deeply that employees now manage teams of specialized AI agents, slashing workflow times and demanding new hiring standards centered on AI fluency.

The journey from AI experimentation to becoming an AI-native enterprise is exemplified by companies like Atlan and Block, which moved beyond treating AI as a mere tool to embedding autonomous agents deeply into workflows, roles, and organizational structures. Atlan’s four-phase transformation included forming an elite AI taskforce, shifting culture through initiatives like an AI productivity challenge, and redesigning roles so that a single customer success manager could be supported by up to nine specialized AI agents, resulting in dramatic productivity gains such as reducing multi-hour processes to under an hour. Similarly, under CTO Dhanji R. Prasanna’s leadership, Block developed Goose, an internal open-source AI agent that saves employees 8 to 10 hours weekly, with leadership’s daily use of AI tools playing a critical role in driving adoption across both technical and non-technical teams.

Being truly AI-native requires reimagining workflows from first principles rather than simply layering AI onto existing processes. As Prukalpa Sankar articulated, AI must become fundamental—woven into the fabric of thinking and operations—not just the primary solution. This shift is reflected in organizational redesigns that replace traditional role-based team structures with end-to-end process ownership, enabling operators to combine judgment, execution, and system design into a single accountable role. Such transformations have led to measurable productivity improvements, with cycle times for workflows like campaign launches dropping by 40–70% while maintaining or improving quality, as seen in marketing teams that now ship more experiments and learn faster than competitors.

The cultural and organizational shifts underpinning AI-native transformation are as crucial as the technology itself, often requiring decades to fully rewire workflows and roles. Early AI deployments are best understood as 'agentic workflows' where AI autonomously handles task-level functions, augmenting rather than replacing human jobs. This human-AI collaboration has revitalized professions like radiology, where AI tools have made the work more engaging. Moreover, enterprises recognize that embedding AI demands talent transformation and AI fluency, with hiring practices evolving to prioritize AI curiosity and skills—as Atlan demonstrated by instituting hiring veto power for candidates lacking AI aptitude and requiring live AI prompting during interviews.

The shift from prompt-based AI to autonomous institutional AI marks a pivotal evolution, enabling AI systems to proactively identify risks and opportunities without human prompting. This continuous, unprompted monitoring creates new workflows and interfaces, allowing AI to flag issues before humans even notice them. Companies like Mindbreeze illustrate this transition by embedding AI-driven contextual workflows that augment employee capabilities without disrupting compliance, emphasizing AI as a workforce booster rather than a replacement. As founder Daniel Fallman notes, operationalizing subject matter expertise alongside AI is essential for meaningful impact, especially in regulated environments where realistic expectations about AI’s role are paramount.

Sources
Hypergrowth LeadershipLenny's PodcastGTM VaultWorld Economic ForumImagination in Actiona16z

Agentic Workflows Redefine Ops

Enterprises are replacing traditional interfaces and processes with autonomous, orchestrated fleets of AI agents that act as proactive collaborators, fundamentally altering how work gets done and governed.

Enterprises like Zuora, Pearson, and Block exemplify the transition from isolated AI pilots to deeply embedded agentic AI workflows that autonomously handle thousands of service requests and complex tasks, drastically accelerating operations—from Zuora cutting feature deployment from 14 days to 10 minutes using Claude Code, to Block’s open-source agent Goose saving employees 8 to 10 hours weekly across diverse teams. This operational integration demands not only technological deployment but also cultural and organizational redesign, as leaders like Dhanji R. Prasanna and Mariesa emphasize the necessity of evolving hiring, upskilling, and onboarding practices to treat AI agents as core collaborators rather than tools.

The evolution of workflows is marked by replacing traditional user interfaces with interactive, agent-driven loops that enable natural language communication and proactive AI collaboration, as highlighted by Adam’s recent infrastructure redesign where a five-year-old UI was discarded in favor of reactive AI commands with Claude. This paradigm shift, occurring rapidly within months, transforms operational models by radiating information back to humans for review rather than manual composition, enabling AI agents to act as 'S tier' employees who autonomously identify, research, and implement solutions while keeping humans in the loop for oversight.

Scaling agentic AI at enterprise scale requires orchestrating multiple specialized AI agents with clear task ownership and well-defined hand-offs to avoid context pollution and ensure reliability, as advised in early 2026 playbooks. Companies like Zapier operationalize this approach by running over 800 active AI agents internally, treating them like employees who must be onboarded with specific context and tools, supported by orchestration layers featuring Context Engineering and Model Context Protocols. This orchestration is complemented by rigorous governance—permissioning, approvals, audit logs—and operational controls such as drift detection and escalation mechanisms to maintain safety, traceability, and cost management in production environments.

Fundamental to successful scaling is the redesign of organizational models and infrastructure to embed AI agents as autonomous collaborators within workflows, shifting human roles from executors to supervisors and orchestrators managing teams of AI agents. This includes treating context as a centrally governed infrastructure to unify disparate agents across departments, avoiding siloed solutions and costly rip-and-replace IT projects. Enterprises like Snowflake and Notion demonstrate the power of integrated AI workflows that reduce task times from weeks to minutes and enable continuous background agent operations, while companies like Xero emphasize guardrails that balance speed with accuracy, ensuring AI accelerates rather than replaces human expertise.

Sources
LaunchPod | Product Management PodcastSiliconANGLE theCUBELenny's PodcastThe Changelog: Software Development, Open SourceThe a16z ShowStrategize Your Career

Governance Gaps Threaten Progress

Despite soaring AI adoption, most organizations lack mature frameworks to manage the unique risks of autonomous agents, forcing CIOs to invent bespoke controls as security incidents surge industry-wide.

By late 2025, industry leaders like Google and Replit highlighted that the primary barriers to AI agent deployment were not intelligence but reliability and integration challenges rooted in legacy workflows and fragmented enterprise data. Mike Clark of Google Cloud emphasized the cultural and operational shift required as enterprises grapple with probabilistic agent workflows that clash with traditional deterministic governance models. This foundational mismatch necessitates rethinking security paradigms, moving away from perimeter-based models to dynamic, least-privilege frameworks suitable for 'pasture-less' environments where agents require broad resource access.

Throughout 2025 and into early 2026, data governance emerged as a critical bottleneck undermining AI agent effectiveness, with Clari Labs reporting that 42% of enterprises lacked formal data governance and 87% missed revenue targets despite record AI investments. The strategic involvement of CIOs in leading governance and operational controls proved pivotal, as enterprises with unified, governed data environments achieved forecast accuracies up to 96% and ROI nearing 400%. Yet, only a minority—21% according to Deloitte—had mature governance models for agentic AI, underscoring a significant gap between ambition and operational readiness.

The governance landscape for AI agents remains fragmented and immature, with leading frameworks like NIST AI RMF, ISO 42001, and the EU AI Act notably omitting agentic AI considerations. Analysts warn this omission creates a structural failure, leaving enterprises without guidance to manage unique risks posed by autonomous agents that act and decide across systems. Consequently, organizations are compelled to build bespoke governance controls focusing on autonomy, permission boundaries, and runtime monitoring, as waiting for external standards risks unmanaged operational and legal liabilities. The rising prevalence of AI-related security incidents—97% reported in 2025—amplifies the urgency for proactive, embedded governance.

By early 2026, the market responded with platforms like OpenAI’s Frontier and Galileo’s Agent Control, which embed operational controls such as permissions, audit logs, and real-time policy enforcement to address governance and reliability at scale. These solutions reflect a broader shift from ad hoc AI experimentation to industrialized AI delivery frameworks that prioritize continuous compliance, observability, and human-in-the-loop verification. Industry voices including Gartner and Veeam stress that governance is no longer a peripheral concern but the linchpin for safe, accountable agentic AI deployment, with failures in governance cited as the leading cause of project cancellations and legal risks.

Sources
Venture BeatBusiness WirePR Newswire - Consumer TechnologyResilient CyberDecoding Customer ExperienceBusiness Wire

Vertical AI Powers Industry OS

Domain-specific AI platforms like Harvey and Casca are leapfrogging generic tools by embedding agentic intelligence directly into industry workflows, transforming vertical SaaS into active, decision-making operating systems.

Since late 2025, vertical AI platforms have emerged as transformative forces by embedding agentic AI tailored to industry-specific workflows, drastically accelerating adoption and delivering outsized productivity gains. Unlike generic horizontal AI tools that yield modest 10-20% improvements, vertical AI solutions like Harvey AI in legal tech achieve 50-80% productivity boosts by deeply understanding domain context—whether parsing case law or OSHA regulations—and integrating selectively with critical data sources rather than replacing entire legacy systems. This wedge-based approach enables rapid time-to-value, often within minutes, and lays the foundation for platform expansion into adjacent workflows, fintech, and marketplaces, effectively turning vertical SaaS into comprehensive operating systems for specialized industries.

By 2026, the rise of dynamic AI agent layers is disrupting traditional enterprise software by autonomously executing complex workflows and collapsing the gap between user intent and execution. Companies like Serval and Casca exemplify this shift: Serval automates IT service management by building AI-native 'mirror' systems that replace legacy help desks, while Casca’s AI-native loan origination platform, backed by a $29M Series A, replaces legacy cores to process commercial loans up to 10x faster and automate 90% of manual work. This full rip-and-replace strategy, especially in regulated sectors, unlocks significant economic value through improved speed, scale, and compliance, moving vertical SaaS from passive systems of record to active systems of action that govern and execute workflows autonomously.

The evolution from systems of record to systems of action is redefining defensibility and business models in vertical AI. Proprietary 'context graphs' or decision layers that capture not just data but the rationale behind decisions create new switching costs beyond traditional data stickiness, as Nic explains: 'It’s not just what happened, but why it happened.' This shift is evident in healthcare verticals where AI-enabled transcription and revenue cycle management embedded in practice management platforms automate complex billing workflows, and in sales teams at Tech Mahindra deploying Perplexity Enterprise Pro to integrate agentic AI with CRM systems for real-time, source-backed insights. These innovations underscore the critical role of clean, structured workflows and robust engineering investments to ensure reliability and compliance in sensitive industry contexts.

Despite the promise, vertical AI platforms face significant adoption challenges due to the complexity of automating cross-functional workflows and realizing ROI, with contracted pilot revenues often exceeding actual booked revenue by a factor of ten. However, investor confidence remains strong, as demonstrated by rapid funding rounds for companies like Serval and Casca, and the growing demand for real-world data to train AI models—particularly in robotics—signals expanding frontiers for vertical AI. Moreover, the preference of 90% of users to purchase specialized vertical AI solutions rather than build their own, coupled with rapid traction seen in startups addressing niche industry problems, suggests vertical AI is poised to surpass generic platforms, echoing past platform unbundling trends from the internet and mobile eras.

Sources
Linear: A Vertical Software Newslettera16zLinear: A Vertical Software & Vertical AI NewsletterThe SplitLinear: A Vertical Software & Vertical AI NewsletterSiliconANGLE theCUBE

Productivity Stalls at Scale

Widespread enthusiasm for AI pilots is colliding with data fragmentation, talent gaps, and legacy bottlenecks, leaving most enterprises unable to move beyond experimentation into scaled, production-grade value.

Enterprise AI adoption has surged rapidly, with companies like Zuora demonstrating remarkable productivity gains by automating workflows and accelerating deployment cycles—from 14 days to 10 minutes using Claude Code—while fostering AI literacy through initiatives such as prompt-a-thons and hackathons. However, despite this enthusiasm and broadening workforce access to AI tools (growing from under 40% to around 60% of workers within a year), a significant productivity gap persists as only about 25% of organizations have moved a substantial portion of AI pilots into production, underscoring the challenge of scaling beyond experimentation. This gap is exacerbated by cultural and talent barriers, with leaders like Mariesa from Pearson emphasizing the critical need for systemic workforce redesign, including upskilling, evolving hiring practices, and career pathing to support AI integration at scale.

Operational and technical challenges remain formidable obstacles to enterprise AI scaling, as even industry giants like Google Cloud and Replit acknowledge that legacy workflows, fragmented and messy data, and governance complexities hinder reliable AI agent deployment. Amjad Masad of Replit highlights that agents frequently fail during extended runs due to unstructured data and integration issues, while Mike Clark of Google Cloud points out the clash between probabilistic AI behavior and deterministic enterprise processes, necessitating fundamental redesigns of workflows, security models, and governance frameworks. These challenges contribute to a widening productivity gap where many enterprises remain stuck in pilot phases, unable to realize scalable business value despite rapid AI experimentation.

Data readiness and governance are pivotal in bridging the productivity gap between AI experimentation and scalable value, as revealed by Clari Labs’ study showing that 87% of enterprises missed 2025 revenue targets largely due to disconnected and ungoverned data systems. Enterprises with unified, governed data frameworks achieve forecast accuracies up to 96% and ROI nearing 400%, emphasizing that AI's true power lies in trusted, contextualized data rather than raw volume. This data imperative aligns with findings from Eminent Global Research Solutions and Genpact, which identify data quality and governance as top barriers alongside talent shortages and legacy system complexity, making workforce development and systemic workflow redesign essential for sustainable AI adoption.

The cultural and organizational transformation required to close the productivity gap is profound, demanding that enterprises move beyond treating AI as a mere tool to embedding AI agents as collaborative co-workers within reimagined workflows. Leaders like Ivan Zhao of Notion describe AI agents as superpowers that enable superhuman efficiency, but this shift requires treating agents like new hires with clear goals, permissions, and oversight, as emphasized by Ramp’s CPO Geoff Charles and Zapier’s VP of Product Chris Geoghegan. Moreover, traditional role-based org charts create coordination bottlenecks that blunt AI’s impact, whereas AI-native operators who combine judgment, execution, and system design unlock 40–70% cycle time reductions. Yet, as Sanjeev Vohra of Genpact warns, the 'frozen middle' of middle management remains a critical bottleneck, underscoring that successful AI scaling hinges on systemic workforce redesign and cultural change as much as technology deployment.

Sources
LaunchPod | Product Management PodcastPR Newswire - Consumer TechnologySiliconANGLE theCUBEVenture BeatGrowthInsider's NewsletterBusiness Wire

AI-Native Leadership Transforms Firms

A new breed of leaders at companies like Shopify and Notion is dismantling hierarchies and orchestrating teams of AI agents, ushering in cross-functional pods and real-time agentic ecosystems as the new enterprise norm.

AI-native leadership is rapidly evolving from traditional technology management to orchestrating autonomous, multi-agent systems that redefine enterprise operations. As Adam highlighted in late 2025, this requires abandoning narrow API designs in favor of wide, exploratory interfaces that treat language models as interactive collaborators, a shift echoed by Notion CEO Ivan Zhao who envisions leaders managing teams of AI agents as a new form of organizational superpower. By early 2026, companies like Shopify and Klarna exemplify this transformation, embedding AI as a living operating model where small, cross-functional pods autonomously leverage AI to drive outcomes, fundamentally dismantling hierarchical structures and emphasizing operational and cultural change over mere technology deployment.

The expansion of AI-native ecosystems and multi-agent orchestration platforms is accelerating the shift toward autonomous enterprise workflows that seamlessly integrate with existing systems. Platforms like Slack are evolving into 'agentic work operating systems' enabling real-time human-agent collaboration, while Appian’s orchestration layer exemplifies how AI can connect legacy systems without costly replacements, facilitating trusted multi-step processes across industries such as banking and healthcare. Meta’s acquisition of Moltbook and Notion’s integrations with Snowflake and cloud code further illustrate a maturing ecosystem where millions of autonomous agents communicate and collaborate, signaling 2026 as a pivotal 'crossover year' for AI-native enterprise maturity.

AI-native user interfaces are undergoing a profound transformation from static, manual tools to dynamic, context-aware agents embedded within everyday workflows. As Mark Andrusko and Andrew Sims note, interfaces are 'melting' into AI agents that proactively anticipate user needs, generate personalized views on demand, and enable multitasking through natural conversation rather than app switching. Voice interactions, spatial XR co-pilot workspaces, and persistent virtual sites are becoming standard, allowing users to supervise AI execution with lightweight oversight while the AI handles complex tasks autonomously, thus collapsing the gap between intent and execution even for non-technical users.

The urgency to adopt AI-native skills and leadership models is acute, with a narrow window measured in months for individuals and organizations to gain radical competitive advantage. Analysts emphasize that traditional credentials and hierarchical titles are giving way to a premium on practical impact, AI fluency, and the ability to orchestrate multi-agent systems effectively. Companies like Lovable demonstrate this shift by replacing manual developer interventions with autonomous AI fixes, while Gartner predicts that by 2028, a third of enterprise software will embed agentic AI, fundamentally redefining software development lifecycles and enterprise workflows.

Sources
The Changelog: Software Development, Open SourceACCESSByteByteGo NewsletterPR Newswire - Consumer TechnologyAI For HumansBusiness Wire

Part of these trends

Get the stories behind the trends

Deep-dive reporting and the weekly brief, in your inbox.