AI kills the annual review: windmill and 15five turn performance feedback into a real-time sport

Traditional annual performance reviews have become increasingly obsolete in the fast-paced AI era, as highlighted by the CEO of an AI-powered review firm who bluntly states, 'The practice just hasn’t kept up.' Employees, especially ambitious individual contributors, consistently report a lack of constructive feedback, with many organizations failing to provide meaningful insights on improvement or recognition beyond a once-a-year check-in. This disconnect underscores a critical gap in fostering continuous development and engagement.

The reliance on annual reviews places disproportionate weight on managers’ memories and subjective judgments, often leading to inconsistent and backward-looking evaluations. Windmill’s analysis reveals that feedback frequency is limited by managerial capacity, with many managers forgetting key events from the past six months, resulting in ineffective and outdated assessments. Moreover, human biases such as recency bias further undermine the objectivity of these reviews, making them unreliable tools for accurately measuring performance.

As organizations flatten and managers face growing spans of control—sometimes overseeing 10 to 20 direct reports—the traditional annual review system becomes increasingly unsustainable. Coinbase’s experience illustrates that without new approaches or systems, the existing model will collapse under the weight of managerial overload. HR teams, overwhelmed by the administrative burden of these processes, often lack the bandwidth to cultivate a culture of frequent, in-the-moment feedback, perpetuating a cycle of inefficiency and disengagement.

The rise of AI fundamentally challenges the conventional task-based evaluation framework that has dominated performance reviews for decades. As AI automates routine tasks, the value shifts toward how employees exercise human judgment and effectively collaborate with AI tools. Analysts argue for a critical redefinition of performance metrics, moving away from mere task completion to rewarding nuanced human-AI interaction and decision-making, thereby aligning evaluations with the evolving nature of work in the AI era.

Windmill revolutionizes traditional performance reviews by embedding AI to deliver continuous, context-rich feedback that transforms one-on-ones and pulse surveys into growth-focused conversations. By integrating diverse work data from tools like Slack, Google Workspace, and GitHub into a unified context graph, the platform eliminates the need for managers and employees to spend time recalling past activities, allowing them instead to concentrate on strategic development. This approach makes performance management processes up to ten times more efficient and meaningful, as the system already knows what each person has been working on over the previous months.

At the core of Windmill’s innovation is its hyper-personalized AI coaching, which provides every employee with a 24/7 digital coach that understands individual goals, company objectives, and managerial priorities. Unlike traditional feedback mechanisms limited to infrequent reviews, this AI coach delivers real-time, actionable development steps tailored to each employee’s communication preferences and cadence, effectively augmenting rather than replacing managers. As co-founders Max Shaw and Brian Distelburger emphasize, this continuous coaching model fosters a smarter, faster, and more engaging talent management experience that employees genuinely appreciate.

Windmill addresses a critical gap in legacy HR systems by creating a unified 'context graph' that synthesizes organizational charts, productivity data, and performance reviews into a single, integrated platform. This innovation not only provides managers with comprehensive, real-time insights into employee contributions and skills but also supports scalable talent development and workforce redeployment. In an era where placing the right talent in the right roles is paramount, Windmill’s AI-driven approach helps organizations navigate evolving job requirements and skill uncertainties, positioning skills assessment as a cornerstone of future-ready human capital management.

Since its November 2025 launch, Windmill has rapidly gained market traction, securing over 100 customers including Kalshi, The Farmer's Dog, and Rho, with early adopters reporting exceptional satisfaction. Notably, 93% of employees participating in Windmill-powered performance reviews rated their experience as the best they have ever had, highlighting the platform’s ability to streamline complex managerial responsibilities and enhance team development amid growing organizational complexity. As managerial scopes expand, Windmill’s AI-driven continuous feedback system becomes indispensable for effectively managing larger teams and delivering high-quality, timely performance evaluations.

15Five’s AI-enhanced continuous performance management revolutionizes traditional review cycles by integrating its Work Context feature with platforms like Slack, Microsoft Teams, Jira, Asana, and GitHub to build a dynamic 'context graph.' This graph synthesizes fragmented data into a real-time, unified narrative of employee contributions, enabling managers to move beyond manual reporting and focus on strategic insights. Complementing this, Focus Briefs deliver weekly, prioritized digests that highlight team progress and coaching opportunities, transforming routine check-ins into proactive, meaningful conversations rather than reactive status updates.

By early 2026, 15Five’s AI Assisted Reviews have dramatically reduced the administrative burden on managers by generating approximately 80% of initial performance review drafts. Leveraging data from the context graph and existing metrics, the AI crafts feedback that is specific, balanced, and development-focused, while still allowing managers full editorial control to tailor evaluations. This blend of automation and human oversight not only accelerates the review process but also enhances the quality and relevance of feedback, marking a significant shift from annual evaluations to continuous, data-driven performance management.

By early 2026, companies like Windmill have demonstrated that AI-driven tools can drastically simplify performance reviews, enabling managers to oversee larger teams with greater complexity and produce high-quality evaluations at a fraction of the traditional cost. However, this shift transforms human roles from task execution to strategic oversight, requiring new performance metrics that emphasize judgment and effective AI utilization rather than mere task completion. As Windmill’s leadership explains, "the factory worker is now becoming the factory manager," highlighting the need for managers to adapt to broader responsibilities and more nuanced evaluation criteria.

Redefining performance in the AI era also exposes significant managerial challenges, particularly in assessing human capabilities beyond automated metrics. Managers often struggle to identify when employees are mismatched to roles, especially as AI automates routine tasks and human contributions become more about interpretation and decision-making. As noted by Windmill analysts, without diverse role experience, managers may fail to recognize better fits for individuals, underscoring the need for deeper human-centric management approaches amid AI disruption.

The evolving workforce structure, propelled by AI, is expected to feature smaller teams with higher individual productivity, intensifying the competition for top talent. Windmill predicts that companies will generate more revenue with fewer people, making managerial roles more complex and elevating the importance of strategic human oversight. This transformation represents a civilizational-level change management challenge, as work remains a core human identity element and organizations must thoughtfully chart the future of human roles alongside AI capabilities.