What is the most important oversight for agentic AI deployment?

The answers agree on the need for thorough, ongoing oversight—whether through observability, responsibility, system evaluation, continuous monitoring, or robust testing—to ensure agentic AI behaves as intended.

5 answers

Answers

  • Rama Akkiraju

    VP, Enterprise AI · Nvidia

    Observability

    Rama Akkiraju says observability is key, especially to understand agent behavior before certifying an agent.

    Imagination in Action · Watch on YouTube
  • Anders Hejlsberg

    Technical Fellow · Microsoft

    Vouch for Responsibility

    Anders Hejlsberg says the practice is to understand what you're vouching for before giving AI the keys, because someone must take responsibility and he wouldn't sleep otherwise.

    Ryan Peterman · Watch on YouTube
  • Rashmi Shetty

    Senior Director - Enterprise Generative AI Platform · Capital One

    Evaluate the Whole System

    Rashmi Shetty says the key oversight practice is evaluating the whole agentic system, not just the LLM model alone, because evaluations provide the evidence package of whether the system accomplished its intended task.

    The answer starts at 14:53.

    Computer Weekly Downtime Upload · Listen on Apple Podcasts
  • Kumar Veetrag

    Chief Technology Officer · Enparadigm

    Continuous Oversight

    Kumar Veetrag says continuous oversight, along with human judgment and ethical governance, is required rather than treating AI as a fully autonomous decision maker, because building trust in AI requires it.

    Analytics Insight · Analytics Insight · Listen at 28:02
  • Konstantin Klyagin

    Founder · Redwerk

    Test Contradictory Inputs

    Konstantin Klyagin says the most important part of testing agentic AI is trying contradictory inputs rather than just the happy path, because people are not always consistent.

    Chrisman Commentary - Daily Mortgage News · Chrisman Commentary - Daily Mortgage News · Listen at 12:43

More Software Engineering questions

View all →