What specific elements are essential for effective AI governance in healthcare organizations, and why?

Most answers emphasize ongoing validation, transparency, and human oversight—especially clinician involvement—as essential for effective AI governance in healthcare, with some also highlighting accountability, training, and measurable impact.

10 answers

Answers

  • Munjal Shah

    Senior Product Manager, Wearables · Google

    Multi-layer model validation

    Munjal Shah says his team built multiple models, including models that check models, to try to ensure safety, describing this layered validation as part of how they engineer safety from day one.

    The answer starts at 20:41.

    B2BaCEO (with Ashu Garg) · Listen on Apple Podcasts
  • Dylan Reid(Moskowitz)

    President

    Explainable, auditable, clinically-aligned AI

    Dylan Reid says the trend is a mandatory demand for absolute truth, auditability and clinical alignment in every deployed algorithm, as regulators like CMS impose transparency mandates on automated decision-making.

    The answer starts at 4:32.

    Becker’s Healthcare Podcast · Listen on Apple Podcasts
  • Hal Wolf

    President and Chief Executive Officer · Himss

    Governance, Processes, Training, Measurement

    Hal Wolf says effective use of AI requires governance, processes, training of people, and measurement, and that organizations must measure impact on access and quality because otherwise the effort's relevance is unclear.

    The answer starts at 6:50.

    The Big Unlock · Listen on Apple Podcasts
  • Nirav Shah, MD, MPH

    Associate Chief Medical Informatics Officer, AI and Innovation · Endeavor Health

    Continuous Model Validation

    Nirav Shah says a partner must remain accountable for continuous model validation and workflow adoption, because AI models drift as clinical populations and workflows evolve after go-live.

    The answer starts at 7:07.

    Becker’s Healthcare Podcast · Listen on Apple Podcasts
  • David Niewolny

    Sr. Dir, Global Head of Business Development - Healthcare / Medical · NVIDIA

    Clear human decision point

    David Niewolny says effective AI governance in healthcare requires a clear human decision point in all cases, describing it as the last of several layers alongside bounded tools and controlled data access.

    The answer starts at 35:44.

    Faces of Digital Health · Listen on Apple Podcasts
  • Rhett Alden

    CTO, Elsevier Health Markets · Elsevier

    Transparency

    Rhett Alden says transparency is critical for clinical adoption, specifically transparency in how a response is arrived at and where the information comes from, because clinicians fear black box algorithms and need quality and patient safety.

    The answer starts at 3:24.

    The AI in Business Podcast · Listen on Apple Podcasts
  • Peter Lee

    President, Microsoft Science · Microsoft

    Personal accountability

    Peter Lee says personal accountability is essential, warning that people must not use AI to avoid responsibility for their role in consequential decisions by hiding behind the data.

    Second Opinion with Christina Farr · Watch on YouTube
  • Anirban Maitra

    Director, Perlmutter Cancer Center · Nyu Langone Health

    Physician Oversight

    Anirban Maitra says the most important thing is using AI safely, which means qualified physicians must analyze and check results rather than letting AI diagnose without oversight, because the physician's judgment remains the captain of the ship.

    The answer starts at 10:15.

    Becker’s Healthcare Podcast · Listen on Apple Podcasts
  • Hannah Galvin, MD, FAAP, FAMIA, CHCIO

    Chief Health Information Officer · Cambridge Health Alliance

    Ongoing monitoring and evaluation

    Hannah Galvin says governing AI requires ongoing algorithm vigilance and monitoring, not just tool selection, and asks how organizations can demonstrate that tools actually improve outcomes and deliver return on investment.

    The answer starts at 5:04.

    Becker’s Healthcare Podcast · Listen on Apple Podcasts
  • Kimberly Powell

    Vice President / General Manager, Healthcare at NVIDIA · Nvidia

    Healthcare professionals in the loop

    Kimberly Powell says it is essential to have healthcare professionals in the loop, both in using the tools and in building them, so clinicians can catch mistakes and treat the systems as a second opinion.

    Second Opinion with Christina Farr · Watch on YouTube

More HealthTech questions

View all →