What challenges arise scaling AI from pilot to enterprise?
The answers highlight challenges in governance, cost, organizational structure, data reliability, and operational deployment, with several emphasizing governance and compliance as recurring obstacles.
6 answers
Answers


Mike Hogan
Senior Managing Director and Chief Information Officer · Pennymac
Governance and Ownership
Mike Hogan says the trouble is ownership and governance: teams built duplicate agents with no clear owners, review backlogs piled up, and he doesn't think anyone in the industry has solved how to govern and control it.
Chrisman Commentary · Watch on YouTube
Jim Scharf
Chief Technology Officer · Mongodb
Cost
Jim Scharf lists cost among the challenges of scaling AI, saying that managing cost is one of the things peers are wrestling with and calling cost a particularly interesting angle.
The answer starts at 21:51.
MTS · Listen on Apple Podcasts

Paul McDonagh-Smith
Visiting Senior Lecturer (IT Group and Executive Education) · Mit Sloan School Of Management
Organizational Structure
Paul McDonagh-Smith says the key challenge is organizational structure, arguing that hardly any of the difficulty is a technology problem and it instead has to do with organizational structure in many dimensions.
The answer starts at 21:44.
The AI Forecast: Data and AI in the Cloud Era · Listen on Apple Podcasts

Sam Pierson
Chief Technology Officer · Qlik
Data Reliability
Sam Pierson says the core part is having reliable, clean data you can trust and make decisions on, because without it you get hallucinations and wrong data.
Data Faces Podcast · Data Faces Podcast · Listen at 6:49

Muralidhar Vemulapalli
Chief Enterprise Architect/ Acting CTO · Arkansas Blue Cross And Blue Shield
Operational Deployment
Muralidhar Vemulapalli says the primary barrier to AI impact in health plans is operational deployment, not algorithmic capability, since models can look good on paper but be useless without a business sponsor tying them to a workflow or decision point.
CDO Magazine Podcast Series · CDO Magazine Podcast Series · Listen at 8:38

Kevin Lee
Chief Technology Officer & Key Pursuits Leader · Nice
Compliance and Governance
Kevin Lee says compliance and governance are key challenges, because highly regulated industries always have compliance requirements and the best organizations lean into them.
The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX · The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX · Listen at 10:19
More Information Technology (IT) questions
View all →- What practice best ensures governance for AI platforms?6 answers
- What is most critical for scaling AI enterprise-wide?7 answers
- What is your first step in modernizing IT with AI?7 answers
- How can AI token use align with business value?5 answers
- What strategies are most effective for securing AI workloads?5 answers












