How do you ensure quality of AI-generated code?

Sagnik Nandy

Chief Technology Officer · Docusign

Human review

Sagnik Nandy says AI-generated code is validated by humans, who correct it when it fails and feed that back into the system.

The answer starts at 24:30.

Michael Jenkins

C.T.O. · Threatlocker

Write good requirements

Michael Jenkins says you have to be really good at writing requirements, because you get much better AI-generated code the better the requirements you give it.

Thariq Shihipar

Member of Technical Staff · Anthropic

Extensive testing

Thariq Shihipar says quality comes from extensive testing: a strong verification harness, roughly 100 times more testing code, and fixtures and tools like Storybook to catch and verify every part.

AH

Anders Hejlsberg

Technical Fellow · Microsoft

Review the code

Anders Hejlsberg says the craft is shifting so agents type lines of code and programmers review the agents' work, meaning they do more reviewing and less typing to handle AI-generated code.

Zach Lloyd

Founder / CEO · Warp

Verification and spec adherence

Zach Lloyd says ensuring quality means using computer-use verification and better specing so agents check for spec adherence, because review is the biggest bottleneck.

Konstantin Klyagin

Founder · Redwerk

Standard software discipline

Konstantin Klyagin says ensuring quality in AI-generated code requires the standard software discipline of specification, documentation and test coverage, because AI only accelerates coding while the rest of the lifecycle still needs that discipline.

RZ

Rob Zuber

CTO · CircleCI

Two-person review

Rob Zuber says two-person review is one way his team chose to manage risk, noting it is not the only possible way.

👨🏾‍💻 Ben Ilegbodu

Senior Software Engineer, TV Client Foundations · Netflix

Verification

Ben Ilegbodu says verification is how to ensure quality, noting his team still reviews code agents generate because they only somewhat trust the output, and he expects verification may become checking that output does what it says.