Who Grades the AI Models? | Ben Horowitz & Rayan Krishnan
The a16z Show
- Published
- September 9, 2026
- Duration
- 39:45
- Summary source
- description
- Last updated
- Sep 23, 2026
Discusses ai.
Summary
a16z’s Erik Torenberg, Ben Horowitz, and Jennifer Li sit down with Vals founder and CEO Rayan Krishnan to discuss one of AI’s increasingly difficult problems: how do you actually measure whether a model is getting better?As public benchmarks saturate and models get better at optimizing for the tests themselves, Rayan makes the case for independent, contin…
Intelligent Report
Sign in to read teasers, or upgrade to Research Pro to commission intelligent report for this episode. Learn more →
Show notes
a16z’s Erik Torenberg, Ben Horowitz, and Jennifer Li sit down with Vals founder and CEO Rayan Krishnan to discuss one of AI’s increasingly difficult problems: how do you actually measure whether a model is getting better?As public benchmarks saturate and models get better at optimizing for the tests themselves, Rayan makes the case for independent, continuously evolving evaluations. They unpack why self-reported model scores can be misleading, how VALS evaluates models in the hours before a rele
Themes
- ai