Cover art for The Neon Show

Vamshi Ambati

The Neon Show

94% CAGR: What the Inference Boom means for your AI costs | Vamshi Ambati

Published
June 9, 2026
Duration
51:56
Summary source
description
Last updated
Aug 23, 2026

Discusses inference.

Summary

Vamshi Ambati has spent more than two decades in AI, through the symbolic era, statistical era, and the neural wave we're experiencing today. A CMU PhD, founder of LatentStructure and Predera (which was acquired), now an investor at Virama Ventures, he's one of the sharper voices on what's actually happening under the hood of the AI boom.We discuss a simp…

Intelligent Report

Sign in to read teasers, or upgrade to Research Pro to commission intelligent report for this episode. Learn more →

Show notes

Vamshi Ambati has spent more than two decades in AI, through the symbolic era, statistical era, and the neural wave we're experiencing today. A CMU PhD, founder of LatentStructure and Predera (which was acquired), now an investor at Virama Ventures, he's one of the sharper voices on what's actually happening under the hood of the AI boom.We discuss a simple question: Who wins when models become cheaper and more abundant? And try to answer this by looking at how inference spend v/s compute spend

Themes

  • inference