The Big Problem with GPUs and How To Solve It | Randolph and Kandan, MantisGrid AI
The Neon Show
- Published
- September 15, 2026
- Duration
- 42:45
- Summary source
- description
- Last updated
- Sep 16, 2026
Discusses agents.
Summary
We don't want the industry to fall apart, that's why we started this company.6 months ago, everyone was talking about model deployment. Now everyone has moved on to agentic AI deployment and autonomous agent swarms. But all of this is running on an infrastructure that itself is not automated.And this underlying infrastructure has massive GPU cluster syste…
Intelligent Report
Sign in to read teasers, or upgrade to Research Pro to commission intelligent report for this episode. Learn more →
Show notes
We don't want the industry to fall apart, that's why we started this company.6 months ago, everyone was talking about model deployment. Now everyone has moved on to agentic AI deployment and autonomous agent swarms. But all of this is running on an infrastructure that itself is not automated.And this underlying infrastructure has massive GPU cluster systems. If even one GPU fails the whole training workload fails. You can't have 100,000 employees managing 100,000 GPUs. But LLMs are not the right
Themes
- agents