20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute | The Real Limits of Post-Training and RL with Erik Bernhardsson, Modal CEO
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
- Published
- November 2, 2026
- Duration
- 1h 2m
- Summary source
- description
- Last updated
- Nov 2, 2026
Discusses llm, agents, inference, investing.
Summary
Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik bu…
Modal's CEO Eric on hitting $1B ARR, why inference margins can reach 50-60%, GPU markets as 'open-air drug markets,' and why the demand for compute is infinite—with zero signs of slowing.
Key takeaways
- Inference is not a commodity if bundled with adjacent products—sandboxes, post-training, RL, batch jobs, and orchestration create switching costs and margin expansion beyond raw token pricing.
- Modal's growth engine is GPU aggregation across 25+ neo-clouds combined with proprietary infrastructure (custom file system, container runtime, scheduler), enabling on-demand scaling without long-term capacity commitments from customers.
- Specialization within inference will accelerate as the market scales from billions to hundreds of billions—low-latency, batch, fine-tuning, and domain-specific workloads will each become large standalone submarkets.
Why this matters
As inference commoditizes at the token level, the durable B2B opportunity lies in owning the full AI infrastructure platform—compute aggregation, sandboxes, post-training, and orchestration—making Modal's platform strategy a blueprint for how infrastructure companies can capture software-like margins in the AI era.
Entities
Related reports
- 20VC: Why Robotics Will be 100x Bigger than Coding Agents | Inference Will Be a $10TRN Market: What No One Sees | Why Software Investors are F***** Today with Naveen Rao, Unconventional
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
- 20VC: Horizontal vs Vertical Agents: Who Wins | Model Routing: Commodity or Increasing in Value | The Future of the Inference Market | Why Founders Should Take Discounts for Tier 1 Firms with Harrison Chase, LangChain
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
- 20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute | The Real Limits of Post-Training and RL with Erik Bernhardsson, Modal CEO
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
Intelligent Report▼
Intelligent Report
20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute | The Real Limits of Post-Training and RL with Erik Bernhardsson, Modal CEO
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
November 2, 2026
Report loads when you expand this section (one request).
Show notes
Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik built Spotify's original music recommendation system. AGENDA: 05:30 - Why wait until your mid-30s to start a company? 06:40 - Is founding a start
Themes
- llm
- agents
- inference
- investing