
20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute | The Real Limits of Post-Training and RL with Erik Bernhardsson, Modal CEO
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
- Published
- November 2, 2026
- Duration
- 1h 2m
- Summary source
- description
- Last updated
- Nov 2, 2026
Discusses llm, agents, inference, investing.
Summary
Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik bu…
Modal's CEO Erik Bernhardsson on hitting $1B ARR, why inference margins can reach 50-60%, the GPU market chaos, and why the demand for compute is bigger than anyone imagined.
Key takeaways
- Inference is not just a commodity layer—bundling sandboxes, post-training, batch jobs, and reinforcement learning around it creates defensible, multi-product platforms with 40-60% long-term margin potential.
- Modal's growth engine was radical PLG authenticity: Eric personally sent 50-100 thank-you DMs nightly to new Twitter followers, converting them into customers and angel investors before any enterprise sales motion.
- Open-source LLM inference and frontier model inference will both grow 5-10-20x in the next 12 months—the market is large enough for deep specialization across latency profiles, fine-tuning, and use-case verticals simultaneously.
Why this matters
As inference scales into a multi-hundred-billion-dollar market, B2B leaders must understand that the defensible position is not raw GPU access but the full-stack platform—spanning sandboxes, post-training, orchestration, and data services—that eliminates switching costs and captures margin across the AI application lifecycle.
Entities
Related reports
- 20VC: Why Robotics Will be 100x Bigger than Coding Agents | Inference Will Be a $10TRN Market: What No One Sees | Why Software Investors are F***** Today with Naveen Rao, Unconventional
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
- 20VC: Horizontal vs Vertical Agents: Who Wins | Model Routing: Commodity or Increasing in Value | The Future of the Inference Market | Why Founders Should Take Discounts for Tier 1 Firms with Harrison Chase, LangChain
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
- 20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute | The Real Limits of Post-Training and RL with Erik Bernhardsson, Modal CEO
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
Intelligent Report▼
Intelligent Report
20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute | The Real Limits of Post-Training and RL with Erik Bernhardsson, Modal CEO
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
November 2, 2026
Report loads when you expand this section (one request).
Show notes
Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik built Spotify's original music recommendation system. AGENDA: 05:30 - Why wait until your mid-30s to start a company? 06:40 - Is founding a start
Themes
- llm
- agents
- inference
- investing