Cover art for The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

20VC: Who Wins the Inference Market | Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute | The Real Limits of Post-Training and RL with Erik Bernhardsson, Modal CEO

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

Published
November 2, 2026
Duration
1h 2m
Summary source
description
Last updated
Nov 2, 2026

Discusses llm, agents, inference, investing.

Summary

Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik bu…

Modal's CEO Erik Bernhardsson on hitting $1B ARR, why inference margins can reach 50-60%, the GPU market chaos, and why the demand for compute is bigger than anyone imagined.

Key takeaways

  • Inference is not just a commodity layer—bundling sandboxes, post-training, batch jobs, and reinforcement learning around it creates defensible, multi-product platforms with 40-60% long-term margin potential.
  • Modal's growth engine was radical PLG authenticity: Eric personally sent 50-100 thank-you DMs nightly to new Twitter followers, converting them into customers and angel investors before any enterprise sales motion.
  • Open-source LLM inference and frontier model inference will both grow 5-10-20x in the next 12 months—the market is large enough for deep specialization across latency profiles, fine-tuning, and use-case verticals simultaneously.

Why this matters

As inference scales into a multi-hundred-billion-dollar market, B2B leaders must understand that the defensible position is not raw GPU access but the full-stack platform—spanning sandboxes, post-training, orchestration, and data services—that eliminates switching costs and captures margin across the AI application lifecycle.

Entities

Related reports

Intelligent Report▼

Report loads when you expand this section (one request).

Show notes

Erik Bernhardsson is the Co-Founder and CEO of Modal, the AI infrastructure platform for training models, running inference and powering AI agents. Modal has raised over $1.2 billion, including a recent $750 million Series D led by Accel at a $15.75BN valuation. The company has surpassed $1BN in ARR, growing more than 15x year-on-year. Previously, Erik built Spotify's original music recommendation system. AGENDA: 05:30 - Why wait until your mid-30s to start a company? 06:40 - Is founding a start

Themes

  • llm
  • agents
  • inference
  • investing