Aditi Raghunathan
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Is It Time to Rethink LLM Pre-Training? with Aditi Raghunathan
- Published
- September 16, 2025
- Duration
- 58:26
- Summary source
- description
- Last updated
- Jul 5, 2026
Discusses llm.
Summary
Today, we're joined by Aditi Raghunathan, assistant professor at Carnegie Mellon University, to discuss the limitations of LLMs and how we can build more adaptable and creative models. We dig into her ICML 2025 Outstanding Paper Award winner, “Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction,” which examines …
Intelligent Report
Sign in to read teasers, or upgrade to Research Pro to commission intelligent report for this episode. Learn more →
Show notes
Today, we're joined by Aditi Raghunathan, assistant professor at Carnegie Mellon University, to discuss the limitations of LLMs and how we can build more adaptable and creative models. We dig into her ICML 2025 Outstanding Paper Award winner, “Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction,” which examines why LLMs struggle with generating truly novel ideas. We dig into the "Roll the dice" approach, which encourages structured exploration by injec
Themes
- llm