Jitendra Malik
The Robot Brains Podcast
Jitendra Malik: Building AI from the ground-up, sensorimotor before language
- Published
- August 17, 2023
- Duration
- 1h 15m
- Summary source
- description
- Last updated
- Jun 10, 2026
Discusses ai.
Summary
Jitendra Malik, Professor of EECS at UC Berkeley discusses with host Pieter Abbeel building AI from the ground-up and sensorimotor before language. Subscribe to the Robot Brains Podcast today | Visit therobotbrains.ai and follow us on YouTube at TheRobotBrainsPodcast and Twitter at @pabbeel. Hosted on Acast. See acast.com/privacy for more information.
Berkeley professor Jitendra Malik discusses why today's AI falls short of human intelligence, the importance of physical skill acquisition, rapid motor adaptation in robots, and how benchmarking transformed computer vision.
Key takeaways
- Rapid Motor Adaptation (RMA) enables robot dogs to traverse diverse terrains—sand, mud, stairs, rocks—using the same neural network by detecting discrepancies between issued motor commands and actual proprioceptive feedback, eliminating the need for terrain-specific engineering.
- Grounded sensorimotor experience precedes and underpins language acquisition in both biological and artificial intelligence; Malik argues that building physically-grounded skills first (what children master before age 5) is essential for robust, non-brittle AI.
- Benchmarking transformed computer vision into a rigorous science—Malik's Berkeley Segmentation Dataset and the broader ImageNet-era culture of standardized evaluation directly enabled the deep learning breakthrough of 2012 (AlexNet), illustrating how infrastructure investments compound into field-wide breakthroughs.
Why this matters
For B2B leaders investing in AI and robotics, Malik's framework reveals that the next competitive frontier is not scaling language models alone but achieving reliable physical intelligence through simulation-based skill acquisition—capabilities that will unlock autonomous elder care, industrial manipulation, and healthcare diagnostics at scale.
Entities
Related reports
- John Schulman of OpenAI on ChatGPT: invention, capabilities and limitations
The Robot Brains Podcast
- Rocky Duan, Covariant CTO joins Pieter Abbeel
The Robot Brains Podcast
Intelligent report▼
Vagelintel · Intelligent report
Jitendra Malik: Jitendra Malik: Building AI from the ground-up, sensorimotor before language
The Robot Brains Podcast
August 17, 2023
Report loads when you expand this section (one request).
Show notes
Jitendra Malik, Professor of EECS at UC Berkeley discusses with host Pieter Abbeel building AI from the ground-up and sensorimotor before language. Subscribe to the Robot Brains Podcast today | Visit therobotbrains.ai and follow us on YouTube at TheRobotBrainsPodcast and Twitter at @pabbeel. Hosted on Acast. See acast.com/privacy for more information.
Themes
- ai