Is Human Data Enough? With David Silver

In this episode of Google DeepMind: The Podcast, VP of Reinforcement Learning, David Silver, describes his vision for the future of AI, exploring the concept of the "era of experience" versus the current "era of human data". Using AlphaGo and AlphaZero as examples, he highlights how these systems surpassed human capabilities by engaging in reinforcement learning without prior human knowledge. This approach contrasts with large language models, which depend on human data and feedback. Silver emphasizes the need to explore this path to drive AI progress and achieve artificial superintelligence.

Timestamps

00:00 Introduction01:50 Era of experience03:45 AlphaZero10:19 Move 3715:20 Reinforcement learning and human feedback24:30 AlphaProof29:50 Math Olympiads35:00 Experience based methods42:56 Hannah's reflections44:00 Fan Hui joins

___

Thanks to everyone who made this possible, including but not limited to:

Presenter: Professor Hannah FrySeries Producer: Dan HardoonSeries Editor: Rami TzabarCommissioner & Producer: Emma YousifMusic Composition: Eleni ShawAudio Engineer: Richard CourticeProduction Manager: Dan LazardVideo Director and Editor: Bernardo ResendeVideo Studio Production: Nicholas DukeVideo Editor: Bilal MerhiAudio Engineer: Perry RogantinCamera and Lighting Operator: Robert MessereProduction Coordination: Zoey Roberts, Sarah Ellen MortonVisual Identity and Design: Rob AshleyCommissioned by Google DeepMind

Please leave us a review on Spotify or Apple Podcasts if you enjoyed this episode. We always want to hear from our audience whether that's in the form of feedback, new idea or a guest recommendation!

Google DeepMind: The Podcast

Where can you listen?

Episodes