#83 The Limitations of Knowledge - David Wolpert

Professor at the Santa Fe Institute renowned for his groundbreaking work across multiple disciplines—from physics and computer science to game theory and complexity.
David Wolpert is one of the modern era's true polymaths. He received his PhD in physics from UC Santa Barbara but has made seminal contributions across numerous fields. His research spans machine learning (where he formulated the "No Free Lunch" theorems), statistical physics, game theory, distributed intelligence, and the foundations of inference and computation. Before joining SFI, Wolpert held positions at NASA, Stanford, and the Santa Fe Institute as a professor. His work consistently bridges disciplinary boundaries to address fundamental questions about complex systems, computation, and the nature of intelligence.

Summary

Professor David Wolpert discusses his interdisciplinary approach to understanding computation in dynamic systems, the role of memory and prediction in human cognition, and the limitations of human understanding. He explores the implications of these themes for history, mathematics, and the future of scientific inquiry, particularly in relation to AI and the environmental costs of information processing. David Wolpert discusses his journey through academia, the challenges of pursuing a career in science, and the philosophical implications of mathematics. The dialogue explores the complexities of human motivation, the evolution of scientific practice, and the fundamental role of mathematics in understanding reality.

Chapters

00:00 Introduction to David Wolpert's Work
01:12 Understanding Computation in Dynamic Systems
04:06 The Role of Bias in Inference and Prediction
09:20 Memory, Prediction, and Human Limitations
14:25 The Limits of Human Understanding
19:51 The Ineffable Nature of Reality
23:19 Mathematics and History: A New Perspective
26:15 Human Societies and Computational Growth
28:23 AI and the Future of Scientific Inquiry
31:55 The Decision to Engage with Society
36:02 Navigating Academia and Career Choices
41:29 The Pursuit of Impact and Fulfillment
46:40 The Role of Science and Trust in Society
47:31 Mathematics: Discovery vs. Creation
59:41 The Paradox of Mathematics and Reality

David Wolpert
https://davidwolpert.weebly.com/self-indulgences.html
https://davidwolpert.weebly.com/
https://scholar.google.com/citations?user=PRjgI8kAAAAJ&hl=en
A sliver of reality https://aeon.co/essays/ten-questions-about-the-hard-limits-of-human-intelligence
. His latest book is The Energetics of Computing in Life and Machines (2019).
Music for every episode
Intro and exit music used: Strange the dreamer by Savfk - www.youtube.com/@savfkmusic

Connect with Ryan Anderson
Instagram: https://www.instagram.com/awonderjunkie/
awonderjunkie.com
Breathe4Flow.com
Youtube: https://www.youtube.com/@awonderjunkie
iTunes: https://podcasts.apple.com/us/podcast/a-wondejunkie/id1739838765
Spotify https://open.spotify.com/show/1CcQXpxfV9P89IrKmtV2hS?si=6519a88aef444ba0
A bit about Ryan Anderson- https://open.spotify.com/episode/7bsR23JM4z6p1RPpbv7czC?si=4ba51224cf464e70