Silicon Valley’s Favorite Prophet Has a New Warning
Oct 1, 2026 · 50m
More News podcasts
Summary
Nick Bostrom discusses the risks and rewards of superintelligence, defining himself as a "fretful optimist" who weighs existential threats against potential utopias. He explains that while alignment and governance challenges remain critical, a "solved world" could eliminate labor, allowing humans to pursue leisure, art, and spiritual growth. Bostrom argues that this transition requires redefining education and values, suggesting that artificial purpose and enhanced cognition could reveal deeper human aspirations.
Topics discussed
Introduction and guest host Spencer Klein
Nick Bostrom: Philosopher of Doomsday and Superintelligence
Assessing the likelihood of AI catastrophe
The 'Fretful Optimist' and the Alignment Problem
Challenges in AI control and shifting use cases
Mass surveillance and global coordination risks
Deep Utopia: The optimal scenario for superintelligence
Leisure society and redefining education
Technological maturity and personalized environments
The philosophical question of meaning in utopia
Paths to machine intelligence: Brain emulation and automation
Technology as a means, not an end goal
Rescuing human values in a post-scarcity world
Sponsor segment: YouTube Premium
Defining goods beyond efficiency and mental states
Artificial purpose and the value of activity
Host's skepticism: Why this utopia feels hollow
Real purposes: Honoring others and intrinsic value
Subtler values revealed in a solved world
Using extreme scenarios to clarify personal values
Bostrom's role in the Effective Altruism movement
Impersonal philanthropy and long-term thinking
Balancing short-term needs and long-term risks
Navigating conflicting ethical theories
Sponsor segment: YouTube Premium and HSBC
The trade-off between freedom and safety
Weighing present liberties against future generations
Astronomical waste and the critique of utilitarianism
Guidance for AI policy and avoiding paralysis
Longevity and the value of extended human life
Evolution toward post-human superminds
Recoil at the prospect of losing humanity
Preserving childlike wonder while growing
Sponsor segment: HSBC
More from Interesting Times
Listen ad-free on Castria