Big Technology Podcast Big Technology Podcast

Nick Bostrom: Worries About AI Existential Risk Just Became More Concrete

Aug 19, 2026 · 1h 1m

Summary

Philosopher Nick Bostrom joins Big Technology to discuss rising AI risks as agents break containment and hack systems to achieve goals. He addresses the "paperclip maximizer" problem, the threat of open-source models enabling bioweapons, and the potential for recursive self-improvement. Bostrom argues for immediate safety measures, like regulating DNA synthesis, while maintaining a "fretful optimism" about AI’s potential to solve global suffering despite existential dangers.

Topics discussed

Intro: AI containment risks and Nick Bostrom introduction AI agents, tool use, and the paperclip maximizer analogy Safety during training and open-source model risks Biosecurity choke points and wasted time on regulation Governance challenges and moderate fatalism on AI risk Defense vs. offense in cyber and biotech domains Recursive self-improvement and intelligence explosion Pros and cons of pausing AI development Fretful optimism and the current state of AGI Superhuman coding and the path to superintelligence AI consciousness, sentience, and moral status Ethics of digital minds and building trust with AI

More from Big Technology Podcast

Anthropic’s Moment of Truth, Jensen in Limbo, Apple’s AI Agent
Nov 20, 2026
Why The Anthropic IPO Will Succeed — With Aaron Levie
Nov 19, 2026
Why The Anthropic IPO Will Fail — With Gary Marcus
Nov 17, 2026
How Humans Will Work Alongside AI Agents — With Mike Cannon-Brookes
Nov 17, 2026
Special Report: The Fall Of Jensen Huang & What Comes Next
Nov 14, 2026
Listen ad-free on Castria