Bonus: We Need to Build the Plane While We're Flying It
Summary
Nathan Calvin, general counsel at Encode, joins to discuss the escalating urgency of AI safety risks following the Hugging Face incident and recent researcher resignations. He explains how current AI capabilities are rapidly approaching dangerous thresholds, making existential threats more plausible than previously thought. The conversation explores the lack of adequate regulatory frameworks and proposes immediate "duct tape" solutions, such as mandatory kill switches and embedded third-party safety testers, to mitigate risks while governments build long-term oversight.
Topics discussed
Introduction and host banter
Introducing guest Nathan Calvin of Encode
Context: Recent AI incidents and the call for a pause
The shift in public awareness and the Y2K comparison
Analysis of the Hugging Face incident and model capabilities
Hypotheses for existential risk and rapid progress
Challenges of regulation, government trust, and international coordination
Building regulatory capacity while the plane is flying
Concrete safety measures: embedded testers and kill switches
Listen ad-free on Castria