Does intelligence need a hard cap?
Summary
Casey Newton reports on The Curve conference, where AI leaders debated capping model intelligence to prevent recursive self-improvement risks. He also announces his return to X, explaining that despite his objections to its management, the platform remains essential for engaging in critical AI policy discussions.
Topics discussed
Introduction and ethics disclosure
Overview of the push to limit AI intelligence
Atmosphere and context of The Curve conference
Drivers: OpenAI incident and recursive self-improvement
Debate on capping superhuman intelligence
Chatham House rule and newsworthy consensus
Proposed mechanisms for limiting AI advancement
Enforcement challenges and government opposition
Alternative safety measures and their limitations
Divergence between lab leaders and US government
Critique of 'superintelligence' branding
Reasons for originally leaving X
Support for alternative platforms like Threads and Bluesky
Failure to create a viable rival to X
X's absorption into XAI and SpaceX
Decision to resume posting on X
Cost-benefit analysis of the X boycott
Conclusion and credits
Listen ad-free on Castria