#190 - AI scaling struggles, OpenAI Agents, Super Weights
Summary
The hosts discuss reports of slowing AI progress at major labs, contrasting this with rapid advances in agentic AI and new reasoning APIs. They cover hardware developments, including OpenAI’s proposed $100 billion data center, XAI’s power approvals, and new chip benchmarks from NVIDIA and Google. Additional topics include Mia Maroti’s new venture, potential Amazon investment in Anthropic, the open-sourcing of AlphaFold 3, and a proposed decentralized trillion-parameter model.
Topics discussed
Sponsors and Intro
Hosts Intro and Episode Preview
Scaling Laws and Diminishing Returns
OpenAI Agents and Google Gemini 1.5 Pro
Image-to-Video and Hermes 3 Reasoning
AI Data Centers, Energy, and Hardware
Amazon and Anthropic Investment Talks
AlphaFold 3 and BitTensor Crypto Project
Super Weights in LLMs
Emergent Capabilities and Contextual Eval
EU AI Regulation and Anthropic Safety
US Chip Policy and OpenAI Departures
Outro and Credits
Listen ad-free on Castria