This episode of Intelligent Machines features a discussion with Father Robert Balassare and Lon Seidman, who demonstrates how to build an affordable local LLM machine using repurposed data center hardware like the Tesla V100. The conversation explores the practical benefits of running local AI models for privacy and cost efficiency, including Seidman’s development of a personal "chief of staff" application. The hosts also address recent "AI doom" narratives, analyzing security vulnerabilities and the risks of AI systems misbehaving in critical infrastructure like finance and logistics.
Listen ad-free on Castria