This episode of Intelligent Machines features guest Lon Sideeman, who details his setup for running local AI models using repurposed data center GPUs like the Tesla V100 and Intel Arc B70. Sideeman shares his experience building a personal "chief of staff" and RAG system for school board duties, emphasizing the privacy and cost benefits of local inference over cloud services. The hosts also discuss the recent "AI doom" narrative sparked by Jacob Coxon's resignation, debating whether the primary risks lie in catastrophic existential threats or more immediate failures in critical infrastructu…
Listen ad-free on Castria