Can AI replace financial advice?
Summary
Which? tested five major AI chatbots on 15 personal finance questions, evaluating their accuracy, clarity, and reliability against expert standards. While the tools performed well on straightforward queries, they struggled with current data, often hallucinating facts or providing US-centric advice irrelevant to UK consumers. The investigation highlights that AI should supplement, not replace, traditional research, urging users to verify sources and be mindful of the technology's environmental and societal impacts.
Topics discussed
Introduction: The rise of AI chatbots in personal finance
Methodology: Testing 5 AI tools against 15 financial questions
Strengths: Summarizing straightforward financial information
Tailored advice: How AIs handle personal data and follow-ups
Best practices: Crafting effective prompts and verifying sources
Weaknesses: Hallucinations, outdated data, and 'cheating' answers
Case study: Travel insurance errors and unreliable sourcing
Comparison: AI chatbots vs. traditional search engines
Results: Accuracy scores and performance rankings of the bots
Broader impact: Environmental costs and job displacement concerns
Regulation: FCA oversight and industry responses to findings
Listen ad-free on Castria