09/23/2026
***AI CHATBOTS GIVE WRONG FINANCIAL ANSWERS MOST OF THE TIME, study finds ***
Popular AI chatbots give incorrect or incomplete answers to financial questions more often than they get them right, according to a new comprehensive benchmarking study by Saturn, an AI and technology firm serving more than 750 financial advice firms and 6,500 advisors.
The Saturn "Artificial Authority" report - the most in-depth benchmarking exercise of its kind to date - tested 18 AI models across 121 different money-related questions, with each question run five times to account for variability. In total, more than 10,000 responses were assessed. The models tested included free and paid-for versions of ChatGPT, Gemini, Claude and CoPilot, across a range of difficulty levels.
Across all 17 current models (one retired model was excluded from the headline figures) the average accuracy rate was just 43%, meaning AI chatbots made mistakes 57% of the time, according to Saturn, which is based in the UK.