It was printed by KPMG, one of many world’s ‘Large 4’ accounting companies.
In October final 12 months, KPMG printed a report titled Whole Expertise: Redefining Excellence within the Age of Agentic AI, which was about how corporations are utilizing AI to cater to clients’ wants. KPMG is among the “Large 4” skilled providers and accounting companies on the planet, together with Deloitte, PricewaterhouseCoopers and Ernst & Younger. Apparently, although, that report was filled with AI hallucinations and included examples of agentic AIs that both didn’t exist or didn’t have the capabilities KPMG said within the paper. Investigators for GPTZero, the maker of an AI content material detection software, discovered inaccuracies and faux footnotes everywhere in the report, which had been additionally verified by the Financial Times.
In its report of the investigation, GPTZero stated that solely 5 citations out of 45 within the paper precisely pointed to actual sources. A complete of 28 citations paraphrased titles or added pretend elements to actual sources, whereas 12 had been phrased too vaguely to find out whether or not they truly existed. GPTZero referred to as the creation of faux references by AI fashions “vibe citing.”
Along with the pretend or inaccurate citations, the investigators additionally discovered that roughly half of the claims within the paper had been pretend or misattributed. They had been “seemingly the results of an AI analysis software over-complying with a request to seek out examples of ‘agentic AI’ within the wild,” GPTZero wrote. In a single instance, KPMG claimed that Emirates launched a cell chatbot referred to as Sara that may speak to passengers and alter their flights for them. Sara was a cell assistant launched in 2023 and never an AI-powered chatbot, and it additionally did not have the facility to alter bookings for passengers.
KPMG additionally claimed that Swiss multinational funding financial institution UBS built-in agentic AI throughout its “funding advisory, threat administration and compliance monitoring.” The financial institution informed the Occasions that the knowledge was “factually incorrect.” In one other instance, KMPG stated that Swiss Federal Railways (SBB) has AI brokers that may assist passengers plan, e book and optimize their journeys based mostly on preferences, real-time circumstances and carbon affect. An SBB spokesperson stated that was “not correct.”
Papers by corporations like KPMG are usually cited in different analysis papers and articles, since they’re thought of as extremely trusted sources. GPTZero chief govt Edward Tian defined that error-riddled papers printed by the Large 4 might “poison the nicely of data” and will result in second-hand AI hallucinations. A KPMG spokesperson informed the Occasions that the corporate “takes the accuracy and integrity of its printed content material significantly.” KPMG has since pulled the paper and is now “reviewing the circumstances surrounding its publication.”
