This accident illustrates that generative AI services are still too immature to produce reliable information for the public, and should not be allowed on the market for such uses.
This statement was originally published on rsf.org on 17 December 2024.
Reporters Without Borders (RSF) is very concerned about the risks posed to media outlets by new artificial intelligence (AI) tools after a new Apple product generated a false news alert and attributed it to the BBC. This accident illustrates that generative AI services are still too immature to produce reliable information for the public, and should not be allowed on the market for such uses.
The Apple Intelligence feature launched in the UK on 11 December by the company behind the iPhone took less than forty-eight hours to demonstrate that its new generative AI tool is incapable of producing reliable information in a consistant, trustworthy manner. On 13 December, the BBC announced a complaint to Apple following a summary generated by the new AI feature of the British broadcaster’s news notifications that announced the suicide of Luigi Mangione, the main suspect in the murder of the CEO of UnitedHealthcare. This information was completely false.
This accident highlights the inability of AI systems to systematically publish quality information, even when it is based on journalistic sources. The probabilistic way in which AI systems operate automatically disqualifies them as a reliable technology for news media that can be used in solutions aimed at the general public.
“AIs are probability machines, and facts can’t be decided by a roll of the dice. RSF calls on Apple to act responsibly by removing this feature. The automated production of false information attributed to a media outlet is a blow to the outlet’s credibility and a danger to the public’s right to reliable information on current affairs. The European AI Act — despite being the most advanced legislation in the world in this area — did not classified information-generating AIs as high-risk systems, leaving a critical legal vacuum. This gap must be filled immediately.”
Vincent Berthier, Head of RSF’s Technology and Journalism Desk
Faced with the upheavals caused by AI in the information space, the Paris Charter initiated by RSF sets out ten essential principles to guarantee the integrity of information and preserve journalism’s role as a public service. Among the central principles, it states that: “Rights holders must make the re-use of their content conditional on respect for the integrity of the information and the fundamental principles of journalistic ethics.”
