24/7 Space News
TECH SPACE
Hey chatbot, is this true? AI 'factchecks' sow misinformation
Hey chatbot, is this true? AI 'factchecks' sow misinformation
By Anuj Chopra with Sumit Dubey in New Delhi and Maria Clara Pestre in Rio de Janeiro
Washington (AFP) June 2, 2025

As misinformation exploded during India's four-day conflict with Pakistan, social media users turned to an AI chatbot for verification -- only to encounter more falsehoods, underscoring its unreliability as a fact-checking tool.

With tech platforms reducing human fact-checkers, users are increasingly relying on AI-powered chatbots -- including xAI's Grok, OpenAI's ChatGPT, and Google's Gemini -- in search of reliable information.

"Hey @Grok, is this true?" has become a common query on Elon Musk's platform X, where the AI assistant is built in, reflecting the growing trend of seeking instant debunks on social media.

But the responses are often themselves riddled with misinformation.

Grok -- now under renewed scrutiny for inserting "white genocide," a far-right conspiracy theory, into unrelated queries -- wrongly identified old video footage from Sudan's Khartoum airport as a missile strike on Pakistan's Nur Khan airbase during the country's recent conflict with India.

Unrelated footage of a building on fire in Nepal was misidentified as "likely" showing Pakistan's military response to Indian strikes.

"The growing reliance on Grok as a fact-checker comes as X and other major tech companies have scaled back investments in human fact-checkers," McKenzie Sadeghi, a researcher with the disinformation watchdog NewsGuard, told AFP.

"Our research has repeatedly found that AI chatbots are not reliable sources for news and information, particularly when it comes to breaking news," she warned.

- 'Fabricated' -

NewsGuard's research found that 10 leading chatbots were prone to repeating falsehoods, including Russian disinformation narratives and false or misleading claims related to the recent Australian election.

In a recent study of eight AI search tools, the Tow Center for Digital Journalism at Columbia University found that chatbots were "generally bad at declining to answer questions they couldn't answer accurately, offering incorrect or speculative answers instead."

When AFP fact-checkers in Uruguay asked Gemini about an AI-generated image of a woman, it not only confirmed its authenticity but fabricated details about her identity and where the image was likely taken.

Grok recently labeled a purported video of a giant anaconda swimming in the Amazon River as "genuine," even citing credible-sounding scientific expeditions to support its false claim.

In reality, the video was AI-generated, AFP fact-checkers in Latin America reported, noting that many users cited Grok's assessment as evidence the clip was real.

Such findings have raised concerns as surveys show that online users are increasingly shifting from traditional search engines to AI chatbots for information gathering and verification.

The shift also comes as Meta announced earlier this year it was ending its third-party fact-checking program in the United States, turning over the task of debunking falsehoods to ordinary users under a model known as "Community Notes," popularized by X.

Researchers have repeatedly questioned the effectiveness of "Community Notes" in combating falsehoods.

- 'Biased answers' -

Human fact-checking has long been a flashpoint in a hyperpolarized political climate, particularly in the United States, where conservative advocates maintain it suppresses free speech and censors right-wing content -- something professional fact-checkers vehemently reject.

AFP currently works in 26 languages with Facebook's fact-checking program, including in Asia, Latin America, and the European Union.

The quality and accuracy of AI chatbots can vary, depending on how they are trained and programmed, prompting concerns that their output may be subject to political influence or control.

Musk's xAI recently blamed an "unauthorized modification" for causing Grok to generate unsolicited posts referencing "white genocide" in South Africa.

When AI expert David Caswell asked Grok who might have modified its system prompt, the chatbot named Musk as the "most likely" culprit.

Musk, the South African-born billionaire backer of President Donald Trump, has previously peddled the unfounded claim that South Africa's leaders were "openly pushing for genocide" of white people.

"We have seen the way AI assistants can either fabricate results or give biased answers after human coders specifically change their instructions," Angie Holan, director of the International Fact-Checking Network, told AFP.

"I am especially concerned about the way Grok has mishandled requests concerning very sensitive matters after receiving instructions to provide pre-authorized answers."

burs-ac/nl

Related Links
Space Technology News - Applications and Research

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
TECH SPACE
NYT signs AI deal with Amazon; Generative AI's most prominent skeptic doubles down
New York (AFP) May 29, 2025
The New York Times has agreed a deal for Amazon to use its content to train artificial intelligence models, the leading US newspaper announced Thursday in its first generative AI licensing deal. Several media groups have already struck similar deals with major tech companies, but The New York Times had previously refused to allow its content to be used in the artificial intelligence race. The newspaper is suing Amazon rival OpenAI, which it accuses of copyright infringement - using its content ... read more

TECH SPACE
Chinese students lament US plans to block visas

Hong Kong to open universities to more foreign students after US ban

At Houston event, NASA astronauts will discuss their recent space station missions

Space tourism's growth blurs the line between scientific and symbolic achievement

TECH SPACE
Starship tumbles back to Ocean after reaching a nominal orbit

After two setbacks, SpaceX could try to launch massive Starship next week

After brief X outage, Musk says refocusing on businesses

SpaceX mega-rocket Starship 9 cleared for launch following earlier mission failures

TECH SPACE
NASA's Perseverance Mars Rover to Take Bite Out of 'Krokodillen'`

UT Austin Researchers Uncover Key Link in Early Martian Water Cycle

What Martian Craters Reveal About the Red Planet's Subsurface

Is Terraforming Mars a Realistic Goal?

TECH SPACE
China Establishes UN-SPIDER Regional Support Office at Wuhan University

Tiangong returns largest sample set yet for biological and materials science research

Space is a place to found a community not a colony

China's Shenzhou-19 astronauts return to Earth

TECH SPACE
SpaceX sends up more Starlink satellites from California

SpaceX deploys 23 Starlink satellites in first launch for new Falcon 9 booster

China's Satellite Navigation Industry Reaches $79.9 Billion in 2024

Making Satellite-Based Real-Time Data Processing a Global Reality

TECH SPACE
Gold and precious metals traced to Earth's core in Hawaiian lava

World first 3D printed soft robots walk off the printer fully formed

Virtual Reality Could Revolutionize Recycling Workforce Training

Laser technique revolutionizes ultra-high temperature ceramic manufacturing for space, defense applications

TECH SPACE
Doubt cast on claim of 'hints' of life on faraway planet

Nanodevice Sheds Light on Early Cyanobacterial Evolution

Twin Star Systems May Hold Key to Planet Formation Insights

Webb Finds First Clear Evidence of Frozen Water in Young Star System

TECH SPACE
The hunt for mysterious 'Planet Nine' offers up a surprise

SwRI Gathers First Ultraviolet Data from NASA's Europa Clipper Mission

Webb Uncovers New Mysteries in Jupiter's Aurora

Juno reveals subsurface secrets of Jupiter and Io

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.