Gazatte
Independent journalism
  • Gold$3,753.61▼ down 2.48%
  • Bitcoin$63,179.00▼ down 2.33%
  • EUR/USD1.0966▼ down 0.30%
  • USD/ILS3.2780▲ up 0.72%
  • Ethereum$1,769.08▼ down 2.48%
  • GBP/USD1.3148▼ down 0.46%
  • USD/EGP53.75▲ up 0.07%
  • Silver$45.11▼ down 4.84%
  • USD/JPY159.28▼ down 0.10%
  • USD/TRY50.44▼ down 0.02%
  • USD/JOD0.70900.00%
  • USD/SAR3.7523▼ down 0.11%
  • Gold$3,753.61▼ down 2.48%
  • Bitcoin$63,179.00▼ down 2.33%
  • EUR/USD1.0966▼ down 0.30%
  • USD/ILS3.2780▲ up 0.72%
  • Ethereum$1,769.08▼ down 2.48%
  • GBP/USD1.3148▼ down 0.46%
  • USD/EGP53.75▲ up 0.07%
  • Silver$45.11▼ down 4.84%
  • USD/JPY159.28▼ down 0.10%
  • USD/TRY50.44▼ down 0.02%
  • USD/JOD0.70900.00%
  • USD/SAR3.7523▼ down 0.11%
Skip to content
Gazatte
Middle EastPalestineWorldPoliticsBusinessCultureOpinionMarkets
Gazatte
Menu
Log in

Sections

Middle EastLebanonSyriaYemenGulfIran-Israel War
PalestineGazaWest BankJerusalemPalestinians of '48
WorldAmericasRussia-Ukraine WarEuropeAsia-PacificAfricaMore world news
PoliticsU.S. PoliticsEuropean PoliticsElectionsDiplomacy & Foreign PolicyInternational Law & Human Rights
Business
CultureCurrent
Opinion
Sports
Travel
Language
GazatteMiddle East & World News
Log in
/
Gazatte
BusinessCultureOpinionMarkets
  1. Culture & Society

AI tools expose long-hidden errors in scientific research

AI tools are exposing mistakes in scientific papers and databases, but researchers still need to verify what the models flag.

By Gazatte Staff

16 August 2026, 14:58 GMT · 3 min read ·

AI tools expose long-hidden errors in scientific research

Artificial intelligence tools are increasingly being used not only to generate scientific research, but also to check the accuracy of existing work, exposing mistakes that have sometimes remained in the scientific record for decades.

One recent chemistry example came from Zhejiang Lab’s 021 science foundation model. During a boiling-point prediction exercise, the model produced results that conflicted with established values in scientific literature and databases. Researchers initially treated the discrepancy as a possible model error, but checking the underlying sources reportedly revealed a decades-old typographical mistake and measurements made with outdated instruments.

The episode illustrates a broader problem with scientific data: an incorrect value can become difficult to challenge once it has been copied from an original paper into reference books and then into digital databases. Researchers have increasingly turned to machine-learning systems to identify such inconsistencies, particularly when large datasets make manual checking difficult. Studies of chemical databases have also documented errors introduced both in original research and during the transfer of information into databases.

The same approach is now being tested directly on scientific papers.

A study by researchers including Federico Bianchi and James Zou developed a GPT-5-based system called the Paper Correctness Checker to identify objective errors in published artificial-intelligence research, including incorrect equations, calculations, figures and tables. The researchers examined 2,500 papers from ICLR, NeurIPS and TMLR and found an average of 4.7 such errors per paper.

Article image

The number increased over time at NeurIPS, from an average of 3.8 errors per paper in 2021 to 5.9 in 2025, a rise of 55.3%. Mathematical and formula-related mistakes accounted for 54% of the errors identified by the system.

Human experts examined 316 potential mistakes flagged by the AI and confirmed 263 of them, giving the system a precision rate of 83.2%. It also proposed corrections that researchers judged correct in 75.8% of cases. The researchers stressed that the system is intended to assist human reviewers rather than replace them.

More in Culture & Society
  • ENVIRONMENTPeru grants legal rights to stingless bees in world first for insects
  • MOROCCAN CULTUREMorocco’s El Mansouri wears traditional caftan at Kremlin reception
  • EUROVISION BOYCOTTNetherlands reverses Eurovision return over Israel's participation
  • CHILDHOOD VACCINATION POLICYUS hepatitis B vaccine policy may leave infants at risk, study warns

Other research points to the limits of this approach. The SPOT benchmark tested AI systems on 83 published scientific papers containing 91 errors that had been confirmed by authors and were serious enough to result in corrections or retractions. The best-performing model detected only 21.1% of the errors, while its precision was 6.1%, showing how difficult reliable scientific verification remains for current models.

Google is also developing tools aimed at bringing AI into scientific validation. Its experimental Paper Assistant Tool is designed to analyse complete manuscripts, check theoretical results and experiments, and identify possible flaws. Google says it is testing such systems with major scientific conferences including ICML, STOC and NeurIPS.

The emerging picture is therefore more complicated than the familiar warning that AI can invent information. The same technology can also be useful for finding contradictions in human-generated research, particularly where an answer can be checked through calculations, equations or underlying data.

But the evidence does not support treating AI as the final authority on scientific truth. Current systems can miss serious errors and generate incorrect warnings of their own. Their most useful role is narrower: identifying anomalies and questions that scientists can then investigate against the original evidence.

Gazatte follows its Editorial Policy. Spotted an error? Tell us.

Add Gazatte as a preferred source on Google

More in Culture & Society

  • ENVIRONMENTPeru grants legal rights to stingless bees in world first for insects
  • MOROCCAN CULTUREMorocco’s El Mansouri wears traditional caftan at Kremlin reception
  • EUROVISION BOYCOTTNetherlands reverses Eurovision return over Israel's participation
  • CHILDHOOD VACCINATION POLICYUS hepatitis B vaccine policy may leave infants at risk, study warns

More from Culture & Society

  • France education protests draw thousands as Lecornu suspends classes
    STUDENT EDUCATION PROTESTS

    France education protests draw thousands as Lecornu suspends classes

  • Nobel medicine prize honours three pioneers of optogenetics
    NOBEL MEDICINE PRIZE

    Nobel medicine prize honours three pioneers of optogenetics

  • Woman accused of firing 20 rounds at Rihanna’s home indicted
    LOS ANGELES SHOOTING

    Woman accused of firing 20 rounds at Rihanna’s home indicted

  • US returns 36 looted antiquities worth over $5m to Syria
    CULTURAL HERITAGE

    US returns 36 looted antiquities worth over $5m to Syria

  • Ed Sheeran calls Gaza war ‘catastrophic and unjustifiable’ after Macklemore tour dispute
    MUSIC AND GAZA

    Ed Sheeran calls Gaza war ‘catastrophic and unjustifiable’ after Macklemore tour dispute

  • UN backs Equal Earth map to show continents at truer scale
    WORLD MAPS

    UN backs Equal Earth map to show continents at truer scale

Gazatte

Independent news and analysis on the Middle East and the world.

Follow us
Add Gazatte as a preferred source on Google

Sections

  • Latest news
  • Markets
  • Palestine
  • Middle East
  • Politics & Diplomacy
  • Opinion
  • Business & Economy

About Gazatte

  • About Us
  • Our Newsroom
  • Editorial Policy
  • Corrections
  • Ownership & Funding

Contact

  • WhatsApp +44 7488 813779
  • support@gazatte.co
  • Contact Us

© Gazatte. All rights reserved.

  • Privacy Policy
  • Terms of Use
  • Cookie Policy