all 3 comments

sorted by: hot top controversial new old
[–] 21 points 8 months ago (1 child)

Interesting numbers for people who dont wanna read :

  • on all the new contributors they taught, only ~5% were flagged by the AI detection tool.
  • on the AI flagged articles, only 7% presented sources that didn't even exist. Most of the AI outputed correct statements with existing sources.
  • however, north of 66% of AI articles failed verification : the citations or facts could not be found in the sources provided by AI
  • source
  • hideshow 1 child comment
  • [–] 4 points 8 months ago

    From the article:

    "A total of 178 out of the 3,078 articles came back as flagged for AI ... About half of our staff spent a month during summer 2025 painstakingly reviewing the text from these 178 articles....

    Far more insidious, however, was something else we discovered: More than two-thirds of these articles failed verification. That means the article contained a plausible-sounding sentence, cited to a real, relevant-sounding source. But when you read the source it’s cited to, the information on Wikipedia does not exist in that specific source."

  • source