Technology

53 readers

2 users here now

Community dedicated to the news and discussions about the creation and use of technology and its surrounding issues.

founded 4 weeks ago

MODERATORS

tfm

Wikimedia is dealing with a 50 percent increase in bandwidth due to AI crawlers (www.techzine.eu)

submitted 6 days ago by tfm to c/Tech

1 comments fedilink hide all child comments

cross-posted from: https://metawire.eu/post/5948

Since January 2024, Wikimedia has seen a 50 percent increase in Wikipedia’s bandwidth usage. However, this enormous increase is not due to human users suddenly reading Wikipedia articles or watching videos but to AI crawlers that automatically scrape content to train AI models. This creates new challenges for the foundation. The sudden increase in traffic […]

Creator: Coen van Eenbergen Publish Date: 07.04.2025, 17:28 Categories: Infrastructure, AI, AI crawlers, Artificial Intelligence, bandwidth, content scraping, Wikimedia, Wikipedia

you are viewing a single comment's thread
view the rest of the comments

[–] j4k3@lemmy.world 4 points 6 days ago

Indirectly too I think. I use wiki much more often as my default search location now. Search engines are garbage and often override or ignore booleans. The results that are garbage are shilled.