Technology

54 readers

2 users here now

Community dedicated to the news and discussions about the creation and use of technology and its surrounding issues.

founded 1 month ago

MODERATORS

tfm

Wikimedia is dealing with a 50 percent increase in bandwidth due to AI crawlers (www.techzine.eu)

submitted 1 week ago by tfm to c/Tech

1 comments fedilink hide all child comments

cross-posted from: https://metawire.eu/post/5948

Since January 2024, Wikimedia has seen a 50 percent increase in Wikipedia’s bandwidth usage. However, this enormous increase is not due to human users suddenly reading Wikipedia articles or watching videos but to AI crawlers that automatically scrape content to train AI models. This creates new challenges for the foundation. The sudden increase in traffic […]

Creator: Coen van Eenbergen Publish Date: 07.04.2025, 17:28 Categories: Infrastructure, AI, AI crawlers, Artificial Intelligence, bandwidth, content scraping, Wikimedia, Wikipedia

top 1 comments

sorted by: hot top controversial new old

[–] j4k3@lemmy.world 4 points 1 week ago

Indirectly too I think. I use wiki much more often as my default search location now. Search engines are garbage and often override or ignore booleans. The results that are garbage are shilled.