MISFIRE

Browse / Unbounded Consumption / AIID-1001

LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem

AIID-1001 ยท 2025-03-17 real-world incident

Class
Unbounded Consumption (filed by a model that read the source)
Technique
Real-world incidents
Affected
Alibaba, Generative AI Developers (incident)

What happened, in short

Aggressive AI scrapers from Alibaba IP ranges ignored robots.txt and spoofed browser headers, overwhelming KDE, GNOME and other FOSS sites and causing outages. (Our summary, written by a model. The source text is below.)

Details

In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.

References

Source: AI Incident Database, used under CC BY-SA 4.0.