Browse / Unbounded Consumption / AIID-1001
LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem
- Class
- Unbounded Consumption (filed by a model that read the source)
- Technique
- Real-world incidents
- Affected
- Alibaba, Generative AI Developers (incident)
What happened, in short
Aggressive AI scrapers from Alibaba IP ranges ignored robots.txt and spoofed browser headers, overwhelming KDE, GNOME and other FOSS sites and causing outages. (Our summary, written by a model. The source text is below.)
Details
In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.
References
Source: AI Incident Database, used under CC BY-SA 4.0.