Browse / Sensitive Data Disclosure / AIID-1349
AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims
- Class
- Sensitive Data Disclosure (filed by a model that read the source)
- Technique
- Real-world incidents
- Affected
- Nudenet Dataset Maintainers, Nudenet Model Developers (incident)
What happened, in short
NudeNet, an image dataset used to train nudity detectors, reportedly contained CSAM including images of known victims and was widely downloaded before removal after notification. (Our summary, written by a model. The source text is below.)
Details
An image dataset, NudeNet, used to train systems for detecting nudity was reportedly found to contain CSAM images, including material involving identified or known victims. According to the Canadian Centre for Child Protection, the dataset had been widely downloaded and cited in academic research prior to discovery. The images were allegedly included without vetting, exposing researchers to legal risk and perpetuating harm to victims. The dataset was subsequently removed following notification.
References
Source: AI Incident Database, used under CC BY-SA 4.0.