MISFIRE

Browse / Sensitive Data Disclosure / AIID-1349

AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims

AIID-1349 ยท 2025-10-24 real-world incident

Class
Sensitive Data Disclosure (filed by a model that read the source)
Technique
Real-world incidents
Affected
Nudenet Dataset Maintainers, Nudenet Model Developers (incident)

What happened, in short

NudeNet, an image dataset used to train nudity detectors, reportedly contained CSAM including images of known victims and was widely downloaded before removal after notification. (Our summary, written by a model. The source text is below.)

Details

An image dataset, NudeNet, used to train systems for detecting nudity was reportedly found to contain CSAM images, including material involving identified or known victims. According to the Canadian Centre for Child Protection, the dataset had been widely downloaded and cited in academic research prior to discovery. The images were allegedly included without vetting, exposing researchers to legal risk and perpetuating harm to victims. The dataset was subsequently removed following notification.

References

Source: AI Incident Database, used under CC BY-SA 4.0.