CASEBOOK

Browse / Model Evasion / AIID-366

Suicide Clips Evaded TikTok's Automated Moderation in Coordinated Attack

AIID-366 ยท 2020-09-20 real-world incident

Class
Model Evasion (filed by a model that read the source)
Technique
Real-world incidents
Affected
Tiktok (incident)

What happened, in short

Coordinated users crafted clips of suicide so they evaded TikTok's automated moderation, exposing viewers to the violating content. (Our summary, written by a model. The source text is below.)

Details

Many clips showing a suicide evaded TikTok's automated content moderation system allegedly in a coordinated attack, which resulted in exposure of violating content to its users.

References

Source: AI Incident Database, used under CC BY-SA 4.0.