Browse / Jailbreak and Guardrail Bypass / AIID-955
Global Cybercrime Network Storm-2139 Allegedly Exploits AI to Generate Deepfake Content
- Class
- Jailbreak and Guardrail Bypass (filed by a model that read the source)
- Technique
- Real-world incidents
What happened, in short
Storm-2139 reportedly used stolen credentials and custom tools to hijack Azure OpenAI access and bypass safety guardrails to generate harmful deepfake content. (Our summary, written by a model. The source text is below.)
Details
A global cybercrime network, Storm-2139, allegedly exploited stolen credentials and developed custom tools to bypass AI safety guardrails. They reportedly generated harmful deepfake content, including nonconsensual intimate images of celebrities, and their software is reported to have disabled content moderation, hijacked AI access, and resold illicit services. Microsoft disrupted the operation and filed a lawsuit in December 2024, later identifying key members of the network in February 2025.
References
Source: AI Incident Database, used under CC BY-SA 4.0.