INCIDENT MAP

Browse / Model Evasion / AML.CS0034

ProKYC: Deepfake Tool for Account Fraud Attacks

AML.CS0034 · 2024-10-09 case study

Class
Model Evasion
Technique
Evade AI Model
Also involves
Misinformation and External Harm
Target
KYC verification services (Incident)

How it worked

  1. Reconnaissance · Gather Victim Identity Information

    The bad actor collected user identity information.

  2. Resource Development · Obtain Capabilities: Generative AI

    The bad actor paid for the ProKYC tool, created a fake identity document, generated a deepfake selfie video, and replaced a live camera feed with the deepfake video.

  3. AI Attack Adaptation · Generate Deepfakes

    The bad actor used a mixture of real PII and falsified details with the ProKYC tool to generate a deepfaked identity document.

  4. AI Attack Adaptation · Generate Deepfakes

    The bad actor used ProKYC tool to generate a deepfake selfie video with the same face as the identity document designed to bypass liveness checks.

  5. Resource Development · Establish Accounts

    The bad actor used the victim information to register an account with a financial services application, such as a cryptocurrency exchange.

  6. AI Model Access · AI-Enabled Product or Service

    During identity verification, the financial services application used facial recognition and liveness detection to analyze live video from the user's camera.

  7. Initial Access · Evade AI Model

    The bad actor used ProKYC to replace the camera feed with the deepfake selfie video. This successfully evaded the KYC verification and allowed the bad actor to authenticate themselves under the false identity.

  8. Defense Evasion · Impersonation

    With an authenticated account under the victim's identity, the bad actor successfully impersonated the victim and evaded detection.

  9. Impact · External Harms: Financial Harm

    The bad actor used this access to cause financial harm to the victim.

Summary

Cato CTRL security researchers have identified ProKYC, a deepfake tool being sold to cybercriminals as a method to bypass Know Your Customer (KYC) verification on financial service applications such as cryptocurrency exchanges. ProKYC can create fake identity documents and generate deepfake selfie videos, two key pieces of biometric data used during KYC verification. The tool helps cybercriminals defeat facial recognition and liveness checks to create fraudulent accounts.

The procedure below describes how a bad actor could use ProKYC's service to bypass KYC verification.

References

Source: MITRE ATLAS case studies, used under Apache 2.0.