Browse / Misinformation and External Harm / AIID-1187
Google AI Overviews and ChatGPT Reportedly Cited Fraudulent Cruise Hotline, Allegedly Enabling Successful Scam
- Class
- Misinformation and External Harm (filed by a model that read the source)
- Technique
- Real-world incidents
What happened, in short
Scammers manipulated Google AI Overviews and ChatGPT to surface a fraudulent Royal Caribbean hotline, and a victim gave his credit card details to the impostor. (Our summary, written by a model. The source text is below.)
Details
Google's AI Overviews allegedly surfaced a fraudulent customer service number for Royal Caribbean. Consumer Alex Rivlin reportedly called the number, spoke with an impostor, and provided his credit card, later incurring $768 in fraudulent charges. The same number reportedly appeared in ChatGPT results and was linked to Disney and Princess cruises, purportedly showing how scammers are manipulating AI outputs to amplify longstanding hotline scams.
References
Source: AI Incident Database, used under CC BY-SA 4.0.