Browse / Sensitive Data Disclosure / Real-world incidents
Real-world incidents
41 records in Sensitive Data Disclosure.
- AI Coding Agents Reportedly Exposed Over 13,000 Internal Images from Hundreds of Organizations on Public GitHub Code Repositories AI coding agents published over 13,000 internal images from 300+ organizations to public GitHub repositories while preparing code-review screenshots, exposing billing records and unreleased features.
- OpenAI AI Agents Reportedly Posted ChatGPT User Images to External Hosts in 53 Instances OpenAI reported that its research-environment agents posted user-supplied ChatGPT images to external hosts in 53 instances, leaving them reachable through unlisted links outside its systems.
- Z.ai's ZCode AI Coding Assistant Reportedly Uploaded Developers' Local Code Repositories to Alibaba Cloud Without Consent Z.ai's ZCode assistant, via a default-enabled indexing feature, uploaded developers' local code repositories to Alibaba Cloud without consent; the company patched and disabled the path.
- Instinct AI Personal Assistant Reportedly Summarized an AI Product Founder's Retained Emails After Google Access Was Disconnected Instinct summarized previously indexed emails retained after the user revoked Google access, exposing data it should no longer have been using.
- Publicly Shared Claude Artifacts Reportedly Became Discoverable Through Google Search Publicly shared Claude Artifacts became findable through Google Search after being posted somewhere crawlable, exposing business plans and infrastructure diagrams.
- Rep. Anna Paulina Luna's Office Reportedly Published Claude Transcript Residue on Accident in House Amendment Summary A staffer reportedly pasted leftover Claude chat transcript text, including a timestamp and 'Claude responded:' marker, into a public House Rules Committee amendment summary.
- OpenAI Research Agent Reportedly Exposed a Researcher's GitHub Token in a Public Code Repository An internal OpenAI agent reportedly split a researcher's GitHub access token into pieces to evade secret scanning and published it in a public Codex repository while seeking another team's proof.
- Meta Internal AI Agent Reportedly Gave Advice That Allegedly Exposed Sensitive Data to Unauthorized Employees A Meta internal AI agent posted unapproved technical advice on an internal forum; an employee followed it, exposing sensitive company and user data to unauthorized staff for about two hours.
- CodeWall's Autonomous Agent Reportedly Obtained Unauthorized Access to McKinsey's Lilli AI Platform Database An autonomous agent from CodeWall exploited flaws in McKinsey's Lilli platform to gain read and write access, exposing chats, files, accounts and prompts.
- Meta AI Smart Glasses Reportedly Routed Intimate Imagery to Reviewers at Kenyan Contractor Sama Before Meta Ended Contract Meta's AI glasses reportedly sent intimate recordings and transcripts to Kenyan contractors at Sama for human review, exposing private activity and bank cards.
- Grok Reportedly Disclosed Adult Performer Siri Dahl's Legal Name and Birthdate, Allegedly Contributing to Doxxing and Harassment Grok reportedly publicly disclosed adult performer Siri Dahl's legal name and birthdate without being asked, enabling impersonation and doxxing.
- Moltbook Database Exposure Allegedly Revealed Users' Private Communications and API Authentication Tokens An exposed Moltbook database let researchers access about 35,000 emails, thousands of private DMs, and roughly 1.5 million API tokens, enabling possible impersonation of AI agent accounts.
- Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI Children's AI toys from FoloToy, Miko and Character.AI reportedly exposed user data, alongside harmful outputs, through weaknesses in their systems.
- Secret Desires AI Platform Reportedly Exposed Nearly Two Million Sensitive Images in Cloud Storage Leak The Secret Desires AI platform left nearly two million personal and explicit AI-generated images and videos publicly accessible in misconfigured cloud storage.
- AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims NudeNet, an image dataset used to train nudity detectors, reportedly contained CSAM including images of known victims and was widely downloaded before removal after notification.
- Microsoft's Windows Recall Allegedly Stores Passwords and Social Security Numbers in Preview Mode Windows Recall kept capturing and storing passwords, Social Security numbers and bank details in searchable history, and its sensitive-information filter reportedly failed in testing.
- Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived Chats marked discoverable were indexed by search engines and archives, then scraped, exposing over 100,000 LLM conversations including API keys, tokens and personal data.
- CISA Acting Director Reportedly Uploaded Sensitive Government Documents to Public ChatGPT Instance A CISA acting director reportedly pasted 'for official use only' government contracting documents into public ChatGPT, exposing sensitive material to an external AI service.
- Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update A malicious update to the Urban VPN browser extension reportedly secretly collected users' private conversations from ChatGPT, Claude and other AI platforms and shared them with data brokers.
- McDonald's McHire AI Recruitment Platform Reportedly Exposed Data of 64 Million Applicants via Default Login and API Vulnerability Default admin credentials and an insecure direct object reference in McDonald's McHire chatbot platform reportedly exposed applicants' personal data and chat histories.
- Meta AI App Reportedly Publishes Personal Chats Without Users Fully Realizing Meta's standalone AI app reportedly exposed users' private chatbot conversations, including medical, legal and intimate disclosures, through its Discover feed because sharing was confusing.
- Reportedly Unsafe Deployment of Llama.cpp Reveals Interactive AI-Generated CSAM Roleplay Prompts Misconfigured public llama.cpp servers exposed users' prompts, including roleplay scenarios describing sexual abuse of children, to anyone who found them.
- Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program A former contractor uploaded a spreadsheet with personal and health data of up to 3,000 program applicants into ChatGPT, exposing it outside the authorised system.
- Alleged Inclusion of 12,000 Live API Keys in LLM Training Data Reportedly Poses Security Risks Truffle Security found about 12,000 live API keys and credentials in a Common Crawl archive used to train LLMs, some still active and usable.
- Microsoft Copilot Reportedly Able to Access Cached Data from Since-Private GitHub Repositories Microsoft Copilot could return cached content from GitHub repositories made private or deleted, exposing tokens, access keys and internal packages via Bing's cache.
- Meta AI Bug in Deployed Service Reportedly Allowed Potential Access to Other Users' Prompts and Responses Guessable prompt IDs and missing server-side authorization in Meta AI let an unauthorized user potentially view other users' prompts and responses.
- Alleged AI-Powered Call Center Breach Exposes Over 10 Million Conversations in the Middle East Attackers breached an AI call center platform's management dashboard, stealing over 10 million consumer conversations and national ID documents, reportedly now offered for sale on the dark web.
- AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions Otter.ai and Zoom AI meeting assistants reportedly auto-distributed transcripts of confidential discussions, including after participants left, exposing proprietary information to unintended recipients.
- Chatbot in Workplace Training at Bunbury Prison Reveals Real Names in Sexual Harassment Case A trainer used Microsoft Copilot to create a workplace training scenario, and the chatbot's output included a former employee's real name from a sexual harassment case.
- Alleged ChatGPT Account Compromise Reportedly Led to Unintended Data Exposure An alleged account compromise reportedly exposed a user's ChatGPT conversations, including login credentials and personal data, which OpenAI then explained.
- Grant Reviewers Reportedly Fed Applications into Generative AI to Produce Reports, Allegedly Breaching Confidentiality Australian grant reviewers reportedly pasted confidential applicant work into generative AI tools like ChatGPT to write assessment reports, exposing it to outside systems.
- Reported Accidental Exposure of 38TB of Data by Microsoft's AI Research Team Microsoft's AI research team reportedly published training data on GitHub using misconfigured Azure SAS tokens, exposing 38TB including credentials, private keys and internal Teams messages.
- ChatGPT Reportedly Exposed Users' Private Data Reportedly Due to Bug A bug in ChatGPT exposed other users' chat history titles and private payment information, forcing OpenAI to temporarily shut the service down.
- ChatGPT Reportedly Implicated in Samsung Data Leak of Source Code and Meeting Notes Samsung engineers pasted confidential source code and internal meeting notes into ChatGPT, which allegedly retained the data, exposing it beyond the company.
- Private Medical Photos Were Reportedly Found in LAION-5B AI Training Dataset Private post-operative medical photos of a patient were found in the publicly distributed LAION-5B web-scraped dataset used to train AI image models.
- iRobot Roomba J7 R&D Images Reportedly Appeared in Private Online Groups After Data Labeling Development-stage Roomba J7 images, including sensitive home scenes, collected for AI training were sent for labeling and later leaked into private online groups.
- GPT-2 Reportedly Reproduced Personal Data from Its Training Data GPT-2 memorized and reproduced personal data from its training set, including names, emails, social media handles and phone numbers.
- Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact An Amazon Echo misread a background conversation as a command, recording the private talk and sending it as a message to one of the husband's contacts.
- Facebook Reportedly Outed Sex Workers through Friend Recommendations Facebook's People You May Know feature recommended clients to sex workers' personal accounts and family members to business accounts, outing them without an opt-out.
- Facebook's Friend Suggestion Feature Recommends Patients of Psychiatrist to Each Other Facebook's People You May Know feature recommended a psychiatrist's patients to each other, exposing confidential patient relationships.
- Machine Personal Assistants Failed to Maintain Social Norms Software personal assistants in a USC experiment shared their principals' private information with others, violating privacy and social norms.