4OpenAI Blog·
OpenAI bans account that used AI to fabricate fake ChatGPT 'Russian troll' error message
OpenAI banned a likely US-based account that used AI to generate a fake ChatGPT error message falsely claiming to detect 'Russian troll' activity. The fabricated screenshot was designed to spread disinformation by impersonating OpenAI's platform. This is part of OpenAI's ongoing effort to disrupt malicious uses of its AI systems.
Related guides (3)
Related events (8)
OpenAI bans Russia-origin 'Stop News' influence operation using AI-generated content
OpenAI banned a cluster of accounts linked to a Russia-origin influence operation dubbed 'Stop News,' which used AI tools to generate multilingual articles and social media posts targeting audiences in Ukraine and Western countries. The operation represents a documented case of AI being weaponized for coordinated inauthentic behavior at scale. OpenAI's disclosure is part of its ongoing effort to detect and disrupt malicious uses of its platform.
OpenAI bans accounts linked to Russian 'Doppelganger' influence operation targeting Ukraine
OpenAI identified and banned accounts associated with the Russia-origin 'Doppelganger' influence operation, which used OpenAI tools to generate anti-Ukraine social media comments, translations, and website copy in multiple languages. The action is part of OpenAI's ongoing effort to detect and disrupt malicious uses of its AI systems. This case illustrates the use of generative AI in state-linked information operations.
OpenAI bans accounts using AI to generate anti-corruption criticism targeting Russian foundation
OpenAI identified and banned accounts that were using its AI systems to generate comments criticizing a Russian anti-corruption foundation and associated figures. The operation represents a documented case of AI-enabled influence operations being disrupted by a frontier lab. This is relevant to AI misuse tracking and platform safety enforcement.
OpenAI bans accounts linked to deceptive AI-assisted fake IT worker employment scheme
OpenAI banned accounts associated with suspected deceptive employment campaigns that used AI tools to generate materials for fraudulent remote-job applications. The operation appears connected to the broader pattern of North Korean-linked IT worker schemes that have targeted Western companies. OpenAI's disclosure is a primary-source safety enforcement action documenting a novel misuse vector.
OpenAI bans accounts linked to Russian-speaking criminal groups building AI-assisted malware
OpenAI identified and banned accounts likely associated with Russian-speaking criminal groups that were using AI to develop malware loaders, evasion layers, credential-theft scripts, and command-and-control infrastructure. The action is part of OpenAI's ongoing effort to disrupt malicious uses of its platform. This case documents a concrete instance of threat actors operationalizing frontier AI for offensive cyber tooling.
OpenAI bans accounts using AI to power romance-baiting pig butchering scams
OpenAI identified and banned accounts apparently originating in Cambodia that were using its AI to translate and generate conversations for romance-baiting and investment scam (pig butchering) workflows. The action represents a concrete enforcement case of AI being weaponized for large-scale fraud operations. This is a notable safety/misuse incident from a tier-1 source.
OpenAI bans accounts linked to North Korea-style deceptive IT-worker employment scheme
OpenAI banned accounts suspected of facilitating a deceptive employment scheme bearing characteristics of publicly reported North Korea-linked IT-worker activity. The operation appears to involve using AI tools to support fraudulent job applications or remote work impersonation. This is a concrete enforcement action by a major AI lab against state-linked misuse of AI systems.
OpenAI bans accounts linked to China-origin 'Spamouflage' influence operation
OpenAI terminated accounts associated with 'Spamouflage', a PRC-linked covert influence operation that used OpenAI tools to research social media activity, generate posts, and debug a previously unreported website. The action represents OpenAI's enforcement against state-linked misuse of its AI systems for information operations. This is notable as a documented case of a major lab detecting and disrupting foreign influence activity leveraging generative AI.