OpenAI banned accounts that used its models via an Israel-based startup to generate conversations and distribute links to gambling sites on X (formerly Twitter). The operation represents a coordinated misuse of AI-generated content for spam and influence purposes. The disclosure is part of OpenAI's ongoing series of reports on disrupting malicious uses of its models.
OpenAI identified and banned accounts associated with online fraud networks that were using its models to generate scam scripts, impersonate individuals, translate content, and engage with victims. The action is part of OpenAI's ongoing effort to disrupt malicious uses of AI. This represents a concrete enforcement case documenting how threat actors are operationalizing LLMs for fraud at scale.
OpenAI terminated accounts associated with 'Spamouflage', a PRC-linked covert influence operation that used OpenAI tools to research social media activity, generate posts, and debug a previously unreported website. The action represents OpenAI's enforcement against state-linked misuse of its AI systems for information operations. This is notable as a documented case of a major lab detecting and disrupting foreign influence activity leveraging generative AI.
OpenAI identified and banned accounts apparently originating in Cambodia that were using its AI to translate and generate conversations for romance-baiting and investment scam (pig butchering) workflows. The action represents a concrete enforcement case of AI being weaponized for large-scale fraud operations. This is a notable safety/misuse incident from a tier-1 source.
OpenAI identified and banned accounts that were using its AI systems to generate comments criticizing a Russian anti-corruption foundation and associated figures. The operation represents a documented case of AI-enabled influence operations being disrupted by a frontier lab. This is relevant to AI misuse tracking and platform safety enforcement.
OpenAI identified and banned accounts that used its models to generate articles, social media posts, and fake engagement targeting Ghana's 2024 presidential election. The action is part of OpenAI's ongoing effort to disrupt malicious uses of AI for political influence operations. This represents a concrete enforcement case documenting how AI tools are being weaponized for election interference.
OpenAI banned accounts linked to China that were using its AI tools to generate US political content and conduct research on people, movements, and online communities. The operation, dubbed 'Uncle Spam,' represents a documented case of AI-assisted foreign influence activity targeting US political polarization. OpenAI's disclosure continues a pattern of the lab publishing threat intelligence on adversarial misuse of its models.
OpenAI banned a cluster of accounts linked to a Russia-origin influence operation dubbed 'Stop News,' which used AI tools to generate multilingual articles and social media posts targeting audiences in Ukraine and Western countries. The operation represents a documented case of AI being weaponized for coordinated inauthentic behavior at scale. OpenAI's disclosure is part of its ongoing effort to detect and disrupt malicious uses of its platform.
OpenAI terminated accounts whose activity overlapped with publicly reported threat groups displaying hallmarks consistent with PRC intelligence requirements. The banned accounts were using AI to support phishing campaigns and scripting workflows. This is part of OpenAI's ongoing effort to detect and disrupt malicious use of its platform by state-affiliated actors.