OpenAI Cracks Down on AI Misuse in Cyber Influence and Surveillance Operations

February 26, 2025 – OpenAI has taken action against multiple accounts abusing its ChatGPT technology for surveillance, disinformation, and cyber fraud. The crackdown reveals how state-backed entities from China, Iran, North Korea, and Cambodia are weaponizing AI for influence campaigns and digital deception.

China’s AI-Powered Surveillance Tool

One of the most alarming discoveries was a China-linked network using AI to analyze global social media platforms, including Facebook, X (Twitter), YouTube, Instagram, Reddit, and Telegram. OpenAI’s models were exploited to process real-time data on anti-China protests, Uyghur rights movements, and Western political activities, with insights reportedly shared with Chinese authorities. The network operated an AI-driven tool known as “Qianyue Overseas Public Opinion AI Assistant.”

AI-Driven Influence Campaigns Uncovered

North Korean Job Fraud

A North Korean group used ChatGPT to create fake IT worker résumés and job applications to infiltrate Western companies. AI-generated responses helped these fraudulent job seekers bypass screening by justifying irregular work hours and location changes.

Chinese Disinformation in Latin America

A Chinese-backed operation leveraged AI to generate anti-US articles in Spanish, which were published in Peruvian, Mexican, and Ecuadorian media outlets—mirroring past tactics linked to Spamouflage, a pro-China propaganda network.

Iranian Influence Operations

OpenAI also disrupted an Iran-linked campaign producing pro-Hamas, pro-Iran, and anti-US content shared across platforms linked to Storm-2035 and the International Union of Virtual Media (IUVM).

Cambodian Scam Networks

Two Cambodia-based operations misused AI for financial fraud. One ran a romance and investment scam, generating and translating deceptive messages for Facebook, X, and Instagram. Another, called a “Task Scam,” lured victims into performing fake online tasks—such as liking videos and writing reviews—in exchange for nonexistent commissions.

North Korean Cyber Espionage

Accounts linked to Kimsuky and BlueNoroff, two North Korean hacking groups, used ChatGPT to study cyber intrusion techniques and debug code for Remote Desktop Protocol (RDP) brute-force attacks.

AI’s Growing Role in Cyber Threats

The misuse of AI in cyber operations is becoming a global security challenge. A Google Threat Intelligence Group (GTIG) report revealed that over 57 state-affiliated threat actors from China, Russia, Iran, and North Korea have used AI for research, content creation, and cyber espionage.

OpenAI’s Call for Industry Collaboration

OpenAI is urging tech companies, cybersecurity firms, and social media platforms to collaborate in detecting and mitigating AI-driven threats. The company emphasized that cross-industry intelligence sharing is crucial to stopping AI-powered cybercrime and disinformation campaigns.

stay tuned for more news on Open Ai and ChatGPT.