Tech

OpenAI finds more Chinese groups using ChatGPT for malicious purposes

OpenAI banned ChatGPT accounts that generated social media posts on political and geopolitical topics relevant to China

Updated 1 year ago · Published on 05 Jun 2025 6:18PM

OpenAI finds more Chinese groups using ChatGPT for malicious purposes
China-linked threat actors used AI to support various phases of their cyber operations, including open-source research - June 5, 2025

OpenAI is seeing an increasing number of Chinese groups using its artificial intelligence technology for covert operations, which the ChatGPT maker described in a report released Thursday.

Reuters reported today that while the scope and tactics employed by these groups have expanded, the operations detected were generally small in scale and targeted limited audiences, the San Francisco-based startup said.

Since ChatGPT burst onto the scene in late 2022, there have been concerns about the potential consequences of generative AI technology, which can quickly and easily produce human-like text, imagery and audio.

OpenAI regularly releases reports on malicious activity it detects on its platform, such as creating and debugging malware, or generating fake content, opens new tab for websites and social media platforms.

In one example, OpenAI banned ChatGPT accounts that generated social media posts on political and geopolitical topics relevant to China, including criticism of a Taiwan-centric video game, false accusations against a Pakistani activist, and content related to the closure of USAID.

Some content also criticized U.S. President Donald Trump's sweeping tariffs, generating X posts, such as "Tariffs make imported goods outrageously expensive, yet the government splurges on overseas aid. Who's supposed to keep eating?".

In another example, China-linked threat actors used AI to support various phases of their cyber operations, including open-source research, script modification, troubleshooting system configurations, and development of tools for password brute forcing and social media automation.

A third example OpenAI found was a China-origin influence operation that generated polarized social media content supporting both sides of divisive topics within U.S. political discourse, including text and AI-generated profile images.

China's foreign ministry did not immediately respond to a Reuters request for comment on OpenAI's findings.

OpenAI has cemented its position as one of the world's most valuable private companies after announcing a $40 billion funding round valuing the company at US$300 billion. - June 5, 2025

Spotlight

Malaysia

Johor state election: MACC receives three reports of alleged corruption

Malaysia

Banks need to do more to help counter rising costs of living – Guan Eng

By Ian McIntyre

Business

BNM holds OPR at 2.75 per cent

Malaysia

MACC: No one off limits in probe into US$13 million luxury property deal

Malaysia

Govt rejects claims Jho Low secretly returned to Malaysia for 1MDB asset talks

Malaysia

School stabbing incident: Suspect claimed she was dissatisfied, allegedly bullied

Places

Four premier hotels in Penang to be restored, open doors soon

By Ian McIntyre

Malaysia

Rosmah demands action against Nga over alleged misleading election poster in Johor polls

Malaysia

Malaysia faces RM51.4b 1MDB burden after recovering RM31.3b in funds and assets

You may be interested

Places

Four premier hotels in Penang to be restored, open doors soon

By Ian McIntyre

Living

Matrix Concepts' home ownership campaign offers over RM30m rewards and prizes