CyberCX Unmasks China-linked AI Disinformation Capability on X

Melbourne, Australia – 14 August 2024

One of the largest networks of inauthentic social media accounts ever discovered
One of the first disinformation capabilities with generative AI at the core of its operations
The network has sharply increased activity since July and may be staged to interfere in the US presidential election in November

CyberCX Intelligence has released new research uncovering a network of at least 5,000 inauthentic X (formerly Twitter) accounts that is being used to amplify divisive political issues in Australia, the United States, the United Kingdom and other western democracies.

The network of accounts – which we have called the Green Cicada Network – is controlled in concert by a Chinese-language Artificial Intelligence (AI) Large Language Model (LLM) and is linked to a researcher affiliated with Tsinghua University and Zhipu AI, a prominent Chinese AI company.

With most of the accounts currently inactive, the network is likely an information operation capability in a development or experimental phase. If ramped up to full capacity, the Green Cicada Network could be used to conduct largescale disinformation operations, amplify polarising content to sow division, and undermine trust in civil and government institutions.

“This is one of the largest ever documented networks of inauthentic accounts discovered on a social media platform and could be the first significant China-related information operation run by generative AI” said CyberCX Chief Strategy Officer Alastair MacGibbon.

“While most accounts in the network are dormant, we have observed the network addressing system errors and ramping up political activity in recent months. With most of the narratives pushed by this operation relating to US politics, it’s plausible that this network is poised to interfere in the US presidential election in November.

“Make no mistake, this is a weapon that could be used to harm and undermine democracy in countries like Australia, the United States and the United Kingdom” Alastair said.

The network, which appears to be trained to interact with politically divisive narratives, was discovered by CyberCX Intelligence researchers in May when a cluster of X accounts began malfunctioning and producing the same AI-generated response.

Accounts linked to the network have been observed writing posts or amplifying content related to:

Criticisms of and support for US Vice President Kamala Harris
US electoral integrity issues, including voter ID requirements, and presidential nomination process
Divisive Australian domestic political issues, including nuclear energy, allegations about CFMEU corruption, and Labor’s immigration policies
Australia’s relationship with China
The recent riots and civil unrest in the United Kingdom
CyberCX Executive Director of Cyber Intelligence, Katherine Mansted said that this network is consistent with a broadly observed shift in China’s approach to information operations and disinformation campaigns.

“Historically, Chinese information operations have focused on promoting pro-Chinese Communist Party ideologies. However, this approach has begun to pivot towards operations that mimic the Russian style of deepening polarisation by amplifying divisive views from multiple perspectives.”

“The Green Cicada Network also highlights how generative AI is making scaled, malicious activity more accessible to an increasingly wide range of threat actors. It also highlights gaps in X’s willingness and ability to detect and respond to disinformation” Katherine said.

CyberCX is urging all organisations to update their threat models to include malicious uses of generative AI and urges tech companies to take proactive steps to prevent their platforms from being exploited by threat actors using malicious AI.

ENDS

You can download the full report by clicking the button below

Download Intelligence Update

About CyberCX

CyberCX is the leading provider of end-to-end cyber security and cloud services. With a workforce of 1,400 cyber security professionals, CyberCX is a trusted partner to private and public sector organisations, helping customers confidently manage cyber risk, respond to incidents, and build resilience in an increasingly complex and challenging threat environment.