Join our Newsletter — 33% off our NHI Course

What would it take for state-backed fake profiles to stay convincing?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20217
Topic starter  

TL;DR: Fake profiles and bot networks are being used to amplify disinformation at scale, according to Cyabra, with election-related conversations sometimes containing 30%, 40% or even 50% fake accounts. Monitoring has to move beyond post-level review and look for persistence, coordination and narrative reuse across communities.

Editorial analysis by NHI Mgmt Group, based on content published by Cyabra: “How Foreign State Actors Threaten Democracies”.

By the numbers:

  • While fake profiles typically make up 5% to 12% of conversations on social media, election-related discussions can rise to 30%, 40% or even 50% fake profiles.

Key questions

Q: Why do disinformation campaigns use bot networks instead of single accounts?

A: Disinformation campaigns use bot networks because many accounts can amplify the same message at speed, mask coordination, and survive takedowns better than one account.

Q: What are the signs of a coordinated influence operation online?

A: Signs of a coordinated influence operation include many accounts posting the same claims, links, or hashtags in a tight time window, with reused language, profile patterns, or sudden bursts from newly created accounts.

Q: How do fake social media profiles gain credibility over time?

A: They gain credibility by looking active, consistent and socially validated before they are used in a campaign.

Practitioner guidance

  • Audit persona authenticity signals Track account age, posting cadence, follower graph changes and repetition patterns to distinguish organic communities from coordinated networks.
  • Correlate content with network behaviour Review whether the same claim is appearing across linked accounts, reused phrasing, mirrored timelines and synchronized amplification.
  • Set escalation thresholds for election periods Treat rapid spikes in engagement around sensitive topics as a trigger for deeper investigation into coordination and synthetic identity behaviour.

Bottom line: Fake profile campaigns are effective because they blend persona construction, synthetic media and repeated amplification into a single trust operation.

Glossary terms: Disinformation, Bot Network, Fake Profiles, Deepfake

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20707
 

Fake personas are now infrastructure, not just content. The article shows that state actors are not relying on isolated false posts. They are building account fleets, engagement loops and synthetic media pipelines that function like an operational influence stack. That changes the governance problem from content moderation to identity assurance at scale. Practitioners should treat network persistence and persona lifecycle as the real control surface.

A question worth separating out:

Q: How should organisations detect GenAI-assisted disinformation?

A: Organisations should detect GenAI-assisted disinformation by combining content analysis, provenance checks, and campaign-level monitoring. Look for mass-produced variants of the same claim, unnatural posting cadence, synthetic media artefacts, repeated prompts or templates, and account clusters that share distribution paths. Human review and platform telemetry help separate automated persuasion from ordinary user discussion.

👉 Read our full editorial: State-backed fake profiles use GenAI to launder disinformation



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.