A profile with a friendly face, a tick next to its name and thousands of followers can now be entirely made up, and the people most likely to be fooled are the ones who rely on those signals to decide who to trust. Generative AI makes it cheap to produce realistic profile photos, polished bios and convincing messages, and follower and engagement counts can still be bought. This guide explains, in plain English, how to spot fake followers and AI-generated profiles, what the verified badges on X, TikTok and other platforms do and do not prove, how to report fakes, and what the US Federal Trade Commission's rule on fake social media indicators means for brands and marketers. It is for anyone who uses social media, and for marketing, social and brand protection teams who vet influencers, partners and inbound contacts. For the platform and marketplace side, see the Bot Farms and Fake Engagement Guide.
Key takeaways
- No single sign proves a fake. Look for several together: a too-perfect or oddly flawed photo, a new or recently renamed account, generic posts, and engagement that does not match the audience.
- A verified badge is not a background check. On X the blue checkmark is tied to a paid Premium subscription and eligibility checks; on TikTok it confirms the account belongs to who it says, but is not an endorsement. A tick typed into a bio or name means nothing.
- AI faces still give themselves away in the details. The FBI lists distorted hands or feet, odd teeth or eyes, irregular faces, strange accessories and wrong shadows as signs of synthetic images.
- Buying followers can break the law, not just platform rules. Since 21 October 2024 the FTC rule at 16 CFR 465.8 bans buying or selling fake followers, views and likes that the buyer knew or should have known were fake, for a commercial purpose.
- Report through the platform, then verify out of band. Use the in-app report or impersonation form, and confirm anyone who asks for money, data or access through a channel you already trust.
What counts as a fake follower or fake profile
The FTC's rule gives a useful working definition. It treats as fake any indicator of social media influence (followers, subscribers, views, likes, shares or comments) that is generated by a bot, belongs to an account that is not a real person, uses a real person's information without consent, comes from a hijacked account, or otherwise does not reflect a real person's or organisation's activity or opinions. In practice you will meet four kinds of fake:
| Type | What it is | Why it exists | Typical risk to you |
|---|---|---|---|
| Bought follower or bot account | Automated or mass-created accounts that follow, like or view on demand | Sold in bundles to make an account look popular | Misleading influence figures, wasted marketing spend |
| AI-generated persona | A profile with a synthetic face and invented history, often with AI-written posts | Scams, influence operations, fake recruiters, fake reviewers | Romance, investment and job scams; data harvesting |
| Impersonation account | Copies a real person or brand's name and image | To borrow their trust | Fake giveaways, fake support, payment fraud |
| Hijacked real account | A genuine account taken over and repurposed | It has real history and followers | Hardest to spot; messages appear to come from a known contact |
The FBI warned in December 2024 (public service announcement I-120324-PSA) that criminals use generative AI to create large numbers of fictitious social media profiles, realistic profile photos, fake identity documents and even live video to make a contact seem real. The problem is no longer just low-quality spam accounts.
Signs of an AI-generated profile
Check the profile as a whole, not just the photo. The more of these you see together, the more cautious you should be.
The photo and other images
- Synthetic image tells: the FBI lists distorted hands or feet, unrealistic teeth or eyes, indistinct or irregular faces, odd accessories such as glasses or jewellery, and inaccurate shadows or watermarks.
- Only one kind of picture: a single flawless headshot, or a handful of studio-quality images with no ordinary photos of friends, places or events.
- Reverse image search: a stolen photo will usually show up elsewhere under another name. A synthetic face will not, so "no results" does not prove the person is real.
- Video calls: lag, unnatural movement, or a reluctance to turn the camera on or move naturally are warning signs the FBI also lists for synthetic video.
The account and its history
- Age and continuity: a new account, or an old account with a long gap followed by a sudden burst of activity, can indicate a bought or hijacked account.
- Name changes: on X, changing the display name, handle or photo temporarily removes the blue checkmark until X reviews it again. A badge that comes and goes, or a handle that does not match the name, is worth noting.
- Generic or polished text: bios and posts that are fluent but say nothing specific, comments that could apply to any post, and the same phrasing across many accounts. AI makes grammar and translation errors less common, so perfect English is no longer a sign of a real person.
- Network: followers and connections who are themselves new, faceless or unrelated to the claimed job, place or interests.
The behaviour
- Moves quickly to private channels: pushes you to WhatsApp, Telegram or email early.
- Asks for something: money, gift cards, crypto, a code, a download, personal documents or a "quick favour". The FBI's advice is never to send money or sensitive information to someone you have only met online.
- Too good to be true: unexpected job offers, investment tips, prizes or romantic attention from a stranger. See the Romance and Investment Scam Awareness Guide.
How to check an account's followers
Brands vetting influencers, and individuals checking a suspicious account, can do a quick follower audit without special tools. These are practical heuristics, not platform rules.
| Check | What real audiences usually look like | What bought or fake audiences often look like |
|---|---|---|
| Follower growth | Gradual, with jumps that match a viral post or press coverage | Sudden step increases with no matching content |
| Engagement versus followers | Likes and comments roughly in proportion across posts | Huge follower count with very few comments, or identical engagement on every post |
| Comment quality | Specific, varied, often replies between people | Emoji-only, generic praise, repeated phrases, off-topic links |
| Sample of followers | Mix of real-looking people with photos, posts and their own followers | Many accounts with no photo, random handles, no posts, created recently |
| Audience location and language | Matches the creator's content and market | Concentrated in places unrelated to the content |
| Views versus likes (video) | Varies by video | High views with almost no other interaction |
Real accounts also pick up fake followers they never asked for, so a few bots are normal. What matters is the pattern and whether the account's owner benefits from it. Platforms remove fake engagement too: YouTube says artificial traffic is not counted in views or subscribers, and spam or terminated subscribers are excluded from totals.
What verified badges do and do not prove
Badges are the signal people trust most and understand least. Each platform means something different by them.
| Platform | What the badge means | What it does not prove |
|---|---|---|
| X (blue checkmark) | The account is an active X Premium subscriber that meets X's criteria: display name, profile photo, activity in the last 30 days, a confirmed phone number and being non-deceptive. Legacy verification ended from 1 April 2023. | X's help page does not say the account holder's identity was checked against an ID. X may remove the checkmark at any time. |
| TikTok (blue check) | TikTok has confirmed the account belongs to the person or brand it represents, based on authenticity, uniqueness and activity, plus requirements such as multi-factor authentication and coverage in multiple news sources. | It is not an endorsement by TikTok, and verification is never sold: anyone offering to sell it is not affiliated with TikTok. |
| Any platform | A genuine badge appears in the platform's own interface, next to the account name, in the same place every time. | A tick emoji or the word "verified" in a display name or bio proves nothing. |
Two practical rules follow. First, treat a badge as "this account passed some platform check", not "this person is who you think and is trustworthy". Second, if a badge appeared or disappeared recently, or the account name changed, slow down: on both X and TikTok a name or username change affects the badge.
How to report fakes and impersonators
- Do not engage or click: do not reply, follow links or download files from the account.
- Capture evidence: screenshot the profile, handle, URL and any messages before reporting, because the account may vanish.
- Report in the app: on X, use the post menu, Report Post, then "It's suspicious or spam" for fake engagement and spam. For impersonation, X has a separate impersonation report form and may need the report to come from the person or brand being impersonated before it acts.
- Report impersonation of you or your brand formally: use the platform's impersonation or trademark route rather than the general spam report, and keep the reference number.
- Warn your audience: if a fake is copying you, post on your real account that you will never ask for money or codes in messages.
- Report fraud losses: if money or data was lost, report it to your bank and to the national fraud reporting service for your country, and keep the evidence.
Platform rules give you leverage. X's policy treats a computer-generated image of a person, used to pose as someone who does not exist, as a deceptive identity, and requires parody and fan accounts to say so in both the account name and the bio. X also bans buying or selling followers, likes and reposts, and "follow trains". YouTube's fake engagement policy bans artificial views, likes, comments and subscribers, including sub4sub schemes, and warns that a hired promoter's methods can get your own content removed or your channel taken down.
The law: FTC rule on fake reviews and fake social media indicators
For US businesses, buying influence is now a regulatory matter. The FTC announced its final Trade Regulation Rule on the Use of Consumer Reviews and Testimonials on 14 August 2024, published it at 89 FR 68077 on 22 August 2024, and it took effect on 21 October 2024.
| Section | What it prohibits | What it means for brands |
|---|---|---|
| 16 CFR 465.8(a) | Selling or distributing fake indicators of social media influence that the seller knew or should have known were fake, where they can be used to materially misrepresent influence for a commercial purpose | Growth agencies and follower sellers are covered |
| 16 CFR 465.8(b) | Buying or obtaining fake indicators that the buyer knew or should have known were fake, to misrepresent influence for a commercial purpose | A brand or influencer that buys followers to look bigger is exposed |
| 16 CFR 465.2 | Writing, creating or selling reviews or testimonials that misrepresent that the reviewer exists or had experience with the product; buying or spreading them when the business knew or should have known | The FTC's announcement says this includes AI-generated fake reviews |
- Knowledge matters: the FTC's question and answer guidance says a business is not liable just because a vendor secretly supplied fake followers, unless there were red flags it should have noticed, and hiring an influencer who happens to have fake followers does not by itself create liability.
- Penalties: the rule allows civil penalties against knowing violators. The FTC guidance does not state a fixed amount, so check the current figure with counsel.
- AI avatars: the FTC says there is no blanket ban on AI avatars in marketing, but testimonial rules still apply, and using a celebrity's likeness without permission can be deceptive.
The UK and other jurisdictions have their own fake review rules; the Bot Farms and Fake Engagement Guide covers the UK Digital Markets, Competition and Consumers Act provisions.
For brands: vetting influencers, partners and inbound contacts
- Write it into contracts: require influencers and agencies to warrant that they have not bought followers or engagement, and allow termination if they have. This also creates the record that you looked for red flags.
- Audit before you pay: run the follower checks above on a sample, ask for platform analytics screenshots or exports directly from the creator's account, and pay on outcomes you can measure, such as tracked clicks or sales, rather than follower counts.
- Do not buy growth for your own accounts: beyond the FTC risk, X, YouTube and other platforms can reduce visibility, remove content or suspend accounts.
- Watch for impersonation of your brand: search regularly for your name, logo and executives' names, and keep a takedown process ready. See the Disinformation and Brand Impersonation Guide.
- Verify inbound approaches: fake recruiters, fake investors and fake partners use AI personas. Confirm through a company switchboard or a known email domain before sharing anything.
- Protect your own accounts: hijacked accounts are the most convincing fakes. Use strong multi-factor authentication and limit who holds admin access. See the Security for Content Creators and Influencer Accounts Guide.
Where identity fits
Fake followers and AI personas are identity problems at internet scale: accounts that claim to be people but are bots, scripts or synthetic identities. For platforms, the same controls that stop fake sign-ups stop fake followers; see the Fake Account Creation and Sign-up Fraud Guide. For brands, the identities that matter most are the admin and agency accounts that control your social profiles and any third-party scheduling tools connected to them. Review who has access, remove old agencies, and treat those connections as privileged.
Measuring whether your checks work
- Influencer vetting rate: percentage of paid partnerships that had a documented follower audit before contract.
- Impersonation takedown time: median days from finding a fake account using your brand to its removal.
- Repeat impersonators: number of fake accounts reappearing after takedown, which shows whether you need formal trademark routes.
- Staff reports: number of suspicious profiles or approaches reported by employees, a sign that awareness training is working.
- Losses avoided: payments or data requests stopped by out-of-band verification.
Common failure patterns
- Trusting the tick. Assuming a blue checkmark means a verified identity, when on X it reflects a paid subscription and eligibility checks.
- Relying on reverse image search alone. Synthetic faces are unique, so a clean search result can be false reassurance.
- Judging by grammar. AI-written messages are fluent; spelling mistakes are no longer a reliable sign of a scam.
- Paying for reach by follower count. Brands that pay per follower reward bought audiences and may be on notice of red flags under the FTC rule.
- Reporting through the wrong route. A general spam report on an impersonator often goes nowhere; impersonation needs the platform's specific form, ideally from the person or brand being copied.
Framework mapping
| Framework | Reference | Relevance |
|---|---|---|
| US FTC rule | 16 CFR 465.2; 465.8 | Fake and AI-generated reviews; buying and selling fake social media indicators |
| MITRE ATT&CK | T1585.001; T1586.001; T1593.001 | Attackers establish or compromise social media accounts and research targets on social media |
| NIST CSF 2.0 | ID.RA-03 | Record external threats such as impersonation of your brand |
| NIST SP 800-53 Rev. 5 | AT-2 | Awareness training that covers fake profiles and AI-generated content |
Practitioner checklist
- Check several signs together: photo details, account age and name history, text quality, network and behaviour.
- Treat verified badges as a platform check, not proof of identity or trustworthiness.
- Verify anyone who asks for money, codes, documents or access through a channel you already trust.
- Capture evidence, then report using the platform's specific impersonation or spam route.
- Audit influencer audiences before contracts and pay on measurable outcomes.
- Put no-bought-engagement warranties into influencer and agency contracts.
- Never buy followers, views or likes for your own accounts.
- Monitor for impersonation of your brand and executives, with a takedown process ready.
- Secure your social media admin accounts with strong multi-factor authentication and review agency access.
Standards and references
- eCFR: 16 CFR Part 465, Use of Consumer Reviews and Testimonials
- Federal Trade Commission: Consumer Reviews and Testimonials Rule, Questions and Answers
- Federal Trade Commission: Final rule banning fake reviews and testimonials
- FBI IC3: Criminals use generative artificial intelligence to facilitate financial fraud
- X Help Center: About verified accounts
- X Help Center: Misleading and deceptive identities policy
- TikTok Help Center: Verified accounts on TikTok
- YouTube Help: Fake engagement policy
Related NHI Mgmt Group resources: Bot Farms and Fake Engagement Guide · Deepfake and AI Impersonation Guide · Impersonation Scams Guide · Social Media Privacy Settings Guide