Account takeover has always been a numbers game, and AI is changing the numbers: attackers can now write convincing lures, mimic human behaviour and handle the conversational parts of an attack at a scale that used to need large teams. The underlying techniques are not new. Credential stuffing, password spraying, phishing, MFA fatigue and help desk social engineering are all well catalogued in MITRE ATT&CK and the OWASP Automated Threat Handbook. What AI changes is the cost per attempt, the quality of the social engineering and how well automated traffic blends in with real users. This guide explains where AI helps attackers across the takeover chain, which defences still hold, how to detect AI-assisted attacks in authentication and recovery logs, and how to roll out the controls that matter most. It is for identity, fraud and security operations teams protecting workforce and customer accounts, and it stays at the level of techniques and defences rather than attack procedures.
Key takeaways
- AI amplifies existing techniques rather than inventing new ones. The UK NCSC assessed in January 2024 that AI would almost certainly increase the volume and impact of attacks, with the main uplift in reconnaissance and social engineering, through evolution of existing tactics.
- Passwords are still the main door. Microsoft's 2025 Digital Defense Report states that more than 97% of identity attacks are password attacks and that phishing-resistant MFA prevents up to 99% of them (vendor figures).
- Phishing-resistant authentication removes the payoff. FIDO2/WebAuthn and PKI credentials cannot be replayed, relayed by a real-time phishing kit or talked out of a user, so AI-written lures and AI-run phishing conversations lose their value.
- Recovery is the new front line. When sign-in is hardened, attackers move to help desks, chatbots and reset flows, where AI voice and text make impersonation cheaper. Recovery must be as strong as sign-in.
- Detect on behaviour across sessions, not single requests. AI-driven bots can solve CAPTCHAs and vary their fingerprints, so look for distributed patterns: success ratios, shared infrastructure, impossible sequences and post-login behaviour.
How AI changes the account takeover chain
A takeover usually follows the same stages: gather targets and credentials, attempt access, defeat or bypass the second factor, then use or sell the account. AI helps at each stage, mostly by making work that was manual cheap enough to do at volume.
| Stage | Established technique | What AI adds | Defence that still holds |
|---|---|---|---|
| Reconnaissance | T1589 Gather Victim Identity Information, T1598 Phishing for Information | Faster profiling of staff, roles and email formats from public data; tailored pretexts | Limit exposed staff data; assume pretexts will be credible |
| Credential acquisition | T1566 Phishing, T1566.002 Spearphishing Link, T1555.003 Credentials from Web Browsers (infostealers) | Fluent, localised lures with no spelling tells; cloned login pages at scale | Phishing-resistant MFA, compromised credential screening |
| Automated access attempts | T1110.004 Credential Stuffing, T1110.003 Password Spraying, T1110.001 Password Guessing | Bots that mimic human timing and input, rotate residential proxies, and use AI to solve CAPTCHAs (OAT-009 CAPTCHA Defeat) | Rate limits per account and per signal cluster, breached password checks, passkeys |
| Second factor | T1621 MFA Request Generation, T1111 MFA Interception, T1557 Adversary-in-the-Middle | Chat or voice agents that coach victims through approving prompts or reading out codes | Number matching, then phishing-resistant MFA |
| Help desk and recovery | T1566.004 Spearphishing Voice, T1598.004 Spearphishing Voice (reconnaissance) | Cloned voices, scripted calls in any language, many calls in parallel | Strong caller verification, re-proofing for resets |
| Session theft and reuse | T1539 Steal Web Session Cookie, T1550.004 Web Session Cookie | Automated triage of infostealer logs to find valuable sessions | Token binding, short sessions, continuous access evaluation |
| Use of the account | T1078 Valid Accounts, T1078.004 Cloud Accounts, T1556.006 Multi-Factor Authentication (modifying MFA) | Fast, scripted actions after login: adding MFA devices, changing payout details, mailbox rules | Step-up on sensitive changes, alerts on new authenticators |
ATT&CK also tracks adversaries obtaining AI capabilities as a resource development technique (T1588.007 Artificial Intelligence). Older mappings of help desk impersonation, including those in the 2023 CISA Scattered Spider advisory, use an impersonation technique that ATT&CK v20 has since revoked, so check any detection content built on them against the current release.
AI-assisted credential attacks at scale
OWASP's Automated Threat Handbook gives the shared vocabulary for bot-driven abuse of web applications. The entries most relevant to takeover are OAT-008 Credential Stuffing (testing stolen username and password pairs), OAT-007 Credential Cracking (guessing passwords for known usernames), OAT-009 CAPTCHA Defeat, OAT-004 Fingerprinting, OAT-019 Account Creation and OAT-020 Account Aggregation. AI has three practical effects here:
- Evasion of challenge-based controls: image and audio CAPTCHAs, once a meaningful barrier, can increasingly be solved by machine learning models. Treat a solved CAPTCHA as weak evidence of a human.
- Human-like interaction: automation frameworks combined with models can produce plausible mouse movement, typing cadence and navigation, which weakens single-request behavioural scoring.
- Better targeting: attackers can prioritise credential pairs and accounts likely to be valuable, and generate plausible password variants of a leaked password, which makes reuse of "slightly changed" passwords risky.
The defensive answer is to make the credential worthless and the attempt expensive. NIST SP 800-63B-4 requires verifiers to compare new and changed passwords against a blocklist of commonly used, expected or compromised values, to limit consecutive failed attempts on an authenticator to no more than 100 per account, and forbids composition rules and forced periodic changes while requiring a change on evidence of compromise. Passwords used as a single factor must be at least 15 characters. See the Password Spraying and Credential Stuffing Defence Guide and the Bot Management Guide.
A growing share of legitimate automated traffic now comes from AI agents acting for users. Separating declared, accountable agents from abusive bots is its own problem: proposals such as signing automated HTTP requests with HTTP Message Signatures are still individual IETF drafts, not standards. See the Bot vs AI Agent Traffic Management Guide.
AI-enhanced social engineering of users and help desks
The biggest AI uplift is in the human layer. The FBI's December 2024 public service announcement describes criminals using generative AI to create fake profiles at scale, write messages without the errors that used to give them away, clone voices from short clips and even access bank accounts with AI-generated audio of account holders. Microsoft's 2025 report states that AI-automated phishing achieved click-through rates of up to 54% against 12% for traditional phishing (vendor figure).
- Real-time phishing with conversational support: adversary-in-the-middle kits relay passwords and one-time codes; AI chat can now handle the victim's questions on a fake support page. See the AiTM Phishing Guide.
- MFA fatigue with a convincing caller: repeated push prompts (T1621) combined with a call from "IT" explaining why to approve. See the MFA Fatigue and Bypass Guide.
- Help desk impersonation: the CISA and FBI advisory on Scattered Spider describes impersonating employees using gathered personal data and security question answers to persuade help desks to reset passwords and MFA, alongside SIM swapping. Voice cloning lowers the bar further.
- Attacks on AI support channels: automated support assistants that can trigger resets are themselves a target. The Meta AI Instagram account takeover showed an AI support assistant sending account recovery links to attackers.
Detailed recovery controls are in the Account Recovery and Help Desk Security Guide, and voice channel risks in the Voice AI Agent Security and Fraud Guide.
Defences ranked by impact
| Control | What it defeats | Limits | Priority |
|---|---|---|---|
| Phishing-resistant MFA (FIDO2/WebAuthn passkeys, security keys, PKI) | Stuffing, spraying, phishing, code relay, MFA fatigue | Recovery and enrolment must also be protected; session theft still possible | 1 |
| Hardened account recovery and help desk verification | Voice and chat impersonation, SIM swap driven resets | Adds friction and cost to support | 1 |
| Compromised credential screening at sign-in and change | Credential stuffing with leaked pairs | Only covers known breaches | 2 |
| Risk-based authentication and bot management | High-volume automation, distributed attempts | AI bots narrow the signal gap; needs tuning | 2 |
| Session protection (short lifetimes, token binding, re-evaluation) | Stolen cookies and tokens | Platform support varies | 2 |
| Step-up and alerts on sensitive changes | Post-login abuse: new MFA device, payout or email change | Detects rather than prevents initial access | 2 |
| Removing SMS and email codes as factors | SIM swap, interception, relay | Needs an alternative for every user | 3 |
- Workforce: enforce phishing-resistant MFA through conditional access, starting with administrators, help desk staff, finance and developers; CISA's Scattered Spider advisory recommends FIDO/WebAuthn or PKI-based MFA as resistant to push bombing and SIM swap. See the Phishing-Resistant MFA Guide.
- Customers: offer passkeys and nudge enrolment after sign-in; NIST SP 800-63B-4 requires at least one phishing-resistant option at AAL2. Keep risk-based checks for users still on passwords. See the Passkey Rollout Guide.
- Small organisations: use the identity provider's built-in protections (breached password detection, sign-in risk, number matching) and buy bot protection as a service rather than building detection.
- Large organisations: combine signals from the identity provider, web application firewall or bot management, fraud engine and endpoint in one detection pipeline, so a distributed attack is seen as one campaign.
Detection and measurement
AI-assisted attacks are designed to look normal one request at a time, so detection has to work across accounts, sessions and time.
- Authentication telemetry: failed and successful sign-ins with username, result code, source IP and ASN, device fingerprint, user agent and client hints, MFA method and outcome. Alert on success ratios that are low across many accounts but high per infrastructure cluster (stuffing), one password across many usernames (spraying), and bursts of MFA prompts (fatigue).
- Recovery telemetry: every reset request by channel (self-service, help desk, chatbot), the verification method used, the agent, and what changed afterwards. Correlate resets with new device sign-ins and MFA registration within the following hours.
- Post-login behaviour: new authenticator registered, recovery email or phone changed, mailbox forwarding rules, payout or payee changes, API token creation, all shortly after a new-device login.
- Session anomalies: a session cookie used from a new device or network without a fresh sign-in, a sign of T1539 and T1550.004. See the Session Hijacking and Cookie Theft Guide.
| Metric | Target direction | Why it matters |
|---|---|---|
| Share of active accounts using phishing-resistant authenticators | Up, towards 100% for privileged users | The control that removes most takeover paths |
| Confirmed account takeovers per 100,000 active accounts | Down | The outcome measure |
| Credential stuffing attempts blocked before password verification | Up as a share of attack traffic | Shows bot defences act early |
| Help desk resets with strong verification | 100% | Recovery is the highest-risk path |
| Time from new-device login to alert on sensitive change | Down, ideally minutes | Limits damage when access succeeds |
| Users found with compromised passwords and forced to change | Tracked monthly | Measures exposure from breaches and infostealers |
Implementation roadmap
- Baseline: collect 30 days of authentication and recovery logs, establish normal failure rates and success ratios per application, and identify every sign-in and recovery endpoint, including legacy protocols and APIs that bypass MFA.
- Quick wins: enable breached password screening, number matching on push MFA, per-account and per-cluster rate limits, and alerts on new MFA registrations. Turn off legacy authentication where possible.
- Harden recovery: rewrite help desk verification so that knowledge of personal data is never enough (NIST SP 800-63A-4 rules out knowledge-based verification), require a call back to a registered number or re-proofing for MFA resets, and remove reset authority from automated assistants unless they hand off to strong verification.
- Pilot phishing-resistant MFA: start with administrators and help desk staff, then high-risk groups. Run conditional access policies in report-only mode first to see who would be blocked, then enforce ring by ring.
- Tune bot and risk controls: run new rules in monitor mode, compare flagged traffic against confirmed fraud, then block or challenge. Keep a fast path to relax a rule that blocks real users.
- Remove weak factors: once coverage is high, retire SMS and email codes for workforce accounts and make them a monitored fallback for customers.
- Rollback and review: keep every policy versioned with a named owner, document emergency access accounts excluded from conditional access, and review metrics monthly.
When a takeover does happen, follow the Account Takeover Response Playbook.
Where identity fits
Takeover is not limited to people. The same automation that tests leaked passwords also tests leaked API keys, personal access tokens and service account credentials, and those often have no second factor at all. ATT&CK's Valid Accounts technique (T1078, with T1078.004 for cloud accounts) covers both human and machine accounts, and the post-login playbook is similar: create new tokens, add OAuth grants or register new credentials so that access survives a password reset.
- Machine credentials in infostealer logs: developer workstations hold cloud CLI tokens, CI/CD secrets and browser sessions to admin consoles. Rotate them when a device is infected, not just the user's password. See the Infostealer Threat Guide.
- Persistence through tokens: after taking over a user, attackers often mint API tokens or approve OAuth applications. Include token and grant revocation in every takeover response.
- Agents acting for users: AI agents that hold delegated user tokens inherit the user's exposure; scope and monitor them as non-human identities.
Framework mapping
| Framework | Reference | Relevance |
|---|---|---|
| NIST CSF 2.0 | PR.AA-03 | Users, services and hardware are authenticated |
| NIST CSF 2.0 | DE.CM-01, DE.AE-02 | Monitoring and analysis of authentication events |
| NIST SP 800-53 Rev. 5 | IA-2, IA-5, IA-11, AC-7 | MFA, authenticator management, re-authentication, unsuccessful logon attempts |
| NIST SP 800-53 Rev. 5 | SI-4, AU-6 | System monitoring, audit review and analysis |
| NIST SP 800-63B-4 | AAL2, AAL3 | Blocklists, rate limits, phishing resistance, restricted SMS |
| MITRE ATT&CK v20 | T1110 and sub-techniques, T1078, T1566, T1621, T1539 | Takeover techniques to detect |
| OWASP Automated Threat Handbook | OAT-007, OAT-008, OAT-009, OAT-019 | Bot-driven credential abuse |
| CIS Controls v8.1 | Control 6 (Access Control Management), Control 8 (Audit Log Management) | MFA for external and administrative access; logging |
Common failure patterns
- MFA gaps on one system: a single application or portal without MFA becomes the entry point. The Snowflake customer breaches showed infostealer credentials working wherever MFA was not enforced.
- Treating reused-password attacks as the user's problem: the 23andMe credential stuffing breach showed how access to a modest number of accounts can expose data on millions through connected features.
- Help desk verification by personal data: the MGM Resorts breach began with a help desk call. AI voice makes such calls easier to scale.
- Push MFA without number matching: users approve prompts they did not start, as in the Uber breach.
- Automated support with reset powers: chatbots or AI assistants allowed to change recovery details without strong verification.
- Relying on CAPTCHA as the main bot control: AI solving makes it a speed bump, not a barrier.
Practitioner checklist
- Inventory every sign-in, API and recovery endpoint, and close legacy protocols that bypass MFA.
- Enforce phishing-resistant MFA for administrators, help desk staff and high-risk roles, then all workforce users.
- Offer passkeys to customers and screen all passwords against compromised credential lists.
- Apply rate limits per account and per infrastructure cluster, within the NIST limit of 100 consecutive failures.
- Rewrite help desk and chatbot recovery so personal data alone never authorises a reset.
- Enable number matching on push MFA and alert on new authenticator registrations.
- Correlate new-device logins with sensitive account changes and alert within minutes.
- Pilot new controls in report-only or monitor mode, enforce in rings, and keep versioned rollback.
- Track the six metrics above monthly and report them to identity and fraud owners.
Standards and references
- NIST: SP 800-63B-4 Digital Identity Guidelines, Authentication and Authenticator Management
- MITRE ATT&CK: Brute Force
- MITRE ATT&CK: Valid Accounts
- OWASP: Automated Threats to Web Applications
- CISA and FBI: Scattered Spider advisory (AA23-320A)
- NCSC: The near-term impact of AI on the cyber threat
- FBI IC3: Criminals Use Generative Artificial Intelligence to Facilitate Financial Fraud
- Microsoft: 2025 Digital Defense Report announcement
Related NHI Mgmt Group resources: Account Takeover Prevention Guide · Password Spraying and Credential Stuffing Defence Guide · Bot Management Guide · Passwordless and Passkeys Guide · Deepfake-Resistant Identity Verification Guide