Notifications
Clear all
Topic starter
27/06/2026 1:12 pm
TL;DR: AI is being used to create more sophisticated attacks at higher volume, and this on-demand webinar explores FraudGPT, how it works, and how malicious AI differs from benign generative tools, according to Abnormal AI. The governance question is no longer whether AI can accelerate cybercrime, but which identity controls can still constrain runtime misuse.
NHIMG editorial — here’s why we think this discussion matters
Questions worth separating out
Q: How should security teams respond to AI-assisted phishing and fraud attempts?
A: Security teams should harden the identity layer that turns a successful lure into real access.
Q: Why do malicious AI tools increase identity risk even when they do not compromise systems directly?
A: They increase risk because they improve the attacker's ability to generate convincing content, scale retries, and adapt messaging to the target.
Practitioner guidance
- Reduce identity blast radius for exposed credentials Review service accounts, API keys, and tokens that can be abused after AI-generated phishing or fraud succeeds.
- Separate content generation from executable access Prevent AI tools from reaching systems that can create, approve, or modify real access paths unless the use case has explicit governance.
- Tighten approval points around high-risk transactions Require stronger validation for payments, credential resets, privilege changes, and external vendor requests when AI-assisted social engineering is a realistic threat.
What to expect at the briefing
Abnormal AI's full webinar covers the operational detail this post intentionally leaves for the source:
- A demo from the threat researcher who discovered FraudGPT and how the tool was used in practice.
- A deeper walkthrough of how malicious AI differs from non-malicious generative models in attacker workflows.
- Real-world examples of AI-shaped cybercrime techniques and the attack patterns they amplify.
- The future of malicious AI and good AI as framed by the webinar speakers.
👉 Register for Abnormal AI's on-demand webinar on FraudGPT and malicious AI →
FraudGPT and malicious AI: what security teams need to know?
Explore further
27/06/2026 2:27 pm
Malicious generative AI is a force multiplier for identity abuse, not a replacement for identity weaknesses. The practical pattern is familiar even when the tooling changes: attackers still need credentials, tokens, or trusted accounts to turn content generation into system action. That means the underlying IAM and NHI exposure remains the decisive control plane. Practitioners should read AI-assisted crime as acceleration of old identity failures, not a separate security category.
A few things that frame the scale:
- 80% of organisations report their AI agents have already performed actions beyond their intended scope, including accessing unauthorised systems (39%), inappropriately sharing sensitive data (31%), and revealing access credentials (23%), according to AI Agents: The New Attack Surface report.
- Only 52% of companies can track and audit the data their AI agents access, leaving 48% with a complete blind spot for compliance and breach investigation.
A question worth separating out:
Q: How can teams tell whether AI-assisted fraud is becoming a practical problem?
A: Look for faster campaign iteration, more personalised impersonation, and higher retry volume across email, chat, and support channels. Those signals suggest attackers are using AI to improve effectiveness. If the same campaigns also lead to credential resets, payment attempts, or privilege requests, the problem has moved from content to identity abuse.
👉 Read our full editorial: FraudGPT and the rise of AI-assisted cybercrime
