Join our Newsletter — 33% off our NHI Course

How did generative AI make phishing more adaptive?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20225
Topic starter  

TL;DR: Phishing is becoming more adaptive, personalised and operationally efficient, according to Valimail, because generative AI helps attackers write convincing lures, clone supporting assets and iterate faster. Email identity checks and provenance signals matter more than surface writing cues.

Editorial analysis by NHI Mgmt Group, based on content published by Valimail: “How generative AI is changing phishing attacks”.

Key questions

Q: Why do generative AI phishing campaigns bypass traditional email controls?

A: Because traditional controls often depend on patterns that attackers can now imitate or vary cheaply at scale.

Q: What are the signs that email authentication controls are not working well enough?

A: Warning signs include users still receiving convincing spoofed emails, phishing attempts reaching inboxes, and recipients having no easy way to verify sender authenticity.

Q: How can organisations defend against AI-generated phishing and impersonation?

A: They should stop relying on grammar, tone, or voice recognition as trust signals.

Practitioner guidance

  • Enforce DMARC to reject spoofed mail Move beyond monitoring to quarantine or reject so direct-domain spoofing is blocked at the receiving edge.
  • Inventory every authorised mail sender Build a complete list of internal and third-party systems that send on behalf of your domains, then assign ownership for each one.
  • Monitor authentication failures and sender drift Track sudden changes in sending sources, authentication failure rates and alignment errors so you can detect abuse early.

Bottom line: Generative AI makes phishing more convincing by improving language quality, context fit and campaign iteration speed.

Glossary terms: Generative AI Phishing, Email Authentication, Domain Alignment, Conversational phishing

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 1 week ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20715
 

AI has turned phishing into a provenance problem, not just a content problem. The central shift is that attackers can now produce clean, context-aware text at scale, which removes many of the cues users were trained to spot. That means the control question changes from “does this look suspicious?” to “can we verify that the sender and message path are legitimate?” Practitioners should reframe phishing governance around identity signals, not message aesthetics.

A few things that frame the scale:

  • According to Gartner, worldwide spending on generative AI is set to reach $644 billion in 2025, a nearly 77% year-over-year increase.

A question worth separating out:

Q: What should teams do when phishing uses a legitimate-looking internal conversation?

A: Treat it as a trusted-channel abuse case, not just a suspicious email. Check mailbox access, login telemetry, reply-to patterns, new forwarding rules and the authenticity of the thread history before acting on any request. If the sender account is compromised, contain that account immediately and review whether the attacker used it to broaden trust inside the organisation.

👉 Read our full editorial: Generative AI is making phishing more adaptive and credible


This post was modified 1 week ago by NHI Mgmt Group

   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.