TL;DR: Threat actors are using an AI website builder to create fraudulent sites for credential phishing, MFA token theft, malware delivery, and payment-data harvesting, with tens of thousands of malicious URLs detected each month since February 2025, according to Proofpoint. The real shift is not AI sophistication but the collapse of effort required to build believable lures and live capture infrastructure.
Editorial analysis by NHI Mgmt Group, based on content published by Proofpoint: “Cybercriminals Abuse AI Website Creation App For Phishing”.
Key questions
Q: What breaks when phishing campaigns are generated and iterated by AI?
A: What breaks is the assumption that phishing is slow, manual, and easy to profile.
Q: Why do AI-generated phishing kits increase account takeover risk?
A: They reduce the effort needed to build convincing lures, which increases campaign volume and lowers the cost of experimentation.
Q: What are the signs that a phishing site is being generated and remixed at scale?
A: Common signs include disposable hosting domains, repeated brand impersonation, CAPTCHA gates, redirect chains and similar layouts appearing across many campaigns.
Practitioner guidance
- Harden sign-in against session theft Require phishing-resistant authentication where feasible, and add controls that detect anomalous cookie reuse, impossible travel and suspicious device binding after login.
- Expand web-lure detection beyond email Monitor redirectors, CAPTCHA pages, disposable hosting domains and branded lookalike sites so blocked URLs are not the only signal defenders rely on.
- Revoke high-risk sessions faster Use session revocation playbooks for credential phishing incidents so stolen cookies and MFA tokens stop being valid before attackers can pivot into downstream systems.
Bottom line: AI-generated phishing sites reduce the effort required to build convincing delivery infrastructure, which makes large-scale credential theft easier to industrialise.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
AI-generated phishing is shrinking the attacker capability gap, not merely improving content quality. The central change is operational: believable lure sites can now be created, hosted and repurposed with far less effort than before. That collapses the cost barrier for smaller actors and increases campaign volume for established ones. The practitioner implication is that phishing defence has to assume near-zero marginal cost for page creation.
A few things that frame the scale:
- Roughly 1 in 3 phishing payloads are delivered outside email, through channels such as social media, search ads and messaging apps.
A question worth separating out:
Q: Should teams block AI website builders or just monitor them?
A: Teams should decide based on business use and abuse history. If a site-generation platform is being repeatedly used for phishing, fraud or malware delivery, allow-listing and tighter access controls may be justified. Where access is needed, monitoring for published projects, redirectors and malicious reuse becomes essential.
👉 Read our full editorial: AI-generated phishing sites lower the barrier for credential theft