TL;DR: Dark AI has become a criminal product category built around malicious models, jailbreaks, and stolen AI credentials, according to ZeroFox. Identity and access controls matter most when attackers can reuse legitimate services at full capability.
Editorial analysis by NHI Mgmt Group, based on content published by ZeroFox: “Dark AI: Inside the Underground Market for Malicious LLMs”.
Key questions
Q: Why do stolen AI credentials create more than just access risk?
A: Because the credential does not only unlock a service, it can also consume paid compute.
Q: What signs show that dark AI activity is becoming operational?
A: Look for corroborated signals, not just isolated chatter.
Q: How should security teams handle dark AI as a risk category?
A: Treat dark AI as an operational criminal ecosystem built around access, distribution, and reuse.
Practitioner guidance
- Govern AI service credentials as privileged identities Inventory API keys, service accounts, and enterprise AI tokens as part of your privileged access estate, then assign clear owners, expiry expectations, and revocation paths.
- Correlate underground signals before escalation Combine forum listings, access broker activity, and target-specific chatter so analysts can distinguish generic noise from likely operational intent.
- Validate AI abuse claims against identity evidence Require supporting evidence such as leaked credentials, authenticated access, or targeted infrastructure before classifying a dark AI signal as actionable.
Bottom line: Dark AI is less about a rogue model than about a criminal distribution layer that packages AI capability for reuse.
Glossary terms: Dark AI, LLM Jailbreaking, AI Credential, Underground Forum
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Dark AI is best understood as a distribution model for abuse, not a model-quality problem. The underground value is in packaging, subscription access, and repeatability, because those are the traits that let criminals scale beyond one-off experimentation. That is why the article's most important point is not the existence of malicious models, but the normalisation of AI as a service layer for fraud and phishing. Practitioners should treat the category as an operational ecosystem, not a novelty.
A few things that frame the scale:
- AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026.
A question worth separating out:
Q: What should teams do when AI tools are being reused for phishing and fraud?
A: Focus on the enabling conditions: exposed credentials, overbroad AI permissions, and weak monitoring of how AI accounts are used. If those controls are weak, attackers can turn generic model access into scalable fraud content, faster phishing iteration, and more persistent abuse. Reduce the identity surface before you chase every output.
👉 Read our full editorial: Dark AI has shifted underground crime from novelty to service