TL;DR: Code execution was achieved on 97.8% of autonomous offensive-security agents in tests, often reaching credentials, persistence, and host control, according to CRACKEN. The core problem is assumption collapse: current review and sandbox models assume agent behaviour is predictable enough to contain after the fact, but autonomous attackers act and escalate inside the same session.
Editorial analysis by NHI Mgmt Group, based on content published by CRACKEN: “Detect and stop AI-driven attacks before they reach real assets, with 97.8% reliability. Introducing Project BlackSea.”.
Key questions
Q: What breaks when autonomous coding agents can act inside a single session without per-step review?
A: Traditional IAM and code review models break because they assume access can be observed, certified, and corrected before meaningful harm occurs.
Q: Why do autonomous AI attacker tools create more risk than ordinary automation?
A: Ordinary automation follows predetermined paths.
Q: What signs show that an autonomous agent is failing safely?
A: Safe failure is not about whether the sandbox exists, but whether it blocks execution before the agent can reach secrets, persistence, or lateral movement.
Practitioner guidance
- Audit autonomous agent execution paths Map where offensive or security agents can download, parse, and run external artifacts without a separate trust decision.
- Remove standing high-risk privileges from agent workloads Identify agents that hold live credentials, API keys, or broad network reach during a run and reduce that authority to the smallest session-scoped set possible.
- Treat task memory and queues as sensitive assets Harden agent memory stores, task queues, and logs because the article shows that manipulated agents can read and write those surfaces during lateral movement and persistence.
Bottom line: Autonomous offensive agents expose a governance gap where runtime decision-making outruns the controls built for predictable execution paths.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Access review assumes privileges last long enough to be reviewed: That assumption was built for humans and conventional NHI workflows, where access outlives the task. Autonomous offensive agents invalidate it because they can acquire, use, and discard authority inside one run. The implication is that governance has to move from review cadence to runtime authorization logic.
A few things that frame the scale:
- 53% of security leaders expect AI to run major portions of their infrastructure autonomously within the next three years, according to the 2026 Infrastructure Identity Survey.
- 67% of organisations still rely heavily on static credentials despite the risks they pose to agentic AI deployments, according to the 2026 Infrastructure Identity Survey.
A question worth separating out:
Q: How should teams govern autonomous attackers versus defensive agents?
A: The same runtime governance principles apply to both, but the attacker case makes the failure mode explicit. Teams should decide who can authorize execution, what artifacts can trigger actions, and when a session must be terminated before autonomous behavior spreads beyond the intended scope.
👉 Read our full editorial: Autonomous AI attacker tools expose a 97.8% control gap