Topic starter
05/09/2026 6:10 pm
TL;DR: Continuous offensive testing is becoming materially cheaper, with an AI agent reaching top-three positions on HackerOne during a quarter-long experiment at about $5,000 a month, according to FireCompass. With 12.7% of 150 reports accepted and 64.4% of severity-rated findings classed as critical or high, the real constraint is no longer discovery capacity alone, but governance, validation, and submission speed.
Editorial analysis by NHI Mgmt Group, based on content published by FireCompass: “How FireCompass AI Agents Reached HackerOne’s Top 3 on $5,000 a Month: Full Methodology, Data, and Limitations”.
By the numbers:
- FireCompass says 64.4% of the 101 severity-rated reports were critical or high.
- FireCompass reports that 12.7% of the 150 reports were accepted.
- FireCompass says 38.7% of the 150 reports were duplicates.
Key questions
Q: How should security teams govern agentic AI in penetration testing workflows?
A: Security teams should keep agentic AI inside a bounded workflow where scope, tool access, and approval rules are enforced by the testing platform, not the model.
Q: Why do duplicates matter so much in agentic penetration testing?
A: Duplicates matter because they often prove the finding was real even if another researcher filed it first.
Q: What are the signs that autonomous offensive testing is outpacing governance?
A: Warning signs include rising duplicate rates, slow human triage, excessive informative results, and a widening gap between valid discoveries and credited submissions.
Practitioner guidance
- Tighten human validation gates Require proof-of-exploit review before any AI-assisted vulnerability is filed, triaged, or sent to remediation queues.
- Measure submission lag Track the time between first valid agent finding and final submission so duplicates, queue delays, and review bottlenecks are visible.
- Constrain autonomous scope Enforce hard blocking on out-of-scope hosts, write operations, and high-velocity request patterns before agents can act.
Bottom line: AI-assisted penetration testing is becoming economically accessible enough to challenge the old assumption that offensive coverage must be scarce and periodic.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
05/09/2026 6:10 pm
Agentic offensive testing is becoming an economic control, not just a technical novelty: when autonomous testing gets cheap enough, the question shifts from whether you can run it to whether you can govern the output. That changes procurement, review capacity, and prioritisation for security teams. Practitioners should treat offensive AI as a standing programme capability, not a one-off demo.
A few things that frame the scale:
- 62% of organisations are at least experimenting with AI agents, but only 23% have scaled one into a single business function, according to McKinsey's 2025 State of AI survey.
A question worth separating out:
Q: When should organisations compare AI penetration testing with manual testing?
A: Compare them when deciding whether to add continuous testing alongside periodic manual engagements. Manual tests still matter for deep contextual review, but AI-assisted testing changes cadence and coverage economics. The practical question is how much validation throughput and operational follow-through your team can support.
👉 Read our full editorial: AI agents are reshaping penetration testing economics