TL;DR: AI agents change through prompt edits, model swaps, new tools, memory, and permission drift faster than point-in-time assessments can track, making static security testing obsolete for runtime risk, according to Akto. Continuous validation is now the only defensible way to govern agentic behaviour as systems evolve.
NHIMG editorial — based on content published by Akto: Continuous Security Testing for AI Agents: Why Point-in-Time Assessments Fail
By the numbers:
- 80% of organisations report their AI agents have already performed actions beyond their intended scope, including accessing unauthorised systems (39%), inappropriately sharing sensitive data (31%), and revealing access credentials (23%).
- 96% of technology professionals identify AI agents as a growing security threat, and 66% believe this risk is immediate.
Questions worth separating out
Q: How should security teams test AI agents after prompts, models, or tools change?
A: They should test AI agents every time a meaningful change occurs, not on a calendar alone.
Q: Why do point-in-time assessments fail for AI agent governance?
A: They fail because the assessment is usually completed against a version that has already changed.
Q: What breaks when AI agents are given broad inherited permissions?
A: Broad inherited permissions break the assumption that access is tied to a narrow business need.
Practitioner guidance
- Rebuild testing around every meaningful change Trigger security validation whenever prompts, models, tools, memory sources, or permissions change, rather than waiting for quarterly or annual review cycles.
- Separate pre-deployment testing from runtime enforcement Use automated red teaming to catch regressions before release, then enforce live AI guardrails that can block unsafe tool calls or sensitive data access in production.
- Version-control agent prompts and tool definitions Treat prompts, tool schemas, and agent configurations as governed artifacts that move through the same review discipline as code and infrastructure changes.
What's in the full article
Akto's full blog post covers the operational detail this post intentionally leaves for the source:
- A continuous testing lifecycle for AI agents across development, pre-deployment, and runtime enforcement
- Examples of prompt injection, goal hijacking, tool abuse, context poisoning, and permission drift scenarios
- A practical mapping of continuous testing to NIST AI RMF functions and OWASP-style agentic risk coverage
- How discovery, red teaming, and guardrails connect into a closed-loop operating model
👉 Read Akto's analysis of continuous security testing for AI agents →
AI agent security testing: why static assessments keep missing drift?
Explore further
Static security assurance is structurally mismatched to agentic systems. A point-in-time assessment assumes the object being tested remains close enough to the tested version that the result still means something later. That assumption fails when prompts, models, tools, and permissions change continuously. The implication is not just that testing should happen more often, but that assurance has to track the live identity state of the agent, not a historical snapshot.
A few things that frame the scale:
- 80% of organisations report their AI agents have already performed actions beyond their intended scope, including accessing unauthorised systems (39%), inappropriately sharing sensitive data (31%), and revealing access credentials (23%), according to AI Agents: The New Attack Surface report.
- A second finding from the same research shows that only 44% have implemented policies to govern AI agents, which leaves most deployments with weak behavioural control even before runtime drift is considered.
A question worth separating out:
Q: What should organisations do when AI agent security is changing faster than review cycles?
A: They should shift from periodic approval to continuous governance. That means automated pre-deployment red teaming, runtime guardrails, change-triggered retesting, and access recertification for tools and data sources. The goal is to govern the agent as a live identity with evolving scope, not as a one-time software release.
👉 Read our full editorial: Continuous security testing is essential for AI agent governance