Subscribe to the Non-Human & AI Identity Journal

Notifications
Clear all

AI-generated code and OWASP risk: what AppSec teams need to know


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 15374
Topic starter  

TL;DR: AI coding assistants can produce syntax-correct code at over 95% accuracy while security pass rates remain around 55%, and roughly 45% of AI-generated samples introduce an OWASP Top 10 weakness directly into repositories, according to OXSecurity and CSA research. The practical shift is from catching isolated bugs to governing prompt-to-runtime failure paths before flawed defaults replicate across services.

NHIMG editorial — based on content published by OXSecurity: LLMjacking: How Attackers Hijack AI Using Compromised NHIs

By the numbers:

Questions worth separating out

Q: What breaks when AI coding agents are allowed to ship code without security constraints?

A: Teams get working software that can still carry old, well-known vulnerabilities back into production.

Q: Why do AI-generated applications increase the risk of security misconfiguration?

A: Because models optimise for working output, they often emit permissive settings that satisfy the prompt but weaken the environment.

Q: How do security teams know whether generated code is actually safe to ship?

A: They should look for policy compliance before commit, not just scan results after commit.

Practitioner guidance

  • Move security controls upstream into prompt and generation policy Require policy checks before code reaches the repository.
  • Treat generated configuration as release-critical artefacts Scan infrastructure-as-code, API policies, and deployment templates produced by AI with the same approval standard as application code.
  • Apply stronger NHI governance to AI-assisted pipelines Inventory service accounts, tokens, and API keys used by IDE assistants, CI jobs, and build automation.

What's in the full article

OXSecurity's full article covers the operational detail this post intentionally leaves for the source:

  • The article walks through the 2025 OWASP category changes and explains why each shift matters for AppSec decision-making.
  • It includes detailed examples of how AI-generated code reproduces broken access control, misconfiguration, and supply chain flaws across modern SDLCs.
  • The source also discusses prompt-level prevention, runtime reachability, and agentic exploit validation as part of a closed-loop defence model.

👉 Read OXSecurity's analysis of AI-generated code and the 2025 OWASP Top 10 →

AI-generated code and OWASP risk: what AppSec teams need to know?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 14958
 

AI-generated code has not created new vulnerability classes, but it has industrialised old ones. The article is right to separate novelty from scale. Broken access control, misconfiguration, and supply chain failures are the same categories security teams already know, but AI now reproduces them across services at machine speed. That means the real change is governance pressure, not taxonomy pressure. AppSec and identity teams should treat generation velocity as a risk multiplier, not a productivity gain.

A question worth separating out:

Q: How can AppSec teams tell whether their controls are keeping pace with AI delivery?

A: Look for signals such as shrinking triage backlog, faster validation cycles, and a complete inventory of AI-enabled features, endpoints, and data flows. If the team can explain the security impact of a new release before it reaches production, the control plane is keeping pace. If not, the programme is already behind.

👉 Read our full editorial: AI-generated code shifts OWASP risk from bugs to systemic assembly



   
ReplyQuote
Share: