Join our Newsletter — 33% off our NHI Course

Why is AI-generated code creating so much AppSec risk?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20217
Topic starter  

TL;DR: Benchmark testing across 18 generative AI models found secure code was inconsistent and vulnerable output appeared in more than 30% of atomic use-case scenarios, according to Armis. AppSec now has to sort security debt by reachability and business impact, not just stack more findings.

Editorial analysis by NHI Mgmt Group, based on content published by Armis: “Beyond the Scanner: Why AI-Native AppSec Must Evolve into Risk Management”.

By the numbers:

  • Armis found vulnerable code in over 30% of atomic use-case scenarios.
  • The benchmark identified CWE-770, allocation of resources without limits, as the most frequent vulnerability across all models.

Key questions

Q: What are the best practices for reducing AppSec tool sprawl in AI-native development?

A: Start by defining a single prioritisation model that ranks findings by exploitability, reachability, and business impact.

Q: What breaks when AppSec teams keep using separate scanners without shared context?

A: They get overlapping findings, inconsistent severity scoring, and manual triage overhead that masks which issues are actually reachable or exploitable.

Q: How should security teams govern AI-generated code in production environments?

A: Security teams should treat AI-generated code as normal production code with extra provenance risk.

Practitioner guidance

  • Prioritise AI-generated code by production reachability Rank findings by whether the vulnerable path is reachable in production and tied to business-critical workflows, not by scanner output alone.
  • Add security-specific gates for AI-assisted delivery Require AI-native scanning and policy checks before code can move from development into production-bound branches or release candidates.
  • Verify fixes with an independent second pass Use a separate validation step after remediation to confirm the original flaw is closed and the change did not introduce a new weakness.

Bottom line: AI-native development is creating a risk-management problem, not just a code-quality problem, because insecure patterns can be produced faster than teams can review them.

Glossary terms: AI-Native AppSec, Scanner sprawl, Production reachability, Security Debt

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 7 days ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20707
 

AI-native AppSec has already shifted from defect detection to security governance. The article’s central point is not that scanners are obsolete, but that scanner output alone no longer defines programme success. When code generation is accelerated by models, the governing question becomes whether the organisation can reduce risk faster than it creates it. That turns prioritisation, reachability, and verification into core controls rather than downstream hygiene. Practitioners should measure security outcomes, not tool volume.

A question worth separating out:

Q: Should organisations prioritise secure coding controls before expanding AI developer tools?

A: Yes, if the current delivery process cannot verify code security at the same pace it can generate code. Organisations should strengthen scanning, secret detection, and release gating first, especially in identity-sensitive applications. Otherwise, AI tools simply amplify the volume of vulnerable code entering production.

👉 Read our full editorial: AI-native AppSec needs risk management, not scanner sprawl


This post was modified 7 days ago by NHI Mgmt Group

   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.