TL;DR: AI-generated code can ship with vulnerabilities at high rates, and user trust in model-produced code increases the chance that insecure output bypasses review, according to Arxan Technologies. The real issue is governance drift: code generation, dependency selection, and deployment controls now need to be treated as one security chain, not separate tasks.
NHIMG editorial — based on content published by Arxan Technologies: Securing AI-Generated Code with Digital.ai Release
By the numbers:
- Out of 130 code samples generated using InCoder and Github Copilot, 68% and 73% of the code samples contained vulnerabilities when checked manually.
- ChatGPT was used to generate 21 programs in five different programming languages, and only five out of 21 were initially secure.
- A 2023 industry survey of 537 technology and IT workers and managers found that 76% responded that AI code is more secure than human produced code.
Questions worth separating out
Q: How should security teams govern AI-generated code in production pipelines?
A: Security teams should treat AI-generated code as a controlled identity event, not just a development artifact.
Q: What do security teams get wrong about AI-generated code risk?
A: They often focus on catching insecure output after code is written, which is too late for AI-native workflows.
Q: What do security and engineering teams get wrong about AI-assisted development?
A: They often confuse faster output with better control.
Practitioner guidance
- Enforce review gates for AI-generated code Require every AI-assisted change to pass the same peer review, testing, and approval steps as human-authored code, with no exception for speed or confidence in the model output.
- Restrict pipeline identities with least privilege Limit build, scanning, policy, and release automation to the narrowest permissions needed, and separate generate, approve, and deploy functions across distinct non-human identities.
- Validate model-suggested dependencies before build promotion Block packages and libraries that fail security policy, and run dependency scanning early enough that risky components never reach staged or production environments.
What's in the full article
Arxan Technologies' full article covers the operational detail this post intentionally leaves for the source:
- Integration specifics for SAST, SCA, OPA, ArgoCD, and Argo Rollouts in a secure release pipeline
- The article's step-by-step compliance framework for testing, policy enforcement, traceability, and rollback
- How RBAC is applied across developers, security teams, and administrators in the AI code workflow
- Examples of how chain of custody records prompts, dependencies, and deployment actions for investigation
👉 Read Arxan Technologies' analysis of securing AI-generated code in release pipelines →
AI-generated code security: are your pipeline controls keeping up?
Explore further
AI-generated code is becoming a governance problem before it is a code-quality problem. The article is about insecure output, but the deeper issue is that organisations are now accepting machine-generated changes through pipelines built for human authorship. That weakens review discipline, provenance, and approval accountability. Security teams should treat AI-assisted development as a controlled identity and policy domain, not just a productivity feature.
A question worth separating out:
Q: How can organisations prove where insecure AI-generated code came from?
A: By maintaining chain of custody for the full software lifecycle. Teams need records of prompts, outputs, dependency selections, policy decisions, and deployment actions so they can reconstruct how a flaw entered the pipeline. Without provenance, remediation becomes guesswork and accountability weakens.
👉 Read our full editorial: AI-generated code security exposes blind spots in pipeline governance