Join our Newsletter — 33% off our NHI Course

SAST or semantic AI review for cross-file vulnerabilities?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20217
Topic starter  

TL;DR: AI-assisted review found 152 confirmed high or critical issues across 23 repositories, versus 17 from commercial SAST, with 70 uncovered through deep semantic analysis, according to Namirial. Cross-file logic and design flaws need a validation layer that can separate credible findings from noise before teams gate release decisions.

Editorial analysis by NHI Mgmt Group, based on content published by Namirial: “Multi-agent AI security: how Namirial hardened its trust services in 28 days, using frontier AI models”.

By the numbers:

  • The AI pipeline produced 152 candidate findings, of which 136 were confirmed by code owners and remediated.
  • The commercial SAST identified 17 high or critical findings across the same perimeter.
  • On 22 of 23 repositories, the AI pipeline identified more high or critical findings than the commercial SAST.

Key questions

Q: When does AI-assisted code review create more value than traditional scanning?

A: It creates the most value when the risk depends on intent, cross-file execution or security decisions hidden across modules.

Q: What are the signs that an AI security pipeline is not trustworthy enough for release gating?

A: High finding counts are not the problem by themselves.

Q: What should security teams do first when AI scanners produce more findings than analysts can triage?

A: Start by separating validated, exploitable findings from unverified output and route them into distinct queues.

Practitioner guidance

  • Define which defect classes belong in AI review Separate logic flaws, trust boundary issues, cryptographic misuse and exception handling from the categories your SAST already covers well.
  • Build a validation stage before human triage Require an independent challenge step that attempts to disprove each candidate finding before engineers spend time on it.
  • Route findings into existing engineering workflows Automatically open issues from structured findings so review, ownership and remediation stay inside the normal delivery process.

Bottom line: Pattern-based scanning still misses logic-heavy and cross-file defects that require semantic reasoning to detect reliably.

Glossary terms: Semantic Vulnerability, Adversarial Validation, Multi-Agent Security Pipeline, Cross-File Data Flow

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 1 week ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20707
 

AI-assisted code review is becoming a governance control, not just a productivity experiment. The article shows a shift from using models as drafting aids to using them as structured security reviewers embedded in a release process. That matters because the primary risk is no longer whether the model can write code, but whether it can improve the organisation’s ability to find flaws that traditional tools miss. The practitioner conclusion is to treat AI review as part of the security control stack, with explicit validation and ownership.

A few things that frame the scale:

A question worth separating out:

Q: How should organisations compare AI security analysis with SAST in a mixed programme?

A: Do not compare them as substitutes. Use SAST for mature signature-based defect classes and AI review for semantic, multi-step and design-level flaws. The best programme is the one that assigns each control to the type of weakness it can actually see, then validates overlap so teams do not chase duplicate findings.

👉 Read our full editorial: AI-assisted vulnerability discovery outperforms pattern-based SAST


This post was modified 1 week ago by NHI Mgmt Group

   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.