TL;DR: Application security assessment is moving beyond code and infrastructure you control, because third-party SaaS, AI tools, and integrations create blind spots in permissions, data flows, and runtime behaviour, according to Vorlon. The real security test is whether teams can score risk contextually across the application ecosystem, not just count vulnerabilities.
Editorial analysis by NHI Mgmt Group, based on content published by Vorlon: “Application Security Assessment: How to Calculate the Risk”.
Key questions
Q: What breaks when application security assessments do not include SaaS and AI integrations?
A: They miss the places where real risk now concentrates: permissions, data flows, and runtime behaviour outside the owned codebase.
Q: Why do third-party SaaS tools and AI services create application security blind spots?
A: Because teams usually cannot inspect their code, infrastructure, or full logs, so the assessment shifts from direct testing to indirect evidence.
Q: How do security teams know if contextual vulnerability management is working?
A: It is working when teams can answer three questions quickly: what can reach this asset, what identities does it trust, and what can an attacker reach from it if it is compromised.
Practitioner guidance
- Map the full application ecosystem Inventory owned applications, SaaS tools, AI services, APIs, data stores, and third-party integrations so assessment scope matches the real attack surface.
- Score risk with business context Rank findings by exploitability, data sensitivity, business impact, and trust-boundary exposure instead of relying on raw vulnerability counts.
- Review OAuth scopes and delegated access Check whether third-party tools and connected services hold permissions that exceed their actual task requirements, especially for data access and action permissions.
Bottom line: Application security assessment is shifting from single-application testing to ecosystem risk management because third-party services now participate in the attack surface.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Ecosystem assessment is now the real AppSec discipline: organisations no longer secure a single codebase, they secure a mesh of applications, identities, APIs, and data-sharing relationships. That changes the unit of analysis from vulnerability management to trust-boundary management, because the most serious failures now happen where services and permissions connect. Practitioners should treat SaaS and AI integrations as part of the application estate, not as peripheral exceptions.
A few things that frame the scale:
- Secrets management is a top five cybersecurity priority for only 33% of organisations, behind cloud security (45%), API security (42%), and endpoint security (36%), according to the 2024 State of Secrets Management Survey.
- 1 in 3 organisations encountered suspicious AI agent activity in 2025, and 99.4% experienced a SaaS or AI ecosystem incident.
A question worth separating out:
Q: Should organisations treat SaaS and AI connections as part of the application estate?
A: Yes. If a service can read data, call APIs, or trigger workflows, it is functionally part of the application estate and must be assessed that way. The governance boundary should follow trust and access, not ownership alone, because attackers exploit the seams between systems, not just the systems themselves.
👉 Read our full editorial: Application security assessments now need SaaS and AI supply chain scope