Join our Newsletter — 33% off our NHI Course
Home FAQ Cyber Security What do banks get wrong about AI in…
Cyber Security

What do banks get wrong about AI in banking programmes?

← Back to all FAQ
By NHI Mgmt Group Editorial Team Updated September 7, 2026 Domain: Cyber Security

Banks often treat AI as a feature project and under-specify its authority. The real issue is whether the system is allowed to read sensitive data, trigger actions, or influence decisions without clear governance. If that boundary is vague, the bank creates machine-driven access paths that auditors and IAM teams cannot easily see.

Where Banks Misread AI Programmes as Feature Delivery

Banks often underestimate that AI in banking is not only a model-risk topic but also an access-governance problem. The failure is rarely the model alone; it is the combination of data reach, decision authority, and execution rights that turns an AI initiative into a control issue. When teams treat AI as a thin layer on top of existing processes, they miss who can see what, who can act, and what evidence proves that those actions were authorised. OWASP’s OWASP Non-Human Identity Top 10 is relevant here because banking AI often operates with the same identity, credential, and privilege questions that apply to other machine actors. In practice, many security teams encounter the access problem only after the AI system has already been wired into live workflows, rather than through intentional governance design.

That matters because AI programmes can quietly expand the bank’s trusted computing surface. A chatbot, triage assistant, underwriting copilot, or analyst tool may be technically useful while still being poorly bounded from a security perspective. Once it can query customer records, draft instructions, or initiate downstream actions, the bank has introduced a control boundary that must be explicitly designed and continuously reviewed.

How the Authority Boundary Should Be Read in Practice

The practical question is not whether the AI works, but what authority it has been given. In banking, the same system may be harmless as a summariser and risky as a decision participant. The difference lies in whether the tool is read-only, whether it can write into systems of record, whether it can trigger approvals, and whether its outputs are treated as recommendations or as operational instructions.

Teams commonly get this wrong in three ways. First, they connect AI to broad data sources without narrowing the scope to the minimum necessary. Second, they expose the system to production workflows before defining what human review is mandatory. Third, they assume that a model policy is enough, even though the real control issue is the machine identity, token, session, or service account that lets the AI act.

  • Separate informational use from actioning use.
  • Define which data classes the system may read, and which it must never touch.
  • Bound every write path, approval path, and handoff path to a named owner.
  • Record when the AI is advisory only, and when it enters a regulated workflow.

In practice, the bank should treat AI as part of the operational control plane, not as a presentation layer. That means the security review has to cover identity, privilege, logging, and exception handling alongside model quality. The guidance breaks down when the programme is built on loosely coupled pilots that never consolidate into a governed operating model, because then no one can reliably prove what the system was allowed to do at any given time.

When Banking AI Becomes an Exception Factory

Tighter AI enablement often increases operational and governance overhead, requiring banks to balance speed of deployment against traceable control over data use and downstream action. The hardest edge case is not the obvious customer-facing assistant, but the internal tool that appears low risk because it only supports staff. Those systems often inherit broader access, more sensitive context, and weaker review discipline than external channels.

Another common edge case is the difference between recommendation and decision influence. Industry practice is not fully settled on where that line should sit for every banking use case, but the governance principle is clear: the closer AI gets to credit, fraud, payments, complaints, or customer remediation, the more it needs explicit approval thresholds and human accountability. A second edge case is delegated action. If an AI can create cases, update records, or send instructions through connected systems, then the control problem is no longer just model output quality. It becomes a question of whether the bank can detect and constrain machine-originated actions with the same discipline applied to privileged users.

That is why a bank programme can look mature on paper while still being fragile in operation. A pilot that avoids production data and actioning may be easy to approve; a scaled programme that blends advice, retrieval, and execution is where boundary ambiguity turns into audit findings, access sprawl, and avoidable exposure.

Risk and Threat Considerations

Banking AI programmes create material exposure when authority is under-defined. The risk is not limited to inaccurate outputs; it also includes over-broad data access, unauthorised action paths, and machine-driven workflows that outgrow existing oversight. Where the AI can retrieve sensitive records or trigger downstream activity, the bank may create a new class of privileged access that is hard to attribute cleanly.

Failure mechanism: The control failure usually emerges when a model, orchestration layer, or agent is granted credentials or system connectivity without tightly scoped permissions, step-up review, and monitoring for non-human action patterns. That can allow excessive read access, unintended writes, or automation of steps that were meant to remain human-controlled.

Impact: The result can be confidentiality exposure, unauthorised transaction or case changes, poor auditability, and weakened segregation of duties. At scale, the bank may lose the ability to prove whether a given action was an approved business decision or an AI-originated workflow event.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Non-Human Identity Top 10 address the attack surface, NIST CSF 2.0 and CIS Controls v8 set the technical controls, and ISO/IEC 42001:2023 define the regulatory obligations.

FrameworkControl / ReferenceRelevance
OWASP Non-Human Identity Top 10NHI-01 — Inventory and OwnershipBanking AI often acts through machine identities and delegated access.
NHI-03 — Secrets and Credential ManagementAI programmes depend on tokens, keys, and service credentials to reach bank systems.
NHI-06 — Authorization and Privilege BoundariesThe question centres on what AI is allowed to read, change, or trigger.
Recommendation — Inventory every AI-linked machine identity and assign a clear owner. Restrict and rotate AI credentials to the minimum access needed. Enforce least privilege for every AI read and action path.
NIST CSF 2.0PR.AC-4 — Access Permissions and AuthorizationsBanks need explicit permission boundaries for AI-linked access paths.
GV.RM-03 — Risk Management StrategyBank AI programmes require governance over authority, data use, and accountability.
Recommendation — Define and review AI permissions before connecting it to live banking systems. Embed AI authority limits into the bank's formal risk strategy.
CIS Controls v86.3 — Access Granting and RevocationAI pilots often expand access faster than banks revoke unused privileges.
Recommendation — Revoke excess AI access paths as soon as they are no longer required.
ISO/IEC 42001:2023A.6.2 — AI system design and developmentThe issue is whether AI is designed with clear governance and operational boundaries.
Recommendation — Design AI workflows with explicit decision and action boundaries.

Practitioner Guidance

What to prioritise: Treat authority definition as the first design decision, not a late-stage control. If the programme cannot state whether the AI is advisory, read-enabled, or action-enabled, it is not yet ready for production use in a bank.

What to verify: Confirm the exact data classes, system actions, and exception paths the AI can reach, and verify that each one has a named business owner and a review rule. Banks often underestimate how quickly a “helpful” internal assistant becomes a privileged workflow when connected to live systems.

Practitioner takeaway: The bank’s real AI control problem is not model enthusiasm; it is authority discipline. If a programme cannot explain what the system may see, what it may change, and who remains accountable when it acts, the bank has not governed AI, it has only connected it.

Deepen Your Knowledge

Sign up to our weekly newsletter — get 33% off our NHI Foundation Level Course

    NHIMG Editorial Note
    Reviewed and updated by the NHIMG editorial team on September 7, 2026.
    NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org