Join our Newsletter — 33% off our NHI Course
Home› FAQ› Architecture & Implementation› Why does storing the private key only on…
Architecture & Implementation

Why does storing the private key only on the admin machine not eliminate SSH access risk?

← Back to all FAQ
By NHI Mgmt Group Editorial Team Updated October 8, 2026 Domain: Architecture & Implementation

Because the key location is only one part of the control model. The session still carries delegated trust through the bastion, and that trust can be used to reach internal hosts. Risk persists wherever the reachable set, forwarding rules, or destination permissions are broader than intended.

Why the private key’s location is not the same as access control

SSH risk is not eliminated by keeping the private key on one admin workstation, because the key is only one input to a larger trust chain. Once that key can authenticate, the real question becomes what the resulting session can reach, what it can forward, and whether the target permissions are narrower than the administrative path allows.

That is why SSH access has to be evaluated as an end-to-end control model, not as a file-placement problem. A locally stored key can still authorize a session that traverses a bastion, uses agent forwarding, or lands on an intermediate system with broader reach than the original admin host intended.

When organisations focus only on where the private key lives, they miss the trust extension created by the session itself. If that session can pivot into internal networks or inherit access to other hosts, the security boundary has simply moved, not disappeared.

What still makes the bastion path risky

The bastion, jump host, or forwarding channel becomes part of the trust boundary, so its compromise or overpermission changes the exposure profile of every key that uses it. A well-placed private key can still unlock a broad administrative path if the bastion is allowed to reach too much of the estate or if the user session inherits credentials beyond the intended destination.

In practice, the risk comes from delegation and reach, not just from theft of the key material. A session that is allowed to forward authentication or connect to internal hosts can be abused for lateral movement even when the original private key never leaves the admin machine.

That is why secure SSH design treats bastions, forwarded credentials, destination ACLs, and account privileges as one control set. If any one of those layers is too permissive, local key custody only reduces one exposure, it does not stop misuse of the authenticated channel.

How to think about SSH access as a bounded trust problem

The right mental model is whether the authenticated path is bounded tightly enough to match the intended administrative task. A private key on a hardened admin machine helps, but it does not by itself constrain what the authenticated user can do once connected.

  • Restrict which internal hosts the bastion can reach, and verify those paths separately from the key custody decision.
  • Limit agent forwarding and other session delegation features unless there is a clear operational need.
  • Use destination-specific permissions, not one broad administrative path for all systems.
  • Prefer short-lived or certificate-based SSH access where practical, so credential value decays faster after misuse.

For a deeper control view, the ssh key lifecycle and bastion problem are best understood alongside SSH Key and SSH Certificate Management Guide, which covers key sprawl, authorized_keys risk, rotation and bastion patterns.

Where SSH access is part of a broader privileged access design, PAM Buyer's Guide is useful for comparing vault-centred and JIT-centred approaches that reduce the blast radius of administrative sessions.

Risk and Threat Considerations

The main risk is not that the private key sits on the wrong laptop, it is that the authenticated session can become a reusable bridge into systems the operator should not broadly control. Once a bastion, forwarding rule, or destination permission is too permissive, compromise of that one path can expose multiple internal hosts.

Failure mechanism: An attacker who obtains or abuses the admin session can pivot through the bastion, forward credentials, or reuse the trust granted by the connection to reach internal targets beyond the intended scope.

Impact: The result can be lateral movement, unauthorized administrative access, and a much larger blast radius than the original private key location suggests.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

NIST SP 800-53 Rev 5 and CIS Controls v8 set the technical controls, while ISO/IEC 27001:2022 defines the regulatory obligations.

FrameworkControl / ReferenceRelevance
NIST SP 800-53 Rev 5IA-5 — Authenticator ManagementSSH key custody and rotation are authenticator lifecycle controls.
AC-6 — Least PrivilegeThe risk comes from sessions reaching more hosts than needed.
IA-9 — Service Identification and AuthenticationBastions and forwarded sessions are trust-bearing authentication paths.
Recommendation — Rotate SSH authenticators, limit lifetime, and revoke them promptly after use or compromise. Restrict SSH session reach and permissions to the minimum destination set required. Authenticate and bound intermediary SSH paths so delegated trust cannot be reused broadly.
ISO/IEC 27001:2022A.5.15 — Access controlSSH access depends on controlling who can reach which systems through the session.
A.8.2 — Privileged access rightsAdmin SSH sessions are privileged paths that need tighter governance.
Recommendation — Define and enforce SSH access rules by system and administrative purpose. Review and constrain privileged SSH rights to the smallest viable scope.
CIS Controls v8CIS-6 — Access Control ManagementSSH bastions and forwarded access are access-control problems, not just key-storage problems.
Recommendation — Manage SSH access paths centrally and remove unnecessary administrative reach.

Practitioner Guidance

What to verify: Confirm that the bastion cannot reach more destinations than the admin role requires, and that forwarding is disabled or tightly scoped for sessions that do not need it. If the path is broad enough to act as a general internal bridge, the control is too weak even if the key never leaves the admin machine.

Decision rule: If the authenticated SSH session can reach production systems, treat the path as privileged access and review destination permissions, session delegation, and key lifetime together rather than as separate issues.

Practitioner takeaway: SSH risk is governed by the reach of the authenticated session, not by where the private key is stored; reduce the session’s authority first, then harden the key custody model.

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.

NHIMG Editorial Note
Reviewed and updated by the NHIMG editorial team on October 8, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org