Join our Newsletter — 33% off our NHI Course
Home› Glossary› Authentication, Authorisation & Trust› Public-Key Authentication
Authentication, Authorisation & Trust

Public-Key Authentication

← Back to Glossary
By NHI Mgmt Group Updated October 31, 2026 Domain: Authentication, Authorisation & Trust

An authentication method that proves possession of a private key without sending the key itself. In OpenSSH certificate workflows, certificate-based authentication builds on this model by adding CA signatures, identity attributes, and expiration checks to control who can connect.

How Public-Key Authentication Works

Public-key authentication proves that a client controls a private key without ever revealing that key to the server. The server checks a corresponding public key, signed challenge, or certificate assertion, so the secret stays local while the proof happens over the wire. That makes the method useful wherever password replay or shared-secret exposure is a concern.

In practice, the security property is possession, not memorised knowledge. The server is not trusting a string the user types; it is trusting cryptographic proof that the connecting party can answer with the right private key at the right moment.

Why It Is Stronger Than Password-Based Sign-In

Public-key authentication changes the attacker’s job. A captured password can often be reused, but a private key is designed to remain non-exported, hardware-backed, or otherwise harder to steal in a usable form. It also fits well with short-lived challenges and key rotation, which reduce the value of intercepted traffic and limit replay.

NIST SP 800-63 Digital Identity Guidelines treats phishing-resistant authenticators and proof-of-possession style flows as materially stronger than reusable shared secrets, especially where the authentication ceremony must resist interception and replay.

The model is still only as strong as the private key’s protection and the verification policy around it. If the private key is copied, exported, or approved too broadly, the cryptography remains sound but the authentication outcome is no longer trustworthy.

Certificates, Trust Anchors, and Identity Binding

Public-key authentication becomes more operationally useful when the public key is wrapped in a certificate or similar trust assertion. In OpenSSH workflows, certificate-based authentication adds a CA signature, identity attributes, and an expiration window, so the key is no longer just a static credential, it is a time-bounded assertion about who may connect.

That extra metadata matters because it lets an organisation bind access to a named trust issuer, scope the key to a role or host class, and revoke or let it expire without depending only on distributed allowlists. It also creates a clean policy layer between raw cryptographic possession and the access decision.

OpenSSH-style certificate flows are therefore not just about strong crypto, they are about reducing reliance on long-lived, manually copied public keys and replacing them with verifiable trust decisions.

RFC 7523: JWT Profile for OAuth 2.0 Client Authentication and Authorization Grants shows the same broader design principle in a different protocol family, namely authenticating with signed assertions instead of shared secrets.

Where Public-Key Authentication Fails in Real Environments

The cryptography can be correct while the deployment is still weak. Common failure modes include unmanaged key sprawl, poor revocation hygiene, overbroad trust in a CA, weak key storage on endpoints, and accidental reuse of the same key across multiple systems. Those issues turn a strong primitive into an operational exposure.

Smart Card and PIV/CAC Authentication Guide is a useful operational companion because it shows how certificate-based authentication depends on enrollment, certificate mapping, and removal policy, not just on the presence of a key pair.

OWASP API Top 10 API2 Broken Authentication Guide is also relevant where the same possession-based model is used for machine callers, because authentication failures often emerge from poor validation, weak token handling, or unsafe fallback paths rather than from broken cryptography itself.

For defenders, the important question is not only whether the key exists, but whether its issuance, binding, expiry, storage, and revocation are controlled tightly enough to preserve the trust the protocol assumes.

Where It Fits in Modern Access Design

Public-key authentication is now a foundation for passwordless login, host and workload identity, SSH certificates, mutual TLS, and signed client assertions. Its practical value is highest when a system needs strong proof of possession, low replay risk, and tighter control over who or what can connect.

NHI Authentication Guide places public-key authentication in the wider non-human identity landscape, including workload authentication, certificate-based sign-in, and sender-constrained flows.

API Keys vs OAuth Tokens Guide helps explain where public-key approaches outperform static keys, especially when short-lived, scoped, and sender-constrained authentication is preferable to reusable bearer material.

Used well, public-key authentication reduces secret exposure and improves assurance. Used casually, it can still become just another long-lived credential store, only with more complicated failure modes.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

NIST SP 800-63, NIST SP 800-53 Rev 5 and OWASP ASVS set the technical controls, while ISO/IEC 27001:2022 defines the regulatory obligations.

FrameworkControl / ReferenceRelevance
NIST SP 800-63Digital Identity GuidelinesDefines phishing-resistant, possession-based authentication assurance for this exact method.
Recommendation — Use phishing-resistant authenticators and proof-of-possession requirements for high-assurance sign-in.
NIST SP 800-53 Rev 5IA-2 — Identification and Authentication (Organizational Users)Covers strong user authentication using cryptographic authenticators in enterprise access control.
IA-9 — Identification and Authentication (Service and External Information Systems)Applies when services, workloads or external systems authenticate with keys or certificates.
Recommendation — Require cryptographic authenticators for organizational sign-in and enforce verifier-side validation. Use certificate- or key-based mutual authentication for service-to-service access.
OWASP ASVSV6 — AuthenticationASVS V6 directly governs authentication strength, verifier handling and anti-replay requirements.
V10 — OAuth and OIDCRelevant where signed client assertions and certificate-bound authentication are used in federated flows.
Recommendation — Verify strong authentication flows, replay resistance and secure credential handling. Validate signed assertions, client binding and token-handling requirements in federated authentication.
ISO/IEC 27001:2022A.5.15 — Access controlAccess control policy must govern how cryptographic authentication is approved and enforced.
A.8.5 — Secure authenticationDirectly addresses secure authentication mechanisms, including certificate and key-based methods.
Recommendation — Define access rules for key-based authentication and limit acceptance to approved trust paths. Implement secure authentication mechanisms with strong enrollment and verification controls.

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.

NHIMG Editorial Note
Reviewed and updated by the NHIMG editorial team on October 31, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org