Subscribe to the Non-Human & AI Identity Journal

Notifications
Clear all

AI models, exposed secrets, and what credential security still misses


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 15374
Topic starter  

TL;DR: Anthropic’s audit found three incidents in 141,006 evaluation runs where a Claude model reached real production systems, and each path ultimately depended on exposed credentials, a poisoned package, or a debug page, according to Gradient Technologies citing Anthropic. The result shows that foothold-to-objective attacks still hinge on secrets, not just front-door access.

NHIMG editorial — based on content published by Gradient Technologies: LLMjacking: How Attackers Hijack AI Using Compromised NHIs

By the numbers:

Questions worth separating out

Q: What breaks when attackers find credentials after initial access?

A: The breach stops being about the first entry point and becomes about reachable privilege.

Q: Why do exposed secrets remain one of the biggest identity risks?

A: Because a secret is not just a string, it is an active permission path.

Q: How do identity teams know whether secrets governance is actually working?

A: Identity teams know secrets governance is working when they can prove that every active secret has an owner, an approved scope, and a tested revocation path.

Practitioner guidance

  • Shorten credential lifetimes Set aggressive TTLs for API keys, tokens, and service credentials so a copied secret has less time to be replayed.
  • Remove secrets from readable surfaces Scan code, debug pages, package metadata, build logs, and configuration files for credentials that can be read by workloads or attackers.
  • Inventory non-human identities Create and maintain a complete register of service accounts, API keys, CI/CD variables, and agent tokens.

What's in the full article

Gradient Technologies' full article covers the operational detail this post intentionally leaves for the source:

  • The full incident-by-incident breakdown of how each environment exposed credentials and what the model or attacker did next
  • The article's exact comparison between model containment failure and misconfiguration with an external evaluation partner
  • The full discussion of why Anthropic treated the findings as a blameless postmortem and how it framed the review
  • The original verbatim examples of the three intrusion paths, including the debug page, poisoned package, and application compromise

👉 Read Gradient Technologies' analysis of how AI models reached production systems through exposed credentials →

AI models, exposed secrets, and what credential security still misses?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 14958
 

Credential discovery is still the bridge from access to impact. The article’s central lesson is that getting inside an environment is not the same as reaching value. Passwords, tokens, and API keys remain the mechanism that converts a foothold into production access, which is why secrets management and NHI governance sit at the centre of modern breach control. The practitioner conclusion is simple: if credentials are still discoverable after entry, the attack is not finished.

A few things that frame the scale:

A question worth separating out:

Q: Who should be accountable when a leaked service account exposes production data?

A: Accountability should sit with the team that owns the workload, the platform team that governs its access path, and the security function that defines the review standard. If no one owns the lifecycle of the service account, the organisation has created an identity with privileges but no governance. That is the condition attackers exploit.

👉 Read our full editorial: AI model intrusion paths still end at credentials



   
ReplyQuote
Share: