Join our Newsletter — 33% off our NHI Course

Does LLM-driven risk scoring improve identity detection?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20230
Topic starter  

TL;DR: Raw identity event sequences can be scored with token-level surprise and peak perplexity to flag anomalous logins and sessions, according to Okta. Identity controls then need to use that signal alongside explicit authentication and session policy decisions, not as a replacement for them.

Editorial analysis by NHI Mgmt Group, based on content published by Okta: “The Next Frontier in Identity Security with LLM-Driven Risk Scoring”.

Key questions

Q: What breaks when identity risk scoring only looks at feature snapshots?

A: Behavioural context breaks first.

Q: When should organisations prioritise sequence-aware scoring over more hand-built features?

A: Prioritise it when risk decisions depend on order, co-occurrence, or behavioural drift rather than on a single field being new or missing.

Q: How should IAM teams use LLM-based risk scoring without replacing existing controls?

A: Use it as an additional behavioural signal, not as a stand-alone decision engine.

Practitioner guidance

  • Tune risk-based MFA to sequence signals Test whether your authentication policies can consume behavioural sequence scores, then map high-risk outcomes to step-up authentication for sensitive applications and privileged sessions.
  • Preserve event order in identity telemetry Keep session timelines intact in your logging and detection pipeline so that user, device, country, and user-agent changes remain evaluable as a sequence rather than only as isolated fields.
  • Separate noisy tokens from identity context Strip or normalise high-entropy values such as IDs and hashes before they reach scoring models so that the model can focus on the identity attributes that matter for anomaly detection.

Bottom line: Identity risk scoring is shifting from static feature engineering toward sequence-aware evaluation of user behaviour.

Glossary terms: Sequence-based Risk Scoring, Peak Perplexity, Constrained-Context Prompting, Risk-Based Authentication

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 1 week ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20712
 

Sequence-aware identity scoring exposes the limits of snapshot-based risk. The article shows why event-by-event heuristics miss the part of identity behaviour that actually matters: order, context, and contradiction across a session. Risk engines built on isolated counters assume the relevant signal survives compression, but much of it disappears when logs are flattened into features. The practitioner conclusion is straightforward: behavioural consistency must be assessed across the full interaction history, not only at the current login.

A few things that frame the scale:

  • AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026.

A question worth separating out:

Q: How do security teams know whether perplexity-based scoring is actually working?

A: Check whether high scores correlate with sessions that are genuinely inconsistent with user history, and whether low scores remain stable for normal behaviour. The model should improve detection precision without flooding the team with alerts on routine travel, device changes, or business-hours variation.

👉 Read our full editorial: LLM-based identity risk scoring exposes the limits of IAM heuristics



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.