By NHI Mgmt Group Editorial TeamBased on Sift: “Fraud Score: How AI Calculates Transaction Risk in Real Time” (September 16, 2025)

TL;DR: AI-powered fraud scoring processes hundreds of transaction, device, and behavioral signals in milliseconds to produce risk scores that can approve, step up, or block payments, according to Sift. The real issue is not whether models can score faster, but whether organisations can tune thresholds, governance, and review paths without creating blind spots or excessive friction.


At a glance

What this is: Sift describes AI fraud scoring as a real-time decision layer that turns many transaction and behavioural signals into a risk score for approval, step-up or blocking.

Why it matters: It matters because IAM, fraud, and payment teams need governance over score thresholds, escalation paths and review decisions, not just faster detection.

By the numbers:

  • Global payment fraud losses reached $48.2 billion in 2024.

Context

Fraud scoring sits at the intersection of transaction security and identity governance because it turns device, behaviour and historical activity into a decision about whether a user or payment flow should be trusted. Binary approve or block logic struggles when fraud patterns change quickly, which is why real-time scoring has become a control point rather than just a detection layer.

For IAM and fraud teams, the governance question is not whether scoring exists, but how thresholds, step-up controls and manual review are tuned and monitored. When score-driven decisions influence checkout, login, and account-change flows, weak calibration can create both fraud blind spots and unnecessary friction for legitimate users.


Key questions

Q: What breaks when fraud scoring thresholds are not calibrated properly?

A: Poorly calibrated thresholds create two failures at once: legitimate customers are blocked or forced through unnecessary step-up checks, and risky transactions may pass because the model is set too leniently. The result is a control that looks sophisticated but performs inconsistently. Teams should evaluate thresholds as a business policy decision, not just a technical model setting.

Q: Why do real-time fraud scores reduce the value of simple yes-no rules?

A: Yes-no rules only react to isolated conditions, while fraud scoring combines many weak signals into one risk view. That matters when attackers vary amount, device, location and timing to avoid obvious triggers. Score-based decisions are more resilient, but only if the signals stay current and the review logic is maintained.

Q: How do security and fraud teams know if AI fraud scoring is working?

A: They should look for stable approval rates, lower false positives, consistent reason codes and a defensible review trail. A model can look accurate in aggregate while still creating operational harm if it cannot explain why a legitimate order was rejected. The test is whether the decision can be audited and improved.

Q: When should organisations add step-up authentication during a session?

A: They should add step-up authentication when the action is higher risk than the original login, such as privileged resource access, unusual device changes, or a suspicious location shift. That approach limits unnecessary friction while still reacting when the session no longer looks trustworthy.


Technical breakdown

How real-time fraud scores are calculated

AI fraud scoring combines supervised learning, anomaly detection and ensemble methods to convert many weak signals into a single transaction risk value. Models examine transaction amount, merchant category, device fingerprint, location, account age, login behaviour and historical patterns, then compare the current event with known legitimate and fraudulent behaviour. Because the output is a score rather than a yes or no rule, the business can map different score bands to different actions.

Practical implication: Use score bands to separate approval, step-up and manual review instead of relying on a single hard block threshold.

Why binary rules create blind spots

Traditional if-then fraud rules are brittle because they fire on isolated conditions and miss context, while also creating high false-positive rates. Score-based systems reduce that rigidity by weighting multiple signals at once and retraining on new fraud patterns as they emerge. That makes them better at catching account takeover, card testing and other changing fraud behaviours, but only if the underlying data inputs remain current and the model is monitored for drift.

Practical implication: Treat rule sets as supplementary controls and monitor model drift whenever transaction patterns or fraud tactics shift.

How low-latency scoring supports payment decisions

Real-time fraud systems have to return a decision within tight processing windows, often under 100 milliseconds, which drives the need for stream processing, caching and sometimes edge execution. The architecture matters because a delayed score is operationally equivalent to no score at all. Continuous updates also matter, since static models degrade as customer behaviour and attacker tactics evolve.

Practical implication: Design decision latency, retraining cadence and fallback logic as part of the control, not as an implementation detail.


NHI Mgmt Group analysis

AI fraud scoring is becoming a governance control, not just a detection model. The article shows that modern payment systems no longer simply identify suspicious activity after the fact, they arbitrate trust in real time. That makes threshold design, escalation logic and human review part of the control plane, not a back-office tuning exercise. Practitioners should treat score governance as a core trust decision.

The real risk is threshold miscalibration, not model speed. Fast scoring has little value if low-risk traffic is over-checked or high-risk traffic is allowed through because the score bands are poorly tuned. The operational failure is a decision system that cannot balance fraud reduction against customer friction. Teams should measure false positives, decline rates and review outcomes as one governance set.

Decision latency is the named concept: if the score does not arrive inside the payment window, the organisation has already lost the control value it was trying to create. That is why architecture, model refresh and response orchestration have to be designed together. Security and fraud teams should align real-time scoring with checkout and account-change workflows, not bolt it on afterwards.

Identity signals are now part of transaction trust, which pulls fraud operations closer to IAM governance. Device consistency, login patterns and account age are identity-adjacent controls, even when they sit inside a payments stack. That means IAM, fraud and application teams need shared ownership of what counts as a trusted session. Practitioners should govern score-driven decisions as cross-functional identity-risk decisions.

Continuous retraining is necessary, but it is not a substitute for control review. Fraud models learn from emerging patterns, but the surrounding business rules still decide what happens when confidence is low. The better programme combines model governance with clear operational thresholds and override paths. Practitioners should review both the model and the decision policy on a standing schedule.

From our research library:

What this signals

Decision latency is now a control requirement. In payments, a risk score that arrives after the authorization window is operationally useless, so latency, stream processing and fallback behaviour must be governed alongside model accuracy. Teams should treat scoring infrastructure as part of the decision boundary, not a separate analytics layer.

Fraud scoring pulls identity signals into transaction governance. Device consistency, account age and behavioural patterns are identity-adjacent inputs that can no longer sit in isolated fraud workflows. Practitioners should align IAM, fraud and application teams around what constitutes a trusted session or trusted device before the next rules change.


For practitioners

  • Define score bands and actions Map specific score ranges to approve, step-up authentication, manual review and block decisions so operators know exactly what each outcome means.
  • Set governance for threshold changes Require fraud, IAM and product owners to approve threshold changes so business pressure cannot quietly weaken risk tolerance.
  • Monitor false positives and review outcomes Track legitimate declines, manual review overturns and abandoned transactions together to see whether the scoring policy is creating avoidable friction.
  • Validate the data signals behind the score Confirm that device, location, behaviour and historical activity inputs are still representative of current customer and attack patterns.
  • Test low-latency fallback paths If the model or stream pipeline fails, define whether the transaction is held, stepped up or declined before the payment window closes.

Key takeaways

  • AI fraud scoring turns payments into real-time trust decisions, which makes threshold governance as important as model performance.
  • The key operational risk is miscalibration, where the system either frustrates legitimate users or lets risky activity through.
  • Teams need shared ownership of scores, review paths and fallback logic so fraud controls stay effective as tactics and customer behaviour change.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

MITRE ATT&CK addresses the attack surface, NIST CSF 2.0, NIST SP 800-53 Rev 5 and CIS Controls v8 set the technical controls, and GDPR defines the regulatory obligations.

FrameworkControl / ReferenceRelevance
NIST CSF 2.0PR.AA-05 — Access Permissions, Entitlements and AuthorizationsRisk scoring influences authorisation decisions for payments and account actions.
Recommendation — Align score-based transaction decisions with PR.AA-05 so authorisation reflects current risk.
NIST SP 800-53 Rev 5IA-5 — Authenticator ManagementStep-up and block outcomes depend on how credentials and auth events are managed.
Recommendation — Apply IA-5 to govern how credentials trigger step-up or block decisions in payment flows.
CIS Controls v8CIS-5 — Account ManagementFraud scoring relies on account behaviour and access patterns tied to account governance.
Recommendation — Use CIS-5 to tie account state and changes into fraud risk evaluation and escalation.
MITRE ATT&CKTA0006 — Credential AccessThe article addresses fraud patterns that often precede account compromise and credential abuse.
Recommendation — Map suspicious transaction patterns to TA0006 indicators when account compromise is suspected.
GDPRArt.32 — Security of ProcessingBehavioural and device data used for scoring may be personal data requiring security safeguards.
Recommendation — Apply Art.32 to protect behavioural scoring data with appropriate security and access controls.

Key terms

  • Fraud Score: A fraud score is a numerical risk value assigned to a transaction, login, or account action to estimate the likelihood of fraud. It lets organisations move beyond binary allow or block decisions and instead choose from graded controls such as step-up authentication, manual review, or decline.
  • Step-up Authentication: Step-up authentication is an additional verification step triggered when a session becomes higher risk or a user attempts a sensitive action. It is used to reduce exposure without forcing extra friction across every interaction, which makes it useful for runtime access governance.
  • False Positive: A false positive is a scanner result that looks like a secret but is not actually sensitive. In secret governance, false positives matter because they consume analyst time, weaken trust in alerts, and can delay response to the findings that truly change exposure and access risk.
  • Model Drift: Model drift is the gradual change in a model’s behaviour or performance after deployment. It happens when the operating environment, user patterns, or inputs no longer match the conditions used to validate the system. Drift matters because a model can appear functional while no longer meeting approved standards.

Deepen your knowledge

NHI Foundation Level course, the industry's only accredited NHI security programme, covers NHI governance, secrets management and workload identity through an identity-first lens. It is designed for practitioners who need to connect access control, governance and operational risk across modern security programmes.
NHIMG Editorial Note
Published by the NHIMG editorial team on July 12, 2026.
Updated on October 13, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org