TL;DR: Shapley values offer a fair, axiomatic way to attribute model predictions to input features, and Fiddler’s explainer shows why they became a standard tool for ML explainability and adverse action reasoning. The practical constraint is that feature absence must be approximated and the computation can explode to 2^n model calls, so attribution quality depends on sampling design and uncertainty handling.
Editorial analysis by NHI Mgmt Group, based on content published by Fiddler: “AI Explained Video Series: What are Shapley Values?”.
Key questions
Q: How should teams govern Shapley-based explanations in high-stakes ML decisions?
A: Treat the explanation method as part of model governance, not a post-processing step.
Q: Why can Shapley values produce misleading explanations if the baseline choice is weak?
A: Because the attribution depends on the counterfactual world created when a feature is treated as absent.
Q: What are the signs that sampled attribution scores are too uncertain to trust?
A: Watch for wide confidence intervals, unstable rankings across repeated runs, and large shifts in attribution when the sampling design changes.
Practitioner guidance
- Define the counterfactual missingness policy Specify how the organisation simulates feature absence for each model class, including baseline replacement, sampling distribution, and any feature dependency handling.
- Require uncertainty bounds for sampled attributions When sampling is used to approximate Shapley values, publish confidence intervals or an equivalent uncertainty measure alongside the attribution scores.
- Document explanation assumptions in model governance Record the feature absence method, sampling design, and limitations in the model card or governance pack so reviewers can assess whether the explanation is fit for lending, review, or adverse action use.
Bottom line: Shapley values give machine learning teams a defensible way to attribute prediction outcomes, but the method only works if the organisation can justify how it simulates missing features.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Shapley values are best understood as governance tools, not just explanation tools. Their value is that they force teams to specify how model contributions are defined and how counterfactuals are constructed. That makes them useful for lending and other high-stakes decisions, but only if the organisation is willing to govern the assumptions behind the attribution, not merely publish the output. The practitioner takeaway is to treat explainability as a controlled method, not a decorative layer.
A question worth separating out:
Q: Should organisations use Shapley values or simpler feature importance methods for explainability?
A: Use Shapley values when the decision is high stakes and you need a fair, axiomatic attribution method that can stand up to scrutiny. Use simpler methods when the business question is directional insight rather than a defensible explanation for human review, and the extra compute cost would not change the decision.
👉 Read our full editorial: Shapley values expose the trade-off between fairness and compute