TL;DR: A model can look fair when assessed separately by gender or race, yet fail badly at their intersection, where subgroup harms become visible and conventional metrics can miss them, according to Fiddler. The lesson for AI governance is that fairness testing must reflect overlapping protected attributes, not just single-axis checks.
Editorial analysis by NHI Mgmt Group, based on content published by Fiddler: “Detecting Intersectional Unfairness in AI: Part 1”.
Key questions
Q: How should teams test AI fairness when multiple protected attributes overlap?
A: Test the model on combinations of protected attributes, not only on one attribute at a time.
Q: Why can an AI model look fair on one metric but still be unfair in practice?
A: Because fairness metrics measure different things.
Q: What breaks when teams only check one protected attribute at a time?
A: They can miss the subgroup where harm is actually concentrated.
Practitioner guidance
- Define protected intersections before model approval List the combined attributes that matter for the use case, such as race and gender together, and make them part of acceptance criteria rather than post-release analysis.
- Test fairness across subgroup combinations Evaluate model outputs on overlapping subgroups and compare results against the single-attribute baseline so hidden disparities do not survive review.
- Document metric choice and trade-offs Record why a specific fairness metric was selected, what it measures, and what kinds of harm it may fail to expose in the target population.
Bottom line: Single-attribute fairness checks can produce false confidence because they flatten the subgroup patterns where harm actually appears.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Intersectional fairness is a governance requirement, not a niche statistical refinement. The article shows how a model can satisfy single-attribute checks and still fail specific overlapping groups. That means fairness controls that stop at one protected attribute are structurally incomplete. For AI governance teams, the practical conclusion is that model acceptance criteria should require intersection-aware evaluation, not just broad demographic reporting.
A question worth separating out:
Q: What should AI governance teams do when unfairness is traced to the data subsystem?
A: They should revisit how the training set was collected, balanced, and labeled, then test whether those choices created a persistent subgroup skew. If the data is the source, model tuning alone will not remove the bias. The remediation has to address sampling, labels, and the assumptions behind the target definition.
👉 Read our full editorial: Intersectional AI fairness exposes subgroup bias hidden by single metrics