Model Interpretability
Explaining a fitted model: permutation importance and partial dependence globally, Shapley values and counterfactuals for one row, audits of who it fails. Interviewers make you defend a black box.
on this pageshowhide
explore
- Global Explanations14 questions
- Interpretable by Design5 questions
- Permutation Importance5 questions
- Partial Dependence and ICE4 questions
- Local Explanations12 questions
- Shapley Value Attribution4 questions
- Surrogates and Counterfactuals4 questions
- Faithfulness and Instability4 questions
- Fairness and Communication14 questions
- Group Fairness Criteria3 questions
- Proxy Features and Slices4 questions
- Reason Codes and Model Cards3 questions
- Mitigating Group Disparity4 questions
questions
page 2 of 2How does reweighing training rows shrink a group disparity before any model is fitted?
basics
~20 sEach training row gets a weight equal to the count its (group, outcome) cell would have if group and label were independent, divided by the count actually observed. The weighted data carries no group-label association, and scoring never needs the protected column.
In a generalized additive model, how does a shape function keep a non-linear effect readable?
basics
~10 sA generalized additive model fits one curve per feature and sums them, so a feature's whole effect is a single readable plot: non-linear in shape, never tangled with the other features.
For an anchor rule explaining one model prediction, what do precision and coverage each mean?
basics
~20 sPrecision is the share of rows satisfying the rule that the model still labels the same way as the explained row; coverage is the share of the population that satisfies the rule at all. Higher precision usually buys narrower coverage.
Which group fairness criterion should a marketplace commit to for a fraud model that routes sellers into manual verification?
basics
~20 sStart from the harm. Extra document checks burden a legitimate seller, so equalizing the false-positive rate across groups is the commitment to state publicly. Prefer equal flag rates instead when the fraud labels are themselves untrustworthy.
Why can a health-risk model be biased when its label is prior healthcare spend?
basics
~20 sSpend is a proxy for need, and the two come apart by group. A group with equal illness but less access spends less, so it scores as lower risk. The bias sits in the target definition, where no feature audit will find it.
Permutation importance ranks a feature first — what business decisions does that actually license?
basics
~10 sOnly model-facing ones: monitoring priority, data-collection spend, sanity checks against domain expectation. It measures one model's reliance on a column under one dataset and metric, not evidence that changing the quantity would change outcomes.
What would you require before per-decision explanations are shown to customers or regulators?
basics
~10 sTreat the explanation as a product surface with its own bar: a faithfulness test the team runs, a measured stability budget across seeds and retrains, a stated purpose, and a fallback when checks fail.
How does the choice of background set change a Shapley explanation of the same prediction?
basics
~20 sThe background set defines what the prediction is compared against, so it decides the whole explanation: attributions sum to the prediction minus the background's prediction, and a feature already sitting at its background value gets zero credit.
showing 31–40 of 40