skip to content

How do you justify a PCA-based credit score to a regulator asking which ratio drove it?

level: principalimportance: nice to knowfreq 30%

answer

  1. components are blends of every column
  2. linear on components is linear on features
  3. regulators want per-feature reason codes
  4. decide before modelling, not afterwards

basics

~20 s

Each principal component is a weighted blend of every input ratio, so per-component reasons are useless to an applicant. If the model on top is linear, compose the loadings with its coefficients to recover one exact weight per ratio.

solid answer

~40 s

The honest starting point is that compressing 60 correlated financial ratios into 8 components deletes the sentence a regulator wants: "your score was driven by this ratio". A component blends all 60, so attributing a decision to component three is unusable in an adverse-action notice. There is a real escape when the model on top is linear: the score is a linear function of the components, each component is a linear function of the centred ratios, so composing loadings with coefficients gives one exact weight per ratio. Put a nonlinear model on top and that composition disappears. So this is a design decision made before modelling: if per-feature reason codes are a duty, keep the stack linear end to end, or drop PCA and control collinearity by grouping and selecting ratios on domain knowledge.

go deeper

for a junior

Remember the trade in one sentence: components compress correlated columns but each one mixes every input, so you can no longer point at a single original feature. That is the cost people mean by lost interpretability.

for a middle

Explain the mechanism through loadings - why a dense blend cannot be named after one column, and why a per-component explanation is unusable to a non-technical audience. Knowing that the sign of a component is arbitrary is a good detail to have.

for a senior

Show you can still deliver an explanation: compose loadings with coefficients when the stack is linear, check that a loading pattern is stable across refits before naming it, and say plainly when the attribution you can produce is not the attribution that was asked for.

for a principal

Own the up-front call about whether feature extraction belongs in a decision that must be justified to an individual, and the governance around refits changing documented component meanings. Be ready to defend using PCA only as a diagnostic while shipping interpretable features.

## What is actually lost Compress 60 correlated financial ratios - leverage measures, coverage measures, liquidity measures, all moving together - into 8 principal components and you gain a compact, uncorrelated, well-conditioned input set. What you lose is per-ratio traceability. Every component is a weighted blend of all 60 ratios, with a loading on each. "Component 3 pushed this application below the cutoff" is not a reason an applicant or a supervisor can act on, and in regimes that require adverse-action reasons or model explainability it is not a compliant answer either. This is the standard cost of any feature *extraction*: the shipped model's inputs are constructed quantities with no independent meaning, so any explanation naturally lands on constructed quantities too. Attribution methods such as SHAP or LIME do not rescue you here on their own - run them over a model whose features are components and they faithfully tell you that component 3 mattered, which is exactly the sentence nobody can use. ## The technical escape: linearity composes There is a genuine and often-missed nuance. PCA is a **linear** map: each component score is the centred ratios multiplied by that component's loadings and summed. If the model on top is also linear - a scorecard, a logistic model - then the score is a linear function of the components, and a linear function of a linear function is a linear function. Multiply the model's component coefficients through the loading matrix and you obtain a single exact weight per original ratio. The shipped model *is* a weighted sum of the 60 ratios; the components were only the route by which those weights were chosen. Two caveats keep this honest. First, truncation to 8 components does change the weights relative to a model fitted on the raw ratios - it constrains them to a subspace - but the composed weights are exactly correct *for the model as shipped*, which is what a regulator is asking about. Second, the composition disappears the moment a nonlinear model sits on top of the components, because there is no longer a single weight per ratio to recover. So if per-ratio explanation is a hard requirement, keeping the stack linear end to end is the design that satisfies it. ## When a component genuinely does mean something Components are not always opaque. On a 40-item employee engagement survey, it is common to find that every item loads on the first component with the same sign and similar magnitude - people who answer positively answer positively everywhere - so reading PC1 as an overall-satisfaction axis is reasonable shorthand. The second component often contrasts groups of items: pay and benefits items loading positive while management and recognition items load negative, which reads as a pay-versus-management tension in the workforce. Use that, but state it correctly. Naming a component is an **interpretation of a loading pattern**, not a measured fact. Before it goes into a report, check that the pattern is stable: refit on a different sample or a later wave and confirm the same items still group the same way. And remember that the sign of a component is arbitrary, so "positive PC2 means pay-focused" is a labelling convention you must fix and document, not a property of the data. ## The decision a lead actually owns This is a scoping call, made before any modelling: - **Is an individual decision explained to a person?** Credit, hiring, insurance pricing, benefits eligibility - here per-feature reasons are usually a duty, and feature extraction fights that duty. Prefer domain-grouped features and supervised selection, so the shipped inputs are quantities a human already names. - **If PCA is worth keeping anyway**, keep the model on top linear so the weights compose back, and document the composition as part of the model's governance package. - **Is nobody owed an explanation?** Internal ranking, anomaly scoring, latency-driven compression, de-correlating inputs for a model whose explanations are not customer-facing - the interpretability cost is close to free, and the conditioning and compactness gains are real. - **Use PCA as a diagnostic even when you do not ship it.** The variance profile of 60 ratios tells you how much genuine independent information the feature set carries. If 8 components hold 95% of the variance, you have learned that your 60 ratios are roughly 8 ideas - which is an argument for pruning to 8 interpretable *ratios*, not necessarily for shipping 8 components. ## Governance details that bite later Components are refit when the data is refreshed, and loadings drift. A story told about PC2 last year may not survive this year's refit, and the sign can flip on a rerun even when nothing substantive changed. If a component's meaning has been documented to a supervisor, refitting silently changes what was documented. Either freeze the loadings between formal model reviews and treat a refit as a model change, or do not build explanations on component identity at all. ## The answer that lands Acknowledge the loss plainly, then show the two ways out: compose the linear weights back to per-ratio contributions if the stack allows it, or decide up front that a regulated, individually-explained decision is the wrong place for feature extraction. Confidence that PCA is simply "a black box, sorry" is as weak an answer as pretending the components are self-explanatory.

  • Can you ever recover per-ratio contributions from a PCA-based score?
    Yes, when the model on top is linear. The score is a linear function of the components and each component is a linear function of the centred ratios, so composing the loadings with the coefficients gives one exact weight per ratio for the model as shipped. Truncation changes those weights relative to a raw fit, but they remain exact for what you deployed. A nonlinear model on top destroys the composition.
  • When is PCA's interpretability cost an acceptable trade?
    Wherever no individual is owed a reason: internal ranking, anomaly detection, compression for latency or memory, and de-correlating inputs for a model whose explanations are not customer-facing. The cost is paid only at the point where a specific decision about a specific person must be justified in terms they can act on.
  • Is naming a component 'overall satisfaction' a defensible claim in a report?
    It is an interpretation of the loading pattern, not a measurement. If all items load with the same sign and comparable magnitude, the shorthand is reasonable, but say it is a reading of the loadings, fix and document the sign convention, and confirm the pattern survives a refit on a fresh sample before it goes in front of stakeholders.
  • What breaks when the components are refit on refreshed data?
    Loadings drift and signs can flip, so a component's documented meaning silently changes and any narrative attached to it goes stale. Treat a refit as a model change with a review, or freeze the loadings between formal reviews. Building explanations on component identity across refits is the failure mode to avoid.

A smoothie: you can list every fruit that went in and in what proportion, but you cannot hand back the strawberry when someone asks which fruit made it taste that way.

saying these in an interview costs you the question

  • Claims principal components are inherently uninterpretable, full stop
  • Names a component after its single highest-loading item
  • Attributes a decision to component three in customer-facing text
  • Adopts PCA in a regulated model without checking reason-code duties
  • Assumes an attribution method restores per-feature explanations

context