skip to content

When a mix shift explains a metric drop, do you report the raw or the mix-adjusted number to leadership?

level: principalimportance: should knowfreq 33%

answer

  1. two questions, so two numbers
  2. what happened versus what we controlled
  3. mix can be a decision, not noise
  4. freeze the standard before you look
  5. what you grade is what gets optimised

basics

~20 s

Report the raw number as the headline — it is what the business actually experienced — with the mix-adjusted figure beside it as the explanation. Never substitute one for the other, and never choose the standard mix after seeing the results.

solid answer

~50 s

Both, with the raw number leading. The unadjusted metric is what actually happened to revenue, capacity and cash, so an adjusted figure can never replace it in the headline. The mix-adjusted figure answers a different question — did the thing this team controls get better — which is what makes it a fair scorecard but a dishonest headline. The real judgment call is ownership: if acquisition deliberately bought cheaper traffic, the mix term is a decision somebody made, not a nuisance to normalise away, and it belongs on that team's line rather than being erased from everyone's. I would fix the standard mix in advance and hold it stable across periods, because an adjustment recomputed each quarter becomes a knob that gets turned until the story improves. And I would watch the incentive: a team graded only on within-segment rates has no reason to care about the mix it creates.

go deeper

for a junior

Know that an adjusted metric describes a composition that did not actually happen, so it cannot be the number a business plans against. Say both figures out loud rather than choosing one.

for a middle

Be ready to present the two side by side with a reconciliation that ties the adjusted view and the mix term back to the raw delta, and to state which reference mix you used and why it was fixed beforehand.

for a senior

Demonstrate that you separate a deliberately chosen mix from exogenous drift, assign an owner to the mix term, and refuse to let the adjustment be recomputed period by period.

for a principal

Own the metric contract: which number leads in leadership reviews, what goes into goals, and which guardrail stops a team from earning a good adjusted rate while the composition it created degrades.

## Two numbers answering two different questions When a blended metric moves and the decomposition shows the movement is mostly composition, you end up holding two figures: - The **raw (crude)** metric: what the blend actually did. It reflects the business as experienced — the money collected, the servers needed, the support tickets received. - The **mix-adjusted (standardised)** metric: what the blend would have done had the segment composition stayed at a fixed reference. It isolates within-segment performance. Neither is more honest than the other in the abstract. They answer different questions, and the failure mode is presenting one while the audience believes it is hearing the other. ## Why the raw number must lead The adjusted number is counterfactual: it describes a composition that did not occur. Nobody can spend it, staff against it, or forecast from it. A leadership review that opens with "conversion is up 1.0 points on a constant mix" while the company actually converted 1.4 points worse has told the audience something true and left them with a false belief. That is the specific failure worth being blunt about — adjusted-first reporting is how organisations get surprised by their own P&L. So: raw as the headline, adjusted immediately underneath as the explanation, and a reconciliation that ties the two together. "Blended conversion -1.4 points; within-segment +1.0, mix -2.4" is one line and closes the gap. ## The ownership question is the real judgment call Mix effects fall into two very different categories, and treating them alike is where leaders go wrong. **Mix as a decision.** Marketing raised spend on a cheaper channel; the company launched in a lower-ARPU country; a new low-priced tier drew volume. Here the mix shift **is** the outcome of a deliberate bet. Normalising it away deletes the very thing that should be evaluated — and evaluated on its own terms, since cheaper traffic converting worse can still be the better trade on cost per acquisition. The mix term belongs on the deciding team's line, priced in the currency that decision was made in. **Mix as exogenous drift.** Seasonal composition, a platform's own audience shifting, a partner changing its traffic. Nobody chose it, and holding the funnel team to a blended number that this drift dominates is a misattribution. Here the adjusted view is the fairer scorecard. The organisational discipline is to say which of the two you believe it is, and to name the owner. "The mix moved and therefore nobody is accountable" is the answer to avoid — mix shifts have causes, and usually a team. ## Governance of the adjustment An adjustment is only credible if it cannot be tuned. Three rules do most of the work: 1. **Fix the reference mix in advance** and keep it constant across periods. A standard recomputed each quarter makes the time series incomparable and hands the analyst a dial. 2. **Fix the segmentation too.** Which dimension you adjust on (channel, country, device, tenure) changes the size of the mix term. Choosing it after seeing results is the same defect one level up. 3. **Require exact reconciliation.** The adjusted view and the mix term must sum to the raw delta. A decomposition that does not tie out is a story, not an analysis. Without these, "it was mix" becomes the universal explanation for every miss, and the credibility of the whole analytics function erodes — the second time a mix explanation precedes a bad quarter, nobody believes the third. ## Incentives: what happens when the adjusted metric becomes a goal Put a mix-adjusted rate in a team's objectives and you have told them that composition is not their problem. Predictably, they optimise within-segment rates and become indifferent to a mix they influence — a funnel team stops caring which traffic arrives, an acquisition team stops caring what it converts to. The company then grows a portfolio nobody chose. The usual remedy is to pair the metrics rather than pick one: the adjusted rate as the performance measure, plus a **mix guardrail** (share of volume from the low-value segment, or the absolute total the mix feeds) that fails loudly if composition drifts past a threshold. And keep at least one absolute total in the goal set, because absolutes cannot be improved by re-weighting anything. ## What a strong answer sounds like Refuse the either/or framing; specify the order and the reconciliation; separate chosen mix from exogenous mix and assign an owner for each; pre-commit the standard and the segmentation; and close on the incentive consequence of whichever metric ends up in the goal document. The arithmetic is the easy half — the question is really about what a number does to an organisation once it becomes a target.

  • When is the mix effect legitimately somebody's responsibility rather than an artefact?
    Whenever a team's decision moved the shares: acquisition spend reallocated to a cheaper channel, a launch in a lower-value market, a new low-priced tier drawing volume. Then the mix term is the measured outcome of a bet, and normalising it away deletes exactly what should be evaluated. Exogenous drift — seasonality, a partner's audience changing — is the other case, and there the adjusted view is the fairer scorecard.
  • How do you stop mix adjustment becoming the standing excuse for every miss?
    Pre-commit the reference mix and the segmentation dimension, keep both constant across periods, and require the decomposition to reconcile exactly to the raw delta. Keep the raw number in the headline every time, not only when it flatters. If "it was mix" appears in three consecutive reviews, that is itself the finding — a persistent mix shift is a strategy change, not an explanation.
  • What is the risk of putting a mix-adjusted metric into a team's goals?
    You have told them composition is not their problem, so they optimise within-segment rates and stop caring about the mix they influence. Pair it with a mix guardrail — the share of volume coming from the low-value segment, or a floor on the absolute total — so a favourable adjusted number cannot be earned by letting composition rot underneath it.

saying these in an interview costs you the question

  • Leads with the adjusted number and buries the actual decline
  • Treats every mix shift as noise to be normalised away
  • Chooses the reference mix after seeing which one helps
  • Concludes that a mix shift means nobody is accountable
  • Recomputes the standard each period and compares across time anyway
  • Puts an adjusted rate in a team's goals with no mix guardrail

context