Overall conversion fell while every acquisition channel's own conversion rate rose — how?
answer
- the total is a blend, not a measurement
- the weights moved too
- sum of share times rate
- traffic drifted to the weak segment
- split into a within effect and a mix effect
basics
~20 sThe overall rate is a traffic-weighted average of the channel rates. If traffic shifts toward a low-converting channel, that weighted average can fall even when every channel improves. This is a mix shift, not a conversion regression.
solid answer
~50 sThe blended rate is `R = sum over channels of w_i * r_i`, where `w_i` is the channel's share of traffic. Both the weights and the rates move between periods, so the blend can move against every one of its parts. Concretely: organic was 80% of traffic converting at 10% and paid was 20% at 4%, blending to 8.8%. This month organic is 40% at 11% and paid is 60% at 5% — every rate improved, but the blend is 7.4%. I split the delta into two pieces: the within-channel effect `sum w_i * (r_i' - r_i)` is +1.0 points, and the mix effect `sum (w_i' - w_i) * r_i` is -2.4 points, reconciling exactly to the observed -1.4. So the honest summary is that acquisition changed the traffic composition while conversion quality improved everywhere, and the fix belongs to whoever moved the mix.
go deeper
Be ready to say that an overall rate is a share-weighted blend of segment rates, and that shares can move. Reciting the formula with a two-segment example is enough at this level.
Expect to compute the split on the spot: within effect at baseline shares, mix effect at baseline rates, and a check that they reconcile to the observed delta. Know that an interaction residual exists and how the symmetric form removes it.
Demonstrate that you attribute per segment correctly given that shares sum to one, handle entrants and exits without breaking the reconciliation, and turn the split into an ownership and cost-per-acquisition conversation.
Own the reporting standard: which segmentation is the company's default, whether the blended rate belongs on the top-line dashboard at all, and how you keep a flat headline from hiding two large offsetting effects.
## The blended rate is a weighted average An overall conversion rate is never a number in its own right. It is a **weighted average** of segment rates, with weights equal to each segment's share of the denominator: ``` R = sum over segments i of w_i * r_i where sum of w_i = 1 ``` Because the weights are part of the formula, the blend has two independent ways to move: the segment rates `r_i` can change, and the shares `w_i` can change. Once you see that, "every part rose but the total fell" stops being paradoxical and becomes ordinary arithmetic. ## A worked example | period | channel | visits | share | conversion | conversions | |---|---|---|---|---|---| | before | organic | 800 | 0.80 | 10% | 80 | | before | paid | 200 | 0.20 | 4% | 8 | | before | **total** | 1000 | | **8.8%** | 88 | | after | organic | 400 | 0.40 | 11% | 44 | | after | paid | 600 | 0.60 | 5% | 30 | | after | **total** | 1000 | | **7.4%** | 74 | Organic improved from 10% to 11%. Paid improved from 4% to 5%. The blend fell 1.4 points. Nothing is wrong with the data: traffic moved from the channel that converts at 10% into the one that converts at 5%, and the shift is larger than the improvements. ## The decomposition Write the change as `R' - R = sum (w_i' * r_i' - w_i * r_i)` and expand it. The exact identity has three terms: ``` within = sum w_i * (r_i' - r_i) rates move, mix held at baseline mix = sum (w_i' - w_i) * r_i mix moves, rates held at baseline interaction = sum (w_i' - w_i) * (r_i' - r_i) both move together ``` These three add up to the total delta exactly. In the example: within `= 0.80*0.01 + 0.20*0.01 = +1.0 point`; mix `= (0.40-0.80)*0.10 + (0.60-0.20)*0.04 = -4.0 + 1.6 = -2.4 points`; interaction `= (-0.40)(0.01) + (0.40)(0.01) = 0`. Total `+1.0 - 2.4 + 0 = -1.4 points`, matching 8.8% to 7.4%. The interaction term is an artefact of holding one factor at baseline, and it embarrasses people in presentations. A **symmetric** version removes it by evaluating each effect at the midpoint of the other: ``` within = sum ((w_i + w_i')/2) * (r_i' - r_i) mix = sum (w_i' - w_i) * ((r_i + r_i')/2) ``` Those two also sum exactly to `R' - R`, with no residual. Either convention is defensible; state which one you used. ## Attributing the mix effect to individual segments A subtlety: shares are constrained to sum to one, so a segment's share change is never independent — one segment gaining forces others to lose. Naively reporting `(w_i' - w_i) * r_i` per segment makes low-rate segments look responsible for gains they did not cause. The cleaner per-segment mix contribution measures each segment's rate **relative to the baseline overall rate**: ``` mix contribution of segment i = (w_i' - w_i) * (r_i - R) ``` This still sums exactly to the total mix effect, because the shares' changes sum to zero and so the `R` term drops out. It reads correctly too: gaining share in a segment that converts **above** the overall average helps; gaining share in one that converts below it hurts. In the example: organic contributes `(-0.40)(0.10 - 0.088) = -0.48 points` and paid contributes `(0.40)(0.04 - 0.088) = -1.92 points`, together the -2.4 point mix effect. ## Segments that appear or disappear A channel launched this period has no baseline share and no baseline rate, so neither the within nor the mix term is defined for it. Do not invent one. Give entrants and exits their own line in the reconciliation and say so explicitly; smearing them across the surviving segments is how a decomposition quietly stops adding up. ## What to do with the answer The decomposition tells you whose problem it is. A large negative mix term with a positive within term means the funnel got better and the traffic portfolio got cheaper — which may be entirely intentional, if the low-converting channel is also far cheaper per visit. That is a question about cost per acquisition, not about conversion. A large negative within term means the experience actually degraded, and the segment-level bars point at where. The wrong move is to accept the headline at face value in either direction. A flat blended rate can hide a real within-segment collapse offset by a favourable mix shift, and that is the more dangerous case, because nothing on the dashboard moves at all. ## What interviewers listen for That you reach for the weighted-average structure immediately rather than doubting the data; that you can write the two effects and show they reconcile; that you notice a change in shares is zero-sum across segments; and that you finish with an ownership statement rather than an arithmetic one.
- Write the exact decomposition of a weighted-average delta into mix and within-segment parts.With shares `w_i` and rates `r_i`, the delta splits as `sum w_i(r_i' - r_i)` (within), plus `sum (w_i' - w_i) r_i` (mix), plus `sum (w_i' - w_i)(r_i' - r_i)` (interaction). Those three add to the delta exactly. If you dislike the residual, use the symmetric form — within evaluated at average shares, mix at average rates — which sums exactly with no third term.
- When the mix effect dominates, who owns the fix?Whoever moved the shares — usually acquisition or marketing, since they chose the channel spend. The funnel team's own rates improved, so holding them accountable for the blended number is a misattribution. And the mix shift may need no fix at all: cheaper traffic converting worse can still be the better trade, which is a cost-per-acquisition question rather than a conversion one.
- How do you handle a channel that launched this period and has no baseline?Give it its own line. With no baseline share and no baseline rate, neither the within nor the mix term is defined for it, so any allocation you invent is arbitrary and breaks the reconciliation. Report entrants and exits as separate bars, note that they mechanically compress the surviving channels' shares, and keep the sum tied to the observed delta.
- The blended rate is flat this month — can you conclude nothing changed?No, and this is the more dangerous case. A flat blend is consistent with a large within-segment decline offset by a favourable shift toward high-converting traffic. Run the split even when the headline does not move: if the two effects are large and opposite, something real is happening that the dashboard is hiding.
A league's overall batting average can drop in a season where every single player improved — if the weakest hitters got far more at-bats.
saying these in an interview costs you the question
- Says the numbers must be wrong or double counted
- Concludes the funnel broke because the blend fell
- Compares channel rates without looking at their traffic shares
- Assumes a weighted average must move with its parts
- Blames the segment that gained share without checking its rate against the overall average