How does survivorship bias inflate the average return in a table of funds that still exist today?
answer
- ask who is missing from the table
- the losers left the list
- closed and merged funds vanish
- the sample conditions on survival
- left tail truncated, not just the mean
basics
~20 sBadly performing funds get closed or merged away, so a table of funds still open today lists mostly winners. Averaging it measures the survivors, not the return an investor could have expected when picking a fund years ago.
solid answer
~40 sThe table is not a sample of the funds that existed at the start of the period; it is a sample of the funds that made it to the end. Poor performers are the ones that get liquidated or merged into a sibling fund, and when that happens their track record leaves the table with them. So the average is an estimate of `E[return | the fund survived]`, not of `E[return]` over everything an investor could have chosen. The correct comparison is built by fixing the cohort at the *start* of the window and following every fund in it, including the ones that later died. Survivorship also truncates the left tail, so the spread and the worst-case drawdown look smaller than they really were.
go deeper
Be ready to define survivorship bias in one sentence and give a concrete case, such as averaging the returns of funds that are still open. Say clearly which way the number is pushed: upward.
Explain that the average estimates a conditional mean given survival, and show how to rebuild the honest comparison by fixing the cohort at the start of the window and following every member, including the ones that died.
Demonstrate that you check the inclusion rule of any table handed to you before computing anything, and that you can say which of mean, variance and drawdown each filter distorts, and by how much if the dead-entity data exists.
Own the standard: any performance table published by your organisation states the cohort definition and the survival rate alongside the average, so a reader can judge how much of the result is selection rather than skill.
## The shape of the mistake Survivorship bias is a form of **selection bias** in which the rule that decides whether a unit appears in your data is correlated with the outcome you are measuring. It is not sampling noise, it is not a data-quality problem, and it does not shrink as you add rows. A table of "all funds available today" is assembled by asking a live database which funds currently exist. That question silently applies a filter: *did this fund survive to today?* Funds are closed or merged for a reason, and the dominant reason is bad performance — assets flow out, fees no longer cover costs, and the sponsor folds the fund into a healthier one. The record that leaves is systematically worse than the records that stay. ## What the average is actually estimating Write `S` for the event that a fund survived to the end of the observation window and `R` for its annualised return. The number you compute from the surviving-only table is an estimate of the conditional mean `E[R | S = 1]` while the number an investor cares about — what could I have expected from a fund chosen at the start? — is the unconditional mean over the whole starting cohort `E[R] = P(S=1) * E[R | S=1] + P(S=0) * E[R | S=0]` Because `E[R | S=0] < E[R | S=1]` (the dead funds did worse), the surviving-only average sits above the cohort average. The gap grows with the death rate: the longer the window, the more of the starting cohort disappears, and the more flattering the survivors look. Ten-year and twenty-year "track records" are the worst offenders precisely because they require ten or twenty years of survival. ## It is not only the mean The same filter truncates the **left tail** of the return distribution. Consequences that candidates often miss: - **Variance and standard deviation are understated.** The catastrophic outcomes were deleted, so the strategy looks less volatile than it was. - **Downside risk measures collapse.** Maximum drawdown, worst-year return and the frequency of large losses are all computed on a population from which the worst cases have been removed. - **Win rates are inflated.** "Eight of the last ten years beat the benchmark" is trivially easier to satisfy if the funds that failed to do so were removed from the list. - **Apparent skill appears out of nowhere.** If a sponsor launches many small funds, quietly closes the ones that stumble and markets the ones that do well, a pure-luck process manufactures an impressive-looking track record. This is sometimes called incubation bias, and it is survivorship applied at the fund-launch stage. ## Diagnosing it The diagnostic question is always the same: **what had to be true for a row to appear in this table?** If the answer includes anything downstream of the outcome — the fund still trades, the company still exists, the customer is still subscribed, the machine came back — you are looking at survivors. To quantify the bias, you need a database that keeps dead entities: freeze the roster at the start of the window, follow every member forward, and record a terminal outcome for the ones that vanish. Comparing the cohort mean with the survivor-only mean gives the size of the bias directly. If no such data exists, the honest move is to state the direction of the bias (upward, for returns) and treat the survivor figure as an upper bound rather than an estimate. ## The same pattern outside finance - A table of successful startups showing that founders dropped out of university tells you nothing without the failed founders who also dropped out. You are reading `P(dropped out | succeeded)` and treating it as `P(succeeded | dropped out)`. - "Buildings from 300 years ago were better made" — the badly made ones are not standing to be inspected. - Employee-engagement scores computed on people who are still at the company omit precisely those who were unhappy enough to leave. ## What a good answer contains Name the filter, say which direction it pushes the estimate, and describe the fix in terms of the *cohort*: define membership at the start of the period and follow everyone, dead or alive. If a candidate says the bias would go away with more funds, they have confused bias with variance — adding more surviving funds gives a tighter estimate of the wrong quantity.
- How would you actually measure how large the survivorship bias is?Rebuild the cohort as it stood at the start of the window from a source that retains dead entities, then follow every member forward with a terminal outcome recorded for the ones that disappear. The difference between the cohort mean and the survivors-only mean is the bias, in the units of the metric. Without such a source, report the survivor figure explicitly as an upper bound.
- Does survivorship bias distort the standard deviation as well as the mean?Yes, and usually more dramatically. Deleting the failures removes the left tail, so the sample standard deviation, the worst observed year and the maximum drawdown are all understated. A strategy can look both higher-returning and lower-risk than it was, which is exactly the combination that sells.
- A sponsor launches twenty small funds and markets only the three that did well. What is that?Survivorship applied at launch, often called incubation bias. Even with zero skill, some of twenty funds will post strong early numbers by chance; quietly closing the rest and advertising the winners manufactures a track record from pure noise. The fix is to demand the full roster of funds the sponsor ever started, not the ones on the brochure.
Abraham Wald was asked which parts of returning WWII bombers needed more armour, given a map of where the bullet holes were. He argued for armouring the places with no holes: planes hit there never came back to be measured. A table of surviving funds is the returning bombers.
saying these in an interview costs you the question
- Says a larger table of surviving funds fixes it
- Treats survivorship bias as random noise that averages out
- Claims the data is fine because every number in it is accurate
- Only mentions the mean, missing the truncated left tail
- Confuses this with imprecision rather than a systematic offset