As fair coin flips accumulate, does the gap between the head count and tail count shrink?
answer
- ratio and difference behave differently
- denominator grows faster than numerator
- gap wanders, proportion settles
- typical gap scales with square root
- no restoring force pulls counts together
basics
~20 sNo. The proportion of heads converges to one half, but the absolute difference between the head and tail counts typically grows as flipping continues. The law of large numbers constrains the ratio, not the raw count difference.
solid answer
~40 sNo, and this is the sharpest way to see what the law of large numbers really claims. The *proportion* of heads converges to 0.5, but the *difference* `|heads - tails|` typically grows — its typical size scales like the square root of the number of flips, so after a million flips a gap of several hundred is entirely ordinary. Both facts hold at once because the gap grows far more slowly than the flip count does: divide a gap of order square-root-of-n by n and the ratio is driven to zero. So the average settles while the running total wanders ever further from perfect balance. Anyone who expects the counts to equalise is quietly assuming the law promises compensation rather than dilution.
code
python · 14 linesimport random
random.seed(7)
heads = 0
for n in range(1, 1_000_001):
heads += random.random() < 0.5
if n in (100, 10_000, 1_000_000):
gap = abs(2 * heads - n) # |heads - tails|
print(n, round(heads / n, 4), gap)
# 100 0.54 8
# 10000 0.503 60
# 1000000 0.5003 590
# the proportion tightens on 0.5; the gap widensgo deeper
Know that the law of large numbers is about the proportion of heads, not the head count. Answering "no, only the fraction settles" already puts you ahead of the common intuition.
Be ready to explain why both facts coexist: the gap grows roughly like the square root of the number of flips while the denominator grows like the flip count itself, so the ratio still collapses to one half.
Apply it to real charts. Show that a wandering cumulative difference is the expected signature of a no-effect process, and that stabilising rates rather than running totals is what volume actually buys you.
Own the reporting consequence: decide which quantities your organisation charts cumulatively, and push back when a growing running total is read as a trend. Framing the metric as a ratio is a design choice with real decision consequences.
## Two quantities, two different fates Flip a fair coin `n` times. Let `H` be the number of heads and `T = n - H` the number of tails. Two natural summaries behave in opposite ways: - **The proportion** `H / n` converges to 0.5. This is the law of large numbers applied to indicator variables: each flip contributes 1 for heads and 0 for tails, the expected value of one flip is 0.5, and the running average approaches it. - **The difference** `D = |H - T| = |2H - n|` does *not* shrink. Its typical magnitude grows without bound as `n` grows, on the order of the square root of `n`. Both statements are true simultaneously, and holding them together is the whole lesson. ## Why they are compatible Write the proportion's deviation in terms of the difference: ``` H/n - 0.5 = (H - T) / (2n) = D_signed / (2n) ``` The numerator grows, but only like the square root of `n`; the denominator grows like `n` itself. A quantity growing like the square root of `n`, divided by `n`, goes to zero. So the proportion converges *because* the gap grows more slowly than the number of flips, not because the gap disappears. Concretely, at `n = 100` a gap of about 8 is typical; at `n = 10,000` a gap of about 80 is typical; at `n = 1,000,000` a gap of about 800 is typical. In absolute terms you are drifting steadily further from perfect balance. In relative terms — 8/100, 80/10,000, 800/1,000,000 — you are marching toward zero. ## Why people expect the opposite The intuition that the counts should equalise is the gambler's fallacy in a respectable coat. If the law of large numbers worked by compensation, the running gap would be actively pulled back to zero, and the counts would converge on each other. It does not work that way. Each flip is drawn afresh from the same distribution, and the running difference behaves like a wandering path with no restoring force: at each step it is equally likely to move up or down by one, so it diffuses away from its starting point. ## A famous nuance The running difference does return to zero. For a fair coin, the head and tail counts are exactly equal infinitely often with probability one — the wandering path keeps crossing its starting line forever. But the waiting times between successive ties get enormously long, and between ties the path can spend vast stretches entirely on one side. So "the counts are exactly equal infinitely often" and "the gap typically grows" are both correct: returns to balance are certain, but rarer and rarer, and the excursions between them get larger. Neither fact gives anyone a reason to bet on the next flip. ## Why this matters beyond coins The same split applies to any running total versus running average: - A rate — conversion rate, defect rate, click-through rate — stabilises with volume, and estimating it well is exactly what the law of large numbers licenses. - The corresponding raw *count* difference — how many more conversions than the expected number you have accumulated — does not stabilise. It drifts, and it drifts more in absolute terms the longer you run. That matters for anyone reading cumulative charts. A cumulative-difference line that keeps wandering away from zero is exactly what a fair, no-effect process looks like; it is not evidence of a trend. Plotting the ratio rather than the running total is usually what you actually want, precisely because the ratio is the quantity the law of large numbers promises will settle. ## Answering it well Say no, then give both halves in one breath: the proportion converges, the absolute gap typically grows like the square root of the number of flips, and the two are compatible because the gap grows more slowly than the count. If you add that the counts nonetheless hit exact equality infinitely often, you have shown you know the difference between a limit statement about ratios and a claim about balance.
- If the head-tail gap grows, why does the proportion still converge to one half?Because the two grow at different speeds. The gap grows far more slowly than the number of flips, so dividing it by the flip count drives the ratio to zero. Convergence of the proportion never required the gap to shrink — only that it be outpaced by the denominator.
- Do the head and tail counts ever become exactly equal again after a long imbalance?Yes. For a fair coin the counts return to exact equality infinitely often with probability one. But the waiting time between successive ties grows enormously, and the path can stay on one side for very long stretches, so this is no basis for predicting any particular flip.
- What does this imply for reading a cumulative-difference chart of a metric?A cumulative difference that drifts steadily away from zero is exactly what a genuinely fair, no-effect process produces — the drift is not evidence of an effect. Plot the ratio instead, since the ratio is the quantity that stabilises with volume and the raw running total is not.
saying these in an interview costs you the question
- Says the head and tail counts converge on each other
- Claims the law of large numbers makes counts balance out
- Treats a growing cumulative gap as evidence of bias
- Confuses convergence of a ratio with convergence of a difference
- Believes a large gap must be repaid by later flips