skip to content

What does an E-value reported alongside an observational risk ratio actually mean?

level: middleimportance: should knowfreq 42%

answer

  1. minimum strength, not a probability
  2. on the risk ratio scale
  3. both associations must reach it
  4. beyond the measured covariates
  5. report one for the interval limit too

basics

~20 s

The E-value is the minimum strength of association, on the risk ratio scale, that an unmeasured confounder would need with both the treatment and the outcome, beyond measured covariates, to fully explain away the observed association.

solid answer

~50 s

An E-value summarises how much unmeasured confounding it would take to reduce an observed association to the null. Concretely, it is the smallest value X such that a hidden variable associated with the exposure by a risk ratio of X and with the outcome by a risk ratio of X, conditional on measured covariates, could account for the whole effect. For an observed risk ratio above 1 it is computed as `RR + sqrt(RR * (RR - 1))`, so a risk ratio of 1.5 gives about 2.4 and a risk ratio of 3.0 gives about 5.4. You normally report two numbers: one for the point estimate and one for the confidence limit closest to the null, which is always the smaller and tells you what it takes to lose statistical significance. Both associations must reach the E-value; a confounder strong on only one side cannot do it.

go deeper

for a junior

Know that the E-value is a robustness number: how strong a hidden confounder would need to be to wipe out the result, on the same scale as a risk ratio. Bigger means harder to explain away.

for a middle

Be able to state the two-sided requirement precisely - the confounder must reach that strength with the exposure and with the outcome, conditional on what was already adjusted for - and to explain why the interval limit gives a second, smaller value.

for a senior

Demonstrate benchmarking. Compare the E-value against the observed strengths of measured covariates in the same study and name the specific unmeasured variables that could plausibly reach it.

for a principal

Decide when a single summary number is enough. Argue about which threats the E-value does not cover - selection, measurement error - and whether your teams treat it as a checkbox rather than an argument.

## The quantity being reported An E-value answers a single question: how strongly would an unmeasured variable have to be related to both the exposure and the outcome, over and above everything already adjusted for, in order to explain away the association we observed? It is a minimum. Anything weaker on either association cannot fully account for the finding, whatever its prevalence. The scale is the risk ratio. If the E-value is 2.4, the hidden variable must be associated with the exposure by a risk ratio of at least 2.4 **and** with the outcome by a risk ratio of at least 2.4. Those are joint requirements. A variable that predicts the outcome tenfold but is evenly distributed across treated and untreated groups is not a confounder at all, and one that is wildly unbalanced across groups but unrelated to the outcome is equally harmless. ## Computing it For an observed risk ratio RR of 1 or more, the E-value is `RR + sqrt(RR * (RR - 1))`. - RR = 1.0 gives 1.0 - no confounding at all is needed, since there is nothing to explain. - RR = 1.2 gives about 1.69. - RR = 1.5 gives about 2.37. - RR = 3.0 gives about 5.45. For a protective association with RR below 1, take the reciprocal first and apply the same formula. Effect measures that are not risk ratios - odds ratios for common outcomes, hazard ratios, standardised mean differences - are converted to an approximate risk ratio scale before the formula is applied, and that conversion is itself an approximation worth flagging. ## Two E-values, not one Good practice reports the E-value for the point estimate and for the confidence limit nearest the null. Suppose a study reports a risk ratio of 1.5 with an interval from 1.2 to 1.9. The point-estimate E-value is about 2.4; the E-value for the limit of 1.2 is about 1.7. The interpretation splits cleanly: confounding at strength 2.4 on both arms would move the estimate to the null, while confounding at only 1.7 would be enough to make the interval include the null. The second number is usually the decision-relevant one, because it is what it takes to lose the claim of a non-zero effect. The limit E-value is always the smaller of the two for a positive association. ## Reading the size There is no universal threshold. Judgment comes from comparison. Compute the observed associations of the measured covariates with the exposure and the outcome; if the strongest measured covariate reaches only 1.4 on each side and the E-value is 2.4, then a confounder would have to be substantially stronger than anything you have already seen in this domain, which is a real argument. If the E-value is 1.3 and several measured covariates comfortably exceed that, the finding is fragile and should be described that way. The scale of the outcome matters too. In a well-studied domain where the causes of the outcome are largely known, a moderate E-value can be persuasive because the space of candidate confounders is nearly exhausted. In a domain full of unmeasured behavioural variables - health-seeking behaviour, motivation, socio-economic position - even a large E-value may not be comforting, because those variables plausibly reach large associations on both sides. ## Common errors The most frequent mistake is treating the E-value as a probability, or as a claim that a confounder of that strength exists. It is neither: it is a threshold on a hypothetical. The second is applying it to only one association - saying the confounder must predict the outcome by 2.4 while forgetting that it must also be that unbalanced across exposure groups. The third is confusing it with prevalence: an E-value of 2.4 says nothing about how common the confounder is. The classical bias formulas do involve prevalence, and the E-value is deliberately the worst case over prevalence, which is why it is a conservative bound and why a confounder meeting the E-value threshold only *could* explain the result, at the most damaging prevalence. A fourth error is over-claiming robustness. A large E-value does not establish causation. It rules out weak confounding only. Selection into the sample, measurement error in the exposure, and outright model misspecification are separate threats that the E-value does not address at all. ## Why it caught on The E-value's appeal is that it needs no assumptions about the unmeasured variable - not its distribution, not its prevalence, not whether it is binary or continuous - and it is a single number computable from an already-published estimate. That makes it cheap enough that it can be reported routinely, which is exactly what turns sensitivity analysis from a specialist exercise into a default part of how an observational claim is presented.

  • Why is the E-value for the confidence limit smaller than the one for the point estimate?
    The limit nearest the null is already closer to no effect, so less bias is needed to push it across. That number answers the question decision-makers actually ask - how much confounding would make this finding no longer distinguishable from zero - which is why it should be reported alongside the point-estimate value.
  • Does a large E-value mean the study is free of bias?
    No. It bounds only unmeasured confounding of the exposure-outcome relationship. Selection into the sample, mismeasured exposure, differential outcome ascertainment and model misspecification are untouched by it. A large E-value with a badly defined exposure window is not a credible result.
  • How do you decide whether an E-value of 2.0 is large in a given study?
    Benchmark it. Compute how strongly the measured covariates are associated with the exposure and with the outcome, and ask whether any realistic unmeasured variable in this domain could exceed those. If the strongest known predictor reaches only 1.5 on each side, 2.0 is a meaningful margin; if several reach 3.0, it is not.

saying these in an interview costs you the question

  • Calls the E-value a probability that confounding exists
  • Applies the threshold to only one of the two associations
  • Confuses the E-value with the confounder's prevalence
  • Says a high E-value proves the association is causal
  • Reports only the point-estimate E-value, never the interval limit

context