Your OLS table shows a large insignificant coefficient beside a tiny significant one — what explains that?
answer
- raw sizes are not comparable across columns
- each coefficient is per one unit of its predictor
- rescale the predictor and t does not move
- each estimate is judged against its own error
- wide interval means uninformative, not null
basics
~20 sSignificance compares each coefficient to its own standard error, not to the other coefficients. Raw magnitudes are not comparable across columns because each is measured per one unit of its own predictor, and units are arbitrary.
solid answer
~50 sTwo separate things are being confused. First, **units**: a coefficient is the outcome change per one unit of its predictor, so a predictor measured in dollars carries a numerically tiny coefficient and one measured in millions carries a huge one, describing the same relationship. Rescaling a predictor by a factor divides both the coefficient and its standard error by that factor, so the t-statistic and p-value do not move at all — proof that raw size and significance are answering different questions. Second, **precision**: a genuinely large estimate can carry an enormous standard error when its predictor barely varied or the outcome is noisy, which leaves it insignificant. To compare predictors, express each effect over a meaningful change in that predictor — one standard deviation, or an interquartile shift — and report the interval in outcome units. And read the insignificant one carefully: if its interval also covers large effects, the data are uninformative, not evidence of no effect.
go deeper
Be ready to say that significance depends on the coefficient relative to its own standard error, so a big number can be insignificant and a small one significant.
Expect to give the rescaling argument: dividing a predictor by 1000 divides its coefficient and standard error alike, leaving the t-statistic untouched.
Show that you convert every coefficient to an effect over a realistic change with an interval attached, and that you distinguish an uninformative estimate from evidence of a small effect.
Own how results reach decision-makers: a table sorted by raw estimate will be misread, so set the reporting standard that ships comparable effects with uncertainty rather than significance stars.
## Why the comparison is invalid as posed An output table invites you to scan down the estimate column and rank predictors by size. That reading is wrong for a structural reason: each coefficient is denominated in *outcome units per one unit of its own predictor*, and the predictors have different units. A coefficient on tenure-in-years and a coefficient on revenue-in-dollars are not on a common scale, so `12000` versus `0.004` says nothing about which predictor matters more. Significance, meanwhile, is a comparison of a coefficient to **its own** standard error: `t = estimate / SE`. That ratio is unitless, so it survives rescaling while the raw magnitude does not. ## The rescaling argument Measure a spend predictor in dollars, then refit with the identical data measured in thousands of dollars. The coefficient is divided by 1000, and its standard error is divided by 1000 as well, because both carry the same units. Their ratio — the t-statistic — is unchanged, and so is the p-value. The fit is identical; only the printed magnitudes moved. This single fact settles the question. If simply changing a unit of measurement can make a coefficient a thousand times larger without changing its significance, then magnitude and significance cannot be measuring the same thing, and ranking predictors by raw coefficient size is meaningless. ## The precision argument The second half of the puzzle is real statistical content rather than bookkeeping. A big estimate becomes insignificant when its standard error is big, and the standard error is `s / (s_x * sqrt(n - 1))` in the simple case: large when the outcome is noisy, when that predictor barely varied in the observed data, or when the sample is small. So a predictor that genuinely swings the outcome hard, but was only ever observed across a narrow band, can produce a headline-grabbing estimate with an interval so wide it means nothing. Conversely, a tiny coefficient can clear the significance bar effortlessly. With tens of thousands of rows, standard errors get small enough that a per-unit effect too small to care about becomes overwhelmingly significant. Significance says the estimate is far from zero relative to its noise; it does not say the effect is worth acting on. ## What to do instead 1. **Put every predictor on a comparable change.** Report the outcome change per one standard deviation of the predictor, or per an interquartile shift, or per a decision-relevant change the business recognises (a 10k increase in spend, one extra year of tenure). Now the numbers are all in outcome units and can be compared. 2. **Always carry the interval.** A point estimate with no interval hides exactly the information that resolves this puzzle. 3. **Distinguish two kinds of insignificance.** If the large coefficient's interval spans, say, `-30,000` to `54,000`, the data are simply uninformative about it — you have not shown a null effect, you have shown you cannot tell. If instead a coefficient's interval is narrow and tightly hugs zero, you have positive evidence that any effect is small. These read identically in the significance column and mean opposite things. 4. **Separate statistical from practical significance.** For the tiny-but-significant coefficient, multiply it out over a realistic change in its predictor and ask whether the resulting outcome movement would change any decision. Very often it would not. ## Communicating it Stakeholders reliably read the biggest number in the estimate column as the most important driver. The fix is not to explain t-statistics to them; it is to never ship a table whose columns invite the comparison. Present effects per a named realistic change, with intervals, sorted by that quantity. When a large estimate is too imprecise to use, say so in those words — *we cannot yet size this one* — rather than reporting it as non-significant, which stakeholders hear as *no effect*. ## What an interviewer is checking That you do not confuse effect size with evidence, that you can produce the rescaling argument on demand, that you know why an insignificant large coefficient is a call for more data or more variation rather than a finding, and that you have a concrete plan for making coefficients comparable.
- How do you make coefficients comparable across predictors in a report?Express each as the outcome change over a meaningful move in that predictor — one standard deviation, an interquartile shift, or a business-recognised step like ten thousand dollars of spend. Every number is then in outcome units and can be ranked honestly. Keep the interval attached to each, converted the same way, so precision travels with the size.
- The large coefficient's interval spans both trivial and enormous effects. What do you conclude?That the data are uninformative about that predictor, which is not the same as evidence of no effect. The honest report is that you cannot size it yet, and the fix is more observations or more variation in that predictor, not dropping it and declaring it irrelevant. Calling it non-significant invites stakeholders to hear no effect, which the interval does not support.
- Can a highly significant coefficient still be practically irrelevant?Routinely. With a very large sample the standard error shrinks until a per-unit effect far too small to matter clears any threshold you like. Translate the coefficient into the outcome change produced by a realistic swing in the predictor and check it against whatever the decision threshold is. Statistical significance is about distance from zero relative to noise, not about business consequence.
saying these in an interview costs you the question
- Ranks predictor importance by raw coefficient magnitude
- Reads a non-significant coefficient as proof of no effect
- Thinks rescaling a predictor changes its p-value
- Treats a significant coefficient as automatically actionable
- Compares coefficients across predictors with different units