skip to content

How do you judge whether an OLS coefficient is significant from its estimate and standard error?

level: middleimportance: must knowfreq 70%

answer

  1. the third column is derived, not new
  2. estimate over its own standard error
  3. compare the ratio to about two
  4. degrees of freedom are n minus coefficients
  5. same call as the interval missing zero

basics

~20 s

Divide the coefficient by its standard error to get the t-statistic, then compare it against a t distribution with n minus the number of estimated coefficients. A magnitude near 2 or more clears the usual 5% bar.

solid answer

~50 s

The t-statistic is `t = (estimate - 0) / SE(estimate)` — how many standard errors the coefficient sits away from zero. It is compared against a t distribution with `n - p` degrees of freedom, where `p` is the number of estimated coefficients including the intercept, and the printed p-value is the two-sided tail probability of a t at least that extreme when the true coefficient is zero. As a mental shortcut, `|t|` of about 2 is the 5% bar once the degrees of freedom get past roughly 30; with very few degrees of freedom the bar sits noticeably higher, around 2.26 at df 9. The same call can be made from the interval: `estimate +/- (critical value) * SE` fails to exclude zero exactly when `|t|` falls short of the critical value. If you want to test against something other than zero, put that value in the numerator: `t = (estimate - c) / SE`.

go deeper

for a junior

Be ready to compute the ratio on the spot and say which direction it goes: the estimate on top, its standard error underneath.

for a middle

Expect to state the degrees of freedom as n minus the number of estimated coefficients including the intercept, and to explain why the roughly-two shortcut loosens on small samples.

for a senior

Demonstrate that you cross-check the ratio against the interval and that you reach for the interval, not the star in the table, when reporting a result.

for a principal

Own the question of what the team is testing against: defaulting every coefficient to a null of zero is a habit, not a decision, and sometimes a business-relevant benchmark is the right null.

## The ratio A regression output table for each coefficient prints four numbers: the estimate, its standard error, a t-statistic and a p-value. The last two are computed from the first two, so given any two of them you can reconstruct the rest. The t-statistic is `t = (estimate - hypothesised value) / SE(estimate)` and the hypothesised value defaults to zero, because the question the table is answering is *does this predictor carry any linear association with the outcome once the others are held fixed*. So in practice `t = estimate / SE`. Read literally, it counts how many of the coefficient's own standard errors separate the estimate from zero. ## Degrees of freedom The reference distribution is a t distribution with `n - p` degrees of freedom, where `n` is the number of observations and `p` is the number of estimated coefficients **including the intercept**. Simple regression with one predictor uses `n - 2`. A model with four predictors and an intercept fit on 200 rows uses `195`. Forgetting the intercept in that count is a routine slip and matters only when `n` is small. Why `n - p`? The standard error is built from `s = sqrt(SSE / (n - p))`, and `p` residual directions have been used up fitting the coefficients themselves. Because `s` is estimated rather than known, the reference distribution has heavier tails than a normal, and the heaviness depends on how much data was left over. ## Reading the bar The two-sided p-value is the probability, computed under the model and assuming the true coefficient is zero, of drawing a t-statistic at least as extreme in absolute value as the one observed. Small p-values mean the observed ratio would be unusual if the coefficient really were zero. The practical shortcut every analyst carries is the **two-sigma bar**: `|t| >= 2` is roughly the 5% cutoff. The exact critical values show how good the approximation is — about 2.05 at 28 degrees of freedom, converging down toward 1.96 as degrees of freedom grow, but climbing to about 2.26 at 9 degrees of freedom and higher still below that. So with a healthy sample, eyeballing `estimate / SE` against 2 is reliable; with a dozen rows it is optimistic and you should look up the actual critical value. ## The interval says the same thing The confidence interval for the coefficient is `estimate +/- (critical value) * SE`. Zero falls inside that interval precisely when `|t|` is below the critical value. So *the interval excludes zero* and *the coefficient is significant at that level* are the same statement, arrived at from the same two numbers. Given a printed estimate and standard error you can produce both without any further computation — a common whiteboard ask. ## Worked reconstruction An estimate of `0.36` with a standard error of `0.30` gives `t = 1.2`. That is well short of 2, so the coefficient does not clear the usual bar, and the approximate 95% interval `0.36 +/- 2 * 0.30 = [-0.24, 0.96]` straddles zero, agreeing. An estimate of `0.36` with a standard error of `0.09` gives `t = 4.0` and an interval of roughly `[0.18, 0.54]`, which clears it comfortably. Identical point estimates, opposite conclusions — the standard error is doing all the work. ## Testing against a value other than zero Sometimes zero is not the interesting null. If a pricing model's slope should be `1` under a proposed pass-through assumption, test `t = (estimate - 1) / SE` with the same degrees of freedom. Interviewers use this to check whether a candidate has memorised the output column or understands the construction. ## What to say out loud Name the ratio, name the reference distribution and its degrees of freedom, give the roughly-2 shortcut with the caveat for small samples, and note that the interval-excludes-zero check is the same test. That is the complete answer at this level.

  • What degrees of freedom does that t-statistic use, and when does it actually matter?
    It uses `n - p`, where `p` counts every estimated coefficient including the intercept — so `n - 2` in simple regression. It matters when the sample is small: the 5% critical value is about 2.05 at 28 degrees of freedom but roughly 2.26 at 9, so the eyeball-against-2 shortcut is too generous on small data. With hundreds of rows the critical value is essentially 1.96 and the distinction stops mattering.
  • What does the p-value printed beside a regression coefficient actually refer to?
    It is the two-sided tail probability of getting a t-statistic at least as extreme in absolute value as the observed one, computed under the fitted model's assumptions and on the supposition that the true coefficient is zero. It is a statement about the data given that supposition, not a probability attached to the coefficient itself.
  • How would you test whether a slope differs from 1 rather than from 0?
    Put the hypothesised value in the numerator: `t = (estimate - 1) / SE`, with the same `n - p` degrees of freedom. Nothing else changes. The printed t and p-value in the output are just this construction with a hypothesised value of zero baked in, which is why you can rebuild them from the estimate and standard error alone.

saying these in an interview costs you the question

  • Divides the standard error by the estimate
  • Uses n as the degrees of freedom instead of n minus coefficients
  • Forgets the intercept when counting estimated coefficients
  • Applies the roughly-two bar to a sample of a dozen rows
  • Thinks a large t-statistic means a large effect

context