skip to content

Math, statistics & experimentation

7 roadmaps750 questionsupdated

This is the math and statistics layer every data and ML interview leans on: probability, hypothesis testing, regression, and how to design and read an A/B test. Interviewers probe it before any tooling because it separates people who can reason about data from people who can only run libraries.

on this pageshow

guide

overview

~1 min

Statistics questions appear in data scientist, analyst and machine-learning interviews, and they usually come before any question about tooling. The interviewer is checking whether you can turn a vague business question into a measurable quantity, say how uncertain your estimate of it is, and notice when the data cannot carry the conclusion someone wants to draw. A correct calculation followed by a wrong interpretation scores worse than a small arithmetic slip with sound reasoning, and at senior levels the discussion is mostly about judgement: which design, which metric, which assumption is doing the work. The subject splits into three groups of sections. The foundations are [descriptive statistics and sampling](/topics/found-math-statistics-descriptive), [probability and distributions](/topics/found-math-statistics-probability), and the [linear algebra](/topics/found-math-statistics-linear-algebra) and [calculus and optimization](/topics/found-math-statistics-calculus-optimization) that models are written in. The inference core is [hypothesis testing and confidence intervals](/topics/found-math-statistics-inference), [regression and statistical modeling](/topics/found-math-statistics-regression), [Bayesian statistics](/topics/found-math-statistics-bayesian) and [time-series analysis](/topics/found-math-statistics-time-series): four ways of getting from a sample to a claim, each with its own assumptions. The decision layer is [A/B testing and experiment design](/topics/found-math-statistics-ab-testing) and [causal inference](/topics/found-math-statistics-causal-inference), where the question shifts from what the number is to whether a change produced it and whether to ship. Start with descriptive statistics and probability, because every later section assumes you can summarise a distribution and reason about chance. Inference comes next; its vocabulary of standard errors, intervals, error rates and power returns almost unchanged in regression output, experiment readouts and causal estimates. Take experiments and causal inference once that vocabulary is automatic. Linear algebra and calculus can run in parallel if your target role trains models; analyst loops lean on them less. Questions range from a junior describing the spread of a column to a principal defending an experiment's decision rule, so revisit a section as your level rises.

primer

A few ideas run through every section. With them in place, most questions below read as applications rather than definitions to memorise. - **Every estimate is one draw from a sampling distribution.** Collect the data again and the mean, the coefficient or the conversion lift would come out different. Standard errors, confidence intervals, p-values and power are all ways of describing that spread, and most of this hub is about reasoning with it rather than about the point estimate. - **Know what a probability is a probability of.** A frequentist statement is about a procedure repeated over imagined samples with the parameter held fixed; a Bayesian statement is about the unknown parameter itself, given a prior and the data. The two readings are easy to blur in conversation, and interviewers phrase questions to see whether you do. - **Noise sets the budget.** The variance of a metric, together with the effect you care about, decides how much data a test needs and what it can detect. Skewed and heavy-tailed metrics, correlated observations and small segments all spend that budget, which is why sizing, metric choice and variance reduction get as much attention as the test itself. - **Every method carries assumptions, and the answer often lives in them.** Independent observations, a stable distribution, constant variance, no unmeasured confounding, a series whose behaviour does not drift: each technique leans on some of these. A strong answer names the assumption a method needs, how you would check it, and what breaks when it fails. - **A causal claim needs a design, not just a correlation.** Randomization earns it by construction. Without randomization you need an explicit, defensible assumption about how treatment came to be assigned, and the observational methods differ mainly in which assumption they ask you to accept. - **Interpretation outweighs computation.** What a coefficient means with the other predictors held fixed, what an interval covers, whether an effect is large enough to matter as well as distinguishable from zero: these decide most rounds. Arithmetic matters, but it is rarely where candidates lose the point. - **Fitting a model is an optimization problem over vectors.** Linear algebra describes the data and the parameters; calculus describes how a loss changes as the parameters move. Whether a unique best fit exists, and whether an iterative method will reach it, are questions those two sections answer.

Sampling distribution
The distribution an estimate would follow across many repeated samples of the same size; its spread is what standard errors and intervals describe.
Standard error
The standard deviation of an estimate's sampling distribution. It shrinks as the sample grows, unlike the spread of the individual observations.
Confidence interval
A range built by a procedure that captures the true parameter in a stated share of repeated samples; the coverage is a property of the procedure.
Credible interval
A Bayesian range holding a stated share of posterior probability for the parameter, given the prior and the model used.
P-value
The probability, computed assuming the null hypothesis, of a result at least as extreme as the one observed. It measures evidence against the null, not the null's probability.
Statistical power
The probability that a test rejects the null when a specified true effect exists; it rises with sample size and effect size and falls as noise grows.
Minimum detectable effect
The smallest true effect an experiment is sized to detect at the chosen significance level and power.
Type I and Type II errors
Rejecting a true null hypothesis, a false positive, and failing to reject a false one, a missed effect; the significance level and power control them.
Multiple comparisons
Running many tests on one dataset, which raises the chance that at least one crosses the threshold by luck unless the threshold is adjusted.
Randomization unit
The entity assigned to a variant, such as a user, session or region; it sets which observations are independent and the effective sample size.
Sample ratio mismatch
An observed split between experiment arms that differs significantly from the designed split, signalling broken assignment or logging rather than a treatment effect.
Confounder
A variable that influences both the treatment and the outcome, creating an association between them that is not causal.
Potential outcomes
The outcomes a unit would have under each treatment condition. Only one is ever observed, so causal effects are estimated over groups of units.
Prior and posterior
The belief about a parameter before seeing data, and the updated belief after combining it with the likelihood of the observed data.
Likelihood
The probability of the observed data viewed as a function of the parameters; used to compare parameter values, not a distribution over them.
Heteroscedasticity
Residual variance that changes with a predictor or the fitted value. Least-squares coefficients stay unbiased, but the usual standard errors become wrong.
Stationarity
A time series whose mean, variance and dependence structure do not change over time; many classical forecasting models assume it, often after a transformation.
Convex function
A function on which every local minimum is also global, so a descent method that settles at a stationary point has found a best fit.

The sections build on each other more than their titles suggest. **Probability is the language; inference runs it backwards.** Probability goes from a known process to the data it produces. Inference goes from observed data back to the process, and the limit theorems are the bridge: they explain why so many test statistics and intervals can lean on an approximately normal sampling distribution even when the raw data is far from normal. **Regression is inference with covariates.** A coefficient table is a list of estimates, each with a standard error, a test and an interval, so everything from the inference section applies line by line. Generalized linear models extend the same reading to binary, count and time-to-event outcomes, and the linear algebra section explains least squares as a projection and why near-collinear predictors make it unstable. **Bayesian statistics answers the same questions with a different object of probability.** Priors and posteriors replace sampling distributions, credible intervals replace confidence intervals, and maximum a posteriori estimation sits close to the regularized fits the optimization section describes. **Experiments are applied inference plus design.** Sample-size planning is a power calculation, the readout is a comparison of two groups, and most validity threats are an inference assumption failing in production: units that are not independent, an assignment that is not random, a test analysed more often than it was designed for. **Causal inference generalises the experiment.** The potential-outcomes framing defines what a randomized test estimates; the observational methods try to recover the same quantity when no one randomized. Confounding and Simpson's paradox first appear in descriptive statistics as surprises and are given a vocabulary and a remedy here. **Descriptive statistics and time series feed the rest.** Metric definitions, mix shift and diagnosing a sudden change come before any test is run. Time-series analysis drops the independence assumption altogether, which is why its evaluation and anomaly-detection methods differ from the cross-sectional ones elsewhere in the hub.

  1. Descriptive Statistics & Sampling →

    Summaries, spread and sampling bias come before any test; interviewers often open here to see whether you read data honestly.

  2. Probability & Distributions →

    Conditioning, expectation and the common distributions are the vocabulary every inference and experiment question is phrased in.

  3. Statistical Inference & Hypothesis Testing →

    Standard errors, intervals, p-values and power return in regression, experiments and causal work, so learn them once and properly.

  4. Regression & Statistical Modeling →

    Applies inference to a model with several predictors and trains the interpretation questions that dominate this area.

  5. A/B Testing & Experiment Design →

    Brings sizing, metrics, readout and validity together in the design question that data roles should expect to face.

  6. Causal Inference →

    Covers the case where nobody randomized and a correlation has to be argued into, or out of, a causal claim.

  • Reading a p-value as the probability that the null is true, or saying a computed 95% confidence interval holds the parameter with 95% probability; only a credible interval says that.

  • Stopping an experiment the first time it looks significant; repeated looks need a sequential design or a fixed horizon set in advance.

  • Calling a non-significant result proof of no effect when the test was never powered to detect a realistic effect size.

  • Testing many metrics or segments and reporting whichever crossed the threshold, with no correction and no metric chosen before launch.

  • Claiming cause from an observational correlation without naming the confounder that could explain it or the design that rules it out.

  • Interpreting a regression coefficient without the other predictors held fixed, or reading a category's coefficient against the wrong reference level.

  • Treating a high share of explained variance as proof the model is right; it says nothing about bias, causality or performance on new data.

  • Shuffling time-ordered data into a random train/test split, or using a feature that would not be known at forecast time.

  • Analysing an experiment whose arms are split differently from the design; a sample ratio mismatch means assignment broke, and no outcome analysis repairs it.

  • Confusing statistical significance with practical significance: with enough data a trivially small true effect becomes significant, and the business question is about size.

Most design and analysis questions in this hub turn on one of a small set of choices. Naming the one you are making, and what would change your mind, is often the substance of a good answer. - **False alarms versus missed effects.** Lowering the significance level cuts false positives and costs power; holding power fixed then costs sample size or runtime. Which error is more expensive depends on the decision, not on convention. - **Speed versus validity.** Shorter tests, early stopping and frequent looks deliver answers sooner, but each needs a design that accounts for it, and a short runtime can miss a fading novelty effect or a weekly cycle. - **Bias versus variance.** Adding covariates, tightening a matching rule or trimming extreme values can reduce bias or noise, usually at the price of the other or of a changed estimand. Say which one you are buying. - **Robust versus efficient summaries.** The median and trimmed means resist extreme values; the mean uses all the information and maps directly onto totals such as revenue. Changing the summary changes the question being answered. - **Randomization unit.** Randomizing finer units gives you more of them and more power; randomizing coarser units such as accounts, regions or time slots protects against interference between units, at a large cost in effective sample size. - **Frequentist versus Bayesian reporting.** One offers long-run error guarantees; the other offers direct probability statements about the parameter that depend on the chosen prior. Either can serve a team well; mixing the two vocabularies in one readout is the usual trap.

A handful of moves recur under different names across the sections. Spotting which one a question wants is often the fastest way in. - **Ask what noise alone would produce.** Null distributions, permutation tests, placebo checks in causal designs and A/A tests all compare the observed result with what chance generates when there is no effect. - **Divide a signal by its noise.** Test statistics, standardized mean differences and sample-size formulas share one shape: an effect measured in units of its own standard error. - **Condition, then re-weight.** Bayes' rule, stratified estimates, propensity weighting, Simpson's paradox and mix-shift decomposition are all about how subgroup results combine into a total. - **Difference away what you cannot measure.** Paired designs, difference-in-differences, differencing a trending series and adjusting with pre-period data each remove a component that stays fixed across the comparison. - **Decompose a total.** Variance into explained and residual parts, a series into trend, season and remainder, a metric change into volume and rate: decomposition turns one surprising number into several explainable ones. - **Simulate when the algebra is hard.** Bootstrap intervals, Monte Carlo estimates for probability puzzles and sampling methods for posteriors replace a closed form with repeated draws. - **Check the assumption before trusting the output.** Residual plots, balance tables, sample-ratio checks, chain convergence diagnostics and stationarity tests are the step that turns a number into a result.

explore

report an issue with this guide →

questions

750 · 10 sections

How does cosine similarity differ from Euclidean distance between two vectors?

level: juniorimportance: must knowfreq 80%
basics
~20 s

Cosine similarity measures only the angle between two vectors; Euclidean distance also reacts to their magnitudes. Two term-count vectors with the same word mix but different document lengths score cosine 1.0 while sitting far apart in Euclidean distance.

open as a page

What does it mean for a vector to be an eigenvector of a matrix A?

level: juniorimportance: must knowfreq 84%
basics
~20 s

A nonzero vector v is an eigenvector of A when Av = lambda v. Multiplying by A leaves v on its own line through the origin, only stretching, shrinking or flipping it; the scalar lambda is that scale factor.

open as a page

What does a determinant of zero tell you about a square matrix?

level: juniorimportance: must knowfreq 76%
basics
~20 s

A zero determinant means the matrix is singular: no inverse exists. For a 2x2 matrix [[a, b], [c, d]] the determinant is ad - bc, so ad - bc = 0 is the exact test for non-invertibility.

open as a page

For the matrix product AB, what shapes must A and B have, and what shape is the result?

level: juniorimportance: must knowfreq 86%
basics
~20 s

Matrix multiplication needs matching inner dimensions: if A is m x n and B is n x p, then AB is m x p. Entry (i,j) is the dot product of row i of A with column j of B.

open as a page

When does the linear system Ax = b have no solution, exactly one, or infinitely many?

level: juniorimportance: must knowfreq 62%
basics
~20 s

Run Gaussian elimination on the augmented matrix. A row that is all zeros on the left but nonzero on the right means no solution. Otherwise, one pivot per unknown means exactly one solution; any free unknown means infinitely many.

open as a page

What is the formal definition of a convex set?

level: juniorimportance: must knowfreq 66%
basics
~20 s

A set is convex if the straight segment joining any two of its points lies entirely inside it: for every x and y in the set C and every t in [0, 1], the point t*x + (1-t)*y is also in C.

open as a page

Why is a zero gradient necessary but not sufficient for a local minimum?

level: juniorimportance: must knowfreq 82%
basics
~20 s

At a smooth interior local minimum the gradient must vanish, so a zero gradient is necessary. But maxima, saddle points and flat inflection points also have a zero gradient, so vanishing slope on its own certifies nothing.

open as a page

Using the limit definition of the derivative, what is the derivative of f(x) = x^2?

level: juniorimportance: must knowfreq 72%
basics
~10 s

The derivative of x^2 is 2x. The difference quotient ((x+h)^2 - x^2)/h expands to (2xh + h^2)/h, which simplifies to 2x + h, and letting h shrink to 0 leaves 2x.

open as a page

In gradient descent, what does the update rule x = x - eta * gradient actually do at each step?

level: juniorimportance: must knowfreq 88%
basics
~20 s

Each iteration moves every parameter a short distance opposite its own partial derivative: new value = old value minus eta times the gradient. The learning rate eta scales how far you move; the loop repeats until the gradient is near zero.

open as a page

For f(x, y) = x^2 * y, what are the two partial derivatives and the gradient at (2, 3)?

level: juniorimportance: must knowfreq 82%
basics
~20 s

Differentiate one variable at a time, holding the other fixed: df/dx = 2xy and df/dy = x^2. At (2, 3) those evaluate to 12 and 4, so the gradient there is the vector (12, 4).

open as a page

How would you estimate the number of piano tuners working in Chicago from scratch?

level: juniorimportance: must knowfreq 74%
basics
~20 s

Break the target number into a chain of estimable factors: city population, people per household, share of households owning a piano, tunings per piano per year, and tunings one tuner performs per year. Multiply through, divide, and land near 50.

open as a page

In a cross-tab of device type by plan, what is the difference between joint, marginal and conditional proportions?

level: juniorimportance: must knowfreq 62%
basics
~20 s

A joint proportion divides a cell count by the grand total. A marginal proportion divides a row or column total by the grand total. A conditional proportion divides a cell by its own row or column total.

open as a page

Ice-cream sales correlate with drowning deaths — what can and cannot be concluded from that?

level: juniorimportance: must knowfreq 85%
basics
~20 s

A correlation only says the two series move up and down together in the observed data. It cannot say ice cream causes drownings: something else, such as hot weather, can drive both, and correlation carries no direction while causation does.

open as a page

What is the difference between sample covariance and Pearson's correlation coefficient r?

level: juniorimportance: must knowfreq 86%
basics
~20 s

Sample covariance measures whether two variables move together, but it carries the product of their units, so its size means little alone. Pearson's r divides covariance by both standard deviations, giving a unitless number between -1 and 1.

open as a page

For a right-skewed column like household income, why does the mean exceed the median?

level: juniorimportance: must knowfreq 84%
basics
~20 s

The mean sums every value, so a long right tail of very high incomes pulls it upward. The median depends only on rank, so extreme values barely move it. Mean above median is the usual signature of right skew.

open as a page

In the Monty Hall problem, why does switching doors win two-thirds of the time?

level: juniorimportance: must knowfreq 64%
basics
~20 s

Your first pick wins only one time in three, so two times in three the car is behind another door. The host, who knows where it is, opens a losing door and concentrates that 2/3 onto the single door left.

open as a page

What does the Central Limit Theorem say about the average of many independent samples?

level: juniorimportance: must knowfreq 85%
basics
~10 s

The Central Limit Theorem says that averaging many independent draws from almost any distribution with finite variance produces an average whose distribution is approximately normal, even when the individual observations are not remotely normal.

open as a page

Test scores are normal with mean 100 and SD 15: by the 68-95-99.7 rule, what share exceeds 130?

level: juniorimportance: must knowfreq 82%
basics
~20 s

About 2.5%. A score of 130 is two standard deviations above the mean, so its z-score is 2; the rule puts roughly 95% of values within two SDs, leaving about 5% split evenly between the two tails.

open as a page

What are the mean and variance of a binomial random variable with n trials and success probability p?

level: juniorimportance: must knowfreq 78%
basics
~10 s

A binomial count over n independent trials with success probability p has mean np and variance np(1-p). It is the sum of n Bernoulli(p) indicators, each contributing mean p and variance p(1-p).

open as a page

For a Poisson count averaging 3 support tickets per hour, what is the probability of zero tickets in an hour?

level: juniorimportance: must knowfreq 64%
basics
~20 s

The Poisson mass function is P(X = k) = e^(-λ) λ^k / k!. With λ = 3 tickets per hour, P(X = 0) = e^(-3), about 0.0498, so roughly a 5 percent chance of a completely quiet hour.

open as a page

What does a one-way ANOVA test, and what are its null and alternative hypotheses?

level: juniorimportance: must knowfreq 76%
basics
~20 s

One-way ANOVA tests whether the population means of three or more groups defined by a single factor are all equal. The null says every group mean is the same; the alternative says at least one differs.

open as a page

Which assumptions must hold for a two-sample t-test comparing group means to be valid?

level: juniorimportance: must knowfreq 72%
basics
~20 s

A two-sample t-test assumes observations are independent within and between groups, that the sampling distribution of each group mean is approximately normal, and, for the pooled version, that the two populations share a common variance.

open as a page

What is bootstrap resampling, and how does it produce a confidence interval for a correlation?

level: juniorimportance: must knowfreq 62%
basics
~20 s

The bootstrap treats your sample as a stand-in for the population: draw many new samples of the same size with replacement, recompute the statistic on each, and read the interval off the middle 95% of those values.

open as a page

How does a chi-square goodness-of-fit test decide whether 600 die rolls came from a fair die?

level: juniorimportance: must knowfreq 68%
basics
~20 s

A chi-square goodness-of-fit test compares observed category counts with the counts a hypothesised distribution predicts. A fair die over 600 rolls predicts 100 per face; the statistic sums (observed minus expected) squared, divided by expected, across the six faces.

open as a page

What does the 95% in a 95% confidence interval actually refer to?

level: juniorimportance: must knowfreq 88%
basics
~20 s

The 95% describes the procedure, not one interval. If you repeated the sampling and rebuilt the interval many times, about 95% of those intervals would contain the fixed true parameter. Any single interval either covers it or does not.

open as a page

Why is treating three repeated blood-pressure readings per patient as three independent observations wrong?

level: juniorimportance: must knowfreq 70%
basics
~20 s

Readings from one patient are correlated, so three readings carry far less information than three different patients. Counting them as independent inflates the sample size, shrinks the standard errors and p-values, and manufactures significance that is not there.

open as a page

In a regression output, what does the standard error of a coefficient tell you?

level: juniorimportance: must knowfreq 78%
basics
~20 s

The standard error of a regression coefficient measures how much that estimate would move around if you refit the model on other samples from the same process. A smaller standard error means a more precisely estimated effect.

open as a page

With day-of-week dummies and Monday as the reference level, what does the Saturday coefficient mean?

level: juniorimportance: must knowfreq 80%
basics
~20 s

The Saturday coefficient is the estimated difference in the outcome between Saturday and Monday, with the model's other predictors held fixed. It is a contrast against the omitted baseline day, not Saturday's own average level.

open as a page

In a subscription churn analysis, how should you record a user who signed up 21 days ago and is still subscribed?

level: juniorimportance: must knowfreq 78%
basics
~20 s

Record the user as right-censored at 21 days: the subscription lasted at least 21 days, and the eventual cancellation time is unknown. Deleting the row biases survival downward; coding it as a cancellation invents an event that never happened.

open as a page

What does the R-squared of a fitted multiple regression tell you about the model?

level: juniorimportance: must knowfreq 78%
basics
~20 s

R-squared is the share of the outcome's total variation that the fitted model accounts for, computed as 1 minus the residual sum of squares over the total sum of squares. It measures fit on the data used, not correctness.

open as a page

In a Bayesian A/B test, what does 'probability B beats A is 96%' actually mean?

level: juniorimportance: must knowfreq 76%
basics
~20 s

It is the posterior probability that variant B's true rate is higher than variant A's, given the data and the prior. It is a claim about the unknown rates, and says nothing about how large the difference is.

open as a page

What is the difference between probability as long-run frequency and probability as degree of belief?

level: juniorimportance: must knowfreq 78%
basics
~20 s

The frequency reading defines probability as the proportion of times an outcome occurs in repeatable trials. The belief reading defines it as a numeric degree of confidence, so it can also score one-off events such as a single rocket launch.

open as a page

Starting from a Beta(1,1) prior, what posterior follows from 8 clicks in 100 impressions?

level: juniorimportance: must knowfreq 58%
basics
~10 s

Beta(1 + 8, 1 + 92), that is Beta(9, 93). The prior contributes one pseudo-success and one pseudo-failure, so the posterior mean is 9/102, about 0.088, slightly above the raw rate of 0.08.

open as a page

What does a 95% Bayesian credible interval of [1.9%, 2.5%] say about a conversion rate?

level: juniorimportance: must knowfreq 82%
basics
~20 s

It says 95% of the posterior probability for the conversion rate falls between 1.9% and 2.5%. Given the model and prior you used, there is a 95% probability the rate lies in that range. The probability attaches to the parameter.

open as a page

What is the difference between probability and likelihood after seeing 7 heads in 10 coin flips?

level: juniorimportance: must knowfreq 75%
basics
~20 s

Probability fixes the coin's bias and varies the data; likelihood fixes the observed data and varies the bias. After 7 heads in 10 flips the likelihood is a curve over p that is not a probability distribution.

open as a page

In an A/B test, what is the difference between a count, a rate, and a share metric?

level: juniorimportance: must knowfreq 72%
basics
~20 s

A count metric sums events, such as total orders. A rate metric divides a count by the units that were exposed, such as orders per visitor. A share metric divides one count by a related total, such as the percentage of orders placed on mobile.

open as a page

What is a guardrail metric in an A/B test, and how does it differ from a driver metric?

level: juniorimportance: must knowfreq 68%
basics
~20 s

A guardrail is a metric the experiment must not damage — latency, crash-free sessions, unsubscribes — and a big enough degradation can veto the launch. A driver metric only explains why the primary metric moved; it never vetoes.

open as a page

Why does revenue per user make an A/B test hard to call when a few users spend far more than the rest?

level: juniorimportance: must knowfreq 74%
basics
~10 s

Almost all the variance in revenue per user comes from a handful of very large spenders, so the interval around the treatment-control difference stays wide. Ordinary experiment sizes then cannot resolve realistic revenue effects.

open as a page

What is an Overall Evaluation Criterion (OEC) in an A/B test?

level: juniorimportance: must knowfreq 74%
basics
~20 s

The Overall Evaluation Criterion is the single metric, agreed before launch, that an experiment's ship-or-not decision is defined against. It expresses what the team means by the product getting better, so the result cannot be reinterpreted afterwards.

open as a page

What does a DAU/MAU stickiness ratio of 0.2 tell you about how a product is used?

level: juniorimportance: must knowfreq 68%
basics
~10 s

A DAU/MAU of 0.2 means the typical monthly active user opens the product on about 6 days out of 30. It measures return frequency, not audience size, and averages over very different user types.

open as a page

What does a difference-in-differences estimate compute from a two-group, two-period panel?

level: juniorimportance: must knowfreq 70%
basics
~20 s

It subtracts the comparison group's before-to-after change from the treated group's before-to-after change. That double difference cancels the fixed level gap between the groups and any shock that moved both of them over the same window.

open as a page

Why can a treatment with an average effect of zero still help some users and harm others?

level: juniorimportance: must knowfreq 62%
basics
~20 s

An average pools opposite effects. A drug that raises recovery for patients under 50 and lowers it by a similar amount for patients over 70 posts an overall average near zero while both real effects remain untouched underneath it.

open as a page

What is a propensity score, and why match on it rather than on the raw covariates?

level: juniorimportance: must knowfreq 76%
basics
~20 s

A propensity score is a unit's probability of receiving the treatment given its observed covariates. Conditioning on that single number balances the covariates that went into it, so matching happens in one dimension instead of many.

open as a page

What does adding a confounder to a regression do to the treatment coefficient?

level: juniorimportance: must knowfreq 76%
basics
~20 s

Adding a measured confounder turns the treatment coefficient from a raw comparison into a within-strata one: it now compares treated and untreated units that share the same covariate value, removing the part of the gap that covariate explained.

open as a page

What does a sensitivity analysis for unmeasured confounding tell you about a causal estimate?

level: juniorimportance: must knowfreq 55%
basics
~10 s

A sensitivity analysis says how strong an unmeasured confounder would have to be to overturn the estimate. It never shows confounding is absent; it prices how much hidden bias the finding can tolerate.

open as a page

Why does MAPE break down on intermittent demand series with many zero-sales days?

level: juniorimportance: must knowfreq 76%
basics
~20 s

MAPE divides each absolute error by the actual value, so a zero-sales day makes that term undefined and a near-zero day makes it explode. On intermittent demand the average is dominated by a handful of tiny denominators.

open as a page

In a time series, what is the difference between a point outlier and a level shift?

level: juniorimportance: must knowfreq 70%
basics
~20 s

A point outlier is one observation far from expectation, after which the series returns to its old level. A level shift moves the series to a new baseline that persists. The difference decides whether you drop a point or re-baseline.

open as a page

Why is a shuffled random train/test split invalid for evaluating a daily demand forecast?

level: juniorimportance: must knowfreq 78%
basics
~20 s

A shuffled split trains on future days and tests on past ones, so the model interpolates between neighbouring dates instead of forecasting. Because adjacent days are highly correlated, the score looks excellent and says nothing about future performance.

open as a page

In a classical time-series decomposition, what do the trend, seasonal and remainder components each represent?

level: juniorimportance: must knowfreq 76%
basics
~20 s

Decomposition splits a series into three parts: trend-cycle, the slow movement of the level; seasonal, the pattern that repeats at a fixed known period such as 12 months; and remainder, the variation left after removing both.

open as a page

In simple exponential smoothing, what does the smoothing parameter alpha control?

level: juniorimportance: must knowfreq 76%
basics
~20 s

Alpha sets how much weight the update puts on the newest observation versus the accumulated past. Alpha near 1 tracks recent data and reacts fast; alpha near 0 averages over a long history and smooths noise.

open as a page