With no recorded baseline, how do you defend a before-and-after number to a behavioral interviewer?
answer
- Provenance before the value
- Say which half you measured
- A bound beats invented precision
- Name the artefact you reconstructed from
- Record the baseline before you start
basics
~20 sSeparate what you measured from what you estimated, show the derivation out loud, and give a bound rather than false precision. A sourced estimate beats a confident figure you cannot explain, and the probe lands exactly there.
solid answer
~40 sThe probe is some version of *what was that number before you started, and how do you know?* — and it is a sourcing question, not a trap. Answer in three moves. Name the source: alert timestamps, the job's own run log, an incident timeline, a cost report. Split measured from inferred: `the nine minutes is measured on every run since the change; the forty-one is the worst case across the runs we captured before it`. Then bound rather than invent: if you sampled a handful of runs, say so and give the range those runs covered. Saying `I did not measure that directly, here is how I sized it` costs nothing and buys the rest of your credibility. Inventing precision costs everything, because the next question is always how you got it.
go deeper
Know that any figure you say out loud can be followed by a question about where it came from. Before an interview, write down the source for every number on your resume.
Explain the difference between a continuously measured value and a sampled one, and be able to state which statistic you are quoting — worst case, median or something else.
Demonstrate that you can reconstruct or bound a missing baseline from surviving artefacts, say plainly which half is inferred, and volunteer the limitation before you are asked.
Own the instrumentation decision that makes this question easy. Be ready to argue what you would measure before starting a piece of work, and what you would deliberately not bother measuring.
## Why this question exists Asking where a number came from is the cheapest calibration an interviewer has. Candidates who ran their own change usually know the before-value, where it was displayed and why it was that bad. Candidates who absorbed a figure from a status update usually know only the after-number and the adjective attached to it. One follow-up separates the two groups, which is why the probe is so common and so often decisive. The failure it catches is specific: an impressive after-number quoted with no baseline, followed by a collapse when asked how it was measured. The collapse is worse than never quoting the figure, because it retroactively puts every other claim on the page in question. ## The three moves ### 1. Name the source before the value Leading with provenance changes the register of the whole answer. *The queue exposed backlog age, and we alerted on it, so the before-value is the alert history* is a sentence that pre-empts the probe. Sources that hold up: metric dashboards and their retention window, alert or paging history, ticket and incident timelines with timestamps, a job's own run log, a cost or billing report, release notes with dates attached. Sources that do not: recollection, a number someone quoted in a meeting, a figure from a document you never verified. ### 2. Split measured from inferred, explicitly Most real claims are a mixture, and saying so is a strength. A truthful decomposition sounds like this: > The nine minutes is measured — every run since the change is in the log. The forty-one is the worst case across the runs we captured beforehand; the typical run was better than that, and I quote the worst case because that is the one that woke people up. Notice what that does. It defines which statistic is being used, admits which half is sampled rather than continuous, and gives the reason for the choice. An interviewer who wanted to probe now has nothing left to probe — you already did it. ### 3. Bound instead of inventing precision When the underlying data is genuinely gone, estimate openly and give a range or a floor. *Above forty minutes on the runs I saw* is defensible; a confident single figure produced from nothing is not. Two honest estimation techniques: - **Reconstruct from an artefact that still exists.** Ticket close times, alert timestamps, a change log, calendar entries for the incident reviews. These are weaker than a metric series but they are real, and you can say which one you used. - **Reason from a known constant.** If the job ran on a fixed schedule and overlapped the next run before your change but no longer does, the schedule interval bounds the before-value from below. State the reasoning, not just the conclusion. What you must not do is round an estimate into something that sounds authoritative. Tidy figures read as invented, and non-tidy figures read as measured, which is one reason a real drop from 41 minutes to 9 is more persuasive than any smoothed version of itself. ## The forward fix This question is much easier to answer if you never had to reconstruct anything. When you start work you expect to improve, record the current value, the date-free description of where you read it, and the statistic you are using — worst case, median, ninety-fifth percentile. Keep that in your own notes rather than only in an employer's system, because access ends when employment does. Keep the record proportionate and mind your obligations: many employers treat operational and financial detail as confidential, and what you may carry away varies by employer and by contract, so check your own situation and prefer relative or de-identified forms where there is any doubt. ## What the scope caveat buys you The same honesty applies to coverage. If the improvement landed on three of seventeen services, saying so up front removes the most obvious challenge to the claim. Candidates fear that the caveat shrinks the achievement. In practice it does the opposite: an interviewer who hears an unprompted limitation stops auditing and starts asking about the mechanism, which is the conversation you wanted. ## When the honest answer is that you do not know Sometimes there is no source, no artefact and no sound reconstruction. Say that, then say what you can support: what you changed, why it was slow before in mechanical terms, and how you would measure it if you were doing it again. That last part is the senior signal in the whole exchange — knowing what instrumentation you would put in first is worth more than any recovered figure.
- What was that number before you started, and how do you know?Worst-case drain time sat at 41 minutes, and I know because the queue exposed backlog age and we paged on it — the alert history has the runs in it. The nine minutes afterwards is continuous rather than sampled, since every run since the change is in the job log. If you want the typical run rather than the worst case I can give you that separately; I quote the worst case because it is the one that woke the on-call engineer.
- Suppose the dashboard retention had expired before you left. What would you have said instead?I would have reconstructed from something that still existed and named it as a reconstruction — alert timestamps or the incident timeline — and given a bound rather than a point value, such as above forty minutes on the runs I could still see. If nothing survived, I would drop the figure entirely and describe the mechanism plus the instrumentation I would add before attempting the work again.
- Is there a risk in volunteering that half your number is an estimate?The opposite, in my experience. The probe is coming regardless, and pre-empting it converts a potential retraction into a demonstration that I track my own evidence. The only real risk is estimating badly and saying so casually — the caveat has to come with the derivation attached, or it reads as a shrug rather than as rigour.
saying these in an interview costs you the question
- Quotes an impressive after-number and cannot source the baseline
- Produces a confident figure from memory with no derivation
- Smooths a measured value into a tidier-sounding one
- Treats the sourcing probe as an accusation and gets defensive
- Claims confidentiality to avoid explaining how a number was obtained