skip to content

As the owner of a bug bar, how do you keep fix deadlines and the ship gate credible under launch pressure?

level: principalimportance: nice to knowfreq 33%

answer

  1. agreed before the argument starts
  2. clocks derived from real capacity
  3. a gate that fires rarely is believed
  4. acceptance belongs to an accountable owner
  5. amend the bar in calibration, not mid-fight

basics

~20 s

Agree the bands, clocks and gate before any finding exists, keep the gating set small enough that a block is believable, route acceptance to an accountable business owner rather than the security engineer, and change the bar only in scheduled reviews, never mid-argument.

solid answer

~50 s

Credibility comes from commitments made in advance. First, the definitions and clocks are agreed before the argument starts — a bank running 7 / 30 / 90-day fix clocks per band settles that in a calibration review, not in the week of a regulated launch. Second, the gating set is deliberately small: if every band blocks a release, the gate gets routed around and stops meaning anything, so I gate Critical hard and track the rest honestly. Third, the escape hatch is explicit and it is not mine — a business owner accountable for the outcome accepts the risk, in writing, with an expiry, and the engineer stops arguing severity. I also keep a floor: on a product with a safety consequence, that band is non-negotiable. Then I measure on-time fix rate per band, and recalibrate the bar in scheduled reviews, never mid-argument.

go deeper

for a junior

Know the shape of the answer: the bands and deadlines are agreed in advance, and shipping with a known High is a business decision someone signs for, not a debate the engineer who found it has to win.

for a middle

Be able to explain why fix clocks must reflect what teams can actually deliver, and why gating every band makes the gate meaningless. Knowing that severity and gating are separate columns is the key mechanic here.

for a senior

Demonstrate you have operated this: clock start rules, the accountable acceptance with an expiry, and the gaming patterns you watch for near ship dates — band drift, appeals that only go down, reopened findings with fresh clocks.

for a principal

Own the strategy: which consequence class you will never trade, how the bar gets co-signed by engineering leadership so it is not security's private document, what data drives recalibration, and how you change the rules without appearing to lose an argument.

## The pressure is the point A bug bar that has never been tested by a deadline has not been tested. The whole artifact exists for the week when a High lands on a feature the company has already announced. Everything below is about making that week boring. ## Set the clocks so they can actually be met Per-band fix deadlines — a bank might run 7 days for Critical, 30 for High, 90 for Moderate — are commitments, and a commitment nobody meets is worse than no commitment, because it teaches the organisation that the bar is decorative. Two disciplines keep them real: - **Derive the clock from observed capacity**, not from aspiration. If the last four quarters show Highs closing in a median of 45 days, a 14-day clock is a lie you are writing down. - **Measure and publish** on-time fix rate per band and the age distribution of open findings. This is the evidence that either defends the bar or tells you to change it. The clock also needs a defined start: normally when the band is assigned, not when someone gets around to triaging it, or the clock becomes a queue-management tool. ## Keep the gating set small Severity and gating are separate columns for a reason. The temptation is to make every band block something, on the theory that this maximises safety; the actual effect is that the gate fires constantly, leadership learns to override it, and the override becomes routine. A gate that blocks rarely and absolutely is worth more than one that blocks often and negotiably. In practice: Critical blocks the build unconditionally; High blocks a major release but not a patch; everything else is tracked against its clock. ## Route acceptance away from the security engineer When the pressure arrives, the wrong conversation is "is this really a High?" and the right one is "who is accepting the consequence of shipping with a known High, and for how long?". Design the bar so that: - The band itself is not up for negotiation, because it is a lookup against pre-agreed rows. - Shipping anyway is a **business decision made by a named accountable owner**, recorded, with an expiry date and a fix commitment attached. - The security engineer's job in that meeting is to state the exposure accurately, not to defend a number. This single separation is what stops severity inflation and deflation both: nobody needs to game the band, because the band is not the lever. ## Keep a floor that never moves Some consequence classes should not be tradeable at all. An agricultural-sprayer autonomy vendor whose products drive themselves through a field can reasonably carry a separate safety band — say, anything that lets someone with maintenance or physical access alter spray-rate or boundary limits — and write into the bar that this band has no acceptance path and no schedule override. The value is not the specific rule; it is that the organisation decided, in the calm, which category it will never trade, so nobody has to win that argument in the heat. ## Change the bar deliberately, never mid-argument The most corrosive failure is amending the bar to resolve the finding in front of you. If the rows are genuinely wrong, that is real information — but the change lands in the next calibration review and applies to future findings. Otherwise the bar becomes a record of who was under the most pressure and when. A workable cadence: review the bar quarterly or per major release, with security and engineering leadership jointly signing it, using three inputs — findings that matched no row, bands that were repeatedly contested, and the on-time fix data. ## What gaming looks like Watch for these, because they are how a bar dies quietly: - **Band drift near release dates.** Compare the band distribution of findings raised in the last two weeks before a ship date against the rest of the quarter. A visible shift downward is a process finding, not a coincidence. - **Reclassification on appeal**, where the second opinion is always the lower one. - **Clock laundering**, where a finding is closed and immediately reopened as a new one, resetting the deadline. - **Scope narrowing**, where the finding is re-described as affecting a component the bar rates lower. - **Permanent acceptances**, where the expiry date is never enforced and the exception becomes the design. ## Shared ownership A bar that security wrote alone is security's document, and it will be treated as an external tax. The version that survives is co-signed by engineering leadership and, for regulated products, by whoever answers to the regulator — because on the day the clock is inconvenient, the people defending it need to include the people who would otherwise be arguing against it. ## The interview signal This is a judgment question with no single right answer, and the answer that lands has four moves in it: pre-agreement, a small and absolute gate, acceptance routed to an accountable owner with an expiry, and measurement that feeds a scheduled recalibration. A candidate who answers only "hold the line" has not run one of these; a candidate who answers only "be pragmatic" has not defended one.

  • How would you detect that teams are quietly gaming the bar as deadlines approach?
    Compare the band distribution of findings raised in the two weeks before a ship date with the rest of the quarter; a downward shift is a process signal. I would also track appeals and their direction, findings closed and immediately reopened as new ones with a fresh clock, and re-descriptions that move a finding onto a component the bar rates lower. Each is cheap to measure and hard to argue with.
  • The bar turns out to be genuinely wrong about a class of flaw. When do you change it?
    In the next calibration review, applying to future findings — not to resolve the argument currently in front of you. Changing the rules mid-dispute is indistinguishable from losing the dispute, and it teaches everyone that pressure edits the bar. I would fix the current finding on the existing row, record it as evidence for the change, and bring it to the review with the other mismatches.
  • Should every severity band block a release?
    No. Gating everything makes the gate routine to override, and an override that happens every release is not a gate. I would rather have Critical block the build unconditionally, High block a major release, and lower bands tracked hard against their clocks. Scarcity is what makes a block credible, and credibility is the only enforcement mechanism a bar actually has.

It works like a fire door: useful precisely because the decision to install it was made when nothing was burning, and worthless the first time someone is allowed to prop it open for convenience.

saying these in an interview costs you the question

  • Answers only hold the line, with no accountable acceptance path
  • Amends the bar to settle the finding currently being argued
  • Makes every band block the release until overrides become routine
  • Sets fix clocks no team has ever met, then ignores the misses
  • Leaves the security engineer to personally veto a launch
  • Grants acceptances with no expiry date or fix commitment

context