skip to content

Before a bug bash, how do you prepare the build, the data and the area split?

level: middleimportance: should knowfreq 46%

answer

  1. The hour is expensive; setup is not
  2. Pin one build, block deploys
  3. Walk it yourself first
  4. Accounts and data already interesting
  5. Assign areas, publish known issues

basics

~10 s

Freeze one deployed build and block deploys for the window, seed an account and interesting data per role, carve the product into named assigned areas, publish known issues, and agree one capture format.

solid answer

~50 s

Preparation is what separates a bug bash from a wasted hour of twenty salaries. Pin the build: one version, deployed to an environment nobody will redeploy during the window, smoke-checked by the organiser beforehand so a broken login or an intermittent timeout does not become everyone's finding. Seed accounts per role with passwords handed out in advance, and seed data that is already in interesting states rather than empty. Split the product into named areas — roughly one per participant, weighted towards recent change and risk — and hand each person their area plus a fallback if theirs turns out thin. Publish the known-issues list so people do not spend the window refiling what is already open. Fix the capture format and the channel, name a duplicate-watcher, and set the start and stop times explicitly. Reserve time after the event for sorting, and say so up front.

go deeper

for a junior

Remember the checklist you would want as a participant: a working login, data that already exists, a named area to cover, a place to file, and a stated stop time. Being able to list those is enough here.

for a middle

Be ready to explain each preparation step and the failure it prevents — deploys frozen so findings are reproducible, seeded roles so permission edges get probed, an assigned split so the crowd does not converge on the home screen.

for a senior

Show the operational instincts: smoke the build yourself first, have a fallback environment, put someone on access problems so they do not eat your window, and stop the event outright rather than collect reports against a broken environment.

for a principal

Frame it as a spend. Twenty-three people for ninety minutes plus the sorting afterwards is real money, so be explicit about what preparation buys, who owns the aftermath, and the conditions under which you would postpone rather than run it.

## The preparation is the event A bug bash looks improvised from the outside and is not. Every minute the participants spend on setup, access or confusion is a minute of a scarce, expensive, simultaneous window that will not come back. Preparing well means having four things ready — the build, the data, the areas, the channel — plus one thing that is nearly always forgotten, which is time booked for the aftermath. ## 1. A pinned, smoke-checked build Name one version and one environment. Block deploys for the window and tell the people who might deploy, in writing, that they are blocked. Then use it yourself for twenty minutes beforehand and walk the main flows. The reason for the walk-through is specific. On a warehouse stock ledger, imagine the stock-adjustment save intermittently timing out under load — it succeeds most of the time and hangs for a few seconds otherwise. With twenty-three people saving adjustments at once, that intermittent timeout becomes the loudest signal in the room: a dozen near-identical reports, several participants convinced the whole environment is down, and a general belief that the build is rubbish. One person's warm-up pass catches it, and then you either fix it, restrict the area, or post it as known and tell everyone in the briefing. The rule is simple: **any defect the organiser already knows about must be visible before the doors open**, because a crowd rediscovering it costs more than it is worth. ## 2. Seeded accounts and interesting data Hand out credentials in advance. A single shared account for twenty-three people is a false economy: people collide on the same record, and one person's edit becomes another person's mystery. Seed one account per role — picker, stock controller, auditor, read-only viewer — with the role differences that matter, because permission edges are one of the areas a mixed crowd genuinely probes well. Seed the data into states that took real setup to reach: a location holding 1,438 units, a purchase order received in part, a stock count that ended out of balance, a record in a locale whose decimal separator and date order differ from the default. Empty data means everyone spends the first fifteen minutes creating records, and creating records is one narrow slice of the product. ## 3. The area split Carve the product into named areas — not features in a backlog sense, but places a person can be sent: receiving, put-away, adjustments, stock counts, transfers, reporting, permissions, search, settings. Aim for roughly one area per participant, weighted so recently changed and higher-risk areas get more than one pair of eyes and static areas get none. Assign explicitly rather than letting people choose. Left to themselves, crowds converge on the home screen and the newest feature, and the reconciliation report gets nobody. Give each person a fallback area for when theirs is exhausted after twenty minutes, and be relaxed about people wandering in the last stretch — the split is there to prevent the default failure mode, not to imprison anyone. ## 4. One channel and one format Decide before the start where reports go and what a report minimally contains: a one-line title in an agreed shape, the area tag, the account used, and enough to find it again. Keeping the capture bar low is deliberate — during the window you want observations flowing, and the detailed investigation of any individual finding is work for afterwards, done by someone who can do it properly. Name one person who is not hunting at all and whose whole job is watching the channel for duplicates and asking for the one missing detail while the reporter is still at the keyboard. ## 5. The briefing and the aftermath Spend five minutes at the start on: what the build is, what is in scope, what the known issues are, what the areas are, where reports go, when you stop. Say explicitly what is *not* wanted — for example, cosmetic wording opinions on a screen that is about to be redesigned — otherwise you will get thirty of them. Then book the aftermath. Sorting a pile of a hundred-plus raw reports takes hours, and if nobody owns it, the pile rots and attendance at the next bug bash falls. A common failure is to book ninety minutes of twenty-three people's time for the hunt and zero minutes of anybody's time for what follows. ## Warm-up and logistics Small things that repeatedly matter: check that new participants can actually log in the day before, not at the start; have a helper on standby for access problems so they do not eat the organiser's window; provide a short crib of unfamiliar domain vocabulary for visiting participants; and if people are remote, use a channel that keeps history rather than a call where findings are spoken and lost.

  • Why publish a known-issues list before a bug bash starts?
    Because a crowd will rediscover every open defect, and each rediscovery costs the reporter's time, the duplicate-watcher's time and the sorter's time afterwards while adding nothing. Publishing the list also protects the event's credibility: participants who see their careful report closed as a duplicate of a six-week-old ticket are less likely to attend the next one.
  • How would you weight the area split when time is short?
    Towards recent change, known-fragile areas and anything customer-visible on the critical path; away from stable areas that have not been touched. Give the highest-risk areas two participants with different backgrounds rather than one, and accept that some low-risk areas get nobody — a split that covers everything thinly reproduces the weakness of a shallow sweep.
  • What do you do if the build breaks fifteen minutes into the window?
    Stop the hunt rather than let people file noise. Announce it in the channel, get the environment back or fall back to a second prepared environment, and extend or reschedule. Reports filed against a broken environment are almost all worthless and they contaminate the pile, which costs more than the lost minutes.

saying these in an interview costs you the question

  • Lets deploys continue during the bug-bash window
  • Gives everyone one shared account and empty data
  • Never smoke-checks the build before the doors open
  • Lets participants pick their own areas freely
  • Skips the known-issues list, so duplicates flood in
  • Books time for the hunt but none for sorting afterwards

context