How do you tell an exploratory test charter is too broad, and how do you split it?
answer
- Can one session honestly finish it?
- Could you state coverage afterwards?
- Watch for "and" joining unrelated areas
- Split on a real dimension, not in half
- Too narrow means it was a check
basics
~20 sA charter is too broad when one uninterrupted session cannot finish it and the tester cannot say afterwards what was covered. Split it along a real dimension — sub-area, data condition, user role, quality attribute or recent change.
solid answer
~40 sThe working test is whether a single session can finish it honestly and produce a coverage statement. Signals that it cannot: the target names a whole subsystem rather than a behaviour, an "and" joins unrelated areas, the resources slot is empty, the information goal is plural and vague, or the same charter keeps coming back "partly done". To split, pick a dimension that makes each piece independently explorable: by workflow step, by data condition, by user role, by quality attribute, or by what changed recently. Each piece keeps the full three-slot shape; the original sentence stays as a backlog heading, not as something runnable. The opposite failure matters too — a charter finished in ten minutes with nothing left to vary was really a check and belongs in an automated suite.
go deeper
Be ready to spot the obvious oversize signals: a target that names a whole subsystem, an "and" joining unrelated areas, or an information goal that just says "issues". Practise rewriting one such sentence into two runnable missions.
Explain the mechanics: which dimensions you split along and why each produces independently explorable pieces, and how you handle the parent sentence afterwards. Expect to be given a broad mission and asked to split it out loud.
Show the production judgement — what you do when a session overruns, how you record the untouched remainder, and how right-sized charters accumulate into a coverage picture you can defend when someone asks what has actually been explored.
Own the tradeoff between granularity and overhead: fine charters give a precise ledger and cost more chartering and debriefing time, coarse ones cost less and report almost nothing. Be able to say where you set that dial for a given team and why.
## Why sizing is the hard part of chartering Writing a plausible-sounding charter is easy; writing one that a single uninterrupted stretch of testing can honestly finish is the skill. An oversized charter fails quietly: the tester works the whole time, produces notes, finds something — and cannot say what fraction of the target was touched. Over a few weeks that team has activity records but no coverage picture, and the areas nobody happened to wander into stay untested indefinitely. ## Signals that a charter is too broad - **You cannot state coverage at the end.** The clearest test. If the honest answer to "what did you cover?" is a shrug or a list of whatever happened to be interesting, the target was too big. - **The target names a subsystem, not a behaviour.** "Explore the appointment scheduler" is a heading; "explore waitlist promotion when a booked appointment is cancelled inside the notice window" is a target. - **An "and" joins unrelated areas.** "Explore booking and clinician rostering" is two charters that share a sentence. - **The resources slot is empty or generic.** "with the usual data" usually means the tester has not yet decided what varies, which means the scope is not yet decided either. - **The information goal is plural and vague.** "to discover issues" covers everything, so it bounds nothing. - **It keeps coming back.** A charter run in three sessions and still "partly done" was never a charter; it is a backlog heading pretending to be one. A concrete case: a four-person team chartered "Explore the scheduler for booking problems." The session ran 78 minutes and touched 3 of the 11 screens involved in booking. The notes were good, the finding was real, and the team still had no idea what the other 8 screens did — because nothing in the charter had ever committed to them. ## The axes you split along Splitting is not slicing the sentence in half; it is choosing a dimension that makes each piece independently explorable. - **By sub-area or workflow step** — booking, rescheduling, cancellation, waitlist promotion. - **By data condition** — clinics whose hours cross midnight; a 17-minute slot length that does not divide the session hour evenly; a patient with two active referrals. - **By user role** — what a receptionist, a clinician and a clinic administrator can each see and do against the same appointment. - **By quality attribute** — the same booking flow explored for accessibility, for behaviour under a slow network, or for what it discloses in error messages. - **By recent change** — the area a change landed in, explored against how it behaved before. Each split charter keeps the full three-slot shape. "Explore rescheduling with appointments already inside the 24-hour notice window, to discover waitlist promotions that skip an earlier claimant" is a session; the parent sentence it came from stays in the backlog as a heading, not as a runnable charter. ## The opposite failure A charter can be too *narrow*. If it is finished in twelve minutes with nothing left to vary, it was a check: the steps and the expected result were effectively known in advance, and the work would be cheaper and more reliable as an automated case. Two symptoms: the tester spends most of the timebox inventing extra scope that the charter does not mention, or the session notes read as a single pass/fail line. Merge such charters upward, or promote the fixed part into an automated check and charter the surrounding uncertainty instead. ## Sizing is a forecast, and forecasts get corrected You do not know the right size until you have run a few sessions on similar material, so treat the first estimate as provisional. When a session overruns its target, the useful response is to record what was actually covered, note the untouched remainder, and write the remainder up as its own charter — not to extend the session until the charter is "done". That habit is what converts a sizing mistake into a piece of planning information instead of an accounting hole. The reverse correction matters too: two charters that both finish early and keep bumping into each other's area should be merged, because the boundary between them was not real. ## What good sizing buys you Right-sized charters make exploratory work **countable** without making it scripted. Each finished charter is a statement of the form "this area, with these conditions, was explored for this risk", which composes into a coverage picture a team can reason about, argue with, and spot holes in. That is the entire practical case for chartering: not the sentence itself, but the honest ledger of targets that the sentence makes possible.
- A session overruns its charter. Do you extend the session or stop?Stop, and turn the mistake into planning information. Record what was actually covered, note the untouched remainder explicitly, and write that remainder up as its own charter. Extending until the charter is "done" destroys the one thing the timebox buys — a comparable, honest unit of coverage — and hides the fact that the sizing estimate was wrong, so the next estimate is no better.
- How do you know when two charters should be merged instead?When both keep finishing early and each session keeps drifting into the other's area, the boundary between them was not real. The same applies when one of them is finished in a few minutes with nothing left to vary. Merge them into a single session-sized charter, or, if the finished part was fixed steps with a known result, promote that part into an automated check and charter what remains uncertain.
- How do you get better at sizing charters?By comparing the estimate against what the session actually covered, repeatedly, on similar material. Sizing is a forecast that only calibrates with feedback, so the useful habit is recording the untouched remainder every time rather than quietly finishing late. Teams that do this converge within a handful of sessions; teams that treat the first estimate as a commitment never find out how wrong it was.
saying these in an interview costs you the question
- Splits a charter by cutting the sentence in half arbitrarily
- Extends the session until the oversized charter is finished
- Says a charter is fine as long as it names a real feature
- Thinks smaller is always better, down to single-step charters
- Cannot state what a finished session covered and what it left
- Keeps re-running the same "partly done" charter each release