skip to content

Where do new exploratory test charters come from, and how do you keep a charter backlog useful?

level: seniorimportance: nice to knowfreq 26%

answer

  1. Several sources, each blind differently
  2. Sessions themselves stock the list
  3. Write the new one, do not chase it
  4. Hygiene is mostly subtraction
  5. Finished column is the coverage record

basics

~20 s

Charters come from recent changes, unusual data shapes, user roles, quality attributes, field and support signal, and above all from findings in earlier sessions. Keeping the backlog useful is mostly subtraction: retire stale entries, merge duplicates, keep each session-sized.

solid answer

~50 s

Stock the backlog from several sources deliberately, because each is blind to different risks: unease about a complex or single-owner area, anything that changed recently, unusual data shapes, each user role that touches a workflow, quality attributes such as error handling or degraded dependencies, clusters of field and support reports, and areas where nobody can state correct behaviour. The richest source is exploration itself — when a session bumps into a second question, the discipline is to write a new charter rather than chase it and lose the coverage statement for the current one. Keeping the backlog useful is mostly subtraction: retire entries written against a design that no longer exists, merge overlapping targets, split entries that have drifted into headings, and record finished charters, since that record is the only coverage evidence unscripted testing produces.

go deeper

for a junior

Be ready to name a few places charters come from besides the specification — recent changes, unusual data, each user role — and to say that a finding in one session often becomes a charter for the next.

for a middle

Explain why multiple sources are used rather than one, and describe the discipline of writing a spawned charter instead of chasing the finding mid-session. Know what a stale or duplicated backlog entry looks like.

for a senior

Show that you maintain the thing: retire, merge and resize entries, keep the finished column as the coverage record, and notice when re-run charters have silently become a manual regression pack that belongs in automation.

for a principal

Own the health of the practice across teams: a backlog of honest, session-sized entries is what makes exploratory work legible to planning, and its absence is why exploration decays into repeatedly poking the same three comfortable areas.

## The backlog as the memory of exploration A **charter backlog** is the running list of missions a team has decided are worth a session but has not run yet. It is the thing that makes exploratory testing survive contact with a real schedule: without it, chartering happens fresh each morning, driven by whatever is loudest, and the areas nobody remembers stay unexplored. With it, the team can see what it intends to explore, what it has explored, and where the gaps are. ## Where charters come from Good backlogs are stocked from several sources deliberately, because each source is blind to different risks. - **Areas the team is uneasy about.** Complexity, churn, a component one person owns alone, a part everyone avoids. Unease is not evidence, but it is a reliable *pointer* to where evidence is missing. - **Recent change.** Anything that landed since the last exploration of that area, explored against how the area behaved before. - **Feature and data shape.** A workflow, or a class of data that stresses assumptions — records at boundaries, records with unusual shapes, records created by an older version of the system. - **User role.** The same area explored as each kind of user who touches it, which surfaces permission and visibility problems that a single-role pass never sees. - **Quality attributes.** The same area explored for accessibility, for error handling, for behaviour under degraded dependencies, for what it discloses when it fails. - **Field and support signal.** Clusters of reported problems, repeated support questions, and past defects, which point at areas where the team's model of the system is known to be wrong. - **Specification gaps.** Places where nobody can say what correct behaviour is. A charter aimed at producing that answer is often worth more than one aimed at finding a defect. ## Charters spawned by findings The most valuable source is the sessions themselves. A session is chartered against one question and routinely bumps into a second one, and the discipline is: **write the new charter, do not chase it now.** Chasing costs the coverage statement for the current charter and produces a set of notes about two half-explored areas. A concrete case: on a hospital appointment scheduler, a four-person team ran a session on rescheduling and hit a schema-drift mismatch — the clinic-hours payload had changed shape between two service versions, so one side read a field the other no longer sent, and appointments quietly kept the old duration. The tester recorded the finding, finished the rescheduling charter, and left the backlog two new charters: one exploring every consumer of that payload for the same drift, one exploring what the system does with records written under the older shape. Neither existed the day before; both are now higher-value than most of the 23 charters already on the list. ## Keeping it useful A backlog rots in predictable ways, and the hygiene is mostly subtraction. - **Retire stale charters.** A charter written against a design that no longer exists is noise. Anything that has sat untouched for a long time gets re-read and either rewritten or deleted. - **Deduplicate.** Two charters whose targets and information goals overlap should be merged, or the boundary between them made explicit. - **Keep them session-sized.** Backlog entries drift into headings over time; a heading must be split before it can be run. - **Record what has been run, not just what is pending.** The backlog's value is as much in the finished column — it is the only coverage record unscripted testing produces. - **Do not let it become a regression checklist.** When the same charter is re-run verbatim every release and finds nothing, its information goal has been answered; the repeatable part belongs in an automated check and the charter should be rewritten around what is still unknown. - **Keep it small enough to read.** A backlog nobody reads is not steering anything; if it has grown past what the team can review in one sitting, that is a signal to retire, not to file. ## Ordering, and where that decision lives Choosing which charter runs next is a planning conversation, not a property of the backlog, and it belongs with whoever owns release-level prioritisation. What chartering owes that conversation is a backlog whose entries are honest: each one session-sized, each one naming the information it would produce, so the cost and the payoff of running it are both legible. A backlog of vague headings cannot be prioritised by anyone, however good the prioritisation process is. ## Why interviewers ask It separates candidates who have *heard of* exploratory testing from those who have sustained it. A practice with no backlog collapses back into ad-hoc poking within a couple of releases, and the symptom is always the same: plenty of session notes, no coverage picture, and the same three comfortable areas explored over and over.

  • A session hits something interesting that is outside its charter. What do you do?
    Record enough to reproduce it, write a new charter for the wider question, and finish the current mission. Chasing it immediately costs the coverage statement for the charter you are on and leaves two half-explored areas with entangled notes. The exception is when what you found makes the current charter meaningless — for example the area is broken enough that nothing else can be exercised — in which case you stop, say so, and recharter.
  • The same charter has been re-run verbatim every release for a year and finds nothing. What does that tell you?
    Its information goal has been answered, and it has quietly become a manual regression checklist. The repeatable part should be written down once as an automated check, and the charter rewritten around what is still genuinely unknown in that area — or retired. Re-running answered questions consumes exactly the session time that unexplored areas need.
  • How do you keep a charter backlog from becoming an unread dumping ground?
    Cap it by attention rather than by ambition: if it has grown past what the team can re-read in a single sitting, the response is retirement, not filing. Re-read entries periodically and delete anything written against a design that no longer exists, merge overlapping targets, and split entries that have drifted into headings. An unread backlog steers nothing, whatever it contains.

saying these in an interview costs you the question

  • Sources every charter from the requirements document alone
  • Chases an out-of-scope finding and abandons the current charter
  • Lets the backlog become a manual regression checklist
  • Never retires charters written against a design that changed
  • Records only pending charters, never the finished ones
  • Treats backlog size as evidence of good test coverage

context