skip to content

How do you decide whether publishing a scenario suite as the specification of record is worth its cost?

level: principalimportance: should knowfreq 40%

answer

  1. Who opens it, and why?
  2. Generation is cheap, wording is not
  3. Look for links and telemetry
  4. Narrow the scope before deleting
  5. An artefact with no owner rots

basics

~20 s

Establish a named audience with a recurring question first, then gather readership evidence over time. Generation is cheap; keeping every scenario worded for outsiders forever is the real cost, so narrow the published scope to where a reader actually exists.

solid answer

~50 s

The generator is a day of work; the cost is the permanent obligation to keep hundreds of scenarios worded for someone who does not know the codebase. So I start with the beneficiary: which named group, asking which recurring question, opens this artefact? 'Stakeholders' is not an answer. Then I gather evidence — access telemetry for unique readers rather than page loads, whether runbooks, incident write-ups or onboarding material link to it, and whether questions arriving at the team are ones the document already answers. The wider claim is contested; there is practitioner experience but no strong published evidence, so I would not quote a benefit figure. Most good outcomes are in the middle: publish only the regulated or partner-facing areas, keep a curated index above the generated pages, or drop the business-readable obligation and publish internally. And name an owner, because an ownerless published artefact eventually misleads.

go deeper

for a junior

Understand that publishing scenarios for outside readers imposes a wording standard the team pays for on every change, and that it only makes sense when somebody outside the team reads the result.

for a middle

Be able to describe the recurring cost concretely: reviewing scenario wording, keeping domain vocabulary consistent, and resisting incidental detail creeping in whenever delivery is under pressure.

for a senior

Bring evidence rather than opinion — readership telemetry, inbound links, the questions the team still gets asked — and be ready to propose narrowing the published scope instead of defending the whole artefact.

for a principal

Own the call and its reversal. Set the audience test, choose between narrowing, downgrading the register and withdrawing, name the owner, and put a date on re-checking rather than letting inertia decide.

### The decision, framed honestly Publishing a scenario suite as the specification of record is not a technical step — the generator is a day of work. The cost is the *ongoing discipline* it obliges: every scenario has to stay worded for a reader who does not know the codebase, forever, under delivery pressure. That cost is paid by the team on every change. The benefit is paid to somebody else, later, and only if that somebody actually opens the document. A lead's job is to establish that the beneficiary exists before committing the team to the cost. ### Establish the audience first Ask who, concretely, is supposed to read it, and what question they bring. Real answers look like: a support group that needs to know what the system promises before escalating; a compliance or audit function that must show a control is demonstrated; a partner team integrating against your behaviour; a new joiner learning the domain; a product owner checking what was actually agreed. Unreal answers look like "stakeholders" and "the business" with no named person and no recurring question. If no named audience survives the question, the honest conclusion is that the scenarios are still worth having as executable checks, but publishing them as a specification is decoration. That is a perfectly good outcome to argue for, and arguing for it is a stronger interview answer than a reflexive yes. ### Get evidence, then keep getting it Readership is measurable, cheaply and imperfectly: - Access telemetry on the published artefact — unique readers, not page loads, and which pages. - Whether anything links to it: incident write-ups, onboarding material, support runbooks, ticket comments. - Whether questions arriving at the team are ones the document answers. If people keep asking the team what happens on a cache expiry, and the document says, the document is not reaching them. - Direct ask, once or twice a year, of the named audience. Treat all of this as a signal, not a verdict. A low-traffic document consulted twice a year by an auditor may be worth more than a high-traffic one skimmed by nobody with a decision to make. But a document with no readers, no inbound links and no questions answered has failed, and continuing to pay its wording tax is a choice you should make deliberately rather than by inertia. Be candid that the wider claim here is contested. There is no strong published evidence that publishing generated specifications improves outcomes; what exists is practitioner experience. Asserting a benefit number would be inventing one. ### The middle options, which is where most good answers land The choice is not publish-everything or publish-nothing. **Narrow the scope.** Publish only the areas with a real external audience — the regulated flows, the partner-facing contract — and let the rest of the suite be automation the team reads. This collapses most of the wording cost while keeping the benefit where it lands. **Curate a layer above.** Publish a small hand-written index that frames the domain and links into the generated pages. The framing does not have to be generated to be useful; the *behaviour claims* do. **Downgrade the register.** Keep publishing internally for the team and adjacent engineers, drop the obligation that it read as a business document, and stop paying for the translation. **Stop, and say so.** Withdraw the artefact, tell the audience it is gone, and see who complains. That is a real experiment and takes about a month. ### The preconditions worth naming Whichever way the decision goes, some conditions have to hold for publishing to be viable at all: a shared domain vocabulary stable enough that the prose survives a quarter; scenarios written declaratively enough to read as statements about the domain; a named owner for the published artefact, because ownerless artefacts rot; and provenance on the document, so a reader can tell which revision it describes. Without an owner in particular, the decision to publish quietly becomes a decision to publish something misleading eighteen months from now. ### A worked example A four-person team owning a parcel-tracking gateway published their scenario report for two years. Telemetry showed 37 unique readers in the last twelve months, 29 of them in the two weeks around a partner integration, and nothing at all from the support group the artefact was originally justified by. Their conclusion was not "delete it": it was to narrow publication to the partner-facing status and tracking behaviour, drop the business-readable obligation on the internal payment-reconciliation scenarios, and re-check in six months. That is the shape of a good answer — evidence, a narrowed scope, and a date to look again. ### How to answer well Name the audience test first, then the evidence you would gather, then the middle options, then the preconditions. Say explicitly that the generation is cheap and the wording discipline is what costs. Refusing to give a blanket yes or no, and instead describing what you would measure and what you would do with each outcome, is the whole point of the question.

  • What is a cheaper option when only one regulated area has an external audience?
    Publish that area alone. Keep the business-readable discipline on the regulated flows, let the rest of the suite be automation the team reads in whatever register suits it, and say plainly in the artefact which areas it covers. This keeps almost all the benefit and collapses most of the recurring wording cost.
  • Who should own a published specification artefact, and what happens without an owner?
    A named person or role on the delivering team, accountable for the wording standard, the provenance stamp and the publish gate. Without one nobody notices when the register slips or the artefact starts describing a stale revision, and it degrades into something that misleads readers who still trust it.
  • How would you run an experiment on whether anyone needs the published document?
    Withdraw it for a defined period, tell the named audience it is gone and where to ask instead, and count what comes back. A month is usually enough. It is a real signal precisely because it costs nothing to reverse, and silence is informative rather than merely disappointing.

It is like maintaining a public showroom for a workshop. Building the showroom is a weekend; keeping every item labelled for visitors is forever, and it is only worth it if visitors actually come through the door.

saying these in an interview costs you the question

  • Justifies publishing with 'the business' and no named reader
  • Quotes a benefit figure as if the evidence were settled
  • Treats the choice as publish everything or publish nothing
  • Assumes generating the artefact is where the cost lies
  • Leaves the published artefact without a named owner
  • Keeps publishing for years without ever checking readership

context