skip to content

An invoice workflow's owner will add a standing rule forbidding direction from supplier email — what do you tell them?

level: principalimportance: nice to knowfreq 27%

answer

  1. what does the patch actually buy
  2. rules about instructions, spans about facts
  3. one span retested is not a class closed
  4. the payoff is the unreviewed filing

basics

~20 s

Tell the owner what the rule buys: spans shaped as commands get costlier. It does nothing about spans shaped as facts, since reading correspondence as fact is the run's job. Then settle who owns the residual.

solid answer

~40 s

Separate three things. First, what the addition buys: spans shaped as commands get more expensive to draft — real, but that family already performed worst. Second, what it cannot buy: the spans that carry never present as direction, and the run cannot separate a counterparty's assertion of fact from a premise planted to redirect the task, because that separation does not exist in prose. Third, the actual decision — where the finding lives. The payoff is a verdict filed unreviewed into the system of record and treated downstream as already checked, and no wording in the preamble touches that. So the owner of the unattended filing path carries the residual, not the prompt author. And say what may be claimed: re-testing your span and seeing it fail closes that span, not the class.

go deeper

for a junior

Understand that changing the wording of a run's instructions can stop one demonstrated span without changing the underlying situation.

for a middle

Be ready to explain why a rule about instructions has no grip on text that reads as fact, and why the run cannot tell the two apart when reading correspondence is its job.

for a senior

Show that you would state the claim boundary explicitly — what may and may not be said after the change — and that you would not accept a single re-run of one span as verification.

for a principal

Own the allocation. Say which owner the residual belongs to, price the cheap and the expensive options side by side at filing time, and make sure an accepted risk is accepted by someone with the standing to accept it.

## What is actually being proposed The run restates the buyer's standing routing and approval rules at the top of every execution. The owner wants one more line among them, to the effect that correspondence is not a source of direction. It is a cheap change, it can ship today, and it will make the demonstrated span stop working. All three of those are true, and none of them is the question. ## What the addition buys, stated precisely It raises the drafting cost of spans that address the model and ask it to act. Those are the crude family — the one most heavily represented in refusal training and in screening corpora, and the one that already performed worst. Making the weakest construction weaker is a real gain and should be reported as one, but it is a gain against the part of the distribution that was already covered. ## What it cannot buy, and why The construction that beat the earlier orders never presented as direction. It presented as content: an assertion about the transaction from which a different task followed. A rule about instructions binds text that reads as instructions. It has no grip on text that reads as fact, and the run cannot tell the two apart, because separating them is not a property of prose — the workflow exists to read supplier correspondence as fact, and stripping that would remove the feature, not the flaw. The honest way to put this to an owner is as a claim boundary. After the change they may say: the crude shape now costs more. They may not say: the workflow no longer takes direction from email. If a stakeholder further downstream will hear the second sentence when you say the first, that is a communication risk to manage, not a detail. ## Where the finding actually sits The payoff in this class is not a leaked secret. It is the filed verdict — a routing or approval decision written into the system of record by an unattended run, which every later reader treats as already checked because a machine signed it, and which no prompt wording touches. That property was created by the decision to run the routine path unattended and to let its output inherit the credibility of a checked decision. So the adjudication is about ownership. The prompt text is owned by whoever writes the run's preamble; the residual risk is owned by whoever owns filing unreviewed verdicts and by whoever consumes them downstream. Routing the finding to the prompt author closes a ticket and moves nothing, and that misallocation is the most common organisational outcome of this class — the cheapest owner is the one who gets it. Say plainly which changes are cheap-and-narrow and which are expensive-and-structural, price both, and let the person who can authorise the expensive one make that call rather than making it for them by silence. ## What re-testing proves Expect to be shown, in a week, that the reported span no longer works. That is evidence about one construction. It is not evidence that the class is closed, for two reasons: the class is defined by a property of the pipeline rather than by any string, and adherence is probabilistic, so a construction can fail a re-run it would have passed on a different day. A verification that consists of re-running the one artefact in the report is the weakest form of evidence available, and a lead should say so before it is presented as closure. ## What a red-team programme should carry away Two standing positions are worth holding. First, a finding whose remedy is a wording change should be reported with the wording change already priced, so nobody mistakes the cheap fix for the scope of the problem. Second, when the payoff of a class depends on an output being treated as authoritative, the durable question is who is entitled to treat it that way — and that is a governance answer, not a prompt answer. Both belong in the report at the time of filing, because after the cheap change ships, the appetite for the expensive conversation is gone.

  • They re-ran your span after the change and it failed. What may they claim?
    That this span now fails, on the runs they measured. Not that the class is closed: the class is a property of a pipeline that reads correspondence as fact, not a property of one string, and adherence is probabilistic enough that a single re-run proves little either way. Ask what rate they measured and over how many runs before treating it as verification.
  • Who should the finding be assigned to?
    Whoever owns filing an unreviewed verdict into the system of record, and whoever downstream treats those verdicts as checked. The prompt author can make the crude shape more expensive and nothing more. Assigning it to the cheapest owner is how this class quietly stays open, so name the expensive owner explicitly even when the expensive change will not be funded.
  • Is it worth reporting at all if the only realistic change is expensive?
    Yes, but report it as a design property with a price attached rather than as a defect awaiting a patch. The value to the organisation is an informed decision about an unattended path, and that decision can legitimately be to accept the risk — what is not legitimate is accepting it without anyone having been told what was accepted.

Adding a rule against being told what to do does nothing about being told what is true.

saying these in an interview costs you the question

  • Accepts a wording change as closing the class
  • Assigns the finding to whoever owns the prompt text
  • Treats one re-run of one span as verification
  • Claims the workflow no longer takes direction from email
  • Reports the expensive option only after the cheap one shipped

context