skip to content

Outputs and Non-Goals

A model's deliverables are owned findings, security requirements, abuse test cases and a corrected diagram - not a report. Interviewers ask because many sessions change nothing.

on this pageshow

questions

3

What concrete artifacts should a threat modeling session hand back when it ends?

level: middleimportance: must knowfreq 66%

answer

  1. judge a session by what leaves the room
  2. four artifacts, each with a consumer
  3. every finding carries a person's name
  4. constraints on unbuilt work count too
  5. the picture leaves corrected

basics

~20 s

Findings that each name a person who owns them, security requirements written into the work being built, abuse test cases for the threats worth exercising, and a diagram corrected to match how the system actually works.

solid answer

~40 s

A session should end with four things, each with a real consumer. First, findings: specific statements of what could go wrong with this design, each attached to a named engineer rather than to "the team". Second, security requirements — constraints the build must satisfy, phrased so they land inside the normal story rather than in a separate security document. Third, abuse test cases: things someone should deliberately try against the system, captured while everyone is still thinking like an attacker. Fourth, the corrected diagram, because the picture you started with is always wrong somewhere and fixing it is half the value. Notice what is absent: a pass/fail verdict, and a list of confirmed exploitable vulnerabilities. A model asserts what could go wrong in a design; it does not demonstrate that anything currently is wrong.

go deeper

for a junior

Be able to name what leaves the room: findings with owners, security requirements, abuse test cases, and the corrected diagram. Knowing that the session ends in artifacts rather than a report is most of the point at this level.

for a middle

Explain what each artifact is for and who consumes it, and articulate the difference between a finding about the design as it stands and a requirement on work not yet built. Be clear that no output is a confirmed vulnerability.

for a senior

Show you run sessions that actually produce these. Expect to describe how you get a name onto every finding before the meeting ends, and how you answer a sponsor who wanted a vulnerability list instead.

for a principal

Own the argument for why outputs are the contract of the practice. Be ready to explain how you would tell a healthy programme from a theatrical one by inspecting artifacts alone, and what you change when only diagrams survive.

### Why the outputs are the whole point A threat modeling session is an analysis of a design, done before or alongside the build. Its value is realised only if something downstream changes because of it. So the useful way to judge a session is not "did we talk about attacks for ninety minutes" but "what did we hand back, and who is going to do something with it". A model whose output is a document filed by the security team has produced nothing. ### The four artifacts **1. Findings, each with a named owner.** A finding is a concrete statement of something that could go wrong with the design as proposed, written specifically enough that a reader who was not in the room can act on it. The part teams skip is the name. "The team should look at the duty-rate override path" is a wish; "Ana owns the override path finding" is work. Ownership at the moment the finding is written is what separates outputs from minutes. **2. Security requirements.** Not everything a model produces is a defect. Much of it is a constraint on something that has not been built yet, and it belongs in the description of the work: "a duty-rate override must be rejected unless the principal holds the customs-supervisor role, and every attempt must be recorded whether it succeeds or fails". A finding says something is wrong now; a requirement says what must be true when the feature is done. Confusing the two is why models aimed at unbuilt features feel like they produce nothing. **3. Abuse test cases.** During the session the group has spent an hour thinking about what an attacker would try, which is exactly the raw material testers rarely have. Capture it as things someone should deliberately attempt — submit a declaration for a consignee the broker does not represent, replay a filed declaration with a lower duty rate, correct a declaration after the filing window closed. Turning those into acceptance criteria and automated negative tests is a separate downstream step; the model's job is to write down the attempts while the reasoning is fresh. **4. The corrected diagram.** The picture the team brings to the session is always wrong somewhere: a queue nobody drew, a batch job that reaches straight into the database, an assumption that a call is internal when it crosses a network the team does not control. The diagram that leaves the room is different from the one that entered, and that corrected shared picture is frequently the longest-lived artifact of all — teams still use it long after the findings have been closed or forgotten. ### Vocabulary that keeps the outputs honest - A **threat** is what could go wrong: an attacker in some position doing something to an asset. - A **vulnerability** is the specific flaw that would let it happen. - A **risk** is the rated consequence of that happening. - A **control** is what you do about it. A threat model deals mainly in threats and controls. It may hypothesise vulnerabilities, but it does not confirm them; it may motivate a rating, but rating is a separate step with its own method. ### What is not an output - **A verdict.** "The design passed threat modeling" is not a thing. There is no pass state, because the exercise is not a test. - **A confirmed vulnerability list.** Sponsors ask for this constantly. On a freight-forwarding customs-declaration service, a model might hand back exactly three findings, two security requirements, one abuse case and a redrawn diagram, while the sponsor keeps asking where the vulnerability list is. The honest answer is that the model reasons about a design, not about a running build, and the list they want comes from testing that build. - **An assurance statement**, and **an organisation-level risk register**. Individual threats may feed those instruments, but the model is neither of them. ### How outputs decay, and what that tells you A genomics research data-sharing platform ran a serious session and wrote the results as prose: paragraphs describing how a partner institution could reach further into the platform than intended. Six months later the only artifact anyone still used was the corrected data-flow diagram. The prose had no owners, so nothing pulled it into anyone's week. The diagram survived because it was directly useful to whoever opened it next. That asymmetry is a good diagnostic: if the diagram is outliving your findings, your findings were not written as work. ### A practical closing habit End the session by reading the artifacts back aloud: this many findings and who holds each, these requirements and which story they enter, these abuse cases, and the diagram as corrected. If any category is empty, say so deliberately — an empty list is a legitimate result, an unnoticed one is not.

  • Where exactly is the line between a finding and a security requirement?
    A finding is about the design as it currently stands: something is wrong and someone must change it. A requirement is about work not yet done: a condition the build must satisfy when it is finished. The same threat can produce either, depending on whether the code exists yet. Findings are chased to closure; requirements are satisfied by being built and are verified as part of the feature.
  • A sponsor says the session produced no vulnerability list, so it produced nothing. How do you answer?
    I would say the model reasons about the design, so its currency is threats and required controls, not confirmed exploitable defects in a running build. Then I would point at what it did produce: findings with owners, requirements now inside stories, abuse cases for whoever tests it, and a diagram that is finally accurate. If they specifically want confirmed defects in the deployed system, that is a testing activity and I would scope it separately.
  • Teams often find the corrected diagram is the only artifact still in use months later. What does that tell you?
    It tells you the diagram was written for a reader and the findings were not. A corrected picture is self-serving: anyone who opens it gets value immediately. Prose findings with no owner have no natural reader, so nothing pulls them forward. The fix is not to devalue the diagram — it is genuinely one of the outputs — but to write findings the way the diagram works: specific, attached to a person, and useful to whoever picks them up.

Like a design review for a bridge: it hands back specific objections with an engineer's name on each, constraints for the drawings still being made, and a corrected plan — not a certificate that the bridge will stand.

saying these in an interview costs you the question

  • Says the output is a report the security team files
  • Leaves findings unassigned until someone volunteers
  • Claims a threat model produces confirmed exploitable vulnerabilities
  • Treats the diagram as a disposable whiteboard aid
  • Treats security requirements as advisory suggestions, not part of the work
  • Talks about a design 'passing' threat modeling

context

open as a page

Your threat model flagged an unauthenticated firmware-push path; a pentest did not exploit it. Is the finding closed?

level: seniorimportance: should knowfreq 48%

basics

~10 s

No. A pentest tests one build, from the positions a tester could reach, in a limited window, so failing to exploit something is not evidence the design constrains an attacker.

open as a page

Your organisation starts treating threat models as both audit evidence and its risk register. How do you respond?

level: principalimportance: should knowfreq 36%

basics

~20 s

Push back on both. A threat model asserts intent about one design at a point in time; an audit needs evidence a control operated over a period, and a register is a maintained, organisation-wide list.

open as a page