skip to content

Published Structures

A finding reads differently once it is placed on a published technique and inside a recognised risk framework, and both translations lose something. Interviewers ask because reports get read by non-attackers.

on this pageshow

explore

questions

8

Your AI red-team report tags each delivered finding with an identifier from a published adversary technique reference. What does that tag give a reader who was not on the engagement, and what does it not give them?

level: juniorimportance: must knowfreq 58%

answer

  1. shared address, not a verdict
  2. reader can look it up
  3. severity comes from your evidence
  4. same technique, wildly different impact
  5. delete the identifier — does the finding still stand?

basics

~20 s

It gives the finding a shared address: a reader can look the technique up, see how other reports used it, and find published mitigations. It does not give severity, likelihood or reproduction detail. Those come from your own evidence, narrative and rating. The identifier is an index entry, not a verdict.

solid answer

~50 s

The identifier is a lookup key into a structure the reader already knows. It lets them place your finding beside findings from other assessments, pull the reference's published detections and mitigations for that technique, and route the item to whichever team owns that class of problem. What it never carries is your engagement's specifics: how hard the attack was, how often it worked under the query budget you had, what the target configuration was, or what evidence you hold. It also does not rank anything — two items under the same technique can differ by an order of magnitude in impact. So the tag sits **beside** the finding's own title, narrative, evidence and rating, never in place of them. A useful test: if a reader could reconstruct your report from the identifier list alone, you have under-written the findings.

go deeper

for a junior

Says the identifier lets a reader look the technique up and compare it with other reports, and that it is not a severity rating.

for a middle

Adds the downstream uses — routing to the owning team, pulling published mitigations — and names what stays engagement-specific: evidence, conditions, success rate, rating.

for a senior

Talks about report design: the tag beside the narrative rather than instead of it, and the failure mode of an identifier table that looks rigorous but is unreadable.

for a principal

Frames it as a communication contract with the client's own tracking system, and cares that ratings are derived from observed evidence rather than inherited from the reference.

### What a "published adversary technique reference" actually is It is a catalogue maintained by somebody other than you. Each entry carries a **stable identifier** (a short code that is not supposed to change casually), a name, a prose description of the attacker's position, the access the technique presupposes and the effect it produces, and usually a list of candidate detections and mitigations. MITRE ATLAS is the AI-focused catalogue most teams mean; MITRE ATT&CK is the enterprise one whose shape it borrows. The structurally important fact is that **nothing in such a catalogue knows anything about your client's system**. Every entry is written about a class of attacker behaviour in the abstract, by people who have never seen the target you tested. ### The mechanism — what writing a tag next to a finding actually does Attaching an identifier is a single assertion: *the behaviour I observed is an instance of the class this entry describes*. That assertion, and nothing more, produces four downstream effects. **Location.** The reader opens the entry and gets a description written by a third party. They stop depending on your prose to understand what family of thing you found. **Comparability.** The same class of finding from another vendor, another quarter, or another product carries the same address, so items can be grouped and filtered across reports nobody wants to re-read end to end. **Routing.** Detection-engineering and platform teams commonly organise their own backlogs and coverage tracking by these identifiers, so a tagged finding lands in a queue that already exists instead of in a general security inbox. **Mitigation lookup.** The entry usually names candidate countermeasures, giving the reader a starting point that was not written by the party being paid for the engagement. ### What it costs Mapping is analyst time, not machine time, and the honest version is not cheap. Doing it properly means reading the **full entry description** for each candidate technique — not its title — and checking three things against your own evidence: where the attacker sat, what access the technique presupposes, and what effect resulted. Budget five to fifteen minutes per finding for someone already fluent in the catalogue, appreciably more the first few times, plus a review pass in which a second person re-derives a sample of the mappings. On a twenty-five-finding report that is most of an analyst day; it recurs on every engagement, and it recurs again as unplanned rework whenever the reference is revised. Those hours come out of the same budget as evidence collection and re-testing, so it is worth being explicit about what they buy: **navigability for outside readers, and no new knowledge whatsoever about the target**. ### Where the reading goes wrong This is the part interviewers are testing, because every misreading below is common and none of them looks like an error on the page. - **The identifier read as a rating.** A column of codes sits where a scoring column normally sits and inherits its authority. But no entry in the catalogue is per-target; a one-in-two-hundred-attempts curiosity and a single-shot data-egress path can carry the identical code and look identical in the table. - **Counts per technique read as a weakness profile.** "Eleven of our findings are technique X" is usually a statement about what you chose to probe and how you split findings, not about where the system is weak. Change the probe mix or the splitting rule and the profile moves while nothing about the target has changed. - **A shared identifier read as duplication.** Two findings under one code are two members of a class, not the same defect; merging them on that basis quietly deletes one of them. - **The listed mitigations read as validated.** The catalogue's countermeasures are generic candidates. None has been tested against this deployment, and a recommendation that says "see the reference's mitigations" implies otherwise. - **The identifier table read as the report.** A findings section that is codes plus one-line titles reads as rigorous and conveys almost nothing: no reader can tell what was done, under what configuration, or why any item deserves attention this quarter. ### What I would check before delivery Run the **delete-the-column test**: strike the identifier column and see whether every finding still stands on its own evidence and narrative. Confirm each mapping records *which* reference and *which* edition it was made against, at authoring time — that is unrecoverable a year later. Confirm each rating was derived from observed impact and exploitability rather than inherited from whatever the entry implies. And check that at least a sample of mappings can be justified from the entry's description rather than from its title, because title-matching is where most wrong mappings begin.

  • A client asks why you also write a plain-language title for each finding when it already has a technique identifier.
    Because the identifier addresses a class, not this instance. The title has to say what happened to *their* system — which surface, what the attacker input did, what came out — and that is what the people who fix it read first.
  • Two findings carry the same technique identifier. Should they be merged?
    Not on that basis. Merge only when they are the same defect on the same surface with the same fix. A shared identifier means the same class, and one may be trivial while the other is a direct data-egress path.
  • Where should the reference's name and edition appear?
    On the mapping itself, or once in the report's methodology section covering all of them. Without it a later reader cannot tell whether a moved or renamed identifier means the finding changed or the reference did.

A technique identifier is a library call number: it tells you which shelf the item sits on and what else sits beside it, and says nothing at all about whether the book is any good.

saying these in an interview costs you the question

  • Treating the technique identifier as a severity or priority signal.
  • Delivering a findings table of identifiers with no narrative or evidence.
  • Claiming the reference's published mitigations are validated for this specific target.
  • Assuming two findings under the same identifier are duplicates.

context

open as a page

A finding from your AI red-team engagement matches no technique in the published adversary reference you map against. What do you do with it, and how do you write that entry?

level: middleimportance: must knowfreq 50%

basics

~20 s

Mark it unmapped and say so explicitly. Describe the behaviour in your own words, name the nearest technique and state exactly why it does not fit. Forcing a fit misdescribes the finding, sends the reader to the wrong mitigations, and hides a gap the reference itself may need to cover.

open as a page

A red-team run against a customer-facing chat assistant produced an attack-success rate of roughly one attempt in five on a jailbreak suite. The governance workstream wants that entered in the AI risk register as a control marked pass or fail. What is lost in that flattening, and how do you record it so the pass or fail is defensible later?

level: middleimportance: must knowfreq 58%

basics

~20 s

You lose the denominator, the mix of attacks that produced the rate, and the fact that the control is probabilistic rather than on or off. Record the rate, the suite it came from, the number of attempts, the target configuration and the date beside the verdict, and state the threshold that turned the rate into pass or fail.

open as a page

An AI red-team report is read both by the engineers who will fix the issues and by a governance function that maintains an AI risk register. What does each of those readers need from the same finding, and what happens to the attack narrative in the register version?

level: juniorimportance: should knowfreq 48%

basics

~20 s

Engineers need reproduction: the prompt pattern, the target configuration, what the model returned, and the fix. The register needs a risk statement, which control it is evidence about, how bad it is, and an owner and date. The attack narrative usually shrinks to one line, so keep the detail in a linked annex.

open as a page

One delivered finding in your AI red-team report came from a chain: untrusted retrieved content steered the assistant into a tool call, and that call moved data out. How do you map it onto a published adversary technique reference without inflating your finding count?

level: seniorimportance: should knowfreq 42%

basics

~20 s

Keep it as one finding — the reader's unit is the delivered impact, not the step count. Name a primary technique for that impact and list the enabling steps as supporting techniques inside the same entry, in order. Splitting one chain into three findings inflates the count and destroys the causal sequence a defender needs.

open as a page

A control in your organisation's AI risk register is marked satisfied on the evidence of an AI red-team assessment against a hosted third-party model your team does not control. How long is that verdict good for, and what do you write into the entry so it expires honestly?

level: seniorimportance: should knowfreq 44%

basics

~20 s

It is good until the thing you tested changes. With a hosted model the provider can change it without telling you, so pin the entry to what you exercised: the model identifier, the system prompt and guard configuration, the date, and re-test triggers — provider change, prompt or tool change, or a fixed interval.

open as a page

A client tracks year-over-year AI red-team trends by published adversary-technique identifier, and the reference your team maps against was reorganised between last year's engagement and this one. How do you keep the two engagements comparable?

level: principalimportance: should knowfreq 30%

basics

~20 s

Stamp every mapping with the reference edition it was made against, so two years are never silently compared. Then re-map last year's findings to the current structure, keep both identifiers on each item, and present the trend on the re-mapped set, calling any movement a taxonomy change rather than a security change.

open as a page

You lead an AI red team whose output must land inside a recognised AI risk-management framework's structure, so findings become entries against governance functions and control statements. How far do you restructure the findings to fit that structure, and what do you refuse to convert?

level: principalimportance: should knowfreq 36%

basics

~20 s

Restructure the summary layer fully — risks, controls, owners and dates in the framework's language, because that is what gets funded. Refuse to convert the evidence: attack narratives, per-family rates and the scope of what was untested stay in a linked technical record. Never invent a control row to make an unmatched finding disappear.

open as a page