Triage wants an owner and a fix date for a jailbreak in a supplier's hosted model - what do you commit to?
answer
- only one half has a release
- commit where there is a repository
- unresolved is not the same as scheduled
- a date nobody meets costs the next date
- the rest are product decisions, not tickets
basics
~20 sCommit only on the half with a repository: name what your team will ship and when, describe it by what it measurably shifts, and record the model-side behaviour as unresolved rather than scheduled. A supplier's release train takes no date from you.
solid answer
~50 sSplit the entry before you fill in the fields. The half your team ships - the prompt, the surfaces, what the product does with returned text - takes a named owner and a real date, and its claim is stated as a measured shift in how often the framing lands, never as removal. The model half takes no date from you at all: the behaviour is trained into weights a supplier serves, and no build of yours contains it. Record it as unresolved and carried, not as fixed next release. Then name the options that do exist, because they are product decisions rather than engineering tickets: narrow who reaches the surface, change what the product does with the output, change model, or continue with the exposure known. The cost of the easy answer is cumulative - a date nobody can meet devalues every date your team gives afterwards.
go deeper
Understand that a fix date is a promise about your own build, so a defect in something your team did not build cannot honestly carry one.
Be able to say which parts of the finding have a repository and a release, and to describe an app-side change by the effect it was measured to have rather than by the status it sets.
Show you can write the two-attribution entry, commit a date only where there is a build, and keep the model-side behaviour explicitly open instead of quietly closed.
Own the judgment: refuse the impossible date, keep the residual visible to whoever chooses whether the product stays on that model, and protect the credibility of every date your organisation does give.
**The remediation process assumes every finding has a fix, an owner and a date. Half the entries on an LLM list break that assumption, and the leadership skill here is refusing to pretend otherwise while still giving the organisation something to act on.** ### Why the pressure to give a date is real A tracker with an open item and no date looks like neglect. Reviewers, auditors and executives all read a blank date field as 'nobody is working on it'. So the path of least resistance is to write 'next release' and move on. In a tool-less consumer chat product built on a supplier's hosted model, that sentence is false in a specific way: your next release contains the system prompt, the client and the surfaces. It does not contain the weights that decide whether a request is declined. You have committed your organisation to an outcome no build of yours can produce. ### What an honest entry contains **One finding, two attributions.** Say which artefact each half lives in. The app half - prompt text, surfaces, session handling, what the product does with returned output - is in a repository your team controls. The model half is trained behaviour in a supplier-served endpoint. **A date only where there is a build.** The app-half work gets a named owner and a real date, like any other ticket. **A claim stated in what it shifts.** Whatever you ship on your side is described by its measured effect - how often the framing landed before and after, on which surfaces - not as closure. Any wording that implies removal will be quoted back at you the first time somebody reproduces it. **An explicit unresolved marker for the model half**, carried in whatever your organisation uses for risk it has not eliminated, with the reason stated plainly: no artefact under our control produces this behaviour, so no release of ours removes it. **The options that do exist**, named as what they are - decisions with owners above the engineering line. Narrowing who can reach the surface. Changing what the product does with the text it gets back. Changing which model the product calls, with everything that costs. Or continuing with the exposure known and stated. Presenting these as choices is the difference between a security function that informs decisions and one that files impossible tickets. ### The half-truths to reject *'We will fix it in the next release.'* The next release does not contain the model. This is the answer the interviewer is listening for you to avoid. *'It is the supplier's problem, so mark it closed.'* Location is not exposure. The output reached your customer under your product's name. *'We tightened the prompt, so it is resolved.'* A prompt edit moves a rate for wordings you tested. Ship it, measure it, and say so - but a resolved status asserts something you cannot demonstrate. *'It only reproduced once, so there is nothing to schedule.'* One success against a sampled model is exactly the evidence this class of defect produces. Reporting it as unreliable is honest; treating unreliable as absent is not. ### The organisational cost of the easy answer Dates are a currency. A team that promises one it cannot meet spends credibility it will need for the finding that genuinely does have a fix. Worse, the false date hides a decision from the people entitled to make it: if a product ships on a model whose behaviour it cannot control, that is a fact the product owner should hold consciously, not one buried under a ticket that closed on schedule and changed nothing that matters. The security function's job in that room is to make the residual visible and legible, not to make the tracker look tidy. ### What good sounds like in the interview A strong answer refuses the false date without refusing the responsibility. It gives the app half an owner and a date; it names the model half as unresolved with a stated reason; it describes the compensating work by its measured effect; and it escalates the remaining choice to whoever owns the product, because 'accept this, narrow it, or move off the model' is not a call an engineer makes in a ticket comment.
- The product owner insists on 'next release'. What is your reply?That the next release ships our prompt, our surfaces and our client, and none of those hold the behaviour in question, so the date would be a commitment to an outcome our build cannot produce. I would offer a dated commitment on the app-half work, state its expected effect as a shift in observed rate, and put the model-side behaviour in front of them as an open decision rather than a scheduled fix.
- Does refusing to give a date mean the security team has nothing to deliver here?No. It delivers a precise attribution, dated work on the half that has a repository, a measured before-and-after for whatever ships, and a legible statement of what remains and who can decide about it. That is more useful than a closed ticket, because it keeps the exposure visible to the people who choose whether the product continues on that model.
- How would you record it a quarter later if nothing has changed?Still open, with the same attribution, plus what has been measured since - attempts made, outcomes, whether the observed rate moved with no deploy of ours. Ageing without change is itself the signal: it tells the owner the exposure is structural to the current design rather than pending, which is exactly the input a decision to narrow the surface or change model needs.
saying these in an interview costs you the question
- Promises a fix in the next release
- Closes the item as the supplier's problem
- Marks a prompt edit as resolving the behaviour
- Gives a date on a supplier's release train
- Treats one intermittent result as nothing to record
- Buries the residual so the tracker looks clean