Depth of Inspection

## The claim the device is making A filter that reads only addresses and ports has everything it needs in the first packet, because everything it needs was written into the header by the sender. An application-aware firewall makes a stronger claim — that the traffic in this flow *is* a particular application — and that claim is a **verdict derived from evidence**, not a field it can read. The evidence is the traffic itself. The device therefore cannot have it until some traffic has already arrived, and "arrived" at a forwarding device means "was on its way onward". ## Where the evidence comes from - **Stream reassembly.** Segments arrive split, out of order, sometimes retransmitted. A classifier that matched on individual packets could be defeated by splitting a distinguishing string across two of them, so it works on the reassembled stream — which means holding state and waiting for enough of the stream to exist. - **Protocol decoders.** Many applications announce themselves in their opening exchange: a request line, a banner, a binding request, a version negotiation. These are the cheap wins and land within a packet or two. - **Handshake metadata for encrypted flows.** A TLS handshake exposes the requested name and the negotiated next protocol before any application data flows, and the server certificate names a service. This names *who is being talked to*, never *what is being said*. - **Behavioural heuristics.** For anything with no readable header, the classifier falls back on shape: packet sizes, inter-packet timing, direction ratios, session length. Shape needs a stretch of traffic before it means anything, and it is the weakest evidence of the four. ## Why the verdict is late, and how late It varies by application, and that variability is the point. Something that identifies itself in its first client message can be labelled almost immediately. Something distinguishable only by how the *server* answers needs a full round trip. Something carried inside an encrypted session may need the handshake plus a run of data packets before a heuristic will commit — and some flows never resolve at all, which is how the unknown bucket fills. ## What the device does while it does not know The normal design is **forward, then re-evaluate**. The alternative — hold the flow until the classifier commits — is not free: it adds latency to every session, it costs per-flow buffer memory at exactly the aggregation point where flow counts are highest, and it breaks protocols where the server speaks first or where a client gives up quickly. Devices accept a small forwarded exposure instead of a large capacity and latency bill. When the verdict lands and the matching rule changes to a deny, what happens is a **session teardown** — the flow is dropped, often with a reset toward one or both ends. The connection existed. Bytes crossed. The session record shows byte counters that are not zero, and reading only the `deny` action understates what reached the server. ## The honest limitation, and it is the interview answer Application identification is a **strong control over sessions and a weak control over first payloads**. Anything that must persist to be useful — a tunnel, an interactive channel, a large transfer — dies at the verdict. A single small request and response that completes inside the pre-verdict window is finished before the label exists. If what you are defending against fits in a few hundred bytes, this is not the control that stops it; you need something that refuses before the connection forms, such as an explicit deny toward that peer at the zone boundary, or no path at all. The adversary side of this is not exotic. Traffic dressed to look like an ordinary permitted application is trying to be labelled as something allowed; traffic that only needs the opening window does not even need to win that argument, because it is done before the argument starts. ## What it costs the defender Three things, and you should be able to name all three: reassembly latency and memory on every flow; a forwarded exposure per flow that you cannot describe precisely to anyone who asks "how much gets through"; and, at a shared boundary that classifies several customers' traffic through one engine, an exposure that exists identically for every one of them while none of them has ever been quoted a number for it.