skip to content

What decides how much of a flood each site absorbs when one address is announced from many sites?

level: middleimportance: should knowfreq 46%

answer

  1. other networks choose, not you
  2. best path, not shortest distance
  3. peering decides more than geography
  4. shares are lumpy and they drift
  5. removing a site redistributes, never removes

basics

~20 s

Other networks decide, not you. Each source network's own BGP best-path choice for your prefix picks the site it reaches, so the split follows routing policy and peering, not geography — uneven, and it moves.

solid answer

~50 s

Every network on the internet independently picks a best path to your announced prefix, using its own policy: local preference, AS path length, where it peers with you, and hot-potato exit selection. Whichever of your sites that path leads to is the one that network's hosts reach, so a site's share of any flood is the sum of the source networks whose routing happens to point at it. That is why the split is never `1/N`: a site peering with a large eyeball network can carry several times a site that only has transit. It also moves — an upstream changes preference, a peering session flaps, and a share doubles overnight with no change in attack volume. So a per-site baseline is a moving target, and shedding a site does not shed its traffic; it re-lands on the neighbours.

go deeper

for a junior

Know that you do not distribute the traffic — every other network picks which of your sites to send to, and the result is uneven.

for a middle

Be ready to name the inputs to that choice: local preference, AS path length, where you peer, and hot-potato exit selection — and to say that distance and your capacity are not among them.

for a senior

Demonstrate the operational consequence: baselines drift with other people's routing, so alert on the estate total plus each site's share, and provision every site for the share it could inherit.

for a principal

Frame the headroom argument. A footprint whose shares are set by third parties needs spare capacity at every site that will usually look wasted, and someone has to fund it before the day it is needed.

## You are not the one doing the load balancing The intuition people bring to a footprint announcing one address from many sites is a load balancer: something takes the incoming requests and deals them out. Nothing of the kind exists. You announce the same prefix from each site, and every other network on the internet independently decides which of those announcements it prefers. The set of source networks that pick a given site is that site's *catchment*, and it is chosen entirely by other people's routing policy. ## What actually drives the choice In rough order of how much they decide: - **Local preference inside the source's network.** An operator who prefers its own settlement-free peering over paid transit will send your traffic to whichever of your sites it peers with, even if a transit path leads somewhere closer. - **AS path length**, as a tie-break once preference is equal — fewer networks traversed wins, which correlates weakly with distance and not at all with your capacity. - **Where you peer.** A site connected to a large residential access network will pull that network's whole subscriber base, which can be several times another site's entire catchment. - **Hot-potato exit selection.** A transit network that hears your prefix in several places hands the traffic off at the exit nearest to where it entered, so the split inside one upstream is decided by where its own customers are. Notice what is absent: geographic distance, round-trip time, and any measure of how loaded or how large your sites are. Two sites twenty kilometres apart can have utterly different catchments, and a small site can find itself carrying the largest share. ## Consequence one: shares are lumpy The practical shape of a real footprint is a few sites carrying most of the traffic and a long tail carrying little. When an attack arrives from a botnet whose sources are scattered across many networks, it broadly follows the same lumpiness as ordinary traffic — but not exactly, because the source mix is different. Compromised devices concentrate in particular access networks, and if those networks all prefer one of your sites, that site takes a disproportionate hit while the rest of the estate looks normal. The reverse also happens: an attack from very widely distributed sources spreads more evenly than your user traffic does. ## Consequence two: shares move, and not because of you Catchment is not a property you configured; it is the current state of thousands of other networks' policies. Any of these will move it, silently: - an upstream adjusts local preference or re-homes a customer - a peering session drops, so that network's traffic falls back to transit and exits somewhere else entirely - a new peer is added at one of your sites - an intermediate network changes its own hot-potato exits A site's share can double overnight with no change in the total. If your alerting compares each site to its own learned baseline, that shift looks exactly like an attack — and, worse, the reverse case looks like nothing at all: a site whose share collapses because a peer went away will sit quietly below threshold while the traffic it used to carry is now stressing a neighbour. So the per-site baseline is a moving target. The number worth alerting on is the estate total, with each site's *share* of that total tracked as a separate series — a share that changes sharply while the total is flat tells you routing moved; a share that changes while the total climbs tells you the source mix changed. ## Consequence three: you cannot steer precisely, and shedding does not shed You have blunt influence — you can make a site less attractive by lengthening the path you advertise from it, or stop announcing from it altogether — but you cannot choose which networks land where, and you cannot predict exactly what a change will do until you make it. Most importantly, taking a site out does not remove its traffic from the estate. Every source that was reaching it re-converges on whichever site its routing prefers next, and the flood lands on the neighbours, which may be smaller. "Turn off the site that is struggling" is therefore not a mitigation; it is a redistribution, and it can turn one hot site into two. ## The wrong answer to avoid The common wrong answer in an interview is that traffic goes to the nearest site and divides roughly evenly. It is the intuition the marketing diagram gives you, it is wrong on both halves, and every defensive consequence above follows from it being wrong.

  • If a site's share doubles overnight with the total flat, what do you suspect first?
    A routing change upstream, not an attack. A peering session at another site may have dropped, or an upstream changed preference, and the source networks that used to land elsewhere now land here. Check whether some other site's share fell by the same amount at the same moment — a redistribution shows up as a zero-sum swap across the estate, while an attack shows up as the total rising.
  • Why is per-site capacity planning harder here than for a single-site deployment?
    Because a site's demand is not a function of anything you control. You have to provision each site for the share it might inherit if a neighbour's peering goes away or a neighbour is taken out of service, not for the share it carries today. That headroom is bought at every site and mostly sits idle, which is exactly the cost someone will question.
  • Does an attacker get to pick which of your sites they hit?
    Not directly — they send to one address and routing decides. But they can influence it: choosing sources in networks that they know route to a particular site concentrates the flood there, and rented or compromised infrastructure in a specific region gives them coarse aim. A defender should not assume an attack will spread as evenly as user traffic does.

saying these in an interview costs you the question

  • Saying traffic goes to the geographically nearest site
  • Assuming an even 1/N split across the announced sites
  • Treating a site's share as a stable, ownable baseline
  • Claiming you can steer catchment precisely from your side
  • Proposing to withdraw a struggling site as if that removed its traffic

context