skip to content

Scheduled Collection Runs

The same collection executed on somebody else's schedule and machines instead of in your pipeline. Interviewers probe what a failure there means and who finds out about it first.

part ofAPI & DB clientsoverview, primer and where to startread it →
on this pageshow

explore

questions

5

When a Postman collection running on a hosted schedule fails, who finds out first, and what does that notice lack?

level: middleimportance: must knowfreq 55%

answer

  1. Nobody pushed, so nobody is blamed
  2. The account holder hears before the author
  3. A symptom report, not an attribution
  4. Bracket last green and first red
  5. Ownership by convention, never by mechanism

basics

~20 s

Whoever holds the vendor account finds out first, not whoever caused the failure. The notice carries a time and a failed request but no commit, no author and no build, so attribution has to be reconstructed by hand.

solid answer

~50 s

A failing pipeline stage names its culprit: a commit, an author, a diff. A hosted scheduled run names none of them, because usually **nobody pushed anything** — the clock fired, the request went out from outside your network, and something answered wrongly. The first notice therefore lands wherever that account routes it, which is rarely the person whose change caused it, and it arrives detached from any change at all. Two things follow. First, attribution is manual: you line the first red run up against what shipped, what was configured by hand, and what expired. Second, ownership is a convention rather than a consequence — if nobody is named by construction, the notice becomes background noise unless a person or rota is assigned to it deliberately. How the notice is routed or displayed is an observability subject; the asymmetry itself belongs to this arrangement.

go deeper

for a junior

Remember the basic asymmetry: a failing build tells you who pushed, a hosted scheduled failure does not, because nothing was pushed. The notice reaches whoever holds the account, not whoever caused the problem.

for a middle

Explain what the notice actually contains — time, request, assertion — and what it structurally cannot contain. Show how you bracket the last green and first red run to reconstruct attribution by hand.

for a senior

Demonstrate a triage order that separates non-code causes from deploys, and reproduces the same collection from inside your network before blaming the service. Talk about who is on the hook and how that was agreed.

for a principal

Own the policy: which schedules are allowed to page anyone, where their notices land relative to other failures, and what your team does about a schedule whose silence nobody has verified in months.

## Why nobody is named In a pipeline, blame is a by-product of the trigger. A change arrives, a stage runs because of that change, and when the stage fails, the change is right there — a commit, an author, a diff, a review thread. Nothing has to be arranged for that to happen; it is the shape of the mechanism. A **hosted scheduled run** removes the trigger and keeps the run. The vendor's clock fires, their machines execute a copy of your collection, a request leaves their network and enters yours from the public side, and an assertion fails. There was no push. There is no author. The failure is real and the notice is accurate, and it points at nobody. That is the whole of the asymmetry, and interviewers probe it because engineers who have only lived inside a pipeline expect the failure to come with a name attached. ## What the notice carries and what it does not | The notice tells you | The notice cannot tell you | |---|---| | when the run fired and when it failed | which change, if any, is responsible | | which request and which assertion failed | who should look at it | | that it entered from outside your network | whether the previous change is even related | | that it used the identity stored in that account | whether the same failure exists from inside | So the first thing a candidate should say is that the notice is a **symptom report, not an attribution**. It tells you the system is answering wrongly to a caller outside your network at a particular moment. Everything about *why* is work you still have to do. ## Who actually sees it first The verdict is recorded on the vendor's side, in the account that owns the schedule. Whoever that account notifies is the first to know, and in practice that tends to be: 1. **The person who set the schedule up**, because they configured the notice while they were configuring the run — often the engineer who happened to be doing this work months ago, who may have changed teams. 2. **A shared inbox or channel nobody owns**, because routing a hosted product's notification into an engineering workflow is an extra step that gets skipped. 3. **Nobody at all**, because the notice goes somewhere that is filtered, and the failure is discovered later by a customer. None of these is the author of the change that broke it, and none of them is guaranteed to be on duty. This is why the first notice from a hosted schedule so often arrives as *hearsay* — somebody mentions in passing that a scheduled check has been red for a while. ## Reconstructing attribution by hand Because nothing links the run to a change, you build the link yourself: - **Bracket the transition.** Find the last passing run and the first failing one. That window is the only evidence you have, and it bounds the search. - **Ask what happened in that window that was not a code change.** A credential rotated, a certificate replaced, an environment edited by hand in the vendor's account, a dependency you call changing behaviour, a firewall or edge rule tightened. - **Then ask what shipped in the window.** A deploy inside that bracket is a suspect, but only a suspect — the run may have been failing for an external reason first. - **Reproduce inward, then outward.** Run the hosted copy of the collection yourself against the same environment; if it passes from inside, the difference is the path in, not the service logic. Distinguishing a genuine intermittent defect from an unreliable case is its own discipline and belongs to testing practice, not here. What belongs here is the recognition that **the arrangement removed your attribution for free, so you pay for it in triage every time.** ## Making ownership exist on purpose Since the mechanism will not assign an owner, you must: - **Name a human owner per schedule**, recorded somewhere your team actually reads — not only in the vendor's account. - **Route the notice into the same place your other failures land**, so it competes for attention on equal terms rather than sitting in a product's own inbox. - **Decide in advance what a red scheduled run means.** If the honest answer is "we look at it when we get to it", say so explicitly, because an unowned check that everyone half-trusts is worse than no check. - **Watch for the absence of notices.** A schedule that stops firing sends nothing at all, and a long quiet stretch is indistinguishable from a long healthy stretch. The designing of alert routes, thresholds and dashboards is an observability topic with its own answers. The point to make in this interview is narrower: **a hosted schedule produces failures that no mechanism assigns to anyone, so ownership has to be arranged by convention or it does not exist.**

  • How do you narrow down a hosted scheduled failure when no commit is attached to it?
    Bracket it: take the last passing run and the first failing one, and treat that window as the search space. Look first at things that change without a push — a rotated credential, an expiring certificate, an edited environment, an upstream dependency — then at whatever deployed inside the window. Finally reproduce the same collection from inside your network to separate the path in from the service itself.
  • Why is a scheduled check that stops firing more dangerous than one that fails?
    A failing check produces a notice; a check that has stopped produces nothing, and nothing is exactly what a healthy system produces. A paused schedule, a lapsed account, or a quietly narrowed run all read as continuous success. You need something that treats a missing run as an event, otherwise silence is indistinguishable from health.
  • Who should own a red hosted scheduled run, given the mechanism names nobody?
    A person or rota named explicitly for that schedule, recorded where your team reads it rather than only inside the vendor's account, with the notice routed into the same queue as your other failures. If no owner can be named, that is a signal the check should not be running there at all.

saying these in an interview costs you the question

  • Assumes the failure notice identifies a commit or author
  • Expects the person who broke it to be told automatically
  • Treats a red scheduled run as proof the latest deploy is guilty
  • Ignores non-code causes such as expiry, rotation or edge rules
  • Reads a long stretch of no notices as proof of health
  • Leaves the notice in a product inbox nobody watches
open as a page

What does it cost you that a hosted scheduled run's definition lives in a vendor account rather than your repository?

level: seniorimportance: must knowfreq 50%

basics

~20 s

The schedule and the copy it runs are production configuration with no version control: no diff, no review, no blame, no revert. Anyone with account access can change or pause it, and a paused schedule looks like a passing one.

open as a page

What is a hosted scheduled run of a Postman collection, and how does it differ from running that collection yourself?

level: juniorimportance: should knowfreq 45%

basics

~20 s

A hosted scheduled run executes the same Postman collection on the vendor's machines, on a clock kept in their account rather than yours, from outside your network, and records the verdict there instead of in your build.

open as a page

Your hosted scheduled collection run is failing while your own runs of the same collection pass. How do you triage that?

level: seniorimportance: should knowfreq 45%

basics

~20 s

Compare what your own run never exercises: the copy the schedule holds, the environment stored beside it, the credential in that account, and the public path in from outside your network. Only then suspect the service.

open as a page

When does a check belong on a vendor's hosted schedule rather than in your own pipeline, and what do you pay for it?

level: principalimportance: should knowfreq 38%

basics

~20 s

Put a check there only when it must run with no change behind it, from outside your network. You pay with an unreviewed second definition, a credential in an account you do not hold, and a borrowed clock.

open as a page