When a company tries to measure whether a specific IT investment actually contributed to a business outcome (like revenue growth or cost reduction), the exercise runs into what economists have called the 'IT productivity paradox.' What does that paradox describe, and what makes measuring an individual IT investment's business contribution hard in practice even when the paradox itself has largely resolved at the macro level?
answer
- Solow's 1987 quip
- mismeasurement / implementation lag / IT output mismeasurement
- resolved at macro level by mid-90s
- attribution problem = unobservable counterfactual
- benefits realization management + TBM
basics
~20 sFor years, companies spent huge amounts on computers but overall economic productivity numbers barely moved — that mismatch was the 'IT productivity paradox.' Even today, tracing one specific IT project to a specific business result is hard because benefits show up late, get mixed with other changes, and are often invisible to the metrics you're using.
solid answer
~50 sThe productivity paradox, named after economist Robert Solow's 1987 remark that 'you can see the computer age everywhere but in the productivity statistics,' described the observed lag between heavy 1970s-80s IT investment and measurable gains in aggregate output. Later research attributed the lag to measurement problems (output like quality/convenience isn't captured well in GDP statistics), implementation lags (organizations need years to redesign processes around new technology before gains appear), and mismeasurement of IT's own output. At the macro level the paradox is now considered largely resolved — productivity gains did show up once complementary organizational change caught up. But at the level of a single investment, the same forces still apply in miniature: benefits are delayed past the measurement window, they're diffused across multiple concurrent changes so attribution is genuinely ambiguous, and much of the value shows up as things standard financial metrics don't capture well, like reduced risk, improved customer experience, or optionality for future initiatives.
go deeper
Should understand at a basic level that IT investments don't show their payoff immediately and that isolating cause-and-effect is genuinely hard.
Should be able to name at least one reason attribution is hard (implementation lag, confounding initiatives, or intangible benefits) with a concrete example.
Should be able to design a measurement approach (defined KPI, baseline, appropriate measurement window, phased rollout as a rough control) rather than either overclaiming or giving up on measurement.
Should be able to install an organization-wide benefits-realization or TBM-style practice that makes IT-to-outcome attribution a routine, defensible discipline rather than a one-off analysis per project.
## The observation itself The IT productivity paradox is a specific, historically documented observation: through the 1970s and into the late 1980s, U.S. businesses poured enormous capital into information technology, yet economy-wide productivity growth (output per hour worked) stagnated or even slowed rather than accelerating as theory predicted it should. Economist Robert Solow captured the puzzle in a 1987 New York Times book review with the line, 'You can see the computer age everywhere but in the productivity statistics' — the observation became known as the Solow paradox and later, more broadly, the IT productivity paradox once researchers like Erik Brynjolfsson formalized it as a research question in the early 1990s. ## The three explanations Subsequent research converged on three main explanations, all of which matter directly to how a practitioner should think about measuring a single IT investment's contribution today. 1. **First, mismeasurement**: standard economic output statistics (GDP, output per hour) were built to count units of physical goods and struggle to capture quality improvements, convenience, variety, and speed — a bank that lets customers check balances instantly instead of waiting for a mailed statement has created real value that doesn't show up as 'more output' the way a factory producing more widgets does. 2. **Second, and most important for a practitioner, implementation and complementary-investment lags**: buying computers doesn't produce a productivity gain by itself — the gain only shows up once an organization redesigns its business processes, retrains its workforce, and restructures its management practices around the new capability, and that redesign work routinely takes years longer than the technology rollout itself. A company that digitizes its ordering process but keeps the same approval hierarchy, the same paper-based exception handling, and the same org structure captures little of the theoretical gain, because the technology was necessary but not sufficient. 3. **Third, mismeasurement of IT's own output and price**, which tends to understate the real capability delivered per dollar over time. ## Why the macro paradox is considered resolved At the macro, economy-wide level, most economists now consider the paradox substantially resolved: productivity statistics did eventually show a marked acceleration in the U.S. in the mid-to-late 1990s and into the 2000s, once several forces caught up — a critical mass of complementary organizational redesign had been done, network effects from widespread connectivity kicked in, and IT capital had simply reached the scale needed to matter at the aggregate level. The lag Solow observed turned out to be real but temporary, not a permanent property of computing investment. ## The same forces, in miniature, on one investment But the reason this history matters to an architect or engineering leader today is that the same three forces operate in miniature on every individual investment, and they don't go away just because the macro paradox resolved. - **A single system replacement or platform investment** shows its benefit only after the organization has actually changed its processes around the new capability — and that process redesign is frequently skipped or under-resourced because it's treated as a 'business change management' problem separate from the IT project, with its own budget and sponsor that often doesn't exist. - **Benefits are also diffused across multiple concurrent initiatives**: if a company simultaneously replaces its CRM, launches a new pricing strategy, and runs a marketing campaign, and revenue grows the following quarter, there is no clean way to attribute what share of that growth came from the CRM versus the other two changes — the counterfactual (what would have happened without the CRM) is unobservable. - **Much of an IT investment's real value** shows up as things a standard P&L-oriented metric doesn't capture cleanly: reduced operational risk, faster time-to-market for future initiatives (an option value, not a direct return), improved employee retention from less painful tooling, or customer experience improvements that show up as lower churn months or years later rather than as an immediate revenue line. ## The practical response — benefits realization management The practical response mature organizations use is benefits realization management: rather than trying to prove precise financial attribution (which is often genuinely impossible to isolate), they: 1. define the specific business KPI a project is meant to move before the project starts, 2. set a measurement window that accounts for the implementation lag rather than measuring immediately at go-live, 3. and track that KPI against a baseline and, where feasible, a control group (e.g., rolling a change out to one region first). Frameworks like Technology Business Management (TBM) push this further by tying IT cost data directly to the business capabilities and outcomes it funds, so conversations about IT value start from real cost-to-outcome linkage rather than an unverifiable claim. The honest failure mode to watch for is an organization that either gives up on measurement entirely ('IT value can't be measured, trust us') or overclaims precise attribution it cannot actually support ('this system caused a 12% revenue increase') when the true answer is a defensible range with a named baseline and named confounders.
- Why can't you just measure a project's ROI immediately after go-live to avoid the attribution problem?Because the implementation lag means the real gain only materializes after the organization redesigns processes, retrains people, and adopts new workflows around the technology — measuring at go-live captures the cost but almost none of the eventual benefit. That's exactly the lag that produced the original macro-level productivity paradox, just replayed at project scale.
- What's a practical way to reduce the attribution problem when several initiatives launch around the same time?Stagger or geographically phase the rollout (e.g., one region or business unit first) so the changed group can be compared against a comparable unchanged group as a rough control — this doesn't eliminate confounders entirely but gives a real baseline to compare against, rather than just comparing before-and-after with several other changes happening simultaneously.
It's like trying to credit a single vitamin supplement for an athlete's improved race time when they also changed their diet, sleep schedule, and training plan the same month — the supplement may have genuinely helped, but isolating its share of the improvement from everything else that changed at the same time is close to impossible without a controlled experiment.
saying these in an interview costs you the question
- Claims a precise revenue/cost figure directly caused by one IT project with no baseline or control
- Measures ROI immediately at go-live with no accounting for implementation lag
- Believes IT value is fundamentally immeasurable and gives up on tracking any KPI
- Unaware that the productivity paradox was ever considered resolved at the macro level
- Ignores that non-financial value (risk reduction, optionality, retention) is real value, not 'soft' and dismissible