I have sat in a review where every delivery tile was the cheerful color.

Deploy frequencyFine
Lead timeFine
Change failFine
Time to recoverFine

Those four are what most dashboards still put on the wall, even though the research set has kept evolving. The product still missed the launch window. On-call was still ugly. Nobody was confused about the tiles.

Everybody was confused about how the tiles were allowed to be fine.

That scene is not a research finding. It is a room I have been in. The useful question is what those tiles are for, and what they are terrible at.

DEPLOY FREQUENCY14 /dayFINETHE QUARTERLAUNCH MISSED
Fig. 01 · Both true at once. The tile is fine, the quarter is not.

Keep the nouns. Drop the religion.

You need shared language when someone asks how delivery is going. The DORA research program has spent years on a small set of software delivery performance metrics for exactly that kind of conversation: how fast changes move, how often you deploy, how often deploys need emergency intervention, and how long recovery takes when a deploy goes wrong. The published model is no longer only "four keys" (recovery is framed around failed deployments, and there is also unplanned rework from production incidents), but you do not need a history seminar to use the idea.

The research also claims something managers still argue about in hallways: over long periods, speed and stability are not a forced tradeoff. Teams that do well tend to do well on both throughput and stability. That is their finding. Treat it as a reason not to accept "we ship slow because we care about quality" as a permanent lifestyle.

What you should not keep is the costume party. "Elite" as a personality. Green dashboards as moral victory. Ranking squads because a template had a column for it. The DORA guide itself calls the metrics a compass for continuous improvement, not a tournament bracket.

How the metrics get abused

The same guide is blunt about failure modes. The interesting ones for real organizations are not exotic.

  1. Metrics as goals
    DORA warns that turning delivery metrics into org-wide targets increases gaming, and points at Goodhart's law: when a measure becomes a target, it stops being a good measure. I once watched a team "fix" deploy frequency by shipping a stream of releases that changed a version string and nothing a user could notice. The chart went vertical. The roadmap did not. That is what goal pressure looked like in one corridor.
  2. Wrong unit of comparison
    The metrics are meant to be applied at the application or service level. Blending them across unlike systems, or across a whole company as if it were one machine, is called out as problematic. An org-wide average lead time that looks "okay" while one service waits two weeks on review is not mysterious. It is arithmetic hiding a fire. Refuse the average when the unit is wrong.
  3. Competition
    DORA's guidance is to improve your team's performance over time, not to compete against other teams or organizations. The moment lead time becomes a ranking in a performance cycle, the data gets weirder. I have seen tickets split into confetti and reviews that were not reviews. The published anti-pattern is the competition. The confetti is what it looked like that week.
  4. Hero recovery
    Fast recovery from a bad deploy can mean excellent operations. It can also mean the same two people always answer the pager. The metric alone will not tell you which. If restore time is excellent and those people are burning out, you did not win. You outsourced the number to martyrs. Treat that as a diagnostic question, not a score.
  5. Measurement without improvement
    Another named pitfall: obsessing over perfect data plumbing while the delivery process stays the same. A prettier tile is not a better quarter. A dashboard nobody uses to make a different decision is furniture, not analytics.

When a metric moves, look sideways

The outcome metrics lag the practices that produce them. DORA's own framing treats them as lagging indicators of how you build and deliver. So when lead time or deploy frequency finally shifts on the org slide, the cause has often been sitting in the open for weeks.

W1W2W3W4W5W6W7W8REVIEW WAIT MOVES (LEADING)LEAD TIME NOTICES (LAGGING)WEEKS OF WARNING
Fig. 02 · Outcome metrics lag. The cause sits in the open for weeks.

When DORA describes how to improve, they do not say "stare harder at the four tiles." They say find the friction, pick the main bottleneck, and add more specific measures as leading indicators. Their examples include how long code reviews take and the quality of your tests. That is the research anchor for looking sideways.

  1. Code review duration / time to first review
    If changes sit unreviewed, everything downstream is cosplay. If more diffs arrive than reviewers can honestly read, lead time will lie to you until you measure the queue.
  2. Test quality (including pipelines that cry wolf)
    If you cannot trust the suite, people batch, delay, and ship scared. You do not need a special brand name for that. You need to know whether green means something.
  3. Batch size
    DORA treats working in small batches as a core lever: smaller changes are easier to understand, move through the process, and recover from when they fail. Huge pull requests with a "fast deploy culture" poster on the wall are a contradiction you can feel in review, even before the outcome chart moves.
  4. Friction in the path
    Mapping the delivery process is part of their suggested conversation. A lot of "slow engineering" is queue time: review, environments, security, product clarification. If you only shout at coding speed, you are yelling at the wrong stage.

None of that replaces the outcome metrics. It explains them. Explanation is the job when the green tile and the red quarter disagree.

A compass has rules

  1. Fight a process, not a person
    "Review wait is eating lead time on checkout" is a systems sentence. "Alice is slow" is how you lose the room and eventually the data.
  2. Prefer the right unit and the ugly tail
    Service by service. Window by window. Middle and tail, not one vanity mean that flatters the org chart.
  3. Improve against your own baseline
    That is the DORA posture on competition. Your product, regulation, and risk tolerance still own the targets. Elite in a regulated product shipping monthly is not the same claim as elite in a consumer app shipping hourly. Other people's labels are not a personality you can put on.
  4. Change one thing and decide what would make you stop
    The published improvement loop is roughly: baseline, find friction, commit to the bottleneck, plan with leading measures, do the work, check, repeat. A slogan is not a step in that loop.
A step in the loop

"We will limit open pull requests for six weeks; if median lead time does not improve by at least a day, or deploys needing a hotfix or rollback rise, we revert."

What I want in the room

When someone puts up cheerful delivery tiles after a bad quarter, I want questions like these:

  1. Q1
    Which application or service is in the tail, and which stage is eating the days?
  2. Q2
    Did deploy frequency rise because users got value sooner, or because we learned to tickle the counter?
  3. Q3
    Is recovery fast because the system is healthy, or because the same two people never sleep?
  4. Q4
    What leading signal moved before the outcome metric moved: review wait, batch size, test trust, something else in the path?

If nobody can answer, you do not have delivery analytics. You have interior decoration.

A working loop, not a transformation offsite

  1. Pick one outcome metric you will defend for the next stretch: written definition (commit to production, not "when we felt done"), fixed window, named service, median and tail.
  2. Hang two leading measures beside it that match how this path actually sticks. For many product teams that is review duration and either batch size or test quality. For you it might be environment wait. Be honest.
  3. Run one change with a kill date. When you check, check the leading measures first, not only whether the outcome tile turned a friendlier color. Keep or undo. Repeat.
  4. Bring that story to the next review. If nothing could falsify it, you are not measuring. You are decorating.
BASELINEFIND FRICTIONONE CHANGECHECK LEADINGKEEP / UNDOKILL DATEREPEAT
Fig. 03 · The working loop. A slogan is not a step in it.

If the green tile and the red quarter still disagree

The trap this essay is about does not disappear because you bought software. Any tool that only restates the same four cheerful numbers will become furniture again.

We build Positron Flux to put the outcome metrics next to the boring signals that explain them (review wait, batch size, test trust, path friction), and to support the loop above: one service, one change, leading measures, a kill date. If that is the work in front of you, Early Access is how we do it with a small number of teams. Apply, talk for thirty minutes, and decide if the fit is real.