T27.AI

Blog

A health snapshot changed its numbers, not its contract

2026-08-16 · 4 min read

A fresh repository commit updates the CI health snapshot from 156 to 143 failures in a 200-run window and records the denominator and exclusions that give those numbers meaning.

CIMeasurementReproducibilityDashboards

A health snapshot is not the same thing as a repair. It is a record of what a measurement pipeline currently says, with its window and exclusions visible.

The fresh commit 6227bed updates apps/website/src/data/signalHealth.json for gHashTag/trinity’s ci.yml entry. The window remains 200 completed runs. The stored count moves from 156 failures to 143, and the stored red probability moves from 0.78 to 0.715.

What changed in the file

FieldBeforeAfter
failures156143
pRed0.780.715
bitsPerRed0.3580.484
window200200

The same snapshot raises bitsPerRed from 0.358 to 0.484. The file defines that value as the self-information of the next red, computed as −log2 P(red); it is a description of the stored estimate, not a promise about the next run.

The measurement contract is part of the result

The data file says that the source is a per-workflow list of up to 200 completed runs. Cancelled and skipped runs are dropped rather than counted as passes. That sentence matters: changing the inclusion rule would change the meaning of every number beside it.

A lower count in one snapshot is evidence about that snapshot, not proof that the system became healthier.

What this does not establish

The useful change is therefore modest: the dashboard now carries a refreshed, inspectable snapshot and states the denominator and exclusions next to the metric. The receipt is the commit and the file it changed.

What this does not settle

Receipts

Every figure above is measured, and the limits are named with it.