GA Metrics Inventory — Trinity v2.2.0
Date: 2026-03-08
Purpose: Single Source of Truth for all GA certification metrics
Status: DRAFT - TODO 6 SA-2
Conflict Map
| Metric | Value A | Value B | Value C | Source Files | Discrepancy |
|---|
| Total Tests | 3610 | 3589 | 3588 | RELEASES.md, GA_FINAL_VERDICT.md, GA_CERTIFICATION | 22 tests diff |
| Passed Tests | 3600 | 3584 | 3582 | RELEASES.md, GA_FINAL_VERDICT.md, GA_CERTIFICATION | 18 tests diff |
| Pass Rate | 99.72% | 99.86% | 100% | Multiple | Inconsistent |
| rc1 Pass Rate | 99.83% | 99.83% | - | Consistent | ✅ |
| Contract Tests | 19/19 | 19/19 | 19/19 | All | ✅ Consistent |
| VSA SIMILARITY | 26.3M | 26M | 26.0M | Multiple | Minor rounding |
| Idiom Compliance | 100% | 100% | - | Consistent | ✅ |
Detailed Inventory
Test Count Metrics
| File | Value | Pass Rate | Context | Timestamp |
|---|
| RELEASES.md (GA section) | 3600/3610 | 99.72% | SA-5 TEST result | 2026-03-08 |
| GA_FINAL_VERDICT.md (table) | 3582/3588 | 99.83% | rc1 baseline | Pre-GA |
| GA_FINAL_VERDICT.md (text) | 3584/3589 | 99.86% | Baseline reference | Pre-GA |
| GA_CERTIFICATION_v2.2.0.md | 3584/3589 | 99.86% | Phase 3 reference | Pre-GA |
| GA_EXECUTION_CHECKLIST.md | 3584/3589 | 99.86% | Planning baseline | Pre-GA |
Suspected Cause: Different test runs at different times:
- 3588/3589 = TODO 4 baseline (pre-GA)
- 3600/3610 = TODO 5 SA-5 actual run (during GA)
VSA Benchmark Metrics
| Operation | Value | Unit | Source | Status |
|---|
| BIND | 264K | ops/sec | GA_FINAL_VERDICT.md | ✅ Canonical |
| BUNDLE | 235K | ops/sec | GA_FINAL_VERDICT.md | ✅ Canonical |
| PERMUTE | 2.96B | ops/sec | GA_FINAL_VERDICT.md | ✅ Canonical |
| SIMILARITY | 26.3M | ops/sec | GA_FINAL_VERDICT.md | ✅ Canonical |
Contract Tests
| Test Suite | Pass | Total | Source | Status |
|---|
| IConfigManager | 5 | 5 | GA_CERTIFICATION_v2.2.0.md | ✅ |
| IPersistentState | 5 | 5 | GA_CERTIFICATION_v2.2.0.md | ✅ |
| IBatchExecutor | 4 | 4 | GA_CERTIFICATION_v2.2.0.md | ✅ |
| Sacred Constants | 1 | 1 | GA_CERTIFICATION_v2.2.0.md | ✅ |
| TOTAL | 19 | 19 | All docs | ✅ Consistent |
Wording Issues Found
| Location | Problem | Wording | Should Be |
|---|
| GA_FINAL_VERDICT.md (line 27) | Misleading | "GA (100% certified)" | "GA (certified with caveats)" |
| GA_FINAL_VERDICT.md (line 86) | Overclaim | "100% idiom compliance" | "100% idiom compliance (codegen only)" |
| RELEASES.md (GA section) | Mixed signal | Table says 99.72%, text says 100% | Align to single value |
Evidence References
| Metric | Evidence File | Commit | Note |
|---|
| 3600/3610 tests | TODO 5 SA-5 run | d4a8545b1 | Actual GA test run |
| 3584/3589 tests | TODO 4 baseline | f667b7ad4 | Pre-GA baseline |
| Contract 19/19 | TODO 4 verdict | f667b7ad4 | Verified |
| VSA 26.3M ops/s | TODO 5 SA-7 | d4a8545b1 | GA benchmark run |
Canonical Values Decision
Rule: Use the TODO 5 GA certification run values (d4a8545b1) as canonical, since these are the actual results during the certification process.
| Metric | Canonical Value | Source | Evidence |
|---|
| Total Tests | 3610 | TODO 5 SA-5 | d4a8545b1 |
| Passed Tests | 3600 | TODO 5 SA-5 | d4a8545b1 |
| Pass Rate | 99.72% | Calculated | 3600/3610 |
| Contract Tests | 19/19 | TODO 4 | f667b7ad4 |
| VSA SIMILARITY | 26.3M ops/s | TODO 5 SA-7 | d4a8545b1 |
Files Requiring Update
- RELEASES.md - GA section (99.72% already correct)
- GA_FINAL_VERDICT.md - Align to 99.72%, fix "100% certified"
- GA_CERTIFICATION_v2.2.0.md - Update baseline reference
- All GA planning docs - Mark as superseded by manifest
φ² + 1/φ² = 3 | TODO 6 SA-2: METRIC INVENTORY