Repository navigation
Gate honesty: checks that pass with nothing measured or judge the wrong commit #5307
Closed as not planned
Description
Scope
Checks that pass without measuring anything: they read the wrong commit, count zero items as green, or accept a self-declared result.
Why it matters
A check that cannot fail is worse than no check, because it is trusted. These rows are known cases.
Done when
Each check named below fails on a planted bad input (a mutation proof is recorded) and judges the commit it claims to judge.
Parent epic: #3863.
Rows
- The release protocol's own reporting lied three ways: a fabricated 95% coverage note, a note-picker hijacked by crate names, and gate() keeping no log #3844 — The release protocol's own reporting lied three ways: a fabricated 95% coverage note, a note-picker hijacked by crate names, and gate() keeping no log
- THE UNIVERSE IS A GLOB: 10 of 28 held models are never measured, because inventory.patterns only matches q4_k/q4k — incl. a Q4_0 MoE and an unmeasured 35B Qwen3.5 #3846 — THE UNIVERSE IS A GLOB: 10 of 28 held models are never measured, because inventory.patterns only matches q4_k/q4k — incl. a Q4_0 MoE and an unmeasured 35B Qwen3.5 (branch:
c1/3846-into-b2) - spec_conformance D6: warn 7 days before any §12 row expires (issue + report line), never a surprise RED (post-0.70) #4652 — spec_conformance D6: warn 7 days before any §12 row expires (issue + report line), never a surprise RED (post-0.70) (branch:
feat/4652-d6-expiring) - fleet_cells_gate: a wildcard waiver waives any RED cell, and a non-date until never expires #5034 — fleet_cells_gate: a wildcard waiver waives any RED cell, and a non-date until never expires
- CI compute row passes a run of 0 tests (ci/sections.yml workspace-test-shard) #5048 — CI compute row passes a run of 0 tests (ci/sections.yml workspace-test-shard) (branch:
fix/5048-compute-zero-tests) - fleet_cells_gate: self-test rows for DEL(127), locale, day guards; run --self-test nightly #5064 — fleet_cells_gate: self-test rows for DEL(127), locale, day guards; run --self-test nightly — done when: each of the four has a self-test row that goes RED by its own rule on a planted input, and the real tree stays GREEN. (branch:
PMAT-5064-cells-selftest-rows) - yokoten: every gate that judges main's head at read time #5082 — yokoten: every gate that judges main's head at read time
- Scripts kill by name pattern; kill only the pid recorded at spawn #5108 — Scripts kill by name pattern; kill only the pid recorded at spawn
- models: full ladder sits on the scheduled night verdict; the release ships on crux smoke — move the ladder to a nightly ticket-only job, measure each stage, andon at 2x #5147 — models: full ladder sits on the scheduled night verdict; the release ships on crux smoke — move the ladder to a nightly ticket-only job, measure each stage, andon at 2x
- Push-path private-text scan let #5159 through with internal names in added lines, filenames and a commit trailer #5265 — Push-path private-text scan let feat(rex): land the review-experiment epic work on main (PMAT-4524) #5159 through with internal names in added lines, filenames and a commit trailer
Each row was a separate ticket, folded here under the 100-open-ticket cap (TRIAGE-100, 2026-10-14) and closed as not planned. Reopen a row's ticket when its work starts; an open PR for it reopens it.
Agent: aprender-clerk
Activity
[-]MASTER S1: folded sub-tickets[/-][+]Gate honesty: checks that pass with nothing measured or judge the wrong commit[/+]noahgift commentedon Oct 14, 2026
Row state, measured against
main@ 8c3b19c:git diff origin/main origin/fix/5048-compute-zero-testsand thefleet_cells_gate.shdiff againstPMAT-5064-cells-selftest-rowsare both empty, andguards-nightly.ymlon main runs both case tables. The CI compute row passes a run of 0 tests (ci/sections.yml workspace-test-shard) #5048 table holds 6/6, and--mutantskills the pre-CI compute row passes a run of 0 tests (ci/sections.yml workspace-test-shard) #5048 rule. These three boxes can be ticked. Brancha7n/5048-compute-zero-tests(a merge of main into the old branch) is redundant and gets no PR.feat/4652-d6-expiring(1 commit,--expiring+--file-issuesinscripts/spec_conformance.sh, +180 lines) is 32 behind. That is the next row here.🤖 Generated with Claude Code
noahgift commentedon Oct 14, 2026
Owner aprender-a7n. Plan per row, measured on
main@ 8c3b19c (0.72 freeze 10-16 12:00Z, due 10-17).pkill/killallline is left in any*.sh, workflow or Makefile. The three remaining hits are prose incontracts/claude-code-parity-apr-v1.yamla7n/4652-d6-expiring@ 07ff7e864d, main merged, selftest 56/0c1/3846-into-b2is 186 behindIn 0.72: #4652, #3846, plus the evidence for #5108 and the #3844 audit. #5082, #5147 and #5265 deliver their survey or table by the freeze and land the code in 0.73.
noahgift commentedon Oct 14, 2026
#3846 row, correction to the plan above: it is not a plain re-cut. Of the branch's 19 commits, only two are this row's: 087c8d7 and a34b910. 087c8d7 adds a new
scripts/lib/model_ladder_universe.py(207 lines; it reads GGUF, APR and safetensors headers) and more inlinepython3inscripts/model_ladder.sh. New Python is not accepted, so cherry-picking it would add exactly what is banned.New plan: port the universe scan so the header reads go through
apr inspect --json(Rust, already in tree) plusjq. The fixtures (four case dirs: green-held-not-swept, red-held-not-swept-no-reason, red-held-not-swept-unreadable, red-held-unaccounted) carry over unchanged as the case table. That needs anaprbuild to measure against, so the row moves to 0.73. For 0.72: the port design on this issue by 10-16 12:00Z.noahgift commentedon Oct 14, 2026
#3844 audit (row from the plan above): all three fixes are on main, nothing to post. The original commit e8c341c never reached main, but the same code landed via the v0.69.3 merge-back (#4338, 5fa13fe). Checked at main 8c3b19c:
scripts/dogfood.sh, cov_pct extractor anchored tolines covered (N%)""(fallback fires);TOTAL: 824853/939270 lines covered (87.82%)gives87.82%gate()threw away its output; the note-picker matched crate namesscripts/dogfood.shgate(): writes$WORKLOG/<name>.log,[log: …]on red, anchored pickerthiserror,proc-macro-error-attr2,0 failno longer match; the three real diagnostics still do)redscalar not reconciled with the rowsscripts/check_model_ladder.shdeclared_redcheck--self-test: 153 cases, 0 bad, rc 0;red-receipt-red-not-recordedrc=1 (the mutant is caught); the #3842 cross-check passesMutation proof for 3 is that fixture. 1 and 2 are pattern case tables, run as above.
noahgift commentedon Oct 14, 2026
Merged into #2876 (TRIAGE-100, 2026-10-14): same theme, so this master's scope and every checklist row now live on #2876, and this ticket is closed as not planned. Reopen it if the theme splits again.
Agent: aprender-clerk