Repository navigation
fix(tdg): CB-200 two over the baseline — one Rust fn refactored to A+, evidence/** excluded as reference harness, baseline lowered 602 → 601 - #3411
Merged
Conversation
… in scope (#PMAT-1098) `pmat comply check` read 604 against a baseline of 602 on the release commit. The box had moved 3.40.1 -> 3.40.2, so the first question was whether the instrument moved rather than the tree. It did not: the last main commit of 2026-09-15 (7ee0eca, the commit the 602 was measured on) reads 602 under 3.40.2 as well, in its own detached worktree and its own index. The +2 is code that landed on 2026-09-16. The baseline is a count, not a roster, so the two definitions the report names are the worst-graded survivors, not the new ones. Diffing the two rosters out of pmat's own context.db (the derivation reproduces 602/481 files and 604 exactly) gives 3 added and 1 removed: + forward_qwen35.rs from_model_and_layers C+ (15) #3114 + evidence/.../apr_raw_logits.cpp main F (48) #3354 + evidence/.../raw_logits_compare.cpp main C+ (21) #3355 - infer/inference_result.rs validate_gpu_first_token B- (17) Only the first is inside this ticket's scope. It is fixed by extraction, no behaviour change: the qwen2/qwen35 metadata fallback chain becomes qwen35_ssm_meta, and the two per-layer struct literals become own_deltanet_layer / own_attention_layer. C+ (15) -> A+ (4), every helper A or A+, and forward_qwen35.rs now has no definition below B. Reading 604 -> 603. The function had no test, because it needs a real hybrid GGUF. The extraction leaves one that does not: qwen35_ssm_meta takes a metadata map, so four tests now pin the defaults, the qwen2-wins-over-qwen35 precedence, non-integer-falls-through, and the per-section RoPE defaulting — behaviours the inline closure chain encoded and nothing asserted. The remaining 1 over is the vendored llama.cpp reference harness under evidence/, which is outside scope_paths and is a policy call (refactor the artefact / exclude evidence/ / re-baseline to 603) rather than this ticket's. docs/audits/cb200-0.68-roster.md records both measurements, the roster diff, the before/after grades, and the three ways to close it. Pmat-Ticket: PMAT-1098 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
…lude it and lower the CB-200 baseline 602 → 601 0.68.0 train T-2: pmat-comply RED on CB-200 (604 vs 602). Roster diff (worker, docs/audits/cb200-0.68-roster.md): three additions since the 09-15 baseline — forward_qwen35.rs::from_model_and_layers (C+, refactored to A+ in the previous commit) and two C++ mains of the vendored llama.cpp reference harness under evidence/. Excluding evidence/** and re-measuring gives 601; the baseline is lowered to that, never raised. Pmat-Ticket: PMAT-1098 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
§13.11 rung 1 — quorum shadow verdict Shadow mode: this records a verdict and merges nothing. A refusal |
check_complexity_ratchet.sh pairs the two: '[tdg] baseline = 601 but scripts/cb200_baseline.txt says 602; the two move together'. Pmat-Ticket: PMAT-1098 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Pmat-Ticket: PMAT-1098 Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
noahgift
enabled auto-merge
September 17, 2026 04:57
guyernest
pushed a commit
to guyernest/aprender
that referenced
this pull request
Sep 29, 2026
paiml#3411 paiml#3412), autopilot on paiml#3411 (paiml#3414) Pmat-Ticket: PMAT-1098 Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
T-2 of the 0.68.0 train (release commit
27f070324) went NO-GO onpmat-comply: CB-200 TDG Grade Gate 604 below B vs baseline 602. The gate says raising the baseline is not the fix, so the roster was derived on both sides from pmat's own index (docs/audits/cb200-0.68-roster.md): baseline commit7ee0ecaadreads 602 under the same pmat 3.40.2 (not a version delta), head 604 — three additions, one removal.crates/aprender-serve/src/gguf/inference/forward/forward_qwen35.rs::from_model_and_layers(C+, cyc 15, from feat(qwen35): Qwen3.5 / Qwen3.8 hybrid GGUFs run on the CPU — apr run + apr chat (#3091) #3114) → A+ (cyc 4) by pure extraction; every helper A/A+; 4 tests pin the extractedqwen35_ssm_metaseam;aprender-serve --lib15814/15814 green.mains of the vendored llama.cppd1d3c3396reference harness underevidence/parity/l0-1/…/producer/*.cpp, which exists to reproduce a cited measurement bit-for-bit.evidence/**is now excluded from[tdg](not shipped code; refactoring it would invalidate the evidence). Re-measured with the exclusion: 601. Baseline 602 → 601, lowered.pmat comply check --checks CB-200is green on this tree.no-close: #3114 — the PR that added the refactored function; referenced as history.
🤖 Generated with Claude Code
ont-delta: none — this PR adds a measurement note under docs/audits/ (the CB-200 roster) and touches no ontology row; no type, shape or anchor changes.