Skip to content

DEFECT: pv validate passes a contract with no falsification tests or an empty test_harness (763 contracts have zero tests) #5291

Closed as not planned
Closed as not planned
DEFECT: pv validate passes a contract with no falsification tests or an empty test_harness (763 contracts have zero tests)#5291
Labels
bugSomething isn't working

Description

@noahgift
noahgift
opened on Oct 14, 2026

pv validate returns rc 0 with 0 errors on a contract that cannot run any falsification test. Found while reviewing #5290 by mutating one of its contracts:

mutant pv validate today
falsification_tests: [] rc 0, 0 errors
every test_harness set to "" rc 0, 0 errors
(control) empty prediction rc 1, SCHEMA-008
(control) duplicate test id rc 1, SCHEMA-007

So "the contract validates" says nothing about whether any test exists or names a harness.

Fix: refuse both shapes in crates/aprender-contracts/src/schema/, the same way SCHEMA-008 refuses an empty prediction. Ship a must-pass / must-fail case table.

Before the fix lands: run the new rule over every contract in contracts/ and list in the PR each contract that newly fails. Nothing is loosened to make that list shorter.

Out of scope here (also seen in the same review, separate ticket if wanted): empty expected_output, an obligation pointing at a nonexistent equation, an equation with no obligation.

Activity

  1. noahgift
    added a parent issue on Oct 14, 2026
  2. noahgift
    changed the title [-]pv validate accepts a contract with no falsification tests or an empty test_harness[/-] [+]DEFECT: pv validate passes a contract with no falsification tests or an empty test_harness (818 contracts have zero tests)[/+] on Oct 14, 2026
  3. noahgift
    added
    bugSomething isn't working
    on Oct 14, 2026

  4. noahgift commented on Oct 14, 2026

    @noahgift
    noahgift
    on Oct 14, 2026
    MemberAuthor

    Reclassified as a DEFECT (label bug). pv validate passed a contract that cannot run a single test.

    Measured (origin/main d97936f, pv built from it plus the fix branch)

    count
    contracts in pv's universe (the pv lint / pv census walker) 1913
    contracts with zero falsification_tests (parsed by pv) 763 (a raw find gives 818 of 1974, but 55 of those are outside pv's universe: binding/ontology files and the kaizen/ and publish-manifests/ dirs pv never walks)
    …of which carry only the legacy top-level falsification: block, which no pv gate reads 412
    …of which have proof obligations but zero tests 20
    by declared metadata.kind schema 572, (none) 131, model-family 28, beat-benchmark 12, registry 8, pattern 7, pretraining-corpus 2, training-loop 1, tokenizer 1, model-family-variant 1
    contracts with falsification_tests: [] written, or a written-but-blank test_harness/test 0 (patched pv over all 1974 .yaml files; the same binary refuses both #5290 mutants with rc 1, so the zero is not vacuous)

    Five whys: why did pv pass it?

    1. Why did pv validate pass the docs(spec): apr code eval — APR-CODE-EVAL-001 spec + pv ontology contracts (Refs #5282) #5290 contract with falsification_tests: []? Its metadata says kind: kernel and also the legacy registry: true. Contract::kind() turns that pair into Registry, so the kernel branch with PROVABILITY-001 ("Kernel contract has no falsification_tests") never ran.
    2. Why does a registry pass with an empty test block? The non-kernel branch validates only the tests that are present (validate_contract, "still validate any … falsification … data that IS present"). Because of #[serde(default)], an absent key and a written [] are the same empty Vec, so no rule can tell "this kind needs no tests" from "this declares a test block and put nothing in it".
    3. Why did six blank test_harness values pass? validate never reads test or test_harness. Only the test-binding check (strict_test_binding) reads them, and it is not part of validate.
    4. Why did no test catch it? The validator suite had no row with an empty test block on a non-kernel kind, and none with a blank harness. Empty was in fact the normal fixture: 143 occurrences in aprender-contracts test fixtures write falsification_tests: [] for convenience.
    5. Why did 763 contracts with no tests pile up with nothing going red? No gate counts them. pv lint and pv coverage are not called from any CI workflow, pv coverage has no threshold and always exits 0, and the planned pv-contract ratchet (CENSUS-RATCHET: entity-bound contracts never drop and rise every release #4709 / ONT coverage P0: make contracts stops after pv lint (.ONESHELL exit); extract --check not on PRs; per-entity-type shape coverage ratchet #4475) was never built.

    Yokoten: do other pv verbs count an empty contract as covered? (pv 0.71.1, the two #5290 mutants)

    verb falsification_tests: [] six blank test_harness
    pv lint all 4 gates Pass (score threshold 0.00) all 4 gates Pass
    pv score Falsify 0.00, grade F, but lint still passes Falsify 1.00, the same as the original, so it counts as covered
    pv coverage contributes 0 obligations covered counted covered: falsification_covered = obligations if ft_count > 0; harness never read
    pv certify not measured yet not measured yet

    pv coverage's "Overall obligation coverage: 98.4%" measures "the contract has at least one test entry", not "each obligation has a test that runs".

    Fix (one PR)

    • SCHEMA-024: falsification_tests: written and empty → error, on every kind.
    • SCHEMA-025: test_harness: or test: written but blank → error, on every kind.
    • No-test debt (operator's 4-part split): a contract with zero tests is refused by pv unless it is on a checked-in debt list of the 763 above. The list can only shrink (an entry that now has tests must be removed), and its length is checked against the step for the workspace version: ≤763 on 0.71.x, ≤572 at 0.72.0, ≤381 at 0.73, ≤190 at 0.74, 0 at 0.75. That is pass/fail in the lib tests, which run in workspace-test; there is no report-only row. The count is printed by pv so the census ratchet (CENSUS-RATCHET: entity-bound contracts never drop and rise every release #4709) reads pv, not a grep.
    • RED proof: the case-table rows fail on the parent commit and pass on the fix.

    The four part lists follow in the next comment.

  5. noahgift commented on Oct 14, 2026

    @noahgift
    noahgift
    on Oct 14, 2026
    MemberAuthor

    No-test debt split into four parts (operator ruling), corrected to pv's universe: 763 contracts (an earlier version of this comment used a raw find count of 818). Order: contracts with proof obligations first, then non-schema kinds, then contracts whose tests already sit in a legacy falsification: block (convert, do not rewrite), then the rest. Measured on d97936f. Part 1 owner: aprender-a7n. Parts 2 to 4: owners to be assigned by the cop.

    Part 1: 191 contracts, release 0.71 (done before the 0.72.0 tag; count ≤572 there)
    contract kind legacy block obligations
    contracts/apr-trace-v1.yaml none yes 2
    contracts/clustering-metrics-relabel-invariant-v1.yaml none yes 3
    contracts/dry-penalty-repeat-len-v1.yaml none yes 1
    contracts/f16-to-f32-subnormal-v1.yaml none yes 3
    contracts/incomplete-beta-correctness-v1.yaml none yes 2
    contracts/knn-tie-smallest-label-v1.yaml none yes 5
    contracts/lasso-elasticnet-alpha-v1.yaml none yes 3
    contracts/lora-adapter-merge-cli-v1.yaml none yes 2
    contracts/pretokenize-bin-v1.yaml pretraining-corpus yes 3
    contracts/quant-solve-f16-round-v1.yaml none yes 5
    contracts/qwen3moe-rope-theta-v1.yaml none yes 2
    contracts/safetensors-bf16-round-v1.yaml none yes 4
    contracts/safetensors-f16-round-v1.yaml none yes 4
    contracts/serve-batched-gpu-gqa-dispatch-v1.yaml none yes 1
    contracts/tokenizer-v1.yaml none yes 8
    contracts/train-test-split-ceil-v1.yaml none yes 4
    contracts/tree-feature-importances-mdi-v1.yaml none yes 5
    contracts/ttest-exact-pvalue-v1.yaml none yes 2
    contracts/ward-linkage-v1.yaml none yes 5
    contracts/xtc-sampling-correctness-v1.yaml none yes 1
    contracts/apr-antigravity-parity-v1.yaml pattern yes 0
    contracts/apr-book-build-v1.yaml none yes 0
    contracts/apr-book-ch01-v1.yaml none yes 0
    contracts/apr-book-ch02-v1.yaml none yes 0
    contracts/apr-book-ch03-v1.yaml none yes 0
    contracts/apr-book-ch04-v1.yaml none yes 0
    contracts/apr-book-ch05-v1.yaml none yes 0
    contracts/apr-book-ch06-v1.yaml none yes 0
    contracts/apr-book-ch07-v1.yaml none yes 0
    contracts/apr-book-ch08-v1.yaml none yes 0
    contracts/apr-book-ch09-v1.yaml none yes 0
    contracts/apr-book-ch10-v1.yaml none yes 0
    contracts/apr-book-ch11-v1.yaml none yes 0
    contracts/apr-book-ch12-v1.yaml none yes 0
    contracts/apr-book-ch13-v1.yaml none yes 0
    contracts/apr-book-ch14-v1.yaml none yes 0
    contracts/apr-book-ch15-v1.yaml none yes 0
    contracts/apr-book-ch16-v1.yaml none yes 0
    contracts/apr-book-ch17-v1.yaml none yes 0
    contracts/apr-book-ch18-v1.yaml none yes 0
    contracts/apr-book-ch19-v1.yaml none yes 0
    contracts/apr-book-ch20-v1.yaml none yes 0
    contracts/apr-claude-proxy-v1.yaml pattern yes 0
    contracts/apr-cli-commands-v1.yaml none yes 0
    contracts/apr-code-parity-v1.yaml pattern yes 0
    contracts/apr-corpus-algorithm-competition-corpus-v1.yaml none yes 0
    contracts/apr-corpus-databricks-ground-truth-corpus-v1.yaml none yes 0
    contracts/apr-corpus-databricks-scala-ground-truth-corpus-v1.yaml none yes 0
    contracts/apr-corpus-hugging-face-ground-truth-corpus-v1.yaml none yes 0
    contracts/apr-corpus-jax-ground-truth-corpus-v1.yaml none yes 0
    contracts/apr-corpus-lean-ground-truth-v1.yaml none yes 0
    contracts/apr-corpus-ludwig-ground-truth-corpus-v1.yaml none yes 0
    contracts/apr-corpus-mixed-python-rust-ground-truth-v1.yaml none yes 0
    contracts/apr-corpus-mixed-rust-lean-ground-truth-v1.yaml none yes 0
    contracts/apr-corpus-safe-lua-groundtruth-v1.yaml none yes 0
    contracts/apr-corpus-tgi-ground-truth-corpus-v1.yaml none yes 0
    contracts/apr-corpus-tiny-model-ground-truth-v1.yaml none yes 0
    contracts/apr-corpus-vllm-ground-truth-corpus-v1.yaml none yes 0
    contracts/apr-gemini-proxy-v1.yaml pattern yes 0
    contracts/apr-hnsw-persistence-v1.yaml registry yes 0
    contracts/apr-hybrid-retrieval-v1.yaml registry yes 0
    contracts/apr-mcp-server-v1.yaml registry yes 0
    contracts/apr-mcp-tool-inventory-v1.yaml registry yes 0
    contracts/apr-mcp-tool-schemas-v1.yaml none yes 0
    contracts/apr-model-capability-v1.yaml registry yes 0
    contracts/apr-org-taxonomy-v1.yaml none yes 0
    contracts/apr-registry-snapshot-v1.yaml registry yes 0
    contracts/apr-rerank-v1.yaml registry yes 0
    contracts/apr-serve-api-key-auth-v1.yaml registry yes 0
    contracts/apr-tool-bashrs-v1.yaml none yes 0
    contracts/apr-tool-ccpo-v1.yaml none yes 0
    contracts/apr-tool-cohete-v1.yaml none yes 0
    contracts/apr-tool-copia-v1.yaml none yes 0
    contracts/apr-tool-decy-v1.yaml none yes 0
    contracts/apr-tool-depyler-v1.yaml none yes 0
    contracts/apr-tool-duende-v1.yaml none yes 0
    contracts/apr-tool-forjar-v1.yaml none yes 0
    contracts/apr-tool-manzana-v1.yaml none yes 0
    contracts/apr-tool-microgpt-v1.yaml none yes 0
    contracts/apr-tool-organizational-intelligence-plugin-v1.yaml none yes 0
    contracts/apr-tool-paiml-mcp-agent-toolkit-v1.yaml none yes 0
    contracts/apr-tool-pcode-v1.yaml none yes 0
    contracts/apr-tool-pdmt-v1.yaml none yes 0
    contracts/apr-tool-pepita-v1.yaml none yes 0
    contracts/apr-tool-pforge-v1.yaml none yes 0
    contracts/apr-tool-rascal-v1.yaml none yes 0
    contracts/apr-tool-rmedia-v1.yaml none yes 0
    contracts/apr-tool-rust-mcp-sdk-v1.yaml none yes 0
    contracts/apr-tool-rust-mdipierro-nlib-v1.yaml none yes 0
    contracts/apr-tool-spydecy-v1.yaml none yes 0
    contracts/archive-repos-v1.yaml none yes 0
    contracts/attention-backward-v1.yaml none yes 0
    contracts/avx512-blis-v1.yaml none yes 0
    contracts/avx512-q4k-v1.yaml none yes 0
    contracts/bpe-encode-bytes-to-unicode-v1.yaml none yes 0
    contracts/cgp-monorepo-build-v1.yaml none yes 0
    contracts/cgp-monorepo-consolidation-v1.yaml none yes 0
    contracts/chat-template-v1.yaml none yes 0
    contracts/claude-code-parity-apr-v1.yaml pattern yes 0
    contracts/clean-chat-output-v1.yaml none yes 0
    contracts/codegen-dispatch-v1.yaml none yes 0
    contracts/comply-check-v1.yaml none yes 0
    contracts/compression-roundtrip-v1.yaml none yes 0
    contracts/context-generation-v1.yaml none yes 0
    contracts/converter-moe-headdim-import-v1.yaml none yes 0
    contracts/crux-competitive-research-ux-v1.yaml none yes 0
    contracts/cuda-classify-training-v1.yaml none yes 0
    contracts/dataset-thestack-python-v1.yaml pretraining-corpus yes 0
    contracts/dimension-independent-kernels-v1.yaml none yes 0
    contracts/distributed-training-v1.yaml none yes 0
    contracts/encoder-roundtrip-v1.yaml none yes 0
    contracts/eval-passk-single-sample-v1.yaml none yes 0
    contracts/export-user-metadata-roundtrip-v1.yaml none yes 0
    contracts/fp16-cublas-gemm-v1.yaml none yes 0
    contracts/gemm-backward-tiled-v1.yaml none yes 0
    contracts/glm-irls-link-derivative-v1.yaml none yes 0
    contracts/golden-trace-v1.yaml none yes 0
    contracts/gpt2-bpe-decode-roundtrip-v1.yaml none yes 0
    contracts/gradient-accumulation-mean-v1.yaml none yes 0
    contracts/lora-adapter-scale-roundtrip-v1.yaml none yes 0
    contracts/lora-gradient-flow-v1.yaml none yes 0
    contracts/lora-target-selection-v1.yaml none yes 0
    contracts/memory-safety-v1.yaml none yes 0
    contracts/metrics-macro-average-v1.yaml none yes 0
    contracts/model-family-parity-v1.yaml none yes 0
    contracts/moe-expert-dispatch-v1.yaml none yes 0
    contracts/moe-router-v1.yaml none yes 0
    contracts/nf4-backward-tensor-core-gemm-v1.yaml none yes 0
    contracts/openai-serve-sampling-determinism-v1.yaml none yes 0
    contracts/orchestrate-macos-portability-v1.yaml none yes 0
    contracts/parser-soundness-v1.yaml none yes 0
    contracts/pipeline-cache-v1.yaml none yes 0
    contracts/present-yaml-expression-executor-v1.yaml pattern yes 0
    contracts/prune-sparsity-correctness-v1.yaml none yes 0
    contracts/q3k-dequant-correctness-v1.yaml none yes 0
    contracts/q5k-dequant-correctness-v1.yaml none yes 0
    contracts/qlora-hyperparameters-v1.yaml none yes 0
    contracts/qwen35-hybrid-serve-dispatch-v1.yaml none yes 0
    contracts/qwen3-moe-repetition-penalty-v1.yaml none yes 0
    contracts/qwen3-moe-sampling-v1.yaml none yes 0
    contracts/qwen3-moe-serve-dispatch-v1.yaml none yes 0
    contracts/qwen3-moe-streaming-sse-v1.yaml none yes 0
    contracts/simd-scalar-parity-v1.yaml none yes 0
    contracts/sparse-spmv-v1.yaml none yes 0
    contracts/tdg-scoring-v1.yaml none yes 0
    contracts/tracing-observability-v1.yaml none yes 0
    contracts/trainer-grad-clip-v1.yaml none yes 0
    contracts/apr-lora-merge-equivalence-beat-v1.yaml beat-benchmark 0
    contracts/apr-nf4-bitsandbytes-equivalence-beat-v1.yaml beat-benchmark 0
    contracts/apr-pytorch-autograd-equivalence-beat-v1.yaml beat-benchmark 0
    contracts/apr-qlora-composed-forward-equivalence-beat-v1.yaml beat-benchmark 0
    contracts/apr-sklearn-gaussiannb-accuracy-beat-v1.yaml beat-benchmark 0
    contracts/apr-sklearn-metrics-parity-beat-v1.yaml beat-benchmark 0
    contracts/apr-sklearn-pipeline-encoder-beat-v1.yaml beat-benchmark 0
    contracts/apr-sklearn-svc-accuracy-beat-v1.yaml beat-benchmark 0
    contracts/beat-lora-gguf-lossless-deploy-v1.yaml beat-benchmark 0
    contracts/beat-ollama-decode-throughput-speed-v1.yaml beat-benchmark 0
    contracts/beat-sklearn-iris-v1.yaml beat-benchmark 0
    contracts/beat-sklearn-linreg-speed-v1.yaml beat-benchmark 0
    contracts/model-families/bert.yaml model-family 0
    contracts/model-families/bloom.yaml model-family 0
    contracts/model-families/deepseek.yaml model-family 0
    contracts/model-families/falcon_h1.yaml model-family 0
    contracts/model-families/falcon.yaml model-family 0
    contracts/model-families/gemma.yaml model-family 0
    contracts/model-families/gpt2.yaml model-family 0
    contracts/model-families/gpt_bigcode.yaml model-family 0
    contracts/model-families/gptneox.yaml model-family 0
    contracts/model-families/granite.yaml model-family 0
    contracts/model-families/internlm2.yaml model-family 0
    contracts/model-families/llama-370m-sovereign-v1.yaml model-family-variant 0
    contracts/model-families/llama.yaml model-family 0
    contracts/model-families/mamba.yaml model-family 0
    contracts/model-families/mistral.yaml model-family 0
    contracts/model-families/moonshine.yaml model-family 0
    contracts/model-families/nemotron.yaml model-family 0
    contracts/model-families/olmo.yaml model-family 0
    contracts/model-families/openelm.yaml model-family 0
    contracts/model-families/opt.yaml model-family 0
    contracts/model-families/phi.yaml model-family 0
    contracts/model-families/qwen2.yaml model-family 0
    contracts/model-families/qwen3_5.yaml model-family 0
    contracts/model-families/qwen3.yaml model-family 0
    contracts/model-families/rwkv7.yaml model-family 0
    contracts/model-families/_schema.yaml model-family 0
    contracts/model-families/stablelm.yaml model-family 0
    contracts/model-families/starcoder2.yaml model-family 0
    contracts/model-families/whisper.yaml model-family 0
    contracts/thinking-budgets-v1.yaml pattern 0
    contracts/tokenizer-bpe-v1.yaml tokenizer 0
    contracts/training-loop-pretrain-v1.yaml training-loop 0
    Part 2: 191 contracts, release 0.72 (≤381 at 0.73)
    contract kind legacy block obligations
    contracts/apr-book-ch21-v1.yaml schema yes 0
    contracts/apr-book-ch22-v1.yaml schema yes 0
    contracts/apr-book-ch23-v1.yaml schema yes 0
    contracts/apr-book-ch24-v1.yaml schema yes 0
    contracts/apr-book-ch25-v1.yaml schema yes 0
    contracts/apr-book-ch26-v1.yaml schema yes 0
    contracts/apr-book-ch27-v1.yaml schema yes 0
    contracts/apr-book-schema-v1.yaml schema yes 0
    contracts/apr-page-advanced-testing-mutation-testing-v1.yaml schema yes 0
    contracts/apr-page-advanced-testing-popperian-falsification-v1.yaml schema yes 0
    contracts/apr-page-architecture-crate-map-v1.yaml schema yes 0
    contracts/apr-page-architecture-monorepo-layout-v1.yaml schema yes 0
    contracts/apr-page-architecture-provable-contracts-v1.yaml schema yes 0
    contracts/apr-page-best-practices-api-design-v1.yaml schema yes 0
    contracts/apr-page-best-practices-builder-pattern-v1.yaml schema yes 0
    contracts/apr-page-best-practices-documentation-standards-v1.yaml schema yes 0
    contracts/apr-page-best-practices-error-handling-v1.yaml schema yes 0
    contracts/apr-page-best-practices-performance-v1.yaml schema yes 0
    contracts/apr-page-best-practices-type-safety-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch01-why-rust-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch02-tensors-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch03-apr-format-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch04-supervised-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch05-unsupervised-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch06-ensembles-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch07-model-selection-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch08-transformer-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch09-inference-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch10-training-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch11-formats-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch12-serving-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch13-profiling-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch14-contracts-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch15-orchestrate-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch16-timeseries-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch17-bayesian-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch18-graphs-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch19-text-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch20-rag-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch21-vs-candle-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch22-vs-llamacpp-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch23-training-benchmarks-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch24-switch-from-pytorch-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch25-switch-from-ollama-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch26-switch-from-ndarray-v1.yaml schema yes 0
    contracts/apr-page-chapters-ch27-switch-from-unsloth-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-chat-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-convert-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-finetune-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-inspect-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-pull-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-run-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-serve-v1.yaml schema yes 0
    contracts/apr-page-cli-reference-apr-validate-v1.yaml schema yes 0
    contracts/apr-page-examples-aco-tsp-v1.yaml schema yes 0
    contracts/apr-page-examples-admm-optimization-v1.yaml schema yes 0
    contracts/apr-page-examples-advanced-merge-v1.yaml schema yes 0
    contracts/apr-page-examples-advanced-nlp-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-cache-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-checkpoint-lifecycle-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-cli-commands-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-cli-demo-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-embed-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-format-deep-dive-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-inspection-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-loading-modes-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-scoring-v1.yaml schema yes 0
    contracts/apr-page-examples-apr-with-metadata-v1.yaml schema yes 0
    contracts/apr-page-examples-audio-mel-spectrogram-v1.yaml schema yes 0
    contracts/apr-page-examples-autograd-training-v1.yaml schema yes 0
    contracts/apr-page-examples-automl-clustering-v1.yaml schema yes 0
    contracts/apr-page-examples-batch-optimization-v1.yaml schema yes 0
    contracts/apr-page-examples-batuta-integration-v1.yaml schema yes 0
    contracts/apr-page-examples-bayesian-blocks-histogram-v1.yaml schema yes 0
    contracts/apr-page-examples-bench-bpe-v1.yaml schema yes 0
    contracts/apr-page-examples-bench-comparison-v1.yaml schema yes 0
    contracts/apr-page-examples-beta-binomial-inference-v1.yaml schema yes 0
    contracts/apr-page-examples-bundle-trace-demo-v1.yaml schema yes 0
    contracts/apr-page-examples-cbtop-profiling-falsification-v1.yaml schema yes 0
    contracts/apr-page-examples-chat-template-v1.yaml schema yes 0
    contracts/apr-page-examples-citl-automated-repair-v1.yaml schema yes 0
    contracts/apr-page-examples-classification-training-v1.yaml schema yes 0
    contracts/apr-page-examples-code-analysis-v1.yaml schema yes 0
    contracts/apr-page-examples-code-eda-v1.yaml schema yes 0
    contracts/apr-page-examples-code-feature-extractor-v1.yaml schema yes 0
    contracts/apr-page-examples-community-detection-v1.yaml schema yes 0
    contracts/apr-page-examples-constrained-optimization-v1.yaml schema yes 0
    contracts/apr-page-examples-content-recommender-v1.yaml schema yes 0
    contracts/apr-page-examples-continual-pretraining-v1.yaml schema yes 0
    contracts/apr-page-examples-convex-optimization-v1.yaml schema yes 0
    contracts/apr-page-examples-conv-layout-dogfood-v1.yaml schema yes 0
    contracts/apr-page-examples-create-test-apr-v1.yaml schema yes 0
    contracts/apr-page-examples-create-test-transformer-apr-v1.yaml schema yes 0
    contracts/apr-page-examples-cross-validation-v1.yaml schema yes 0
    contracts/apr-page-examples-cuda-backend-v1.yaml schema yes 0
    contracts/apr-page-examples-custom-error-classifier-v1.yaml schema yes 0
    contracts/apr-page-examples-dam-merge-v1.yaml schema yes 0
    contracts/apr-page-examples-data-preprocessing-scalers-v1.yaml schema yes 0
    contracts/apr-page-examples-data-quality-pipeline-v1.yaml schema yes 0
    contracts/apr-page-examples-dbscan-clustering-v1.yaml schema yes 0
    contracts/apr-page-examples-decision-tree-regression-v1.yaml schema yes 0
    contracts/apr-page-examples-descriptive-statistics-v1.yaml schema yes 0
    contracts/apr-page-examples-design-by-contract-v1.yaml schema yes 0
    contracts/apr-page-examples-differential-evolution-v1.yaml schema yes 0
    contracts/apr-page-examples-dirichlet-multinomial-inference-v1.yaml schema yes 0
    contracts/apr-page-examples-distillation-advanced-v1.yaml schema yes 0
    contracts/apr-page-examples-dpo-preference-v1.yaml schema yes 0
    contracts/apr-page-examples-eval-harness-v1.yaml schema yes 0
    contracts/apr-page-examples-evolutionary-merge-v1.yaml schema yes 0
    contracts/apr-page-examples-examples-reference-v1.yaml schema yes 0
    contracts/apr-page-examples-explainability-audit-v1.yaml schema yes 0
    contracts/apr-page-examples-federation-gateway-v1.yaml schema yes 0
    contracts/apr-page-examples-federation-routing-v1.yaml schema yes 0
    contracts/apr-page-examples-gamma-poisson-inference-v1.yaml schema yes 0
    contracts/apr-page-examples-gbm-iris-v1.yaml schema yes 0
    contracts/apr-page-examples-gmm-clustering-v1.yaml schema yes 0
    contracts/apr-page-examples-gnn-node-classification-v1.yaml schema yes 0
    contracts/apr-page-examples-gpu-fallback-dogfood-v1.yaml schema yes 0
    contracts/apr-page-examples-graph-algorithms-comprehensive-v1.yaml schema yes 0
    contracts/apr-page-examples-graph-social-network-v1.yaml schema yes 0
    contracts/apr-page-examples-grid-search-tuning-v1.yaml schema yes 0
    contracts/apr-page-examples-hex-forensics-v1.yaml schema yes 0
    contracts/apr-page-examples-hierarchical-clustering-v1.yaml schema yes 0
    contracts/apr-page-examples-isolation-forest-anomaly-v1.yaml schema yes 0
    contracts/apr-page-examples-knn-iris-v1.yaml schema yes 0
    contracts/apr-page-examples-lof-anomaly-v1.yaml schema yes 0
    contracts/apr-page-examples-logic-family-tree-v1.yaml schema yes 0
    contracts/apr-page-examples-logistic-regression-v1.yaml schema yes 0
    contracts/apr-page-examples-lottery-ticket-pruning-v1.yaml schema yes 0
    contracts/apr-page-examples-market-basket-apriori-v1.yaml schema yes 0
    contracts/apr-page-examples-mem-test-full-v1.yaml schema yes 0
    contracts/apr-page-examples-mem-test-v1.yaml schema yes 0
    contracts/apr-page-examples-metaheuristics-optimization-v1.yaml schema yes 0
    contracts/apr-page-examples-mixture-of-experts-v1.yaml schema yes 0
    contracts/apr-page-examples-model-bundling-paging-v1.yaml schema yes 0
    contracts/apr-page-examples-model-format-v1.yaml schema yes 0
    contracts/apr-page-examples-model-merge-strategies-v1.yaml schema yes 0
    contracts/apr-page-examples-model-serialization-v1.yaml schema yes 0
    contracts/apr-page-examples-model-serving-v1.yaml schema yes 0
    contracts/apr-page-examples-model-zoo-v1.yaml schema yes 0
    contracts/apr-page-examples-moe-construction-v1.yaml schema yes 0
    contracts/apr-page-examples-monte-carlo-simulation-v1.yaml schema yes 0
    contracts/apr-page-examples-naive-bayes-iris-v1.yaml schema yes 0
    contracts/apr-page-examples-negative-binomial-glm-v1.yaml schema yes 0
    contracts/apr-page-examples-neural-network-training-v1.yaml schema yes 0
    contracts/apr-page-examples-nlp-advanced-v1.yaml schema yes 0
    contracts/apr-page-examples-normal-inverse-gamma-inference-v1.yaml schema yes 0
    contracts/apr-page-examples-online-learning-v1.yaml schema yes 0
    contracts/apr-page-examples-pca-iris-v1.yaml schema yes 0
    contracts/apr-page-examples-per-layer-merge-v1.yaml schema yes 0
    contracts/apr-page-examples-phi-hf-import-v1.yaml schema yes 0
    contracts/apr-page-examples-pii-filtering-v1.yaml schema yes 0
    contracts/apr-page-examples-pipeline-verification-v1.yaml schema yes 0
    contracts/apr-page-examples-poka-yoke-validation-v1.yaml schema yes 0
    contracts/apr-page-examples-predator-prey-optimization-v1.yaml schema yes 0
    contracts/apr-page-examples-probar-tui-testing-v1.yaml schema yes 0
    contracts/apr-page-examples-pruning-magnitude-v1.yaml schema yes 0
    contracts/apr-page-examples-ptx-parity-validation-v1.yaml schema yes 0
    contracts/apr-page-examples-publish-shell-safety-v1.yaml schema yes 0
    contracts/apr-page-examples-qa-chat-v1.yaml schema yes 0
    contracts/apr-page-examples-qa-falsification-v1.yaml schema yes 0
    contracts/apr-page-examples-qa-falsify-v1.yaml schema yes 0
    contracts/apr-page-examples-qa-run-v1.yaml schema yes 0
    contracts/apr-page-examples-qa-serve-v1.yaml schema yes 0
    contracts/apr-page-examples-qa-verify-v1.yaml schema yes 0
    contracts/apr-page-examples-qwen3.5-hybrid-attention-v1.yaml schema yes 0
    contracts/apr-page-examples-qwen-apr-native-v1.yaml schema yes 0
    contracts/apr-page-examples-qwen-chat-v1.yaml schema yes 0
    contracts/apr-page-examples-qwen-inference-v1.yaml schema yes 0
    contracts/apr-page-examples-qwen-qa-playbook-v1.yaml schema yes 0
    contracts/apr-page-examples-random-forest-regression-v1.yaml schema yes 0
    contracts/apr-page-examples-recommend-content-v1.yaml schema yes 0
    contracts/apr-page-examples-rlvr-v1.yaml schema yes 0
    contracts/apr-page-examples-rosetta-stone-v1.yaml schema yes 0
    contracts/apr-page-examples-sharded-safetensors-serve-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-completion-benchmarks-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-completion-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-encryption-demo-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-encryption-tiers-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-hf-hub-publishing-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-history-developer-guide-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-homomorphic-encryption-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-model-format-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-safety-inference-v1.yaml schema yes 0
    contracts/apr-page-examples-shell-safety-training-v1.yaml schema yes 0
    contracts/apr-page-examples-showcase-benchmark-v1.yaml schema yes 0
    contracts/apr-page-examples-sovereign-offline-v1.yaml schema yes 0
    contracts/apr-page-examples-sovereign-stack-v1.yaml schema yes 0
    contracts/apr-page-examples-spectral-clustering-v1.yaml schema yes 0
    contracts/apr-page-examples-state-machine-playbooks-v1.yaml schema yes 0
    contracts/apr-page-examples-svm-iris-v1.yaml schema yes 0
    Part 3: 191 contracts, release 0.73 (≤190 at 0.74)
    contract kind legacy block obligations
    contracts/apr-page-examples-synthetic-data-generation-v1.yaml schema yes 0
    contracts/apr-page-examples-tabu-tsp-v1.yaml schema yes 0
    contracts/apr-page-examples-tensorlogic-reasoning-v1.yaml schema yes 0
    contracts/apr-page-examples-text-classification-v1.yaml schema yes 0
    contracts/apr-page-examples-text-preprocessing-v1.yaml schema yes 0
    contracts/apr-page-examples-time-series-forecasting-v1.yaml schema yes 0
    contracts/apr-page-examples-tokenizer-surgery-v1.yaml schema yes 0
    contracts/apr-page-examples-topic-sentiment-analysis-v1.yaml schema yes 0
    contracts/apr-page-examples-tracing-memory-paging-v1.yaml schema yes 0
    contracts/apr-page-examples-trueno-compute-integration-v1.yaml schema yes 0
    contracts/apr-page-examples-tsne-visualization-v1.yaml schema yes 0
    contracts/apr-page-examples-tsp-solver-crate-v1.yaml schema yes 0
    contracts/apr-page-examples-validated-tensors-v1.yaml schema yes 0
    contracts/apr-page-examples-whisper-transcribe-v1.yaml schema yes 0
    contracts/apr-page-examples-xor-neural-network-v1.yaml schema yes 0
    contracts/apr-page-examples-xor-training-v1.yaml schema yes 0
    contracts/apr-page-getting-started-first-inference-v1.yaml schema yes 0
    contracts/apr-page-getting-started-first-server-v1.yaml schema yes 0
    contracts/apr-page-getting-started-first-training-v1.yaml schema yes 0
    contracts/apr-page-getting-started-installation-v1.yaml schema yes 0
    contracts/apr-page-introduction-v1.yaml schema yes 0
    contracts/apr-page-methodology-red-green-refactor-v1.yaml schema yes 0
    contracts/apr-page-methodology-test-first-philosophy-v1.yaml schema yes 0
    contracts/apr-page-methodology-what-is-extreme-tdd-v1.yaml schema yes 0
    contracts/apr-page-methodology-zero-tolerance-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-active-learning-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-advanced-optimizers-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-apriori-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-audio-processing-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-automatic-differentiation-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-automl-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-bayesian-inference-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-chaos-engineering-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-classification-metrics-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-compiler-in-the-loop-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-cross-validation-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-decision-trees-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-descriptive-statistics-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-ensemble-methods-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-feature-scaling-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-fine-tuning-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-gradient-descent-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-graph-algorithms-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-graph-components-traversal-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-graph-link-prediction-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-graph-neural-networks-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-graph-pathfinding-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-kmeans-clustering-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-knn-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-linear-regression-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-logistic-regression-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-lottery-ticket-hypothesis-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-metaheuristics-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-monte-carlo-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-naive-bayes-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-neural-network-pruning-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-neuro-symbolic-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-online-learning-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-pca-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-probability-calibration-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-README-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-regression-metrics-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-regularization-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-speech-voice-processing-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-svm-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-TEMPLATE-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-transfer-learning-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-tsne-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-weak-supervision-v1.yaml schema yes 0
    contracts/apr-page-ml-fundamentals-webassembly-ml-v1.yaml schema yes 0
    contracts/apr-page-quality-gates-jidoka-v1.yaml schema yes 0
    contracts/apr-page-tools-apr-cli-v1.yaml schema yes 0
    contracts/apr-page-tools-apr-spec-v1.yaml schema yes 0
    contracts/apr-page-tools-mcp-server-v1.yaml schema yes 0
    contracts/apr-provenance-v1.yaml schema 0
    contracts/work/APR-ANTIGRAVITY-INTEGRATION-001.yaml schema 0
    contracts/work/APR-ANTIGRAVITY-PARITY-001.yaml schema 0
    contracts/work/APR-GEMINI-PROXY-001.yaml schema 0
    contracts/work/baseline-v1.yaml schema 0
    contracts/work/BEAT-OLLAMA-DECODE-CI-001.yaml schema 0
    contracts/work/GH-339.yaml schema 0
    contracts/work/GH-597.yaml schema 0
    contracts/work/GH-602.yaml schema 0
    contracts/work/GH-603.yaml schema 0
    contracts/work/GH-619.yaml schema 0
    contracts/work/GH-621.yaml schema 0
    contracts/work/GH-622.yaml schema 0
    contracts/work/GH-623.yaml schema 0
    contracts/work/GH-624.yaml schema 0
    contracts/work/GH-663.yaml schema 0
    contracts/work/GH-664.yaml schema 0
    contracts/work/GH-665.yaml schema 0
    contracts/work/GH-666.yaml schema 0
    contracts/work/GH-667.yaml schema 0
    contracts/work/GH-668.yaml schema 0
    contracts/work/GH-669.yaml schema 0
    contracts/work/GH-670.yaml schema 0
    contracts/work/GH-671.yaml schema 0
    contracts/work/GH-672.yaml schema 0
    contracts/work/PILLAR1-001.yaml schema 0
    contracts/work/PILLAR1-002.yaml schema 0
    contracts/work/PILLAR1-003.yaml schema 0
    contracts/work/PILLAR1-004.yaml schema 0
    contracts/work/PILLAR1-007.yaml schema 0
    contracts/work/PILLAR1-008.yaml schema 0
    contracts/work/PILLAR1-009.yaml schema 0
    contracts/work/PILLAR1-010.yaml schema 0
    contracts/work/PILLAR1-011.yaml schema 0
    contracts/work/PILLAR1-012.yaml schema 0
    contracts/work/PILLAR1-013.yaml schema 0
    contracts/work/PILLAR1-014.yaml schema 0
    contracts/work/PILLAR1-015.yaml schema 0
    contracts/work/PILLAR1-016.yaml schema 0
    contracts/work/PILLAR1-017.yaml schema 0
    contracts/work/PILLAR1-018.yaml schema 0
    contracts/work/PILLAR1-019.yaml schema 0
    contracts/work/PILLAR1-020.yaml schema 0
    contracts/work/PILLAR1-021.yaml schema 0
    contracts/work/PILLAR1-022.yaml schema 0
    contracts/work/PILLAR1-023.yaml schema 0
    contracts/work/PILLAR1-024.yaml schema 0
    contracts/work/PILLAR1-025.yaml schema 0
    contracts/work/PILLAR1-026.yaml schema 0
    contracts/work/PILLAR1-027.yaml schema 0
    contracts/work/PILLAR1-028.yaml schema 0
    contracts/work/PILLAR1-029.yaml schema 0
    contracts/work/PILLAR1-030.yaml schema 0
    contracts/work/PILLAR1-031.yaml schema 0
    contracts/work/PMAT-328.yaml schema 0
    contracts/work/PMAT-330.yaml schema 0
    contracts/work/PMAT-331.yaml schema 0
    contracts/work/PMAT-342.yaml schema 0
    contracts/work/PMAT-480.yaml schema 0
    contracts/work/PMAT-481.yaml schema 0
    contracts/work/PMAT-482.yaml schema 0
    contracts/work/PMAT-483.yaml schema 0
    contracts/work/PMAT-484.yaml schema 0
    contracts/work/PMAT-485.yaml schema 0
    contracts/work/PMAT-486.yaml schema 0
    contracts/work/PMAT-487.yaml schema 0
    contracts/work/PMAT-488.yaml schema 0
    contracts/work/PMAT-489.yaml schema 0
    contracts/work/PMAT-490.yaml schema 0
    contracts/work/PMAT-491.yaml schema 0
    contracts/work/PMAT-493.yaml schema 0
    contracts/work/PMAT-495.yaml schema 0
    contracts/work/PMAT-496.yaml schema 0
    contracts/work/PMAT-497.yaml schema 0
    contracts/work/PMAT-498.yaml schema 0
    contracts/work/PMAT-499.yaml schema 0
    contracts/work/PMAT-500.yaml schema 0
    contracts/work/PMAT-501.yaml schema 0
    contracts/work/PMAT-502.yaml schema 0
    contracts/work/PMAT-503.yaml schema 0
    contracts/work/PMAT-504.yaml schema 0
    contracts/work/PMAT-505.yaml schema 0
    contracts/work/PMAT-506.yaml schema 0
    contracts/work/PMAT-507.yaml schema 0
    contracts/work/PMAT-508.yaml schema 0
    contracts/work/PMAT-509.yaml schema 0
    contracts/work/PMAT-510.yaml schema 0
    contracts/work/PMAT-511.yaml schema 0
    contracts/work/PMAT-512.yaml schema 0
    contracts/work/PMAT-513.yaml schema 0
    contracts/work/PMAT-514.yaml schema 0
    contracts/work/PMAT-515.yaml schema 0
    contracts/work/PMAT-516.yaml schema 0
    contracts/work/PMAT-517.yaml schema 0
    contracts/work/PMAT-518.yaml schema 0
    contracts/work/PMAT-519.yaml schema 0
    contracts/work/PMAT-520.yaml schema 0
    contracts/work/PMAT-521.yaml schema 0
    contracts/work/PMAT-522.yaml schema 0
    contracts/work/PMAT-523.yaml schema 0
    contracts/work/PMAT-524.yaml schema 0
    contracts/work/PMAT-525.yaml schema 0
    contracts/work/PMAT-526.yaml schema 0
    contracts/work/PMAT-527.yaml schema 0
    contracts/work/PMAT-528.yaml schema 0
    contracts/work/PMAT-529.yaml schema 0
    contracts/work/PMAT-530.yaml schema 0
    contracts/work/PMAT-531.yaml schema 0
    contracts/work/PMAT-532.yaml schema 0
    contracts/work/PMAT-533.yaml schema 0
    contracts/work/PMAT-534.yaml schema 0
    contracts/work/PMAT-535.yaml schema 0
    contracts/work/PMAT-536.yaml schema 0
    contracts/work/PMAT-537.yaml schema 0
    contracts/work/PMAT-538.yaml schema 0
    contracts/work/PMAT-539.yaml schema 0
    contracts/work/PMAT-540.yaml schema 0
    Part 4: 190 contracts, release 0.74 (0 at 0.75)
    contract kind legacy block obligations
    contracts/work/PMAT-541.yaml schema 0
    contracts/work/PMAT-542.yaml schema 0
    contracts/work/PMAT-543.yaml schema 0
    contracts/work/PMAT-544.yaml schema 0
    contracts/work/PMAT-545.yaml schema 0
    contracts/work/PMAT-546.yaml schema 0
    contracts/work/PMAT-547.yaml schema 0
    contracts/work/PMAT-548.yaml schema 0
    contracts/work/PMAT-549.yaml schema 0
    contracts/work/PMAT-550.yaml schema 0
    contracts/work/PMAT-551.yaml schema 0
    contracts/work/PMAT-552.yaml schema 0
    contracts/work/PMAT-553.yaml schema 0
    contracts/work/PMAT-554.yaml schema 0
    contracts/work/PMAT-555.yaml schema 0
    contracts/work/PMAT-556.yaml schema 0
    contracts/work/PMAT-557.yaml schema 0
    contracts/work/PMAT-558.yaml schema 0
    contracts/work/PMAT-559.yaml schema 0
    contracts/work/PMAT-560.yaml schema 0
    contracts/work/PMAT-561.yaml schema 0
    contracts/work/PMAT-562.yaml schema 0
    contracts/work/PMAT-563.yaml schema 0
    contracts/work/PMAT-564.yaml schema 0
    contracts/work/PMAT-565.yaml schema 0
    contracts/work/PMAT-566.yaml schema 0
    contracts/work/PMAT-567.yaml schema 0
    contracts/work/PMAT-568.yaml schema 0
    contracts/work/PMAT-569.yaml schema 0
    contracts/work/PMAT-570.yaml schema 0
    contracts/work/PMAT-571.yaml schema 0
    contracts/work/PMAT-572.yaml schema 0
    contracts/work/PMAT-573.yaml schema 0
    contracts/work/PMAT-574.yaml schema 0
    contracts/work/PMAT-575.yaml schema 0
    contracts/work/PMAT-576.yaml schema 0
    contracts/work/PMAT-577.yaml schema 0
    contracts/work/PMAT-578.yaml schema 0
    contracts/work/PMAT-579.yaml schema 0
    contracts/work/PMAT-580.yaml schema 0
    contracts/work/PMAT-581.yaml schema 0
    contracts/work/PMAT-582.yaml schema 0
    contracts/work/PMAT-583.yaml schema 0
    contracts/work/PMAT-584.yaml schema 0
    contracts/work/PMAT-585.yaml schema 0
    contracts/work/PMAT-586.yaml schema 0
    contracts/work/PMAT-587.yaml schema 0
    contracts/work/PMAT-588.yaml schema 0
    contracts/work/PMAT-589.yaml schema 0
    contracts/work/PMAT-590.yaml schema 0
    contracts/work/PMAT-591.yaml schema 0
    contracts/work/PMAT-592.yaml schema 0
    contracts/work/PMAT-593.yaml schema 0
    contracts/work/PMAT-594.yaml schema 0
    contracts/work/PMAT-595.yaml schema 0
    contracts/work/PMAT-596.yaml schema 0
    contracts/work/PMAT-597.yaml schema 0
    contracts/work/PMAT-598.yaml schema 0
    contracts/work/PMAT-599.yaml schema 0
    contracts/work/PMAT-600.yaml schema 0
    contracts/work/PMAT-601.yaml schema 0
    contracts/work/PMAT-602.yaml schema 0
    contracts/work/PMAT-603.yaml schema 0
    contracts/work/PMAT-604.yaml schema 0
    contracts/work/PMAT-605.yaml schema 0
    contracts/work/PMAT-606.yaml schema 0
    contracts/work/PMAT-607.yaml schema 0
    contracts/work/PMAT-608.yaml schema 0
    contracts/work/PMAT-609.yaml schema 0
    contracts/work/PMAT-610.yaml schema 0
    contracts/work/PMAT-611.yaml schema 0
    contracts/work/PMAT-612.yaml schema 0
    contracts/work/PMAT-613.yaml schema 0
    contracts/work/PMAT-614.yaml schema 0
    contracts/work/PMAT-615.yaml schema 0
    contracts/work/PMAT-616.yaml schema 0
    contracts/work/PMAT-617.yaml schema 0
    contracts/work/PMAT-618.yaml schema 0
    contracts/work/PMAT-619.yaml schema 0
    contracts/work/PMAT-620.yaml schema 0
    contracts/work/PMAT-621.yaml schema 0
    contracts/work/PMAT-622.yaml schema 0
    contracts/work/PMAT-623.yaml schema 0
    contracts/work/PMAT-624.yaml schema 0
    contracts/work/PMAT-625.yaml schema 0
    contracts/work/PMAT-626.yaml schema 0
    contracts/work/PMAT-627.yaml schema 0
    contracts/work/PMAT-628.yaml schema 0
    contracts/work/PMAT-629.yaml schema 0
    contracts/work/PMAT-630.yaml schema 0
    contracts/work/PMAT-631.yaml schema 0
    contracts/work/PMAT-632.yaml schema 0
    contracts/work/PMAT-633.yaml schema 0
    contracts/work/PMAT-634.yaml schema 0
    contracts/work/PMAT-635.yaml schema 0
    contracts/work/PMAT-636.yaml schema 0
    contracts/work/PMAT-637.yaml schema 0
    contracts/work/PMAT-638.yaml schema 0
    contracts/work/PMAT-639.yaml schema 0
    contracts/work/PMAT-640.yaml schema 0
    contracts/work/PMAT-641.yaml schema 0
    contracts/work/PMAT-642.yaml schema 0
    contracts/work/PMAT-643.yaml schema 0
    contracts/work/PMAT-644.yaml schema 0
    contracts/work/PMAT-645.yaml schema 0
    contracts/work/PMAT-646.yaml schema 0
    contracts/work/PMAT-647.yaml schema 0
    contracts/work/PMAT-648.yaml schema 0
    contracts/work/PMAT-649.yaml schema 0
    contracts/work/PMAT-650.yaml schema 0
    contracts/work/PMAT-651.yaml schema 0
    contracts/work/PMAT-652.yaml schema 0
    contracts/work/PMAT-653.yaml schema 0
    contracts/work/PMAT-654.yaml schema 0
    contracts/work/PMAT-655.yaml schema 0
    contracts/work/PMAT-656.yaml schema 0
    contracts/work/PMAT-657.yaml schema 0
    contracts/work/PMAT-658.yaml schema 0
    contracts/work/PMAT-659.yaml schema 0
    contracts/work/PMAT-660.yaml schema 0
    contracts/work/PMAT-661.yaml schema 0
    contracts/work/PMAT-662.yaml schema 0
    contracts/work/PMAT-663.yaml schema 0
    contracts/work/PMAT-664.yaml schema 0
    contracts/work/PMAT-665.yaml schema 0
    contracts/work/PMAT-666.yaml schema 0
    contracts/work/PMAT-667.yaml schema 0
    contracts/work/PMAT-668.yaml schema 0
    contracts/work/PMAT-669.yaml schema 0
    contracts/work/PMAT-670.yaml schema 0
    contracts/work/PMAT-671.yaml schema 0
    contracts/work/PMAT-672.yaml schema 0
    contracts/work/PMAT-673.yaml schema 0
    contracts/work/PMAT-674.yaml schema 0
    contracts/work/PMAT-675.yaml schema 0
    contracts/work/PMAT-676.yaml schema 0
    contracts/work/PMAT-677.yaml schema 0
    contracts/work/PMAT-678.yaml schema 0
    contracts/work/PMAT-679.yaml schema 0
    contracts/work/PMAT-680.yaml schema 0
    contracts/work/PMAT-681.yaml schema 0
    contracts/work/PMAT-682.yaml schema 0
    contracts/work/PMAT-683.yaml schema 0
    contracts/work/PMAT-684.yaml schema 0
    contracts/work/PMAT-685.yaml schema 0
    contracts/work/PMAT-686.yaml schema 0
    contracts/work/PMAT-687.yaml schema 0
    contracts/work/PMAT-688.yaml schema 0
    contracts/work/PMAT-689.yaml schema 0
    contracts/work/PMAT-690.yaml schema 0
    contracts/work/PMAT-691.yaml schema 0
    contracts/work/PMAT-692.yaml schema 0
    contracts/work/PMAT-693.yaml schema 0
    contracts/work/PMAT-697.yaml schema 0
    contracts/work/PMAT-698.yaml schema 0
    contracts/work/PMAT-705.yaml schema 0
    contracts/work/PMAT-710.yaml schema 0
    contracts/work/PMAT-711.yaml schema 0
    contracts/work/PMAT-712.yaml schema 0
    contracts/work/PMAT-713.yaml schema 0
    contracts/work/PMAT-714.yaml schema 0
    contracts/work/PMAT-715.yaml schema 0
    contracts/work/PMAT-716.yaml schema 0
    contracts/work/PMAT-717.yaml schema 0
    contracts/work/PMAT-718.yaml schema 0
    contracts/work/PMAT-719.yaml schema 0
    contracts/work/PMAT-720.yaml schema 0
    contracts/work/PMAT-721.yaml schema 0
    contracts/work/PMAT-722.yaml schema 0
    contracts/work/PMAT-723.yaml schema 0
    contracts/work/PMAT-724.yaml schema 0
    contracts/work/PMAT-725.yaml schema 0
    contracts/work/PMAT-726.yaml schema 0
    contracts/work/PMAT-727.yaml schema 0
    contracts/work/PMAT-728.yaml schema 0
    contracts/work/PMAT-729.yaml schema 0
    contracts/work/PMAT-731.yaml schema 0
    contracts/work/PMAT-732.yaml schema 0
    contracts/work/PMAT-734.yaml schema 0
    contracts/work/PMAT-736.yaml schema 0
    contracts/work/PMAT-737.yaml schema 0
    contracts/work/PMAT-738.yaml schema 0
    contracts/work/PMAT-739.yaml schema 0
    contracts/work/PMAT-740.yaml schema 0
    contracts/work/PMAT-741.yaml schema 0
    contracts/work/PMAT-CLAUDE-PROXY-001.yaml schema 0
    contracts/work/PMAT-CODE-MCP-CLIENT-001.yaml schema 0
    contracts/work/PMAT-CODE-PARITY-MATRIX-001.yaml schema 0
    contracts/work/PMAT-MCP-PARITY-001.yaml schema 0
    contracts/work/SVC-SMO-WSS-001.yaml schema 0
  6. noahgift
    changed the title [-]DEFECT: pv validate passes a contract with no falsification tests or an empty test_harness (818 contracts have zero tests)[/-] [+]DEFECT: pv validate passes a contract with no falsification tests or an empty test_harness (763 contracts have zero tests)[/+] on Oct 14, 2026
  7. noahgift
    added a commit that references this issue on Oct 14, 2026

    fix(contracts): bind 18 legacy falsification blocks to real cargo tes…

    22855c6

  8. noahgift commented on Oct 14, 2026

    @noahgift
    noahgift
    on Oct 14, 2026
    MemberAuthor

    The 61 .yaml files under contracts/ that pv never walks, sorted. #5295 reports them as unwalked in pv census and caps the number at 61, so it cannot rise while they are sorted. (Measured on d97936f. 55 of the 61 have zero tests, which is the gap between a raw find count of 818 and pv's 763.)

    files n sort why action
    **/binding.yaml 10 not a contract BindingRegistry, own schema and validator (ArtifactKind::Binding) move out of contracts/ (CLAUDE.md pv rule 3); the readers default to contracts/**/binding.yaml, so it is its own ticket
    ontology.yaml 1 not a contract Σ, the vocabulary contracts may use (ONT-2b); no metadata: move out of contracts/
    external-corpora.yaml 1 not a contract declaration of external corpora, validated by EXT-CORPORA move out of contracts/
    publish-manifests/*.yaml 3 not a contract PublishManifest artifacts keyed by model_id: move out of contracts/
    {entrenar,trueno}/kaizen/*.yaml 46 real contracts (metadata.kind: kaizen) skipped by the walker's kaizen dir rule; 6 of 46 carry falsification_tests pv must walk them; the zero-test ones then join the no-test debt, and the debt-list length plus its per-release caps rise to match in that same PR (the caps' cadence is unchanged)

    Each move or walk lowers unwalked, and the cap is then lowered to the new number in the same PR.

  9. noahgift
    added 7 commits that reference this issue on Oct 14, 2026

    fix(contracts): distributed-training binds its two claims to the data…

    7f19c93

    fix(ci): register schema::no_test_debt as a tree-reader test module (…

    7e9ec5f

    fix(contracts): five legacy blocks bound to the unit tests that check…

    d42ba53

    fix(contracts): the 21 book contracts bound to the checks their workf…

    fa23e35

    fix(pv): SCHEMA-026 refuses only in the census tree; 024/025 surface …

    c2052d3

    test(pv): the real contracts/ census tree refuses a nested zero-test …

    a260a01

    fix(contracts): 108 book page contracts bound to book-gate.sh --strict (

    9b6eb9d

  10. 12 remaining items

  11. noahgift
    added 2 commits that reference this issue on Oct 14, 2026

    fix(contracts): bind falsification tests for nine more top-level cont…

    9180f9a

    fix(contracts): bind falsification tests for five more top-level cont…

    ce0c312

  12. noahgift commented on Oct 14, 2026

    @noahgift
    noahgift
    on Oct 14, 2026
    MemberAuthor

    Part 1 (top-level contracts/*.yaml) — state at ce0c312cbb on fix/5291-part1-obligation-tests (branch only, no PR yet)

    • 356 of 428 top-level contracts now carry falsification_tests. Each entry names an existing test whose asserts were read. Where a test is narrower than its condition, the prediction says how.
    • 35 are external-repo rows. They stay in the debt count; book: create-missing = true makes the 'SUMMARY.md references nonexistent file' condition unfalsifiable #5300 tracks them.
    • 37 have no existing test that asserts any of their conditions. They are left unbound rather than given a placeholder. They are listed below so a test can be written for each.

    No asserting test in tree (needs a new test)

    • attention-backward, cuda-classify-training, fp16-cublas-gemm, nf4-backward-tensor-core-gemm: the existing tests are PTX-text, print-only or GPU-only, with no output-value check.
    • dimension-independent-kernels: 001 compares PTX text only. gemm-backward-tiled: 001 skips silently with no adapter; 002 covers 5×7 only.
    • golden-trace (logs only), memory-safety (MEM-002 names an error variant core Tensor does not have), moe-expert-dispatch, tdg-scoring (no TDG code in tree), tracing-observability (no child-within-parent interval test).
    • context-generation: the 002 test asserts doc count < 2, not total tokens ≤ max, and the proptest allows +50 tokens of slack. This may be a real defect.
    • dataset-thestack-python, pretokenize-bin: corpus-level or cross-host checks (006: the manifest never emits corpus_sha256).
    • apr-claude-proxy, apr-gemini-proxy, claude-code-parity-apr: the planned harness files are absent; the CCPA tests live in the companion repo.
    • qwen35-hybrid-serve-dispatch: all four tests pass silently when no model file is present. qwen3-moe-serve-dispatch / qwen3-moe-streaming-sse: #[ignore] + env only.
    • beat-ollama-decode-throughput-speed, beat-sklearn-linreg-speed: only #[ignore] benches (GPU+ollama / uv+scikit-learn). Those are nightly checks and cannot be a PR-path binding.
    • apr-book-schema, archive-repos: no test.
    • apr-page-examples-* (8): their examples need args, a model or a feature, so book-gate G5/G6 cannot run them bare.
    • apr-page-methodology-zero-tolerance: G8 counts 16 placeholder words. The page discusses TODO/TBD as its subject, so this is either a gate false positive or a page defect.
    • apr-page-ml-fundamentals-graph-pathfinding: G9 finds one contracted section missing from the page (real drift). apr-page-ml-fundamentals-TEMPLATE: the page file does not exist.
    • qlora-hyperparameters: code and contract disagree. The validator enforces alpha = 2·rank; the contract says a ratio in [0.5, 4].
    • crux-competitive-research-ux (DRAFT): CRUX-001 is false today (295 stories, not 250); the scripts for 3/5/6/8 are missing.

    Defects found while binding

    • cgp-monorepo-build BUILD-002: test_workspace_version_consistency asserts nothing (eprintln only), so it is vacuous. Left unbound.
    • chat-template CHAT-002: there is no Llama 3 template; llama-3 maps to the Llama 2 one.
    • Integration targets bound here that no ci/explicit-test-commands.d fragment runs (dark on the PR path): falsify_mcp_008, falsify_ship_012_tokenizer_roundtrip.
    • pv lint <one file> resolves Gate 4 against the contract file's own directory. A mod::path::test_x reference fails there spuriously, and a bare-name reference is not checked at all. The bindings here were checked with pv lint contracts/ --strict-test-binding-only: 1187 refs, 27 missing, none of them from this branch.

    Partially covered conditions inside bound contracts (for example moe-router 001, pipeline-cache 002, tokenizer-bpe 001/002/004, training-loop-pretrain 004) are named in each commit message and stay open.

    keep-open: part 1 PR not yet opened (waiting on a PR slot)

    🤖 Generated with Claude Code

  13. noahgift
    added 3 commits that reference this issue on Oct 14, 2026

    merge #5295 head a260a01 into #5291 part 1 (no rebase)

    ca9572c

    fix(contracts): delete the 356 no_test_debt lines part 1 bound (#5291)

    ad7f23a

    fix(pv): walk the 46 kaizen contracts; debt 803 split 602/401/200/0 (…

    ed75daf

  14. noahgift commented on Oct 14, 2026

    @noahgift
    noahgift
    on Oct 14, 2026
    MemberAuthor

    Merged into #5308 (TRIAGE-100, 2026-10-14): same theme, so this master's scope and every checklist row now live on #5308, and this ticket is closed as not planned. Reopen it if the theme splits again.

    Agent: aprender-clerk

  15. noahgift
    closed this as not plannedon Oct 14, 2026
  16. noahgift
    removed a parent issue on Oct 14, 2026
  17. noahgift
    added a commit that references this issue on Oct 14, 2026

    merge main into #5295; README count and ONT witness regenerated, not …

    248c2bb

  18. noahgift commented on Oct 14, 2026

    @noahgift
    noahgift
    on Oct 14, 2026
    MemberAuthor

    The 34 apr-tool* and apr-corpus* entries on the no-test debt list stay counted as debt, for now.

    Each of these contracts makes a claim about an external paiml repository: archived state, README, CI, recency of the last commit, or RAG indexing. No in-tree test can falsify those claims; a real check needs network access to GitHub. A test that only checks the YAML would pass whatever the repos look like, so these entries are not bound to one. They are not excluded from the list either, since that would loosen the cap.

    The burn-down does the in-tree entries first. These 34 move to their own issue later.

  19. noahgift
    added 4 commits that reference this issue on Oct 15, 2026

    fix(contracts): kaizen falsification ids use the hyphen-only sequence

    212f9d5

    fix(contracts): vecmat-blis-gemv cites each tiled test by its exact name

    f760930

    fix(contracts): resync the packaged mirrors of contracts this PR bound

    8a6a170

    merge origin/main 8f601ca into the #5291 pv debt branch — picks up wa…

    ebb62df
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions