Skip to content

#3712 row B2: the cells producer — a resident runner over S2's derived cells (cell_id rows, output_sha256, wall_ms load vs measured), ≤ 8 h/host, a cell tests its own command shape #3783

Closed as not planned

Description

@noahgift

#3712 row B2: the cells producer (resident runner). Owner: aprender-62. Stacked on S3.4 (#3752), which makes check_model_ladder.sh's cells verdict pv's release-readiness-v1 shape over S2's derived cells (#3777).

Cop ruling (2026-09-21), quoted

"don't shrink coverage; cut the per-cell cost. At ~5 s/cell the time is mostly model LOAD. Cells sharing (host, binary, model) run through ONE resident process (a long-lived apr serve for generating cells; one process per model for CLI-shape cells where the verb allows batching), so the load is paid once per model rather than once per cell … Budget: the full derived set in ONE NIGHT per host (≤ 8 h). If the projection after the resident runner still exceeds that, bring me the numbers and I'll rule a rotation explicitly. Nothing gets dropped silently."

Scale (measured by S2)

14,984 derived cells for the 16 ladder host-model pairs: 11,176 matrix, 3,042 effect, 390 base, 376 probe. The full measured inventory is 18 files on lambda and 14 on gx10.

done_when

Refs #3712 #3745 #3777 #3752 #3719 #3743

Activity

  1. noahgift commented on Sep 21, 2026

    @noahgift
    MemberAuthor

    done_when amended (cop aprender-04, 2026-09-21), two cost levers that keep "a cell tests its own command":

    The cop also withdrew "a long-lived apr serve for generating cells": a run cell routed through serve passes a surface it doesn't test (the #3743 leak shape). Every cell executes its own command and args, resident only where the verb itself batches.

  2. noahgift commented on Sep 21, 2026

    @noahgift
    MemberAuthor

    done_when amended (cop aprender-04, 2026-09-21, from aprender-37's finding on #3748): GPU correctness cells were vacuous when F2 printed "CPU reference forward skipped [source=receipt]". F2 receipts are keyed per model, so another binary's receipt can skip validation.

    • Every correctness cell row records F2's source: fresh, or receipt plus that receipt's binary sha (field names agreed with aprender-97, who owns pv's shape and is the one judge).
    • The judge scores source=receipt from a binary other than the cell's own as UNMEASURED, never Pass.
    • B2's runner sets a fresh APR_F2_RECEIPT_DIR per binary to force fresh validation.
  3. noahgift commented on Sep 21, 2026

    @noahgift
    MemberAuthor

    F2 field names (agreed with aprender-97, who owns pv's shape; S2 branch PMAT-3745-s2-derived-cells): every generating (GPU correctness) cell row carries:

    • f2_source: fresh or receipt;
    • f2_receipt_binary_sha: full 40-hex, never a prefix.

    pv's rule is f2Measured = f2_source == "fresh" OR (f2_source == "receipt" AND f2_receipt_binary_sha == the receipt's own apr_sha). An absent f2_source counts as unmeasured. The Cell shape requires f2Measured. Model, probe and effect cells don't carry these fields.

    This composes with #3771 (PR #3784): the receipt's apr_sha is now the BINARY's full commit, resolved in the repo, or null when the checkout doesn't know it. A null apr_sha can never match, so a receipt-sourced F2 on such a run is unmeasured (the strict side). B2 sets a fresh APR_F2_RECEIPT_DIR per binary, so its own rows record f2_source: fresh.

  4. added this to the 0.71.0 milestone on Sep 23, 2026
  5. noahgift commented on Sep 23, 2026

    @noahgift
    MemberAuthor

    milestone → 0.71.0 per docs/roadmaps/milestone-triage-2026-09-23.md (#4024), operator approval 2026-09-23 (relayed by aprender-cf). Reason: the ladder cells producer (#3712 row B2): the certified matrix (#3994)

  6. modified the milestones: 0.71.0, 0.72.0 on Sep 25, 2026
  7. noahgift commented on Sep 25, 2026

    @noahgift
    MemberAuthor

    Parked by APR-EPIC-001: over S1 budget (rank 59/163). Reopen = pull. Applied by aprender-d1: claude+agy both said close, apr shadow row recorded (handoff/close-quorum-2026-09-25.json).

  8. modified the milestones: 0.72.0, backlog on Sep 25, 2026
  9. added
    parkedClosed over epic budget (APR-EPIC-001 rule 5). Reopen = pull.
    on Sep 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Medium priorityparkedClosed over epic budget (APR-EPIC-001 rule 5). Reopen = pull.

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions