research: add SYM-ARCH-002A6 online measurement dynamics - #65
Draft
Tristan-Stoltz-ERC wants to merge 11 commits into
Draft
research: add SYM-ARCH-002A6 online measurement dynamics#65Tristan-Stoltz-ERC wants to merge 11 commits into
Tristan-Stoltz-ERC wants to merge 11 commits into
Conversation
Integration-only parent sync; no A6 scientific changes.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds SYM-ARCH-002A6 online measurement dynamics as a draft sibling tranche directly on the frozen 002A core (#57).
This PR adds no architecture mechanism and consumes no CONFIRM data. It closes measurement gaps exposed by the negative SYM-ARCH-001 result, especially the ambiguity between low forgetting and weak acquisition.
Prequential acquisition contract
Every online-learning step is measured in this order:
Post-update correctness on the same item is not admissible as acquisition evidence.
Provenance-bound phase traces
Each
OnlineMeasurementTracebinds:The trace receives its own domain-separated BLAKE3 digest.
Acquisition metrics
A6 adds:
The cumulative-AUC definition is frozen and cannot be silently replaced by ordinary mean correctness or post-update accuracy.
Criterion validity
experiment_measurement_validityaudits the frozen acquisition criterion against a preregistered simple-reference accuracy ceiling and a minimum practical excess.It exposes:
admissiblevsreference_confoundedstatus with qualifiers.A claim-bearing examples-to-criterion result may not use a
reference_confoundedcriterion.This is a construct-validity guard only; A4 shortcut controls and A2 uncertainty/power remain required.
Latency / throughput
For inference and update latency independently:
Latency traces are runtime-context-bound. A6 does not authorize cross-hardware latency claims from unmatched runtime-context digests.
Resource trace
Post-update snapshots record:
Summaries report final/peak trainable and persistent state plus peak replay, temporal state, and observed RSS.
Scientific boundary
A6 complements rather than replaces the continual
R[t_train][t_eval]matrix:A system with low forgetting but slow/absent criterion attainment can therefore no longer be described as strong continual learning merely because retention-style metrics look stable.
CI
Dedicated exact-head workflow gates:
cargo fmt --all -- --check;experiment_measurementtests;experiment_measurement_validitytests;symthaea-psych-benchlibrary check on Rust 1.96.Wording ceiling
Merging this PR supports only:
It does not support a Symthaea performance claim, a faster-learning claim, a hardware-independent latency claim, a resource-efficiency claim, or a claim-bearing threshold that fails the reference audit.
Tracks #55. Depends only on #57.