Skip to content

feat(recognition): publish reference embeddings and the model pipeline for screenshot recognition - #16

Merged
nichinichisou0609 merged 1 commit into
mainfrom
feat/recognition-encoder
Oct 5, 2026
Merged

nichinichisou0609 merged 1 commit into
mainfrom
feat/recognition-encoder

Conversation

@nichinichisou0609

@nichinichisou0609 nichinichisou0609 commented Oct 4, 2026 •

Copy link
Copy Markdown

The recognition bundle moves to moenotes.recognition-bundle/2:

  • Gallery (moenotes.embedding-gallery/1): every Member and Snap card of the enabled regions with its Master identity, regions and level limit, plus per-kind reference embeddings computed in the build job by the pinned encoders with ONNX Runtime on the CPU (float32 unit rows, content-addressed buffers).
  • Models manifest (moenotes.recognition-models/1): ONNX Runtime Web, the card locator, the Member and Snap encoders, field readers and rank readers, each with its crop sizes and acceptance thresholds from recognition-runtime.json.
  • The runtime job stages the encoder models for the build job; publication keeps its create-only order, superset check, read-back and pointer-last rules.

Pinned files come from the draft release recognition-runtime-2 (BoxLens v0.2.0 models and ONNX Runtime Web 1.30.0). python -m pytest .github/scripts/test_recognition.py passes.

…e for screenshot recognition

The bundle now carries a gallery of per-kind reference embeddings, made in the
build job by the pinned Member and Snap encoders with ONNX Runtime on the CPU,
and a models manifest naming ONNX Runtime Web, the card locator, the encoders
and the per-kind field and rank readers with their thresholds. Each card also
records its level limit from master data. The runtime job stages the encoder
models for the build; publication keeps its create-only order, superset check,
read-back and pointer-last rules.
@nichinichisou0609
nichinichisou0609 merged commit 23670d5 into main Oct 5, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant