Repository navigation
Conversation
gilby
force-pushed
the
dsv41-metal-pr/09-compressor-engram
branch
from
November 1, 2026 04:45
e56ed15 to
dd457e7
Compare
6 of 9 tasks
Owner
gilby
force-pushed
the
dsv41-metal-pr/09-compressor-engram
branch
2 times, most recently
from
November 2, 2026 07:49
a31c325 to
48b5050
Compare
Owner
|
Thanks @gilby: nothing owed from you here. Every kernel in this part is gated against float64 with planted controls, and the push is a clean rebase. We're running |
6 of 9 tasks
Owner
|
Our Metal kernel contract over the stack ( |
This was referenced Nov 2, 2026
dsv41 metal: one decoder layer's launch over 1-16 rows, checked stage by stage against float64
#1715
Closed
gilby
force-pushed
the
dsv41-metal-pr/09-compressor-engram
branch
from
November 3, 2026 05:30
48b5050 to
1a2c89a
Compare
index.metal scores FP4 queries against FP4 keys in one stated order with causal and block masks, topk512.metal keeps each row's top 512, cand.metal picks the candidate blocks as a byte mask, and route.metal takes the top-k of sqrt(softplus(logit)) + bias for the backbone and the drafter. Each is registered with the contract.
compress.metal pools the ratio-2 and ratio-4 compressed KV and round-trips it through FP4; engram.metal dequantises the FP8 Engram rows, projects them, gates them and adds them to the residual. Registered with the contract against float64 and bit-equal to the phase-1 glue where they replace it.
gilby
force-pushed
the
dsv41-metal-pr/09-compressor-engram
branch
from
November 3, 2026 09:39
1a2c89a to
d9cf9de
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this changes
The KV compressor (
compress.metal) and Engram (engram.metal: FP8 row dequantisation, projection, gate, residual add) on Metal, registered with the kernel contract.Main's shared files change only by one-line hooks; this part's records, suites and limits go into the family's own files (
dsv41_metal_records.zig,metal_dsv41_main.zig,metal_dsv41_limits.zig).Part 9 of 18 of the stack for #1676; stacks on
dsv41-metal-pr/08-indexer-topk-route(part 8, #1712), on main with parts 1 to 5 (#1705 to #1709) merged.Receipt
tools/bench_concurrent.py --alone --serialortoken_shaagainst"draft": false: n/a: kernels only; the kernel contract checks each launch geometry's bits against the others and against float64.tools/bench_openai.py: measured on the PR that turns serving on.ttft_sfromtools/bench_cache.py --require-coldon a long prompt, or "n/a" with the reason when the change cannot reach prompt processing: measured on the PR that turns serving on.zig build test tf-kernel-contract -Dcpu=apple_m1: exit 0, 621/621 steps succeeded; kernel contract,tf-kernel-contract --only dsv41(Metal):SUMMARY 65 kernels: 65 pass gates 1-4, 0 fail, 0 known findings; 129 controls: 129 red as planted, 0 missed; 0 limit problems; gates 118459 ms, limits 157 ms;python3 tools/zig/lean_check.py: 5068 files, 424 problems, the same count as main (5027 files, 424). Zig's summary counts only the test binaries it ran in that invocation, so the step count is the comparable figure.Checklist
"draft": false, a resumed prompt equals a fresh one, and concurrent equals solo.SUMMARYline is in the receipt.