Repository navigation
Conversation
81cc148 to
db704f1
Compare
|
Thanks @gilby, this answers both of our 31 Oct points for this part: |
db704f1 to
a3fbeef
Compare
22ddfb8 to
01352d8
Compare
|
A fix to one of this part's planted controls, found while re-running the contract on an Apple M5 Max: Parts 10 to 18 are rebuilt on it (the only difference from the previous heads is that line) and pushed. |
01352d8 to
f1eea29
Compare
index.metal scores FP4 queries against FP4 keys in one stated order with causal and block masks, topk512.metal keeps each row's top 512, cand.metal picks the candidate blocks as a byte mask, and route.metal takes the top-k of sqrt(softplus(logit)) + bias for the backbone and the drafter. Each is registered with the contract.
compress.metal pools the ratio-2 and ratio-4 compressed KV and round-trips it through FP4; engram.metal dequantises the FP8 Engram rows, projects them, gates them and adds them to the residual. Registered with the contract against float64 and bit-equal to the phase-1 glue where they replace it.
…lded decode glue hc.metal runs hc_mixes with Sinkhorn, hc_pre and hc_post in fixed orders; fused.metal and fold.metal split or fold neighbouring glue launches at the same bits. Registered with the contract against float64 and bit-equal to the phase-1 glue.
f1eea29 to
371bf9e
Compare
What this changes
The hyper-connection boundary (
hc.metal: hc_mixes with Sinkhorn, hc_pre, hc_post) and the decode launches that fuse or fold neighbouring glue at the same bits (fused.metal,fold.metal), all registered with the kernel contract:hc.metal(3 launch records),fold.metal(3) andfused.metal(11, with planted controls in every kernel that compile away atTF_CTL 0, checked by five gate suitesmetal_dsv41_fused*.zigagainst the unfused kernels and float64).Main's shared files change only by one-line hooks; this part's records, suites and limits go into the family's own files (
dsv41_metal_records.zig,metal_dsv41_main.zig,metal_dsv41_limits.zig).Part 10 of 18 of the stack for #1676; stacks on
dsv41-metal-pr/09-compressor-engram(part 9, #1713), on main with parts 1 to 5 (#1705 to #1709) merged.Receipt
tools/bench_concurrent.py --alone --serialortoken_shaagainst"draft": false: n/a: kernels only; the kernel contract checks each launch geometry's bits against the others and against float64.tools/bench_openai.py: measured on the PR that turns serving on.ttft_sfromtools/bench_cache.py --require-coldon a long prompt, or "n/a" with the reason when the change cannot reach prompt processing: measured on the PR that turns serving on.zig build test tf-kernel-contract -Dcpu=apple_m1: exit 0, 621/621 steps succeeded; kernel contract,tf-kernel-contract --only dsv41(Metal):SUMMARY 89 kernels: 89 pass gates 1-4, 0 fail, 0 known findings; 186 controls: 186 red as planted, 0 missed; 0 limit problems; gates 119418 ms, limits 161 ms;python3 tools/zig/lean_check.py: 5085 files, 424 problems, the same count as main (5027 files, 424). Zig's summary counts only the test binaries it ran in that invocation, so the step count is the comparable figure.Checklist
"draft": false, a resumed prompt equals a fresh one, and concurrent equals solo.SUMMARYline is in the receipt.