You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
D5: serve over device KV (4096) returns 500 — refuse with 400 'context exceeds N'; --context-length sizes KV for gate-named cells #4616
OPERATOR ruling D5 (ruling-3715, 2026-09-28), verbatim: "Serve > 4096 tokens → rc500: a 500 is a crash-class lie. Minimum for rc.2: over-length requests return a clear 4xx ("context exceeds 4096"), and serve cells > 4096 are withdrawn by data with a warning, UNLESS gate-named (then fixed: KV size = the model's context)."
Child of #3715: its serve × consumer-context cells above 4096 tokens fail with 500.
Defect: dense CUDA apr serve sends a turn longer than the device KV (max_kv_len(), 4096) to generation. Generation fails with UnsupportedOperation, and the server returns HTTP 500.
Activity
roadmap: PMAT-4616 (D5): the ticket #4614 implements, not #3715
fix(PMAT-4616): D5 gate reds — the cap is CUDA-free and tested, try_c…
noahgift commentedon Oct 4, 2026
Fixed on main by #4655 (merged 2026-10-02). #4614 is closed. (ISSUE-TREE-001 cleanup, C297 §4, aprender-wtix-even)
fold: #4630 into #4623 -- serve sizes its GPU KV to the model context…