Skip to content

fix(serve): K1 — GPU KV = model context within VRAM, not a fixed 4096 (#4603) - #4630

Closed
noahgift wants to merge 52 commits into
mainfrom
devont/k1-serve-kv
Closed

fix(serve): K1 — GPU KV = model context within VRAM, not a fixed 4096 (#4603)#4630
noahgift wants to merge 52 commits into
mainfrom
devont/k1-serve-kv

merge devont/k1-serve-kv (#4630) onto main (316dee2cd4)

da4f4f9
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar