Skip to content

lfm2_moe CUDA: attention pages from the shared KV pool, and the prompt cache (stacked on #1492) - #1503

Draft
jschmied wants to merge 12 commits into
ashhart:mainfrom
jschmied:lfm2-cuda-pool
Draft

jschmied wants to merge 12 commits into
ashhart:mainfrom
jschmied:lfm2-cuda-pool

docs: LFM2.5 on CUDA leases pool pages and keeps chat states in the p…

10f3274
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
zig-macos-dev-tools
succeeded Oct 29, 2026 in 11m 8s