Skip to content

lfm2_moe CUDA: attention pages from the shared KV pool, and the prompt cache (stacked on #1492) - #1503

Draft
jschmied wants to merge 12 commits into
ashhart:mainfrom
jschmied:lfm2-cuda-pool
Draft

lfm2_moe CUDA: attention pages from the shared KV pool, and the prompt cache (stacked on #1492)#1503
jschmied wants to merge 12 commits into
ashhart:mainfrom
jschmied:lfm2-cuda-pool

Commits

  1. Commits on Oct 29, 2026