refactor(kv): index_copy_ for KV-cache writes (enabler for multi-user batching + CUDA Graphs) - #53

Open

prashant182 wants to merge 3 commits into

Robbyant:mainfrom

prashant182:feat/e1-index-copy-kv-write

Commits on May 19, 2026

Merge pull request #4 from prashant182/feat/b3-eliminate-item-calls
prashant182
authored
c2cd957
Merge branch 'Robbyant:main' into main
prashant182
authored
dc98362

Commits on May 20, 2026

refactor(kv): index_copy_ for KV-cache writes (multi-tenant primitive)
prashant182
committed
744c980