Repository navigation

flashnext cuda: drafted rounds: first token early, n-gram table resident, deeper greedy drafts, CUDA graphs - #1786

Open

Arminova wants to merge 12 commits into

ashhart:mainfrom

Arminova:flashnext/draft-round

Open

flashnext cuda: drafted rounds: first token early, n-gram table resident, deeper greedy drafts, CUDA graphs#1786
Arminova wants to merge 12 commits into
ashhart:mainfrom
Arminova:flashnext/draft-round

Commits on Nov 1, 2026
Commits on Nov 2, 2026
Commits on Nov 3, 2026
- Merge main into flashnext/draft-round (#1764 as landed, b5c96c533, 89a6600ff)
  Arminova
  committed
  6074f39
- flashnext cuda: a held window graph takes a new length or a new request in place
  Arminova
  committed
  7bfdfc6