Repository navigation

Flash Next shared down: remove the scatter with direct slot output - #1792

Open

laudney wants to merge 17 commits into

ashhart:mainfrom

laudney:pr-fn-prompt-kernels

Open

Flash Next shared down: remove the scatter with direct slot output#1792
laudney wants to merge 17 commits into
ashhart:mainfrom
laudney:pr-fn-prompt-kernels

Commits on Nov 2, 2026
- fix(flashnext): keep the ranked vtable static
  laudney
  committed
  ac2e81c
- feat(cuda): serve --tp to the CUDA families with ranks
  laudney
  committed
  f60cc18
- feat(flashnext): ranks agree on a computed checkpoint digest
  laudney
  committed
  0a97be7
- feat(flashnext): accept BF16 dense and shared layers in ModelOpt
  laudney
  committed
  c24e2f4
- feat(flashnext): FP8 rows in the n-gram table
  laudney
  committed
  c6e4247
- feat(flashnext): FP8 block experts in the MTP head
  laudney
  committed
  399d535
- docs(flashnext): serve NVIDIA's NVFP4 checkpoint at TP=2
  laudney
  committed
  be7eba0
- refactor(cuda): keep --tp's refusals and test out of cuda.zig
  laudney
  committed
  fd3c61d
- test(contract): gate Flash Next NVFP4's BF16 and FP8 expert kernels
  laudney
  committed
  f14b20e
- fix(flashnext): keep one GPU's expert sums at --tp 2
  laudney
  committed
  57647e4
- docs(changelog): note --tp 2 replies equal one GPU's for Flash Next
  laudney
  committed
  87dd668
- style(contract): shorten comments for the lean rule
  laudney
  committed
  6c0a0a5
- fix(flashnext): word the --tp load refusals and credit the PR
  laudney
  committed
  db7e9f5
- feat(flashnext): split dense output columns with exact gathers
  laudney
  committed
  1bfd6cc
- test(cuda): compare GDN heads against a frozen baseline
  laudney
  committed
  1077d5f
- perf(flashnext): write shared down into its output slot
  laudney
  committed
  369601a
- fix(cuda): fall back when the strided shared down cannot take a shape
  laudney
  committed
  90938e0

Commits

Commits on Nov 2, 2026