Repository navigation

Flash Next on CUDA: serve NVIDIA's NVFP4 checkpoint on one GB10 or at --tp 2 - #1771

Merged

ashhart merged 14 commits into

ashhart:mainfrom

laudney:pr-fn-nvfp4

Nov 3, 2026

Merged

Flash Next on CUDA: serve NVIDIA's NVFP4 checkpoint on one GB10 or at --tp 2#1771
ashhart merged 14 commits into
ashhart:mainfrom
laudney:pr-fn-nvfp4

Commits on Nov 3, 2026
- fix(flashnext): keep the ranked vtable static
  
  laudney
  authored and
  ashhart
  committed
  e7a6cbb
- feat(cuda): serve --tp to the CUDA families with ranks
  
  laudney
  authored and
  ashhart
  committed
  84e88b0
- feat(flashnext): ranks agree on a computed checkpoint digest
  
  laudney
  authored and
  ashhart
  committed
  e868bb7
- feat(flashnext): accept BF16 dense and shared layers in ModelOpt
  
  laudney
  authored and
  ashhart
  committed
  36e4d8d
- feat(flashnext): FP8 rows in the n-gram table
  
  laudney
  authored and
  ashhart
  committed
  a9b3e5f
- feat(flashnext): FP8 block experts in the MTP head
  
  laudney
  authored and
  ashhart
  committed
  e84ec3d
- docs(flashnext): serve NVIDIA's NVFP4 checkpoint at TP=2
  
  laudney
  authored and
  ashhart
  committed
  7d33ef1
- refactor(cuda): keep --tp's refusals and test out of cuda.zig
  
  laudney
  authored and
  ashhart
  committed
  8380951
- test(contract): gate Flash Next NVFP4's BF16 and FP8 expert kernels
  
  laudney
  authored and
  ashhart
  committed
  e32ce54
- fix(flashnext): keep one GPU's expert sums at --tp 2
  
  laudney
  authored and
  ashhart
  committed
  097042c
- docs(changelog): note --tp 2 replies equal one GPU's for Flash Next
  
  laudney
  authored and
  ashhart
  committed
  f58554a
- style(contract): shorten comments for the lean rule
  
  laudney
  authored and
  ashhart
  committed
  bbfa9a4
- fix(flashnext): word the --tp load refusals and credit the PR
  
  laudney
  authored and
  ashhart
  committed
  2da5cf7
- changelog: #1771's line once (the rebase's keep-both copied it three times)
  ashhart
  committed
  fa57d2a

Commits

Commits on Nov 3, 2026