Repository navigation

relu^2 keeps a NaN: grouped experts, ck experts and Nemotron's pocket - #1628

Merged

ashhart merged 3 commits into

ashhart:mainfrom

BobClawblaw:relu2-nan

Oct 30, 2026

Merged

relu^2 keeps a NaN: grouped experts, ck experts and Nemotron's pocket#1628
ashhart merged 3 commits into
ashhart:mainfrom
BobClawblaw:relu2-nan

Commits on Oct 30, 2026
- experts relu^2: a NaN sum stays NaN (b < 0 ? 0 : b, not fmaxf)
  
  BobClawblaw
  authored and
  ashhart
  committed
  3f9a704
- ck experts and pockets relu^2: a NaN stays NaN (v < 0 ? 0 : v), and an NVFP4 block holding one gets a NaN scale (max_nan, not fmaxf)
  
  BobClawblaw
  authored and
  ashhart
  committed
  7f37d8c
- changelog: #1628
  ashhart
  committed
  b014536