Skip to content

qwen3_5 cuda: 2, 3, 5 and 6-bit tiles of their own width and a prompt GEMM for them (27B oQ2 on 16 GB) - #859

Merged
ashhart merged 36 commits into
ashhart:mainfrom
BobClawblaw:cuda-native-lowbit
Oct 18, 2026
Merged

qwen3_5 cuda: 2, 3, 5 and 6-bit tiles of their own width and a prompt GEMM for them (27B oQ2 on 16 GB)#859
ashhart merged 36 commits into
ashhart:mainfrom
BobClawblaw:cuda-native-lowbit

Commits

  1. Commits on Oct 16, 2026