Skip to content

llama: a smaller Llama drafting for the served one (--drafter), replies unchanged (builds on #1415) - #1417

Open
BobClawblaw wants to merge 12 commits into
ashhart:mainfrom
BobClawblaw:llama-drafter-pr
Open

BobClawblaw wants to merge 12 commits into
ashhart:mainfrom
BobClawblaw:llama-drafter-pr

llama: the plain --drafter serves the bf16 drafter; --drafter-bits is…

c3ee3db
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
desktop
succeeded Oct 29, 2026 in 8m 12s