Skip to content

Budget inference tokens across workers, not per worker - #22

Merged
anketpratapsingh merged 2 commits into
mainfrom
perf/total-token-budget
Aug 22, 2026
Merged

Budget inference tokens across workers, not per worker#22
anketpratapsingh merged 2 commits into
mainfrom
perf/total-token-budget

Migrate blob_to_f32 to as_chunks for clippy 1.98

afc6ca8
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar