Skip to content

Budget inference tokens across workers, not per worker - #22

Merged
anketpratapsingh merged 2 commits into
mainfrom
perf/total-token-budget
Aug 22, 2026
Merged

Budget inference tokens across workers, not per worker#22
anketpratapsingh merged 2 commits into
mainfrom
perf/total-token-budget

Commits

Commits on Aug 22, 2026