Name		Name	Last commit message	Last commit date
CLIENT.py		CLIENT.py
README.md		README.md
RPD_Profile.sh		RPD_Profile.sh
SERVER.py		SERVER.py
parse_serving_results.py		parse_serving_results.py

Repository files navigation

SGLang-benchmarks

Example to run:

python3 SERVER.py --model GROK2 --attn-backend aiter
python3 CLIENT.py --model GROK2
python3 parse_serving_results.py online-GROK2.jsonl

About

No description, website, or topics provided.

0 stars

0 watching

Report repository

Releases

Packages

Contributors

Languages