Skip to content

Feat (brevitas_examples/vllm): evaluate LLM through vLLM - #1601

Draft
Giuseppe5 wants to merge 2 commits into
Xilinx:masterfrom
Giuseppe5:vllm_benchmark
Draft

Giuseppe5 wants to merge 2 commits into
Xilinx:masterfrom
Giuseppe5:vllm_benchmark

Conversation

@Giuseppe5

Copy link
Copy Markdown
Collaborator

This new script should allow to run zero-shot evaluation with a Brevitas-exported vLLM model

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant