Issues

• Server load-aware testing

  openshift-psap/llm-load-test#96 · Filter by author thameem-abbas opened on Feb 17, 2025

• Need for the ability to launch a load test with either purely CLI parameters or the ability to override yaml parameters selectively.

  Feature

  openshift-psap/llm-load-test#95 · Filter by author thameem-abbas opened on Feb 17, 2025

• NoneType Error in result.output_text Join When Serving Qwen2.5-72B-Instruct

  openshift-psap/llm-load-test#94 · Filter by author h-albert-lee opened on Feb 17, 2025

• ITL: ZeroDivisionError: float division by zero

  openshift-psap/llm-load-test#93 · Filter by author kpouget opened on Feb 14, 2025

• Graceful exit or validation of server parameters

  openshift-psap/llm-load-test#89 · Filter by author thameem-abbas opened on Feb 1, 2025

• Need different test duration for different concurrencies

  openshift-psap/llm-load-test#87 · Filter by author thameem-abbas opened on Jan 31, 2025
  1

• Update dataset format

  openshift-psap/llm-load-test#85 · Filter by author sjmonson opened on Jan 23, 2025

• Review dependencies

  kind/cleanup
  openshift-psap/llm-load-test#79 · Filter by author sjmonson opened on Jan 16, 2025

• Version llm-load-test

  kind/feature
  openshift-psap/llm-load-test#76 · Filter by author sjmonson opened on Jan 16, 2025
  

• Adding Wiki pages to the repo

  kind/feature
  openshift-psap/llm-load-test#70 · Filter by author thameem-abbas opened on Jan 2, 2025

• Interrupt ongoing requests at end of test

  openshift-psap/llm-load-test#37 · Filter by author dagrayvid opened on Mar 18, 2024

• Make the system prompt and prompt format configurable

  openshift-psap/llm-load-test#33 · Filter by author dagrayvid opened on Feb 26, 2024

• Add dataset config to set min input tokens

  openshift-psap/llm-load-test#32 · Filter by author dagrayvid opened on Feb 26, 2024

• Add evaluation metrics on the test dataset

  openshift-psap/llm-load-test#24 · Filter by author ashishkamra opened on Jan 18, 2024

• Run the appropriate linter on the diff, not on all the code

  openshift-psap/llm-load-test#11 · Filter by author fcami opened on Mar 14, 2023
  

• CI: end-to-end test(s)

  kind/feature
  openshift-psap/llm-load-test#7 · Filter by author fcami opened on Mar 13, 2023