Repository navigation
[疑问] 自定义数据集跑不起来报错 #217
Description
[2026-03-29 01:04:32,658] [ais_bench] [INFO] Warmup finished Total Count: 1 Success Count: 0 Failed Count: 1
Failed Reasons:
+---------------+-------+
| Failed Reason | Count |
+---------------+-------+
| | 1 |
+---------------+-------+
Traceback (most recent call last):
File "/home/benchmark/ais_bench/benchmark/tasks/openicl_api_infer.py", line 704, in
raise e
File "/home/benchmark/ais_bench/benchmark/tasks/openicl_api_infer.py", line 701, in
inferencer.run(task_state_manager)
File "/home/benchmark/ais_bench/benchmark/tasks/openicl_api_infer.py", line 488, in run
self.warm_up(data_list, task_state_manager)
File "/home/benchmark/ais_bench/benchmark/tasks/openicl_api_infer.py", line 467, in warm_up
raise AISBenchRuntimeError(
ais_bench.benchmark.utils.logging.exceptions.AISBenchRuntimeError: [TINFER-RUNTIME-001]warmup failed. Exit task because all warmup requests failed, failed reasons: {'': 1} | Visit https://ais-bench-benchmark-rf.readthedocs.io/zh-cn/latest/faqs/error_codes.html#tinfer-runtime-001 for further help.
[2026-03-29 01:04:34,642] [ais_bench] [INFO] Inference tasks completed.
[2026-03-29 01:04:34,644] [ais_bench] [INFO] Summarizing performance results...
[2026-03-29 01:04:34,644] [ais_bench] [WARNING] Can't find details perf data of [vllm-api-stream-chat/gsm8k] in outputs/default/20260329_010406, use tmp cache data.
Traceback (most recent call last):
File "/usr/local/bin/ais_bench", line 33, in
sys.exit(load_entry_point('ais-bench-benchmark', 'console_scripts', 'ais_bench')())
File "/home/benchmark/ais_bench/benchmark/cli/main.py", line 6, in main
task_manager.run()
File "/home/benchmark/ais_bench/benchmark/cli/task_manager.py", line 39, in run
workflow_executor.execute()
File "/home/benchmark/ais_bench/benchmark/cli/workers.py", line 453, in execute
worker.do_work(cfg)
File "/home/benchmark/ais_bench/benchmark/cli/workers.py", line 430, in do_work
summarizer.summarize()
File "/home/benchmark/ais_bench/benchmark/summarizers/default_perf.py", line 427, in summarize
details_perf_datas = self._load_details_perf_data(
File "/home/benchmark/ais_bench/benchmark/summarizers/default_perf.py", line 251, in _load_details_perf_data
raise FileMatchError(
ais_bench.benchmark.utils.logging.exceptions.FileMatchError: [SUMM-FILE-001]can't find detail perf data file. Can't find any details perf data file in work_dir, please check outputs/default/20260329_010406. | Visit https://ais-bench-benchmark-rf.readthedocs.io/zh-cn/latest/faqs/error_codes.html#summ-file-001 for further help.
Activity
github-actions commentedon Mar 25, 2026
🌟欢迎给AISBench benchmark测评工具提issue，您可以先尝试以下途径寻求issue的解决方法：
github-actions commentedon Mar 25, 2026
🤖 基于AI机器人的issue内容完整性检查结果:
问题内容检查结果
检查状态
PASS
详细检查
改进建议
所有内容已完备！
补充
👉 如果想重新检查，在评论区@issue_checker即可。
【强烈推荐❤️🔥】确保issue描述完整后，可以试着将issue交给
回答，deepwiki包含了和工具相关的所有知识库
github-actions commentedon Mar 28, 2026
🤖 issue content check result from AI robot:
Issue Content Check Result
Check Status
FAIL
Detailed Check
Improvement Suggestions
The "Inquiry Description" section is missing. The current issue body only contains error logs and tracebacks. To make the issue actionable and understandable, please provide the following information:
ais_benchversion or how it was installed.Additional Comments
The provided logs indicate a
warmup failederror and acan't find detail perf data fileerror. While these are helpful, they are symptoms. A proper "Inquiry Description" from the user is essential to understand the root cause and provide assistance.👉 If you want to re-check, please comment @issue_checker.
[Strongly recommended❤️🔥]Ensure your issue description is complete, then try to ask
for help, as deepwiki contains all the knowledge related to the tool.
wenba0 commentedon Jun 22, 2026
warmup failed，请确保models配置可以正常与服务建立连接，另外基于gsm8k自定义数据的话需确保数据格式与原始保持一致