[Bug] qpqa 测试卡住 #580

Operating System and Version

ubuntu

Python Environment for Tool Installation

Python virtual environment created with Anaconda/Miniconda

Python Version

3.10

AISBench Tool Version

v3.1-20260912-master

AISBench Execution Command

ais_bench --models vllm_api_stream_chat --datasets gpqa_gen_0_shot_cot_chat_prompt --num-warmups 0

Model Configuration File or Custom Configuration File Content

vllm_api_stream_chat.py
from ais_bench.benchmark.models import VLLMCustomAPIChat
from ais_bench.benchmark.utils.postprocess.model_postprocessors import extract_non_reasoning_content

models = [
dict(
attr="service",
type=VLLMCustomAPIChat,
abbr="vllm-api-stream-chat",
path="/mnt/share/DeepSeek-V4.1-Flash-bf16/",
model="deepseek-v41-engram",
stream=True,
request_rate=0,
use_timestamp=False,
retry=2,
api_key="",
host_ip="localhost",
host_port=8000,
url="",
max_out_len=98304,
batch_size=1024,
trust_remote_code=False,
generation_kwargs=dict(
temperature=1,
top_p=0.95,
chat_template_kwargs=dict(reasoning_effort="low", enable_thinking=True),
),
pred_postprocessor=dict(type=extract_non_reasoning_content),
)
]

Expected Behavior

No response

Actual Behavior

一直卡在145不动，然后前端服务有推理
Base path of result&log : outputs/default/20260929_113620
Task Progress Table (Updated at: 2026-09-29 12:59:41)
Page: 1/1 Total 2 rows of data
Press Up/Down arrow to page, 'P' to PAUSE/RESUME screen refresh, 'Ctrl + C' to exit

+-----------------------------------+-----------+-----------------------------------------------------+-------------+-------------+--------------------------------------------
| Task Name | Process | Progress | Time Cost | Status | Log Path
+===================================+===========+=====================================================+=============+=============+============================================
| vllm-api-stream-chat/GPQA_diamond | 1142811 | [##################### ] 145/198 [0.3 it/s] | 1:22:59 | inferencing | logs/infer/vllm-api-stream-chat/GPQA_diamon
+-----------------------------------+-----------+-----------------------------------------------------+-------------+-------------+--------------------------------------------
------+------------------------------------------------------+

Pre-Checks

• I have read the Quick Start section in the homepage documentation and cannot resolve the issue
• I have searched the FAQ and found no duplicate issues
• I have searched existing Issues and found no duplicate issues
• I have updated to the latest version, and the issue still persists