Skip to content

Make Windows CUDA Python tests deterministic #2478

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Copilot wants to merge 1 commit into
base: main
Choose a base branch
from
+11 −2
Open

Make Windows CUDA Python tests deterministic #2478

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 11 additions & 2 deletions .github/workflows/win-cuda-x64-build.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ env:
CUDA_PATH: ${{ github.workspace }}\\cuda_sdk\\v12.8
buildRoot: 'build/cuda/win-x64'
binaryDir: 'build/cuda/win-x64/Release'
SCCACHE_DIR: ${{ github.workspace }}\sccache
ORT_NUGET_SOURCE: "https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/nuget/v3/index.json"
ORT_EP_NUGET_SOURCE: "https://pkgs.dev.azure.com/aiinfra/PublicPackages/_packaging/ORT-Nightly/nuget/v3/index.json"
ORT_EP_PYPI_SOURCE: "https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple/"
Expand Down Expand Up @@ -111,7 +112,6 @@ jobs:

- name: Build with build.py
run: |
$env:SCCACHE_DIR = "${{ github.workspace }}\sccache"
# Limit CUDA archs to SM 86 (matches the A10 runner GPU) to keep CI build
# time and memory usage manageable.
python -m pip install -r requirements-dev.txt
Expand Down Expand Up @@ -197,9 +197,18 @@ jobs:
run: |
ctest --test-dir $env:binaryDir\src\java --build-config Release --verbose --timeout 10800

- name: Verify CUDA EP
shell: pwsh
run: |
python -c "import onnxruntime_genai as og; assert og.is_cuda_available(), 'CUDA EP failed to load'"
Comment thread
tianleiwu marked this conversation as resolved.

- name: Run the Python Tests
run: |
python test/python/test_onnxruntime_genai.py --cwd "test\python" --test_models "test\models" --e2e
python test/python/test_onnxruntime_genai.py `
--cwd "test\python" `
--test_models "test\models" `
--eps cuda `
--e2e

- name: Verify Build Artifacts
if: always()
Expand Down
Loading