Skip to content

benchdnn: matmul: introduce weekly set - #5985

Open
dzarukin wants to merge 2 commits into
mainfrom
dzarukin/benchdnn_matmul_weekly
Open

dzarukin wants to merge 2 commits into
mainfrom
dzarukin/benchdnn_matmul_weekly

Conversation

@dzarukin

@dzarukin dzarukin commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Existing fwks input files are fixed from release to release but may occupy significant amount of time in Nightly validation scope.
The consensus is to keep them in validation as there's a desire to verify external workloads are still functionally correct but shift them to a weekly cadence on the identical to Nightly support matrix.

This PR introduces a new TEST_SET level, converts option sets into harnesses as this is what they are and consolidates a single input for them which will run for CPU and GPU.

This PR is pending on #5984 to resolve "false-positive" failures on CPU as they are expected.
It also identified MFDNN-15553

@dzarukin
dzarukin requested review from a team as code owners September 9, 2026 23:24
@github-actions github-actions Bot added component:tests Codeowner: @oneapi-src/onednn-arch component:build labels Sep 9, 2026
@dzarukin
dzarukin force-pushed the dzarukin/benchdnn_matmul_weekly branch from e4a8e22 to c00a2ea Compare September 11, 2026 18:57
From this point, Weekly test set covers manually managed problems
obtained through verbose logs conversion from various sources.
@dzarukin
dzarukin force-pushed the dzarukin/benchdnn_matmul_weekly branch from c00a2ea to cf6e7b0 Compare September 15, 2026 01:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component:build component:tests Codeowner: @oneapi-src/onednn-arch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant