Skip to content

feat(evalboard): count agent time apart from eval overhead, and filter runs by variant #748

feat(evalboard): count agent time apart from eval overhead, and filter runs by variant

feat(evalboard): count agent time apart from eval overhead, and filter runs by variant #748

Triggered via pull request September 24, 2026 21:20
Status Cancelled
Total duration 7m 37s
Artifacts 2

pr-checks.yml

on: pull_request
Quality Gate (Format, Lint, Type, Test, Security)
6m 9s
Quality Gate (Format, Lint, Type, Test, Security)
Evalboard (Types, Tests, Build)
1m 52s
Evalboard (Types, Tests, Build)
Claude Code Plugin (manifests + offline scaffold)
26s
Claude Code Plugin (manifests + offline scaffold)
No-Extra Install (uipath optional)
31s
No-Extra Install (uipath optional)
Windows Smoke Test
6m 55s
Windows Smoke Test
E2E Smoke Tests (Real API)
6m 32s
E2E Smoke Tests (Real API)
Live Integration Tests (Settings Enforcement + Cost Budget)
1m 18s
Live Integration Tests (Settings Enforcement + Cost Budget)
Live Integration Tests (Codex)
57s
Live Integration Tests (Codex)
Live Integration Tests (BYOA Plugin)
45s
Live Integration Tests (BYOA Plugin)
Action Dogfood (composite action, real API)
35s
Action Dogfood (composite action, real API)
Delegate Live E2E (ROPC)
1m 46s
Delegate Live E2E (ROPC)
Fit to window
Zoom out
Zoom in

Annotations

3 errors, 8 warnings, and 2 notices
PR Quality Checks
Canceling since a higher priority waiting request for PR Quality Checks-refs/pull/198/merge exists
Windows Smoke Test
Canceling since a higher priority waiting request for PR Quality Checks-refs/pull/198/merge exists
Windows Smoke Test
The operation was canceled.
Claude Code Plugin (manifests + offline scaffold)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020, astral-sh/setup-uv@38f3f104447c67c051c4a08e39b64a148898af3a. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Action Dogfood (composite action, real API)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020, astral-sh/setup-uv@38f3f104447c67c051c4a08e39b64a148898af3a. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Live Integration Tests (Settings Enforcement + Cost Budget)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Delegate Live E2E (ROPC)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Live Integration Tests (BYOA Plugin)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Evalboard (Types, Tests, Build)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
E2E Smoke Tests (Real API)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Windows Smoke Test
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Claude Code Plugin (manifests + offline scaffold)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"
Action Dogfood (composite action, real API)
"The ubuntu-latest label will migrate to Ubuntu 26 beginning October 19, 2026. For more information, see https://github.com/actions/runner-images/issues/14748"

Artifacts

Produced during runtime
Name Size Digest
coverage-report
55.6 KB
sha256:66e741c1d6e3dbce171b3595d41720661ea396ee08f6c0f6b4d08f55dc560227
security-reports
2.34 KB
sha256:2aeee855a78f983dda860a6d56d0628c8cd708c038df394f43cfef229101d70b