Skip to content

ci: run every skill's tests with one glob step - #10

Merged
mikeastock merged 1 commit into
mainfrom
ci-glob-skill-tests
Oct 12, 2026
Merged

mikeastock merged 1 commit into
mainfrom
ci-glob-skill-tests

Conversation

@mikeastock-bot

@mikeastock-bot mikeastock-bot commented Oct 7, 2026 •

Copy link
Copy Markdown

Replaces the four per-skill node --test steps with one step: node --test evals/tasks/*/*.test.mjs. A new skill's tests now run in CI without anyone editing the workflow.

  • It still runs on Node 22, with Poppler installed first for Proposal Builder's PDF page checks.
  • Locally it runs all 55 tests (Bid Leveling 18, Proposal Builder 12, RFP Intake 11, Workforce Planning 14), the same tests the four steps ran.
  • Trade-off: a failure is reported under one step, not a per-skill step. The test output still names the file and test.

Note

Run all skill tests in CI with a single glob step

Replaces the four explicitly named Node test steps in the validate workflow with one step that matches every evals/tasks/*/*.test.mjs file. New skill tests are now picked up automatically. Behavioral Change: CI runs every matching test module under evals/tasks/, so a failing test in any previously unlisted file now fails validation. See validate.yml.

Macroscope summarized d75915c.

@mikeastock
mikeastock merged commit b3ec0a7 into main Oct 12, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants