Skip to content

fix: honor engine exit codes in library verdicts#307

Open
pmatos wants to merge 1 commit into
mainfrom
sym/jsse/294-node-compat-harness-pass-fail-total-verdicts-in-js-sha256-lodash-luxon-ignore-engine-exit-code
Open

fix: honor engine exit codes in library verdicts#307
pmatos wants to merge 1 commit into
mainfrom
sym/jsse/294-node-compat-harness-pass-fail-total-verdicts-in-js-sha256-lodash-luxon-ignore-engine-exit-code

Conversation

@pmatos

@pmatos pmatos commented Jul 17, 2026

Copy link
Copy Markdown
Owner

Summary

  • capture the engine exit code in the js-sha256, lodash, and luxon verdict hooks
  • require a zero engine exit in addition to a zero-failure, nonempty summary
  • preserve the parsed test count when a timeout or crash turns the verdict into FAIL

Validation

  • focused PASS/FAIL/TOTAL verdict matrix for clean exit, timeout, crash, reported failure, and empty suite
  • bash -n scripts/libs/js-sha256.sh scripts/libs/lodash.sh scripts/libs/luxon.sh
  • cargo fmt --check
  • cargo clippy
  • cargo build --release
  • cargo test --release
  • ./scripts/lint.sh
  • TZ=UTC uv run python scripts/run-test262.py — 99,568/99,568 passed, zero regressions

The host workspace uses Europe/Berlin; an initial unqualified full run exposed 22 pre-existing timezone-sensitive Intl failures. All 22 passed under UTC, and the UTC-normalized full run matched the 100% result recorded in README. No baseline or README update was needed.

Closes #294

Require successful engine termination before js-sha256, lodash, or luxon
can report PASS from a zero-failure summary. This prevents timeouts and
crashes after the summary from becoming false passes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

node-compat harness: PASS/FAIL/TOTAL verdicts in js-sha256/lodash/luxon ignore engine exit code

1 participant