Skip to content

Capture and check the logs of Simulation tests with @test_logs - #6087

Merged
giordano merged 4 commits into
mainfrom
mg/quiet-simulation-tests
Sep 28, 2026
Merged

giordano merged 4 commits into
mainfrom
mg/quiet-simulation-tests

Conversation

@giordano

Copy link
Copy Markdown
Member

Make tests less chatty and actually test more things.

Since the move to ParallelTestRunner most tests share a single CI job, whose
log is dominated by messages printed by the tests.  In
`test/simulation/simulation.jl` every `run!`, first `time_step!` and stop
criterion call printed initialization, initial-time-step and stop messages.
Wrap these calls in `@test_logs`, which both silences them and asserts the
exact sequence of messages: the stop reason, that the `NaNChecker` fires
during initialization, the order of progress-callback messages relative to
the stop messages, and the previously untested warning emitted when
`minimum_relative_step` skips a time step.  Also drop the `@info "Testing ..."`
banners, which are redundant with the testset names.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01YT3BwDvhiaJUeJXHKwCb7A
@giordano giordano added the testing 🧪 Tests get priority in case of emergency evacuation label Sep 26, 2026
@giordano
giordano requested a review from navidcy September 28, 2026 08:35
@codecov

codecov Bot commented Sep 28, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 75.25%. Comparing base (2141abf) to head (6cc4364).
⚠️ Report is 93 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6087      +/-   ##
==========================================
+ Coverage   74.01%   75.25%   +1.24%     
==========================================
  Files         428      434       +6     
  Lines       26420    27282     +862     
==========================================
+ Hits        19554    20532     +978     
+ Misses       6866     6750     -116     
Flag Coverage Δ
buildkite 69.13% <ø> (+1.38%) ⬆️
distributed_tripolar 20.73% <ø> (?)
julia 69.13% <ø> (+1.38%) ⬆️
reactant_1 ?
reactant_2 ?
reactant_3 ?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@giordano
giordano merged commit cf4d90f into main Sep 28, 2026
18 checks passed
@giordano
giordano deleted the mg/quiet-simulation-tests branch September 28, 2026 11:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

testing 🧪 Tests get priority in case of emergency evacuation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants