Repository navigation
feat(audit): support matrix for extra checks, null batch average, partial performance score (#788 #768 #769) - #818
Merged
Conversation
…trix-696bc8 # Conflicts: # CHANGELOG.md # docs/OUTPUT_CONTRACT.md # tests/integration_test.rs
…trix-696bc8 # Conflicts: # CHANGELOG.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Partial work on #788, #768 and #769 (issues stay open).
#788
audit::support_matrix: per extra check (--isolate-third-party-impact,--check-ssr-content,--ai-transparency,--dns-check) the prerequisite and the outcome per mode (single, batch, cache, replay).Args::validaterejects unsupported combinations with the reason (isolation without performance, SSR gap without SEO,--ai-transparencyin batch). Before, they were silently set tofalse/ a note was printed.module_runs.#768
BatchSummary.average_scoreisOption<f64>(+average_over);summary.accessibility_score/overall_scorearenullwhen no URL produced a report. Schema and OUTPUT_CONTRACT updated (schema now also listscoverage,attempted_url_count).selected > attemptedmakes the batch incomplete (not_attempted_urls,incomplete_scope);with_samplere-derives the decision.selected > attempted, fully-failed JSON, binary exit 2 for an all-failed batch (#[ignore], Chrome).#769
PerformanceScore.partial(serialized) when not all four core metrics exist; partial/not-measured modules no longer repeat their subset score as page/summary<module>_score(null).module_scoresto JSON (old: 100 everywhere).Overlaps / open
src/cli/args.rs(one block invalidate),src/cli/runners.rs(removed batch AI note + feature check),src/audit/pipeline/mod.rs,report.rs(with_sample,is_complete),verdict.rs/validation.rs(average now optional): expect small conflicts with [2.0][U26] First-N-Auswahl ist keine belegte repräsentative Websitebewertung #791 (815), [2.0][U25] Schichten, Persistenz und Reproduzierbarkeit sind noch nicht geschlossen #790 (816), [2.0][U13] Prüfabdeckung und Vollständigkeit werden nicht konsequent aus Ausführung abgeleitet #778 (814).NotRun("replay_does_not_measure")), no entry point yet ([2.0][U25] Schichten, Persistenz und Reproduzierbarkeit sind noch nicht geschlossen #790); capability/budget are not matrix columns (feature-gate check for ai-transparency stays in runners); grade/certificate of an all-failed batch still derive from 0; the all-failed binary test needs Chrome.cargo test --all-features,cargo clippy --all-features --all-targets -- -D warnings, ignored Chrome tests for the new batch/CLI cases.