Skip to content

Skip /go's fix-commit review and Final simplify for small, low-risk fixes - #271

Merged
haacked merged 6 commits into
mainfrom
haacked/go-scale-review
Oct 29, 2026
Merged

haacked merged 6 commits into
mainfrom
haacked/go-scale-review

Conversation

@haacked

@haacked haacked commented Oct 28, 2026

Copy link
Copy Markdown
Owner

/go reviews its review fixes with a second review-code run that costs about as much as reviewing the whole PR (a median of 1.5M tokens in review-code's log), even when the fixes are a few lines. Final simplify then runs over the same fixes. Each review's token rows also lived only under the worktree's .notes/, so they were deleted with the worktree and nobody could measure this.

This skips those two late steps when the change is small and safe to skip. I kept the first review at full strength, because in review-code's log 4 of the 5 real blockers on diffs under 50 lines came from specialist reviewers, not correctness. Small code fixes keep their review too, since 7-line and 63-line deltas in the log each had a blocker. So review-tier.py skips the fix-commit review only for a small docs or tests change that touches no risky path (migration, API, wire format, auth, infra, dependency, SQL delete) and makes no uncertain change (rename, deleted file, binary, mode change). A file it doesn't recognize counts as code. Final simplify skips when the fixes change 20 lines or fewer, or only docs. The Report lists each skipped step, and run-review.py copies the review's token rows into review-code's shared log with the go run IDs added.

A separate review-code change will let /go narrow small code fix commits to correctness and testing instead.

Test plan

  • python3 ai/skills/go/scripts/tests/test_review_tier.py, including a small migration, a rename across 12 files, deleted-only diffs, .txt and prompt files, and an added line starting with ++
  • python3 ai/skills/go/scripts/tests/test_run_review.py, including undecodable token rows and a symlinked shared log
  • Run /go on a branch whose review fixes touch only tests, and check that the Report lists the skipped review and the unreviewed commits

https://claude.ai/code/session_01AovXvYY2uZDJFssBEumPmd

/go's single pass follows the rule, and the stage loop passes it to each
stage implementer alongside the judgment-call rule. review-code --fix
agents still get neither.

ai/evals/smallest-change is an eval-only plugin for `claude plugin eval`.
The with arm loads a SessionStart hook that prints rule.md, a copy of the
rule that ai/tests/test-eval-rule-sync.sh keeps in sync. The without arm
is the tool's no-plugin baseline, so the rule is the only difference.
Three scaffolded Python cases grade with hidden tests, a production-line
limit, a dependency check, and (in two cases) a check that the change
uses the stdlib module or existing helper.

Claude-Session: https://claude.ai/code/session_01AovXvYri48wFhqGV3epaMi
Judgment calls and Smallest complete change go to the single pass and
each stage implementer only. The test writer and review-code --fix
agents get neither.

Claude-Session: https://claude.ai/code/session_01AovXvYri48wFhqGV3epaMi
…ixes

review-tier.py decides over a commit range whether Review fix commits
runs its review (skipped only for small docs or test changes with no
risky path or uncertain change) and whether Final simplify runs
(skipped for a few lines or docs only). The Report lists each skipped
step.

run-review.py copies the review child's token-usage rows into
review-code's shared log, tagged with the go run IDs, so they survive
removal of the worktree.

Claude-Session: https://claude.ai/code/session_01AovXvYY2uZDJFssBEumPmd
@haacked
haacked force-pushed the haacked/go-scale-review branch from 59c9cf8 to be56a78 Compare October 29, 2026 16:09
@haacked
haacked changed the base branch from haacked/go-smallest-change to main October 29, 2026 16:15
@haacked
haacked marked this pull request as ready for review October 29, 2026 16:33
@haacked
haacked merged commit 497fe59 into main Oct 29, 2026
1 check passed
@haacked
haacked deleted the haacked/go-scale-review branch October 29, 2026 16:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant