Skip to content

Fix comparison ordering to use absolute rank gaps - #305

Merged
ALeonard9 merged 1 commit into
mainfrom
codex/comparison-raw-rank-gap
Aug 5, 2026
Merged

Fix comparison ordering to use absolute rank gaps#305
ALeonard9 merged 1 commit into
mainfrom
codex/comparison-raw-rank-gap

Conversation

@ALeonard9

Copy link
Copy Markdown
Owner

Summary

  • replace percentile-normalized comparison distance with abs(your rank - their rank)
  • order biggest gaps from largest raw difference to smallest
  • order most aligned from smallest raw difference to largest
  • update the overall alignment score to use the average raw rank gap
  • update the explanation shown on comparison pages

Regression coverage

  • equal ranks such as #14 and #14 produce a zero gap and sort first under Most aligned
  • rankings such as #88 and #10 produce a gap of 78 and sort under Biggest gaps
  • integration coverage asserts both full orderings

Verification

  • full API suite: 791 passed
  • Black and Pylint passed
  • changed-test pre-push suite passed

@ALeonard9
ALeonard9 merged commit 3073434 into main Aug 5, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant