Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Events
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
ServiceNow
webarena-verified
Repository navigation
Code
Issues
21
(21)
Pull requests
7
(7)
Actions
Security and quality
Insights
More
items
Feature/add leaderboard
- #27
#27
Draft
Am1n3e
wants to merge 71 commits into
main
ServiceNow/webarena-verified:main
from
feature/add-leaderboard
ServiceNow/webarena-verified:feature/add-leaderboard
Copy head branch name to clipboard
Conversation
Commits
71
(71)
Checks
Files changed
Draft
Feature/add leaderboard
#27
Am1n3e
wants to merge 71 commits into
main
ServiceNow/webarena-verified:main
from
feature/add-leaderboard
ServiceNow/webarena-verified:feature/add-leaderboard
Copy head branch name to clipboard
Commits
Commits on Feb 7, 2026
Add Phase 0 leaderboard canonical models and specs
amine-elh-sn
committed
46c7914
View commit details
Copy full SHA for 46c7914
Browse repository at this point
Add leaderboard submission PR CI validator with fail-closed rate limits
amine-elh-sn
committed
1dbcc6e
View commit details
Copy full SHA for 1dbcc6e
Browse repository at this point
Implement Track A control-plane transitions and validation
amine-elh-sn
committed
d6b7797
View commit details
Copy full SHA for d6b7797
Browse repository at this point
Merge branch 'codex/leaderboard-track-a-control' into add-leadearboard-site
amine-elh-sn
committed
6cbded5
View commit details
Copy full SHA for 6cbded5
Browse repository at this point
Address Track B review: move validator to dev and harden PR checks
amine-elh-sn
committed
b24cc00
View commit details
Copy full SHA for b24cc00
Browse repository at this point
Implement Astro leaderboard site with tabbed rankings and styled responsive table
amine-elh-sn
committed
1a0bd03
View commit details
Copy full SHA for 1a0bd03
Browse repository at this point
Refine leaderboard controls alignment and hide page size label
amine-elh-sn
committed
da1fd4f
View commit details
Copy full SHA for da1fd4f
Browse repository at this point
Merge branch 'codex/leaderboard-track-b-ci' into add-leadearboard-site
amine-elh-sn
committed
09a4c2a
View commit details
Copy full SHA for 09a4c2a
Browse repository at this point
Address Track C review: base-aware site paths and schema parity
amine-elh-sn
committed
f99cb8e
View commit details
Copy full SHA for f99cb8e
Browse repository at this point
Merge branch 'codex/leaderboard-track-c-site' into add-leadearboard-site
amine-elh-sn
committed
3037c70
View commit details
Copy full SHA for 3037c70
Browse repository at this point
Implement Track D atomic leaderboard publish workflow and dev tooling
amine-elh-sn
committed
0da507b
View commit details
Copy full SHA for 0da507b
Browse repository at this point
Merge branch 'codex/leaderboard-track-d-docs-e2e' into add-leadearboard-site
Show description for 2974072
amine-elh-sn
committed
2974072
View commit details
Copy full SHA for 2974072
Browse repository at this point
Commits on Feb 8, 2026
Implement HF PR-only scheduled leaderboard ingestion
amine-elh-sn
committed
c882e67
View commit details
Copy full SHA for c882e67
Browse repository at this point
Seed leaderboard integration branch with full implementation baseline
amine-elh-sn
committed
bf7685a
View commit details
Copy full SHA for bf7685a
Browse repository at this point
Commits on Mar 7, 2026
Refactor leaderboard CI validation modules (#26)
Am1n3e
authored
f944845
View commit details
Copy full SHA for f944845
Browse repository at this point
Add leaderboard implementation planning docs
Show description for ae39d24
Am1n3e
committed
ae39d24
View commit details
Copy full SHA for ae39d24
Browse repository at this point
Allow leaderboard manifest URL override via env
Show description for c3008fe
Am1n3e
committed
c3008fe
View commit details
Copy full SHA for c3008fe
Browse repository at this point
Freeze Lane B contracts around integer submission IDs (#31)
Am1n3e
authored
d4fe3aa
View commit details
Copy full SHA for d4fe3aa
Browse repository at this point
Add read-only PR gate intake validation (#33)
Am1n3e
authored
79a6a63
View commit details
Copy full SHA for 79a6a63
Browse repository at this point
Implement Lane D finalize workflow with canonical records (#32)
Am1n3e
authored
f1a6970
View commit details
Copy full SHA for f1a6970
Browse repository at this point
Implement Lane E canonical rebuild single-writer flow (#34)
Am1n3e
authored
1e17610
View commit details
Copy full SHA for 1e17610
Browse repository at this point
Document Lane A governance plan and execution status (#30)
Am1n3e
authored
c7342eb
View commit details
Copy full SHA for c7342eb
Browse repository at this point
Complete Lane F source wiring and Lane G contract coverage (#35)
Am1n3e
authored
a757128
View commit details
Copy full SHA for a757128
Browse repository at this point
Harden leaderboard submission pipeline and remove legacy HF sync path
Am1n3e
committed
6c392d9
View commit details
Copy full SHA for 6c392d9
Browse repository at this point
Remove legacy leaderboard workflows and processed publish path
Am1n3e
committed
a91b8a6
View commit details
Copy full SHA for a91b8a6
Browse repository at this point
Move leaderboard scripts and inline rebuild into finalize workflow
Am1n3e
committed
4904e66
View commit details
Copy full SHA for 4904e66
Browse repository at this point
Harden leaderboard finalize trust boundaries and public row contract
Am1n3e
committed
d244f35
View commit details
Copy full SHA for d244f35
Browse repository at this point
Fix leaderboard site bugs and improve visual polish
Show description for 27d1972
Am1n3e
committed
27d1972
View commit details
Copy full SHA for 27d1972
Browse repository at this point
Clean up redundant content and add sticky footer
Am1n3e
committed
8612ad7
View commit details
Copy full SHA for 8612ad7
Browse repository at this point
Replace legacy leaderboard intake with HF-direct control flow
Show description for 6b019b8
Am1n3e
and
sisyphus-dev-ai
committed
6b019b8
View commit details
Copy full SHA for 6b019b8
Browse repository at this point
Remove FAQ page, fix full-width layout, nav highlight, and table alignment
Am1n3e
committed
da0029a
View commit details
Copy full SHA for da0029a
Browse repository at this point
Remove temporary plan docs and apply review cleanups
Am1n3e
committed
75a006c
View commit details
Copy full SHA for 75a006c
Browse repository at this point
Remove tracked .wip docs and rename file lock helper
Am1n3e
committed
a47e114
View commit details
Copy full SHA for a47e114
Browse repository at this point
Remove leaderboard spec docs from branch
Am1n3e
committed
8dfa83c
View commit details
Copy full SHA for 8dfa83c
Browse repository at this point
Separate CI leaderboard schemas from submission types
Show description for 2a0754a
Am1n3e
committed
2a0754a
View commit details
Copy full SHA for 2a0754a
Browse repository at this point
Remove redundant leaderboard row field checks
Am1n3e
committed
51ad00a
View commit details
Copy full SHA for 51ad00a
Browse repository at this point
Remove webhook bridge and unused leaderboard templates
Show description for ec238dd
Am1n3e
committed
ec238dd
View commit details
Copy full SHA for ec238dd
Browse repository at this point
Consolidate leaderboard types into core modules
Show description for fea946b
Am1n3e
committed
fea946b
View commit details
Copy full SHA for fea946b
Browse repository at this point
Remove dead utility modules from leaderboard scripts
Show description for c9222b3
Am1n3e
and
sisyphus-dev-ai
committed
c9222b3
View commit details
Copy full SHA for c9222b3
Browse repository at this point
Simplify leaderboard type validators and payload contracts
Show description for 4b1befc
Am1n3e
and
sisyphus-dev-ai
committed
4b1befc
View commit details
Copy full SHA for 4b1befc
Browse repository at this point
Add backward-compat key stripping for submission control records
Show description for 21611ac
Am1n3e
and
sisyphus-dev-ai
committed
21611ac
View commit details
Copy full SHA for 21611ac
Browse repository at this point
Simplify publish path and ingest workflow
Show description for b05997a
Am1n3e
and
sisyphus-dev-ai
committed
b05997a
View commit details
Copy full SHA for b05997a
Browse repository at this point
Fix stale-event submission_uid consistency in HF ingest
Show description for ef02ad4
Am1n3e
and
sisyphus-dev-ai
committed
ef02ad4
View commit details
Copy full SHA for ef02ad4
Browse repository at this point
Remove stale site lockfile and update AGENTS docs
Show description for fd20c96
Am1n3e
and
sisyphus-dev-ai
committed
fd20c96
View commit details
Copy full SHA for fd20c96
Browse repository at this point
Remove tar archive generation from create-submission-pkg
Show description for 9e64a38
Am1n3e
and
sisyphus-dev-ai
committed
9e64a38
View commit details
Copy full SHA for 9e64a38
Browse repository at this point
Commits on Mar 8, 2026
Add leaderboard submit CLI and documentation
Am1n3e
committed
46c6ea1
View commit details
Copy full SHA for 46c6ea1
Browse repository at this point
Refactor submission handlers for two-step create-then-submit workflow
Show description for 425f4c0
Am1n3e
and
sisyphus-dev-ai
committed
425f4c0
View commit details
Copy full SHA for 425f4c0
Browse repository at this point
Update CLI args for two-step submission workflow
Show description for 0c2e5fa
Am1n3e
and
sisyphus-dev-ai
committed
0c2e5fa
View commit details
Copy full SHA for 0c2e5fa
Browse repository at this point
Update submission docs for two-step workflow
Show description for 2ccf696
Am1n3e
and
sisyphus-dev-ai
committed
2ccf696
View commit details
Copy full SHA for 2ccf696
Browse repository at this point
Refactor leaderboard workflows to use script entrypoints
Am1n3e
committed
f233b2e
View commit details
Copy full SHA for f233b2e
Browse repository at this point
Simplify submission packaging metadata and validation
Am1n3e
committed
fa1c86b
View commit details
Copy full SHA for fa1c86b
Browse repository at this point
Refine submission metadata schema and validation
Am1n3e
committed
268fd4c
View commit details
Copy full SHA for 268fd4c
Browse repository at this point
Harden vNext submission ingest and leaderboard rebuild flow
Am1n3e
committed
4e741ab
View commit details
Copy full SHA for 4e741ab
Browse repository at this point
Fix deterministic rebuilds and coverage-aware evaluation scoring
Am1n3e
committed
638f83f
View commit details
Copy full SHA for 638f83f
Browse repository at this point
Remove leaderboard smoke workflow and related code
Am1n3e
committed
865e44e
View commit details
Copy full SHA for 865e44e
Browse repository at this point
Remove manual leaderboard rebuild workflow and task wiring
Am1n3e
committed
94ad740
View commit details
Copy full SHA for 94ad740
Browse repository at this point
Simplify leaderboard CI to single ingest workflow
Am1n3e
committed
20cb52b
View commit details
Copy full SHA for 20cb52b
Browse repository at this point
Consolidate leaderboard script modules
Show description for a30761c
Am1n3e
and
sisyphus-dev-ai
committed
a30761c
View commit details
Copy full SHA for a30761c
Browse repository at this point
Move leaderboard-only code from client package to leaderboard scripts
Show description for 6e765bd
Am1n3e
and
sisyphus-dev-ai
committed
6e765bd
View commit details
Copy full SHA for 6e765bd
Browse repository at this point
Add docstrings to all classes and public functions in leaderboard scripts
Am1n3e
committed
c862036
View commit details
Copy full SHA for c862036
Browse repository at this point
Unify docs and leaderboard deploy into single gh-pages workflow
Am1n3e
committed
30cf9c4
View commit details
Copy full SHA for 30cf9c4
Browse repository at this point
Add Pydantic settings config for leaderboard scripts
Show description for ec95265
Am1n3e
and
sisyphus-dev-ai
committed
ec95265
View commit details
Copy full SHA for ec95265
Browse repository at this point
Add HF API backend facade for submission data access
Show description for 5d2068d
Am1n3e
and
sisyphus-dev-ai
committed
5d2068d
View commit details
Copy full SHA for 5d2068d
Browse repository at this point
Refactor leaderboard builder with deduplication and logging
Show description for 1c0f058
Am1n3e
and
sisyphus-dev-ai
committed
1c0f058
View commit details
Copy full SHA for 1c0f058
Browse repository at this point
Simplify ingest pipeline to direct function calls
Show description for 3541682
Am1n3e
and
sisyphus-dev-ai
committed
3541682
View commit details
Copy full SHA for 3541682
Browse repository at this point
Update rebuild tests to use LeaderboardBuilder directly
Show description for 0a4bea9
Am1n3e
and
sisyphus-dev-ai
committed
0a4bea9
View commit details
Copy full SHA for 0a4bea9
Browse repository at this point
Rename ingest_hf_submission to sync_submission and reuse backend instance
Am1n3e
committed
4459ef1
View commit details
Copy full SHA for 4459ef1
Browse repository at this point
Make backend a required parameter in sync_submission
Am1n3e
committed
c54e999
View commit details
Copy full SHA for c54e999
Browse repository at this point
Add docstring to _locate_submission_directory
Am1n3e
committed
a85d1e2
View commit details
Copy full SHA for a85d1e2
Browse repository at this point
Construct leaderboard artifacts via Pydantic models instead of raw dicts
Am1n3e
committed
427b7b5
View commit details
Copy full SHA for 427b7b5
Browse repository at this point
Consolidate score computation into core TasksEvalResults
Am1n3e
committed
088f496
View commit details
Copy full SHA for 088f496
Browse repository at this point
You can’t perform that action at this time.
