Skip to content

[Draft] #208

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
AnkitaNaik wants to merge 43 commits into from
Closed

[Draft] #208

Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
bce4c63
Add PR regression testing workflow setup script
AnkitaNaik Aug 17, 2026
6fa7bdc
feat(pr-eval): Update pr-regression setup script and add eval.sh script.
AnkitaNaik Aug 17, 2026
a3c5987
Add main pr-regression runner.
AnkitaNaik Aug 17, 2026
37b275a
Update hard-coded paths in regression runner for VM compatability.
AnkitaNaik Aug 18, 2026
0d6e49a
Add support for RITS in the react agent.
AnkitaNaik Aug 18, 2026
70db4cd
Remove hard-coded port for AppWorld.
AnkitaNaik Aug 18, 2026
bbeb57f
Remove hard-coded ports.
AnkitaNaik Aug 18, 2026
13629ab
Default using Langfuse to false.:
AnkitaNaik Aug 18, 2026
802906b
Add support for all the agents for AppWorld.
AnkitaNaik Aug 18, 2026
e99de5c
Log the complete report in the PR comment.
AnkitaNaik Aug 18, 2026
dc8b488
Log the agent name.
AnkitaNaik Aug 18, 2026
724b62d
fix(appworld): skip Langfuse fetch when tracing is disabled
AnkitaNaik Aug 18, 2026
b0e2af6
fix(pr-eval): improve collapsible PR report formatting
AnkitaNaik Aug 18, 2026
e9b3991
Format the summary report.
AnkitaNaik Aug 18, 2026
a5a28dc
fix(pr-eval): support RITS credentials for CUGA agent runs
AnkitaNaik Aug 18, 2026
68352bd
Fix logging.
AnkitaNaik Aug 18, 2026
3d4d44c
feat:Support benchmark selection in PR eval
AnkitaNaik Aug 18, 2026
e66d37b
Update evaluation report.
AnkitaNaik Aug 20, 2026
c6b3325
Add litellm support.
AnkitaNaik Aug 20, 2026
1857bef
Add litellm URL.
AnkitaNaik Aug 20, 2026
5993979
Reorganize files and add README.
AnkitaNaik Aug 20, 2026
14dd055
Fix script path.
AnkitaNaik Aug 20, 2026
48f32e1
Reorganize files.
AnkitaNaik Aug 20, 2026
741bc30
Update the README.
AnkitaNaik Aug 20, 2026
86d0c69
Update README with parameter name.
AnkitaNaik Aug 20, 2026
cd7b75d
Add support for AppWorld subsets.
AnkitaNaik Sep 5, 2026
0c7feed
fix(pr-eval): gate PR report formatting and fix RITS config
AnkitaNaik Sep 17, 2026
8675ad9
fix(appworld): gate PR summary markers by environment
AnkitaNaik Sep 17, 2026
0ba3c69
fix(pr-eval): align runner script with validated workflow input
AnkitaNaik Sep 17, 2026
e84d3ed
fix(pr-eval): restore inline evaluation report comments
AnkitaNaik Sep 17, 2026
ef1bafd
Merge remote-tracking branch 'upstream/main'
AnkitaNaik Sep 17, 2026
8cf2a93
Fork aligned with main.
AnkitaNaik Sep 17, 2026
342ed08
Update teh compare_report for merging.
AnkitaNaik Sep 18, 2026
60c59d6
Move report parsing to the runner.
AnkitaNaik Sep 18, 2026
4e9ed0f
Clarify PR eval provider environment contract
AnkitaNaik Sep 18, 2026
2269957
Fix ReAct eval Ruff import issues
AnkitaNaik Sep 18, 2026
ca01b44
Keep PR eval comment formatting out of bundles
AnkitaNaik Sep 24, 2026
02dd85d
Harden PR eval provider config handling
AnkitaNaik Sep 24, 2026
9f6c7a1
Use AppWorld SDK evaluator for PR evals
AnkitaNaik Oct 1, 2026
1a5ace7
Merge branch 'cuga-project:main' into main
AnkitaNaik Oct 1, 2026
a25b564
Use AppWorld SDK only for CUGA PR evals
AnkitaNaik Oct 5, 2026
ab30891
Format React agent helper with Ruff
AnkitaNaik Oct 5, 2026
9f607cb
Merge branch 'cuga-project:main' into main
AnkitaNaik Oct 5, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view

These merge commits were added into this branch cleanly.

There are no new changes to show.