Repository navigation

Add EvalAssist judges integration - #1936

Draft

martinscooper wants to merge 14 commits into

mainfrom

evalassist-judges

Draft

Add EvalAssist judges integration#1936
martinscooper wants to merge 14 commits into
mainfrom
evalassist-judges

Commits on Sep 16, 2025
- Add EvalAssist judges integration
  martinscooper
  committed
  0c4ff84
- Change artifact name
  martinscooper
  committed
  aa4d349
Commits on Sep 30, 2025
- Fixed criteria check to be earlier in the code.
  yoavkatz
  committed
  da756d4
Commits on Oct 5, 2025
- Added RITS version of new eval assist judges
  yoavkatz
  committed
  5929882
- Moved back criteria check , to allow partially defined objects in the catalog.
  yoavkatz
  committed
  b648e97
- Allow overriding average in F1Binary
  yoavkatz
  committed
  7eb91e4
- Added example to evaluate faithfulnes metrics
  yoavkatz
  committed
  0714bde
Commits on Oct 6, 2025
- Updated code to evaluate faithfulness metrics to use f1_macro as main score, and also show f1 for each class.
  yoavkatz
  committed
  a0300cf
Commits on Oct 12, 2025
- 1. Added vllm to cross provider example
  yoavkatz
  committed
  50f0540
- Fixed casing
  yoavkatz
  committed
  bf5eeb6
Commits on Oct 13, 2025
- Added eval assist to test requirements
  yoavkatz
  committed
  835c28c
- Fixed test of eval assist
  yoavkatz
  committed
  e851cd9
- Update python 3.10
  yoavkatz
  committed
  a46a7b5
- Merge branch 'main' into evalassist-judges
  yoavkatz
  authored
  f278764