fix(graders): thread agent reply text into graders so MCP-only evals grade correctly - #198

Merged

sanchitmehtagit merged 10 commits into

mainfrom

fix/agent-text-grader-support

Aug 14, 2026

Commits on Aug 13, 2026

fix(graders): thread agent reply text into runGraders so MCP-only evals grade correctly
sanchitmehtagit
committed
c1a12a9
fix(axis): pass agent reply text into runGraders so MCP-only evals grade via AXIS
sanchitmehtagit
committed
b7cae60
refactor(graders): switch agent reply search from auto-fallback to opt-in source field
sanchitmehtagit
committed
f4f83ac
docs(architecture): document agentText flow and source opt-in in sequence diagrams
sanchitmehtagit
committed
210ed72
fix(graders): thread full response text into gradeText so source:response works in baseline
sanchitmehtagit
committed
26c3fe5
test(axis): update grader-hook tests for 9th agentText param in runGraders
sanchitmehtagit
committed
8464324
fix(graders): make judge honor source:response as reply-only and add tests
sanchitmehtagit
committed
0029c7f
refactor(graders): named GraderSource type, shared searchCorpus helper, required agentText, docs
sanchitmehtagit
committed
b31337f

Commits on Aug 14, 2026

fix: address PR review feedback
sanchitmehtagit
committed
291940b
fix: address PR review feedback
sanchitmehtagit
committed
51506a3