Skip to content

Commit 7df5bd1

Browse files
semantic-releasegithub-actions[bot]
authored andcommitted
chore(release): 0.12.6 [skip ci]
1 parent 17fb10f commit 7df5bd1

6 files changed

Lines changed: 68 additions & 5 deletions

File tree

‎CHANGELOG.md‎

Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,69 @@
22

33
<!-- version list -->
44

5+
## v0.12.6 (2026-09-23)
6+
7+
### Bug Fixes
8+
9+
- **claude-code**: End a turn the CLI did not cap at max_turns
10+
([#194](https://github.com/UiPath/coder_eval/pull/194),
11+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
12+
13+
- **claude-code**: Kill the CLI on a cooperative stop
14+
([#194](https://github.com/UiPath/coder_eval/pull/194),
15+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
16+
17+
- **claude-code**: Kill the CLI on a max_turns backstop stop without a turn timeout
18+
([#194](https://github.com/UiPath/coder_eval/pull/194),
19+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
20+
21+
- **codex**: End a capped turn before the next call can run a tool
22+
([#194](https://github.com/UiPath/coder_eval/pull/194),
23+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
24+
25+
- **delegate**: Count a tool-only reply as a model call
26+
([#194](https://github.com/UiPath/coder_eval/pull/194),
27+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
28+
29+
- **delegate**: Keep counting model calls when a tool never returns
30+
([#194](https://github.com/UiPath/coder_eval/pull/194),
31+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
32+
33+
- **evalboard**: Compare visible turns, not SDK num_turns, against expected_turns
34+
([#194](https://github.com/UiPath/coder_eval/pull/194),
35+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
36+
37+
- **pricing**: Add Opus 5.5 and GPT-6, correct rates that moved publicly
38+
([#195](https://github.com/UiPath/coder_eval/pull/195),
39+
[`11b902f`](https://github.com/UiPath/coder_eval/commit/11b902fa9bc0d307bcab22801dc56523fcc1d92a))
40+
41+
- **run-limits**: Count max_turns as model API calls on every harness
42+
([#194](https://github.com/UiPath/coder_eval/pull/194),
43+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
44+
45+
- **run-limits**: Count max_turns as model API calls on every harness and enforce it on claude-code
46+
([#194](https://github.com/UiPath/coder_eval/pull/194),
47+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
48+
49+
- **run-limits**: Stop a turn mid-flight once a token or USD budget is crossed
50+
([#194](https://github.com/UiPath/coder_eval/pull/194),
51+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
52+
53+
- **simulation**: End a dialog with agent_max_turns when the agent hits its own cap
54+
([#194](https://github.com/UiPath/coder_eval/pull/194),
55+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
56+
57+
### Documentation
58+
59+
- **parity**: Record the claude-code max_turns backstop
60+
([#194](https://github.com/UiPath/coder_eval/pull/194),
61+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
62+
63+
- **run-limits**: Say max_turns restarts per iteration and expected_turns counts tool calls
64+
([#194](https://github.com/UiPath/coder_eval/pull/194),
65+
[`17fb10f`](https://github.com/UiPath/coder_eval/commit/17fb10f1250b23df0aa80d33e568996b892711dd))
66+
67+
568
## v0.12.5 (2026-09-22)
669

770
### Bug Fixes

‎action.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ inputs:
2525
version:
2626
description: coder-eval version to install from PyPI, or "local" to install from the action checkout
2727
required: false
28-
default: "0.12.5" # <-- kept in sync with releases by release.yml
28+
default: "0.12.6" # <-- kept in sync with releases by release.yml
2929
extras:
3030
description: >-
3131
Comma-separated coder-eval extras (`codex`, `antigravity,litellm`), composed

‎plugins/coder-eval/.claude-plugin/plugin.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"$schema": "https://json.schemastore.org/claude-code-plugin-manifest.json",
33
"name": "coder-eval",
44
"displayName": "Coder Eval",
5-
"version": "0.12.5",
5+
"version": "0.12.6",
66
"description": "Test whether your Claude Code skills actually trigger, and benchmark any coding agent — author, run, and analyze the eval suite that proves it, locally or as a CI gate.",
77
"author": { "name": "UiPath", "email": "coder-eval@uipath.com", "url": "https://github.com/UiPath/coder_eval" },
88
"homepage": "https://coder-eval.com",

‎pyproject.toml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[project]
22
name = "coder-eval"
3-
version = "0.12.5"
3+
version = "0.12.6"
44
description = "Evaluate, benchmark, and A/B-test AI coding agents (Claude Code, Codex, Gemini/Antigravity, OpenCode, Pi, Delegate) with sandboxed, reproducible YAML task suites."
55
readme = "README.md"
66
license = "Apache-2.0"

‎src/coder_eval/__init__.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
"""coder_eval - A framework for evaluating AI coding agents."""
22

3-
__version__ = "0.12.5"
3+
__version__ = "0.12.6"

‎uv.lock‎

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)