Repository navigation
Publish live budget, token, turn and cache figures in telemetry #244
Description
Parent
Agent-side change from the map Agent fleet dashboard: map; the consolidated list is in the resolution of Define the dashboard project. The snapshot shape is decided in Define the telemetry snapshot contract and the command mechanics in Decide the agentctl telemetry command. Terms: Telemetry snapshot and Figure basis in CONTEXT.md; ADR 0006.
What to build
During model execution, telemetry shows the current attempt's budget, token, turn and cache figures as they change, each tagged with its figure basis. When model execution ends they freeze at their final values.
Acceptance criteria
- The executor receives an injected publisher (like its event log) and publishes an immutable attempt view after every limit check. Publishing is a reference swap under a lock held only for the swap. The listener thread never reads the token ledger.
-
budget.used(measuredwhen its estimated part is 0, otherwiseestimated),budget.measured,budget.estimated,budget.hard_ceiling_reached, andbudget.soft_thresholdwithvalue(the effective threshold after the handoff reserve),rule(percentageorreserve),percentage,reserve_turns,crossed,crossed_at_tokens,crossed_at. The soft threshold isconfiguredunderpercentage; underreserveit inherits the main context's basis. -
tokens_by_category(input_tokens,cache_read_input_tokens,cache_creation_input_tokens,output_tokens; measured part only),turns(main-thread responses,measured),cache.main_hit_ratewithcounted(unavailable below the configured minimum of measured responses),elapsed_seconds(measured). -
provider_rate_limitis always{value: null, basis: "unavailable", reason: "not exposed through the gateway"}. No USD figure is sent. -
observed_atandsequenceadvance with every publication. After model execution ends, the view stays frozen at its final values until finalisation. - Tests: figures and bases match the attempt-in-progress and soft-threshold-crossed contract examples' shape; a failing publish does not affect the attempt; frozen after execution.
Activity
lbacik commentedon Oct 14, 2026
Agent Attempt Result: handoff
Branch: agent/issue-244
PR: none
Handoff note commit:
b1980f444ae4e69e48cf8a3dbb532f1ed8f513f5Evidence
UV_PROJECT_ENVIRONMENT=/home/agent/venv-py311 uv run --python 3.11 --extra dev ruff check && UV_PROJECT_ENVIRONMENT=/home/agent/venv-py311 uv run --python 3.11 --extra dev pytest && UV_PROJECT_ENVIRONMENT=/home/agent/venv-py313 uv run --python 3.13 --extra dev pytest→ exit code NoneDetails
Handoff note: issue #244
Summary
Implemented live attempt-figure publication for telemetry (issue #244, "publish the attempt's budget/token/turn/cache figures as they change"). All code changes are written but uncommitted (sealing will commit them):
simple_coding_agent/token_ledger.py: addedmain_measured_response_countandmain_context_basis()(measured when the main thread's latest response reported usage, else estimated).simple_coding_agent/telemetry.py:TelemetryReporter.publish_attempt_view()stampsobserved_atand swaps the stored view under_attempt_view_lock(held only for the swap);_build_current_attemptserves the published view merged with the claim seed (full shape: budget used/measured/estimated + hard ceiling + soft threshold with rule/percentage/reserve_turns/crossed/crossed_at_tokens/crossed_at, tokens_by_category, turns, cache.main_hit_rate with counted, elapsed, provider_rate_limit, no USD). Without a published view it keeps the old tracer shape.begin_attempt/finish_attemptclear the view.simple_coding_agent/model_execution.py:ModelExecutortakes injectedattempt_publisher(ctor param +set_attempt_publisher, likeevent_log), publishes an immutableMappingProxyTypeview at the end of every_check_limits, records soft-threshold crossing wall-time, logstelemetry_publish_failedwithout affecting the attempt on publisher failure.simple_coding_agent/lifecycle.py:_wire_attempt_telemetry_publisher()wiresreporter.publish_attempt_viewinto the executor before dispatch; called alongside_wire_attempt_runner_handoff().tests/test_telemetry_live_figures.py(new, 13 tests): example-shape conformance for attempt-in-progress and soft-threshold-crossed, used-basis rule, hit-rate unavailability below minimum, observed_at/sequence advance, immutable per-check publication, failing-publish safety, frozen-after-execution, detached listener copy, begin/finish clearing, ledger helpers, lifecycle wiring.Remaining work
code-reviewskill on the changes (required by the completion gate; an attempt with commits but nocode-reviewinvocation counts as incomplete).ruff check, fullpyteston Python 3.12, fullpyteston Python 3.13 (env vars redacted in the issue; PATH/HOME/UV_PYTHON_INSTALL_DIR/UV_PYTHON_DOWNLOADS/UV_NO_PROGRESS are set by the gate).agent/issue-244.Evidence
UV_PROJECT_ENVIRONMENT=/tmp/venv-py3-check uv run --python 3.12 --extra dev pytest tests/test_telemetry_live_figures.py→ 13 passed.test_telemetry,test_telemetry_examples,test_model_execution,test_prompt_cache,test_lifecycle) → 206 passed.PytestUnhandledThreadExceptionWarningabout recovery, unrelated).ruff check→ all checks passed.code-reviewskill, fullpyteston Python 3.13, gate with the official env.Automatic continuation 0/2 used; the agent will continue automatically.
Handoff note: issue #244
Seal attempt work for #244 (model_limit_reached)
Address code-review findings for #244 (deep-freeze published view, wi…
lbacik commentedon Oct 14, 2026
Agent Attempt Result: complete
Branch: agent/issue-244
PR: #254
Merge: auto-merge enabled (merge)
Evidence
UV_PROJECT_ENVIRONMENT=/home/agent/venv-py311 uv run --python 3.11 --extra dev ruff check && UV_PROJECT_ENVIRONMENT=/home/agent/venv-py311 uv run --python 3.11 --extra dev pytest && UV_PROJECT_ENVIRONMENT=/home/agent/venv-py313 uv run --python 3.13 --extra dev pytest→ exit code 0Details
Claude SDK completed the implementation workflow.