Skip to content

report skill: hand-check the paths no run has exercised #37

Open

Description

@sabind

Before you file

  • I searched the existing issues.
  • I read evals/README.md.

Component

report (skill)

Behaviour

The comment on #26 after PR #31 merged listed the report skill's paths that no eval or manual run had exercised. Two have been checked since; the rest have not:

Run each by hand and record on this issue what was seen, quoting the Message. A path that misbehaves becomes its own bug.

Grading

Manual. These are paths an eval cannot drive without #28's legged cases, which is why they are checked by hand.

Prompt

For status: ask "what is going on" mid-task. For the rewrite: type /freethinking:report after any hand-back. For the hand-offs: a scratch issue on the calc fixture, answering in the tool.

Activity

  1. added
    qualityThe behaviour of the skills, agents and rules, and the evals and checks that guard it
    triageNot yet classified by a maintainer
    on Oct 16, 2026
  2. added theissue type on Oct 16, 2026
  3. sabind commented on Oct 16, 2026

    @sabind
    ContributorAuthor

    When checking the bugfix to pr hand-off: if the hand-back Message is missing before the Pull request question, or on a pre-answered Open it now, that is the failure #27 was closed on thin evidence for. Reopen #27 with the trace; the fix it proposes, a hand-off record the pr skill reads as context, is designed in its comments.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    qualityThe behaviour of the skills, agents and rules, and the evals and checks that guard ittriageNot yet classified by a maintainer

    Type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions