Skip to content

Add .claude/skills for PR workflow, testing tiers, and review rounds - #960

Merged
OsherElhadad merged 3 commits into
mainfrom
chore/agent-dev-skills
Nov 8, 2026
Merged

OsherElhadad merged 3 commits into
mainfrom
chore/agent-dev-skills

Conversation

@OsherElhadad

Copy link
Copy Markdown
Collaborator

What & why

Gives AI agents (and anyone following CLAUDE.md) a repeatable, repo-aware process
for development work in cap-evolve: opening a PR, picking the right testing tier,
and running real review cycles — instead of ad-hoc behavior per session.

Adds .claude/skills/:

  • open-pr — branch off main, commit under the right identity, classify the
    change's track (code / dashboard / docs-only), fill the PR checklist.
  • testing — the unit tier CI already runs, always; plus a real end-to-end
    run (free zero-API locally, or a dispatched Integration tests/Benchmarks
    workflow run) whenever the change can plausibly affect one. Includes the model
    provider order (RITS → ETE-INT → ETE), moved here from CLAUDE.md.
  • dashboard-change — for dashboard/frontend changes: build + before/after
    screenshots (Playwright MCP if connected, else the repo's existing
    scripts/tools/shoot_dashboard.py) attached to the PR, no real end-to-end run
    needed
    .
  • docs-change — for docs-only changes: a local lychee link check, then
    straight to review — no run, no screenshots.
  • review-cycles — 3 independent review rounds per PR, each with two parallel
    reviewers (GLM via Claude Code, IBM Bob Shell, or the user's own Claude Code as
    fallback). Ported from
    rossoctl/context-guru's
    offload-review skill (Apache-2.0) — see scripts/offload-review/NOTICE.md for
    exactly what changed (3 rounds instead of 2, cap-evolve's own house rules in the
    review prompts, dropped a context-guru-specific policy).

CLAUDE.md is rewritten short: what the repo is, a table pointing at the skills
above, and a DCO reminder (this repo's probot/dco check fails any PR with an
unsigned commit — always git commit -s). The detailed model-provider prose moved
into the testing skill; .bob/rules/01-cap-evolve.md now points at the skills
too.

Checklist

  • python -m pytest core/tests -q passes (no core/ changes in this PR)
  • python skills/_registry/build_manifest.py skills is clean (this PR doesn't
    touch the product's own skills/ registry — .claude/skills/ is a separate,
    Claude-Code-only tree)
  • N/A — no skills/<component>/<name>/scripts/check.py added or changed
  • Honesty invariants untouched — docs/process-only change
  • Docs updated: CLAUDE.md rewritten, .bob/rules/01-cap-evolve.md points at
    the new skills, scripts/offload-review/NOTICE.md explains the port
  • bash scripts/offload-review/self_check.sh passes (new, not in CI yet):
    usage/validation errors, every backend defines the 3 required functions, every
    shell script parses
  • lychee --offline over CLAUDE.md + the new skill/script markdown: 0 errors

🤖 Generated with Claude Code

@skillberry-bot

Copy link
Copy Markdown
Contributor

❌ Automatic Labeling Failed

An error occurred while trying to automatically label this pull request. Please check the workflow logs for details and add labels manually.

Osher Elhadad and others added 3 commits November 9, 2026 00:09
Adds .claude/skills/ for the agent development workflow in this repo:

- open-pr: branch, identity, classify the change's track, PR checklist
- testing: unit tier (what ci.yml runs) always, plus a real end-to-end
  run (zero-API local, or a dispatched Integration tests/Benchmarks CI
  leg) when the change can affect one
- dashboard-change: build + before/after screenshots (Playwright MCP
  if connected, else the repo's own scripts/tools/shoot_dashboard.py)
  instead of a real run, for dashboard/frontend-only changes
- docs-change: link check only, for docs-only changes
- review-cycles: 3 rounds of two independent reviewers in parallel
  (GLM via Claude Code, IBM Bob Shell, the user's own Claude Code as
  fallback), ported from rossoctl/context-guru's offload-review skill
  (Apache-2.0) and adapted to this repo's house rules and a 3-round
  default; see scripts/offload-review/NOTICE.md for what changed

CLAUDE.md is rewritten short: what the repo is, a table pointing at
the skills above, and a DCO reminder (every commit needs
Signed-off-by, checked by this repo's probot/dco CI check) — the
detailed provider-order prose moved into the testing skill.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Signed-off-by: Osher Elhadad <Osher.Elhadad@ibm.com>
…xists

core/tests ran against this PR's own new ./.claude/skills/ (the dev-
workflow skills this PR adds) and failed: _find_skills_dir() picked
it as soon as Path(cand).is_dir() was true, without checking it is
actually a built cap-evolve skills registry. It has no
_registry/manifest.json, so _resolve_skills() then raised
FileNotFoundError downstream in cap-evolve run.

This was already a latent bug for any host whose .claude/skills/ (or
~/.claude/skills/) holds unrelated, non-cap-evolve skills — not
specific to this PR's directory. Require _registry/manifest.json to
exist before accepting a candidate; add a regression test.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Signed-off-by: Osher Elhadad <Osher.Elhadad@ibm.com>
Signed-off-by: Osher Elhadad <Osher.Elhadad@ibm.com>
@OsherElhadad
OsherElhadad force-pushed the chore/agent-dev-skills branch from 051767d to f4e0116 Compare November 8, 2026 22:11
@OsherElhadad
OsherElhadad merged commit 4e93f41 into main Nov 8, 2026
15 checks passed
@OsherElhadad
OsherElhadad deleted the chore/agent-dev-skills branch November 8, 2026 22:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants