[OsherElhadad]

What & why

Benchmark material was split across templates/adapters/<x> (minimal copy-and-run
adapters) and examples/<x> (full worked runs), with inconsistent naming
(tau2_bench vs tau2_airline vs tau2_sierra_airline) and no single place to see
what exists for a given benchmark.

This PR puts everything under one benchmarks/ directory, one folder per
benchmark, each with a predictable template/ and/or examples/<variant>/ shape:

benchmarks/
  README.md                 index of every benchmark
  ADDING_A_BENCHMARK.md      step-by-step for onboarding a new one
  _scaffold/{project,skill}  generic scaffolds (cap-evolve init, new-skill template)
  _shared/model_config.py    provider-agnostic model wiring
  generic/{jsonl_litellm,huggingface_litellm,harbor}/template
  tau2/template, tau2/examples/{airline,sierra_airline}
  skillsbench/template, skillsbench/examples/shared_skills
  swe_bench/template, spreadsheetbench/template, rfe_creator/template
  appworld/examples/react_agent
  parsec/examples/rca_prompts
  toy/examples/{calc,skill}

templates/ and examples/ are removed. Every reference to the old paths —
CLI (cap-evolve init), CI workflows, shell scripts, tests, docs, and the public
site HTML — is updated to the new layout, with history preserved via git mv.

Checklist

• python -m pytest core/tests -q passes (2857/2858; the one failure —
  test_explicit_pool_split.py::test_explicit_feedback_and_confirm_become_the_partition
  — reproduces identically on unmodified origin/main, so it predates this change
  and is unrelated to it)
• python skills/_registry/build_manifest.py skills is clean
• python skills/_registry/lint_skills.py skills is clean
• lychee --offline link check over README/docs/benchmarks markdown: 0 errors
• Zero-API e2e: bash benchmarks/toy/examples/calc/run.sh, cap-evolve init,
  intake skill scaffold, and ci/e2e_all_algorithms.sh (all 5 algorithms) all pass
• Honesty invariants untouched (gate on val, test sealed) — pure path rename,
  core/tests/test_ci_tau2_sierra_arms.py's example-not-template invariant kept,
  just re-pointed at the new paths
• Docs updated (README/ADAPTER_TEMPLATES.md/benchmarks/README.md)

🤖 Generated with Claude Code

[skillberry-bot]

❌ Automatic Labeling Failed

An error occurred while trying to automatically label this pull request. Please check the workflow logs for details and add labels manually.