Skip to content

SkillOpt pilot: run one machine-scorable optimization pass on craft-critique (E1.3) #106

Description

@sungjunlee

Epic: #102 · PRD E1.3 (findings F3, F4)

craft-autoresearch's loop is isomorphic to SkillOpt (rollout → reflect → bounded edit → validate); SkillOpt adds programmatic rollout volume + held-out gating. Pilot it once before deciding anything bigger.

Scope (timeboxed)

  • Target: craft-critique — its output contract (sections, severity tags) is regex-scorable.
  • Author the scorer + benchmark tasks; run one SkillOpt pass.
  • Write a dated adopt/fork/defer note (radar snapshot or decision-log entry), explicitly comparing scorer-authoring cost vs agent-in-the-loop autoresearch.

AC

  • Decision note exists with evidence either way
  • No SkillOpt dependency lands in the repo without an adopt decision
  • Run artifacts stay outside the repo (~/.craftkit convention)

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: docsDocumentation and README workarea: opsOperational safety and eval workflowarea: skillsSkill authoring assetscraft-reviewWork derived from CraftKit skill reviewpriority: lowLow prioritytype: taskConcrete implementation task

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions