You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
agentops-pr workflow templates should auto-detect committed baseline file #155
The agentops-pr.yml workflow shipped by agentops workflow generate already supports this — drop a baseline file in your repo (e.g. .agentops/baseline/results.json) and add this step: ...
But the shipped templates run agentops eval run --config <cfg> with no --baseline flag. Users have to manually edit the workflow to consume a committed baseline file. Affected templates:
Make the PR step auto-detect a committed baseline file at .agentops/baseline/results.json and pass --baseline only when it exists. Without the file, behaviour is unchanged.
Apply the same guard to both the GitHub Actions step and the Azure DevOps AzureCLI@2 inline script so behaviour is consistent across platforms.
Why it matters
Today the tutorial promises 'just drop the file in the repo', then the user discovers the workflow doesn't honour it. Either the docs need to be softened (and the user has to manually edit the workflow), or the templates should match the doc. This issue is the option to make the templates match.
Prior art
Closed PR #154 implemented this end-to-end (templates + tests + doc). It was closed to keep the validation series doc-only; the work is preserved in the closed PR diff for whoever picks this up.
Activity
feat(workflow): auto-detect committed baseline in agentops-pr templat…
placerda commentedon Jun 14, 2026
Shipped via PR #306 and released in v0.4.0.