Skip to content

chore: refine Rollbar triage skill - #17

Merged
davebarnwell merged 1 commit into
mainfrom
feature/refine-rollbar-cli-skill
Jul 19, 2026
Merged

chore: refine Rollbar triage skill#17
davebarnwell merged 1 commit into
mainfrom
feature/refine-rollbar-cli-skill

Conversation

@davebarnwell

@davebarnwell davebarnwell commented Jul 19, 2026

Copy link
Copy Markdown
Owner

Summary

Refactors the Rollbar skill from a long command catalogue into an evidence-led production triage workflow.

The revised workflow covers time-window baselines, active and all-status queries, impact ranking, deduplication, representative occurrence review, deploy correlation, root-cause classification, regression-tested code fixes, browser-noise guardrails, post-deploy verification, and explicit authorization for Rollbar mutations. Detailed commands move into a progressively loaded reference, and Codex UI metadata is added.

Validation

  • Skill validator passed
  • Source and installed skill copies were checked for parity
  • git diff --check passed

Summary by CodeRabbit

  • Documentation

    • Replaced the Rollbar CLI guide with a structured investigation and troubleshooting playbook.
    • Added command reference documentation covering issue, occurrence, environment, deployment and user operations.
    • Added guidance for safe, read-only diagnosis, privacy protection, evidence classification and authorised production changes.
    • Added investigation completion checklist covering findings, verification, testing and follow-up actions.
  • New Features

    • Added Rollbar CLI agent configuration with focused error investigation and regression-tested fix guidance.

@coderabbitai

coderabbitai Bot commented Jul 19, 2026

Copy link
Copy Markdown

Review Change Stack

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: a36564d5-ec42-41c2-a0cc-8415f3a9f2cb

📥 Commits

Reviewing files that changed from the base of the PR and between 528e336 and 7cb61ee.

📒 Files selected for processing (3)
  • .ai/skills/rollbar-cli/SKILL.md
  • .ai/skills/rollbar-cli/agents/openai.yaml
  • .ai/skills/rollbar-cli/references/command-reference.md

📝 Walkthrough

Walkthrough

The Rollbar CLI skill is rewritten as a read-only investigation playbook with authorised mutation rules, evidence and safety guidance, completion reporting, agent metadata, and a command reference covering inspection, deployment, user, mutation, and filtering operations.

Changes

Rollbar CLI playbook

Layer / File(s) Summary
Agent contract and access
.ai/skills/rollbar-cli/agents/openai.yaml, .ai/skills/rollbar-cli/SKILL.md
Defines the agent presentation, default prompt, credential handling, environment discovery, and read-only diagnosis constraints.
Investigation workflow and safeguards
.ai/skills/rollbar-cli/SKILL.md
Adds ranking, evidence correlation, classification, automation, privacy, authorised remediation, and completion-summary rules.
Command reference
.ai/skills/rollbar-cli/references/command-reference.md
Documents JSON-oriented commands for items, occurrences, environments, deploys, users, authorised mutations, watching, and result narrowing.

Estimated code review effort: 2 (Simple) | ~10 minutes

Poem

I’m a rabbit with logs in my den,
Sorting errors from one to ten.
Tokens stay hidden, payloads stay tame,
Fixes need permission before they gain flame.
With carrots and tests, the loop closes bright!

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feature/refine-rollbar-cli-skill

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@davebarnwell
davebarnwell marked this pull request as ready for review July 19, 2026 19:32
Copilot AI review requested due to automatic review settings July 19, 2026 19:32
@davebarnwell
davebarnwell merged commit f43e226 into main Jul 19, 2026
3 of 4 checks passed
@davebarnwell
davebarnwell deleted the feature/refine-rollbar-cli-skill branch July 19, 2026 19:32

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Refactors the rollbar-cli Copilot skill documentation from a command-heavy catalogue into an evidence-led production triage workflow, with a separate progressive command reference and added agent UI metadata.

Changes:

  • Replaced the main skill doc with a structured investigation workflow, automation rules, and privacy/safety guidance.
  • Added a dedicated command reference markdown for exact flags and mutation commands.
  • Added agents/openai.yaml metadata for UI display and a default prompt.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File Description
.ai/skills/rollbar-cli/SKILL.md Rewrites the skill into a step-by-step triage workflow with explicit safety/authorization boundaries.
.ai/skills/rollbar-cli/references/command-reference.md Introduces a focused command/flags reference to keep the main workflow concise.
.ai/skills/rollbar-cli/agents/openai.yaml Adds agent UI metadata and a default prompt for the skill.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

- You need to inspect raw occurrences for a specific item or fetch one occurrence directly.
- You need to look up Rollbar account users before assigning an item.
Use `rollbar-cli` to move from an error signal to an evidence-backed classification or code fix. Keep diagnosis read-only
unless the user asks for a fix or explicitly authorises a Rollbar state change.

## Privacy And Safety

- Redact access tokens, cookies, authorisation headers, session identifiers, and direct personal data.
rollbar-cli users list --fields id,username,email --no-headers
```

Mutate an item only with explicit user authorisation:

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7cb61eea3a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".


# All statuses in the same window
rollbar-cli items list \
--status all \

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Omit the invalid all-status filter

For the all-status baseline, this command passes all as a non-empty item status; cmd/items.go forwards --status verbatim to the Rollbar API, and Rollbar's List all items docs say valid status values are active, resolved, muted, and archived (multiple status filters are separate valid values, not all). Following this reference will either error or fail to retrieve the resolved/muted regressions the workflow is trying to catch, so the all-status example should omit --status or use valid status values.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants