Skip to content

doc(docs): mark annotation queues and in-playground evaluation as shipped on the roadmap#4678

Merged
mmabrouk merged 1 commit into
mainfrom
docs/roadmap-shipped-annotation-eval
Jun 15, 2026
Merged

doc(docs): mark annotation queues and in-playground evaluation as shipped on the roadmap#4678
mmabrouk merged 1 commit into
mainfrom
docs/roadmap-shipped-annotation-eval

Conversation

@mmabrouk

Copy link
Copy Markdown
Member

What

The roadmap's "Last Shipped" list (docs/src/data/roadmap.ts) was stuck at the Webhooks and GitHub Automations entry from 3/11/2026, even though two of the features still listed under In progress had already shipped and been announced in the changelog.

This moves them to Last Shipped:

Feature Changelog Shipped
Annotation Queues /changelog/annotation-queues 2026-05-18
Evaluate While You Iterate in the Playground /changelog/playground-evaluation-workbench 2026-06-09

Before / After

  • Before: "Annotation Queues for Traces" (Annotation Queues for Traces #4009) and "Running Evaluators in the Playground" (Running Evaluators in the Playground #3702) sat in In progress, telling visitors these were still being built. The roadmap's newest shipped item was from March.
  • After: Both are removed from In progress and added to the top of shippedFeatures, each linking to its published changelog entry.

Notes

@vercel

vercel Bot commented Jun 12, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
agenta-documentation Ready Ready Preview, Comment Jun 12, 2026 12:54pm

Request Review

@dosubot dosubot Bot added size:M This PR changes 30-99 lines, ignoring generated files. documentation Improvements or additions to documentation labels Jun 12, 2026
@coderabbitai

coderabbitai Bot commented Jun 12, 2026

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 7decafd2-5326-457f-a936-0d3407d46644

📥 Commits

Reviewing files that changed from the base of the PR and between a2e9150 and 016c959.

📒 Files selected for processing (1)
  • docs/src/data/roadmap.ts

📝 Walkthrough

Summary by CodeRabbit

  • Documentation
    • Updated the product roadmap to highlight two completed features: Playground Evaluation Workbench and Annotation Queues, including their descriptions and ship dates.
    • Refreshed the in-progress features section.

Walkthrough

The roadmap data structure is updated to mark two features as shipped with their metadata and descriptions, and to remove two planned features from the in-progress list. The shipped features include playground-evaluation-workbench and annotation-queues with corresponding changelog paths and release dates.

Changes

Roadmap Feature Status Updates

Layer / File(s) Summary
Shipped and in-progress feature entries
docs/src/data/roadmap.ts
Two new shipped features (playground-evaluation-workbench and annotation-queues) are added with descriptions, changelog paths, shipped dates, and label metadata. Two previously planned in-progress features (evaluators-in-playground and annotation-queues-traces) are removed from the roadmap.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~5 minutes

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly and specifically describes the main change: moving two features (annotation queues and playground evaluation) from 'In progress' to 'shipped' on the roadmap.
Description check ✅ Passed The description is directly related to the changeset, providing detailed context about which features were moved, their changelog links, shipped dates, and rationale for the changes.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch docs/roadmap-shipped-annotation-eval

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@mmabrouk mmabrouk merged commit f16190b into main Jun 15, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation size:M This PR changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants