Skip to content

Rename Vercel AI experimental_decide spans from evaluate to decide #25251

Closed

Description

@andreiborza

Follow getsentry/sentry-conventions#696: gen_ai.evaluate is deprecated in favor of gen_ai.decide.

ai 7.0.128 renamed experimental_evaluate to experimental_decide. The old name is a deprecated alias, and the tracing channel always publishes type: 'experimental_decide'. Vercel's own @ai-sdk/otel now names the span decide <model> with gen_ai.operation.name: decide. Our channel subscriber still makes evaluate <model> spans.

Target span

  • Name: decide <model> (was evaluate <model>)
  • Op: gen_ai.decide (was gen_ai.evaluate)
  • gen_ai.operation.name: decide (was evaluate)
  • No other change. gen_ai.input.messages / gen_ai.output.messages keep type: 'evaluation'.

Scope

  • packages/server-utils/src/integrations/vercel-ai/vercel-ai-dc-subscriber.ts. Keep the experimental_evaluate channel type for ai 7.0.111 to 7.0.127.
  • Update the tests: unit test test/integrations/vercel-ai/evaluate.test.ts; node-integration-tests suite vercelai/v6_v7; e2e app node-eve.
  • Change the test scenarios to call experimental_decide. They still call the deprecated experimental_evaluate and will break when Vercel removes the alias.

Activity

  1. linear-code commented on Oct 12, 2026

    @linear-code
  2. added a commit that references this issue on Oct 12, 2026
    17a8a15
  3. github-actions commented on Oct 12, 2026

    @github-actions
    Contributor

    A PR closing this issue has just been released 🚀

    This issue was referenced by PR #25274, which was included in the 11.7.0 release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions