Skip to content

Rename TypeSafe and LangChain Jev spans from evaluate to decide #25249

Closed

Description

@andreiborza

Follow getsentry/sentry-conventions#696: gen_ai.evaluate is deprecated in favor of gen_ai.decide.

The TypeSafe integration (src/ai/typesafe/) makes the span for TypeSafeClient.systemOne(). The LangChain integration uses the same startEvaluateSpan() for TypeSafeClassifier runs and for Jev middleware calls inside createAgent / LangGraph. So one change covers all three paths.

Target span

  • Name: decide <model> (was evaluate <model>)
  • Op: gen_ai.decide (was gen_ai.evaluate)
  • gen_ai.operation.name: decide (was evaluate)
  • No other change. gen_ai.input.messages / gen_ai.output.messages keep type: 'evaluation'.

Scope

  • packages/server-utils/src/ai/typesafe/index.ts and src/ai/langchain/typesafe-classifier.ts. Rename startEvaluateSpan and related helpers to match.
  • Update the tests: node-integration-tests suites typesafe, langchain/v1, langgraph/v1; cloudflare-integration-tests suite langchain-typesafe-classifier; unit test test/ai/lib/tracing/langchain-invoke-agent.test.ts.

Activity

  1. linear-code commented on Oct 12, 2026

    @linear-code
  2. added a commit that references this issue on Oct 12, 2026
    6aa337a
  3. github-actions commented on Oct 12, 2026

    @github-actions
    Contributor

    A PR closing this issue has just been released 🚀

    This issue was referenced by PR #25270, which was included in the 11.7.0 release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions