Skip to content

feat: add DeepSeek agent runner - #216

Draft
sanchitmehtagit wants to merge 1 commit into
mainfrom
feat/deepseek-runner
Draft

feat: add DeepSeek agent runner#216
sanchitmehtagit wants to merge 1 commit into
mainfrom
feat/deepseek-runner

Conversation

@sanchitmehtagit

Copy link
Copy Markdown
Contributor

Adds a new deepseek agent runner that drives DeepSeek models via the Codex SDK against an OpenAI-compatible Responses API endpoint. Routes through the configured proxy (DEEPSEEK_PROXY_BASE_URL env var, falling back to LLM_PROXY_BASE_URL) using the same LLM_API_KEY as all other runners.

  • packages/evals/src/runners/deepseek/ - new runner (agent.ts + runner.ts)
  • evals-core: add 'deepseek' to KNOWN_AGENT_TYPES, AGENT_CONTEXT_FILENAMES, DEEPSEEK_MODELS prefix, isDeepSeekModel() helper, cost table entries
  • evals/cli: register DeepSeekRunner in run.ts and sandbox-runner.ts
  • apps/auth0-evals/eval.config.js: add deepseek agent proxy config

By submitting a PR to this repository, you agree to the terms within the Auth0 Code of Conduct. Please see the contributing guidelines for how to create and submit a high-quality PR for this repo.

Description

Describe the purpose of this PR along with any background information and the impacts of the proposed change. For the benefit of the community, please do not assume prior context.

Provide details that support your chosen implementation, including: breaking changes, alternatives considered, changes to the API, etc.

If the UI is being changed, please provide screenshots.

References

Include any links supporting this change such as a:

  • GitHub Issue/PR number addressed or fixed
  • Auth0 Community post
  • StackOverflow post
  • Support forum thread
  • Related pull requests/issues from other repos

If there are no references, simply delete this section.

Testing

Describe how this can be tested by reviewers. Be specific about anything not tested and reasons why. If this library has unit and/or integration testing, tests should be added for new functionality and existing tests should complete without errors.

Please include any manual steps for testing end-to-end or functionality not covered by unit/integration tests.

Also include details of the environment this PR was developed in (language/platform/browser version).

  • This change adds test coverage for new/changed/fixed functionality

Checklist

  • I have added documentation for new/changed functionality in this PR or in auth0.com/docs
  • All active GitHub checks for tests, formatting, and security are passing
  • The correct base branch is being used, if not the default branch

Adds a new `deepseek` agent runner that drives DeepSeek models via the
Codex SDK against an OpenAI-compatible Responses API endpoint. Routes
through the configured proxy (DEEPSEEK_PROXY_BASE_URL env var, falling
back to LLM_PROXY_BASE_URL) using the same LLM_API_KEY as all other runners.

- packages/evals/src/runners/deepseek/ - new runner (agent.ts + runner.ts)
- evals-core: add 'deepseek' to KNOWN_AGENT_TYPES, AGENT_CONTEXT_FILENAMES,
  DEEPSEEK_MODELS prefix, isDeepSeekModel() helper, cost table entries
- evals/cli: register DeepSeekRunner in run.ts and sandbox-runner.ts
- apps/auth0-evals/eval.config.js: add deepseek agent proxy config
@coderabbitai

coderabbitai Bot commented Aug 24, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant