Skip to content

Add vertex explicitly as an available provider#844

Merged
Erin McNulty (erin2722) merged 1 commit into
mainfrom
fix-vertex-resolution
Jun 22, 2026
Merged

Add vertex explicitly as an available provider#844
Erin McNulty (erin2722) merged 1 commit into
mainfrom
fix-vertex-resolution

Conversation

@erin2722

Copy link
Copy Markdown
Contributor

The failover work broadened the set of providers considered for each model by looking at equivalent/fallback models. For provider-native Vertex model names, that meant the gateway could receive both Gemini and Vertex credentials because the catalog entry itself did not explicitly say it was Vertex-only. Since those Vertex model names are not valid Gemini API model names, routing could select the Gemini provider and return a 404. This PR adds available_providers: ["vertex"] to provider-native Vertex catalog entries so gateway provider-default remapping resolves them to GOOGLE_DEFAULT_CREDENTIALS instead of falling back to Gemini.

@vercel

vercel Bot commented Jun 22, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
ai-proxy Ready Ready Preview, Comment Jun 22, 2026 3:24pm

Request Review

"claude-fable-5": ["anthropic"],
"openai.gpt-oss-safeguard-120b": ["bedrock"],
"openai.gpt-oss-safeguard-20b": ["bedrock"],
"openai.gpt-5.5": ["bedrock"],

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this was a drive-by from running sync-models, I need to seperately fix why this wouldn't have happened at model addition time.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: bb66cfb31f

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "Codex (@codex) address that feedback".

Comment on lines +9593 to +9595
"available_providers": [
"vertex"
]

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Keep provider-native Vertex lookups from inheriting Gemini

Adding available_providers: ["vertex"] here does not make this exact Vertex model ID Vertex-only for callers of getModelEndpointTypes: the reverse fallback scan in schema/index.ts still sees canonical gemini-2.5-flash listing this ID in fallback_models, then adds the canonical model's direct google endpoint as well. In the current catalog, publishers/google/models/gemini-2.5-flash therefore still resolves to both vertex and google, so the dual-credential 404 scenario described in the commit can still occur unless provider-native lookups stop inheriting canonical providers or direct provider restrictions are made authoritative.

Useful? React with 👍 / 👎.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that is fine, we now prefer the vertex one

@erin2722 Erin McNulty (erin2722) merged commit 4ae8fd0 into main Jun 22, 2026
7 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants