Skip to content

[replicate] Add verified model metadata#2137

Open
rekram1-node wants to merge 2 commits into
devfrom
audit/replicate-reasoning-20260610
Open

[replicate] Add verified model metadata#2137
rekram1-node wants to merge 2 commits into
devfrom
audit/replicate-reasoning-20260610

Conversation

@rekram1-node

@rekram1-node rekram1-node commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator

Scope

  • coverage is complete only for the repository's checked-in four-model Replicate discovery inventory
  • this is not a comprehensive audit of Replicate's 100+ official model catalog
  • three inventory models currently resolve and are included; meta/meta-llama-3.1-405b-instruct returns 404 and is excluded

Reasoning and tools

  • deepseek-ai/deepseek-r1: fixed reasoning, reasoning_options = [], and tool_call = false because Replicate's current deployment schema exposes no tools interface
  • meta/meta-llama-3-8b-instruct: non-reasoning; reasoning options omitted
  • meta/meta-llama-3-70b-instruct: non-reasoning; reasoning options omitted

Evidence

  • current Replicate model-specific llms.txt input schemas for all three included deployments
  • checked-in Cloudflare AI Gateway Replicate discovery snapshot for the four-model repository inventory and pricing
  • current Replicate model URL checks, including the unavailable 405B ID
  • generated provider output confirms DeepSeek R1 resolves with tool_call: false

Validation

  • bun validate: passed
  • bun test packages/core/test/generate.test.ts --test-name-pattern "repository provider JSON": 2 passed
  • bun test packages/core/test/generate.test.ts --test-name-pattern "base_model": 3 passed
  • git diff --check: passed

The full suite was previously 43 passed with one unrelated baseline open-weight metadata failure reproduced on untouched origin/dev; focused tests covering this update pass.

@rekram1-node rekram1-node self-assigned this Jun 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant