Skip to content

Commit 27e1e3a

Browse files
committed
fix: correct test count from 147 to 137 to match table breakdown
1 parent ffb2ab4 commit 27e1e3a

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

src/blog/how-we-test-tanstack-ai-across-7-providers.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ LLM responses are non-deterministic. API calls cost money. And the thing that wo
1313

1414
If you've ever built on an AI SDK, you know the feeling: you trust the library works because the README says it supports your provider. But does it? Has anyone actually verified that tool calling works the same way across OpenAI, Gemini, and Ollama? That streaming structured output doesn't break when you switch from Groq to Anthropic?
1515

16-
We got tired of wondering. So we built an E2E testing infrastructure for TanStack AI that verifies every feature across every provider on every pull request. 147 tests. 7 providers. About 2 minutes. Zero API keys required.
16+
We got tired of wondering. So we built an E2E testing infrastructure for TanStack AI that verifies every feature across every provider on every pull request. 137 tests. 7 providers. About 2 minutes. Zero API keys required.
1717

1818
Here's how it works and why it matters for the long-term stability of the project.
1919

@@ -51,11 +51,11 @@ graph LR
5151

5252
Playwright opens the test app, navigates to a route like `/openai/chat`, and interacts with the UI. The app's provider adapter thinks it's talking to OpenAI, but the `baseURL` points at aimock. aimock matches the request against a fixture file and returns a deterministic response.
5353

54-
Every test gets a unique `X-Test-Id` header. This is what makes parallel execution work: aimock uses the header to route each test to its own fixture sequence, so 147 tests can run simultaneously without stepping on each other.
54+
Every test gets a unique `X-Test-Id` header. This is what makes parallel execution work: aimock uses the header to route each test to its own fixture sequence, so 137 tests can run simultaneously without stepping on each other.
5555

5656
## The Numbers
5757

58-
147 tests cover 17 features across 7 providers. Here's the matrix:
58+
137 tests cover 17 features across 7 providers. Here's the matrix:
5959

6060
| Category | Tests | Features |
6161
| --------------- | ----- | ----------------------------------------------------------------- |

0 commit comments

Comments
 (0)