Skip to content

docs: document Table.add progress callback (TypeScript)#243

Open
mintlify[bot] wants to merge 2 commits into
mainfrom
docs/ts-add-progress
Open

docs: document Table.add progress callback (TypeScript)#243
mintlify[bot] wants to merge 2 commits into
mainfrom
docs/ts-add-progress

Conversation

@mintlify
Copy link
Copy Markdown
Contributor

@mintlify mintlify Bot commented May 18, 2026

Summary

Documents the new optional progress callback on Table.add() in the TypeScript SDK, which surfaces per-batch write progress for long-running ingests.

Changes

  • Added a "Tracking ingestion progress" subsection to the ingest docs, describing the WriteProgress fields (outputRows, outputBytes, totalRows, elapsedSeconds, activeTasks, totalTasks, done), when callbacks fire, and the non-blocking/error-swallowing semantics.
  • Added a TypeScript code example snippet showing how to log progress from table.add().

Context

Upstream PR adds an optional progress callback to Table.add(data, { progress }) in the Node.js SDK. The callback fires once per batch and once more with done: true on completion; errors thrown from user callbacks are logged and swallowed so they don't abort the write.

@mintlify
Copy link
Copy Markdown
Contributor Author

mintlify Bot commented May 18, 2026

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
lancedb-bcbb4faf 🟢 Ready View Preview May 18, 2026, 4:31 PM

@prrao87 prrao87 requested a review from brendanclement May 18, 2026 17:46
@prrao87 prrao87 added the needs_new_release Only merge once we release a new version of LanceDB label May 19, 2026
Comment thread docs/tables/create.mdx Outdated

A few things to know before you wire this up:

- Non-blocking: if your callback is slow, intermediate updates may be dropped so the write doesn't stall. The final `done: true` callback is always delivered.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

a slow callback will queue events rather than back-pressure the writer, they shouldn't be dropped

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs_new_release Only merge once we release a new version of LanceDB

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants