Conversation
files_backend: fsspec plus a files_url (gcs://, abfs://, s3://, sftp://, file://, ...) and files_storage_options reach whatever filesystem fsspec has an implementation installed for, through the same FileStore protocol the local and boto3 S3 backends implement. fsspec was already in the tree through any-llm and is now a declared dependency. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
|
Important Draft PR not reviewedDraft PRs are not automatically reviewed by default.
To automatically review draft PRs, update your CodeRabbit configuration: reviews:
auto_review:
drafts: trueThanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
This PR appears to be missing required sections from the PR template. Please edit your PR description to include the PR Type, Checklist, and AI Usage sections. The template helps maintainers review your contribution. This PR will be automatically closed in 24 hours if the template is not restored. If you're using an AI coding tool, please ensure it preserves the PR template. |
|
This PR has been automatically closed because the required template sections were not restored within 24 hours. Please create a new PR using the template and complete the checklist. The template helps maintainers review your contribution. |
Stacked on #976 (
feat/files-api-parity); only the last commit is this PR.What
files_backend: fsspecwithfiles_url(gcs://bucket/prefix,abfs://container/prefix,s3://bucket/prefix,sftp://host/path,file:///path,memory://) andfiles_storage_optionsfor the implementation's own keyword arguments (credentials, endpoints, projects).FsspecFileStoreimplements the sameFileStoreprotocol as the local and boto3 S3 backends: writes and reads stream through worker threads, a partial upload is removed on failure or cancellation, backend exceptions are translated to theOSErrorfamily callers already handle, and a ref that could leave the root is refused.fsspec was already in the dependency tree through any-llm and is now declared; the lock gains only that entry.
files_storage_optionsis kept out of the settings view as a credential. Operators install the implementation package for their protocol (gcsfs,adlfs,s3fs,paramiko).Validation
Unit tests run on fsspec's built-in
memory://andfile://filesystems, so no cloud package or network is needed.make lint,make typecheck, unit suite, OSS smoke gate, and the files/config/settings integration tests pass.🤖 Generated with Claude Code