Skip to content

Remove single file secondary_filters_byte_ranges API - #23800

Draft
qbacpey wants to merge 4 commits into
NVIDIA:mainfrom
qbacpey:hybrid/api-split-t3
Draft

Remove single file secondary_filters_byte_ranges API#23800
qbacpey wants to merge 4 commits into
NVIDIA:mainfrom
qbacpey:hybrid/api-split-t3

Conversation

@qbacpey

@qbacpey qbacpey commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Description

Close #23801

Replaces single-file hybrid_scan_reader::secondary_filters_byte_ranges() with separate bloom_filters_byte_ranges() and dictionary_pages_byte_ranges(), matching hybrid_scan_multifile signatures.

Updates all consumers: C++ tests/example/benchmarks, pylibcudf bindings, and Java/JNI. Java's SecondaryFilterRanges is replaced by two ByteRange[] accessors

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

…bloom filter` and `dict filter` API, update Java, Python, and examples related to it
@qbacpey qbacpey added this to libcudf Aug 25, 2026
@qbacpey qbacpey added 2 - In Progress Currently a work in progress libcudf Affects libcudf (C++/CUDA) code. Python Affects Python cuDF API. Java Affects Java cuDF API. labels Aug 25, 2026
@qbacpey qbacpey added breaking Breaking change pylibcudf Issues specific to the pylibcudf package labels Aug 25, 2026
@copy-pr-bot

copy-pr-bot Bot commented Aug 25, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@qbacpey qbacpey added the improvement Improvement / enhancement to an existing function label Aug 25, 2026
@qbacpey

qbacpey commented Aug 25, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 16c1ac6

@github-actions github-actions Bot added the Python Affects Python cuDF API. label Aug 25, 2026
…d remove redundant assertions on reported ranges.
@qbacpey

qbacpey commented Aug 25, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 12d3b7d


// Filter row groups with dictionary pages
auto dict_page_filtered_row_groups = std::vector<cudf::size_type>{};
dict_page_filtered_row_groups.reserve(current_row_group_indices.size());

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe no needed since dict_page_filtered_row_groups = reader.filter_row_groups_with_dictionary_pages(...); would move-assign?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

2 - In Progress Currently a work in progress breaking Breaking change improvement Improvement / enhancement to an existing function Java Affects Java cuDF API. libcudf Affects libcudf (C++/CUDA) code. pylibcudf Issues specific to the pylibcudf package Python Affects Python cuDF API.

Projects

Status: Todo
Status: No status

Development

Successfully merging this pull request may close these issues.

[FEA] Replace the hybrid scan single-file secondary-filter API

1 participant