Skip to content

[BUG] Lucene: GPU search codecs ignore the filter cache config on read and don't share a cache #2705

Open

Description

@imotov

Describe the bug

When an index is opened from disk, each segment's codec is created with default settings, so a custom FilterBitsetCacheConfig is ignored. Each codec generation also has its own cache with its own memory budget. An index upgraded across Lucene minors (for example 10.3 → 10.4) can therefore use twice the configured cache memory until its old segments are merged away.

Additional context

The problem exists today but adding support for multiple versions of Lucene in #2702 made it more likely to affect users, and should be fixed as #2702 follow up.

Possible fix
Use one cache shared by all GPU search codecs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

LucenebugSomething isn't working

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions