GH-50628: [C++][Parquet] Rework RecordReader to introduce flat optional optimization - #50629

Open

AntoinePrv wants to merge 46 commits into

apache:mainfrom

AntoinePrv:levels-bitmap

Commits on Aug 6, 2026

Move TypedColReaderImpl::Skip
AntoinePrv
committed
c278835
Break TypedRecordReader inheritance on TypedColumnReader
AntoinePrv
committed
a5d35f9
Add ReadValuesBuffer
AntoinePrv
committed
190c63a
Split ColumnReaderImplBase definition and declaration
AntoinePrv
committed
04fbe04
Add DefRepLevelsDecoder
AntoinePrv
committed
1b68bd5
Explicit int32_t for LevelDecoder
AntoinePrv
committed
17ee986
Change ValuesBuffer API
AntoinePrv
committed
469c647
Add StackedLevelDecoder and prepare for modularity
AntoinePrv
committed
07b9a69
Remove DefRepLevelsDecoder
AntoinePrv
committed
707860d
Split TypedRecordReader implementation
AntoinePrv
committed
e1bf5a5
First RequiredTypedRecordReader
AntoinePrv
committed
90c8150
Remove RecordReader protected members
AntoinePrv
committed
e70e6ba
Fully use RequiredRecordReader
AntoinePrv
committed
a35f2ac
Rename ReadValues -> ValueSink
AntoinePrv
committed
21764b0
Split ReserveValuesAndIsValid
AntoinePrv
committed
2daa62b
Devirtualize hooks with CRTP
AntoinePrv
committed
f5b54b4
Simplify template
AntoinePrv
committed
745bc2c
Remove StackedLevelDecoder
AntoinePrv
committed
dbd0b48
Remove mark_as_written
AntoinePrv
committed
2e934cb
Make some of ColumnReaderImplBase private
AntoinePrv
committed
3944e26
Fix horrible dictionnary handling
AntoinePrv
committed
4842c57
Simplify and rename ColumnChunkReader
AntoinePrv
committed
56c1efa
Add RleBitPackedToBitmapDecoder::CountUpTo
AntoinePrv
committed
fb6dc86
Add BitPackedToBitmapDecoder
AntoinePrv
committed
b996c40
Add RleBitPackedToBitmapDecoder::Advance
AntoinePrv
committed
f5c479a
Add LevelToBitmapDecoder
AntoinePrv
committed
b465b45
Add ValiditySinkBuffer
AntoinePrv
committed
4b4d389
Auto reserve space in sinks:
AntoinePrv
committed
37e58b6
Fix integer types
AntoinePrv
committed
581f269
Nit in ColumnChunkReader
AntoinePrv
committed
c69aef2
Eagerly read dict
AntoinePrv
committed
3038390
Cleanups
AntoinePrv
committed
4ab6611
Add FlatOptionalTypedRecordReader
AntoinePrv
committed
9802eea
Add some doc
AntoinePrv
committed
a888f92
Factorize ReadDictionary
AntoinePrv
committed
236ddb6
Simplify read_dense_for_nullable
AntoinePrv
committed
6a7c6cc
Factor Sinks with DataSinkBuffer
AntoinePrv
committed
f64b7e8
Use LevelBufferSink in TypedRecordReader
AntoinePrv
committed
07229b7
Relax record reader level tests flat optional
AntoinePrv
committed
2025c06
Fix compiler errrors
AntoinePrv
committed
3609201
Safe decoded number check and func rename
AntoinePrv
committed
0c634ec
Explicit values_written contract
AntoinePrv
committed
53134a0
Fix LevelDecoder::max_level type
AntoinePrv
committed
0855c13
Fix integer convertion
AntoinePrv
committed
3e54f99
Factorize level decoders
AntoinePrv
committed
94a6eae
Fixt typos
AntoinePrv
committed
fe89180