Refact reader branch#64904

Draft

Gabriel39 wants to merge 57 commits into

apache:masterfrom

Gabriel39:refact_reader_branch

Commits on Jun 26, 2026

[refactor](be) Refactor file table reader stack
Gabriel39
committed
Fix 0612 (#64456)
Gabriel39
committed
[refactor](be) Normalize parquet complex schema projection (#64451)

suxiaogang223
authored and
Gabriel39
committed
support truncate_char_or_varchar (#64463)

zhangstar333
authored and
Gabriel39
committed
Fix wrong map (#64474)
Gabriel39
committed
fix (#64475)
Gabriel39
committed
fix compile (#64477)
Gabriel39
committed
fix(column-mapper): handle nested predicates on evolved complex columns (#64480)
Gabriel39
committed
fix rf (#64481)
Gabriel39
committed
fix paimon (#64482)
Gabriel39
committed
[test](regression) Update parquet int96 timestamp outputs

suxiaogang223
authored and
Gabriel39
committed
[fix](be) Allow nullable parquet map keys

suxiaogang223
authored and
Gabriel39
committed
[fix](be) Execute runtime filter wrapper expressions

suxiaogang223
authored and
Gabriel39
committed
[fix](be) Support decimal256 in new parquet reader

suxiaogang223
authored and
Gabriel39
committed
[fix](be) Count parquet lazy materialized rows

suxiaogang223
authored and
Gabriel39
committed
fix (#64526)
Gabriel39
committed
[chore](be) Clean up format v2 code style

suxiaogang223
authored and
Gabriel39
committed
fix some hive case failed (#64534)

zhangstar333
authored and
Gabriel39
committed
unit tests for file scanner and AccessPathParser (#64543)
Gabriel39
committed
clang format

suxiaogang223
authored and
Gabriel39
committed
[test](regression) Update external timestamp outputs

suxiaogang223
authored and
Gabriel39
committed
fix by_index column mapper with struct type (#64567)

zhangstar333
authored and
Gabriel39
committed
[refactor](be) Unify new parquet profile definitions

suxiaogang223
authored and
Gabriel39
committed
[refactor](be) Move format v2 implementations under format namespace

suxiaogang223
authored and
Gabriel39
committed
[test](regression) Update timestamp regression outputs

suxiaogang223
authored and
Gabriel39
committed
[fix](be) Support parquet timestamp nanos in new reader

suxiaogang223
authored and
Gabriel39
committed
[refactor](be) Refine parquet reader pruning and documentation

suxiaogang223
authored and
Gabriel39
committed
[comment](be) Rewrite documentation comments for core Parquet modules

authored and
Gabriel39
committed
[fix](regression) Use old scanner for parquet condition cache case

suxiaogang223
authored and
Gabriel39
committed
fix UT (#64616)
Gabriel39
committed
[fix](parquet) disable int96 timestamps by default

suxiaogang223
authored and
Gabriel39
committed
fix

suxiaogang223
authored and
Gabriel39
committed
[fix](parquet) Normalize nested schema in new reader

suxiaogang223
authored and
Gabriel39
committed
[fix](regression) Refresh parquet export p0 outputs

suxiaogang223
authored and
Gabriel39
committed
support condition cache (#64719)
Gabriel39
committed
support iceberg and paimon jni reader (#64722)

zhangstar333
authored and
Gabriel39
committed
support hudi reader (#64726)
Gabriel39
committed
fix hive UT (#64745)
Gabriel39
committed
support paimon hybrid reader to handle native and jni splits (#64790)

zhangstar333
authored and
Gabriel39
committed
[test](be) Add new parquet reader UT coverage (#64729)

suxiaogang223
authored and
Gabriel39
committed
[test](regression) Update external hive timestamp outputs

suxiaogang223
authored and
Gabriel39
committed
[fix](be) Preserve timestamptz scale in protobuf

suxiaogang223
authored and
Gabriel39
committed
[test](regression) Update parquet TIME expected error

suxiaogang223
authored and
Gabriel39
committed
[test](regression) Update malformed parquet expectation

suxiaogang223
authored and
Gabriel39
committed
fix

suxiaogang223
authored and
Gabriel39
committed
Support CSV/TEXT reader (#64792)
Gabriel39
committed
[fix](be) Fix timestamptz protobuf test type (#64804)
Gabriel39
committed
[fix](be) Preserve empty repeated parquet rows

suxiaogang223
authored and
Gabriel39
committed
[fix](be) Cast parquet logical integers by bit width

suxiaogang223
authored and
Gabriel39
committed
fix

suxiaogang223
authored and
Gabriel39
committed
support hudi/trino/max_compute jni reader (#64865)

zhangstar333
authored and
Gabriel39
committed
Support JSON reader (#64830)
Gabriel39
committed
[fix](be) Apply scanner v2 load counter fixes (#64871)
Gabriel39
authored
fix external pipeline
suxiaogang223
committed
[improvement](be) Add scanner v2 parquet page cache (#64883)
Gabriel39
authored
[feature](be) Add FileScannerV2 native reader (#64902)
Gabriel39
authored
[feature](be) Add Remote Doris reader to file scanner v2
Gabriel39
committed