[branch-4.1] Backport FileScannerV2 and follow-up fixes#65559

Open

Gabriel39 wants to merge 34 commits into

apache:branch-4.1from

Gabriel39:agent/backport-format-v2-prs-4.1

Commits on Jul 13, 2026

[feature](be) Add file scanner v2 readers (#65046)
Gabriel39
committed
[refactor](be) Remove nested file column predicate filters (#65130)
Gabriel39
committed
[improvement](parquet) Add prefetch for file scanner v2 (#65151)
Gabriel39
committed
[fix](be) Use VExpr for file scanner v2 ZoneMap pruning (#65175)
Gabriel39
committed
[test](regression) Update HDFS parquet group4 output (#65194)
Gabriel39
committed
[fix](be) Rework FileScannerV2 scan accounting and stop handling (#65218)
Gabriel39
committed
[fix](be) Fix deletion vector cache identity (#65281)
Gabriel39
committed
[chore](be) Add code owners for format v2 (#65326)
Gabriel39
committed
[fix](be) Keep Paimon JNI predicate compatibility (#65328)
Gabriel39
committed
[improvement](paimon) Support IOManager for JNI reads (#65332)
Gabriel39
committed
[improvement](paimon) Add Paimon JNI scanner observability (#65354)
Gabriel39
committed
[fix](fe) Preserve external table column name case (#65094)
Gabriel39
committed
[fix](be) Release deletion vector rows on read errors (#65351)
Gabriel39
committed
[fix](regression) Stabilize Iceberg DV profile check (#65359)
Gabriel39
committed
[fix](be) Align cast input nullability for Iceberg struct evolution (#65370)
Gabriel39
committed
[feature](be) Add ORC reader for format v2 (#65183)

xylaaaaa
authored and
Gabriel39
committed
[improvement](be) Optimize Parquet predicate filtering in format v2 (#65369)
Gabriel39
committed
[improvement](be) Improve FileScannerV2 profiling and pruning (#65449)
Gabriel39
committed
[improvement](external) Enable FileScannerV2 for batch mode (#65437)
Gabriel39
committed
[improvement](be) Retain deletion vectors as Roaring bitmaps (#65451)
Gabriel39
committed
[chore](be) Add FileScannerV2 review guidance (#65475)
Gabriel39
committed
[fix](be) Count complex Parquet structs safely (#65495)
Gabriel39
committed
[fix](be) Preserve condition cache granule base (#65496)
Gabriel39
committed
[fix](be) Align CSV V2 enclosed field parsing (#65501)
Gabriel39
committed
[fix](be) Harden external reader filtering, statistics, and nested Parquet reads (#65500)
Gabriel39
committed
[improvement](be) Add ORC v2 stripe merged reads (#65478)

xylaaaaa
authored and
Gabriel39
committed
[fix](be) Harden JNI reader split lifecycle (#65503)
Gabriel39
committed
[fix](backport) Adapt FileScannerV2 changes to branch-4.1
Gabriel39
committed