Skip to content

Flink: Fix read split table properties being ignored - #17445

Open
vishnuprakaz wants to merge 1 commit into
apache:mainfrom
vishnuprakaz:flink-read-split-table-props
Open

Flink: Fix read split table properties being ignored#17445
vishnuprakaz wants to merge 1 commit into
apache:mainfrom
vishnuprakaz:flink-read-split-table-props

Conversation

@vishnuprakaz

Copy link
Copy Markdown
Contributor

Setting read.split.target-size, read.split.planning-lookback, or read.split.open-file-cost as a table property has no effect on Flink reads. The split options in FlinkReadOptions declare default values, so FlinkConfParser always returns the Flink default and never reaches the table property fallback in FlinkReadConf, even though the docs promise read option, then Flink configuration, then table property. This is a regression from #5967, which introduced the read options with declared defaults; before that the planner only set the split scan options when explicitly configured and the table properties were honored.

The split options now declare no default, like the write options, and the defaults are applied in FlinkReadConf after the table property lookup. Needs a backport to 1.20 and 2.0

@github-actions github-actions Bot added the flink label Jul 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant