Release DataFusion 52.4.0 (minor/) Release (Mar 2026)

@alamb

Is your feature request related to a problem or challenge?

Part of [EPIC] DataFusion Releases #19783
Follow on to Release DataFusion 52.3.0 (minor/) Release (Mar 2026) #20681

Are several other regressions reported against 52 that we might want to backport to branch-52 that didn't make it into #20681. Let's coordinate on this ticket in case we want to create a new release

Steps:

Update version and changelog: [branch-52] Update version to 52.4.0 and update changelog #21004
Voting Thread: https://lists.apache.org/thread/gtdxclh1ywd89sjfz4r1pb4d5x0s5j90
Publish to crates.io

Potential Content:

Requested Bug Fixes. Issue / requester / Backport

I have a first pass at the potential content above

Possible other issues:

Ok, I made a bunch of backport PRs (with codex's help)

[branch-52] fix: disable dynamic filter pushdown for non min/max aggregates (#20279) #20877
[branch-52] fix: maintain inner list nullability for (#19948) #20878
[branch-52] fix: Ensure columns are casted to the correct names with Unions (#20146) #20879
[branch-52] fix: interval analysis error when have two filterexec that inner filter proves zero selectivity (#20743) #20880
[branch-52] fix: Return probe_side.len() for RightMark/Anti count(*) queries (#20710) #20881

[branch-52] fix: maintain inner list nullability for (#19948) (#20878)

[branch-52] fix: Ensure columns are casted to the correct names with …

[branch-52] fix: interval analysis error when have two filterexec tha…

I found another regression:

Incorrect ORDER BY in unparser after DF 52 upgrade #20905

[branch-52] fix: Return `probe_side.len()` for RightMark/Anti count(*…

[branch-52] fix: disable dynamic filter pushdown for non min/max aggr…

[branch-52] fix: maintain inner list nullability for (apache#19948) (a…

[branch-52] fix: Ensure columns are casted to the correct names with …

[branch-52] fix: interval analysis error when have two filterexec tha…

[branch-52] fix: Return `probe_side.len()` for RightMark/Anti count(*…

[branch-52] fix: disable dynamic filter pushdown for non min/max aggr…

Comet is still seeing SMJ regressions even after upgrading to 52.3. I'm going to benchmark backporting #20478 to 52 and will submit a PR if the numbers look good.

SOunds good -- I am still waiting on a few more PRs so there is plenty of time

[branch-52] Fix duplicate group keys after hash aggregation spill (#20724) (#20858) #20917

[branch-52] Update to use lz4_flex 0.12.1 and quinn-proto 0.11.14 (#2…

Ok, I think we are basically ready now -- I polished up the changelog in #21004 and once that merges I'll make an RC

There appears to be some sort of SVN issue:

Uploading to datafusion dist/dev to https://dist.apache.org/repos/dist/dev/datafusion/apache-datafusion-52.4.0-rc1
svn: E170013: Unable to connect to a repository at URL 'https://dist.apache.org/repos/dist/dev/datafusion'
svn: E120108: Error running context: The server unexpectedly closed the connection.

I will try again in a bit

Ok, I made a release candidate and started a voting thread:

https://lists.apache.org/thread/gtdxclh1ywd89sjfz4r1pb4d5x0s5j90

I am proactively also considering a new branch-52 release

Release DataFusion 52.5.0 (minor) Release (Apr 2026) #21078

Release is approved and published: https://lists.apache.org/thread/7bj6gynx25f6yfbwqm1h0m14bo5lov4z

[main] add 52.4.0 changelog (#21053)

Merge datafusion upstream 52.4.0 into branch-52 (#98)

[branch-52] fix: disable dynamic filter pushdown for non min/max aggr…

[main] add 52.4.0 changelog (apache#21053)

Navigation Menu

Repository navigation

Release DataFusion 52.4.0 (minor/) Release (Mar 2026) #20855

Is your feature request related to a problem or challenge?

Potential Content:

5 remaining items

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Release DataFusion 52.4.0 (minor/) Release (Mar 2026) #20855

Description

Is your feature request related to a problem or challenge?

Potential Content:

Activity

alamb commented on Mar 10, 2026

alamb commented on Mar 11, 2026

alamb commented on Mar 12, 2026

mbutrovich commented on Mar 13, 2026

alamb commented on Mar 13, 2026

5 remaining items

alamb commented on Mar 18, 2026

alamb commented on Mar 18, 2026

alamb commented on Mar 18, 2026

alamb commented on Mar 20, 2026

alamb commented on Mar 22, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions