Skip to content

deps: [DO NOT MERGE] Start testing what will be DataFusion 54.0 #3916

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
mbutrovich wants to merge 14 commits into
base: main
Choose a base branch
from
Draft

deps: [DO NOT MERGE] Start testing what will be DataFusion 54.0 #3916

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
931f2bc
Start testing what will be DataFusion 54.0.
mbutrovich Apr 8, 2026
8d922b5
fix expandexec
mbutrovich Apr 8, 2026
b75c321
Bump commits.
mbutrovich Apr 15, 2026
42813d9
Merge branch 'main' into df54
mbutrovich Apr 15, 2026
af84b73
Fix.
mbutrovich Apr 15, 2026
e19aa50
Fix metrics aggregation for native scan.
mbutrovich Apr 15, 2026
e798f9a
enable SMJ with filter by default
mbutrovich Apr 15, 2026
4236c27
add test for SPARK-43113
mbutrovich Apr 16, 2026
3bff80b
test https://github.com/apache/datafusion/pull/21660
mbutrovich Apr 16, 2026
ec18066
Fix after merging in latest datafusion main in the feature branch.
mbutrovich Apr 16, 2026
68f1a09
Fix after merging in latest datafusion main in the feature branch.
mbutrovich Apr 16, 2026
276ad63
Merge branch 'main' into df54
mbutrovich Apr 16, 2026
ab809d1
Fix after merging in latest datafusion main in the feature branch.
mbutrovich Apr 16, 2026
f716fc3
Fix after merging in latest datafusion main in the feature branch.
mbutrovich Apr 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions common/src/main/scala/org/apache/comet/CometConf.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -313,9 +313,10 @@ object CometConf extends ShimCometConf {
val COMET_EXEC_SORT_MERGE_JOIN_WITH_JOIN_FILTER_ENABLED: ConfigEntry[Boolean] =
conf("spark.comet.exec.sortMergeJoinWithJoinFilter.enabled")
.category(CATEGORY_ENABLE_EXEC)
.doc("Experimental support for Sort Merge Join with filter")
.doc("Support for Sort Merge Join with filter. " +
"Deprecated: this config will be removed in a future release.")
.booleanConf
.createWithDefault(false)
.createWithDefault(true)

val COMET_TRACING_ENABLED: ConfigEntry[Boolean] = conf("spark.comet.tracing.enabled")
.category(CATEGORY_TUNING)
Expand Down
Loading
Loading