chore: Upgrade to DataFusion 44 #972

Activity

1. timsaucer

   added

   enhancementNew feature or requestNew feature or request

   on Dec 13, 2024
2. timsaucer commented on Dec 13, 2024

   

   timsaucer

   on Dec 13, 2024

   Last edited by timsaucer

   MemberAuthor

   More actions

   1. The trait definition of ExecutionPlanProperties return type for output_ordering now is Option<&LexOrdering> instead of Option<&[PhysicalSortExpr]>. The recommendation is to use .into() to convert into the required output.
   2. find_df_window_func has now been removed from the logical_expr crate. If users require this functionality they can perform equivalent searches by either creating a default session context, or calling all_default_aggregate_functions and all_default_window_functions, or by searching their existing session context using ctx.udaf, ctx.window_functions, ctx.aggregate_functions, and so on.
   3. LogicalPlan::Prepare and LogicalPlan::Execute have been removed. We do not actively use these in datafusion-python and I didn't search further for figuring out migration strategy.
   4. to_substrait_plan and from_substrait_plan no longer take a session context. Rather they expect a SubstraitPlanningState which is implemented by SessionState. One recommended migration is to call ctx.ctx.state() and use a borrow of the returned SessionState.
   5. RuntimeConfig is now deprecated in favor of RuntimeEnvBuilder. The migration is fairly straightforward, except to create the RuntimeEnv you now call build().
   6. String concat of a string view and string returns a string view.
   7. date_part function returns int32 instead of float64.
3. timsaucer

   closed this as completedin #973on Jan 9, 2025