Upgrade guide for DataFusion 47.0.0 #15707

Is your feature request related to a problem or challenge?

• Part of Release DataFusion 47.0.0 (April 2025) #15072

There were several changes in DataFusion 47 that deserve mention in the upgrade guide: https://datafusion.apache.org/library-user-guide/upgrading.html

We should write that document.

Describe the solution you'd like

Changes to add to upgrade guide

Add notes about each of these:

• chore: remove deprecated variants of UDF's invoke (invoke, invoke_no_args, invoke_batch) #15123
• chore: remove ScalarUDFImpl::return_type_from_exprs #15130
• Fix type coercion for unsigned and signed integers (Int64 vs UInt64, etc) #15341
• Refactor: add FileGroup structure for Vec<PartitionedFile> #15379
• Add downcast_to_source method for DataSourceExec #15416
• Support computing statistics for FileGroup #15432
• Need to handle DisplayFormatType::TreeRender for execution plans.
• map_partial_batch is removed from schema mapper
• page_pruning_predicate is removed from public api -- parquet reader: move pruning predicate creation from ParquetSource to ParquetOpener #15561

Describe alternatives you've considered

We can potentially use the experience / patterns set in the delta-rs / other early upgrades to help

• feat: upgrade to DataFusion 47.0.0 delta-io/delta-rs#3378

Additional context

No response