Test DataFusion 44.0.0 with delta.rs #13834

Is your feature request related to a problem or challenge?

• Part of [DISCUSS] More extensive pre-release testing #13661

We are trying to make sure the upgrade experience for DataFusion is better and to do so we are hoping to improve the testsing of major downstream projects

For version 44.0.0 we would like to test with more versions prior to release

Describe the solution you'd like

I would like to create a PR to test delta.rs with a pre-released version of DataFusion (pinned to the main branch)

Here is the last PR that upgraded to 43.0.0 as an example

• chore: upgrade to datafusion 43 delta-io/delta-rs#2886

Here is discussion with the maintaiers for upgrading upgrading: delta-io/delta-rs#2886 (comment)

Describe alternatives you've considered

No response

Additional context

No response