Blog post with DataFusion Jan - June 2024 #9602

Activity

1. alamb

   added

   enhancementNew feature or requestNew feature or request

   on Mar 13, 2024
2. alamb commented on Mar 13, 2024

   

   alamb

   on Mar 13, 2024

   ContributorAuthor

   More actions

   I am starting to collect a list of things to highlight here

   • New trait based APIs
   • Pluggable handler for CREATE FUNCTIONL Add plugable handler for CREATE FUNCTION #9333 (thanks @milenkovicm)
   • DataFusion Comet blog published: https://arrow.apache.org/blog/2024/03/06/comet-donation/
   • Move of DataFusion to a top level Apache project was approved by the community: [DISCUSS] Move Apache Arrow Datafusion to a new top level Apache project #6475
   • Large scale "extract scalar functions from the core" continues at good pace way [Epic] Port BuiltInFunctons to datafusion-functions-* crates #9285

   Performance improvements:

   • specialized group values for strings/binary Implement specialized group values for single Uft8/LargeUtf8/Binary/LargeBinary column #8827

   • Meetup

   • Agenda for DataFusion meetup 2024 is looking good UPDATE: VENUE IS FULL Invitation: Mar 25, 2024 DataFusion meetup before the DataCouncil March 2024 in Austin TX #8522

   • DataFusion SIGMOD paper about DataFusion was Finalize SIGMOD 2024 paper ~(if accepted)~ #8373 (comment)

   SQL to String features from @devinjdangelo / @backkem

   • [EPIC] Support converting Exprs and LogicalPlans --> SQL Strings #9494

   Maybe REcursive CTEs:

   • Hardening Recursive CTEs Add support for recursive CTEs #462 with @matthewgapp and @jonahgao
3. alamb commented on Mar 16, 2024

   

   alamb

   on Mar 16, 2024

   ContributorAuthor

   More actions

   CTE support: #9619
4. Omega359 commented on Mar 18, 2024

   

   Omega359

   on Mar 18, 2024

   Contributor

   More actions

   Just a few things that come to mind:

   Functions:

   • New: nv1, nvl2
   • Improvements: unnest, null handling improvements for lead/lag

   👍React with 👍1Reacted by Andrew Lamb
5. alamb commented on Apr 1, 2024

   

   alamb

   on Apr 1, 2024

   ContributorAuthor

   More actions

   WASM from @waynexia #9834
6. alamb

   self-assigned this

   on Jun 5, 2024
7. alamb commented on Jul 1, 2024

   

   alamb

   on Jul 1, 2024

   ContributorAuthor

   More actions

   I am now officially out of time and excuses -- I need to write this post soon
8. alamb commented on Jul 9, 2024

   

   alamb

   on Jul 9, 2024

   ContributorAuthor

   More actions

   Started gathering ideas apache/datafusion-site#6
9. alamb commented on Jul 22, 2024

   

   alamb

   on Jul 22, 2024

   ContributorAuthor

   More actions

   I plan one more round of copyediting and then posting in 2 days. Please leave comments if you have any: apache/datafusion-site#6
10. alamb

    closed this as completedin datafusion-site#6on Jul 24, 2024
11. alamb commented on Jul 24, 2024

    

    alamb

    on Jul 24, 2024

    ContributorAuthor

    More actions

    Blog post is live: https://datafusion.apache.org/blog/2024/07/24/datafusion-40.0.0/
12. alamb commented on Jul 24, 2024

    

    alamb

    on Jul 24, 2024

    ContributorAuthor

    More actions

    Filed #11631 to track the next one