You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Push down limit to SortPreservingMergeExec and SortPreservingMergeStream #6000
This should reduce memory usage of sort and hope this could help for #5969
Describe the solution you'd like
Push down the limit in red path above, i.e. SortPreservingMergeExec and SortPreservingMergeStream
(don't forget the path sort -> streaming_merge as well)
Activity
alamb commentedon Apr 14, 2023
FYI @tustvold
jychen7 commentedon Apr 14, 2023
I try to implement the
fetchin SortPreservingMergeStream. I read about Tournament_Tree, but not sure how to further improve it with TopK.It would be nice if have 2nd 👀 and see whether it is in a good direction.
https://github.com/apache/arrow-datafusion/pull/6014/files#r1167309647