Repository navigation

Unlimited memory consumption in `RepartitionExec` #4816

Closed

Labels

opened

Describe the bug
See https://github.com/apache/arrow-datafusion/blob/5b70e3543f5c10832e43ed25e7d4166cf0c1df78/datafusion/core/src/physical_plan/repartition.rs#L333-L340

To Reproduce
-

Expected behavior
The data kept in these channels should be registered with the MemoryManager.

Additional context
-

crepererum
added
bugSomething isn't working
on Jan 4, 2023
crepererum commented on Jan 4, 2023
crepererum
on Jan 4, 2023
ContributorAuthor
I'm working on this.
Reacted by Andrew Lamb
crepererum
added a commit that references this issue on Jan 4, 2023
fix: account for memory in `RepartitionExec`
3ee4902
alamb
closed this as completedin #4820 on Jan 7, 2023
alamb
added a commit that references this issue on Jan 7, 2023
fix: account for memory in `RepartitionExec` (#4820)
83c1026

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests