Skip to content

[datafusion-spark]: Implement collect_set #17924

Closed
Feature
#19699
Closed
[datafusion-spark]: Implement collect_set#17924
Feature
#19699
Labels
enhancementNew feature or request

Description

@rishvin
rishvin
opened on Oct 5, 2025

Is your feature request related to a problem or challenge?

Implement collect_set equivalent of spark.

Note that, Spark doc explicitly mentions this for collect_set - The function is non-deterministic because the order of collected results depends on the order of the rows which may be non-deterministic after a shuffle., link.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

Activity

  1. rishvin
    added
    enhancementNew feature or request
    on Oct 5, 2025
  2. rishvin
    added the
    Feature
    issue type on Oct 5, 2025

  3. alamb commented on Oct 14, 2025

    @alamb
    alamb
    on Oct 14, 2025
    Contributor

    Thanks! I added this to the epic:

  4. cht42 commented on Jan 8, 2026

    @cht42
    cht42
    on Jan 8, 2026
    Contributor

    take

  5. github-merge-queue
    added a commit that references this issue on Jan 10, 2026

    feat(spark): Implement collect_list/collect_set aggregate functions (#…

    821d410
  6. Jefffrey
    closed this as completedin #19699on Jan 10, 2026
  7. de-bgunter
    added a commit that references this issue on Mar 24, 2026

    feat(spark): Implement collect_list/collect_set aggregate functions (a…

    f3b06fe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    Feature

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions