Skip to content

Consolidate Examples: regexp.rs into dataframe.rs and sql_query.rs #13938

Closed as not planned

Description

@alamb

Is your feature request related to a problem or challenge?

The large number of small examples in DataFusion leads to multiple problems:

  • Makes it harder to find the relevant examples
  • Unnecessarily large amounts of disk space on a full build (each example binary takes 100+ MB)
  • Larger cargo t time (each binary must be linked / created)

Thus I think the fewer examples we have the

  1. easier it will be to find the relevant examples
  2. faster our dev experience will be

Describe the solution you'd like

I would like to consolidate the common SQL based examples and common dataframe based query examples

Then update the readme page:

Describe alternatives you've considered

No response

Additional context

I think this is a good first issue as the task is straightforward and doesn't require deep understanding of the DataFusion codebase

Activity

  1. self-assigned this
    on Dec 29, 2024
  2. alamb commented on Dec 29, 2024

    @alamb
    ContributorAuthor

    I would like to do this one myself and then I will file tickets for the other similar examples that I think others could work on in parallel

  3. alamb commented on Dec 29, 2024

    @alamb
    ContributorAuthor

    After studying regexp.rs I think the content actually should go into the docs for the various regexp functions rather than the examples. 🤔

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions