Repository navigation
Speedup statistics_from_parquet_metadata (DataFusion side) #20005
Description
Is your feature request related to a problem or challenge?
Collecting metadata / statistics is quite slow in DataFusion.
statistics_from_parquet_metadata takes about 80% of the "loading" time in different queries and can take 10s of ms (and runs currently on a single thread.
Describe the solution you'd like
We can add some fast paths / optimizations.
Describe alternatives you've considered
No response
Additional context
No response
Activity
[-]Speedup statistics_from_parquet_metadata[/-][+]Speedup statistics_from_parquet_metadata (DataFusion side)[/+]Speedup statistics_from_parquet_metadata (#20004)
Speedup statistics_from_parquet_metadata (apache#20004)