Repository navigation
Internal error: The "regex_replace" function can only accept strings #7345
Description
Describe the bug
On running the query below on the Clickbench multi file dataset,
SELECT REGEXP_REPLACE("Referer", '^https?://(?:www.)?([^/]+)/.*$', '1') AS k, AVG(length("Referer")) AS l, COUNT(*) AS c, MIN("Referer") FROM hits WHERE "Referer" <> '' GROUP BY k HAVING COUNT(*) > 100000 ORDER BY l DESC LIMIT 25;we get this error,
Internal error: The "regex_replace" function can only accept strings.. This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue trackerTo Reproduce
Download the data using,
./benchmarks/bench.sh data clickbench_partitionedA hits_multi directory with the parquet files will be created.
Execute the above queries,
datafusion-cli -c "CREATE EXTERNAL TABLE hits STORED AS PARQUET LOCATION 'hits_multi';" "{query}"Expected behavior
The queries should run successfully without erroring.
Additional context
Datafusion 29.0.0
Activity
alamb commentedon Aug 21, 2023
This looks similar to #7039 which @jonahgao fixed by adding a coercion from binary --> UTF8 for comparison. I think we could do something similar here.
alamb commentedon Aug 21, 2023
Marking as a good first issue as there is a reproducer and I think the fix should be relatively straightforward
Weijun-H commentedon Aug 22, 2023
I am glad to fix it.