You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
numba threadpool under dask results in thread oversubscription #1798
When a numba kernel with parallel=True is called from a dask worker thread, numba starts its own thread pool inside dask's. What happens next depends on numba's threading layer. Under workqueue the whole process aborts ("Concurrent access has been detected"); running a percentile over a chunked neighborhood reduction on dask's threaded scheduler reproduces it today. Under omp it doesn't crash, but every calling thread gets a full thread team, so a 12-thread pool grows to 179 OS threads. Only tbb handles it cleanly, and users get whichever layer happens to be installed.
changed the title [-]numba threadpool under dask results in a thread bomb[/-][+]numba threadpool under dask results in thread oversubscription[/+]on Sep 29, 2026
Activity
uxarray/core#1789[-]numba threadpool under dask results in a thread bomb[/-][+]numba threadpool under dask results in thread oversubscription[/+]uncomment dask calculus tests (#1798 was fixed)
Support Calculus with 2D+ arrays (#1823)