How to ignore non-existing dims given in chunks?

Is there a way of over-specifying chunks upon opening a dataset without throwing an error?

Currently, giving chunk sizes along dimensions that are not present in the dataset fails with a ValueError:

da = xr.DataArray(np.arange(10), dims=("x", ), name="example_data")
da.to_dataset().to_netcdf("example.nc")
ds = xr.open_dataset("example.nc", chunks={"x": 5, "y": 1})

I don't think so. You can do chunks=5 which will chunk along all dimensions.

@willirath

@willirath if the problem is that you don't know the dimensions of the dataset until after you've opened it, you could always open first then chunk afterwards, I think the result is the same:

chunks = {'x': 5}

ds = xr.open_dataset("example.nc")

if 'y' in ds.dims:
    chunks['y'] = 1

ds = ds.chunk(chunks=chunks)

Navigation Menu

Repository navigation

How to ignore non-existing dims given in chunks? #3633

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

How to ignore non-existing dims given in chunks? #3633

Description

Activity

dcherian commented on Dec 17, 2019

TomNicholas commented on Dec 28, 2019

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions