You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# with flox, this mean calculation should be straightforwardimportflox.xarray# required# ideally we would use the default method="cohorts" but that's not very optimal at the momentmean=ds.groupby("time.dayofyear").mean(method="map-reduce")
# A user would do ds.groupby('time.dayofyear') - mean# but this is what Xarray does under the hood, and it is clearer# about what's happening# The chunking to 1 *should* make this work better below, but wouldn't expect the average user to do it.anomaly=ds-mean.sel(dayofyear=ds.time.dt.dayofyear)
anomaly
Activity
mrocklin commentedon Apr 13, 2023
Do you happen to have something like this living in AWS?
dcherian commentedon Apr 13, 2023
https://registry.opendata.aws/ecmwf-era5/ But I can't tell what the zarr chunking is. I don't have access to a AWS cluster anymore...
dcherian commentedon Apr 13, 2023
I should also say, we can reduce complexity here by just working with a few variables, not all 19 or so.
mrocklin commentedon Apr 13, 2023
Do you want access to an AWS cluster? We've gotten pretty good at providing those ...