β‘ What about Zarr?#
When it comes to subsetting large datasets, GRIB has some limitations. The Zarr data format, however, makes downloading small chunks of large, gridded dataset easy. Herbie does not download Zarr data, but it could in the future (pull request anyone?).
Unfortunately, weather data is not widely available in Zarr formatβexcept for at least one model.
HRRR-Zarr#
Select parts of the HRRR model archive are available in Zarr format in the s3://hrrrzarr
bucket on AWS developed by Taylor Gowan and managed by the MesoWest group at the University of Utah. If you are using large amounts of the HRRR dataset and need to do a lot of subsetting, you might find this dataset useful.
HRRR-Zarr Documentation by University of Utah - Mesowest
HRRR-Zarr Examples by Taylor Gowan
HRRR-Zarr AMS Short Course by Kevin Tyle
HRRR-Zarr Sandbox by Brian Blaylock