RRFS Data

The Rapid Refresh Forecast System (RRFS) is undergoing rapid development. There are prototype products available on the cloud on AWS. Some files have an index file, others do not.

from herbie import Herbie
from toolbox import EasyMap, pc
from paint.standard2 import cm_tmp

import matplotlib.pyplot as plt
import cartopy.crs as ccrs

H = Herbie("2021-07-23", model="rrfs", fxx=1, member=1)

✅ Found ┊ model=rrfs ┊ product=mean ┊ 2021-Jul-23 00:00 UTC F01 ┊ GRIB2 @ aws ┊ IDX @ aws

H.SOURCES

{'aws': 'https://noaa-rrfs-pds.s3.amazonaws.com/rrfs.20210723/00/ensprod/rrfsce.t00z.conus.mean.f01.grib2',
 'aws-mem': 'https://noaa-rrfs-pds.s3.amazonaws.com/rrfs.20210723/00/mem01/rrfs.t00z.mem01.meanf001.grib2'}

H.PRODUCTS

{'mean': 'ensemble mean',
 'avrg': 'ensemble products: ???',
 'eas': 'ensemble products: ???',
 'ffri': 'ensemble products: ???',
 'lpmm': 'ensemble products: ???',
 'pmmn': 'ensemble products: ???',
 'prob': 'ensemble products: ???',
 'testbed.conus': 'surface grids (one for each member)',
 'na': 'native grids (one for each member)'}

ds = H.xarray("TMP:2 m")

👨🏻‍🏭 Created directory: [C:\Users\blaylock\data\rrfs\20210723\mem01]

C:\Users\blaylock\_GITHUB\Herbie\herbie\archive.py:1041: UserWarning: sorry, on windows I couldn't remove the file.
  warnings.warn("sorry, on windows I couldn't remove the file.")

ds

<xarray.Dataset>
Dimensions:              (y: 1059, x: 1799)
Coordinates:
    time                 datetime64[ns] 2021-07-23
    step                 timedelta64[ns] 01:00:00
    heightAboveGround    float64 2.0
    latitude             (y, x) float64 21.14 21.14 21.15 ... 47.86 47.85 47.84
    longitude            (y, x) float64 237.3 237.3 237.3 ... 299.0 299.0 299.1
    valid_time           datetime64[ns] 2021-07-23T01:00:00
Dimensions without coordinates: y, x
Data variables:
    t2m                  (y, x) float32 295.3 295.3 295.3 ... 287.7 287.8 287.8
    gribfile_projection  object None
Attributes:
    GRIB_edition:            2
    GRIB_centre:             kwbc
    GRIB_centreDescription:  US National Weather Service - NCEP
    GRIB_subCentre:          2
    Conventions:             CF-1.7
    institution:             US National Weather Service - NCEP
    model:                   rrfs
    product:                 mean
    description:             Rapid Refresh Forecast System (RRFS) Ensemble
    remote_grib:             https://noaa-rrfs-pds.s3.amazonaws.com/rrfs.2021...
    local_grib:              C:\Users\blaylock\data\rrfs\20210723\mem01\subse...
    searchString:            TMP:2 m

xarray.Dataset

• Dimensions:
  • y: 1059
  • x: 1799
• Coordinates: (6)
  • time
    ()
    datetime64[ns]
    2021-07-23

    long_name :

    initial time of forecast

    standard_name :

    forecast_reference_time

    array('2021-07-23T00:00:00.000000000', dtype='datetime64[ns]')

  • step
    ()
    timedelta64[ns]
    01:00:00

    long_name :

    time since forecast_reference_time

    standard_name :

    forecast_period

    array(3600000000000, dtype='timedelta64[ns]')

  • heightAboveGround
    ()
    float64
    2.0

    long_name :

    height above the surface

    units :

    m

    positive :

    up

    standard_name :

    height

    array(2.)

  • latitude
    (y, x)
    float64
    21.14 21.14 21.15 ... 47.85 47.84

    units :

    degrees_north

    standard_name :

    latitude

    long_name :

    latitude

    array([[21.138     , 21.14498716, 21.15196735, ..., 21.15463298,
            21.14765546, 21.14067096],
           [21.16287153, 21.16986157, 21.17684464, ..., 21.17951136,
            21.17253096, 21.16554359],
           [21.18774553, 21.19473844, 21.20172438, ..., 21.20439221,
            21.19740893, 21.19041869],
           ...,
           [47.78937778, 47.79966771, 47.80994756, ..., 47.81387334,
            47.80359733, 47.79331126],
           [47.81391163, 47.82420486, 47.83448802, ..., 47.83841506,
            47.82813575, 47.81784637],
           [47.83844191, 47.84873845, 47.85902491, ..., 47.86295322,
            47.8526706 , 47.84237791]])

  • longitude
    (y, x)
    float64
    237.3 237.3 237.3 ... 299.0 299.1

    units :

    degrees_east

    standard_name :

    longitude

    long_name :

    longitude

    array([[237.28      , 237.3066666 , 237.33333755, ..., 287.65646903,
            287.68314163, 287.7098099 ],
           [237.27250288, 237.29917661, 237.32585467, ..., 287.66394919,
            287.69062891, 287.71730429],
           [237.26500142, 237.29168227, 237.31836746, ..., 287.67143368,
            287.69812053, 287.72480303],
           ...,
           [225.93454382, 225.97106897, 226.00760628, ..., 298.97842782,
            299.01496977, 299.05149957],
           [225.91921463, 225.95575173, 225.99230099, ..., 298.99372853,
            299.03028244, 299.06682419],
           [225.90387326, 225.94042231, 225.97698355, ..., 299.00904139,
            299.04560728, 299.08216099]])

  • valid_time
    ()
    datetime64[ns]
    2021-07-23T01:00:00

    standard_name :

    time

    long_name :

    time

    array('2021-07-23T01:00:00.000000000', dtype='datetime64[ns]')

• Data variables: (2)
  • t2m
    (y, x)
    float32
    295.3 295.3 295.3 ... 287.8 287.8

    GRIB_paramId :

    167

    GRIB_dataType :

    fc

    GRIB_numberOfPoints :

    1905141

    GRIB_typeOfLevel :

    heightAboveGround

    GRIB_stepUnits :

    1

    GRIB_stepType :

    instant

    GRIB_gridType :

    lambert

    GRIB_DxInMetres :

    3000.0

    GRIB_DyInMetres :

    3000.0

    GRIB_LaDInDegrees :

    38.5

    GRIB_Latin1InDegrees :

    38.5

    GRIB_Latin2InDegrees :

    38.5

    GRIB_LoVInDegrees :

    262.5

    GRIB_NV :

    0

    GRIB_Nx :

    1799

    GRIB_Ny :

    1059

    GRIB_cfName :

    air_temperature

    GRIB_cfVarName :

    t2m

    GRIB_gridDefinitionDescription :

    Lambert Conformal can be secant or tangent, conical or bipolar

    GRIB_iScansNegatively :

    0

    GRIB_jPointsAreConsecutive :

    0

    GRIB_jScansPositively :

    1

    GRIB_latitudeOfFirstGridPointInDegrees :

    21.138

    GRIB_latitudeOfSouthernPoleInDegrees :

    -90.0

    GRIB_longitudeOfFirstGridPointInDegrees :

    237.28

    GRIB_longitudeOfSouthernPoleInDegrees :

    0.0

    GRIB_missingValue :

    3.4028234663852886e+38

    GRIB_name :

    2 metre temperature

    GRIB_parameterName :

    Temperature

    GRIB_parameterUnits :

    K

    GRIB_shortName :

    2t

    GRIB_stepRange :

    1

    GRIB_totalNumber :

    9

    GRIB_units :

    K

    long_name :

    2 metre temperature

    units :

    K

    standard_name :

    air_temperature

    grid_mapping :

    gribfile_projection

    array([[295.3 , 295.3 , 295.31, ..., 301.  , 300.99, 300.99],
           [295.28, 295.28, 295.28, ..., 301.  , 300.99, 300.99],
           [295.25, 295.25, 295.25, ..., 301.  , 301.  , 300.99],
           ...,
           [287.51, 287.51, 287.52, ..., 287.7 , 287.75, 287.78],
           [287.5 , 287.51, 287.51, ..., 287.72, 287.77, 287.81],
           [287.5 , 287.51, 287.51, ..., 287.74, 287.78, 287.82]],
          dtype=float32)

  • gribfile_projection
    ()
    object
    None

    crs_wkt :

    PROJCRS["unknown",BASEGEOGCRS["unknown",DATUM["unknown",ELLIPSOID["unknown",6371229,0,LENGTHUNIT["metre",1,ID["EPSG",9001]]]],PRIMEM["Greenwich",0,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8901]]],CONVERSION["unknown",METHOD["Lambert Conic Conformal (2SP)",ID["EPSG",9802]],PARAMETER["Latitude of false origin",38.5,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8821]],PARAMETER["Longitude of false origin",262.5,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8822]],PARAMETER["Latitude of 1st standard parallel",38.5,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8823]],PARAMETER["Latitude of 2nd standard parallel",38.5,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8824]],PARAMETER["Easting at false origin",0,LENGTHUNIT["metre",1],ID["EPSG",8826]],PARAMETER["Northing at false origin",0,LENGTHUNIT["metre",1],ID["EPSG",8827]]],CS[Cartesian,2],AXIS["(E)",east,ORDER[1],LENGTHUNIT["metre",1,ID["EPSG",9001]]],AXIS["(N)",north,ORDER[2],LENGTHUNIT["metre",1,ID["EPSG",9001]]]]

    semi_major_axis :

    6371229.0

    semi_minor_axis :

    6371229.0

    inverse_flattening :

    0.0

    reference_ellipsoid_name :

    unknown

    longitude_of_prime_meridian :

    0.0

    prime_meridian_name :

    Greenwich

    geographic_crs_name :

    unknown

    horizontal_datum_name :

    unknown

    projected_crs_name :

    unknown

    grid_mapping_name :

    lambert_conformal_conic

    standard_parallel :

    (38.5, 38.5)

    latitude_of_projection_origin :

    38.5

    longitude_of_central_meridian :

    262.5

    false_easting :

    0.0

    false_northing :

    0.0

    long_name :

    RRFS model grid projection

    array(None, dtype=object)

• Indexes: (0)
• Attributes: (12)

  GRIB_edition :

  2

  GRIB_centre :

  kwbc

  GRIB_centreDescription :

  US National Weather Service - NCEP

  GRIB_subCentre :

  2

  Conventions :

  CF-1.7

  institution :

  US National Weather Service - NCEP

  model :

  rrfs

  product :

  mean

  description :

  Rapid Refresh Forecast System (RRFS) Ensemble

  remote_grib :

  https://noaa-rrfs-pds.s3.amazonaws.com/rrfs.20210723/00/ensprod/rrfsce.t00z.conus.mean.f01.grib2

  local_grib :

  C:\Users\blaylock\data\rrfs\20210723\mem01\subset_3ce4cf9d__rrfsce.t00z.conus.mean.f01.grib2

  searchString :

  TMP:2 m

ax = EasyMap(crs=ds.herbie.crs, figsize=[10, 8]).ax
p = ax.pcolormesh(
    ds.longitude, ds.latitude, ds.t2m, transform=pc, **cm_tmp(units="K").cmap_kwargs
)
plt.colorbar(
    p, ax=ax, orientation="horizontal", pad=0.05, **cm_tmp(units="K").cbar_kwargs
)

ax.set_title(ds.t2m.GRIB_name, loc="right")
ax.set_title(f"{H.model.upper()}: {H.product_description}", loc="left")

Text(0.0, 1.0, 'RRFS: ensemble mean')

Missing index files

We have to download the full file.

H = Herbie(
    "2021-07-23", model="rrfs", product="testbed.conus", member=1, priority="aws-mem"
)

✅ Found ┊ model=rrfs ┊ product=testbed.conus ┊ 2021-Jul-23 00:00 UTC F00 ┊ GRIB2 @ aws-mem ┊ IDX @ aws-mem

# no index file available. Have to download the full file.
H.download()

✅ Success! Downloaded RRFS from aws-mem             
        src: https://noaa-rrfs-pds.s3.amazonaws.com/rrfs.20210723/00/mem01/rrfs.t00z.mem01.testbed.conusf000.grib2
        dst: /p/cwfs/blaylock/data/rrfs/20210723/mem01/rrfsce.t00z.conus.testbed.conus.f00.grib2

import xarray

# Since we have the full file, we need to filter by keys to open the
# variable we want with cfgrib
x = xarray.open_dataset(
    H.get_localFilePath(),
    engine="cfgrib",
    backend_kwargs={
        "filter_by_keys": {"shortName": "2t", "typeOfLevel": "heightAboveGround"}
    },
)

ax = EasyMap(crs=x.herbie.crs, figsize=[8, 8]).ax
p = ax.pcolormesh(
    x.longitude, x.latitude, x.t2m, transform=pc, **cm_tmp(units="K").cmap_kwargs
)
plt.colorbar(
    p, ax=ax, orientation="horizontal", pad=0.05, **cm_tmp(units="K").cbar_kwargs
)

ax.set_title(x.t2m.GRIB_name, loc="right")
ax.set_title(f"{H.model.upper()}: member {H.member}", loc="left")

Text(0.0, 1.0, 'RRFS: member 1')

Grid Mapping

Herbie attempts to parse the CF grid mapping from the GRIB data if it is available. This can be parsed by metpy.

import metpy

crs_info = x.metpy.parse_cf().metpy_crs.item()
crs_info.to_cartopy()

<cartopy.crs.LambertConformal object at 0x2ab37c61ccc0>

crs_info.to_pyproj()

<Projected CRS: {"$schema": "https://proj.org/schemas/v0.2/projjso ...>
Name: undefined
Axis Info [cartesian]:
- E[east]: Easting (metre)
- N[north]: Northing (metre)
Area of Use:
- undefined
Coordinate Operation:
- name: unknown
- method: Lambert Conic Conformal (2SP)
Datum: World Geodetic System 1984
- Ellipsoid: WGS 84
- Prime Meridian: Greenwich