RAP Data

This demonstrates how to use data from the Rapid Refresh (RAP) model. This is perhaps the messiest dataset Herbie tries to look for (lots of sources, different file naming conventions, lots of different products).

from herbie import Herbie
from toolbox import EasyMap, pc
from paint.standard2 import cm_tmp
import pandas as pd

import matplotlib.pyplot as plt
import cartopy.crs as ccrs

H = Herbie("2021-11-19", model="rap", product="awp130pgrb")

✅ Found ┊ model=rap ┊ product=awp130pgrb ┊ 2021-Nov-19 00:00 UTC F00 ┊ GRIB2 @ aws ┊ IDX @ aws

H.PRODUCTS

{'awp130pgrb': 'CONUS Pressure levels; 13-km resolution',
 'awp252pgrb': 'CONUS Pressure levels; 20-km resolution',
 'awp236pgrb': 'CONUS Pressure levels; 40-km resolution',
 'awp130bgrb': 'CONUS Native levels; 13-km resolution',
 'awp252bgrb': 'CONUS Native levels; 20-km resolution',
 'wrfprs': 'Full domain Pressure Levels; 13-km',
 'wrfnat': 'Full domain Native Levels; 13-km',
 'awip32': 'NOAMHI - High-Resolution North American Master Grid; 32-km resolution',
 'awp242': 'Alaska Quadruple Resolution Pressure levels; 11-km resolution',
 'awp200': 'Puerto Rico Pressure levels; 16-km resolution',
 'awp243': 'Eastern North America Pressure levels, 0.4 degree resolution',
 'wrfmsl': 'WRFMSL; 13-km resolution'}

H.SOURCES

{'aws': 'https://noaa-rap-pds.s3.amazonaws.com/rap.20211119/rap.t00z.awp130pgrbf00.grib2',
 'nomads': 'https://nomads.ncep.noaa.gov/pub/data/nccf/com/rap/prod/rap.20211119/rap.t00z.awp130pgrbf00.grib2',
 'google': 'https://storage.googleapis.com/rapid-refresh/rap.20211119/rap.t00z.awp130pgrbf00.grib2',
 'azure': 'https://noaarap.blob.core.windows.net/rap/rap.20211119/rap.t00z.awp130pgrbf00.grib2'}

ds = H.xarray("TMP:2 m above")
ds

<xarray.Dataset>
Dimensions:              (y: 337, x: 451)
Coordinates:
    time                 datetime64[ns] 2021-11-19
    step                 timedelta64[ns] 00:00:00
    heightAboveGround    float64 2.0
    latitude             (y, x) float64 ...
    longitude            (y, x) float64 ...
    valid_time           datetime64[ns] ...
Dimensions without coordinates: y, x
Data variables:
    t2m                  (y, x) float32 ...
    gribfile_projection  object None
Attributes:
    GRIB_edition:            2
    GRIB_centre:             kwbc
    GRIB_centreDescription:  US National Weather Service - NCEP
    GRIB_subCentre:          0
    Conventions:             CF-1.7
    institution:             US National Weather Service - NCEP
    model:                   rap
    product:                 awp130pgrb
    description:             Rapid Refresh (RAP) from NOMADS and Big Data Pro...
    remote_grib:             https://noaa-rap-pds.s3.amazonaws.com/rap.202111...
    local_grib:              C:\Users\blaylock\data\rap\20211119\subset_5aefe...
    searchString:            TMP:2 m above

xarray.Dataset

• Dimensions:
  • y: 337
  • x: 451
• Coordinates: (6)
  • time
    ()
    datetime64[ns]
    2021-11-19

    long_name :

    initial time of forecast

    standard_name :

    forecast_reference_time

    array('2021-11-19T00:00:00.000000000', dtype='datetime64[ns]')

  • step
    ()
    timedelta64[ns]
    00:00:00

    long_name :

    time since forecast_reference_time

    standard_name :

    forecast_period

    array(0, dtype='timedelta64[ns]')

  • heightAboveGround
    ()
    float64
    2.0

    long_name :

    height above the surface

    units :

    m

    positive :

    up

    standard_name :

    height

    array(2.)

  • latitude
    (y, x)
    float64
    ...

    units :

    degrees_north

    standard_name :

    latitude

    long_name :

    latitude

    [151987 values with dtype=float64]

  • longitude
    (y, x)
    float64
    ...

    units :

    degrees_east

    standard_name :

    longitude

    long_name :

    longitude

    [151987 values with dtype=float64]

  • valid_time
    ()
    datetime64[ns]
    ...

    standard_name :

    time

    long_name :

    time

    [1 values with dtype=datetime64[ns]]

• Data variables: (2)
  • t2m
    (y, x)
    float32
    ...

    GRIB_paramId :

    167

    GRIB_dataType :

    fc

    GRIB_numberOfPoints :

    151987

    GRIB_typeOfLevel :

    heightAboveGround

    GRIB_stepUnits :

    1

    GRIB_stepType :

    instant

    GRIB_gridType :

    lambert

    GRIB_DxInMetres :

    13545.0

    GRIB_DyInMetres :

    13545.0

    GRIB_LaDInDegrees :

    25.0

    GRIB_Latin1InDegrees :

    25.0

    GRIB_Latin2InDegrees :

    25.0

    GRIB_LoVInDegrees :

    265.0

    GRIB_NV :

    0

    GRIB_Nx :

    451

    GRIB_Ny :

    337

    GRIB_cfName :

    air_temperature

    GRIB_cfVarName :

    t2m

    GRIB_gridDefinitionDescription :

    Lambert Conformal can be secant or tangent, conical or bipolar

    GRIB_iScansNegatively :

    0

    GRIB_jPointsAreConsecutive :

    0

    GRIB_jScansPositively :

    1

    GRIB_latitudeOfFirstGridPointInDegrees :

    16.281

    GRIB_latitudeOfSouthernPoleInDegrees :

    0.0

    GRIB_longitudeOfFirstGridPointInDegrees :

    233.862

    GRIB_longitudeOfSouthernPoleInDegrees :

    0.0

    GRIB_missingValue :

    3.4028234663852886e+38

    GRIB_name :

    2 metre temperature

    GRIB_parameterName :

    Temperature

    GRIB_parameterUnits :

    K

    GRIB_shortName :

    2t

    GRIB_stepRange :

    0

    GRIB_units :

    K

    long_name :

    2 metre temperature

    units :

    K

    standard_name :

    air_temperature

    grid_mapping :

    gribfile_projection

    [151987 values with dtype=float32]

  • gribfile_projection
    ()
    object
    None

    crs_wkt :

    PROJCRS["unknown",BASEGEOGCRS["unknown",DATUM["unknown",ELLIPSOID["unknown",6371229,0,LENGTHUNIT["metre",1,ID["EPSG",9001]]]],PRIMEM["Greenwich",0,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8901]]],CONVERSION["unknown",METHOD["Lambert Conic Conformal (2SP)",ID["EPSG",9802]],PARAMETER["Latitude of false origin",25,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8821]],PARAMETER["Longitude of false origin",265,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8822]],PARAMETER["Latitude of 1st standard parallel",25,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8823]],PARAMETER["Latitude of 2nd standard parallel",25,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8824]],PARAMETER["Easting at false origin",0,LENGTHUNIT["metre",1],ID["EPSG",8826]],PARAMETER["Northing at false origin",0,LENGTHUNIT["metre",1],ID["EPSG",8827]]],CS[Cartesian,2],AXIS["(E)",east,ORDER[1],LENGTHUNIT["metre",1,ID["EPSG",9001]]],AXIS["(N)",north,ORDER[2],LENGTHUNIT["metre",1,ID["EPSG",9001]]]]

    semi_major_axis :

    6371229.0

    semi_minor_axis :

    6371229.0

    inverse_flattening :

    0.0

    reference_ellipsoid_name :

    unknown

    longitude_of_prime_meridian :

    0.0

    prime_meridian_name :

    Greenwich

    geographic_crs_name :

    unknown

    horizontal_datum_name :

    unknown

    projected_crs_name :

    unknown

    grid_mapping_name :

    lambert_conformal_conic

    standard_parallel :

    (25.0, 25.0)

    latitude_of_projection_origin :

    25.0

    longitude_of_central_meridian :

    265.0

    false_easting :

    0.0

    false_northing :

    0.0

    long_name :

    RAP model grid projection

    array(None, dtype=object)

• Indexes: (0)
• Attributes: (12)

  GRIB_edition :

  2

  GRIB_centre :

  kwbc

  GRIB_centreDescription :

  US National Weather Service - NCEP

  GRIB_subCentre :

  0

  Conventions :

  CF-1.7

  institution :

  US National Weather Service - NCEP

  model :

  rap

  product :

  awp130pgrb

  description :

  Rapid Refresh (RAP) from NOMADS and Big Data Program

  remote_grib :

  https://noaa-rap-pds.s3.amazonaws.com/rap.20211119/rap.t00z.awp130pgrbf00.grib2

  local_grib :

  C:\Users\blaylock\data\rap\20211119\subset_5aefe363__rap.t00z.awp130pgrbf00.grib2

  searchString :

  TMP:2 m above

ax = EasyMap(crs=ds.herbie.crs, figsize=[8, 8]).STATES().ax
p = ax.pcolormesh(
    ds.longitude, ds.latitude, ds.t2m, transform=pc, **cm_tmp(units="K").cmap_kwargs
)
plt.colorbar(
    p, ax=ax, orientation="horizontal", pad=0.05, **cm_tmp(units="K").cbar_kwargs
)

ax.set_title(ds.t2m.GRIB_name, loc="right")
ax.set_title(f"{ds.model.upper()}: {H.product_description}", loc="left")

Text(0.0, 1.0, 'RAP: CONUS Pressure levels; 13-km resolution')

RAP record on NCEI

H = Herbie("2019-11-23", model="rap_historical", product="analysis")

✅ Found ┊ model=rap_historical ┊ product=analysis ┊ 2019-Nov-23 00:00 UTC F00 ┊ GRIB2 @ rap_130 ┊ IDX @ rap_130

ds = H.xarray("TMP:2 m above")
ds

👨🏻‍🏭 Created directory: [C:\Users\blaylock\data\rap_historical\20191123]

C:\Users\blaylock\_GITHUB\Herbie\herbie\archive.py:1041: UserWarning: sorry, on windows I couldn't remove the file.
  warnings.warn("sorry, on windows I couldn't remove the file.")

<xarray.Dataset>
Dimensions:              (y: 337, x: 451)
Coordinates:
    time                 datetime64[ns] 2019-11-23
    step                 timedelta64[ns] 00:00:00
    heightAboveGround    float64 2.0
    latitude             (y, x) float64 16.28 16.31 16.34 ... 55.54 55.51 55.48
    longitude            (y, x) float64 233.9 234.0 234.1 ... 302.3 302.4 302.6
    valid_time           datetime64[ns] 2019-11-23
Dimensions without coordinates: y, x
Data variables:
    t2m                  (y, x) float32 298.3 298.4 298.5 ... 274.3 274.3 274.4
    gribfile_projection  object None
Attributes:
    GRIB_edition:            2
    GRIB_centre:             kwbc
    GRIB_centreDescription:  US National Weather Service - NCEP
    GRIB_subCentre:          0
    Conventions:             CF-1.7
    institution:             US National Weather Service - NCEP
    model:                   rap_historical
    product:                 analysis
    description:             Rapid Refresh - NCEI Historical
    remote_grib:             https://www.ncei.noaa.gov/data/rapid-refresh/acc...
    local_grib:              C:\Users\blaylock\data\rap_historical\20191123\s...
    searchString:            TMP:2 m above

xarray.Dataset

• Dimensions:
  • y: 337
  • x: 451
• Coordinates: (6)
  • time
    ()
    datetime64[ns]
    2019-11-23

    long_name :

    initial time of forecast

    standard_name :

    forecast_reference_time

    array('2019-11-23T00:00:00.000000000', dtype='datetime64[ns]')

  • step
    ()
    timedelta64[ns]
    00:00:00

    long_name :

    time since forecast_reference_time

    standard_name :

    forecast_period

    array(0, dtype='timedelta64[ns]')

  • heightAboveGround
    ()
    float64
    2.0

    long_name :

    height above the surface

    units :

    m

    positive :

    up

    standard_name :

    height

    array(2.)

  • latitude
    (y, x)
    float64
    16.28 16.31 16.34 ... 55.51 55.48

    units :

    degrees_north

    standard_name :

    latitude

    long_name :

    latitude

    array([[16.281     , 16.30836614, 16.33562845, ..., 17.38598091,
            17.363161  , 17.34023363],
           [16.39828505, 16.42568412, 16.45297923, ..., 17.50458529,
            17.48173835, 17.45878381],
           [16.51559943, 16.54303139, 16.57035924, ..., 17.62321703,
            17.60034309, 17.57736144],
           ...,
           [53.97394127, 54.00790887, 54.04173934, ..., 55.33884573,
            55.31079595, 55.2826082 ],
           [54.07324369, 54.10721488, 54.14104889, ..., 55.43826705,
            55.41021535, 55.38202566],
           [54.17241813, 54.20639281, 54.24023027, ..., 55.53755643,
            55.5095029 , 55.48131134]])

  • longitude
    (y, x)
    float64
    233.9 234.0 234.1 ... 302.4 302.6

    units :

    degrees_east

    standard_name :

    longitude

    long_name :

    longitude

    array([[233.862     , 233.98419514, 234.1064416 , ..., 290.71357615,
            290.83782217, 290.96202426],
           [233.83341078, 233.95571014, 234.07806096, ..., 290.73745411,
            290.86180986, 290.98612158],
           [233.80476994, 233.9271737 , 234.04962904, ..., 290.76137592,
            290.8858416 , 291.01026312],
           ...,
           [220.2599064 , 220.42892476, 220.59808701, ..., 302.16983749,
            302.34470507, 302.51944524],
           [220.20196465, 220.37116928, 220.54051831, ..., 302.21910048,
            302.3941759 , 302.56912343],
           [220.14387816, 220.31326939, 220.48280555, ..., 302.26849092,
            302.44377462, 302.61892995]])

  • valid_time
    ()
    datetime64[ns]
    2019-11-23

    standard_name :

    time

    long_name :

    time

    array('2019-11-23T00:00:00.000000000', dtype='datetime64[ns]')

• Data variables: (2)
  • t2m
    (y, x)
    float32
    298.3 298.4 298.5 ... 274.3 274.4

    GRIB_paramId :

    167

    GRIB_dataType :

    fc

    GRIB_numberOfPoints :

    151987

    GRIB_typeOfLevel :

    heightAboveGround

    GRIB_stepUnits :

    1

    GRIB_stepType :

    instant

    GRIB_gridType :

    lambert

    GRIB_DxInMetres :

    13545.0

    GRIB_DyInMetres :

    13545.0

    GRIB_LaDInDegrees :

    25.0

    GRIB_Latin1InDegrees :

    25.0

    GRIB_Latin2InDegrees :

    25.0

    GRIB_LoVInDegrees :

    265.0

    GRIB_NV :

    0

    GRIB_Nx :

    451

    GRIB_Ny :

    337

    GRIB_cfName :

    air_temperature

    GRIB_cfVarName :

    t2m

    GRIB_gridDefinitionDescription :

    Lambert Conformal can be secant or tangent, conical or bipolar

    GRIB_iScansNegatively :

    0

    GRIB_jPointsAreConsecutive :

    0

    GRIB_jScansPositively :

    1

    GRIB_latitudeOfFirstGridPointInDegrees :

    16.281

    GRIB_latitudeOfSouthernPoleInDegrees :

    0.0

    GRIB_longitudeOfFirstGridPointInDegrees :

    233.862

    GRIB_longitudeOfSouthernPoleInDegrees :

    0.0

    GRIB_missingValue :

    3.4028234663852886e+38

    GRIB_name :

    2 metre temperature

    GRIB_parameterName :

    Temperature

    GRIB_parameterUnits :

    K

    GRIB_shortName :

    2t

    GRIB_stepRange :

    0

    GRIB_units :

    K

    long_name :

    2 metre temperature

    units :

    K

    standard_name :

    air_temperature

    grid_mapping :

    gribfile_projection

    array([[298.2679, 298.3929, 298.5179, ..., 301.5179, 301.4554, 301.3929],
           [298.2054, 298.3304, 298.3304, ..., 301.5179, 301.3929, 301.3304],
           [298.0804, 298.0804, 298.0179, ..., 301.6429, 301.4554, 301.2679],
           ...,
           [283.5804, 283.5804, 283.5804, ..., 274.2054, 274.2679, 274.3304],
           [283.5179, 283.5804, 283.5804, ..., 274.2054, 274.3304, 274.3929],
           [283.5179, 283.5179, 283.5179, ..., 274.2679, 274.3304, 274.3929]],
          dtype=float32)

  • gribfile_projection
    ()
    object
    None

    crs_wkt :

    PROJCRS["unknown",BASEGEOGCRS["unknown",DATUM["unknown",ELLIPSOID["unknown",6371229,0,LENGTHUNIT["metre",1,ID["EPSG",9001]]]],PRIMEM["Greenwich",0,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8901]]],CONVERSION["unknown",METHOD["Lambert Conic Conformal (2SP)",ID["EPSG",9802]],PARAMETER["Latitude of false origin",25,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8821]],PARAMETER["Longitude of false origin",265,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8822]],PARAMETER["Latitude of 1st standard parallel",25,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8823]],PARAMETER["Latitude of 2nd standard parallel",25,ANGLEUNIT["degree",0.0174532925199433],ID["EPSG",8824]],PARAMETER["Easting at false origin",0,LENGTHUNIT["metre",1],ID["EPSG",8826]],PARAMETER["Northing at false origin",0,LENGTHUNIT["metre",1],ID["EPSG",8827]]],CS[Cartesian,2],AXIS["(E)",east,ORDER[1],LENGTHUNIT["metre",1,ID["EPSG",9001]]],AXIS["(N)",north,ORDER[2],LENGTHUNIT["metre",1,ID["EPSG",9001]]]]

    semi_major_axis :

    6371229.0

    semi_minor_axis :

    6371229.0

    inverse_flattening :

    0.0

    reference_ellipsoid_name :

    unknown

    longitude_of_prime_meridian :

    0.0

    prime_meridian_name :

    Greenwich

    geographic_crs_name :

    unknown

    horizontal_datum_name :

    unknown

    projected_crs_name :

    unknown

    grid_mapping_name :

    lambert_conformal_conic

    standard_parallel :

    (25.0, 25.0)

    latitude_of_projection_origin :

    25.0

    longitude_of_central_meridian :

    265.0

    false_easting :

    0.0

    false_northing :

    0.0

    long_name :

    RAP_HISTORICAL model grid projection

    array(None, dtype=object)

• Indexes: (0)
• Attributes: (12)

  GRIB_edition :

  2

  GRIB_centre :

  kwbc

  GRIB_centreDescription :

  US National Weather Service - NCEP

  GRIB_subCentre :

  0

  Conventions :

  CF-1.7

  institution :

  US National Weather Service - NCEP

  model :

  rap_historical

  product :

  analysis

  description :

  Rapid Refresh - NCEI Historical

  remote_grib :

  https://www.ncei.noaa.gov/data/rapid-refresh/access/historical/analysis/201911/20191123/rap_130_20191123_0000_000.grb2

  local_grib :

  C:\Users\blaylock\data\rap_historical\20191123\subset_82efe363__rap_130_20191123_0000_000.grb2

  searchString :

  TMP:2 m above

ax = EasyMap(crs=ds.herbie.crs, figsize=[8, 8]).ax
p = ax.pcolormesh(
    ds.longitude, ds.latitude, ds.t2m, transform=pc, **cm_tmp(units="K").cmap_kwargs
)
plt.colorbar(
    p, ax=ax, orientation="horizontal", pad=0.05, **cm_tmp(units="K").cbar_kwargs
)

ax.set_title(ds.t2m.GRIB_name, loc="right")
ax.set_title(f"{ds.model.upper()}: {H.product_description}", loc="left")

Text(0.0, 1.0, 'RAP_HISTORICAL: RAP')