Greetings all,
This past February Radio Occultation data from UCAR's COSMIC program was
added to the IDD. This data was provided by Spire Global as part of the
NOAA Commercial Data Program Delivery Order 5 (DO5).
That above project has run its course, and the data from Spire Global has
ceased. Through a new partnership with PlanetIQ <https://planetiq.com/>,
COSMIC has resumed processing and sharing this data, which is available on
the IDD now; data is on the EXP feed with a typical volume of 80-110MB per
hour. Data formats and sizes should be about the same as the previous data
set, however the product IDs have changed slightly. Below is a statement
from COSMIC providing additional details on the new delivery order and the
data, complete with LDM patterns and examples.
The NOAA Commercial Data Program
<https://www.space.commerce.gov/business-with-noaa/commercial-weather-data-pilot-cwdp/>
Radio Occultation Data Buy 2 (RODB-2) Delivery Order 2 (DO2) implements
unrestricted data rights for the radio occultation data processed by UCAR
<https://www.ucar.edu/> COSMIC <https://cosmic.ucar.edu/>’s CDAAC
<https://www.cosmic.ucar.edu/what-we-do/data-processing-center> in near
real time, with the goal of making data products available to a wider
audience. For DO2 PlanetIQ <https://planetiq.com/> provides observation
data from its satellite constellation for processing into higher level
neutral atmosphere (up to 3100 profiles/day) and ionosphere products (total
electron content). The RODB-2 DO2 data
<https://data.cosmic.ucar.edu/gnss-ro/planetiq/noaa/> are made available on
a next day basis at CDAAC and will additionally be distributed via Unidata
<https://www.unidata.ucar.edu/>’s Internet Data Distribution (IDD)
<https://www.unidata.ucar.edu/projects/index.html#idd> service in near-real
time. The available IDD products are:
1) Atmospheric profile without moisture information (atmPrf)
Full resolution profiles of physical parameters including bending angle,
refractivity, dry pressure, dry temperature, impact parameter, etc. versus
geometric height above mean sea level. Reference:
https://cdaac-www.cosmic.ucar.edu/cdaac/cgi_bin/fileFormats.cgi?type=atmPrf.
2) Atmospheric occultation profile with moisture information included
(wetPf2)
Atmospheric occultation profile with moisture information included. A
gridded analysis or short-term forecast is used to separate the pressure,
temperature and moisture contributions to refractivity. This file is
interpolated to 100 meter height levels. References:
https://cdaac-www.cosmic.ucar.edu/cdaac/cgi_bin/fileFormats.cgi?type=wetPf2
and https://doi.org/10.3390/rs14215614.
3) WMO BUFR (bfrPrf)
A low resolution (200 meter) atmospheric profile in the BUFR format.
Contains data taken from the atmPhs, atmPrf and wetPrf files, including:
header information, occultation location and time; bending angle versus
impact parameter profiles; refractivity versus mean sea level geometric
height; pressure, temperature, and moisture versus geopotential height
profiles. References:
https://cdaac-www.cosmic.ucar.edu/cdaac/cgi_bin/fileFormats.cgi?type=bfrPrf
and https://preop.romsaf.org/romsaf_bufr.pdf.
4) Absolute total electron content (podTec)
Absolute total electron content (TEC) and auxiliary data in netCDF format.
Each file contains a TEC track data from one receiver-transmitter satellite
pair. Reference:
https://cdaac-www.cosmic.ucar.edu/cdaac/cgi_bin/fileFormats.cgi?type=podTec
5) Electron density profiles (ionPrf)
An ionospheric data profile for a single occultation in netCDF format.
Reference:
https://cdaac-www.cosmic.ucar.edu/cdaac/cgi_bin/fileFormats.cgi?type=ionPrf
Details for accessing this data on the IDD
These products will be added to the IDD EXP feed, with a typical data
volume of 80-110MB per hour. You will need to configure your LDM to
receive these products; sample Product IDs, REQUEST lines and PQACT entries
are below:
1) atmPrf
Example LDM/IDD Product ID:
gnomesbrt/level2/atmPrf/2023.213/atmPrf_GN03.2023.213.14.54.E12_0001.0001_nc
Example LDM Configuration file REQUEST line:
REQUEST EXP “gnomesbrt/level2/atmPrf” upstream_IDD_relay
Example LDM pattern-action file action:
EXP gnomesbrt/level2/atmPrf/([0-9]{4}).([0-9]{3})/(atmPrf.*_nc)
FILE -close -overwrite
/data/ldm/pub/native/COSMIC/gnomesbrt/atmPfr/\3
2) wetPf2
Example LDM/IDD Product ID:
gnomesbrt/level2/wetPf2/2023.213/wetPf2_GN03.2023.213.14.55.E33_0001.0001_nc
Example LDM Configuration file REQUEST line:
REQUEST EXP “gnomesbrt/level2/wetPf2” upstream_IDD_relay
Example LDM pattern-action file action:
EXP gnomesbrt/level2/wetPf2/([0-9]{4}).([0-9]{3})/(wetPf2.*_nc)
FILE -close -overwrite
/data/ldm/pub/native/COSMIC/gnomesbrt/wetPf2/\3
3) bfrPrf
Example LDM/IDD Product ID:
gnomesbrt/level2/bfrPrf/2023.213/bfrPrf_GN02.2023.213.15.45.C26_0001.0001_bufr
Example LDM Configuration file REQUEST line:
REQUEST EXP “gnomesbrt/level2/bfrPrf” upstream_IDD_relay
Example LDM pattern-action file action:
EXP gnomesbrt/level2/bfrPrf/([0-9]{4}).([0-9]{3})/(bfrPrf.*_bufr)
FILE -close -overwrite
/data/ldm/pub/native/COSMIC/gnomesbrt/bfrPrf/\3
4) podTec
Example LDM/IDD Product ID:
gnomesbrt/level1b/podTec/2023.213/podTec_GN03.2023.213.14.55.0009.C45.01_0001.0001_nc
Example LDM Configuration file REQUEST line:
REQUEST EXP “gnomesbrt/level1b/podTec” upstream_IDD_relay
Example LDM pattern-action file action:
EXP gnomesbrt/level1b/podTec/([0-9]{4}).([0-9]{3})/(podTec.*_nc)
FILE -close -overwrite
/data/ldm/pub/native/COSMIC/gnomesbrt/podTec/\3
5) ionPrf
Example LDM/IDD Product ID:
gnomesbrt/level2/ionPrf/2023.214/ionPrf_GN02.2023.214.20.39.G03_0001.0001_nc
Example LDM Configuration file REQUEST line:
REQUEST EXP “gnomesbrt/level2/ionPrf” upstream_IDD_relay
Example LDM pattern-action file action:
EXP gnomesbrt/level2/ionPrf/([0-9]{4}).([0-9]{3})/(ionPrf.*_nc)
FILE -close -overwrite
/data/ldm/pub/native/COSMIC/gnomesbrt/ionPrf/\3
6) All available data
If you would like to request all products on one REQUEST line:
REQUEST EXP “gnomesbrt” upstream_IDD_relay
If you need assistance in configuring your LDM, or have other
questions/comments regarding the LDM or IDD, please contact
support-idd@xxxxxxxxxxxxxxxx.
For additional information regarding the data, please contact COSMIC at
cosmicops@xxxxxxxx.
Best,
-Mike
*Mike Zuranski*
Data Engineer II
Unidata Program Center
University Corporation for Atmospheric Research
