[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

New Release

hiya,

I am pleased to announce a new release of the netCDF decoders package
(decoders-4.0.0.tar.Z).

This release has so many changes that it warranted a change in the major
release number to 4.0.0

Summary:

- reference to perl's location changed /usr/local/bin/perl -> /usr/bin/perl
- perl decoders pqact entries argument yyyymm removed
- perl decoders have a new naming convention, ie Surface_METAR_yyyymmdd_hhmm.nc
- perl decoders have (-n old) flag for old naming convention, new is default
- perl decoders have -h flag for hourly files, daily files is default
- perl decoders manage log files to only keep 3 logs
- perl decoders station tables updated
- perl decoders bug fixes
- metar.cdl.new1 changed to added global attributes and to change some variable
  names to be more descriptive.
- removed java Grib decoder jars etc, it's has it own release package now
  called GRIBJava.tar.gz.  Look at the Decoders web page
- gribtonc cdl files gfs_211.cdl, eta_211.cdl, and ruc2_236.cdl updated
- prepended model, coverage, and resolution to netCDF file names
- attached is decoders.pqact that contains the ldm pqact decoder entries
- installation requires the shut down of the ldm and the removal of *.log and
  *.lst files otherwise netCDF files will not receive data for one day.

Decoders homepage:
http://www.unidata.ucar.edu/software/decoders/

Decoders downloads:
http://www.unidata.ucar.edu/downloads/decoders/index.jsp


Details:

Since many of the os's store the perl binaries in /usr/bin/, the location
of perl was changed perl from /usr/local/bin/perl to /usr/bin/perl. If your
system has different perl versions installed at the different locations, then
one should check that the netcdf-perl package is installed at /usr/bin/perl.
One method of checking would be to run a perl decoder from the command line,ie

% metar2nc metar.cdl data < <raw data file>

If the command line test fails, then one should install netcdf-perl on the
/usr/bin/perl installation. A temporary fix would be to change /usr/bin/perl
to /usr/local/bin/perl in the perl decoders.

The perl decoders pqact entries have the yyyymm argument removed because it
caused multiple decoders to run at the end of the month and possibly miss
data. The yyyymm inquires are now done inside the decoders.

The perl decoders have a new naming convention, ie
Surface_METAR_yyyymmdd_hhmm.nc, Surface_Buoy_yyyymmdd_hhmm.nc,
Surface_Synoptic_yyyymmdd_hhmm.nc and Upperair_yyyymmdd_hhmm.nc
Since some users would like to retain the old naming convention there is a flag
"-n old" to revert back to the old convention.

The perl decoders create files on a daily basis verses a hourly time period.
Since some users would like to have hourly files, a flag -h has been added
to write hourly files for the all perl decoders, the default is a daily file.

The perl decoders managed log files to only keep 3 logs. When installing the
decoders it is wise to shut down the ldm and then to delete all the log files
and the *.lst files.  If the the ldm is not shut down, it is possible to not
receive data in the netCDF files for one day.

The following station tables have been updated: sfmetar.tbl, snworld.tbl and
systns_upc.tbl. If users know the information about missing table entries,
sent the information to address@hidden and they will be added to the
tables and made available in the next release.

Bugs:

- fixed bug in syn2nc decoder that returned wind DIR greater than 900
- buoy2nc decoder now store multiple reports for same time period
- metar2nc decoder had regular expression fixes
- changed testdata.wmo to testdata.wmo.bak in make files
- metar.cdl.new1 was changed to added global attributes and change some
variable names to be more descriptive.

    :title = "METAR Data from NWS";
    :version = 2.3;
    :processor =  "metar2nc  version v1.2";
    :Conventions = "Unidata Observation Dataset v1.0";
    :standard_name_vocabulary = "CF-1.0";
    :description = "Metar Data from NWS distributed through the Unidata IDD
    realtime datastream. 1 day's worth of data";
    :time_coordinate = "time_observation";
    :cdm_datatype = "Station";
    :stationDimension = "station";
    :station_id = "station_id";
    :station_description = "station_description";
    :latitude_coordinate = "latitude";
    :longitude_coordinate = "longitude";
    :altitude_coordinate = "altitude";
    :geospatial_lat_max = "90.0";
    :geospatial_lat_min = "-90.0";
    :geospatial_lon_max = "360.0";
    :geospatial_lon_min = "0.0";
    :time_coverage_start = "xxxxxxxxxx";
    :time_coverage_end = "xxxxxxxxxx";
    :observationDimension = "recNum";

variable changes: lastChild, numChildren, parent_index, prevChild, and xfields

Thanks to all the users who sent in bug reports.

Removed java Grib decoder jars, it's has it own release package now
called GRIBJava.tar.gz.  Look at the Decoders web page

The cdl files gfs_211.cdl, eta_211.cdl, and ruc2_236.cdl were updated to add
new parmeters and levels.

The gribtonc netCDF file names have been changed to be more descriptive by
prepending the model, coverage, and resolution to the file. ie
NAM_CONUS_80km_yyyymmdd_hh00.nc
One can use the old pqact entries to retain the old naming convention.

As always send support questions to address@hidden

Robb...
===============================================================================
Robb Kambic                                Unidata Program Center
Software Engineer III                      Univ. Corp for Atmospheric Research
address@hidden             WWW: http://www.unidata.ucar.edu/
===============================================================================
#
# surface data in netCDF format
#
# metar decoder, creates NetCDF files formated Surface_METAR_yyyymmdd_hh00.nc
# All aviation reports including metar tests. old netcdf file format
DDS|IDS ^S(A....|P....|XUS8.) .... ([0-3][0-9])
        PIPE    decoders/metar2nc
        etc/metar.cdl
        data/pub/decoded/netcdf/surface/metarold
#
# metar decoder, creates NetCDF files with new CDL format on a daily basis
# formated data/decoded/yyyymmdd_metar.nc
DDS|IDS ^S(A....|P....|XUS8.) .... ([0-3][0-9])
        PIPE    decoders/metar2nc.new1
        etc/metar.cdl.new1
        data/pub/decoded/netcdf/surface/metar
#
# upper air perl decoder
DDS|IDS ^U[ABDEFGHIJKLMPQRSTXZ].... .... ([0-3][0-9])
        PIPE    decoders/ua2nc
        etc/raob.cdl
        data/pub/decoded/netcdf/upperair
#
# buoy reports in yymmddhh_buoy.nc decoded into NetCDF format
DDS|IDS ^S[NS].... .... ([0-3][0-9])
        PIPE    decoders/buoy2nc
        etc/buoy.cdl
        data/pub/decoded/netcdf/surface/buoy
#
# Synoptic reports in yymmddhh_syn.nc decoded into NetCDF format
DDS|IDS ^SM.... .... ([0-3][0-9])
        PIPE    decoders/syn2nc
        etc/syn.cdl
        data/pub/decoded/netcdf/surface/synoptic
#
# grid data in netCDF format
#
# GFS grid on Lambert conformal CONUS grid replacing avn-q
HRS     ^Y.Q... KWB. (..)(..).*/m(AVN|SSIAVN|GFS|SSIGFS)
        PIPE    decoders/gribtonc
        etc/gfs_211.cdl
        
data/pub/decoded/netcdf/grid/NCEP/GFS/CONUS_80km/GFS_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc
#
# GFS grid on thinned grids, interpolated to global 5.0 x 2.5 regular grid
HRS     ^H.[I-P]... KWB. (..)(..).*/m(AVN|SSIAVN|GFS|SSIGFS)
        PIPE    decoders/gribtonc
        -q "lin,dlat=2.5,dlon=5.0" etc/gfs_37-44.cdl
        
data/pub/decoded/netcdf/grid/NCEP/GFS/Global_5x2p5deg/GFS_Global_5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc
#
# ECMWF grid on global 2.5 x 2.5 degree grid
HRS     ^H.[A-L]... ECMF (..)(..)
        PIPE    decoders/gribtonc
        etc/ecmwf_1-12.cdl
        
data/pub/decoded/netcdf/grid/ECMWF/Global_2p5x2p5deg/ECMWF_Global_2p5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc
#
# ETA grid on Lambert conformal CONUS grid
HRS     ^Y.Q... KWB. (..)(..).*/m(ETA|NAM)
        PIPE    decoders/gribtonc
        etc/eta_211.cdl
        
data/pub/decoded/netcdf/grid/NCEP/NAM/CONUS_80km/NAM_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc
#
# GFS grid on global 5.0 x 5.0 degree grid
HRS     ^H.[EF]... KWB. (..)(..)
        PIPE    decoders/gribtonc
        etc/gfs_25-26.cdl
        
data/pub/decoded/netcdf/grid/NCEP/GFS/Global_5x5deg/GFS_Global_5x5deg_(\1:yyyy)(\1:mm)\1_\200.nc
#
# NGM grid on Lambert conformal CONUS grid
HRS     ^Y.Q... KWB. (..)(..).*/mNGM
        PIPE    decoders/gribtonc
        etc/ngm_211.cdl
        
data/pub/decoded/netcdf/grid/NCEP/NGM/CONUS_80km/NGM_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc
#
# NOW and PWAV grids on global 5.0 x 2.5 degree grids
HRS     ^H.[A-D]... .... (..)(..).*(/mNOW|/mPWAV)
        PIPE    decoders/gribtonc
        etc/ocean_21-24.cdl
        
data/pub/decoded/netcdf/grid/NCEP/OCEAN/Global_5x2p5deg/OCEAN_Global_5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc
#
# RUC grid on Lambert conformal CONUS grid
HRS     ^[YZ].Q... KWB. (..)(..).*/mRUC
        PIPE    decoders/gribtonc
        etc/ruc_211.cdl
        
data/pub/decoded/netcdf/grid/NCEP/RUC/CONUS_80km/RUC_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc
#
# RUC2 grid on Lambert conformal CONUS grid
HRS     ^Y.W... KWB. (..)(..).*/mRUC2
        PIPE    decoders/gribtonc
        etc/ruc2_236.cdl
        
data/pub/decoded/netcdf/grid/NCEP/RUC2/CONUS_40km/RUC2_CONUS_40km_(\1:yyyy)(\1:mm)\1_\200.nc
#
# SST grid on global 5.0 x 2.5 degree grids
HRS     ^H.[A-D]... .... (..)(..).*/mSST
        PIPE    decoders/gribtonc
        etc/sst_21-24.cdl
        
data/pub/decoded/netcdf/grid/NCEP/SST/Global_5x2p5deg/SST_Global_5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc
#
# SST grid on global 2.0 x 2.0 degree grid
HRS     ^H.[T-W]... .... (..)(..).*/mSST
        PIPE    decoders/gribtonc
        etc/sst_61-64.cdl
        
data/pub/decoded/netcdf/grid/NCEP/SST/Global_2x2deg/SST_Global_2x2deg_(\1:yyyy)(\1:mm)\1_\200.nc
#