[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[CONDUIT #BRX-137819]: GFS naming problems - ingest problem?



Pete,

This appears to be an issue with the GRIB1 files and the daylight savings 
time change. This off by one is progressing downward by run toward Sunday AM. 
I'll see if there is anything that can be done during this period.

I wrote the GRIB2 parts using the GEMPAK GRIB2 code (parameter tables etc)
and time routines, and they appear to be OK for the ensemble runs. 
The grib1 names use wgrib and apparently there is a gmtime offset past the time 
change.

Steve Chiswell
Unidata User Support


> 
> Steve/whoever,
> 
> Since the cutover to the new machine/naming structure, we've found that
> many of the GFS products (usually after 100 hours or so into the forecast)
> are being incorrectly identified. We use the Fxxx after the !grib to
> identify the forecast hour, since it is always a 3 digit forecast hour,
> rather than the fxxx number in the original file name, since for the
> < 100 hours, that is only one or two digits.
> 
> Here's an example from yesterday's 18 UTC GFS run:
> 
> Oct 23 22:29:12 pqutil INFO:    36004 20061023222839.142 CONDUIT 269  
> data/nccf/com/gfs/prod/gfs.2006102318/gfs.t18z.pgrbf159 
> !grib/ncep/GFS/#003/200610231800/F160/SOILW/40-100_cm_down! 000269
> 
> Notice how the f159 product is incorrectly being labeled as F160..
> 
> This looks like an ingest problem of some sort to me. At any rate,
> all of my forecast times from then on are incorrectly labeled, including
> the 2.5 deg files from 192 to 384h.
> 
> Any ideas?
> 
> Here's the listing of all of the files for all of forecast times
> from that run (18 UTC 10/23/2006):  The problem begins here with
> the 129 hour forecast (labeled as 130) and continues the rest
> of the run.
> 
> 
> -rw-rw-r--    1 ldm      ldm      94154832 Oct 23 16:27 
> /data/grib/gblav.06102318_F000
> -rw-rw-r--    1 ldm      ldm      26969296 Oct 23 16:29 
> /data/grib/gblav.06102318_F003
> -rw-rw-r--    1 ldm      ldm      26864870 Oct 23 16:30 
> /data/grib/gblav.06102318_F006
> -rw-rw-r--    1 ldm      ldm      27034284 Oct 23 16:31 
> /data/grib/gblav.06102318_F009
> -rw-rw-r--    1 ldm      ldm      27103278 Oct 23 16:33 
> /data/grib/gblav.06102318_F012
> -rw-rw-r--    1 ldm      ldm      27077370 Oct 23 16:35 
> /data/grib/gblav.06102318_F015
> -rw-rw-r--    1 ldm      ldm      27174076 Oct 23 16:35 
> /data/grib/gblav.06102318_F018
> -rw-rw-r--    1 ldm      ldm      27069314 Oct 23 16:36 
> /data/grib/gblav.06102318_F021
> -rw-rw-r--    1 ldm      ldm      27123756 Oct 23 16:38 
> /data/grib/gblav.06102318_F024
> -rw-rw-r--    1 ldm      ldm      27144828 Oct 23 16:39 
> /data/grib/gblav.06102318_F027
> -rw-rw-r--    1 ldm      ldm      27154754 Oct 23 16:40 
> /data/grib/gblav.06102318_F030
> -rw-rw-r--    1 ldm      ldm      27138234 Oct 23 16:41 
> /data/grib/gblav.06102318_F033
> -rw-rw-r--    1 ldm      ldm      27100934 Oct 23 16:43 
> /data/grib/gblav.06102318_F036
> -rw-rw-r--    1 ldm      ldm      27059772 Oct 23 16:43 
> /data/grib/gblav.06102318_F039
> -rw-rw-r--    1 ldm      ldm      27113884 Oct 23 16:44 
> /data/grib/gblav.06102318_F042
> -rw-rw-r--    1 ldm      ldm      27168774 Oct 23 16:53 
> /data/grib/gblav.06102318_F045
> -rw-rw-r--    1 ldm      ldm      27181168 Oct 23 16:48 
> /data/grib/gblav.06102318_F048
> -rw-rw-r--    1 ldm      ldm      27164122 Oct 23 16:51 
> /data/grib/gblav.06102318_F051
> -rw-rw-r--    1 ldm      ldm      27159918 Oct 23 16:53 
> /data/grib/gblav.06102318_F054
> -rw-rw-r--    1 ldm      ldm      27291726 Oct 23 16:57 
> /data/grib/gblav.06102318_F057
> -rw-rw-r--    1 ldm      ldm      27297128 Oct 23 16:57 
> /data/grib/gblav.06102318_F060
> -rw-rw-r--    1 ldm      ldm      27149798 Oct 23 16:58 
> /data/grib/gblav.06102318_F063
> -rw-rw-r--    1 ldm      ldm      27211678 Oct 23 17:03 
> /data/grib/gblav.06102318_F066
> -rw-rw-r--    1 ldm      ldm      27167316 Oct 23 17:02 
> /data/grib/gblav.06102318_F069
> -rw-rw-r--    1 ldm      ldm      27345876 Oct 23 17:04 
> /data/grib/gblav.06102318_F072
> -rw-rw-r--    1 ldm      ldm      27137988 Oct 23 17:05 
> /data/grib/gblav.06102318_F075
> -rw-rw-r--    1 ldm      ldm      27142378 Oct 23 17:11 
> /data/grib/gblav.06102318_F078
> -rw-rw-r--    1 ldm      ldm      27094842 Oct 23 17:09 
> /data/grib/gblav.06102318_F081
> -rw-rw-r--    1 ldm      ldm      27105062 Oct 23 17:10 
> /data/grib/gblav.06102318_F084
> -rw-rw-r--    1 ldm      ldm      27048578 Oct 23 17:12 
> /data/grib/gblav.06102318_F087
> -rw-rw-r--    1 ldm      ldm      26997226 Oct 23 17:12 
> /data/grib/gblav.06102318_F090
> -rw-rw-r--    1 ldm      ldm      27023282 Oct 23 17:16 
> /data/grib/gblav.06102318_F093
> -rw-rw-r--    1 ldm      ldm      27050340 Oct 23 17:16 
> /data/grib/gblav.06102318_F096
> -rw-rw-r--    1 ldm      ldm      27041388 Oct 23 17:17 
> /data/grib/gblav.06102318_F099
> -rw-rw-r--    1 ldm      ldm      27053300 Oct 23 17:17 
> /data/grib/gblav.06102318_F102
> -rw-rw-r--    1 ldm      ldm      27118918 Oct 23 17:17 
> /data/grib/gblav.06102318_F105
> -rw-rw-r--    1 ldm      ldm      27138826 Oct 23 17:18 
> /data/grib/gblav.06102318_F108
> -rw-rw-r--    1 ldm      ldm      27153810 Oct 23 17:19 
> /data/grib/gblav.06102318_F111
> -rw-rw-r--    1 ldm      ldm      27186884 Oct 23 17:19 
> /data/grib/gblav.06102318_F114
> -rw-rw-r--    1 ldm      ldm      27142610 Oct 23 17:19 
> /data/grib/gblav.06102318_F117
> -rw-rw-r--    1 ldm      ldm      27137484 Oct 23 17:20 
> /data/grib/gblav.06102318_F120
> -rw-rw-r--    1 ldm      ldm      27125984 Oct 23 17:21 
> /data/grib/gblav.06102318_F123
> -rw-rw-r--    1 ldm      ldm      27132494 Oct 23 17:21 
> /data/grib/gblav.06102318_F126
> -rw-rw-r--    1 ldm      ldm      27140954 Oct 23 17:21 
> /data/grib/gblav.06102318_F130
> -rw-rw-r--    1 ldm      ldm      27231230 Oct 23 17:22 
> /data/grib/gblav.06102318_F133
> -rw-rw-r--    1 ldm      ldm      27047844 Oct 23 17:22 
> /data/grib/gblav.06102318_F136
> -rw-rw-r--    1 ldm      ldm      27120478 Oct 23 17:22 
> /data/grib/gblav.06102318_F139
> -rw-rw-r--    1 ldm      ldm      27026972 Oct 23 17:23 
> /data/grib/gblav.06102318_F142
> -rw-rw-r--    1 ldm      ldm      27059298 Oct 23 17:23 
> /data/grib/gblav.06102318_F145
> -rw-rw-r--    1 ldm      ldm      26997250 Oct 23 17:24 
> /data/grib/gblav.06102318_F148
> -rw-rw-r--    1 ldm      ldm      27161632 Oct 23 17:25 
> /data/grib/gblav.06102318_F151
> -rw-rw-r--    1 ldm      ldm      27161780 Oct 23 17:27 
> /data/grib/gblav.06102318_F154
> -rw-rw-r--    1 ldm      ldm      27059196 Oct 23 17:27 
> /data/grib/gblav.06102318_F157
> -rw-rw-r--    1 ldm      ldm      27113694 Oct 23 17:29 
> /data/grib/gblav.06102318_F160
> -rw-rw-r--    1 ldm      ldm      27195118 Oct 23 17:30 
> /data/grib/gblav.06102318_F163
> -rw-rw-r--    1 ldm      ldm      27176770 Oct 23 17:31 
> /data/grib/gblav.06102318_F166
> -rw-rw-r--    1 ldm      ldm      27199382 Oct 23 17:32 
> /data/grib/gblav.06102318_F169
> -rw-rw-r--    1 ldm      ldm      27074074 Oct 23 17:33 
> /data/grib/gblav.06102318_F172
> -rw-rw-r--    1 ldm      ldm      27087352 Oct 23 17:35 
> /data/grib/gblav.06102318_F175
> -rw-rw-r--    1 ldm      ldm      27101512 Oct 23 17:35 
> /data/grib/gblav.06102318_F178
> -rw-rw-r--    1 ldm      ldm      27199640 Oct 23 17:38 
> /data/grib/gblav.06102318_F181
> -rw-rw-r--    1 ldm      ldm       4327132 Oct 23 17:38 
> /data/grib/gblav.06102318_F193
> -rw-rw-r--    1 ldm      ldm       4342332 Oct 23 17:38 
> /data/grib/gblav.06102318_F205
> -rw-rw-r--    1 ldm      ldm       4336014 Oct 23 17:38 
> /data/grib/gblav.06102318_F217
> -rw-rw-r--    1 ldm      ldm       4335458 Oct 23 17:38 
> /data/grib/gblav.06102318_F229
> -rw-rw-r--    1 ldm      ldm       4337622 Oct 23 17:39 
> /data/grib/gblav.06102318_F241
> -rw-rw-r--    1 ldm      ldm       4349286 Oct 23 17:39 
> /data/grib/gblav.06102318_F253
> -rw-rw-r--    1 ldm      ldm       4355426 Oct 23 17:40 
> /data/grib/gblav.06102318_F265
> -rw-rw-r--    1 ldm      ldm       4325784 Oct 23 17:40 
> /data/grib/gblav.06102318_F277
> -rw-rw-r--    1 ldm      ldm       4317576 Oct 23 17:41 
> /data/grib/gblav.06102318_F289
> -rw-rw-r--    1 ldm      ldm       4335506 Oct 23 17:41 
> /data/grib/gblav.06102318_F301
> -rw-rw-r--    1 ldm      ldm       4328630 Oct 23 17:42 
> /data/grib/gblav.06102318_F313
> -rw-rw-r--    1 ldm      ldm       4325420 Oct 23 17:42 
> /data/grib/gblav.06102318_F325
> -rw-rw-r--    1 ldm      ldm       4328554 Oct 23 17:42 
> /data/grib/gblav.06102318_F337
> -rw-rw-r--    1 ldm      ldm       4354672 Oct 23 17:43 
> /data/grib/gblav.06102318_F349
> -rw-rw-r--    1 ldm      ldm       4344730 Oct 23 17:43 
> /data/grib/gblav.06102318_F361
> -rw-rw-r--    1 ldm      ldm       4325634 Oct 23 17:44 
> /data/grib/gblav.06102318_F373
> -rw-rw-r--    1 ldm      ldm       4308642 Oct 23 17:44 
> /data/grib/gblav.06102318_F385
> 
> Thanks,
> 
> Pete
> 
> 
> --
> +>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+
> ^ Pete Pokrandt                    V 1447  AOSS Bldg  1225 W Dayton St^
> ^ Systems Programmer               V Madison,         WI     53706    ^
> ^                                  V      address@hidden       ^
> ^ Dept of Atmos & Oceanic Sciences V (608) 262-3086 (Phone/voicemail) ^
> ^ University of Wisconsin-Madison  V       262-0166 (Fax)             ^
> +<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+
> 
> 


Ticket Details
===================
Ticket ID: BRX-137819
Department: Support CONDUIT
Priority: Normal
Status: Closed