Patrick Finnegan wrote:
Hi all,
I seem to be having some problems downloading data via ldm from the new
Super Res sites. Unfortunately, a person who has moved on set up our
LDM infrastructure, and I don't have a very thorough understanding of
all of the bits of it.
All of the "Super Res" sites are downloading their data, and either the
files are not completely downloading, or are not properly getting
renamed after they download... For example, an ls -ga of KABR's
directory looks like this:
-rw------- 1 ldm 1266789 Jul 4 17:08 .KABR_20080704_2059
-rw------- 1 ldm 1266485 Jul 4 17:18 .KABR_20080704_2108
-rw------- 1 ldm 1266864 Jul 4 17:27 .KABR_20080704_2118
-rw------- 1 ldm 1262873 Jul 4 17:36 .KABR_20080704_2127
-rw------- 1 ldm 1262526 Jul 4 17:46 .KABR_20080704_2136
-rw------- 1 ldm 1260206 Jul 4 17:55 .KABR_20080704_2146
,,,
I tried upgrading ldm to the newest version (6.6.5), keeping the same
configuration files as before, but it didn't help any.
Does anyone here have any idea what could be wrong, or what else I could
look at?
SuperRes ("Build 10") changed a number of things, including the filenames.
I'm glad to look at your ldmd.conf and the appropriate pqact.conf files,
having recently fought this battle and won.
In general, the pqact incantation looks something like this:
CRAFT
^L2-BZIP2/(....)/([0-9][0-9][0-9][0-9][0-1][0-9][0-3][0-9])([0-2][0-9][0-5][0-9])
FILE data/gempak/nexrad/craft/\1/\1_\2_\3
In older incantations, we stored the 100-radial scans in an
intermediate hidden file 'til the whole volume scan was completed, as
indicated by a "/E" as the last character of a radial scan filename.
The End-Of-Scan "E" is now embedded in the middel of the name, making
its capture a little more interesting. What we do here, then, is to
ignore it, and just expose the incomplete volume scan as it's filled.
To trigger image-making sprees based on a completed volume scan (using
Gempak 5.11.1) we have 2 pqactions: one for BUILD 9 filenames and one
for BUILD 10 filenames:
CRAFT
^L2-BZIP2/(K...)/([0-9][0-9][0-9][0-9][0-1][0-9])([0-3][0-9])([0-2][0-9][0-5][0-9])([0-9][0-9]).*/E$
EXEC scripts/\1.sh \3/\4
CRAFT
^L2-BZIP2/(K...)/([0-9][0-9][0-9][0-9][0-1][0-9])([0-3][0-9])([0-2][0-9][0-5][0-9])([0-9][0-9]).*/E/
EXEC scripts/\1.sh \3/\4
The regex substitution identifies the appropriate site, AND includes the
RADTIM file designation.
Gerry
--
Gerry Creager -- gerry.creager@xxxxxxxx
Texas Mesonet -- AATLT, Texas A&M University
Cell: 979.229.5301 Office: 979.458.4020 FAX: 979.862.3983
Office: 1700 Research Parkway Ste 160, TAMU, College Station, TX 77843
