Re: [ldm-users] NEXRAD3 & NEXRAD2


Hi Daryl ..

I just have the following in my pqact.conf
NEXRAD2 ^L2-BZIP2/(....)/([0-9][0-9][0-9][0-9][0-1][0-9][0-3][0-9])([0-2][0-9][0-5][0-9])

   FILE    data/raw/level2/\1/\1_\2_\3


didn't know, (or read) about entries in the pq exec lines

and yes .. it has become pretty busy ..

-Jeff



Subject: Re: [ldm-users] NEXRAD3 & NEXRAD2


On Mon, 12 Apr 2010, Jeff Lake - Admin wrote:

I have been watching the server in my system that receives NEXRAD2 & 3 during our mini severe outbreak Easter Weekend it fell drastically behind in storing NEXRAD2 (on the tune of 30-45 minutes) at that time it had 4gb RAM on a 10Mbit port ..

Jeff,

Do you have your pqact split across multiple files? Each pqact process can only take up 32 child processes, so if you have a busy system, pqact will wait for "slots" to open up before it can start a new write or process. So I do something like this in ldmd.conf

exec    "pqact -p BZIP2/K[A-D] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[E-H] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[I-K] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[L-O] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[P-R] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[S-Z] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/[NTP] -f CRAFT etc/pqact.CRAFT"

Notice how the regex splits up the processing, eventhough I use the same pqact config file in each.

daryl



  • 2010 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: