[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #TQN-970252]: Issue with pqact

Hi Ziv,

re:
> I am having an issue with ldm bringing together NEXRAD2 scans and writing
> them into /tmp.

Is /tmp on a local filesystem or is it on a mounted filesystem?

re:
> My log file consists of many blocks of the following entry:
> 
> Jan  8 18:42:25 ldm-downstream pqact[25686] WARN: Processed oldest product in 
> queue: 610.687 s
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:      37394 
> 20160108174037.612 NEXRAD2 931015 L2-BZIP2/KOKX/20160108173739/931/15/I/V06/0
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:      33017 
> 20160108174037.544 NEXRAD2 689064 L2-BZIP2/KMUX/20160108173715/689/64/I/V06/0
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:      10853 
> 20160108174025.029 NEXRAD2 523029 L2-BZIP2/PHKM/20160108173516/523/29/I/V07/0
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:      38388 
> 20160108174037.767 NEXRAD2 80017  L2-BZIP2/KLSX/20160108173953/80/17/I/V06/0
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:      25733 
> 20160108174037.738 NEXRAD2 565031 L2-BZIP2/KMXX/20160108173235/565/31/I/V06/0
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:      76814 
> 20160108174037.838 NEXRAD2 909042 L2-BZIP2/KIWX/20160108173125/909/42/I/V06/0
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:      18313 
> 20160108174025.988 NEXRAD2 551030 L2-BZIP2/PHMO/20160108173533/551/30/E/V07/0
> Jan  8 18:42:25 ldm-downstream notifyme[3702] INFO:     172698 
> 20160108174037.724 NEXRAD2 626018 L2-BZIP2/KFCX/20160108173903/626/18/I/V06/0
> Jan  8 18:42:25 ldm-downstream pqact[25686] ERROR: Child 25757 exited with 
> status 1

A couple of things jump out at me from this listing:

- it looks like you are running a 'notifyme' invocation that is logging to your 
LDM
  log file.  Probably something like:

  <as 'ldm'>
  notifyme -v -f NEXRAD2

  or something similar.  This not a problem, but it is a little different than
  I am used to.

- the Processed oldest product in queue message is a red flag

  This indicates that the 'pqact' processing is way behind.  If you see lots of
  these messages, it means that you will be missing data (meaning not processing
  products fast enough so they will be overwritten by new products being
  received before they are processed.  This is a problem.

- the 'ERROR: Child 25757 exited with status 1' message is especially
  troubling

  I am not really sure what this error means.  It would be most helpful if
  we could logon to your machine (VM, whatever) to poke around, but you
  already told me that this would not be possible.  This means that
  troubleshooting will be slow...

re:
> With the first and last lines of particular note. I obtained my pqact
> script from this link <ftp://ftp.unidata.ucar.edu/pub/nexrad2/pqact.radars>,

I just updated the pqact.radars file with one where CRAFT was replaced by
NEXRAD2.

re:
> and the script to put together the NEXRAD2 scans from this other link
> <ftp://ftp.unidata.ucar.edu/pub/nexrad2/hhmmssRadarII.pl>.

OK.  This file should be fine as it is one I copied from one of the
systems we are actively using to process NEXRAD2 data.

re:
> Is there anything else that you need to get a better idea of the issue at
> hand? Thank you.

Short of a login, please send (as attachments, not cut and paste copies):

~ldm/etc/ldmd.conf
~ldm/etc/registry.xml
~ldm/etc/pqact.radars

Also send the output from:

mount

(I want to see if /tmp is on a local or remote file system)

ldmadmin config

(I want to see how your LDM configurations)

df -h

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: TQN-970252
Department: Support IDD
Priority: Normal
Status: Closed