[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

20000602: pqact entry? (fwd)


===============================================================================
Robb Kambic                                Unidata Program Center
Software Engineer III                      Univ. Corp for Atmospheric Research
address@hidden             WWW: http://www.unidata.ucar.edu/
===============================================================================

---------- Forwarded message ----------
Date: Sat, 03 Jun 2000 08:17:06 -0600
From: Unidata Support <address@hidden>
To: address@hidden
Subject: 20000602: pqact entry?


------- Forwarded Message

>To: Bob Lipschutz <address@hidden>
>cc: "Herbster, Chris" <address@hidden>,
>cc: address@hidden
>From: Chris Herbster <address@hidden>
>Subject: Re: pqact entry?
>Organization: Embry Riddle
>Keywords: 200006022237.e52MbaT04107 LDM pqexpire SIGALARM Linux

Thanks Bob!

Yup, our machine just isn't coping well.  I think it is under RAMed,
only 112 MB, which is low for Linux....  The LDM runs fine with a
trickle of data, but dies when I try to increase to flow.

Right now I am only ingesting data from FSL and SUNY Albany.  SUNY
appears to be down, so only the ACARS data are entering the queue.

"ldmadmin tail" (with pqact in debug mode) sees:

Jun 02 22:20:46 opwx pqact[26675]: SIGALRM 
Jun 02 22:20:46 opwx pqact[26675]: End of Queue 
Jun 02 22:20:55 opwx pqact[26675]: SIGCONT 
Jun 02 22:20:55 opwx pqact[26675]: 00a10cf2baa21126d902380af81c3186  
384732 20000602222033.057    PCWS 000  FSL.NetCDF.ACARS.QC.20001542220.* 
Jun 02 22:20:55 opwx pqact[26675]: End of Queue 
Jun 02 22:21:10 opwx pqact[26675]: SIGALRM 
Jun 02 22:21:10 opwx pqact[26675]: End of Queue 


I assume that the "SIGALRM" comes from scanning the queue and not
finding anything to do, but that's a guess.


"ldmadmin watch" sees:

 Jun 02 22:20:56 pqutil:   384732 20000602222033.057    PCWS 000 
FSL.NetCDF.ACARS.QC.20001542220.*


No decoders are fired off and no data are being written to disk.  (Other
DDPLUS data do get written to disk when I add FSU to the request.)

Here are the pqact.conf entries:

# FSL ACARS data
PCWS    ^FSL\.NetCDF\.ACARS\.QC\.([0-9]+)\..*
        PIPE    -close  /usr/local/ldm/decoders/bin/dcacars -v -b 30
        -e GEMTBL=/home/gempak/NAWIPS-5.4/gempak5.4/tables
        -l logs/dcacars.log data/gempak/acars/YYYYMMDDHHNN_acars.gem

PCWS    ^FSL\.NetCDF\.ACARS\.QC\.([0-9]+)\..*  
        FILE  -close data/netcdf/acars/\1.acars

The beginning of line characters are tabs.

Any ideas?  I've Cc'd the support folks at Unidata to see if they can
help.

Thanks again for the help!

Chris H.


Bob Lipschutz wrote:
> 
> > Bob,
> >
> > Could you please send me the sample entry for our pqact.conf file that
> > you sent before?  I lost that email and my line for the GEMPAK decoder
> > doesn't appear to be working.  Either way, I'd like to save the netCDF
> > files.
> >
> > Thanks!
> >
> 
> Chris,
> 
> Here y'go...
> 
> BTW, the network connectivity to your machine still seems to be up-and-down.
> Looks like we're up now...as of 19Z (1pm MDT)... it had been down since
> yesterday afternoon.  You may want to talk to your network administrator
> about this.
> 
> Also, as indicated in the note below, you may want to subscribe to
> our acars-data mailing list if you are interested in receiving
> messages when our service experiences an outage or changes for
> some reason.
> 
>         -Bob
> 
> ------- Forwarded Message
> To: address@hidden (Chris Herbster)
> cc: Bob Lipschutz <address@hidden>, address@hidden,
>         address@hidden
> Subject: Re: Re[2]: ACARS data request
> In-reply-to: Your message of "Tue, 23 May 2000 11:19:21 -0400."
>              <address@hidden>
> Date: Tue, 23 May 2000 15:52:52 +0000
> From: Bob Lipschutz <address@hidden>
> Content-Type: text
> Content-Length: 4513
> 
> Chris,
> 
> Here's our standard message regarding LDM configuration and
> FSL support for the ACARS service.  Once Bill gives the say-so,
> we'll add your hosts to our ldmd.conf to allow your access.
> FYI, Loeta Hendrickson is our LDM point-of-contact and will
> be doing the configuring...
> 
> You will need to add the following to your ldmd.conf:
> 
> request  PCWS   "^FSL\.NetCDF\.ACARS\.QC\..*"    ldm.fsl.noaa.gov
> 
> For capturing the files, you might do something like this in your pqact.conf:
> 
> PCWS   ^FSL\.NetCDF\.ACARS\.QC\.([0-9]+)\..*  FILE  -close \1.acars
> 
> This expression should give you a time-based file name like
> '19991652230.acars', where the time string is <yyyyjjjhhmm>,
> with jjj being "julian day," otherwise known as "day of year."
> The files are roughly 300 KB each.
> 
> Files are generated and sent out every 10 minutes, starting on the hour.
> Each file contains observations taken during the preceeding hour period
> (ending at the time hack in the data key).  This means that the files have
> redundant data, which we leave to the recipient to deal with.  We do this
> because some ACARS reports can arrive 45 min late, and we want to have
> several chances to include them.  (Actually some arrive even later, which
> we miss, but very rarely.)
> 
> You may want to read the FAQ at http://acweb.fsl.noaa.gov/FAQ.html
> which says a little bit about the timing of the processing.  The
> 'additional grusome details' therein doesn't apply to the LDM stream, but
> the rest of the FAQ does.
> 
> I believe the Unidata support folks can provide applications that use
> these files.
> 
> We have set up a majordomo mailing list for acars data recipients.
> The main intent of this list is for our operations staff to post messages
> regarding data service outages.  To subscribe, send mail to
> address@hidden, with the message body:
> 
>     subscribe acars-data
>     end
> 
> You can contact the FSL operators at address@hidden (303-497-6636)
> regarding real-time data.  They monitor our real-time systems 7 days a
> week, 6am-10pm.
> 
> Please send any LDM-related questions to address@hidden, rather
> than directly to me... several of us read that mail.
> 
>         Regards,
> 
>                 Bob Lipschutz
>                 NOAA/Forecast Systems Laboratory
>                 Facility Division
>                 325 Broadway  R/E/FS2
>                 Boulder, CO 80303
>                 303-497-6636
>                 address@hidden
> 
> > Bob:
> >
> > We've been "waiting" all this time to get ourselves setup - a few more
> > days won't make a difference.  In the meantime, if you could forward any
> > info for the decoder actions I would greatly appreciate.  (For the LDM
> > pqact.conf file.)  I'm still getting used to the LDM software and I'd
> > like to prepare for the data if possible.  If I'll have to wait until
> > formal access is granted I understand.
> >
> > Thanks for the quick reply!
> >
> > Chris Herbster
> >
> > PS  I'll be in Boulder for a Unidata workshop in June and I would love
> > to come by and visit.  We teach meteorology to future commercial and
> > corporate pilots and I'd love to get a peak at the work that you folks
> > are doing at FSL.
> >
> >
> > ______________________________ Reply Separator 
> > ______________________________
> ___
> > Subject: Re: ACARS data request
> > Author:  Bob Lipschutz <address@hidden> at Internet-Mail
> > Date:    5/22/00 8:32 PM
> >
> >
> >
> > Chris,
> >
> > Thanks for your interest in ACARS data.  I'm sure your request
> > will be granted.  Unfortunately, Bill Moninger, who is the
> official grantor of requests is out this week.  If you wouldn't
> > mind waiting, I'd appreciate it.
> >
> >         Bob Lipschutz
> >         Facility Division
> >         NOAA Forecast System Laboratory
> >         address@hidden
> >         303-497-6636
> >
> > > I would like to establish an LDM connection for the ACARS data for use
> > > in our meteorological teaching efforts.
> > >
> > > We have been actively participating in the Unidata IDD for almost 12
> > > months now.
> > >
> > > Our contact info:
> > >
> > > Dr. Chris Herbster
> > > Assist. Prof.
> > > Applied Aviation Sciences
> > > Embry-Riddle Aeronautical University 600 S. Clyde Morris Blvd.
> > > Daytona Beach, FL 32114-3900
> > >
> > > 904.226.6444
> > > 904.226.6012 [fax]
> > > address@hidden
> > >
> > > Primary machine: opwx.db.erau.edu
> > > Backup machine: thermal.db.erau.edu
> > >
> > > If you could please supply a sample request line and any other
> > > configuration information I would greatly appreciate it.
> > >
> > > Thank you,
> > >
> > > Chris Herbster
> 
> ------- End of Forwarded Message


------- End of Forwarded Message