[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: pqsurf.conf



Alan,

I looked into the pqsurf code, here's the scoop. The pqsurf code is
looking for the standard WMO type of header before it can split the
bulletin into individual reports. There are 2 solutions:

- modify your ingest code to produce standard WMO type headers, ie
eliminate the NOAAPORT prefix and change the "." to spaces.

- modify the surf_split.c code in the LDM pqsurf directory to accept your
current type headers.  At this time, I have many other top priority
projects so I could not get to this for months. Maybe you have the
resources to do the modifications.

I know this is not what you wanted to hear but that's about it in a
nutshell. Maybe Leslie could help you out.

Robb...

On Mon, 22 Nov 1999 address@hidden wrote:

> 
> 
> I think we are making progress.  I'm getting some entries in the ldmd.log
> that tell me we are getting things to pqsurf.  Here is a sample of the log:
> 
> Nov 22 13:30:15 npfos pqsurf[9283]: Starting Up (9279)
> Nov 22 13:30:15 npfos pqsurf[9283]: lastmatch:
> 6453cb112c44cf491c21769dee1f4138      987 19991122133008.749     WMO 000
> NOAAPORT.NW
> Nov 22 13:30:15 npfos pqsurf[9283]: 19991122123015.215 TS_ENDT {{WMO,
> "^NOAAPORT\.NWSTG\.TEXT\.S[AIMNP]"}}
> Nov 22 13:30:15 npfos pqact[9284]: Starting Up
> Nov 22 13:30:15 npfos pqact[9284]: Successfully read pattern file
> "/usr/local/ldm/etc/pqsurf.conf"
> Nov 22 13:30:15 npfos pqact[9284]: TS_ZERO TS_ENDT {{WMO,  ".*"}}
> Nov 22 13:30:15 npfos pqact[9284]:        0 19991122133015.238     ANY 000
>   _BEGIN_
> Nov 22 13:30:17 npfos localhost[9291]: Connection from localhost
> Nov 22 13:30:17 npfos localhost[9291]: Connection reset by peer
> Nov 22 13:30:17 npfos localhost[9291]: Exiting
> Nov 22 13:30:30 npfos pqsurf[9283]:      103 19991122133016.828     WMO 000
>   NOAAPORT.NWSTG.TEXT.SPCN51.CWAO.221327.1999326133016827
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      121 19991122133016.830     WMO 000
>   NOAAPORT.NWSTG.TEXT.SPCN31.CWAO.221326.1999326133016830
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      139 19991122133016.832     WMO 000
>   NOAAPORT.NWSTG.TEXT.SPCN41.CWAO.221327.1999326133016832
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      111 19991122133016.841     WMO 000
>   NOAAPORT.NWSTG.TEXT.SPUS43.KWBC.221328.1999326133016840
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      586 19991122133016.843     WMO 000
>   NOAAPORT.NWSTG.TEXT.SPUS70.KWBC.221328.1999326133016843
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      144 19991122133016.845     WMO 000
>   NOAAPORT.NWSTG.TEXT.SPXX60.KWBC.221328.1999326133016844
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      115 19991122133019.927     WMO 000
>   NOAAPORT.NWSTG.TEXT.SAPL61.KRAK.221330.1999326133019926
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      545 19991122133024.005     WMO 000
>   NOAAPORT.NWSTG.TEXT.SNVB20.RJTD.221300.1999326133024005
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      107 19991122133026.080     WMO 000
>   NOAAPORT.NWSTG.TEXT.SPCN48.CWAO.221326.1999326133026080
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> Nov 22 13:30:30 npfos pqsurf[9283]:      133 19991122133026.083     WMO 000
>   NOAAPORT.NWSTG.TEXT.SACN87.CWAO.221325.1999326133026083
> Nov 22 13:30:30 npfos pqsurf[9283]: surface_split: Can't handle
> MESSAGE_TYPE_UNKNOWN
> 
> What is MESSAGE_TYPE_UNKNOWN and how can I correct it?
> 
> 
> 
> 
> 
> Robb Kambic <address@hidden> on 11/19/99 04:11:06 PM
>                                                               
>                                                               
>                                                               
>  To:      Alan Hall/NCDC                                      
>                                                               
>  cc:      support-ldm <address@hidden>          
>                                                               
>                                                               
>                                                               
>  Subject: Re: pqsurf.conf                                     
>                                                               
> 
> 
> 
> 
> 
> 
> 
> 
> On Fri, 19 Nov 1999 address@hidden wrote:
> 
> >
> >
> > I have the following entry in my pqsurf.conf file (this very line works
> > perfectly in pqact.conf):
> >
> > WMO
> >
> ^NOAAPORT\.NWSTG\.(TEXT)\.([A-Z]...).[0-9]\.[A-Z]..[A-Z]|[0-9]\.([0-3][0-9]
> > )....\.
> >      FILE -strip
> >      /npraid/noaaport/data/NWSTG/\1/SURF/\2(\3:yyyy)(\3:mmm)(\3:dd)
> 
> Alan,
> 
> I reread the man page, it seems there are flags to set the feedtype and
> pattern. use the following flags on the pqsuf line in ldmd.conf.
> 
> exec pqsurf -f WMO -p "^NOAAPORT\.NWSTG\.(TEXT)\.S[AIMNP]"
> 
> Robb...
> 
> 
> 
> >
> > tabs separate all the fields.  I can't get anything from pqsurf.  I am
> > completely lost on what this is supposed to do...
> > What should an entry in pqsurf look like?
> >
> > Alan.
> >
> >
> 
> ===========================================================================
> ====
> Robb Kambic                      Unidata Program Center
> Software Engineer III                 Univ. Corp for Atmospheric Research
> address@hidden         WWW: http://www.unidata.ucar.edu/
> ===========================================================================
> ====
> 
> 
> 
> 

===============================================================================
Robb Kambic                                Unidata Program Center
Software Engineer III                      Univ. Corp for Atmospheric Research
address@hidden             WWW: http://www.unidata.ucar.edu/
===============================================================================