[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

20030828: 20030827: 20030827: 20030827: 20030826: dcnexr2 write errors



Eric,

If you have an instance of dcnexr2 running, it will create the directory
(KLOT presumably). Has this been done? The data file will initially 
be opened in the directory with a "." preceeding the filename specified
in order to help with the fact that the data are sent 100 radials at a time.
The file will be renamed from .filename to filename the first time the decoder 
exits.

Steve Chiswell


>From: Eric Nelson <address@hidden>
>Organization: UCAR/Unidata
>Keywords: 200308281400.h7SE0vLd017431

>
>Ok,
>
>I've recovered from my earlier typos in pqact so that everything is
>working that was working with version J.  I copied all the dc* into
>/home/ldm/decoders where they should be.  I'm not seeing anymore write
>errors in my ldmd.log file.
>
>dcnexr2 is still not creating any output.  I used the sample entry and
>modified it to generate a log file in the same place the rest of my log
>files are.  I also changed the data output location for my data tree.  The
>pattern is the same.
>
>CRAFT
>^L2-BZIP2/(....)/([0-9][0-9][0-9][0-9][0-1][0-9][0-3][0-9])([0-2][0-9][0-5][0-
> 9])([0-9][0-9])
>       PIPE    decoders/dcnexr2 -s \1 -d data/gempak/logs/dcnexr2.log
>data/gempak/craft/\1/\1_\2_\3
>
>No log files, No data.  When I look at the list of processes running I see
>an instance of dcnexr2 running.
>
>The dir that it should be writing to has 777 permissions on it.
>
>-Eric
>--
>________________________________________________________________________
>Eric Nelson                                                            |   
>                                                                       |
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++   |
>+ College of Dupage Meteorology Dept. + Research Applications Prog. +  | 
>+ Weather Data Manager                + UCAR/NCAR                   +  | 
>+ http://weather.cod.edu              + http://www.rap.ucar.edu     +  | 
>+ address@hidden             + address@hidden        +  |
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++   |
>                                                                       |
>"I love deadlines.  I especially like the whooshing sound they make as | 
>they go flying by."     --Douglas Adams                                |
>________________________________________________________________________
>
>On Wed, 27 Aug 2003, Unidata Support wrote:
>
>> 
>> Eric,
>> 
>> The line:
>> [8328] 030827/1249 [IN -11]  Parameter msfc.pack is invalid.
>> 
>> means that the $GEMTBL/pack/msfc.pack file is not being found. This would in
> dicate
>> that either your GEMTBL link is wrong, or the path in your pqact
>> entry is wrong, or you don't have read permission on that file.
>> 
>> Steve Chiswell
>> 
>> 
>> >From: Eric Nelson <address@hidden>
>> >Organization: UCAR/Unidata
>> >Keywords: 200308272018.h7RKIKLd010543
>> 
>> >
>> >Inline repies.
>> >
>> >On Wed, 27 Aug 2003, Unidata Support wrote:
>> >
>> >> 
>> >> Eric,
>> >> 
>> >> The reason I mentioned the path is that you showed the decoders/dcnexr2 p
> ath
>> >> while the log file contained decoders/gempak/dcgrib2 for that decoder.
>> >> 
>> >> Can you tell me what is in the dcmsfc.log file from:  
>> >> 
>> >> >> Aug 27 16:49:48 climate pqact[1442]: pipe_dbufput: 
>> >>    decoders/gempak/dcmsfc -b9 -a 10000 -d data/gempak/logs/dcmsfc.log
>> >>   -e GEMTBL=/home/gempak/gempak/tables
>> >>   data/gempak/ship/YYYYMMDDHH_sb.gem
>> >> >> write error
>> >> 
>> >
>> >I the log file dcmsfc.log i see multiple instances of the following...
>> >
>> >[8328] 030827/1249 [DC 3]  Starting up. Version 5.6.k
>> >[8328] 030827/1249 [IN -11]  Parameter msfc.pack is invalid.
>> >[8328] 030827/1249 [FL -1]  Cannot open file ....
>> >[8328] 030827/1249 [DC 5]  Normal termination.
>> >[8328] 030827/1249 [DC 2]  Number of bulletins read and processed: 0
>> >[8328] 030827/1249 [DC 6]  Shutting down.
>> >
>> >
>> >> If the log file is being created, then that may help diagnose the problem
> .
>> >> If not, then we need to make sure the LDM has write permission to data/ge
> mpa
>> > k
>> >> in order to create the logs/ and ship/ directories.
>> >> 
>> >> Is any file being created in data/gempak/ship?
>> >
>> >Looks like the last file that was written to was...
>> >-rw-r--r--    1 ldm      ldm       1709060 Aug 26 21:10 2003082702_sb.gem
>> >which would correspond to when I was working in things last night.
>> >
>> >Appearently something I did last night is causing problems.  I'm going to
>> >try to fall back to some previous file versions (pqact and Gemeviron) to
>> >see if I can get data to start writing again.
>> >
>> >It also appears the either the network I am on now (mscd.edu) or COD's is
>> >having a lot of trouble at the moment.  I'm not sure if I'll be able to
>> >follow up on this today.
>> >
>> >-Eric
>> >
>> >> 
>> >> If not, then it would be most likely that the decoder isn't finding the p
> ack
>> > ing 
>> >> file under /home/gempak/gempak/tables/pack (your symbolic link to the act
> ual
>> >  path)/
>> >> 
>> >> Steve Chiswell
>> >> 
>> >> 
>> >> 
>> >> 
>> >> 
>> >> >From: Eric Nelson <address@hidden>
>> >> >Organization: UCAR/Unidata
>> >> >Keywords: 200308271917.h7RJHcLd013079
>> >> 
>> >> >
>> >> >Steve,
>> >> >
>> >> >In /home/ldm/decoders/ I made a symbolic link to
>> >> >/home/gempak/gempak-5.6.k/bin/linux .  The /home/ldm/decoders/ dir
>> >> >contains mainly ldm-mcidas decoders (area2png, nldn2md, etc).  When we
>> >> >installed our previous gempak version (j) the person doing the install d
> id
>> >> >not place anything into the decoders dir.  I came along later and put in
>> >> >the symbolic link and modified the pqact entries to reflect the correct
>> >> >location.  
>> >> >
>> >> >As far as the tables not being found I don't see reason that the tables
>> >> >would not be found.  I've rechecked that path lots of times.  
>> >> >
>> >> >I suppose I'll try to copy the dc* directly into the decoders dir.
>> >> >
>> >> >-Eric
>> >> >
>> >> >
>> >> >On Wed, 27 Aug 2003, Unidata Support wrote:
>> >> >
>> >> >> 
>> >> >> Eric,
>> >> >> 
>> >> >> I notice you have changed the path tho the decoders from decoders/dcgr
> ib2
>> >> >> for example to decoders/gempak/dcgrib2.
>> >> >> Is that path correct? All the entries I provide assume you will have t
> he 
>> > dec
>> >> > oders
>> >> >> under decoders/ from the LDMHOME.
>> >> >> 
>> >> >> Nothing in $GEMTBL needs write permission, so the error you are seeing
>> >> >> is most likely either that the decoder isn't being found from pqact,
>> >> >> or that a table isn't found, shich would be noted in the log file
>> >> >> created by the decoder (typically under data/gempak/logs).
>> >> >> 
>> >> >> Steve Chiswell
>> >> >> 
>> >> >> 
>> >> >> 
>> >> >> >From: Eric Nelson <address@hidden>
>> >> >> >Organization: UCAR/Unidata
>> >> >> >Keywords: 200308271717.h7RHHsLd019379
>> >> >> 
>> >> >> >
>> >> >> >Ok, I inserted the /dev/null back into the pqact entry.  
>> >> >> >
>> >> >> >I'm also recieving other write errors in my ldmd.log.  Examples below
> ...
>> >> >> >
>> >> >> >Aug 27 16:48:39 climate pqact[1442]: pipe_prodput: trying again 
>> >> >> >Aug 27 16:48:39 climate pqact[1442]: pbuf_flush (34) write: Broken pi
> pe 
>> >> >> >Aug 27 16:48:39 climate
>> >> >> >pqact[1442]: pipe_dbufput: decoders/gempak/dcgrib2-ddata/gempak/logs/
> dcg
>> > rib
>> >> > _co
>> >> >> > nduit.log-eGEMTBL=/home/gempak/gempak/tables
>> >> >> >write error 
>> >> >> >Aug 27 16:48:39 climate pqact[1442]: pipe_prodput: trying again 
>> >> >> >Aug 27 16:49:24 climate pqact[1442]: pbuf_flush 4: time elapsed   4.8
> 894
>> > 70 
>> >> >> >Aug 27 16:49:48 climate pqact[1442]: pbuf_flush (10) write: Broken pi
> pe 
>> >> >> >Aug 27 16:49:48 climate
>> >> >> >pqact[1442]: pipe_dbufput: decoders/gempak/dcmsfc-b9-a10000-ddata/gem
> pak
>> > /lo
>> >> > gs/
>> >> >> > dcmsfc.log-eGEMTBL=/home/gempak/gempak/tablesdata/gempak/ship/YYYYMM
> DDH
>> > H_s
>> >> > b.g
>> >> >> > em
>> >> >> >write error
>> >> >> >
>> >> >> >Some of the errors in the dc*.log say that it can't open various tabl
> es,
>> >> >> >set GEMTBL.
>> >> >> >
>> >> >> >My $GEMTBL is set to /home/gempak/gempak/tables which is really 
>> >> >> >/home/gempak/gempak-5.6.k/gempak/tables  which looks correct.  Is the
> re 
>> > a
>> >> >> >certain way the permissions need to be set up in the tables directori
> es
>> >> >> >(does ldm need write  permissions for everything under $GEMTBL ?)
>> >> >> >
>> >> >> >-Eric
>> >> >> >
>> >> >> >
>> >> >> >On Wed, 27 Aug 2003, Unidata Support wrote:
>> >> >> >
>> >> >> >> 
>> >> >> >> Eric,
>> >> >> >> 
>> >> >> >> The entry provided was correct. Your problems are due to the fact t
> hat
>> >  si
>> >> > nce
>> >> >> >  you deleted
>> >> >> >> the data log file name (/dev/null), the output file name is being u
> sed
>> >  fo
>> >> > r t
>> >> >> > he log file, and you
>> >> >> >> don't have a file for the output to go to. I use /dev/null for the 
> log
>> >  fi
>> >> > le 
>> >> >> > since 
>> >> >> >> I was decoding all sites and didn't need all those logs. You can us
> e s
>> > ome
>> >> > thi
>> >> >> > ng like
>> >> >> >> dsata/gempak/logs/dcnexr2.log as the option for the -d flag.
>> >> >> >> 
>> >> >> >> Steve Chiswell
>> >> >> >> 
>> >> >> >> >From: Eric Nelson <address@hidden>
>> >> >> >> >Organization: UCAR/Unidata
>> >> >> >> >Keywords: 200308270215.h7R2FGLd001464
>> >> >> >> 
>> >> >> >> >
>> >> >> >> >We just installed the latest verison of Gempak (k) and I inserted 
> the
>> >  ne
>> >> > w
>> >> >> >> >CRAFT pqact lines into my existing pqact.conf.  
>> >> >> >> >
>> >> >> >> >First, it looks like the default entry generated by gen_pact has s
> ome
>> >> >> >> >bogus chars...
>> >> >> >> >CRAFT
>> >> >> >> >^L2-BZIP2/(....)/([0-9][0-9][0-9][0-9][0-1][0-9][0-3][0-9])([0-2][
> 0-9
>> > ][0
>> >> > -5]
>> >> >> > [0-
>> >> >> >> > 9])([0-9][0-9])
>> >> >> >> >   PIPE    decoders/dcnexr2 -s \1 -d /dev/null data/craft/\1/\1_\2
>> > _\3
>> >> >> >> >
>> >> >> >> >Is the "/dev/null" supposed to be in there???  I took it out when 
> I
>> >> >> >> >inserted it into my current pqact.conf.
>> >> >> >> >
>> >> >> >> >Secondly, I'm getting write errors in my ldmd.log from the dcnexr2
> ...
>> >> >> >> >
>> >> >> >> >Aug 27 02:08:50 climate pqact[30531]: pipe_prodput: trying again 
>> >> >> >> >Aug 27 02:08:50 climate pqact[30531]: pbuf_flush (11) write: Broke
> n p
>> > ipe
>> >> >  
>> >> >> >> >Aug 27 02:08:50 climate
>> >> >> >> >pqact[30531]: pipe_dbufput: decoders/dcnexr2-sKLOT-ddata/craft/KLO
> T/K
>> > LOT
>> >> > _20
>> >> >> > 030
>> >> >> >> > 827_0204
>> >> >> >> >write error
>> >> >> >> >
>> >> >> >> >None of my other data seems to be having problems.
>> >> >> >> >
>> >> >> >> >-Eric
>> >> >> >> >
>> >> >> >> >--
>> >> >> >> >__________________________________________________________________
> ___
>> > ___
>> >> >> >> >Eric Nelson                                                       
>    
>> >   |
>> >> >    
>> >> >> >> >                                                                  
>    
>> >   |
>> >> >> >> > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> ++ 
>> >   |
>> >> >> >> >+ College of Dupage Meteorology Dept. + Research Applications Prog
> . +
>> >   |
>> >> >  
>> >> >> >> >+ Weather Data Manager                + UCAR/NCAR                 
>   +
>> >   |
>> >> >  
>> >> >> >> >+ http://weather.cod.edu              + http://www.rap.ucar.edu   
>   +
>> >   |
>> >> >  
>> >> >> >> >+ address@hidden             + address@hidden      
>   +
>> >   |
>> >> >> >> > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> ++ 
>> >   |
>> >> >> >> >                                                                  
>    
>> >   |
>> >> >> >> >"I love deadlines.  I especially like the whooshing sound they mak
> e a
>> > s |
>> >> >  
>> >> >> >> >they go flying by."     --Douglas Adams                           
>    
>> >   |
>> >> >> >> >__________________________________________________________________
> ___
>> > ___
>> >> >> >> >
>> >> >> >> >
>> >> >> >> 
>> >> >> >> *******************************************************************
> ***
>> > ***
>> >> > ***
>> >> >> >> Unidata User Support                                    UCAR Unidat
> a P
>> > rog
>> >> > ram
>> >> >> >> (303)497-8643                                                  P.O.
>  Bo
>> > x 3
>> >> > 000
>> >> >> >> address@hidden                                   Boulder,
>  CO
>> >  80
>> >> > 307
>> >> >> >> -------------------------------------------------------------------
> ---
>> > ---
>> >> > ---
>> >> >> >> Unidata WWW Service              http://my.unidata.ucar.edu/content
> /su
>> > ppo
>> >> > rt 
>> >> >> >> *******************************************************************
> ***
>> > ***
>> >> > ***
>> >> >> >> 
>> >> >> >
>> >> >> 
>> >> >> **********************************************************************
> ***
>> > ***
>> >> >> Unidata User Support                                    UCAR Unidata P
> rog
>> > ram
>> >> >> (303)497-8643                                                  P.O. Bo
> x 3
>> > 000
>> >> >> address@hidden                                   Boulder, CO
>  80
>> > 307
>> >> >> ----------------------------------------------------------------------
> ---
>> > ---
>> >> >> Unidata WWW Service              http://my.unidata.ucar.edu/content/su
> ppo
>> > rt 
>> >> >> **********************************************************************
> ***
>> > ***
>> >> >> 
>> >> >
>> >> 
>> >> *************************************************************************
> ***
>> >> Unidata User Support                                    UCAR Unidata Prog
> ram
>> >> (303)497-8643                                                  P.O. Box 3
> 000
>> >> address@hidden                                   Boulder, CO 80
> 307
>> >> -------------------------------------------------------------------------
> ---
>> >> Unidata WWW Service              http://my.unidata.ucar.edu/content/suppo
> rt 
>> >> *************************************************************************
> ***
>> >> 
>> >
>> 
>> ****************************************************************************
>> Unidata User Support                                    UCAR Unidata Program
>> (303)497-8643                                                  P.O. Box 3000
>> address@hidden                                   Boulder, CO 80307
>> ----------------------------------------------------------------------------
>> Unidata WWW Service              http://my.unidata.ucar.edu/content/support 
>> ****************************************************************************
>> 
>
>