Re: [ldm-users] my data seems to be blackhole-ing

Blair, using notifyme on my own host, I see that your pqact regex does match:


[ldm@curoi ~]$ notifyme -xvl - -f NEXRAD2
    <snip>
Jul 15 22:00:45 notifyme[12695] INFO: 4dbf8f1267267ef84bbf5116ca74bf27    72827 
20130715220044.013 NEXRAD2 248034  L2-BZIP2/KPUX/20130715215857/248/34/I/V06/0
Jul 15 22:00:45 notifyme[12695] INFO: 9ca012c97e06efca9825648d61147346    31772 
20130715220044.972 NEXRAD2 336009  L2-BZIP2/KRGX/20130715220021/336/9/I/V06/0
^CJul 15 22:00:45 notifyme[12695] NOTE: exiting
[ldm@curoi ~]$ regex -s "L2-BZIP2/KRGX/20130715220021/336/9/I/V06/0" 
"^L2-BZIP2/(....)/([0-9]{8})([0-9]{4})[0-9]{2}/([0-9]{1,4}).*/[SI]"
match
[ldm@curoi ~]$

What do you see?

On 7/15/13 4:56 PM, Blair Trosper wrote:
The only thing I have in my pqact.conf is to request all NEXRAD2 from
idd.tamu.edu <http://idd.tamu.edu>

I've left ldmadmin in verbose mode for the last 20 minutes, and it's put
nothing besides the contents of "ldmadmin watch" into that file.

What else should I be seeing?


On Mon, Jul 15, 2013 at 4:54 PM, Gerry Creager - NOAA Affiliate
<gerry.creager@xxxxxxxx <mailto:gerry.creager@xxxxxxxx>> wrote:

    It'a actually adding more than just the contents of ldmadmin watch
    to the file. What you can do, after enabling verbose mode, is
    'ldmadmin tail' to see the logging live. I suspect you've got the
    requests coming in but perhaps you have a bunch of lines commented
    out in ~/etc/pqact.conf, and it's unable to to find anything it
    thinks it's supposed to write out.

    OR... another issue: What do your request lines look like? (parallel
    question: What version of ldm are you running?) If your request line
    is 'request ANY ".*" from foo.bar' you will get the feeling you
    should be seeing something, but you won't on later versions of LDM.

    gerry


    On Mon, Jul 15, 2013 at 4:45 PM, Blair Trosper
    <blair.trosper@xxxxxxxxxxxxxxxxxxx
    <mailto:blair.trosper@xxxxxxxxxxxxxxxxxxx>> wrote:

        My which I mean it only adds the contents of "ldmadmin watch" to
        the ldmd.log, which doesn't really help me.

        I used "ldmadmin restart -v", did you mean something else?
          Perhaps I misunderstood.  :/


        On Mon, Jul 15, 2013 at 4:44 PM, Karen Cooper - NOAA Affiliate
        <karen.cooper@xxxxxxxx <mailto:karen.cooper@xxxxxxxx>> wrote:

            Try putting pqact into verbose mode.

            exec "pqact -v"

            and then restart ldm.  It should tell you everything pqact
            is doing.


            On Mon, Jul 15, 2013 at 4:42 PM, Blair Trosper
            <blair.trosper@xxxxxxxxxxxxxxxxxxx
            <mailto:blair.trosper@xxxxxxxxxxxxxxxxxxx>> wrote:

                It's enabled and not commented.

                Putting ldm into verbose mode didn't seem to yield
                anything additional in the log files.  In fact, it's
                very UNdescriptive.


                On Mon, Jul 15, 2013 at 4:41 PM, Karen Cooper - NOAA
                Affiliate <karen.cooper@xxxxxxxx
                <mailto:karen.cooper@xxxxxxxx>> wrote:

                    And of course what I really meant was the exec line
                    in your ldmd.conf...

                    exec    "pqact "


                    On Mon, Jul 15, 2013 at 4:40 PM, Karen Cooper - NOAA
                    Affiliate <karen.cooper@xxxxxxxx
                    <mailto:karen.cooper@xxxxxxxx>> wrote:

                        Blair,

                        First a sanity check. -- Are you sure that pqact
                        is uncommented in your ldmadmin.pl
                        <http://ldmadmin.pl>?

                        You can set pqact to verbose mode and then you
                        should see what it's trying to do, as it will
                        log to your ldmd.log files.  I often use this
                        when I'm testing out new pqact entries that
                        aren't working as I expect.


                        On Mon, Jul 15, 2013 at 4:35 PM, Blair Trosper
                        <blair.trosper@xxxxxxxxxxxxxxxxxxx
                        <mailto:blair.trosper@xxxxxxxxxxxxxxxxxxx>> wrote:

                            I'm receiving several feeds as proven by
                            ldmadmin watch...and the logs all look fine.
                              However, my data isn't being saved to disk.

                             From *registry.xml*:

                                   <pqact>

                                
<config-path>/mnt/data/ldm/etc/pqact.conf</config-path>

                                
<datadir-path>/mnt/data/ldm/var/data</datadir-path>
                                   </pqact>


                             From */mnt/data/ldm/etc/pqact.conf*:

                                # L2 data
                                NEXRAD2
                                
^L2-BZIP2/(....)/([0-9]{8})([0-9]{4})[0-9]{2}/([0-9]{1,4}).*/[SI]
                                         FILE    nexrad2/\1/\1_\2-\3.part
                                NEXRAD2
                                
^L2-BZIP2/(....)/([0-9]{8})([0-9]{4})[0-9]{2}/([0-9]{1,4}).*/E
                                         FILE    -close
                                nexrad2/\1/\1_\2-\3.part
                                (snip)


                            However, following those two things, here's
                            a directory listing of */mnt/data/ldm/var/data*:

                                ldm@chicago-il-1:~/data$ ls -lsha
                                total 8.0K
                                4.0K drwxr-xr-x 2 ldm ldm 4.0K Jul 15
                                16:09 .
                                4.0K drwxr-xr-x 5 ldm ldm 4.0K Jul 13
                                23:19 ..


                            Nothing.  The same is true of other feeds
                            which should be stashed in other subdirectories.

                            The bandwidth is certainly registering,
                            which I have verified at the router, so I'm
                            definitely receiving the data...so...

                            Where are my files going?  Any way to track
                            this down?

                            (I've also done "du -ksh" from the home
                            directory of the ldm user over the last few
                            hours, and it's not increasing.  Definitely
                            nothing being written to hard disk.  And
                            still no errors in the LDM or system logs.)

                            --
                            Blair Trosper
                            Weather Data / Updraft Networks
                            blair.trosper@xxxxxxxxxxxxxxxxxxx
                            <mailto:blair.trosper@xxxxxxxxxx>
                            NOC: 512-666-0536

                            _______________________________________________
                            ldm-users mailing list
                            ldm-users@xxxxxxxxxxxxxxxx
                            <mailto:ldm-users@xxxxxxxxxxxxxxxx>
                            For list information or to unsubscribe,
                              visit:
                            http://www.unidata.ucar.edu/mailing_lists/




                        --
                        “Climate is what you expect, weather is what you
                        get."
                          -- Robert A. Heinlein

                        -------------------------------------------
                        Karen.Cooper@xxxxxxxx <mailto:Karen.Cooper@xxxxxxxx>

                        Phone: 405-325-6982 <tel:405-325-6982>
                        Cell: 405-834-8559 <tel:405-834-8559>
                        INDUS Corporation
                        National Severe Storms Laboratory




                    --
                    “Climate is what you expect, weather is what you get."
                      -- Robert A. Heinlein

                    -------------------------------------------
                    Karen.Cooper@xxxxxxxx <mailto:Karen.Cooper@xxxxxxxx>

                    Phone: 405-325-6982 <tel:405-325-6982>
                    Cell: 405-834-8559 <tel:405-834-8559>
                    INDUS Corporation
                    National Severe Storms Laboratory




                --
                Blair Trosper
                Weather Data / Updraft Networks
                blair.trosper@xxxxxxxxxxxxxxxxxxx
                <mailto:blair.trosper@xxxxxxxxxx>
                NOC: 512-666-0536




            --
            “Climate is what you expect, weather is what you get."
              -- Robert A. Heinlein

            -------------------------------------------
            Karen.Cooper@xxxxxxxx <mailto:Karen.Cooper@xxxxxxxx>

            Phone: 405-325-6982 <tel:405-325-6982>
            Cell: 405-834-8559 <tel:405-834-8559>
            INDUS Corporation
            National Severe Storms Laboratory




        --
        Blair Trosper
        Weather Data / Updraft Networks
        blair.trosper@xxxxxxxxxxxxxxxxxxx <mailto:blair.trosper@xxxxxxxxxx>
        NOC: 512-666-0536

        _______________________________________________
        ldm-users mailing list
        ldm-users@xxxxxxxxxxxxxxxx <mailto:ldm-users@xxxxxxxxxxxxxxxx>
        For list information or to unsubscribe,  visit:
        http://www.unidata.ucar.edu/mailing_lists/




    --
    Gerry Creager
    NSSL/CIMMS
    405.325.6371 <tel:405.325.6371>
    ++++++++++++++++++++++
    “Big whorls have little whorls,
    That feed on their velocity;
    And little whorls have lesser whorls,
    And so on to viscosity.”
    Lewis Fry Richardson (1881-1953)




--
Blair Trosper
Weather Data / Updraft Networks
blair.trosper@xxxxxxxxxxxxxxxxxxx <mailto:blair.trosper@xxxxxxxxxx>
NOC: 512-666-0536


_______________________________________________
ldm-users mailing list
ldm-users@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/




  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: