[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Support #HDQ-517625]: Assistance requested for "Gap in packet sequence" log entries from noaaportIngester

Hi Gregg,

re:
> Thanks for the information about product sizes being the same on the
> systems you have access to.
> 
> LDM on both SBN1 and SBN2 are 6.13.11.

I believe that I knew this, but it was good to restate it.

re:
> I did look on the official AWIPS system at SPC to see what the product
> sizes are compared to SBN1 & SBN2.  It turns out the product sizes on
> AWIPS and SBN2 are the same, and the SBN1 has a smaller product size.
> Recall the AWIPS LDM version is slightly older, 6.12.14.

The product size match between your AWIPS and SBN2 systems is akin to the
product size match between the UW/SSEC machine and the UCAR/Unidata machines
since the UW/SSEC machines are running v6.13.7 and the UCAR/Unidata machines
are running v6.13.11.  Given these matches, I think we can safely conclude
that the size difference is NOT a reflection of anything in the NOAAPort
ingest code included in LDM distributions.

re:
> For example:
> 
> *ACUS02 KWNS:*
> 
> *SBN1:*
> [ldmcp@sbn1 ~/logs]$ grep ACUS02 *log
> 1.nmc.log:20200706T053805.556031Z noaaportIngester[3132] 
> process_prod.c:process_prod:217     NOTE  ACUS02 KWNS 060537 /pSWODY2 
> inserted [cat 1 type 4 ccb 2/0 seq 51026273 size *3021*]
> 1.nmc.log:20200706T174109.199759Z 
> noaaportIngester[31121]process_prod.c:process_prod:217     NOTE  ACUS02 KWNS 
> 061741 /pSWODY2 inserted [cat 1 type 4 ccb 2/0 seq 53221947 size *4535*]
> 
> *SBN2:*
> [ldmcp@sbn2 ~/logs]$ grep ACUS02 *log
> 1.nmc.log:20200706T053805.556039Z noaaportIngester[4137] 
> process_prod.c:process_prod:217     NOTE  ACUS02 KWNS 060537 /pSWODY2 
> inserted [cat 1 type 4 ccb 2/0 seq 51026273 size *3025*]
> 1.nmc.log:20200706T174109.199853Z noaaportIngester[4137] 
> process_prod.c:process_prod:217     NOTE  ACUS02 KWNS 061741 /pSWODY2 
> inserted [cat 1 type 4 ccb 2/0 seq 53221947 size *4539*]
> 
> *AWIPS:*
> bash-4.2$ grep ACUS02 *log
> ldmd.log:Jul  6 05:38:05 cpsbn1-spcn journal: pqact[4853] NOTE: Filed in 
> "/data_store/summaries/20200706/05/ACUS02_KWNS_060537_51026273.2020070605":
> *3025* 20200706053805.556 IDS|DDPLUS 51026273  ACUS02 KWNS 060537 /pSWODY2
> ldmd.log:Jul  6 17:41:14 cpsbn1-spcn journal: pqact[4853] NOTE: Filed in 
> "/data_store/summaries/20200706/17/ACUS02_KWNS_061741_53221947.2020070617":
> *4539* 20200706174109.199 IDS|DDPLUS 53221947  ACUS02 KWNS 061741 /pSWODY2
> nwstg.log:Jul  6 05:38:05 cpsbn1-spcn journal: noaaportIngester[4855] NOTE: 
> ACUS02 KWNS 060537 /pSWODY2 inserted [cat 1 type 4 ccb 2/0 seq 51026273 size 
> *3025*]
> nwstg.log:Jul  6 17:41:09 cpsbn1-spcn journal: noaaportIngester[4855] NOTE: 
> ACUS02 KWNS 061741 /pSWODY2 inserted [cat 1 type 4 ccb 2/0 seq 53221947 size 
> *4539*]
> 
> 
> *ACUS01 KWNS:*
> 
> *SBN1:*
> ldmcp@sbn1 ~/logs]$ grep ACUS01 *log
> 1.nmc.log:20200706T005033.304696Z noaaportIngester[3132]  
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 060050 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 50060321 size 1915]
> 1.nmc.log:20200706T055736.899171Z noaaportIngester[3132]  
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 060557 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 51083251 size 3759]
> 1.nmc.log:20200706T125308.528403Z noaaportIngester[3132]  
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 061253 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 52318573 size 7251]
> 1.nmc.log:20200706T163748.374131Z noaaportIngester[31121] 
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 061637 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 53013867 size 4988]
> 
> *SBN2: *
> ldmcp@sbn2 ~/logs]$ grep ACUS01 *log
> 1.nmc.log:20200706T005033.304791Z noaaportIngester[4137]  
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 060050 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 50060321 size 1919]
> 1.nmc.log:20200706T055736.899186Z noaaportIngester[4137]  
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 060557 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 51083251 size 3763]
> 1.nmc.log:20200706T125308.528432Z noaaportIngester[4137]  
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 061253 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 52318573 size 7255]
> 1.nmc.log:20200706T163748.374109Z noaaportIngester[4137]  
> process_prod.c:process_prod:217     NOTE  ACUS01 KWNS 061637 /pSWODY1 
> inserted [cat 1 type 4 ccb 2/0 seq 53013867 size 4992]
> 
> 
> *AWIPS:*
> bash-4.2$ grep ACUS01 *log
> ldmd.log:Jul  6 05:57:36 cpsbn1-spcn journal: pqact[4853] NOTE: Filed in 
> "/data_store/summaries/20200706/05/ACUS01_KWNS_060557_51083251.2020070605":
> 3763 20200706055736.900 IDS|DDPLUS 51083251  ACUS01 KWNS 060557 /pSWODY1
> ldmd.log:Jul  6 12:53:08 cpsbn1-spcn journal: pqact[4853] NOTE: Filed in 
> "/data_store/summaries/20200706/12/ACUS01_KWNS_061253_52318573.2020070612":
> 7255 20200706125308.528 IDS|DDPLUS 52318573  ACUS01 KWNS 061253 /pSWODY1
> ldmd.log:Jul  6 16:37:48 cpsbn1-spcn journal: pqact[4853] NOTE: Filed in 
> "/data_store/summaries/20200706/16/ACUS01_KWNS_061637_53013867.2020070616":
> 4992 20200706163748.373 IDS|DDPLUS 53013867  ACUS01 KWNS 061637 /pSWODY1
> nwstg.log:Jul  6 05:57:36 cpsbn1-spcn journal: noaaportIngester[4855] NOTE: 
> ACUS01 KWNS 060557 /pSWODY1 inserted [cat 1 type 4 ccb 2/0 seq 51083251 size 
> 3763]
> nwstg.log:Jul  6 12:53:08 cpsbn1-spcn journal: noaaportIngester[4855] NOTE: 
> ACUS01 KWNS 061253 /pSWODY1 inserted [cat 1 type 4 ccb 2/0 seq 52318573 size 
> 7255]
> nwstg.log:Jul  6 16:37:48 cpsbn1-spcn journal: noaaportIngester[4855] NOTE: 
> ACUS01 KWNS 061637 /pSWODY1 inserted [cat 1 type 4 ccb 2/0 seq 53013867 size 
> 4992]
> 
> 
> *ASUS44 KLZK:*
> 
> *SBN1:*
> 20200706T190309.796879Z noaaportIngester[2669]  
> process_prod.c:process_prod:217     NOTE  ASUS44 KLZK 061903 /pRWRLZK 
> inserted [cat 1 type 4 ccb 2/0 seq 53475920 size 3697]
> 
> *SBN2:*
> 0200706T190309.796782Z noaaportIngester[4137]  
> process_prod.c:process_prod:217     NOTE  ASUS44 KLZK 061903 /pRWRLZK 
> inserted [cat 1 type 4 ccb 2/0 seq 53475920 size 3701]
> 
> *AWIPS:*
> nwstg.log:Jul  6 19:03:09 cpsbn1-spcn journal: noaaportIngester[4855] NOTE: 
> ASUS44 KLZK 061903 /pRWRLZK inserted [cat 1 type 4 ccb 2/0 seq 53475920 size 
> 3701]
> 
> *FNUS53 KBIS:*
> 
> *SBN1:*
> 20200706T191400.904227Z noaaportIngester[4545]  
> process_prod.c:process_prod:217     NOTE  FNUS53 KBIS 061913 /pFWFBIS 
> inserted [cat 1 type 4 ccb 2/0 seq 53508973 size 36952]
> 
> *SBN2:*
> 20200706T191400.903692Z noaaportIngester[4137]  
> process_prod.c:process_prod:217     NOTE  FNUS53 KBIS 061913 /pFWFBIS 
> inserted [cat 1 type 4 ccb 2/0 seq 53508973 size 36956]
> 
> *AWIPS:*
> nwstg.log:Jul  6 19:14:00 cpsbn1-spcn journal: noaaportIngester[4855] NOTE: 
> FNUS53 KBIS 061913 /pFWFBIS inserted [cat 1 type 4 ccb 2/0 seq 53508973 size 
> 36956]
> 
> 
> *The SBN2 server invoked noaaportIngester as the following:*
> 
> root      4137  4133  4 Jul01 ?        04:52:51 noaaportIngester -m 224.0.1.1 
> -n -l /home/ldmcp/logs/1.nmc.log
> root      4138  4133  0 Jul01 ?        00:00:02 noaaportIngester -m 224.0.1.2 
> -n -l /home/ldmcp/logs/2.goes.log
> root      4139  4133  9 Jul01 ?        10:52:09 noaaportIngester -m 224.0.1.3 
> -n -l /home/ldmcp/logs/3.nmc2.log
> root      4140  4133  0 Jul01 ?        00:12:27 noaaportIngester -m 224.0.1.4 
> -n -l /home/ldmcp/logs/4.nopt.log
> root      4141  4133  0 Jul01 ?        00:23:58 noaaportIngester -m 224.0.1.5 
> -n -l /home/ldmcp/logs/5.nmc3.log
> root      4142  4133  1 Jul01 ?        01:23:05 noaaportIngester -m 224.0.1.8 
> -n -l /home/ldmcp/logs/8.exp.log
> root      4143  4133  0 Jul01 ?        00:00:00 noaaportIngester -m 224.0.1.9 
> -n -l /home/ldmcp/logs/9.grw.log
> root      4144  4133  3 Jul01 ?        03:51:41 noaaportIngester -m 
> 224.0.1.10 -n -l /home/ldmcp/logs/10.gre.log
> 
> *I've tried invoking the noaaportIngester on SBN1 like the above, in SBN2,
> and the following, but in both cases the received product sizes are smaller
> than SBN1 and AWIPS:*
> 
> root      4545  4541  4 19:13 ?        00:00:09 noaaportIngester *-I 
> 10.0.5.50 *-m 224.0.1.1 -n -l /home/ldmcp/logs/1.nmc.log
> root      4546  4541  0 19:13 ?        00:00:01 noaaportIngester -I 10.0.5.50 
> -m 224.0.1.2 -n -l /home/ldmcp/logs/2.goes.log
> root      4547  4541  5 19:13 ?        00:00:11 noaaportIngester -I 10.0.5.50 
> -m 224.0.1.3 -n -l /home/ldmcp/logs/3.nmc2.log
> root      4548  4541  0 19:13 ?        00:00:01 noaaportIngester -I 10.0.5.50 
> -m 224.0.1.4 -n -l /home/ldmcp/logs/4.nopt.log
> root      4549  4541  0 19:13 ?        00:00:01 noaaportIngester -I 10.0.5.50 
> -m 224.0.1.5 -n -l /home/ldmcp/logs/5.nmc3.log
> root      4550  4541  1 19:13 ?        00:00:02 noaaportIngester -I 10.0.5.50 
> -m 224.0.1.8 -n -l /home/ldmcp/logs/8.exp.log
> root      4551  4541  3 19:13 ?        00:00:07 noaaportIngester -I 10.0.5.50 
> -m 224.0.1.9 -n -l /home/ldmcp/logs/9.grw.log
> root      4552  4541  5 19:13 ?        00:00:12 noaaportIngester -I 10.0.5.50 
> -m 224.0.1.10 -n -l /home/ldmcp/logs/10.gre.log
> 
> 
> *One difference* is SBN1 is in the satellite farm with a direct connection
> to the NOVRA box, while SBN2 and AWIPS are in the server room and have
> media-converters being used.

OK.  This is good to re-note for the record.

re:
> This should be resolved so LDM will DUP out the products on the downstream
> LDM servers, otherwise every product will be acted on twice (e.g. decoded
> twice, written to file twice).

Have you actually tried to REQUEST feeds from both SBN1 and SBN2 and see
if the product's MD5 signatures are, in fact, different?  This would be a
good test to run!

re:
> Any suggestions?

Since we don't have access to your machines, it is hard to come up with
any reason(s) for the difference you are seeing, sorry.

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: HDQ-517625
Department: Support NOAAPORT
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.