[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Duplicate Products



Daryl,

These products (eg 1608Z and 1716Z) were broadcast on NOAAPORT multiple
times, with unique ids, and the MD5 checksum that is calculated is
unique due to the different number of bytes/lines etc.

May 18 15:46:09 WUUS53 KIND 181545 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5488157 size 1090] 
May 18 16:08:47 WUUS53 KIND 181608 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5511107 size 1107] 
May 18 16:09:41 WUUS53 KIND 181608 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5511891 size 1104] 
May 18 16:22:23 WUUS53 KIND 181622 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5522054 size 1179] 
May 18 16:26:38 WUUS53 KIND 181626 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5525169 size 1347] 
May 18 16:42:21 WUUS53 KIND 181642 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5537768 size 1119] 
May 18 16:45:10 WUUS53 KIND 181644 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5540113 size 1034] 
May 18 17:09:52 WUUS53 KIND 181709 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5558401 size 1024] 
May 18 17:16:20 WUUS53 KIND 181716 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5563340 size 1247] 
May 18 17:17:17 WUUS53 KIND 181716 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5563908 size 1244] 
May 18 18:07:44 WUUS53 KIND 181807 /pSVRIND inserted [cat 1 type 4 ccb 2/0 seq 
5604971 size 880]

The LDM will reject products which have the same MD5 checksums, however, since 
the
content within the bulletin on NOAAPORT is unique, they are both delivered.

Steve Chiswell
Unidata User Support


On Thu, 2006-05-18 at 11:31, Daryl Herzmann wrote:
> Hi,
> 
> I have been noticing some duplicate NWS products in the IDD stream this 
> morning.  For example,
> 
> $ pqcat -v -l - -f IDS -p "/p(SVRIND)" > /dev/null
> May 18 17:23:03 pqcat NOTE: Starting Up (7989)
> May 18 17:23:16 pqcat INFO:     1090 20060518154609.452 IDS|DDPLUS 5488157 
> WUUS53 KIND 181545 /pSVRIND
> May 18 17:23:50 pqcat INFO:     1107 20060518160847.083 IDS|DDPLUS 5511107 
> WUUS53 KIND 181608 /pSVRIND
> May 18 17:23:51 pqcat INFO:     1104 20060518160941.666 IDS|DDPLUS 5511891 
> WUUS53 KIND 181608 /pSVRIND  <-- DUP
> May 18 17:24:11 pqcat INFO:     1179 20060518162222.470 IDS|DDPLUS 5522054 
> WUUS53 KIND 181622 /pSVRIND
> May 18 17:24:15 pqcat INFO:     1347 20060518162637.775 IDS|DDPLUS 5525169 
> WUUS53 KIND 181626 /pSVRIND
> May 18 17:24:37 pqcat INFO:     1119 20060518164221.951 IDS|DDPLUS 5537768 
> WUUS53 KIND 181642 /pSVRIND
> May 18 17:24:40 pqcat INFO:     1034 20060518164510.313 IDS|DDPLUS 5540113 
> WUUS53 KIND 181644 /pSVRIND
> May 18 17:24:55 pqcat INFO:     1024 20060518170952.243 IDS|DDPLUS 5558401 
> WUUS53 KIND 181709 /pSVRIND
> May 18 17:24:56 pqcat INFO:     1247 20060518171620.707 IDS|DDPLUS 5563340 
> WUUS53 KIND 181716 /pSVRIND
> May 18 17:24:57 pqcat INFO:     1244 20060518171717.084 IDS|DDPLUS 5563908 
> WUUS53 KIND 181716 /pSVRIND <-- DUP
> 
> 
> So, there are two dups in there with a size difference of 3 bytes and a 
> timestamp difference of around 50 seconds.  Diffing the dups reveils that 
> the pqinsert seq number differs and there is an extra line feed in one of 
> the products near the end.  I asked a local WFO if they have two copies of 
> the 1716 SVRIND and they said they didn't.
> 
> Anybody else seeing this?  Perhaps there is an issue upstream on the IDD?
> 
> thanks,
>   daryl