Just an FYI the CONDUIT latency times continue to slowly increase. Unidata is
seeing the same slowly increasing lags, so that suggests to me it is an issue
with the source. I don't think we're actually getting data that much later, I
think the clock has a slow drift on conduit.ncep.noaa.gov.
We are not experiencing any real problems with this right now, but if the lag
grows larger than 3600 seconds, I am concerned we will begin losing data, since
(as I understand it) the ldm doesn't ask for data more than an hour old.
Can you please have someone look into this at some point?
Thanks,
Pete
[cid:58106196-ef48-4d9d-b000-7f87319ce235]
<http://www.weather.com/tv/shows/wx-geeks/video/the-incredible-shrinking-cold-pool>-----
Pete Pokrandt - Systems Programmer
UW-Madison Dept of Atmospheric and Oceanic Sciences
608-262-3086 - poker@xxxxxxxxxxxx
________________________________
From: Dustin Sheffler - NOAA Federal <dustin.sheffler@xxxxxxxx>
Sent: Friday, June 5, 2020 1:50 PM
To: Pete Pokrandt <poker@xxxxxxxxxxxx>
Cc: Carissa Klemmer - NOAA Federal <carissa.l.klemmer@xxxxxxxx>; Anne Myckow -
NOAA Federal <anne.myckow@xxxxxxxx>; _NCEP.List.pmb-dataflow
<ncep.list.pmb-dataflow@xxxxxxxx>
Subject: Re: [Ncep.list.pmb-dataflow] [conduit] NCEP CONDUIT Outage planned
Hi Pete,
Thank you for passing along the information about the increasing lag times your
seeing for CONDUIT ingest. That is a very interesting and telling graph for a
slowly worsening issue. We will investigate and let you know what we find.
-Dustin
On Tue, Jun 2, 2020 at 5:15 PM 'Pete Pokrandt' via _NCEP list.pmb-dataflow
<ncep.list.pmb-dataflow@xxxxxxxx<mailto:ncep.list.pmb-dataflow@xxxxxxxx>> wrote:
Carissa, Anne,
Thanks so much for keeping us updated on these outages.
FYI I think there is a slow clock drift on the CONDUIT source machine
conduit.ncep.noaa.gov<http://conduit.ncep.noaa.gov>. I'm seeing the lags slowly
increasing at my ingest site, and I see the same slow increase on
conduit.unidata.ucar.edu<http://conduit.unidata.ucar.edu>. I don't see the same
drift on data feeds from other sources.
Maybe the conduit.ncep.noaa.gov<http://conduit.ncep.noaa.gov> isn't running
ntpd to keep the time accurate?
https://rtstats.unidata.ucar.edu/cgi-bin/rtstats/iddstats_nc?CONDUIT+idd-agg.aos.wisc.edu
https://rtstats.unidata.ucar.edu/cgi-bin/rtstats/iddstats_nc?CONDUIT+conduit.unidata.ucar.edu
[cid:17285ce99bacb971f161]
Thanks,
Pete
<http://www.weather.com/tv/shows/wx-geeks/video/the-incredible-shrinking-cold-pool>-----
Pete Pokrandt - Systems Programmer
UW-Madison Dept of Atmospheric and Oceanic Sciences
608-262-3086 - poker@xxxxxxxxxxxx<mailto:poker@xxxxxxxxxxxx>
________________________________
From: conduit
<conduit-bounces@xxxxxxxxxxxxxxxx<mailto:conduit-bounces@xxxxxxxxxxxxxxxx>> on
behalf of Anne Myckow - NOAA Federal via conduit
<conduit@xxxxxxxxxxxxxxxx<mailto:conduit@xxxxxxxxxxxxxxxx>>
Sent: Monday, June 1, 2020 1:00 PM
To: Carissa Klemmer - NOAA Federal
<carissa.l.klemmer@xxxxxxxx<mailto:carissa.l.klemmer@xxxxxxxx>>
Cc: support-conduit@xxxxxxxxxxxxxxxx<mailto:support-conduit@xxxxxxxxxxxxxxxx>
<conduit@xxxxxxxxxxxxxxxx<mailto:conduit@xxxxxxxxxxxxxxxx>>;
_NCEP.List.pmb-dataflow
<ncep.list.pmb-dataflow@xxxxxxxx<mailto:ncep.list.pmb-dataflow@xxxxxxxx>>
Subject: Re: [conduit] [Ncep.list.pmb-dataflow] NCEP CONDUIT Outage planned
Hello,
Wanted to let you know that the 6/3 outage has been moved to 6/8, same time .
Please let us know if you have any questions, thanks.
Anne
On Thu, May 28, 2020 at 8:23 PM Carissa Klemmer - NOAA Federal
<carissa.l.klemmer@xxxxxxxx<mailto:carissa.l.klemmer@xxxxxxxx>> wrote:
Hello -
We have 2 dates of maintenance that I'd like to make you aware of, both of
which may impact your ability to pull conduit data.
6/1 between 13-15Z
6/3 between 13-15Z
Expect that the outage will last the entire 2 hours. Data will be queued up to
backfill anything that was missed during the outage. If you have any questions
please ask the dataflow team.
Thanks,
Carissa Klemmer
NCEP Central Operations
IDSB Branch Chief
301-683-3835
_______________________________________________
Ncep.list.pmb-dataflow mailing list
Ncep.list.pmb-dataflow@xxxxxxxxxxxxxxxxxxxx<mailto:Ncep.list.pmb-dataflow@xxxxxxxxxxxxxxxxxxxx>
https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.pmb-dataflow
--
Anne Myckow
Dataflow Team Lead
NWS/NCEP/NCO
301-683-3825
_______________________________________________
Ncep.list.pmb-dataflow mailing list
Ncep.list.pmb-dataflow@xxxxxxxxxxxxxxxxxxxx<mailto:Ncep.list.pmb-dataflow@xxxxxxxxxxxxxxxxxxxx>
https://www.lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.pmb-dataflow
--
Dustin Sheffler
NCEP Central Operations - Dataflow
<tel:%28301%29%20683-1400>5830 University Research Court, Rm 1030
College Park, Maryland 20740
Office: (301) 683-3827<tel:%28301%29%20683-1400>
<tel:%28301%29%20683-1400>
