Re: [conduit] Recent CONDUIT latencies?

• To: "support-conduit@xxxxxxxxxxxxxxxx" <conduit@xxxxxxxxxxxxxxxx>, Anne Myckow - NOAA Federal <anne.myckow@xxxxxxxx>, Pete Pokrandt <poker@xxxxxxxxxxxx>
• Subject: Re: [conduit] Recent CONDUIT latencies?
• From: "Herzmann, Daryl E [AGRON]" <akrherz@xxxxxxxxxxx>
• Date: Mon, 17 May 2021 15:51:50 +0000
• Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=iastate.edu; dmarc=pass action=none header.from=iastate.edu; dkim=pass header.d=iastate.edu; arc=none
• Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EKj4OZH+8ubHGbE95E1YdRvmF2l2VBmG+VFx445EOFE=; b=L86NoyCAZuEBFFuVoHJo9GegYqkYu4rFZPCmhVn2qeL/MKP8G/qnrwlrrf7qPpx79ye9nqiO2bIAn4AooR6uGgaw2I6lAuWgieT5TIzIFpHgVk0knLS1ZkdVg3nqqe+TUc5WLtRc0cZPbCBGrTrdaSgRM5myF8OTzrn9OXOzvtOia/dk1UW2QmSIyaDboaovw+VrK6FweyvPIc1KUrfPIzRl00P3WE8WQSvikatWDzvUXcYJ8tAw6amlLs5RppJ+YeJsQuIU93HGzeH4noMjIoaZxcBnERHKmxxlUEsszOyGp48J/0POXWp0j4U8IN8a3U8Yaw5l/ZMwV//V78idRA==
• Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AR+NFuJ50EpFxQjhgy98Tkd0batnflc5oRXq8GSpyG+9ZOQUhVTaOGDp/qNo90XJdhdhKYj4YXyKRVXnxlbiWOucagN3pJIXNQguqxs8vTS2ZhRUt46ggWfEyWcxJjR6nDAZtS50kPG8Xy0Ou2Y3lajfP4GCUllBH0DEguicYIZii1M9bJLFjwB1/z5v+rO0kDn0Q5+WVRgmM3JnRBejaCLFAldYwelYauRTLsySqMvqpD47SuuXbvhtynGQI8P6pEMgsPdC2lPGIN3HKyXnk4xsOow33QVF7mfTGLQkFPPVeTqtHv2tl0tX4KBuedk2Q26Y3XQu0n2Urlir9M9F8w==
• Authentication-results: unidata.ucar.edu; dkim=none (message not signed) header.d=none;unidata.ucar.edu; dmarc=none action=none header.from=iastate.edu;

Howdy Pete,

How heavily sharded (how many LDM FEED requests) are you making to get all the 
CONDUIT data that you need?  If you totaled up all your feed request volume and 
divided by the number of LDM requests, what rough number do you get for 
bandwidth per LDM TCP connection? :)

daryl

--
/**
 * daryl herzmann
 * Systems Analyst III -- Iowa Environmental Mesonet
 * https://mesonet.agron.iastate.edu
 */

________________________________________
From: conduit <conduit-bounces@xxxxxxxxxxxxxxxx> on behalf of Pete Pokrandt via 
conduit <conduit@xxxxxxxxxxxxxxxx>
Sent: Saturday, May 15, 2021 10:52 AM
To: support-conduit@xxxxxxxxxxxxxxxx; Anne Myckow - NOAA Federal
Subject: Re: [conduit] Recent CONDUIT latencies?

Anne,

Over the past few days, our latencies have been in line with what we have come 
to expect - 30-60 seconds as the bursts of model forecast hours come through.

Here's the graph of our latencies the past ~3 days. That red blip around 15/06 
looks like maybe a conduit ingest server's ldm was restarted? Other than that, 
they are pretty consistently 30-60s. This graph can be found at

https://rtstats.unidata.ucar.edu/cgi-bin/rtstats/iddstats_nc?CONDUIT+idd-agg.aos.wisc.edu


Pete

[cid:9377ebe1-5745-4dd7-bec0-98a991b681d2]




<http://www.weather.com/tv/shows/wx-geeks/video/the-incredible-shrinking-cold-pool>-----
Pete Pokrandt - Systems Programmer
UW-Madison Dept of Atmospheric and Oceanic Sciences
608-262-3086  - poker@xxxxxxxxxxxx

________________________________
From: conduit <conduit-bounces@xxxxxxxxxxxxxxxx> on behalf of Anne Myckow - 
NOAA Federal via conduit <conduit@xxxxxxxxxxxxxxxx>
Sent: Tuesday, May 11, 2021 2:57 PM
To: support-conduit@xxxxxxxxxxxxxxxx <conduit@xxxxxxxxxxxxxxxx>
Subject: [conduit] Recent CONDUIT latencies?

CONDUIT users,

Can you let us know what your latencies have been recently? We have had 
customers complaining about transfer rates on some of our systems and I want to 
see if it might be affecting you as well.

Thanks,
Anne
--
Anne Myckow
Dataflow Team Lead
NWS/NCEP/NCO

Attachment: image.png
Description: image.png

• Follow-Ups:
  • Re: [conduit] Recent CONDUIT latencies?
    • From: Person, Arthur A.

• References:
  • [conduit] Recent CONDUIT latencies?
    • From: Anne Myckow - NOAA Federal
  • Re: [conduit] Recent CONDUIT latencies?
    • From: Pete Pokrandt