Re: [conduit] GFS spotty since 0Z

• To: "Tyle, Kevin R" <ktyle@xxxxxxxxxx>
• Subject: Re: [conduit] GFS spotty since 0Z
• From: Pete Pokrandt <poker@xxxxxxxxxxxx>
• Date: Tue, 23 Mar 2021 14:46:01 +0000
• Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=aos.wisc.edu; dmarc=pass action=none header.from=aos.wisc.edu; dkim=pass header.d=aos.wisc.edu; arc=none
• Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Xw4HHlU2dsvl6CmoZKYlCTDnT+QG40KYBQ/ZDX7JHtA=; b=XOPcbuUp1n+6n+KkdQOBBvPR9YUZkKsKdjqTDWW0jeBQcsd41eIz3pMrQsbXVhRcOD+nCp3Fof6rr7a35Ui7EqKgYXijxTxETdI+C+ifWOoCf7L65+axDsJ9ugPNy3dTUUKOOESGAR/UtrilO7bp+wgYwimYCvNkSCx8WSxWRIWFo7WJ93UvuBvX1DBtPhnCkU5kTZ2oMsdLRpXWMK4G1gRPBviHWvmQbMnMwf2CvV5uRHKkfUQpQa+TDm/J4vcwDKdgX0y5zV/Vx1uTS8S6JpbB4wxp+X1s2dRrl/SfifDt9u4pCIbV2TbWKXjb1Oa5XqjuUvKm22jxFJ3oaiLaNQ==
• Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=eM8qtipEVjIaQgNQGGvFMfQI7uHyRnEPmNGHEy2Kn8t7vL9Dtc9P3V9QRtgMLn/+E+W8qZJvTulxbiM3yAAsm/B7Na7x2AvluwcEELPJp0FIUdf1sT28nPqItSTop0fQzKRZixspg4TyU87w1TcOHeddpEUZrCiOjTmtHlssbLQeLgmhIQTmcnCiL+5Oz9ZSIuZ8+UbZDckfhPrOhkj1U6sWP2mxQAk/kaW4/1J/41YzPdEz//LLLlA70bwR56n9B2+zO1n0b8yDpLMBFNbT8j8h56Jpn/ZT4zG+e5mblQw/CJDL6LyNx+WsXZUxn2j3i4xaY2sUKIhwxZwkV+o0FA==

Kevin (cc conduit, support, Anne, Dustin)

Re: incomplete GFS runs on conduit

Yes, we are seeing the same. The forecast hours that come through are complete, 
but not all forecast hours are coming through. For the 06 UTC run on the 0p50 
grid last night, it looks complete up to F201 and then there are some forecast 
hours that are completely missing (e.g. F204, F207, F213, etc..)

I seem to recall a problem like this within the past year or two, but I don't 
offhand recall what the problem was or how it got fixed. Something is up on the 
ingest side, where not all of the forecast hours are making into CONDUIT.

You can see the reduction in data amounts on the IDD status graphs at Unidata - 
both for us (idd-agg.aos.wisc.edu) and for Unidata (lead.unidata.ucar.edu)

https://rtstats.unidata.ucar.edu/cgi-bin/rtstats/iddstats_vol_nc?CONDUIT+idd-agg.aos.wisc.edu
https://rtstats.unidata.ucar.edu/cgi-bin/rtstats/iddstats_vol_nc?CONDUIT+lead.unidata.ucar.edu


Here's what the 06 UTC 23 Mar 2021 0p50 GFS run looked like from our end (file 
names are changed from what came over on CONDUIT)


-rw-r--r--. 1 ldm ldm 150475420 Mar 23 04:31 gblav2.21032306_F000
-rw-r--r--. 1 ldm ldm 161458306 Mar 23 04:34 gblav2.21032306_F003
-rw-r--r--. 1 ldm ldm 162855161 Mar 23 04:37 gblav2.21032306_F006
-rw-r--r--. 1 ldm ldm 162587162 Mar 23 04:34 gblav2.21032306_F009
-rw-r--r--. 1 ldm ldm 162917663 Mar 23 04:36 gblav2.21032306_F012
-rw-r--r--. 1 ldm ldm 162116581 Mar 23 04:39 gblav2.21032306_F015
-rw-r--r--. 1 ldm ldm 163642600 Mar 23 04:37 gblav2.21032306_F018
-rw-r--r--. 1 ldm ldm 163140953 Mar 23 04:38 gblav2.21032306_F021
-rw-r--r--. 1 ldm ldm 162532415 Mar 23 04:39 gblav2.21032306_F024
-rw-r--r--. 1 ldm ldm 162443371 Mar 23 04:40 gblav2.21032306_F027
-rw-r--r--. 1 ldm ldm 162900215 Mar 23 04:41 gblav2.21032306_F030
-rw-r--r--. 1 ldm ldm 162325126 Mar 23 04:41 gblav2.21032306_F033
-rw-r--r--. 1 ldm ldm 162115930 Mar 23 04:42 gblav2.21032306_F036
-rw-r--r--. 1 ldm ldm 161711022 Mar 23 04:42 gblav2.21032306_F039
-rw-r--r--. 1 ldm ldm 162205354 Mar 23 04:43 gblav2.21032306_F042
-rw-r--r--. 1 ldm ldm 162494846 Mar 23 04:44 gblav2.21032306_F045
-rw-r--r--. 1 ldm ldm 163184046 Mar 23 04:44 gblav2.21032306_F048
-rw-r--r--. 1 ldm ldm 161488854 Mar 23 04:45 gblav2.21032306_F051
-rw-r--r--. 1 ldm ldm 162339913 Mar 23 04:47 gblav2.21032306_F054
-rw-r--r--. 1 ldm ldm 162605480 Mar 23 04:47 gblav2.21032306_F057
-rw-r--r--. 1 ldm ldm 162067320 Mar 23 04:48 gblav2.21032306_F060
-rw-r--r--. 1 ldm ldm 162428155 Mar 23 04:48 gblav2.21032306_F063
-rw-r--r--. 1 ldm ldm 162421492 Mar 23 04:51 gblav2.21032306_F066
-rw-r--r--. 1 ldm ldm 162414972 Mar 23 04:52 gblav2.21032306_F069
-rw-r--r--. 1 ldm ldm 162541484 Mar 23 04:52 gblav2.21032306_F072
-rw-r--r--. 1 ldm ldm 160813325 Mar 23 04:54 gblav2.21032306_F075
-rw-r--r--. 1 ldm ldm 162061554 Mar 23 04:54 gblav2.21032306_F078
-rw-r--r--. 1 ldm ldm 161611841 Mar 23 04:54 gblav2.21032306_F081
-rw-r--r--. 1 ldm ldm 161876278 Mar 23 04:55 gblav2.21032306_F084
-rw-r--r--. 1 ldm ldm 161372460 Mar 23 04:56 gblav2.21032306_F087
-rw-r--r--. 1 ldm ldm 162169224 Mar 23 04:56 gblav2.21032306_F090
-rw-r--r--. 1 ldm ldm 161434969 Mar 23 04:57 gblav2.21032306_F093
-rw-r--r--. 1 ldm ldm 161021815 Mar 23 04:57 gblav2.21032306_F096
-rw-r--r--. 1 ldm ldm 159923756 Mar 23 04:58 gblav2.21032306_F099
-rw-r--r--. 1 ldm ldm 160659519 Mar 23 05:00 gblav2.21032306_F102
-rw-r--r--. 1 ldm ldm 159581680 Mar 23 05:00 gblav2.21032306_F105
-rw-r--r--. 1 ldm ldm 160292034 Mar 23 05:01 gblav2.21032306_F108
-rw-r--r--. 1 ldm ldm 160712053 Mar 23 05:01 gblav2.21032306_F111
-rw-r--r--. 1 ldm ldm 161058411 Mar 23 05:02 gblav2.21032306_F114
-rw-r--r--. 1 ldm ldm 161093163 Mar 23 05:02 gblav2.21032306_F117
-rw-r--r--. 1 ldm ldm 161976752 Mar 23 05:04 gblav2.21032306_F120
-rw-r--r--. 1 ldm ldm 160955140 Mar 23 05:04 gblav2.21032306_F123
-rw-r--r--. 1 ldm ldm 161864402 Mar 23 05:05 gblav2.21032306_F126
-rw-r--r--. 1 ldm ldm 161284116 Mar 23 05:05 gblav2.21032306_F129
-rw-r--r--. 1 ldm ldm 161914513 Mar 23 05:06 gblav2.21032306_F132
-rw-r--r--. 1 ldm ldm 161183283 Mar 23 05:06 gblav2.21032306_F135
-rw-r--r--. 1 ldm ldm 161934137 Mar 23 05:07 gblav2.21032306_F138
-rw-r--r--. 1 ldm ldm 161018288 Mar 23 05:08 gblav2.21032306_F141
-rw-r--r--. 1 ldm ldm 161258540 Mar 23 05:08 gblav2.21032306_F144
-rw-r--r--. 1 ldm ldm 161227819 Mar 23 05:09 gblav2.21032306_F147
-rw-r--r--. 1 ldm ldm 162484147 Mar 23 05:10 gblav2.21032306_F150
-rw-r--r--. 1 ldm ldm 162453652 Mar 23 05:10 gblav2.21032306_F153
-rw-r--r--. 1 ldm ldm 162169306 Mar 23 05:11 gblav2.21032306_F156
-rw-r--r--. 1 ldm ldm 161267470 Mar 23 05:12 gblav2.21032306_F159
-rw-r--r--. 1 ldm ldm 161089660 Mar 23 05:13 gblav2.21032306_F162
-rw-r--r--. 1 ldm ldm 162070875 Mar 23 05:14 gblav2.21032306_F165
-rw-r--r--. 1 ldm ldm 161681467 Mar 23 05:15 gblav2.21032306_F168
-rw-r--r--. 1 ldm ldm 161140254 Mar 23 05:15 gblav2.21032306_F171
-rw-r--r--. 1 ldm ldm 162243140 Mar 23 05:16 gblav2.21032306_F174
-rw-r--r--. 1 ldm ldm 162092750 Mar 23 05:17 gblav2.21032306_F177
-rw-r--r--. 1 ldm ldm 162156634 Mar 23 05:17 gblav2.21032306_F180
-rw-r--r--. 1 ldm ldm 161621678 Mar 23 05:19 gblav2.21032306_F183
-rw-r--r--. 1 ldm ldm 162393378 Mar 23 05:19 gblav2.21032306_F186
-rw-r--r--. 1 ldm ldm 161208777 Mar 23 05:20 gblav2.21032306_F189
-rw-r--r--. 1 ldm ldm 160910941 Mar 23 05:21 gblav2.21032306_F192
-rw-r--r--. 1 ldm ldm 161003293 Mar 23 05:22 gblav2.21032306_F195
-rw-r--r--. 1 ldm ldm 161413148 Mar 23 05:22 gblav2.21032306_F198
-rw-r--r--. 1 ldm ldm 160776464 Mar 23 05:23 gblav2.21032306_F201
-rw-r--r--. 1 ldm ldm 160265668 Mar 23 05:26 gblav2.21032306_F210
-rw-r--r--. 1 ldm ldm 159395465 Mar 23 05:27 gblav2.21032306_F216
-rw-r--r--. 1 ldm ldm 159484261 Mar 23 05:28 gblav2.21032306_F219
-rw-r--r--. 1 ldm ldm 160606423 Mar 23 05:30 gblav2.21032306_F222
-rw-r--r--. 1 ldm ldm 159827636 Mar 23 05:33 gblav2.21032306_F237
-rw-r--r--. 1 ldm ldm 161442268 Mar 23 05:47 gblav2.21032306_F294
-rw-r--r--. 1 ldm ldm 161139109 Mar 23 05:47 gblav2.21032306_F297
-rw-r--r--. 1 ldm ldm 160828989 Mar 23 05:49 gblav2.21032306_F300
-rw-r--r--. 1 ldm ldm 159837903 Mar 23 05:49 gblav2.21032306_F303
-rw-r--r--. 1 ldm ldm 160115585 Mar 23 05:50 gblav2.21032306_F306
-rw-r--r--. 1 ldm ldm 161293996 Mar 23 05:52 gblav2.21032306_F312
-rw-r--r--. 1 ldm ldm 161529924 Mar 23 05:52 gblav2.21032306_F315
-rw-r--r--. 1 ldm ldm 162262363 Mar 23 05:53 gblav2.21032306_F321
-rw-r--r--. 1 ldm ldm 162652140 Mar 23 05:55 gblav2.21032306_F327
-rw-r--r--. 1 ldm ldm 163059071 Mar 23 05:56 gblav2.21032306_F330
-rw-r--r--. 1 ldm ldm 163167459 Mar 23 05:57 gblav2.21032306_F333
-rw-r--r--. 1 ldm ldm 163317132 Mar 23 05:57 gblav2.21032306_F336
-rw-r--r--. 1 ldm ldm 161847992 Mar 23 06:01 gblav2.21032306_F351
-rw-r--r--. 1 ldm ldm 162842095 Mar 23 06:02 gblav2.21032306_F354
-rw-r--r--. 1 ldm ldm 162385970 Mar 23 06:03 gblav2.21032306_F357
-rw-r--r--. 1 ldm ldm 162980199 Mar 23 06:03 gblav2.21032306_F360
-rw-r--r--. 1 ldm ldm 162501030 Mar 23 06:05 gblav2.21032306_F366
-rw-r--r--. 1 ldm ldm 161922055 Mar 23 06:06 gblav2.21032306_F369
-rw-r--r--. 1 ldm ldm 162414317 Mar 23 06:08 gblav2.21032306_F378
-rw-r--r--. 1 ldm ldm 162022901 Mar 23 06:09 gblav2.21032306_F381

Pete




<http://www.weather.com/tv/shows/wx-geeks/video/the-incredible-shrinking-cold-pool>-----
Pete Pokrandt - Systems Programmer
UW-Madison Dept of Atmospheric and Oceanic Sciences
608-262-3086  - poker@xxxxxxxxxxxx

________________________________
From: Tyle, Kevin R <ktyle@xxxxxxxxxx>
Sent: Tuesday, March 23, 2021 7:38 AM
To: Pete Pokrandt <poker@xxxxxxxxxxxx>
Subject: GFS spotty since 0Z

Hey Pete, hope all is well and you're staying healthy! Thanks for the info re: 
the new "atmos/" subdirectory with the GFSv16. I noticed that both our 0 and 6Z 
GFS grib files were very spotty today ... did you notice the same on your end?

Cheers,

Kevin

_________________________________________________
Kevin Tyle, M.S.; Manager of Departmental Computing
NSF XSEDE Campus Champion
Dept. of Atmospheric & Environmental Sciences
University at Albany
Earth Science 228, 1400 Washington Avenue
Albany, NY 12222
ktyle@xxxxxxxxxx | 518-442-4578 | @nywxguy | he/him/his
_________________________________________________