Re: [thredds] Authentication problems with the TDS and pydap

  • To: "Pols, Maarten" <M.Pols@xxxxxx>, "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx>
  • Subject: Re: [thredds] Authentication problems with the TDS and pydap
  • From: Jim Fluke <james.fluke@xxxxxxxxxxxxx>
  • Date: Thu, 11 Jul 2024 11:47:43 -0600
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=colostate.edu; dmarc=pass action=none header.from=colostate.edu; dkim=pass header.d=colostate.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=RoeISOjnkAqxLlI2nv8XyD/06jtDmGlm55KMbz7T/D4=; b=lTYsXtjPLiL8omjfPovHcJLUYgkNLKXdPbKc76CiO1JcwNOPhTUB39SS2ReQZoGxILN6Z9yft2dcEPc9nnwORaqFfr4vMcmGP8zLabWGQXDWeK/ChTO8Mx1I3bqAsBTswRcS8qVG4WTrcA5L2kVeaoDQduJ6TG3cZiHHr5iW47TKMbrYumf2NxljuPZNJ4N0M5dBGuzMt5FoXwoMC4Rns5UjEylbashZI/7jymmFmytictQAUKUkDjHefAxiU4g7eA6TssLFnD28/Tjt5PFPLk7CvEfXabD6nrHjq0Ubgjd9c327bfIqcn2k6BP0fsPilmIZsjqL9GB3pMT+GkTKIA==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=rjNcga+NWUDT0rnpI+TVc/H98r781LkgLkff3lU01d23Ol7vnM+RWQ6W8BxkWX5nbrGj2EPO434snTN/3ZEPNvwdOjZWc3bA9TlNrZhnlOyYIpA5WcIdEE4iyenPF+OlwcqUtTktoPK46UMv7NUBhT7Vg/3fP3uNNzRTY6i0XAlAMcIdOaoOLZpqabDnTW/X5nt54N5pi3AHChvYSKbsZpXks4B5XWPwbMi5veMVT0eBwmrzejBRLyVdU3Ik4K0UlSCiSNznKpzB/2X3n41uvmJOGt+Ll52+HZQXdXvD/S0yzdjfiUvd1FmcTyqCU3xsL9hrXyzeQTm4IATuWXt1ow==
  • Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=colostate.edu;
<!DOCTYPE html><html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body>
    Pols,<br>
    <br>
    I created a self-signed certificate since it's just for testing
    right now. So far I can't get it to work though. Here are the errors
    I get at TDS start up:<br>
    <span style="font-family:monospace"><span 
style="color:#000000;background-color:#ffffff;">10-Jul-2024
        15:26:16.372 SEVERE [main]
        org.apache.catalina.util.LifecycleBase.handleSubClassException
        Failed to initialize component
        [Connector[&quot;https-openssl-nio-8443&quot;]]
      </span><br>
      
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;org.apache.catalina.LifecycleException:
 Protocol handler
      initialization failed<br>
      &nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; .<br>
      &nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; .<br>
      &nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; .<br>
      &nbsp;&nbsp;&nbsp; &nbsp;&nbsp; </span><span 
style="font-family:monospace"><span 
style="color:#000000;background-color:#ffffff;">Caused by:
        java.lang.IllegalArgumentException: Keystore was tampered with,
        or password was incorrect</span></span><span 
style="font-family:monospace"><span 
style="color:#000000;background-color:#ffffff;"><br>
        &nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; .<br>
        &nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; .<br>
        &nbsp;&nbsp;&nbsp; &nbsp;&nbsp;&nbsp;&nbsp; .<br>
        &nbsp;&nbsp;&nbsp; &nbsp;&nbsp; Caused by: 
java.security.UnrecoverableKeyException:
        Password verification failed</span></span><span 
style="font-family:monospace"><span 
style="color:#000000;background-color:#ffffff;"><br>
      </span></span><br>
    And, I am still using 8443. Also because this is a test environment.<br>
    <br>
    Do you have any idea where I can change the password. If that really
    is the problem.<br>
    <br>
    Thanks,<br>
    Jim<br>
    <br>
    <div class="moz-cite-prefix">On 7/10/24 01:33, Pols, Maarten wrote:<br>
    </div>
    <blockquote type="cite" 
cite="mid:AS8P195MB238656339640EC8D7C9527F1E0A42@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx">
      
      <meta name="Generator" content="Microsoft Word 15 (filtered medium)">
      <!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
      <style>@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}@font-face
        {font-family:Verdana;
        panose-1:2 11 6 4 3 5 4 4 2 4;}@font-face
        {font-family:Aptos;}@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}@font-face
        {font-family:"Segoe UI";
        panose-1:2 11 5 2 4 2 4 2 2 3;}p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        font-size:12.0pt;
        font-family:"Aptos",sans-serif;}a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}span.E-mailStijl22
        {mso-style-type:personal-compose;
        font-family:"Tahoma",sans-serif;
        color:windowtext;
        position:relative;
        top:0pt;
        mso-text-raise:0pt;
        letter-spacing:0pt;}.MsoChpDefault
        {mso-style-type:export-only;
        font-size:10.0pt;
        mso-ligatures:none;}div.WordSection1
        {page:WordSection1;}</style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
      <div>
        <p><span style="background-color: #feec97; color: #000;"><strong>**
              Caution: EXTERNAL Sender **</strong></span></p>
      </div>
      <div>
        <div class="WordSection1">
          <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">Dear Jim,<o:p></o:p></span></p>
          <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US"><o:p>&nbsp;</o:p></span></p>
          <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">I think you are right, first setup a SSL
              certificate, I’m also using the thredds docker image,
              together with a nginx proxy server.<o:p></o:p></span></p>
          <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US"><o:p>&nbsp;</o:p></span></p>
          <div>
            <div>
              <p class="MsoNormal"><b><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">M.J.
                    (Maarten) Pols</span></b><b><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif"><br>
                  </span></b><b><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Producten
                    en services</span></b><b><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif"><br>
                  </span></b><b><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Systeem-
                    en applicatiebeheerder</span></b><b><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">
                  </span></b><o:p></o:p></p>
            </div>
            <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
            <div>
              <table class="MsoNormalTable" cellpadding="0" border="0">
                <tbody>
                  <tr>
                    <td style="padding:.75pt .75pt .75pt .75pt">
                      <p class="MsoNormal"><img 
style="width:1.8437in;height:.6354in" id="Afbeelding_x0020_2" 
src="cid:part1.TYLgP3jt.Ar8BW20a@colostate.edu" class="" width="177" 
height="61"><o:p></o:p></p>
                    </td>
                    <td style="padding:.75pt .75pt .75pt .75pt">
                      <div>
                        <p class="MsoNormal" style="margin-bottom:12.0pt"><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Botter
                            11-29, 8232 JN Lelystad (tevens 
postadres)</span><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif"><br>
                          </span><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Berkenweg
                            7, Amersfoort | Informaticalaan 8, 
Delft</span><o:p></o:p></p>
                      </div>
                      <div>
                        <p class="MsoNormal"><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Telefoon
                            0320 294292</span><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">
                            <br>
                          </span><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Internet</span><span
 style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">
                            <u><a href="http://www.hkv.nl/"; 
originalsrc="http://www.hkv.nl/"; 
shash="x6ho/LfPAvguAu9tDpRz/1Q7mf1eii/5xTGk2Xq8Gt48IyOuNBXPe2hbadhs4lqyAQC4TEG3YragSGRGdAntOd24HeOhjZO6AAppZ+HuqUfWU3hfeVvNr9QlvghYu9CEtmbZgzkwP7zHLLTab5hQei/B0Lb1N6zbDTDvVtMOZyE="
 moz-do-not-send="true">www.hkv.nl</a></u>
                            <o:p></o:p></span></p>
                      </div>
                    </td>
                  </tr>
                </tbody>
              </table>
            </div>
            <div>
              <p class="MsoNormal">&nbsp;&nbsp; <o:p></o:p></p>
            </div>
          </div>
          <p class="MsoNormal"><span 
style="font-size:6.0pt;font-family:&quot;Verdana&quot;,sans-serif" 
lang="NL">HKV, de kennisondernemer voor water en
              veiligheid
            </span><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="NL"><o:p></o:p></span></p>
          <div>
            <div style="border:none;border-top:solid #E1E1E1 
1.0pt;padding:3.0pt 0cm 0cm 0cm">
              <p class="MsoNormal"><b><span 
style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" 
lang="NL">Van:</span></b><span 
style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="NL"> 
Jim Fluke <a class="moz-txt-link-rfc2396E" 
href="mailto:james.fluke@xxxxxxxxxxxxx";>&lt;james.fluke@xxxxxxxxxxxxx&gt;</a>
                  <br>
                  <b>Verzonden:</b> Tuesday, 9 July 2024 19:45<br>
                  <b>Aan:</b> Pols, Maarten <a class="moz-txt-link-rfc2396E" 
href="mailto:M.Pols@xxxxxx";>&lt;M.Pols@xxxxxx&gt;</a>;
                  <a class="moz-txt-link-abbreviated" 
href="mailto:thredds@xxxxxxxxxxxxxxxx";>thredds@xxxxxxxxxxxxxxxx</a><br>
                  <b>Onderwerp:</b> Re: [thredds] Authentication
                  problems with the TDS and pydap<o:p></o:p></span></p>
            </div>
          </div>
          <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
          <table class="MsoNormalTable" style="width:100.0%" width="100%" 
cellspacing="0" cellpadding="0" border="0" align="left">
            <tbody>
              <tr>
                <td style="background:#A6A6A6;padding:5.25pt 1.5pt 5.25pt 
1.5pt"><br>
                </td>
                <td style="width:100.0%;background:#EAEAEA;padding:5.25pt 
3.75pt 5.25pt 11.25pt" width="100%">
                  <div>
                    <p class="MsoNormal" 
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-element:frame;mso-element-frame-hspace:2.25pt;mso-element-wrap:around;mso-element-anchor-vertical:paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly">
                      <span style="font-size:9.0pt;font-family:&quot;Segoe 
UI&quot;,sans-serif;color:#212121;mso-fareast-language:NL">##
                        Let op: deze mail is afkomstig van een externe
                        afzender.</span><span style="color:black">
                        <a href="https://aka.ms/LearnAboutSenderIdentification"; 
moz-do-not-send="true"><span style="font-size:9.0pt;font-family:&quot;Segoe 
UI&quot;,sans-serif;mso-fareast-language:NL">Meer
                            informatie over waarom dit belangrijk is</span></a>
                      </span><o:p></o:p></p>
                  </div>
                </td>
                <td style="width:56.25pt;background:#EAEAEA;padding:5.25pt 
3.75pt 5.25pt 3.75pt;align:left" width="75">
                  <br>
                </td>
              </tr>
            </tbody>
          </table>
          <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
            <br>
            <o:p></o:p></p>
          <div>
            <p class="MsoNormal" style="margin-bottom:12.0pt">Pols,<br>
              <br>
              Thank you for your response!<br>
              <br>
              But, it still does not work. I think I probably need this,
              or something like it, but it's not enough.<br>
              <br>
              Now the web browser authentication fails with this
              message:<br>
              <span style="font-family:&quot;Courier New&quot;">Secure
                Connection Failed<br>
                <br>
                An error occurred during a connection to localhost.
                PR_END_OF_FILE_ERROR<br>
                <br>
                Error code: PR_END_OF_FILE_ERROR<br>
                <br>
                &nbsp;&nbsp;&nbsp; The page you are trying to view cannot be 
shown
                because the authenticity of the received data could not
                be verified.<br>
                &nbsp;&nbsp;&nbsp; Please contact the website owners to inform 
them of
                this problem.</span><br>
              <br>
              And the pydap authentication fails with this message:<br>
              <span style="font-family:&quot;Courier 
New&quot;;color:black;background:white">ssl.SSLEOFError:
                [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in
                violation of protocol (_ssl.c:1000)</span><br>
              <br>
              Which seems to indicate that I need to add an SSL
              certificate, which I have not done. Again, I am using the
              thredds-docker image, which does not have a certificate by
              default. And the port forwarding that it does might be an
              issue as well.<br>
              <br>
              I'll try the certificate, but other suggestions would be
              very welcome.<br>
              <br>
              Jim<o:p></o:p></p>
            <div>
              <p class="MsoNormal">On 7/9/24 00:35, Pols, Maarten 
wrote:<o:p></o:p></p>
            </div>
            <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
              <div>
                <p><strong><span 
style="font-family:&quot;Aptos&quot;,sans-serif;color:black;background:#FEEC97">**
                      Caution: EXTERNAL Sender **</span></strong><o:p></o:p></p>
              </div>
              <div>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">Dear Jim,</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">This problem cost me months to cover.
                    It was working in previous versions of thredds but
                    after een upgrade it broke my python 
scripts.</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">First of all, don’t upgrade to the
                    latest numpy packages, it will break pydap, latest
                    working version is 1.26.x</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">Than to solve this issue, you need to
                    change applicationContext.xml file, this file is in
                    webapps -&gt; thredds -&gt; WEB-INF</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">You need to change line 112 and 113:</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;</span><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp; &lt;bean
                      id=&quot;restrictedDatasetAuthorizer&quot;
                      
class=&quot;thredds.servlet.restrict.TomcatAuthorizer&quot;&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &lt;property 
name=&quot;useSSL&quot;
                      value=&quot;false&quot;/&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &lt;property 
name=&quot;sslPort&quot;
                      value=&quot;8443&quot;/&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp; &lt;/bean&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">Into
                  </span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;</span><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp; &lt;bean
                      id=&quot;restrictedDatasetAuthorizer&quot;
                      
class=&quot;thredds.servlet.restrict.TomcatAuthorizer&quot;&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &lt;property 
name=&quot;useSSL&quot;
                      
value=&quot;<b>true</b>&quot;/&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &lt;property 
name=&quot;sslPort&quot;
                      
value=&quot;<b>443</b>&quot;/&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><i><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;&nbsp;&nbsp; &lt;/bean&gt;</span></i><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">This was solving the issue in my case,
                    and I hope it will help you.</span><o:p></o:p></p>
                <p class="MsoNormal"><span 
style="font-size:10.0pt;font-family:&quot;Tahoma&quot;,sans-serif;mso-fareast-language:EN-US"
 lang="EN-US">&nbsp;</span><o:p></o:p></p>
                <div>
                  <div>
                    <div>
                      <div>
                        <p class="MsoNormal"><b><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">M.J.
                              (Maarten) Pols<br>
                              Products and Services<br>
                              System and application administrator 
</span></b><o:p></o:p></p>
                      </div>
                      <p class="MsoNormal">&nbsp;<o:p></o:p></p>
                      <div>
                        <table class="MsoNormalTable" cellpadding="0" 
border="0">
                          <tbody>
                            <tr>
                              <td style="padding:.75pt .75pt .75pt .75pt">
                                <p class="MsoNormal"><img 
style="width:1.8541in;height:.6354in" id="Afbeelding_x0020_1" 
src="cid:part2.dRc4PDys.OEISMLpm@colostate.edu" class="" width="178" 
height="61" border="0"><o:p></o:p></p>
                              </td>
                              <td style="padding:.75pt .75pt .75pt .75pt">
                                <div>
                                  <p class="MsoNormal" 
style="margin-bottom:12.0pt"><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Botter
                                      11-29, 8232 JN Lelystad, The
                                      Netherlands (also postal address)
                                      <br>
                                      Berkenweg 7, Amersfoort |
                                      Informaticalaan 8, 
Delft</span><o:p></o:p></p>
                                </div>
                                <div>
                                  <p class="MsoNormal"><span 
style="font-size:7.5pt;font-family:&quot;Verdana&quot;,sans-serif">Telephone
                                      +31 (0)320 294292
                                      <br>
                                      Internet <u><a 
href="http://www.hkv.nl/en/"; originalsrc="http://www.hkv.nl/en/"; 
shash="EjDz5KgdCFqyzSCb1b/0qxwtzfqp6gmQZyknWMiXV4vI1rj3kZUvKRde3NvThaor3yHAZVQNJgaKfpiz8yYL+xz+y53QqpbnGowz4e3OHlrK13w4ovgb1z4D//wWZm5PevCmdq+iPQbLeaEQ7tQosbJ3gnj0UljHF1BLsXIMKxo="
 moz-do-not-send="true">www.hkv.nl/en/</a></u>
                                    </span><o:p></o:p></p>
                                </div>
                              </td>
                            </tr>
                          </tbody>
                        </table>
                      </div>
                      <div>
                        <p class="MsoNormal">&nbsp;&nbsp; <o:p></o:p></p>
                      </div>
                      <div>
                        <p class="MsoNormal"><span 
style="font-size:6.0pt;font-family:&quot;Verdana&quot;,sans-serif" 
lang="EN-US">HKV, knowledge entrepreneurs in
                            flood risk and water resources management
                          </span><o:p></o:p></p>
                      </div>
                    </div>
                  </div>
                </div>
                <div>
                  <div style="border:none;border-top:solid #E1E1E1 
1.0pt;padding:3.0pt 0cm 0cm 0cm">
                    <p class="MsoNormal"><b><span 
style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" 
lang="NL">Van:</span></b><span 
style="font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" lang="NL"> 
thredds
                        <a href="mailto:thredds-bounces@xxxxxxxxxxxxxxxx"; 
moz-do-not-send="true">&lt;thredds-bounces@xxxxxxxxxxxxxxxx&gt;</a>
                        <b>Namens </b>Jim Fluke<br>
                        <b>Verzonden:</b> Tuesday, 9 July 2024 00:04<br>
                        <b>Aan:</b> <a href="mailto:thredds@xxxxxxxxxxxxxxxx"; 
moz-do-not-send="true" 
class="moz-txt-link-freetext">thredds@xxxxxxxxxxxxxxxx</a><br>
                        <b>Onderwerp:</b> [thredds] Authentication
                        problems with the TDS and pydap</span><o:p></o:p></p>
                  </div>
                </div>
                <p class="MsoNormal">&nbsp;<o:p></o:p></p>
                <table class="MsoNormalTable" style="width:100.0%" width="100%" 
cellspacing="0" cellpadding="0" border="0" align="left">
                  <tbody>
                    <tr>
                      <td style="background:#A6A6A6;padding:5.25pt 1.5pt 5.25pt 
1.5pt"><br>
                      </td>
                      <td style="width:100.0%;background:#EAEAEA;padding:5.25pt 
3.75pt 5.25pt 11.25pt" width="100%">
                        <div>
                          <p class="MsoNormal" 
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-element:frame;mso-element-frame-hspace:2.25pt;mso-element-wrap:around;mso-element-anchor-vertical:paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly">
                            <span 
style="font-size:9.0pt;font-family:&quot;Segoe 
UI&quot;,sans-serif;color:#212121;mso-fareast-language:NL">##
                              Let op: deze mail is afkomstig van een
                              externe afzender.</span><span style="color:black">
                              <a 
href="https://aka.ms/LearnAboutSenderIdentification"; 
moz-do-not-send="true"><span style="font-size:9.0pt;font-family:&quot;Segoe 
UI&quot;,sans-serif;mso-fareast-language:NL">Meer
                                  informatie over waarom dit belangrijk
                                  is</span></a>
                            </span><o:p></o:p></p>
                        </div>
                      </td>
                      <td 
style="width:56.25pt;background:#EAEAEA;padding:5.25pt 3.75pt 5.25pt 
3.75pt;align:left" width="75">
                        <br>
                      </td>
                    </tr>
                  </tbody>
                </table>
                <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
                  <br>
                  <br>
                  <o:p></o:p></p>
                <div>
                  <p class="MsoNormal">Hello,<br>
                    <br>
                    I'm now trying to get user authentication working
                    with our thredds-docker based TDS. I'm pretty sure I
                    have the configuration set up to enable
                    authentication as described in the TDS manual's &quot;<span 
style="color:black;background:white"><a 
href="https://docs.unidata.ucar.edu/tds/current/userguide/restict_access_to_tds.html#restrict-access-by-dataset-in-tds-catalogs";
 
originalsrc="https://docs.unidata.ucar.edu/tds/current/userguide/restict_access_to_tds.html#restrict-access-by-dataset-in-tds-catalogs";
 
shash="PZOx9FLcAuu6KJ3pOsQECLIq/7vDvB93iRpnyXJ5zfvhfz4oqoT4iw9rqvraz0aHdsiafPq6+KPO0gTalzurUvVrMsH9Ff+813xYwKGcZLlvP/amr5vxY1SYkBBN7/fssMKL9PBYZBD6DK6Ldr5iF+M3SybMn65xHalJZmVaLwU="
 moz-do-not-send="true">Restrict Access To The
                        TDS</a>&quot; page</span>. And I have verified this
                    by accessing the TDS from a browser and having the
                    credentials entry pop-up window display and work
                    correctly.<br>
                    <br>
                    But, I can't get the authentication to work in
                    Python with pydap. According to the pydap
                    documentation the credentials should be added to the
                    URL this way:<br>
                    <br>
                    <span style="font-family:&quot;Courier 
New&quot;;color:black;background:white">&gt;&gt;&gt;
                      from pydap.client import open_url
                    </span><span style="font-family:&quot;Courier 
New&quot;"><br>
                      &gt;&gt;&gt; dataset = open_url('<a 
href="http://username:password@xxxxxxxxxxxxxxxxxx/path/to/dataset"; 
originalsrc="http://username:password@xxxxxxxxxxxxxxxxxx/path/to/dataset"; 
shash="Zh3uGJ4zUcnUVgOrhTlG7l/nXlKCe4PM7oxWe7cxzBIAQ4/9fg+bUgsHbkSIP4FoyplI22zBLF9MD+60wIcUBdKRRVkkKQrRV/Lruaq+qCaZOVMBcFWAK2BHZxAjBXo0VCy3DMM0VHC9Km/+RLtoecXyOapT33YGPxmdlARi4E4="
 
moz-do-not-send="true">http://username:password@xxxxxxxxxxxxxxxxxx/path/to/dataset</a>')<br>
                    </span><br>
                    But because <a 
href="https://docs.unidata.ucar.edu/tds/current/userguide/digested_passwords.html";
 
originalsrc="https://docs.unidata.ucar.edu/tds/current/userguide/digested_passwords.html";
 
shash="d10mi9S0MG9tBEd/3f47M085b+0at93qhvFwbqBahPl9vktr2O/lDMk0ZZsQrdNNWsQocJ915bmA4wuAKl81J2iK4IB7Mdnw9XUoeN8a2LIjbeBkgIRDyG6/gDJKpEYiIPTAGNCFXgL4gcgh1eRzRR1iMf8E4TTUEoSqA46rPb4="
 moz-do-not-send="true">
                      Digested Passwords</a> are enabled for our TDS, it
                    seems clear that I should use the digested password,
                    so this is what I tried:<br>
                    <br>
                    <span style="font-family:&quot;Courier 
New&quot;;color:black;background:white">&gt;&gt;&gt;
                      from pydap.client import open_url
                    </span><span style="font-family:&quot;Courier 
New&quot;"><br>
                      &gt;&gt;&gt; dataset = open_url('<span 
style="color:black;background:white">http://fluke:d1ef3ce7e7c41de74192a362524ad0a460692a222d9dd796ee383b56e446d749$1$d03ce0f88475505a68bd0eb37fa570df8120e59ccf62a4f580a55ad612f695c0e385893fe7205f7c181b221ab49bc817d4a33a2b</span><br>
                      <a 
href="mailto:2bb727fdc0ee3420e7e5b99e@localhost:7000/thredds/dodsC/cloudsat-data/2B-GEOPROF.P1_R05/2008/366/2008366031107_14239_CS_2B-GEOPROF_GRANULE_P1_R05_E02_F00.hdf";
 moz-do-not-send="true" 
class="moz-txt-link-freetext">2bb727fdc0ee3420e7e5b99e@localhost:7000/thredds/dodsC/cloudsat-data/2B-GEOPROF.P1_R05/2008/366/2008366031107_14239_CS_2B-GEOPROF_GRANULE_P1_R05_E02_F00.hdf</a><br>
                      ')<br>
                    </span><br>
                    But it does not work. Here is the output:<br>
                    <br>
                    <span style="font-family:&quot;Courier 
New&quot;;color:black;background:white">@
                      ~/devRepos/thredds-dpc-gh-actual/tests$
                      docker-compose run --rm test_opendap
                    </span><span style="font-family:&quot;Courier 
New&quot;"><br>
                      url: <a 
href="http://fluke:d1ef3ce7e7c41de74192a362524ad0a460692a222d9dd796ee383b56e446d749$1$d03ce0f88475505a68bd0eb37fa570df8120e59ccf62a4f580a55ad612f695c0e385893fe7205f7c181b221ab49bc817d4a33a2b";
 moz-do-not-send="true" class="moz-txt-link-freetext">
http://fluke:d1ef3ce7e7c41de74192a362524ad0a460692a222d9dd796ee383b56e446d749$1$d03ce0f88475505a68bd0eb37fa570df8120e59ccf62a4f580a55ad612f695c0e385893fe7205f7c181b221ab49bc817d4a33a2b</a><br>
                      <a 
href="mailto:2bb727fdc0ee3420e7e5b99e@localhost:7000/thredds/dodsC/cloudsat-data/2B-GEOPROF.P1_R05/2008/366/2008366031107_14239_CS_2B-GEOPROF_GRANULE_P1_R05_E02_F00.hdf";
 moz-do-not-send="true" 
class="moz-txt-link-freetext">2bb727fdc0ee3420e7e5b99e@localhost:7000/thredds/dodsC/cloudsat-data/2B-GEOPROF.P1_R05/2008/366/2008366031107_14239_CS_2B-GEOPROF_GRANULE_P1_R05_E02_F00.hdf</a>
                      <br>
                      <br>
                      Traceback (most recent call last): <br>
                      &nbsp;File &quot;/app/opendap_pydap.py&quot;, line 8, in
                      &lt;module&gt; <br>
                      &nbsp;&nbsp;&nbsp;dataset = open_url(url) <br>
                      
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;^^^^^^^^^^^^^
 <br>
                      &nbsp;File
                      
&quot;/opt/conda/lib/python3.12/site-packages/pydap/client.py&quot;,
                      line 68, in open_url
                      <br>
                      &nbsp;&nbsp;&nbsp;handler = 
pydap.handlers.dap.DAPHandler(url,
                      application, session, output_grid,
                      <br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                      <br>
                      &nbsp;File
                      
&quot;/opt/conda/lib/python3.12/site-packages/pydap/handlers/dap.py&quot;,
                      line 71, in __init__
                      <br>
                      &nbsp;&nbsp;&nbsp;self.make_dataset() <br>
                      &nbsp;File
                      
&quot;/opt/conda/lib/python3.12/site-packages/pydap/handlers/dap.py&quot;,
                      line 96, in make_dataset
                      <br>
                      &nbsp;&nbsp;&nbsp;self.dataset_from_dap2() <br>
                      &nbsp;File
                      
&quot;/opt/conda/lib/python3.12/site-packages/pydap/handlers/dap.py&quot;,
                      line 109, in dataset_from_dap2
                      <br>
                      &nbsp;&nbsp;&nbsp;pydap.net.raise_for_status(r) <br>
                      &nbsp;File
                      
&quot;/opt/conda/lib/python3.12/site-packages/pydap/net.py&quot;,
                      line 38, in raise_for_status
                      <br>
                      &nbsp;&nbsp;&nbsp;raise HTTPError( <br>
                      webob.exc.HTTPError: 401 Unauthorized <br>
                      &lt;!doctype html&gt;&lt;html
                      lang=&quot;en&quot;&gt;&lt;head&gt;&lt;title&gt;HTTP 
Status
                      401 – Unauthorized&lt;/title&gt;&lt;style
                      type=&quot;text/css&quot;&gt;body
                      {font-family:Tahoma,Arial,sans-serif;} h1, h2, h3,
                      b {color:white;background-co<br>
                      lor:#525D76;} h1 {font-size:22px;} h2
                      {font-size:16px;} h3 {font-size:14px;} p
                      {font-size:12px;} a {color:black;} .line
{height:1px;background-color:#525D76;border:none;}&lt;/style&gt;&lt;/head&gt;&lt;bod<br>
                      y&gt;&lt;h1&gt;HTTP Status 401 –
                      Unauthorized&lt;/h1&gt;&lt;hr class=&quot;line&quot;
                      /&gt;&lt;p&gt;&lt;b&gt;Type&lt;/b&gt; Status
                      Report&lt;/p&gt;&lt;p&gt;&lt;b&gt;Description&lt;/b&gt;
                      The request has not been applied to the target
                      resource because it lacks va<br>
                      lid authentication credentials for that
                      resource.&lt;/p&gt;&lt;hr class=&quot;line&quot;
                      /&gt;&lt;h3&gt;Apache
                      Tomcat&lt;/h3&gt;&lt;/body&gt;&lt;/html&gt;<br>
                      <br>
                    </span>So, am I right to be using the digested
                    password? Do you see anything else that could be
                    wrong? Why does this work for the browser but not
                    for pydap?<br>
                    <br>
                    I will add that the algorithm for the <span 
style="color:black;background:white">
                      CredentialHandler is &quot;sha-</span><b><span 
style="color:#FF5454;background:white">512</span></b>&quot;
                    in the ~tomcat/conf/server.xml file inside the
                    container, so that is why the digested password is
                    an sha512 digest. And the clear text password is
                    &quot;flukeTmp&quot;. I'll be changing that for our 
production
                    system.<br>
                    <br>
                    And, all of this - the TDS configuration and the
                    test python script with the above URL - are now
                    checked in to our
                    <a 
href="https://github.com/JimFluke/thredds-dpc/tree/master"; 
originalsrc="https://github.com/JimFluke/thredds-dpc/tree/master"; 
shash="OU/KJT9dXcykuQBuNc5fh5lBjuAHHu4Rbyqv7agsmCze+nH1SOPACKqw2usZk9XvQGHiLnfY2h+o6oFXnHRvM11Tbi21H2nCQOziEBKDUSE/JPG76iU476LFZMBCTqvJo6C22pl3+b1KGZiSX/7308eFc1/fumm5+lv8IglEpRM="
 moz-do-not-send="true">thredds-dpc</a> repository
                    on GitHub so you can look at the details there.<br>
                    <br>
                    Any help would be greatly appreciated.<br>
                    <br>
                    Thanks,<br>
                    Jim<o:p></o:p></p>
                </div>
              </div>
            </blockquote>
            <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
          </div>
        </div>
      </div>
    </blockquote>
    <br>
  </body>
</html>

JPEG image

JPEG image

  • 2024 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: