Re: [thredds] Uncorrelate disk path and href for catalogRef and dataset in catalog.xml

• To: Léo Le Lonquer <leo.le.lonquer@xxxxxxxxxx>, "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx>
• Subject: Re: [thredds] Uncorrelate disk path and href for catalogRef and dataset in catalog.xml
• From: David Robertson <robertson@xxxxxxxxxxxxxxxxxx>
• Date: Wed, 30 Oct 2024 15:01:22 +0000
• Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=marine.rutgers.edu; dmarc=pass action=none header.from=marine.rutgers.edu; dkim=pass header.d=marine.rutgers.edu; arc=none
• Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=uMbtHYCBESfgUqDS1bYVqizPF1ACWNeUBRMDJTOfsLQ=; b=lcpo53oSFFkT/rgly4ppZND52uvXO5zOm30e4QL2We3TrsiJTv6ZYsYEQPFxOJvmONPuMDSdPbQDmEtEOTT3DY8td8Gm/bN5EcSmSwka5YLz1KlUqx9fUsOV2u8bwf8HFHAbSR5BEieAY10RTuckV03buCtHPzeV7OH4Cmpuie6KGyGDWN6w/38E6PPuylcZLR3FLn9GqS1raQ8bRr0ezRhCBdpPj1g4C1/2K0Wzmm8/lrKUfeRzfT3lF6lfxke0xUGYh23YatPhWsZh25SM1PSIHN5oeXBOgNKpEkSWuJFv1IcMz44fisbAvgZ5IFExg9crKLuMjOMjr3jQIJ2eYQ==
• Arc-seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=kIxA+t8pqyMGM22hYLZFABSJWzcOm0U39gFg9d/YtGjZYxWouUA0W3OFmRMqO+5AMC9MdCBCddzJ0TBEws6CtSv1GWfVpPyTdWeasAbFdVFVb39Q2vFyDf/yQjt5HZQSYspb5E8BVJBPW9Tx/+LTvetkzrjXJmLvQlLaYAovP3mBPN8+ksQbMi7/a363HBEYxwvOOJ2QWhCatQAePXgwrr8zjcbQOqRQY8CcrgJUEaqhBPOUMrHkCipFtKkoxmKEY7k0vsvDrcZ1bfatRLdSU7tsufGReQgjATJZlnSqvaAcC8ZomjzJZdN3FngLiiwbkDjKjQarsbVu2J7DovbOFQ==
• Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=marine.rutgers.edu;

Hi,

If your THREDDS instance went from 4.6 to 5.x then you are probably running 
into the same thing I did that is detailed in the following GitHub issue:

https://github.com/Unidata/tds/issues/504

Dave

From: thredds <thredds-bounces@xxxxxxxxxxxxxxxx> on behalf of Léo Le Lonquer 
<leo.le.lonquer@xxxxxxxxxx>
Date: Wednesday, October 30, 2024 at 10:25 AM
To: thredds@xxxxxxxxxxxxxxxx <thredds@xxxxxxxxxxxxxxxx>
Subject: [thredds] Uncorrelate disk path and href for catalogRef and dataset in 
catalog.xml

Hello everyone,

I'm migrating Thredds instances, and as I do so, I'm also reorganising Thredds 
folders.

We have a large amount of catalogRef and datasets that are located under 
{tds.content.root.path}. I would like to move them all to a new folder 
{tds.content.root.path}/catalogs to simplify management.

However doing so, an extra /catalogs/ is added to the URL of each of the 
underlying datasets.

ex :

https://tds0.ifremer.fr/thredds/CERSAT.html => 
https://tds0.ifremer.fr/thredds/catalogs/CERSAT.html



My root catalog is the following :
<?xml version="1.0" encoding="UTF-8"?>
<catalog name="tds0" 
xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";<http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0>
 xmlns:xlink="http://www.w3.org/1999/xlink";<http://www.w3.org/1999/xlink>>
<catalogRef xlink:title="CERSAT" xlink:href="catalogs/CERSAT.xml" name=""/>
<catalogRef xlink:title="CORIOLIS" xlink:href="catalogs/CORIOLIS.xml" name=""/>
<catalogRef xlink:title="LPO" xlink:href="catalogs/LPO.xml" name=""/>
</catalog>



I tried several solution but none of them worked :

- adding in threddsConfig.xml a catalogRoot element pointing to a new 
catalog.xml file located at catalogs/catalog.xml. But it resolves as url : 
thredds/catalogs/catalog.html

- using attributes name, ID, alias, urlPath in the definition of catalogRef 
elements in catalog.xml file trying to truncate catalogs/ folder

- defining default catalog.xml at startup, but couldn't find a java parameter 
to do so. Only tds.content.root.path is settable.



It is quite important to keep the same urls while migrating as a lot of 
products stored in the Ifremer Thredds instances are referenced in multiple 
services with their urls.

Maybe I missed a configuration while reading the docs. Does anybody know if 
it's possible and how to do it ?

Thanks,
--

Léo Le Lonquer
Ingénieur Cloud pour la Science
Ifremer Centre Bretagne, 29280 Plouzané, France

• Follow-Ups:
  • Re: [thredds] Uncorrelate disk path and href for catalogRef and dataset in catalog.xml
    • From: Léo Le Lonquer

• References:
  • [thredds] Uncorrelate disk path and href for catalogRef and dataset in catalog.xml
    • From: Léo Le Lonquer