Re: [thredds] THREDDS Root Catalog

Hi All,

I was able to get this working.
Looks like the "path" attribute in different catalogs served through the
same THREDDS server cannot be the same (even though one of the catalogs is
a subset of the other).

I just made a small tweak to this attribute and got it to work.

-Ajay

On Fri, Oct 31, 2014 at 2:00 PM, <thredds-request@xxxxxxxxxxxxxxxx> wrote:

> Send thredds mailing list submissions to
>         thredds@xxxxxxxxxxxxxxxx
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         http://mailman.unidata.ucar.edu/mailman/listinfo/thredds
> or, via email, send a message with subject or body 'help' to
>         thredds-request@xxxxxxxxxxxxxxxx
>
> You can reach the person managing the list at
>         thredds-owner@xxxxxxxxxxxxxxxx
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of thredds digest..."
>
>
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit:
> http://www.unidata.ucar.edu/mailing_lists/
>
> Today's Topics:
>
>    1. THREDDS Root Catalog (Ajay Krishnan - NOAA Affiliate)
>    2. thredds4.5 and Feature Collections
>       (Roy Mendelssohn - NOAA Federal)
>    3. TDM and featureCollections (Roy Mendelssohn - NOAA Federal)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Thu, 30 Oct 2014 17:06:49 -0400
> From: Ajay Krishnan - NOAA Affiliate <ajay.krishnan@xxxxxxxx>
> To: THREDDS community <thredds@xxxxxxxxxxxxxxxx>
> Subject: [thredds] THREDDS Root Catalog
> Message-ID:
>         <
> CAA9eyS42D8T28sEJmCfVsQ_8j5yy5j7qxhckz4vpCPMSYckU3w@xxxxxxxxxxxxxx>
> Content-Type: text/plain; charset="utf-8"
>
> Hi Everyone,
>
> I have a catalog that I don't want visible from my main thredds catalog.
> Here's what I did to accomplish that.
>
> I created a new folder '*temp*' under my /content/thredds directory
> I created a new '*catalog.xml*' file (the one that I don't want visible, in
> the temp folder)
>
> In the threddsConfig.xml file, I added this:
> <catalogRoot>*temp/catalog.xml*</catalogRoot>
>
> Restarted services on tomcat. Ideally, I should be able to get to the new
> root catalog using the following URL, right?:
>
> server:8080/thredds/temp/catalog.html
>
> Strangely, I don't see all the datasets being displayed at the above URL.
>
> Datasets with <catalogRef> elements work just fine.
> But I am having issues with datasets that have a <datasetScan> element.
> Only one of the many, is visible in the new root catalog.
>
>
> The elements within the datasetScan tag are exactly the same for all
> datasets.
> Can someone tell what is causing only selective datasets to be displayed?
>
> Thanks,
> Ajay
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://mailman.unidata.ucar.edu/mailing_lists/archives/thredds/attachments/20141030/60b3940d/attachment.html
> >
>
> ------------------------------
>
> Message: 2
> Date: Thu, 30 Oct 2014 16:17:36 -0700
> From: Roy Mendelssohn - NOAA Federal <roy.mendelssohn@xxxxxxxx>
> To: thredds@xxxxxxxxxxxxxxxx
> Subject: [thredds] thredds4.5 and Feature Collections
> Message-ID: <6B145613-25AE-414D-83DD-4E55F4F1AD7A@xxxxxxxx>
> Content-Type: text/plain; charset="windows-1252"
>
> Hi All:
>
> Nothing like FeatureCollections to help one feel old and slow - and boy do
> I feel old and slow.  I have been putting off upgrading to thredds 4.5 just
> because of the changes  (I had enough trouble getting featureCollections
> working the first time around).
>
> I have a working thredds4.3 feature collection that is failing with
> thredds4.5 on my test server on my laptop.  So, though what is wrong is
> probably obvious, it hasn?t been obvious to me, nor to my bum knee.  So
> here goes.
>
> 1.  Do I understand correctly that a featureCollection will only work in
> thredds4.5 with TDM running, or is that only if the dataset is being
> updated?
>
> 2.  If I look at:
>
>
> http://www.unidata.ucar.edu/software/thredds/current/tds/UpgradingTo4.5.html
>
> I see:
>
>  <update startup="nocheck" trigger="allow"/>
>  <tdm startup="true" rescan="0 8,23,38,53 * * * ? *" trigger="allow"/>
> replaced with:
>
>   <update startup="never" trigger="allow"/>
>   <tdm rewrite="test" rescan="0 8,23,38,53 * * * ? *" trigger="allow"/>
> I had update on startup before  (more below) does it need to be ?never?
> always  (or basically I am unclear in what sense one  replaces the other).
> I didn?t have an update command, just
>
>        <tdm startup="true" rescan="0 0/15 * * * ? *" trigger="allow"/>
>
>
> I have looked at the logs and it is unclear to me what is causing the
> error.  Below I have put what I hope are the relevant parts of the the
> catalogs.  If someone can point out the problem, I would be most grateful.
>
> -Roy
>
> thredds4.3:
>
>      <featureCollection name="FNMOC NAVGEM 0.5-degree 6-hourly Pressure"
> featureType="GRIB" harvest="true" path="FNMOC/navgem/pressure/6hr">
>        <dataFormat>GRIB-1</dataFormat>
>        <metadata inherited="true">
>           <serviceName>all</serviceName>
>           <documentation type="summary">
>               FNMOC 1-degree pressure fields from the NOGAPS model
>            </documentation>
>        </metadata>
>
>        <collection
> spec="/u00/FNMOC/NAVGEM/pressure/**/US058GMET-GR1mdl.0018_0056_00000F0..#yyyyMMddHH#_0102_000000-000000pres$"
>                    olderThan="5 min"/>
>        <tdm startup="true" rescan="0 0/15 * * * ? *" trigger="allow"/>
>        <gribConfig datasetTypes="Best LatestFile" />
>      </featureCollection>
>
> thredds4.5:
>
>      <featureCollection name="FNMOC NAVGEM 0.5-degree 6-hourly Pressure"
> featureType="GRIB1" harvest="true" path="FNMOC/navgem/pressure/6hr">
>        <dataFormat>GRIB-1</dataFormat>
>        <metadata inherited="true">
>           <serviceName>all</serviceName>
>           <documentation type="summary">
>               FNMOC 1-degree pressure fields from the NOGAPS model
>            </documentation>
>        </metadata>
>
>        <collection
> spec="/u00/FNMOC/NAVGEM/pressure/**/US058GMET-GR1mdl.0018_0056_00000F0..#yyyyMMddHH#_0102_000000-000000pres$"
>                    olderThan="5 min"/>
>         <update startup="never" trigger="allow"/>
>        <tdm rewrite="test" rescan="0 0/15 * * * ? *" trigger="allow"/>
>        <gribConfig datasetTypes="TwoD Best LatestFile" />
>      </featureCollection>
>
>
>
> **********************
> "The contents of this message do not reflect any position of the U.S.
> Government or NOAA."
> **********************
> Roy Mendelssohn
> Supervisory Operations Research Analyst
> NOAA/NMFS
> Environmental Research Division
> Southwest Fisheries Science Center
> ***Note new address and phone***
> 110 Shaffer Road
> Santa Cruz, CA 95060
> Phone: (831)-420-3666
> Fax: (831) 420-3980
> e-mail: Roy.Mendelssohn@xxxxxxxx www: http://www.pfeg.noaa.gov/
>
> "Old age and treachery will overcome youth and skill."
> "From those who have been given much, much will be expected"
> "the arc of the moral universe is long, but it bends toward justice" -MLK
> Jr.
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://mailman.unidata.ucar.edu/mailing_lists/archives/thredds/attachments/20141030/7b210a67/attachment.html
> >
>
> ------------------------------
>
> Message: 3
> Date: Thu, 30 Oct 2014 17:58:24 -0700
> From: Roy Mendelssohn - NOAA Federal <roy.mendelssohn@xxxxxxxx>
> To: thredds@xxxxxxxxxxxxxxxx
> Subject: [thredds] TDM and featureCollections
> Message-ID: <63957599-9C1F-4844-953E-BB304D45BF7E@xxxxxxxx>
> Content-Type: text/plain; charset=windows-1252
>
> Okay I may have made a little headway on featureCollections in thredds4.5,
> though I think it is due to some random changes rather than any
> understanding.  Since on the real server the featureCollection will be
> changing,  I am trying to see if I can make it dynamic.  So I have
> installed the TDM, and now don?t understand what it is doing.  I have
> modified the /tomcat-user.xml  just as in the instructions, to be:
>
> > <tomcat-users>
> >   <role ... />
> >   <role rolename="tdsTrigger"/>
> >   <user ... />
> >   <user username="tdm" password="secret" roles="tdsTrigger"/>
> > </tomcat-users>
>
> and I have created a shell script with the line:
>
> > /usr/local/jre1.7.0_25/bin/java -Xmx800m
> -Dtds.content.root.path=/usr/local/tomcat/content -jar tdm-4.5.jar -tds
> "http:/localhost:8080" -showOnly
>
> Now according to the web page, the -showOnly does:
>
> > -showOnly: (optional) if this is present, just show the
> featureCollections that will be indexed and exit.
>
> When I run it I get:
>
> > Server added http://localhost:8080/
> > contentDir=/usr/local/tomcat/content
> > catalog=/usr/local/tomcat/content/thredds/catalog.xml
> > Server added http:/localhost:8080
> >
> > Enter password for tds trigger: secret
> >
> > Password = 'secret' OK (Y/N)?y
> > Tdm startup at Thu Oct 30 17:43:35 PDT 2014
> > Feature Collection names:
> >  FNMOC NAVGEM 0.5-degree 6-hourly Pressure
> >
> > Triggers:
> >  thredds/admin/collection/trigger?trigger=never&collection=FNMOC NAVGEM
> 0.5-degree 6-hourly Pressure
>
> and then it hangs there and doesn?t exit - the test file set is only like
> 10 files and has already been scanned.  Should not TDM have exited?  Even
> more, can I exit it and then will it be called, or do I just leave it
> running or what.
>
> Thanks for any help.
>
> -Roy
>
> **********************
> "The contents of this message do not reflect any position of the U.S.
> Government or NOAA."
> **********************
> Roy Mendelssohn
> Supervisory Operations Research Analyst
> NOAA/NMFS
> Environmental Research Division
> Southwest Fisheries Science Center
> ***Note new address and phone***
> 110 Shaffer Road
> Santa Cruz, CA 95060
> Phone: (831)-420-3666
> Fax: (831) 420-3980
> e-mail: Roy.Mendelssohn@xxxxxxxx www: http://www.pfeg.noaa.gov/
>
> "Old age and treachery will overcome youth and skill."
> "From those who have been given much, much will be expected"
> "the arc of the moral universe is long, but it bends toward justice" -MLK
> Jr.
>
>
>
> End of thredds Digest, Vol 69, Issue 9
> **************************************
>
  • 2014 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: