Re: [thredds] issue with fileServer service

  • To: Roy Mendelssohn - NOAA Federal <roy.mendelssohn@xxxxxxxx>
  • Subject: Re: [thredds] issue with fileServer service
  • From: Mark Maciolek <mlm@xxxxxxxxxx>
  • Date: Fri, 3 Jul 2015 08:52:01 -0400
hi,

Done and it works.

http://netflow.sr.unh.edu:8080/thredds/catalog/testAll/catalog.html?dataset=testDatasetScan/2004050312_eta_211.nc

Now I just have to figure out which production server I can install it on. We really don't like installing packages manually but it looks like that is the only way this will work.

Mark

On 7/2/2015 11:01 PM, Roy Mendelssohn - NOAA Federal wrote:
Hi Mark:

Can I suggest that you setup another, clean copy of tomcat with nothing else in it (you can always copy 
over any existing catalogs later).  Put thredds.war in  $TOMCAT_HOME/webapps, edit a setting.sh in  
$TOMCAT_HOME/bin  ( and if you like post a copy of that to make certain you have set up correctly), and 
make certain your permissions are set such that whatever “user” is running tomcat has 
read/write permissions in the $TOMCAT_HOME directories.  Normally this is a user “tomcat” 
with no login shell.

This will give you a clean install, and the war file should expand.  You can 
then shutdown the tomcat, edit the new thredds config file, and copy over 
catalogs that you have in the present one.  We usually start with one simple 
datasets and make certain that all the services run with that.  It 
uncomplicated things that way.

Also, if you are proxying in Apache, so that the TDS URL does not contain a 
port number, which is good practice, you most likely need to proxy each and 
every service.  To see if the service is working, test the service  with a 
request on the local machine to localhost:8080  (assuming tomcat is running on 
8080), then test with the proxy URL

HTH,

-roy


On Jul 2, 2015, at 7:35 PM, Christian Ward-Garrison <cwardgar@xxxxxxxx> wrote:

Hi Mark,

There's something very strange going on, and I don't think I can remotely debug 
it.

If you:
* Have Java 7+ installed
* Have Tomcat 7+ installed
* Drop a fresh v4.6.2 thedds.war into $TOMCAT_HOME/webapps. Delete any existing 
thredds/ directory and thredds.war.
* Specify tds.content.root.path in $TOMCAT_HOME/bin/setenv.sh [1]. It should be 
an empty or non-existent directory (thredds will create it if necessary)
* Run $TOMCAT_HOME/bin/startup.sh

What SHOULD happen is that thredds will copy some default catalogs and datasets 
into your content root and successfully startup. You will have HTTPServer and 
OpenDAP access to many of the examples.

Are you following this exact procedure? If so, I'm basically out of ideas, as I 
can't debug it in person. I'm sorry I can't be of more help.

Cheers,
Christian

[1] http://www.unidata.ucar.edu/software/thredds/current/tds/UpgradingTo4.6.html

On Thu, Jul 2, 2015 at 8:12 PM, Mark Maciolek <mlm@xxxxxxxxxx> wrote:
hi,

even worst luck trying it with Tomcat 7 on a different server will not even 
deploy thredds.war.

  ERROR Unable to invoke factory method in class class 
org.apache.logging.log4j.core.appender.FileAppender


Mark


On 7/2/2015 6:24 AM, Mark Maciolek wrote:
hi,

I would have to move the web site to a new server as everything I read says 
thredds 4.6 require Java 7 and Tomcat 7.
The current web server the site is on can't be upgraded since it would break 
the other tomcat sites.

The only error in the apache log is that 
/web/opal/webapps/ROOT/thredds/fileServer not found which is true but then 
/web/opal/webapps/ROOT/thredds/dodsC does not exist either but the OPENDAP 
links work.

Mark

On 7/2/2015 12:37 AM, Christian Ward-Garrison wrote:
Hi Mark,

I just noticed that you're running v4.3, which is quite old at this point. 
Would you mind trying 4.6.2? [1] This document may be useful. [2]

Also, I noticed that for your HTTPServer request, you're getting an Apache 404 
page, not a Tomcat one. Maybe something in the Apache config is at fault?

Cheers,
Christian

[1] ftp://ftp.unidata.ucar.edu/pub/thredds/4.6/current/thredds.war
[2] http://www.unidata.ucar.edu/software/thredds/current/tds/UpgradingTo4.6.html


On Wed, Jul 1, 2015 at 7:26 PM, Mark Maciolek <mlm@xxxxxxxxxx> wrote:
hi,

Finally found time to try this again. I went back to plain catalog.xml with 
just test data.

I noticed in the logs that I never see fileServer in the serverStartup.log but 
do see
the opendap

serverStartup: thredds.server.opendap.OpendapServlet initialization start
2015-07-01T21:10:22.371-0400 [      1083][       1] INFO  serverStartup: 
thredds.server.opendap.OpendapServlet version= opendap/3.7 ascLimit = 50 
binLimit = 500
2015-07-01T21:10:22.371-0400 [      1083][       1] INFO  serverStartup: 
thredds.server.opendap.OpendapServlet initialization done

Should I not see some thredds.server.??? about the fileServer

The only http line is:

serverStartup: CdmInit: HTTPFileCache.initCache= [10,20] scour = 1020

So am I missing some folder from content/WEB-INF/classes/thredds/server/  ?

Mark



On 6/23/2015 5:53 PM, Christian Ward-Garrison wrote:
Hi Mark,

Yes, a catalog can have multiple datasetRoots. They can even have the same 
location—only their paths must differ. Here's an example from one of our 
catalogs:

   <datasetRoot path="localContent" location="content/testdata/"/>
   <datasetRoot path="testRestrictedDataset" location="content/testdata/"/>
   <datasetRoot path="cdmUnitTest" location="${cdmUnitTest}"/>

As for your catalogs, they look good to me. I was able to load them into TDS and access 
them via "HTTPServer". All I had to do was create some dummy data and change 
the datasetScan location attributes to match my machine.

I'm not sure why you're encountering these issues, but it may have to do with the filtering you've 
set up. For example, you have a datasetScan with 
location="/net/nfs/wilma/data3/odac/model/mm5/analysis" that includes only 
"*.grib" files. You need to make sure that such files are actually where you said they'd 
be, or else TDS won't generate a link in the Dataset page. Have you tested with dummy data files?

Cheers,
Christian

On Tue, Jun 23, 2015 at 8:12 AM, Mark Maciolek <mlm@xxxxxxxxxx> wrote:
hi,

Attached my two catalog xml files, if someone would be kind enough to review 
them and point out any errors that prevents the fileServer service from working 
I would appreciate it.

mark

On 6/22/2015 7:50 PM, Christian Ward-Garrison wrote:
Hi Mark,

Both service definitions are fine. Rather, I suspect the problem is that you 
haven't defined a dataset root [1]. Here is a very basic example:

<?xml version="1.0" encoding="UTF-8"?>
<catalog name="Local TDS" 
xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
          version="1.0.6" xmlns:xlink="http://www.w3.org/1999/xlink";>
     <service name="http" serviceType="HTTPServer" base="/thredds/fileServer/"/>
<datasetRoot path="my/data" location="C:/Users/cwardgar/dev/data" />

     <dataset name="A Test Dataset" ID="testDataset" urlPath="my/data/foo.nc" >
         <serviceName>http</serviceName>
     </dataset>
</catalog>

I have a file at C:/Users/cwardgar/dev/data/foo.nc that TDS serves at 
http://localhost:8080/thredds/fileServer/my/data/foo.nc. In the datasetRoot 
element, the path I've chosen is arbitrary; the location is not (unless I move 
the file).

Cheers,
Christian

[1] 
http://www.unidata.ucar.edu/software/thredds/current/tds/tutorial/BasicConfigCatalogs.html#ConfigCatalogs

On Mon, Jun 22, 2015 at 12:19 PM, Mark Maciolek <mlm@xxxxxxxxxx> wrote:
hi,

Trying to get the thredds service fileServer working on our system
thredds 4.3

http://www.opal.sr.unh.edu/thredds/catalog/opal_ts/WBD/catalog.html?dataset=opal_ts/WBD/WBD_2015.nc

        • Data format: netCDF
        • Data size: 1.034 Mbytes
        • Data type: GRID
        • ID: opal_ts/WBD/WBD_2015.nc

from the catalog.xml file:

  <service name="fileServer" serviceType="HTTPServer" base="/thredds/fileServer
/"/>

have also tried this:

<service name="http" serviceType="HTTPServer" base="/thredds/fileServer/" />

get 404 error

there is nothing in the threddsServlet.log

Is there another config file or xml file I should be looking at?

mark
--

Mark Maciolek
Network Administrator
Morse Hall Room 339

603-862-3050
https://www.unh.edu/research/support-units/research-computing-center

_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/

--

Mark Maciolek
Network Administrator
Morse Hall Room 339

603-862-3050
https://www.unh.edu/research/support-units/research-computing-center




_______________________________________________
thredds mailing list

thredds@xxxxxxxxxxxxxxxx

For list information or to unsubscribe,  visit:
http://www.unidata.ucar.edu/mailing_lists/

_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/

_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/
**********************
"The contents of this message do not reflect any position of the U.S. Government or 
NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
***Note new address and phone***
110 Shaffer Road
Santa Cruz, CA 95060
Phone: (831)-420-3666
Fax: (831) 420-3980
e-mail: Roy.Mendelssohn@xxxxxxxx www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.





  • 2015 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: