Ethan, John, et al.,
Roy Mendelssohn sent me a catalog.xml file he uses with the TDS. I had
some questions about it that he suggested I put to you. Please see
forwarded message below.
Nathan
Begin forwarded message:
From: Nathan Potter <ndp@xxxxxxxxxxx>
Date: January 22, 2010 6:56:41 AM PST
To: Roy Mendelssohn <Roy.Mendelssohn@xxxxxxxx>
Cc: Nathan Potter <ndp@xxxxxxxxxxx>
Subject: Re: catalog.xml
Thanks Roy!
I have a question already:
- There are no thredds:datasetScan elements, I take it that they get
replaced with thredds:dataset elements that contain an NcML
aggregation. Is that true?
- I see thredds:dataset elements that contain what looks like a NcML:
<netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2
">
<aggregation dimName="time" type="joinExisting"
recheckEvery="720 min">
<variableAgg name="PHssta" />
<scan location="/u00/satellite/PH/ssta/1day/" suffix=".nc" />
</aggregation>
</netcdf>
However the NcML fragment is not in the NcML namespace (http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2
) but in the THREDDS namespace (http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0
) Is that really correct? The <netcdf> element and <aggregation>
elements do not appear in the THREDDS specification (http://www.unidata.ucar.edu/projects/THREDDS/tech/catalog/InvCatalogSpec.html
)
I assume that means that the TDS swallows this just fine. Does it
swallow it if the Ncml sections are put into the NcML namespace?
See attached document.
Nathan
<?xml version="1.0" encoding="UTF-8"?>
<catalog xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
xmlns:xlink="http://www.w3.org/1999/xlink";
xmlns:ncml="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
xsi:schemaLocation="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0
http://www.unidata.ucar.edu/schemas/thredds/InvCatalog.1.0.xsd";
name="Oceanwatch THREDDS Data Server"
version="1.0.1" >
<service name="all" serviceType="Compound" base="">
<service name="ncdods" serviceType="OPENDAP" base="/thredds/dodsC/" />
<service name="wcs" serviceType="WCS" base="/thredds/wcs/" />
<service name="wms" serviceType="WMS" base="/thredds/wms/" />
</service>
<dataset name="SST, Pathfinder Ver 5.0, Day and Night, 4.4 km, Global,
Science Quality">
<dataset name="1-day" ID="satellite/PH/ssta/1day"
urlPath="satellite/PH/ssta/1day">
<serviceName>all</serviceName>
<ncml:netcdf
xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
<ncml:aggregation dimName="time" type="joinExisting" recheckEvery="720
min">
<ncml:variableAgg name="PHssta" />
<ncml:scan location="/u00/satellite/PH/ssta/1day/" suffix=".nc" />
</ncml:aggregation>
</ncml:netcdf>
<metadata inherited="true">
<authority>gov.noaa.pfel.coastwatch</authority>
<dataType>Grid</dataType>
<dataFormat>NetCDF</dataFormat>
<documentation type="Summary">
AVHRR Pathfinder Oceans Project seeks to create a long-term,
continuous sea surface temperature data series for use in climate research.
The Pathfinder SST data begins with historic AVHRR Global Area Coverage SST.
This data is re-evaluated and re-calibrated, improving both the accuracy and
number of valid SST values (due to improved cloud-masking).
</documentation>
<documentation type="Rights">
The data may be used and redistributed for free but is not intended
for legal use, since it may contain inaccuracies. Neither the data Contributor,
CoastWatch, NOAA, nor the United States Government, nor any of their employees
or contractors, makes any warranty, express or implied, including warranties of
merchantability and fitness for a particular purpose, or assumes any legal
liability for the accuracy, completeness, or usefulness, of this information.
</documentation>
<documentation
xlink:href="http://coastwatch.pfel.noaa.gov/infog/PH_ssta_las.html";
xlink:title="Dataset Summary" />
<documentation xlink:href="http://oceanwatch.pfeg.noaa.gov";
xlink:title="Oceanwatch Live Access Server" />
<creator>
<name>NOAA NODC</name>
<contact url="" email="" />
</creator>
<publisher>
<name>NOAA CoastWatch, West Coast Node</name>
<contact url="http://coastwatch.pfel.noaa.gov";
email="dave.foley@xxxxxxxx" />
</publisher>
<geospatialCoverage>
<northsouth>
<start>-89.97803</start>
<size>179.95606</size>
<resolution>0.0439453137973138</resolution>
<units>degrees_north</units>
</northsouth>
<eastwest>
<start>0.02197266</start>
<size>359.95602734</size>
<resolution>0.04394530916127457</resolution>
<units>degrees_east</units>
</eastwest>
</geospatialCoverage>
<timeCoverage>
<start>1985-01-04 12:00:00Z</start>
<end>2007-12-31 12:00:00Z</end>
</timeCoverage>
<variables vocabulary="CF-1.0">
<variable name="time" vocabulary_name="time" units="seconds since
1970-01-01T00:00:00Z">time</variable>
<variable name="altitude" vocabulary_name="altitude"
units="m">altitude</variable>
<variable name="lat" vocabulary_name="latitude"
units="degrees_north">lat</variable>
<variable name="lon" vocabulary_name="longtitude"
units="degrees_east">lon</variable>
<variable name="PHssta" vocabulary_name="sea_surface_temperature"
units="degree_C">SST, Pathfinder Ver 5.0, Day and Night, 4.4 km, Global,
Science Quality</variable>
</variables>
</metadata>
</dataset>
<dataset name="5-day" ID="satellite/PH/ssta/5day"
urlPath="satellite/PH/ssta/5day">
<serviceName>all</serviceName>
<ncml:netcdf
xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
<ncml:aggregation dimName="time" type="joinExisting" recheckEvery="720
min">
<ncml:variableAgg name="PHssta" />
<ncml:scan location="/u00/satellite/PH/ssta/5day/" suffix=".nc" />
</ncml:aggregation>
</ncml:netcdf>
<metadata inherited="true">
<authority>gov.noaa.pfel.coastwatch</authority>
<dataType>Grid</dataType>
<dataFormat>NetCDF</dataFormat>
<documentation type="Summary">
AVHRR Pathfinder Oceans Project seeks to create a long-term,
continuous sea surface temperature data series for use in climate research.
The Pathfinder SST data begins with historic AVHRR Global Area Coverage SST.
This data is re-evaluated and re-calibrated, improving both the accuracy and
number of valid SST values (due to improved cloud-masking).
</documentation>
<documentation type="Rights">
The data may be used and redistributed for free but is not intended
for legal use, since it may contain inaccuracies. Neither the data Contributor,
CoastWatch, NOAA, nor the United States Government, nor any of their employees
or contractors, makes any warranty, express or implied, including warranties of
merchantability and fitness for a particular purpose, or assumes any legal
liability for the accuracy, completeness, or usefulness, of this information.
</documentation>
<documentation
xlink:href="http://coastwatch.pfel.noaa.gov/infog/PH_ssta_las.html";
xlink:title="Dataset Summary" />
<documentation xlink:href="http://oceanwatch.pfeg.noaa.gov";
xlink:title="Oceanwatch Live Access Server" />
<creator>
<name>NOAA NODC</name>
<contact url="" email="" />
</creator>
<publisher>
<name>NOAA CoastWatch, West Coast Node</name>
<contact url="http://coastwatch.pfel.noaa.gov";
email="dave.foley@xxxxxxxx" />
</publisher>
<geospatialCoverage>
<northsouth>
<start>-89.97803</start>
<size>179.95606</size>
<resolution>0.0439453137973138</resolution>
<units>degrees_north</units>
</northsouth>
<eastwest>
<start>0.02197266</start>
<size>359.95602734</size>
<resolution>0.04394530916127457</resolution>
<units>degrees_east</units>
</eastwest>
</geospatialCoverage>
<timeCoverage>
<start>1985-01-03 12:00:00Z</start>
<end>2007-12-29 12:00:00Z</end>
</timeCoverage>
<variables vocabulary="CF-1.0">
<variable name="time" vocabulary_name="time" units="seconds since
1970-01-01T00:00:00Z">time</variable>
<variable name="altitude" vocabulary_name="altitude"
units="m">altitude</variable>
<variable name="lat" vocabulary_name="latitude"
units="degrees_north">lat</variable>
<variable name="lon" vocabulary_name="longtitude"
units="degrees_east">lon</variable>
<variable name="PHssta" vocabulary_name="sea_surface_temperature"
units="degree_C">SST, Pathfinder Ver 5.0, Day and Night, 4.4 km, Global,
Science Quality</variable>
</variables>
</metadata>
</dataset>
<dataset name="7-day" ID="satellite/PH/ssta/7day"
urlPath="satellite/PH/ssta/7day">
<serviceName>all</serviceName>
<ncml:netcdf
xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
<ncml:aggregation dimName="time" type="joinExisting" recheckEvery="720
min">
<ncml:variableAgg name="PHssta" />
<ncml:scan location="/u00/satellite/PH/ssta/7day/" suffix=".nc" />
</ncml:aggregation>
</ncml:netcdf>
<metadata inherited="true">
<authority>gov.noaa.pfel.coastwatch</authority>
<dataType>Grid</dataType>
<dataFormat>NetCDF</dataFormat>
<documentation type="Summary">
AVHRR Pathfinder Oceans Project seeks to create a long-term,
continuous sea surface temperature data series for use in climate research.
The Pathfinder SST data begins with historic AVHRR Global Area Coverage SST.
This data is re-evaluated and re-calibrated, improving both the accuracy and
number of valid SST values (due to improved cloud-masking).
</documentation>
<documentation type="Rights">
The data may be used and redistributed for free but is not intended
for legal use, since it may contain inaccuracies. Neither the data Contributor,
CoastWatch, NOAA, nor the United States Government, nor any of their employees
or contractors, makes any warranty, express or implied, including warranties of
merchantability and fitness for a particular purpose, or assumes any legal
liability for the accuracy, completeness, or usefulness, of this information.
</documentation>
<documentation
xlink:href="http://coastwatch.pfel.noaa.gov/infog/PH_ssta_las.html";
xlink:title="Dataset Summary" />
<documentation xlink:href="http://oceanwatch.pfeg.noaa.gov";
xlink:title="Oceanwatch Live Access Server" />
<creator>
<name>NOAA NODC</name>
<contact url="" email="" />
</creator>
<publisher>
<name>NOAA CoastWatch, West Coast Node</name>
<contact url="http://coastwatch.pfel.noaa.gov";
email="dave.foley@xxxxxxxx" />
</publisher>
<geospatialCoverage>
<northsouth>
<start>-89.97803</start>
<size>179.95606</size>
<resolution>0.0439453137973138</resolution>
<units>degrees_north</units>
</northsouth>
<eastwest>
<start>0.02197266</start>
<size>359.95602734</size>
<resolution>0.04394530916127457</resolution>
<units>degrees_east</units>
</eastwest>
</geospatialCoverage>
<timeCoverage>
<start>1985-01-11 12:00:00Z</start>
<end>2007-12-27 12:00:00Z</end>
</timeCoverage>
<variables vocabulary="CF-1.0">
<variable name="time" vocabulary_name="time" units="seconds since
1970-01-01T00:00:00Z">time</variable>
<variable name="altitude" vocabulary_name="altitude"
units="m">altitude</variable>
<variable name="lat" vocabulary_name="latitude"
units="degrees_north">lat</variable>
<variable name="lon" vocabulary_name="longtitude"
units="degrees_east">lon</variable>
<variable name="PHssta" vocabulary_name="sea_surface_temperature"
units="degree_C">SST, Pathfinder Ver 5.0, Day and Night, 4.4 km, Global,
Science Quality</variable>
</variables>
</metadata>
</dataset>
<dataset name="8-day" ID="satellite/PH/ssta/8day"
urlPath="satellite/PH/ssta/8day">
<serviceName>all</serviceName>
<ncml:netcdf
xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
<ncml:aggregation dimName="time" type="joinExisting" recheckEvery="720
min">
<ncml:variableAgg name="PHssta" />
<ncml:scan location="/u00/satellite/PH/ssta/8day/" suffix=".nc" />
</ncml:aggregation>
</ncml:netcdf>
<metadata inherited="true">
<authority>gov.noaa.pfel.coastwatch</authority>
<dataType>Grid</dataType>
<dataFormat>NetCDF</dataFormat>
<documentation type="Summary">
AVHRR Pathfinder Oceans Project seeks to create a long-term,
continuous sea surface temperature data series for use in climate research.
The Pathfinder SST data begins with historic AVHRR Global Area Coverage SST.
This data is re-evaluated and re-calibrated, improving both the accuracy and
number of valid SST values (due to improved cloud-masking).
</documentation>
<documentation type="Rights">
The data may be used and redistributed for free but is not intended
for legal use, since it may contain inaccuracies. Neither the data Contributor,
CoastWatch, NOAA, nor the United States Government, nor any of their employees
or contractors, makes any warranty, express or implied, including warranties of
merchantability and fitness for a particular purpose, or assumes any legal
liability for the accuracy, completeness, or usefulness, of this information.
</documentation>
<documentation
xlink:href="http://coastwatch.pfel.noaa.gov/infog/PH_ssta_las.html";
xlink:title="Dataset Summary" />
<documentation xlink:href="http://oceanwatch.pfeg.noaa.gov";
xlink:title="Oceanwatch Live Access Server" />
<creator>
<name>NOAA NODC</name>
<contact url="" email="" />
</creator>
<publisher>
<name>NOAA CoastWatch, West Coast Node</name>
<contact url="http://coastwatch.pfel.noaa.gov";
email="dave.foley@xxxxxxxx" />
</publisher>
<geospatialCoverage>
<northsouth>
<start>-89.97803</start>
<size>179.95606</size>
<resolution>0.0439453137973138</resolution>
<units>degrees_north</units>
</northsouth>
<eastwest>
<start>0.02197266</start>
<size>359.95602734</size>
<resolution>0.04394530916127457</resolution>
<units>degrees_east</units>
</eastwest>
</geospatialCoverage>
<timeCoverage>
<start>1985-01-05 00:00:00Z</start>
<end>2007-12-23 00:00:00Z</end>
</timeCoverage>
<variables vocabulary="CF-1.0">
<variable name="time" vocabulary_name="time" units="seconds since
1970-01-01T00:00:00Z">time</variable>
<variable name="altitude" vocabulary_name="altitude"
units="m">altitude</variable>
<variable name="lat" vocabulary_name="latitude"
units="degrees_north">lat</variable>
<variable name="lon" vocabulary_name="longtitude"
units="degrees_east">lon</variable>
<variable name="PHssta" vocabulary_name="sea_surface_temperature"
units="degree_C">SST, Pathfinder Ver 5.0, Day and Night, 4.4 km, Global,
Science Quality</variable>
</variables>
</metadata>
</dataset>
<dataset name="Monthly" ID="satellite/PH/ssta/mday"
urlPath="satellite/PH/ssta/mday">
<serviceName>all</serviceName>
<ncml:netcdf
xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
<ncml:aggregation dimName="time" type="joinExisting" recheckEvery="720
min">
<ncml:variableAgg name="PHssta" />
<ncml:scan location="/u00/satellite/PH/ssta/mday/" suffix=".nc" />
</ncml:aggregation>
</ncml:netcdf>
<metadata inherited="true">
<authority>gov.noaa.pfel.coastwatch</authority>
<dataType>Grid</dataType>
<dataFormat>NetCDF</dataFormat>
<documentation type="Summary">
AVHRR Pathfinder Oceans Project seeks to create a long-term,
continuous sea surface temperature data series for use in climate research.
The Pathfinder SST data begins with historic AVHRR Global Area Coverage SST.
This data is re-evaluated and re-calibrated, improving both the accuracy and
number of valid SST values (due to improved cloud-masking).
</documentation>
<documentation type="Rights">
The data may be used and redistributed for free but is not intended
for legal use, since it may contain inaccuracies. Neither the data Contributor,
CoastWatch, NOAA, nor the United States Government, nor any of their employees
or contractors, makes any warranty, express or implied, including warranties of
merchantability and fitness for a particular purpose, or assumes any legal
liability for the accuracy, completeness, or usefulness, of this information.
</documentation>
<documentation
xlink:href="http://coastwatch.pfel.noaa.gov/infog/PH_ssta_las.html";
xlink:title="Dataset Summary" />
<documentation xlink:href="http://oceanwatch.pfeg.noaa.gov";
xlink:title="Oceanwatch Live Access Server" />
<creator>
<name>NOAA NODC</name>
<contact url="" email="" />
</creator>
<publisher>
<name>NOAA CoastWatch, West Coast Node</name>
<contact url="http://coastwatch.pfel.noaa.gov";
email="dave.foley@xxxxxxxx" />
</publisher>
<geospatialCoverage>
<northsouth>
<start>-89.97803</start>
<size>179.95606</size>
<resolution>0.0439453137973138</resolution>
<units>degrees_north</units>
</northsouth>
<eastwest>
<start>0.02197266</start>
<size>359.95602734</size>
<resolution>0.04394530916127457</resolution>
<units>degrees_east</units>
</eastwest>
</geospatialCoverage>
<timeCoverage>
<start>1985-01-16 12:00:00Z</start>
<end>2007-12-16 12:00:00Z</end>
</timeCoverage>
<variables vocabulary="CF-1.0">
<variable name="time" vocabulary_name="time" units="seconds since
1970-01-01T00:00:00Z">time</variable>
<variable name="altitude" vocabulary_name="altitude"
units="m">altitude</variable>
<variable name="lat" vocabulary_name="latitude"
units="degrees_north">lat</variable>
<variable name="lon" vocabulary_name="longtitude"
units="degrees_east">lon</variable>
<variable name="PHssta" vocabulary_name="sea_surface_temperature"
units="degree_C">SST, Pathfinder Ver 5.0, Day and Night, 4.4 km, Global,
Science Quality</variable>
</variables>
</metadata>
</dataset>
</dataset>
</catalog>
On Jan 21, 2010, at 2:06 PM, Roy Mendelssohn wrote:
Hi Nathan:
Attached is the catalog.xml file (at the lowest level where the
aggregation is done) for some of our pathfinder data - something I
sent to Ken Casey recently. I will put together a sample of the
files also.
-Roy
**********************
"The contents of this message do not reflect any position of the
U.S. Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097
e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/
"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
<pathfinder_catalog.xml>
= = =
Nathan Potter ndp at opendap.org
OPeNDAP, Inc. +1.541.231.3317
= = =
Nathan Potter ndp at opendap.org
OPeNDAP, Inc. +1.541.231.3317
