Re: [thredds] Join Existing aggregations with ncml in TDS 4.2 and 4.3

Hi,

This is still happening again when I attempt to use the latest TDS
(4.3.15).  We are trying to aggregate remote OPeNDAP URLs.  Has that
capability been deprecated?

Error {
    code = 500;
    message = 
"http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.2011.nc#843772940
is not a valid URL, return status=400";
};


Yet, when I go to the cache directory, it looks empty to me:

[rhs@dunkel cache]$ pwd
/home/users/rhs/tomcat2/content/thredds/cache
[rhs@dunkel cache]$ ls -lR
.:
total 12
drwxr-xr-x 2 rhs tmap 4096 Mar 15 06:10 agg
drwxr-xr-x 2 rhs tmap 4096 Mar 15 06:10 cdm
drwxr-xr-x 2 rhs tmap 4096 Mar 15 06:10 grib

./agg:
total 0

./cdm:
total 0

./grib:
total 0

Roland


On Mon, Mar 4, 2013 at 8:26 AM, Roland Schweitzer - NOAA Affiliate <
roland.schweitzer@xxxxxxxx> wrote:

> Hi John,
>
> Thanks.  We did not find a cache file that matched when we grepped for the
> number.  We probably cleared the cache at some point.  We will experiment
> with recreating the problem which likely came up by running a 4.2 server
> then upgrading to 4.3 without clearing the contents of
> content/thredds/cache in between.
>
> Roland
>
>
> On Sat, Feb 23, 2013 at 4:08 PM, John Caron <caron@xxxxxxxxxxxxxxxx>wrote:
>
>> Hi Roland:
>>
>> It looks like a caching problem.
>>
>> go into {tomcat_home}/thredds/content/cache/agg/
>>
>> and grep for "1405627963". If you find it, send me that file.
>>
>> John
>>
>> On 1/10/2013 1:05 PM, Roland Schweitzer - NOAA Affiliate wrote:
>> > Hi,
>> >
>> > In TDS version 4.2.5 - 20110302.2315 we would do aggregations with this
>> > sort of ncml specification and things worked as we expected, but with
>> > TDS Version 4.3.15 - 20121218.1126 when use the exact same catalog we
>> > get the following error:
>> >
>> > Error {
>> >      code = 500;
>> >      message = "
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
>>  is not a valid URL, return status=400";
>> > };
>> >
>> >
>> > 2013-01-10T12:01:00.718 -0800 [    971459][      22] ERROR -
>> thredds.server.opendap.OpendapServlet - path=
>> /Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation.html
>> > java.io.IOException:
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
>>  is not a valid URL, return status=400
>> >          at
>> ucar.nc2.dataset.NetcdfDataset.disambiguateHttp(NetcdfDataset.java:725)
>> >          at
>> ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:674)
>> >          at
>> ucar.nc2.dataset.NetcdfDataset.acquireFile(NetcdfDataset.java:628)
>> >          at
>> ucar.nc2.ncml.Aggregation$Dataset.acquireFile(Aggregation.java:634)
>> >          at
>> ucar.nc2.ncml.AggregationExisting.buildNetcdfDataset(AggregationExisting.java:74)
>> >
>> >          [...]
>> >
>> >
>> > I know FMRC aggregations changed, but I thought something along the
>> lines of the catalog below would still work in 4.3.  What's the right way
>> to do this sort of aggrgation in 4.3?
>> >
>> > Roland
>> >
>> >
>> > <?xml version="1.0" encoding="UTF-8"?>
>> > <catalog
>> > xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
>> > xmlns:xlink="http://www.w3.org/1999/xlink"; version="1.0.1">
>> >    <service name="compound" serviceType="compound" base="">
>> >      <service name="dods" base="/thredds/dodsC/" serviceType="OPeNDAP"
>> />
>> >    </service>
>> >    <dataset name="pressure"
>> > ID="PSDgriddedData/ncep.reanalysis2.dailyavgs/pressure">
>> >      <metadata inherited="true">
>> >        <dataType>GRID</dataType>
>> >      </metadata>
>> >      <dataset name="air"
>> > ID="PSDgriddedData.ncep.reanalysis2.dailyavgs.pressure.air.1979.nc
>> > <http://PSDgriddedData.ncep.reanalysis2.dailyavgs.pressure.air.1979.nc
>> >"
>> > urlPath="Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation">
>> >        <documentation type="Notes"
>> > xlink:href="
>> http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.html
>> "
>> > xlink:title="Aggregated from catalog
>> >
>> http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.html
>> > starting with
>> >
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure
>> "
>> > />
>> >        <property name="eastwestPropertyNumberOfPoints" value="144" />
>> >        <property name="eastwestResolution" value="2.5" />
>> >        <property name="eastwestStart" value="0.0" />
>> >        <property name="northsouthPropertyNumberOfPoints" value="73" />
>> >        <property name="northsouthResolution" value="2.5" />
>> >        <property name="northsouthStart" value="-90.0" />
>> >        <property name="updownValues" value="1000.0 925.0 850.0 700.0
>> > 600.0 500.0 400.0 300.0 250.0 200.0 150.0 100.0 70.0 50.0 30.0 20.0
>> 10.0" />
>> >        <property name="hasZ" value="air" />
>> >        <property name="hasT" value="air" />
>> >        <property name="timeAxisUnits" value="hours since 1800-1-1
>> > 00:00:0.0" />
>> >        <property name="timeCoverageStart" value="1979-01-01 00:00:00Z"
>> />
>> >        <property name="timeCoverageNumberOfPoints" value="12235" />
>> >        <timeCoverage>
>> >          <start>1979-01-01 00:00:00Z</start>
>> >          <end>1982-12-31 00:00:00Z</end>
>> >        </timeCoverage>
>> >        <geospatialCoverage zpositive="down">
>> >          <northsouth>
>> >            <start>-90.0</start>
>> >            <size>180.0</size>
>> >            <units>degrees_north</units>
>> >          </northsouth>
>> >          <eastwest>
>> >            <start>0.0</start>
>> >            <size>357.5</size>
>> >            <units>degrees_east</units>
>> >          </eastwest>
>> >          <updown>
>> >            <start>10.0</start>
>> >            <size>990.0</size>
>> >            <units>millibar</units>
>> >          </updown>
>> >        </geospatialCoverage>
>> >        <serviceName>compound</serviceName>
>> >        <metadata inherited="true">
>> >          <variables vocabulary="netCDF_contents">
>> >            <variable name="air" units="degK" vocabulary_name="Daily Air
>> > Temperature on Pressure Levels" />
>> >          </variables>
>> >        </metadata>
>> >        <dataSize units="Mbytes">130.4</dataSize>
>> >        <date type="modified">2011-06-14 00:26:25Z</date>
>> >        <netcdf
>> > xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
>> >          <aggregation type="joinExisting" dimName="time">
>> >            <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1979.nc
>> "
>> > ncoords="365" />
>> >            <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1980.nc
>> "
>> > ncoords="366" />
>> >            <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc
>> "
>> > ncoords="365" />
>> >            <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1982.nc
>> "
>> > ncoords="365" />
>> >          </aggregation>
>> >        </netcdf>
>> >      </dataset>
>> >    </dataset>
>> > </catalog>
>> >
>> >
>> > _______________________________________________
>> > thredds mailing list
>> > thredds@xxxxxxxxxxxxxxxx
>> > For list information or to unsubscribe,  visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>> >
>>
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe,  visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>>
>
>
  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: