Hi,
This is still happening again when I attempt to use the latest TDS
(4.3.15). We are trying to aggregate remote OPeNDAP URLs. Has that
capability been deprecated?
Error {
code = 500;
message =
"http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.2011.nc#843772940
is not a valid URL, return status=400";
};
Yet, when I go to the cache directory, it looks empty to me:
[rhs@dunkel cache]$ pwd
/home/users/rhs/tomcat2/content/thredds/cache
[rhs@dunkel cache]$ ls -lR
.:
total 12
drwxr-xr-x 2 rhs tmap 4096 Mar 15 06:10 agg
drwxr-xr-x 2 rhs tmap 4096 Mar 15 06:10 cdm
drwxr-xr-x 2 rhs tmap 4096 Mar 15 06:10 grib
./agg:
total 0
./cdm:
total 0
./grib:
total 0
Roland
On Mon, Mar 4, 2013 at 8:26 AM, Roland Schweitzer - NOAA Affiliate <
roland.schweitzer@xxxxxxxx> wrote:
> Hi John,
>
> Thanks. We did not find a cache file that matched when we grepped for the
> number. We probably cleared the cache at some point. We will experiment
> with recreating the problem which likely came up by running a 4.2 server
> then upgrading to 4.3 without clearing the contents of
> content/thredds/cache in between.
>
> Roland
>
>
> On Sat, Feb 23, 2013 at 4:08 PM, John Caron <caron@xxxxxxxxxxxxxxxx>wrote:
>
>> Hi Roland:
>>
>> It looks like a caching problem.
>>
>> go into {tomcat_home}/thredds/content/cache/agg/
>>
>> and grep for "1405627963". If you find it, send me that file.
>>
>> John
>>
>> On 1/10/2013 1:05 PM, Roland Schweitzer - NOAA Affiliate wrote:
>> > Hi,
>> >
>> > In TDS version 4.2.5 - 20110302.2315 we would do aggregations with this
>> > sort of ncml specification and things worked as we expected, but with
>> > TDS Version 4.3.15 - 20121218.1126 when use the exact same catalog we
>> > get the following error:
>> >
>> > Error {
>> > code = 500;
>> > message = "
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
>> is not a valid URL, return status=400";
>> > };
>> >
>> >
>> > 2013-01-10T12:01:00.718 -0800 [ 971459][ 22] ERROR -
>> thredds.server.opendap.OpendapServlet - path=
>> /Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation.html
>> > java.io.IOException:
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
>> is not a valid URL, return status=400
>> > at
>> ucar.nc2.dataset.NetcdfDataset.disambiguateHttp(NetcdfDataset.java:725)
>> > at
>> ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:674)
>> > at
>> ucar.nc2.dataset.NetcdfDataset.acquireFile(NetcdfDataset.java:628)
>> > at
>> ucar.nc2.ncml.Aggregation$Dataset.acquireFile(Aggregation.java:634)
>> > at
>> ucar.nc2.ncml.AggregationExisting.buildNetcdfDataset(AggregationExisting.java:74)
>> >
>> > [...]
>> >
>> >
>> > I know FMRC aggregations changed, but I thought something along the
>> lines of the catalog below would still work in 4.3. What's the right way
>> to do this sort of aggrgation in 4.3?
>> >
>> > Roland
>> >
>> >
>> > <?xml version="1.0" encoding="UTF-8"?>
>> > <catalog
>> > xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0"
>> > xmlns:xlink="http://www.w3.org/1999/xlink" version="1.0.1">
>> > <service name="compound" serviceType="compound" base="">
>> > <service name="dods" base="/thredds/dodsC/" serviceType="OPeNDAP"
>> />
>> > </service>
>> > <dataset name="pressure"
>> > ID="PSDgriddedData/ncep.reanalysis2.dailyavgs/pressure">
>> > <metadata inherited="true">
>> > <dataType>GRID</dataType>
>> > </metadata>
>> > <dataset name="air"
>> > ID="PSDgriddedData.ncep.reanalysis2.dailyavgs.pressure.air.1979.nc
>> > <http://PSDgriddedData.ncep.reanalysis2.dailyavgs.pressure.air.1979.nc
>> >"
>> > urlPath="Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation">
>> > <documentation type="Notes"
>> > xlink:href="
>> http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.html
>> "
>> > xlink:title="Aggregated from catalog
>> >
>> http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.html
>> > starting with
>> >
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure
>> "
>> > />
>> > <property name="eastwestPropertyNumberOfPoints" value="144" />
>> > <property name="eastwestResolution" value="2.5" />
>> > <property name="eastwestStart" value="0.0" />
>> > <property name="northsouthPropertyNumberOfPoints" value="73" />
>> > <property name="northsouthResolution" value="2.5" />
>> > <property name="northsouthStart" value="-90.0" />
>> > <property name="updownValues" value="1000.0 925.0 850.0 700.0
>> > 600.0 500.0 400.0 300.0 250.0 200.0 150.0 100.0 70.0 50.0 30.0 20.0
>> 10.0" />
>> > <property name="hasZ" value="air" />
>> > <property name="hasT" value="air" />
>> > <property name="timeAxisUnits" value="hours since 1800-1-1
>> > 00:00:0.0" />
>> > <property name="timeCoverageStart" value="1979-01-01 00:00:00Z"
>> />
>> > <property name="timeCoverageNumberOfPoints" value="12235" />
>> > <timeCoverage>
>> > <start>1979-01-01 00:00:00Z</start>
>> > <end>1982-12-31 00:00:00Z</end>
>> > </timeCoverage>
>> > <geospatialCoverage zpositive="down">
>> > <northsouth>
>> > <start>-90.0</start>
>> > <size>180.0</size>
>> > <units>degrees_north</units>
>> > </northsouth>
>> > <eastwest>
>> > <start>0.0</start>
>> > <size>357.5</size>
>> > <units>degrees_east</units>
>> > </eastwest>
>> > <updown>
>> > <start>10.0</start>
>> > <size>990.0</size>
>> > <units>millibar</units>
>> > </updown>
>> > </geospatialCoverage>
>> > <serviceName>compound</serviceName>
>> > <metadata inherited="true">
>> > <variables vocabulary="netCDF_contents">
>> > <variable name="air" units="degK" vocabulary_name="Daily Air
>> > Temperature on Pressure Levels" />
>> > </variables>
>> > </metadata>
>> > <dataSize units="Mbytes">130.4</dataSize>
>> > <date type="modified">2011-06-14 00:26:25Z</date>
>> > <netcdf
>> > xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2">
>> > <aggregation type="joinExisting" dimName="time">
>> > <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1979.nc
>> "
>> > ncoords="365" />
>> > <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1980.nc
>> "
>> > ncoords="366" />
>> > <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc
>> "
>> > ncoords="365" />
>> > <netcdf
>> > location="
>> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1982.nc
>> "
>> > ncoords="365" />
>> > </aggregation>
>> > </netcdf>
>> > </dataset>
>> > </dataset>
>> > </catalog>
>> >
>> >
>> > _______________________________________________
>> > thredds mailing list
>> > thredds@xxxxxxxxxxxxxxxx
>> > For list information or to unsubscribe, visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>> >
>>
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe, visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>>
>
>