-------- Original Message --------
Subject: RE: [thredds] grib2 feature collection on TDS 4.5 dev
Date: Mon, 9 Jun 2014 11:36:36 -0400
From: Guan Wang <gwang@xxxxxxx>
To: 'John Caron' <caron@xxxxxxxxxxxxxxxx>
Hi John,
Thank you so much for the prompt reply!
You are absolutely right! Regular Exp '.*' instead of '*' is the fix.
Now TDS can find the files and I can see ncx2 files created.
Guan
*From:*thredds-bounces@xxxxxxxxxxxxxxxx
[mailto:thredds-bounces@xxxxxxxxxxxxxxxx] *On Behalf Of *John Caron
*Sent:* Monday, June 9, 2014 11:11 AM
*To:* thredds@xxxxxxxxxxxxxxxx
*Subject:* Re: [thredds] grib2 feature collection on TDS 4.5 dev
Hi Guan:
<collection
spec="/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t*z.grib2$"
is a regular expression, not a glob
it probably should be
/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t.*z.grib2$
John
On 6/9/2014 8:47 AM, Guan Wang wrote:
Hi,
I have trouble to make TDS 4.5 dev work with grib2 feature
collection. The WaveWatch III grib2 file can be served individually
in TDS 4.5 but the feature collection doesn't work. I guess I must
miss something in the xml. Could you please shed some light on this?
Here is the xml:
<?xml version="1.0" encoding="UTF-8"?>
<catalog name="WWIII GL"
xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
<http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0>
xmlns:xlink="http://www.w3.org/1999/xlink";
<http://www.w3.org/1999/xlink>>
<service name="latest" serviceType="Resolver" base="" />
<service name="both" serviceType="Compound" base="">
<service name="ncdods" serviceType="OPENDAP"
base="/thredds/dodsC/" />
<service name="HTTPServer" serviceType="HTTPServer"
base="/thredds/fileServer/" />
</service>
<dataset name="Great Lakes WWIII">
<metadata inherited="true">
<serviceName>both</serviceName>
<authority>edu.ucar.unidata</authority>
<dataFormat>GRIB-2</dataFormat>
<documentation type="rights">Freely available</documentation>
<documentation xlink:href=" " xlink:title=" "></documentation>
<creator>
<name vocabulary="DIF"> </name>
<contact url=" " email=" " />
</creator>
<publisher>
<name vocabulary="DIF"> </name>
<contact url="http://www.unidata.ucar.edu/";
<http://www.unidata.ucar.edu/> email="support@xxxxxxxxxxxxxxxx"
<mailto:support@xxxxxxxxxxxxxxxx> />
</publisher>
</metadata>
<featureCollection name="WWIII-GL" featureType="GRIB2"
harvest="true" path="glww3/">
<metadata inherited="true">
<!--<dataFormat>GRIB2</dataFormat>-->
<documentation type="summary">
WWIII GL Test
</documentation>
</metadata>
<collection
spec="/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t*z.grib2$"
timePartition="directory" olderThan="5 min"
dateFormatMark="#ww3_#yyyy-MM-ddTHH:mm:ssZ"/>
<update startup="true" trigger="allow"/>
<tdm rescan="0 0/15 * * * ? *" trigger="allow"/>
<gribConfig datasetTypes="TwoD Best LatestFile Files" />
</featureCollection>
</dataset>
</catalog>
Here is the traceback stack:
2014-06-06T20:10:33.535 +0000 INFO - FeatureCollection added = name
='WWIII_GL' type='GRIB2'
spec='/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t??z.grib2$'
olderThan =5 min
timePartition =none
updateConfig =UpdateConfig{userDefined=false,
recheckAfter='null', rescan='null', triggerOk=true, updateType=test}
tdmConfig =UpdateConfig{userDefined=true, recheckAfter='null',
rescan='0 0/15 * * * ? *', triggerOk=true, updateType=test}
ProtoConfig{choice=Penultimate, change='null', param='null',
outerNcml='null', cacheAll=true}
hasInnerNcml =false
GribConfig{datasets=[TwoD, Best, Latest],
pdsHash={useGenType=false, intvMerge=true, useTableVersion=true},
filesSortIncreasing=true}
2014-06-06T20:10:33.613 +0000 INFO - Schedule startup scan
force=test for 'WWIII_GL' at 2014-06-06T20:10:36.607+0000
2014-06-06T20:10:36.641 +0000 WARN - No records found in files.
Check Grib1/Grib2 for collection WWIII_GL-testdata. If wrong, delete
gbx9.
2014-06-06T20:10:36.642 +0000 ERROR - UpdateCollectionJob.execute
startup failed collection=WWIII_GL
java.lang.IllegalStateException: No records found in dataset
WWIII_GL-testdata
at
ucar.nc2.grib.collection.Grib2CollectionBuilder.makeGroups(Grib2CollectionBuilder.java:157)
~[grib-4.5.0.jar:4.5.0]
at
ucar.nc2.grib.collection.GribCollectionBuilder.createIndex(GribCollectionBuilder.java:117)
~[grib-4.5.0.jar:4.5.0]
at
ucar.nc2.grib.collection.GribCdmIndex.updateGribCollection(GribCdmIndex.java:243)
~[grib-4.5.0.jar:4.5.0]
at
ucar.nc2.grib.collection.GribCdmIndex.openGribCollection(GribCdmIndex.java:461)
~[grib-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFcGrib.updateCollection(InvDatasetFcGrib.java:151)
~[grib-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.checkState(InvDatasetFeatureCollection.java:294)
~[cdm-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.update(InvDatasetFeatureCollection.java:313)
~[cdm-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.sendEvent(InvDatasetFeatureCollection.java:230)
~[cdm-4.5.0.jar:4.5.0]
at
thredds.inventory.CollectionUpdater$UpdateCollectionJob.execute(CollectionUpdater.java:207)
[cdm-4.5.0.jar:4.5.0]
at org.quartz.core.JobRunShell.run(JobRunShell.java:207)
[quartz-2.2.0.jar:?]
at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:560)
[quartz-2.2.0.jar:?]
2014-06-06T20:13:20.577 +0000 INFO - FeatureCollection added = name
='WWIII_GL' type='GRIB2'
spec='/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t??z.grib2$'
olderThan =5 min
timePartition =none
updateConfig =UpdateConfig{userDefined=true, recheckAfter='null',
rescan='null', triggerOk=true, updateType=never}
tdmConfig =UpdateConfig{userDefined=true, recheckAfter='null',
rescan='0 0/15 * * * ? *', triggerOk=true, updateType=test}
ProtoConfig{choice=Penultimate, change='null', param='null',
outerNcml='null', cacheAll=true}
hasInnerNcml =false
GribConfig{datasets=[TwoD, Best, Files, Latest],
pdsHash={useGenType=false, intvMerge=true, useTableVersion=true},
filesSortIncreasing=true}
2014-06-06T20:13:20.659 +0000 INFO - Schedule startup scan
force=never for 'WWIII_GL' at 2014-06-06T20:13:23.653+0000
2014-06-06T20:13:23.667 +0000 INFO - updateGribCollection WWIII_GL
changed false took 3 msecs
2014-06-06T20:13:23.670 +0000 WARN - GribCdmIndex.openCdmIndex
failed on
/var/lib/tomcat7054/content/thredds/public/testdata/WWIII_GL.ncx2
java.io.FileNotFoundException:
/var/lib/tomcat7054/content/thredds/public/testdata/WWIII_GL.ncx2
(No such file or directory)
at java.io.RandomAccessFile.open(Native Method) ~[?:1.7.0_60]
at
java.io.RandomAccessFile.<init>(RandomAccessFile.java:241) ~[?:1.7.0_60]
at
java.io.RandomAccessFile.<init>(RandomAccessFile.java:122) ~[?:1.7.0_60]
at
ucar.unidata.io.RandomAccessFile.<init>(RandomAccessFile.java:279)
~[cdm-4.5.0.jar:4.5.0]
at
ucar.unidata.io.RandomAccessFile.<init>(RandomAccessFile.java:261)
~[cdm-4.5.0.jar:4.5.0]
at
ucar.nc2.grib.collection.GribCdmIndex.openCdmIndex(GribCdmIndex.java:109)
[grib-4.5.0.jar:4.5.0]
at
ucar.nc2.grib.collection.GribCdmIndex.openGribCollection(GribCdmIndex.java:464)
[grib-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFcGrib.updateCollection(InvDatasetFcGrib.java:151)
[grib-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.checkState(InvDatasetFeatureCollection.java:294)
[cdm-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.update(InvDatasetFeatureCollection.java:313)
[cdm-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.sendEvent(InvDatasetFeatureCollection.java:230)
[cdm-4.5.0.jar:4.5.0]
at
thredds.inventory.CollectionUpdater$UpdateCollectionJob.execute(CollectionUpdater.java:207)
[cdm-4.5.0.jar:4.5.0]
at org.quartz.core.JobRunShell.run(JobRunShell.java:207)
[quartz-2.2.0.jar:?]
at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:560)
[quartz-2.2.0.jar:?]
2014-06-06T20:13:23.673 +0000 ERROR -
InvDatasetFcGrib.updateCollection failed name ='WWIII_GL' type='GRIB2'
spec='/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t??z.grib2$'
olderThan =5 min
timePartition =none
updateConfig =UpdateConfig{userDefined=true, recheckAfter='null',
rescan='null', triggerOk=true, updateType=never}
tdmConfig =UpdateConfig{userDefined=true, recheckAfter='null',
rescan='0 0/15 * * * ? *', triggerOk=true, updateType=test}
ProtoConfig{choice=Penultimate, change='null', param='null',
outerNcml='null', cacheAll=true}
hasInnerNcml =false
GribConfig{datasets=[TwoD, Best, Files, Latest],
pdsHash={useGenType=false, intvMerge=true, useTableVersion=true},
filesSortIncreasing=true}
2014-06-06T20:13:23.674 +0000 ERROR - UpdateCollectionJob.execute
startup failed collection=WWIII_GL
java.lang.NullPointerException
at
thredds.catalog.InvDatasetFcGrib.makeDatasetFromCollection(InvDatasetFcGrib.java:183)
~[grib-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFcGrib.makeDatasetTop(InvDatasetFcGrib.java:516)
~[grib-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.checkState(InvDatasetFeatureCollection.java:295)
~[cdm-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.update(InvDatasetFeatureCollection.java:313)
~[cdm-4.5.0.jar:4.5.0]
at
thredds.catalog.InvDatasetFeatureCollection.sendEvent(InvDatasetFeatureCollection.java:230)
~[cdm-4.5.0.jar:4.5.0]
at
thredds.inventory.CollectionUpdater$UpdateCollectionJob.execute(CollectionUpdater.java:207)
[cdm-4.5.0.jar:4.5.0]
at org.quartz.core.JobRunShell.run(JobRunShell.java:207)
[quartz-2.2.0.jar:?]
at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:560)
[quartz-2.2.0.jar:?]
It appears that the index file can not be built for feature
collection. But, I bet it's not the root cause.
Thanks a lot!
Guan
_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx <mailto:thredds@xxxxxxxxxxxxxxxx>
For list information or to unsubscribe, visit:http://www.unidata.ucar.edu/mailing_lists/
