[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [thredds] GRIB files, featureCollection, mixed tables and ncml



Hi Roy:

1) get latest 4.3.17 thredds.war:

ftp://ftp.unidata.ucar.edu/pub/thredds/4.3/4.3.17/thredds.war


2) for just the datasets with this problem, replace:

  <gribConfig datasetTypes="Best LatestFile" />

in the catalog.xml with:

<gribConfig datasetTypes="Best LatestFile">

  <pdsHash>
    <useTableVersion>false</useTableVersion>
  </pdsHash>

</gribConfig>

3. delete the *.ncx files associated with that dataset (gbx9 are ok)

4. restart, let it reindex, and then try accessing that dataset.

lemmw know if you see any problems

On 3/25/2013 3:27 PM, Roy Mendelssohn - NOAA Federal wrote:
Thanks for any help, though technically what you are doing is correct.  If the 
tables are different the whole shebang might be different  (why I love external 
tables, I know you share the joy), but in our case it is not.  This is more 
carelessness from our data provider, because there is no reason for the table 
to be different (supposedly it is the same code generating the file as part of 
a routine process - go figure that one).  If we can do a workaround in ncml we 
will.  We just figured out how to do the VIIRS hdf4 files in a workable manner, 
that aggregate and update, so we have gotten pretty good with ncml.

Thanks again for any help you can provide or any suggestions as to what we can 
do.

-Roy


On Mar 25, 2013, at 2:12 PM, John Caron <address@hidden> wrote:

Hi Roy:

Im working on a workaround, as soon as I can get around to working ;^)

John

On 3/25/2013 1:02 PM, Roy Mendelssohn - NOAA Federal wrote:
HI All:

We are having again having a problem that arose a couple of months ago with aggregating our 
grub files using <featureCollection type="GRIB">.  The problem arises because 
we get the following error when trying to access the aggregation:

Error {
     code = 500;
     message = "Variable name (pres_msl) must be unique within Group ";
};

and this problem is caused by the following  (thanks Ethan et al. for figuring 
this out):


it looks like the files are using two different versions of the same grib 
table. In the wgrib output for some files says:
...
center 58 subcenter 0 process 58 Table 2 scan: WE:SN winds(N/S)
...

but for some others:
...
center 58 subcenter 0 process 58 Table 3 scan: WE:SN winds(N/S)

Now my question has to do with how your grib reader works, how that interacts with 
featureCollection, and how ncml files are viewed. What if for each file I created an ncml file that 
created a new variable that is basically the same one in the grib file, but because it is 
"new" it wouldn't be seen as different .  Now my question is how would the resulting 
virtual file be viewed by TDS.  Would it still be seen as a "grib" file and therefore 
aggregated using featureCollection, or is it now viewed as a netcdf file and aggregated using a 
aggregation scan, or will this not work at all?

We are supplied the files, and unfortunately don't have a good capability to 
rewrite the grib files, so are looking for a workaround.

Thanks,

-Roy

**********************
"The contents of this message do not reflect any position of the U.S. Government or 
NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: address@hidden (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.

_______________________________________________
thredds mailing list
address@hidden
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/


_______________________________________________
thredds mailing list
address@hidden
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/

**********************
"The contents of this message do not reflect any position of the U.S. Government or 
NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: address@hidden (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.