Re: [thredds] Static aggregations

I believe if you don't set rescan it uses the default value - but would have to check on that. I know there is a way to tell it to not rescan.

-Roy

On Oct 22, 2009, at 9:42 AM, David Robertson wrote:

Hi,

Roy Mendelssohn wrote:
What is your rescan set to for that dataset? That is probably what is causing it.

I am not using rescan or recheckEvery so that's probably the problem the dataset element I'm using is pasted below:

<dataset name="2006"
        ID="cool-avhrr-bigbight-2006"
        urlPath="cool/avhrr/bigbight/2006" >

  <metadata inherited="true">
     <timeCoverage>
        <start>2006-01-01 03:10:00 UTC</start>
        <end>2006-12-31 22:53:00 UTC</end>
     </timeCoverage>
     <geospatialCoverage>
        <northsouth>
           <start>34.9950981140137</start>
           <size> 11.0090637207031</size>
           <units>degrees_north</units>
        </northsouth>
        <eastwest>
           <start>-77.0059967041016</start>
           <size>  14.0119972229004</size>
           <units>degrees_east</units>
        </eastwest>
     </geospatialCoverage>
  </metadata>

<netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2 ">
     <aggregation dimName="time" type="joinExisting">
        <scan location="/home/om/dods-data/thredds/cool/avhrr/nc4/"
              regExp="^2006.*\.nc" />
     </aggregation>
  </netcdf>
</dataset><!--2006-->


On Oct 22, 2009, at 8:47 AM, David Robertson wrote:
Hi,

Is there a way to tell the TDS NOT to look for new files to add to an aggregated dataset? I have several aggregations set up that do not change (no added or removed or modified files). Yesterday after generating the aggregation cache, access the dataset was quite quick; ~1 second to load the Data Access Form. However, when I try to access those same datasets today it takes just as long as it did to generate the aggregation cache in the first place (5 minutes).

It should be noted that these aggregations are subsets of files in a directory that IS being updated. What I have done used a regExp to separate a very large dataset into years. The 2008 and prior aggregations will not have files added so I'm looking for a way to stop the TDS from searching for new files to add to the aggregation cache.

Thanks,
Dave

_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/
**********************
"The contents of this message do not reflect any position of the U.S. Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097
e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/
"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"

**********************
"The contents of this message do not reflect any position of the U.S. Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"



  • 2009 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: