[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[THREDDS #KKM-141749]: offsetsGreaterEqual



Hi David:

Im (finally) looking at this issue, which is also tracked here:

  https://bugtracking.unidata.ucar.edu/browse/TDS-470

I want to make sure Im understanding these files.

Lansing downloaded 

Files found=
 Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0007.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0006.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0001.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0005.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0003.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0004.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0002.nc 

 Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0005.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0006.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0004.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0003.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0002.nc
 Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0001.nc 
 Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0007.nc 

The first 7 files are all at runtime 2013-05-05, and the second 7 at 
2013-05-06. IS taht corrct?

I see these offsets:

 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0007.nc =   time  
     2013-05-05T00:00:00Z       offsets=146.0, 148.0, 150.0, 152.0, 154.0, 
156.0, 158.0, 160.0, 162.0, 164.0, 166.0, 168.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0006.nc =   time  
     2013-05-05T00:00:00Z       offsets=122.0, 124.0, 126.0, 128.0, 130.0, 
132.0, 134.0, 136.0, 138.0, 140.0, 142.0, 144.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0001.nc =   time  
     2013-05-05T00:00:00Z       offsets=0.0, 2.0, 4.0, 6.0, 8.0, 10.0, 12.0, 
14.0, 16.0, 18.0, 20.0, 22.0, 24.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0005.nc =   time  
     2013-05-05T00:00:00Z       offsets=98.0, 100.0, 102.0, 104.0, 106.0, 
108.0, 110.0, 112.0, 114.0, 116.0, 118.0, 120.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0003.nc =   time  
     2013-05-05T00:00:00Z       offsets=50.0, 52.0, 54.0, 56.0, 58.0, 60.0, 
62.0, 64.0, 66.0, 68.0, 70.0, 72.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0004.nc =   time  
     2013-05-05T00:00:00Z       offsets=74.0, 76.0, 78.0, 80.0, 82.0, 84.0, 
86.0, 88.0, 90.0, 92.0, 94.0, 96.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130505_0000_0002.nc =   time  
     2013-05-05T00:00:00Z       offsets=26.0, 28.0, 30.0, 32.0, 34.0, 36.0, 
38.0, 40.0, 42.0, 44.0, 46.0, 48.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0005.nc =   time  
     2013-05-06T00:00:00Z       offsets=98.0, 100.0, 102.0, 104.0, 106.0, 
108.0, 110.0, 112.0, 114.0, 116.0, 118.0, 120.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0006.nc =   time  
     2013-05-06T00:00:00Z       offsets=122.0, 124.0, 126.0, 128.0, 130.0, 
132.0, 134.0, 136.0, 138.0, 140.0, 142.0, 144.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0004.nc =   time  
     2013-05-06T00:00:00Z       offsets=74.0, 76.0, 78.0, 80.0, 82.0, 84.0, 
86.0, 88.0, 90.0, 92.0, 94.0, 96.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0003.nc =   time  
     2013-05-06T00:00:00Z       offsets=50.0, 52.0, 54.0, 56.0, 58.0, 60.0, 
62.0, 64.0, 66.0, 68.0, 70.0, 72.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0002.nc =   time  
     2013-05-06T00:00:00Z       offsets=26.0, 28.0, 30.0, 32.0, 34.0, 36.0, 
38.0, 40.0, 42.0, 44.0, 46.0, 48.0,  
  opened Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0001.nc 
rundate = 2013-05-06T00:00:00Z
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0001.nc =   time  
     2013-05-06T00:00:00Z       offsets=0.0, 2.0, 4.0, 6.0, 8.0, 10.0, 12.0, 
14.0, 16.0, 18.0, 20.0, 22.0, 24.0,  
 Fmr add GridDatasetInv 
Q:/support/DavidRobertson/espresso/espresso_his_20130506_0000_0007.nc =   time  
     2013-05-06T00:00:00Z       offsets=146.0, 148.0, 150.0, 152.0, 154.0, 
156.0, 158.0, 160.0, 162.0, 164.0, 166.0, 168.0,  

Since you are asking to exclude offsets less than 26, this would be the same as 
excluding

espresso_his_20130501_0000_0001

and 

espresso_his_20130506_0000_0001

is that correct?

John


> Hi,
> 
> I have added a near (no ConstantForecasts) complete featured FMRC at:
> 
> http://tds.marine.rutgers.edu:8080/thredds/catalog/roms/espresso/2013_da/fmrc_t1/his/catalog.html
> 
> That dataset is with the 26 hour offset for Best. You should be able to
> reproduce the behavior by retrieving the *_20130505_* and *_20130506_*
> files and mimicking my configuration at the bottom of this email.
> HTTPServer access is enabled for the individual files.
> 
> When we tested the dataset we compared the variable zeta in the first
> record from the "Best" dataset to zeta in the first record of file
> espresso_his_20130505_0000_0002.nc and the second record of file
> espresso_his_20130506_0000_0001.nc.
> 
> We expected the first record of file espresso_his_20130505_0000_0002.nc
> to match but instead the second record from
> espresso_his_20130506_0000_0001.nc matched.
> 
> Please let me know if you need any other information.
> 
> Thanks,
> Dave
> 
> 
> 
> 
> On 5/22/13 2:16 PM, Unidata THREDDS Support wrote:
> > David,
> >
> > Can bundle these files up and send them to us, or point us to where we can 
> > grab them?  We'd like to reproduce the behavior locally for testing and 
> > debugging.
> >
> > -Lansing
> >
> >>>>>>>>>
> >
> > Hello,
> >
> > I am running the latest stable versions (as of May 20, 2013) of Java 
> > (1.7.0_21), Tomcat(7.0.40) and TDS(Version 4.3.16 - 20130319.1353).
> >
> > I have 7 day hindcast/forecasts that run once daily with output every 2 
> > hours that I am trying to put into an fmrc. My files are named using the 
> > the start date/time of the hindcast. I want to exclude the first 24 hours 
> > of each run from "Best" datasets. I thought using offsetsGreaterEqual="26" 
> > would do the trick but it only excludes the first 24 hours from run 0 and 
> > not from subsequent runs. Meaning, if I look at hour 26 of the "Best" 
> > dataset (the first record in that dataset) I'm getting data from the 
> > beginning (first 24 hours) of run 1 instead of hour 26 from run0.
> >
> > Is this the intended behavior of offsetsGreaterEqual? If so I think the 
> > documentation at:
> >
> > http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.3/reference/collections/FmrcCollection.html
> >
> > should be clarified. Otherwise I'd like to report a bug.
> >
> > Thanks,
> > David Robertson
> >
> >
> >
> > Catalog entry:
> >
> >     <featureCollection name="espresso_2013_da_history_fmrc"
> >                        featureType="FMRC"
> >                        harvest="true"
> >                        path="roms/espresso/2013_da/fmrc/his">
> >        <metadata inherited="true">
> >           <serviceName>both</serviceName>
> >        </metadata>
> >        <collection 
> > spec="/home/om/dods-data/thredds/roms/espresso/tmp/.*\.nc$"
> >                    name="espresso_2013_da_his_fmrc"
> >                    dateFormatMark="#espresso_his_#yyyyMMdd_HHmm"
> >                    olderThan="5 min" />
> >        <update startup="true" rescan="0 0/5 * * * ? *" trigger="allow" />
> >        <protoDataset choice="Penultimate">
> >           <netcdf 
> > xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2"; 
> > location="nc/cldc.mean.nc">
> >              <remove name="ocean_time" type="variable" />
> >           </netcdf>
> >        </protoDataset>
> >        <fmrcConfig regularize="false"
> >                    datasetTypes="TwoD Files Runs ConstantForecasts 
> > ConstantOffsets">
> >           <dataset name="Best" offsetsGreaterEqual="26" />
> >        </fmrcConfig>
> >     </featureCollection>
> >
> > -Lansing Madry
> >    Unidata
> >    Boulder, Colorado
> >
> 
> 

Ticket Details
===================
Ticket ID: KKM-141749
Department: Support THREDDS
Priority: Low
Status: Open