Steve,
Let's move this discussion off the thredds mailing list to
stackoverflow.
http://stackoverflow.com/questions/14776450/is-there-a-hardwired-limit-to-the-ncml-thredds-values-element/14778665#14778665
Ask your followup there.
-Rich
On Fri, Feb 8, 2013 at 12:29 PM, Steven Baum <baum@xxxxxxxxxxxxxxxx> wrote:
>
> Rich,
>
> I just posted the question on stackoverflow - a very interesting and useful
> site - under
> the netcdf category since that was the only one that was both applicable and
> allowed.
>
> As for your suggestion of using a union, I set up a very long script last
> night to use
> the NCOs to append the lon/lat arrays to all of the history files, although
> it's taking
> a good long while to append them to the 13GB history files as well as supply
> the
> required attribute information. It's only gotten through about 30 of the
> files, so if I
> stop it and try the union thing, what will happen if I attempt to union the
> files to
> which I've already added the lon/lat fields with the NetCDF file containing
> the lon/lat
> files? That is, what happens when the same field is present within both
> files that
> you're trying to union?
>
> Steve
>
> On Fri, 8 Feb 2013 07:46:26 -0500, Signell, Richard wrote
>> Steve,
>>
>> I don't know the answer to your question about the size limit for
>> <values>, but there is another way to solve your problem..
>>
>> You can write your lon,lat values to a netcdf file, and then use a
>> "union" aggregation that aggregates the "joinExisting"
>> aggregation with your grid file.
>>
>> For example, if you have a bunch of files like:
>> mod_his_0001.nc
>> mod_his_0002.nc
>> ...
>> and you create a netcdf file that contains the lon,lat variables:
>> lonlat.nc
>>
>> you can aggregate them together like so:
>>
>> <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
>> <!-- union the (1) time aggregation with the (2) grid file -->
>> <aggregation type="union">
>> <!-- (1) time aggregate files like "mod_his_0001.nc" -->
>> <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
>> <aggregation dimName="time" type="joinExisting">
>> <scan
>> location="/home/baum/models/run01/"
>> regExp=".*mod_his_[0-9]{4}\.nc$"/>
>> </aggregation>
>> </netcdf>
>> <!-- (2) grid file -->
>> <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";
>> location="/home/baum/models/lonlat.nc"/>
>> </aggregation>
>> </netcdf>
>>
>> Make sense?
>>
>> -Rich
>>
>> P.S. Can you please ask the same question on stackoverflow.com and tag
>> with "netcdf" and "xml"? I think as a community we should start to
>> get info like this captured in a place where others can comment and
>> improve the answers, and best answers can rise to the top. It's a lot
>> easier than wading through mailing lists. If you ask it, I promise to
>> answer. And I need to get up to 1500 points so I can add an "ncml"
>> tag. ;-)
>>
>> On Thu, Feb 7, 2013 at 5:44 PM, Steven Baum <baum@xxxxxxxxxxxxxxxx> wrote:
>> >
>> > Is there a limit to the size or number of entries that can be placed
>> > within the values
>> > NcML element? I'm attempting to get a set of NetCDF files without lon/lat
>> > variables -
>> > but with x/y variables - to be read as a featureCollection by adding NcML
>> > entries of the
>> > form:
>> >
>> > <netcdf
>> > xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
>> >
>> > <variable name="lat_rho" shape="eta_rho xi_rho" type="float">
>> > <attribute name="units" type="String" value="degrees_north" />
>> > <values>[671x191 blankspace-separated latitudes here]</values>
>> > </variable>
>> >
>> > The lat and lon variables exist in a separate file and I've extracted them
>> > into single
>> > strings using ncks which I've stuck between appropriate <values></values>
>> > locations.
>> >
>> > The error messages in featureCollectionScan.log are:
>> >
>> > [2013-02-07T15:15:37.386-0600] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
>> > java.lang.NullPointerException
>> >
>> > ....
>> >
>> > [2013-02-07T15:15:37.388-0600] ERROR ucar.nc2.ft.fmrc.Fmrc:
>> > /raid/data/txla_nesting6/.*\.nc$: makeFmrcInv failed
>> > java.lang.RuntimeException: java.lang.NullPointerException
>> >
>> > ....
>> >
>> > [2013-02-07T15:15:37.694-0600] WARN ucar.nc2.ft.fmrc.GridDatasetInv:
>> > GridDatasetInv
>> > using gds.getStartDate() for run date =%s
>> > [2013-02-07T15:15:37.694-0600] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
>> > java.lang.NullPointerException
>> >
>> > ....
>> > [2013-02-07T15:15:37.695-0600] ERROR ucar.nc2.ft.fmrc.Fmrc:
>> > /raid/data/txla_nesting6/.*\.nc$: makeFmrcInv failed
>> > java.lang.RuntimeException: java.lang.NullPointerException
>> >
>> >
>> >
>> > _______________________________________________
>> > thredds mailing list
>> > thredds@xxxxxxxxxxxxxxxx
>> > For list information or to unsubscribe, visit:
> http://www.unidata.ucar.edu/mailing_lists/
>>
>> --
>> Dr. Richard P. Signell (508) 457-2229
>> USGS, 384 Woods Hole Rd.
>> Woods Hole, MA 02543-1598
>
>
> --
> Open WebMail Project (http://openwebmail.org)
>
--
Dr. Richard P. Signell (508) 457-2229
USGS, 384 Woods Hole Rd.
Woods Hole, MA 02543-1598
