To this point in time, it has been an implicit assumption
that a netcdf dataset encompasses a single file. This functionality
effectively challenges that assumption. So, I would solicit
community input on this. What problems are created if a netcdf
dataset now requires multiple files?
=Dennis Heimmbigner
Unidata
On 7/13/2016 5:09 AM, Eugen Betke wrote:
Dear NetCDF-Group,
we have been working on NetCDF external link functionality. This allows
NetCDF applications to create dimension variables which values are
stored in an external file. Therefore, it uses the HDF5 virtual dataset
(VDS) functionality. This is useful for, e.g., climate applications that
rely on a variable per file and timestep configuration. The idea is to
store the grid in a separate file and link our data to this grid. We
already have our first working version. You find the patch and the
examples on our page:
http://wr.informatik.uni-hamburg.de/research/projects/bullio/netcdf_external_links/start
Under the hood it uses HDF5 virtual datasets. VDS has the advantage of
being compatible to the functions that are supported by oridinary
datasets. Therefore, files containing VDS should be supported by the
most software.
There is a minor issue related to HDF5, the call H5F_try_close function
fails, when ncdump trys to read data from an external dimension. So far
we found a workaround, but we will fix this issue.
It would be great if external link functionality could be supported by
netCDF at some timepoint. We would like to improve our patch and for
that reason we need your feedback. If you have some idea to the issue
above, we would be grateful for each hint.
Regards,
Eugen
_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web. Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.
netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx
For list information or to unsubscribe, visit:
http://www.unidata.ucar.edu/mailing_lists/
