We have a lidar that produces netCDF data files. We archive these files on a
server.
We need a reliable mechanism to update the current hourly file as it is being
updated by the instrument and produce an updated copy on our server. This
allows our scientists to see real-time updates from the lidar.
At present, we’re using a homegrown Python script that parses the netCDF file
and sends the progressively appended UNLIMITED dimension blocks to the server.
(This code knows just enough about the netCDF3 file structure to detect the
newly appended blocks.)
I’d appreciate any advice on a better way to copy incremental updates from the
instrument to the server.
Thanks!
