Re: [netcdfgroup] Using Fancy Compressors (zfp, etc) in netCDF

  • To: "Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND APPLICATIONS INC]" <matthew.thompson@xxxxxxxx>
  • Subject: Re: [netcdfgroup] Using Fancy Compressors (zfp, etc) in netCDF
  • From: "Lynnes, Christopher S. (GSFC-5860)" <christopher.s.lynnes@xxxxxxxx>
  • Date: Mon, 19 Nov 2018 21:25:27 +0000
if you are going to AGU, you may also want to stop by the Larry Knox's (HDF) 
e-Lightning talk on compression:
• IN21B-22:  Tuning HDF5 (and NetCDF-4) Applications to Overcome and Avoid 
Compression Pitfalls
https://agu.confex.com/agu/fm18/meetingapp.cgi/Paper/467672
Unfortunately, the talk part is at 8:10 Tuesday morning, but I think the 
e-Lightning poster sticks around (eLightning Theater II) until 10:00 if you 
want to come by and talk compression.

On Nov 19, 2018, at 10:22, Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND 
APPLICATIONS INC] <matthew.thompson@xxxxxxxx<mailto:matthew.thompson@xxxxxxxx>> 
wrote:

All,

This is a bit of a general question inspired by going to the "Compression for 
Scientific Data" tutorial at SC18 last week. Namely, is there currently an easy 
way to test out and try new compressors like zfp and SZ in netCDF?

I know they need to be compiled and registered and all with HDF5 (which I could 
probably get to happen), but as my shop is a netCDF (Fortran) shop and not an 
HDF5 shop, I can't quite use them until they can be accessed through netCDF.

A search online shows that perhaps once there was a "compress" branch of 
netCDF-C, but it seems stale.

Is there any effort in Unidata to start supporting the HDF5 extra compressors? 
Or are they supported and I just don't know enough advanced netCDF to know how 
to use them (always possible!)?

Thanks,
Matt
--
Matt Thompson, SSAI, Sr Scientific Programmer/Analyst
NASA GSFC,    Global Modeling and Assimilation Office
Code 610.1,  8800 Greenbelt Rd,  Greenbelt,  MD 20771
Phone: 301-614-6712                 Fax: 301-614-6246
http://science.gsfc.nasa.gov/sed/bio/matthew.thompson

_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web.  Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.


netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/

—
Christopher Lynnes   NASA/GSFC    301-614-5185
"The future is already here — it's just not very evenly distributed." - Wm. 
Gibson




  • 2018 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdfgroup archives: