[netcdfgroup] Fw: Profiling NetCDF4-python

  • To: "netcdfgroup@xxxxxxxxxxxxxxxx" <netcdfgroup@xxxxxxxxxxxxxxxx>
  • Subject: [netcdfgroup] Fw: Profiling NetCDF4-python
  • From: Matthew Jones <M.Jones3@xxxxxxxxxxxxxxxxx>
  • Date: Mon, 9 May 2016 10:35:11 +0000
  • Authentication-results: unidata.ucar.edu; dkim=none (message not signed) header.d=none;unidata.ucar.edu; dmarc=none action=none header.from=pgr.reading.ac.uk;
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:23
Hi


I am trying to profile my NetCDF4-python code to see how to improve read 
performance, which I have identified as the bottleneck. I have done this using 
kcachegrind and line_profiler.


I want to delve a bit deeper into the library to see where the performance is 
dropping. I can't work out how to use line_profiler with the @profile decorator 
in the variable class. I also can't work out how to get kcachegrind to delve 
into the library because the slicing syntax var[...] is not an explicit 
function call, and I can't get var.__getitem__() to do the same thing.


Does anyone have any ideas how I could get more information from profiling the 
netcdf4 library?


Many thanks

Matt



----------------------------------------
Matthew Jones
PhD Student
Atmosphere, Oceans and Climate
Department of Meteorology,
University of Reading

Room 288, ESSC, Harry Pitt Building,
3 Earley Gate, Reading, RG6 6AL, UK


https://www.linkedin.com/pub/matthew-jones/8b/b81/25a
http://www.met.reading.ac.uk/users/users/1887