NOTE: The decoders mailing list is no longer active. The list archives are made available for historical reasons.
On Tue, 20 May 2003, [iso-8859-1] "Mathias D. Müller" wrote:
hi Robb i still get too many dimensions with the created cdl file. it's not obvious what might be wrong, the dimensions in the cdl look ok. i put a grib file and the cdl file on a server: http://www.unibas.ch/geo/mcr/3d/meteo/transfer/lmbc_012 http://www.unibas.ch/geo/mcr/3d/meteo/transfer/bidgdomain.cdl
Mathias, The cdl file looks ok. Could you send a raw grib file attached to an email and the table file if you used one. I'll take a look at it. Robb...
would be cool if you could have a look at it.
a variable that's causing the trouble is called 'u' and has dimensions
Array[183, 141, 39, 2]
instead of Array[183, 141, 39,
cu and thanks
mathias
At 10:55 19.05.2003 -0600, you wrote:
On Sat, 17 May 2003, [iso-8859-1] "Mathias D. Müller" wrote:
> it works now!!!!!!!!!
Mathias,
Great
>
> i had to compile udunits and netcdf library.
>
> i will have to retune the cdl file or create a tab-file (is
there a utility
> for the tab file?)
Noop, has to be created by hand. But there is a utility to
make the cdl
called gribtocdl. There's man pages.
> data in the netcdf looks good, but some 3d fields are now
stored twice in
> the same variable by adding a 4 th dimension
>
> e.g. [x,y,z,2] where [x,y,z,0] is the data which is perfect
and [x,y,z,1]
> is all -9999
> anyhow it just wastes a lot of space, but the data is fine.
>
I think it's the way you created the cdl. gribtonc creates
the space
before hand using the supplied cdl. So if you have [x,y,z,2],
then
NetCDF will create [x,y,z,0] and [x,y,z,1]. Since [x,y,z,1]
is all missing
data values maybe your dimensions need rearranged, ie
[x,y,z,1]. Since I
don't know your data format my suggestion could be wrong.
The main point is
the space for the NetCDF file is allocated all at once for
each new
unlimited dimension variable (usually the record variable)
> the 4 mb grib file is now a 80 mb netcdf, but i can read it
much faster
> with the idl programming language and it only takes about a
second to
> create the nc-file. that is awesome.
> do you know how i could read the grib file directly with
idl as efficient
> as your decoder works?
noop, grid is mainly a packing/transportation format.
Robb...
> i used to spawn wgrib, dump the grib into a binary file and
than read this
> binary with idl. but that takes about 2 minutes.
> (time is very important, since i do realtime forecasting
and have to
> process several gigabytes of data every day)
>
>
>
> many thanks
> mathias
>
> ps: here is a link to the weather forecast results:
> http://www.unibas.ch/geo/mcr/3d/meteo/
>
> At 10:50 16.05.2003 -0600, you wrote:
> >On Fri, 16 May 2003, Mathias D. Mueller wrote:
> >
> > > thanks
> > >
> > > i already had compiled with gcc. i did it by setting
the following into the
> > > CUSTOMIZE file
> > >
> > > CPP_LDM=-I/usr/local/ldm/include
> > > LD_LDM='-L/usr/local/ldm/lib -lldm'
> > > #
> > > # netCDF header file and library references:
> > > CPP_NETCDF=-I/usr/local/netcdf-3.5.0/include
> > > LD_NETCDF='-L/usr/local/netcdf-3.5.0/lib -lnetcdf'
> > > #
> > > # udunits header file and library references:
> > > CPP_UDUNITS=-I/usr/local/udunits-1.11.3/include
> > > LD_UDUNITS='-L/usr/local/udunits-1.11.3/lib -ludunits'
> > > #
> > > # Type of C compiler:
> > > CC='gcc'
> > > #
> > > # C compiler flags:
> > > CFLAGS=-g
> > > #
> > > # Installation prefix:
> > > prefix=/usr/local/unidata
> > >
> > >
> > > the UDUNITS and netcdf library i didn't compile but
copied a binary
> > version from
> > > the internet to my usr/local directory, since it seemed
to be easier than
> > > compiling:-)
> >
> >Mathias,
> >That's probably the problem.
> >
> > >
> > > i probaly have to compile those:
> > > which source codes should i use ?
> > >
> >
> >You can get the source from the web page at:
> >
> >http://my.unidata.ucar.edu/content/software/index.html
> >
> >
> > > are there any special flags needed?
> > >
> >Noop
> >
> > > my system: RED HAT 8.0 with
> > > Linux ws-eta 2.4.18-19.8.0 #1 Thu Dec 12 05:39:29 EST
2002 i686 i686
> > i386 GNU/Linux
> >
> >I tested it on linux 8.0 last week
> >
> >Robb...
> > >
> > >
> > > many thanks and best regards
> > > mathias
> > >
> > >
> > >
> > >
> > >
> > >
> > > Quoting Robb Kambic <rkambic@xxxxxxxxxxxxxxxx>:
> > >
> > > > On Fri, 16 May 2003, Mathias D. Mueller wrote:
> > > >
> > > > > hi
> > > > > i am a phd student at the university of basel.
> > > > > i try to decode grib files from my eta model into
netcdf.
> > > > >
> > > > > i installed the new decoders.
> > > > > i created a cdl-file, which seems to work.
> > > > > gribdump on the girb file works also and i see all
the data in it.
> > > > >
> > > > > however if i call the
> > > > > gribtonc using the cdl-file i get only the message:
> > > > >
> > > > > May 16 12:40:20 gribtonc[31493]: Starting Up
> > > > > segmentation
> > >
> > >
> > > fault
> > > > >
> > > > > the nc-file written only probalby only contains the
stuff from the
> > > > cdl-file
> > > > >
> > > > >
> > > > > do you have any ideas what might be wrong
> > > >
> > > > Hiya Mathias,
> > > >
> > > > Another user had a similar problem, it turned out to
be the compiler
> > > > flags. For linux type systems try:
> > > >
> > > > % setenv CC gcc
> > > >
> > > > For Solaris
> > > >
> > > > % setenv CC cc or gcc
> > > >
> > > > If that doesn't solve the problem, send me the
machine type and the
> > > > version of the OS, ie
> > > >
> > > > % uname -a
> > > >
> > > > If that is the problem, NetCDF and udunits need to be
recompiled before
> > > > recompiling the decoders.
> > > >
> > > > Robb...
> > > >
> > > > >
> > > > > best regards and many thanks
> > > > > mathias
> > > > >
--------------------------------------------------------
> > > > >
> > > > > Mathias D. Müller
> > > > >
> > > > > University of Basel
> > > > > Institute of Meteorology, Climatology and Remote
Sensing
> > > > >
> > > > > Klingelbergstr. 27
> > > > > 4056 Basel
> > > > > Tel: (+41 61) 267 07 56
> > > > > my page: http://www.unibas.ch/geo/mcr/3d
> > > > >
> > > > > -------------------------------------------------
> > > > > This mail sent through IMP: http://horde.org/imp/
> > > > >
> > > > >
============================================================================== Robb Kambic Unidata Program Center Software Engineer III Univ. Corp for Atmospheric Research rkambic@xxxxxxxxxxxxxxxx WWW: http://www.unidata.ucar.edu/ ==============================================================================
decoders archives: