[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
20041212: wavelet decompression ADDE server code
- Subject: 20041212: wavelet decompression ADDE server code
- Date: Sun, 12 Dec 2004 13:29:48 -0700
>From: "Valentijn Venus" <address@hidden>
>Organization: ITC
>Keywords: 200412121854.iBCIsXlI001486 McIDAS ADDE MSG Wavlet compression
Hi Valentijn,
>Tom, do you have the latest msg server code, i saw that the people at
>Winsconsin made the follwoing improvements (22 October):
>
>* updated MSG servers to allow multi-band requests in IMGCOPY [12597]
>* added EUMETSAT's suggested MSG visible calibration fix [12672]
The 12597 inquiry mods are included in the current Unidata McIDAS distribution.
The 12672 inquiry mod was included in the SSEC v2004a addendum, but
it has not been included in the Unidata distribution (yet).
I just read the inquiry (from Marianne Koenig to SSEC/MUG), and the
modification is trivial, add one line in kbxmsg.dlm.
At line 151 of ~mcidas/mcidas2004/kbxmsg.dlm you should find the line:
XTEMP = ( REAL(ITEMP) * GAIN ) + OFFSET
Change this to:
XTEMP = ( REAL(ITEMP) * GAIN ) + OFFSET
IF (XTEMP.LT.0.0) XTEMP = 0.0
After making the editing change, rebuild McIDAS using:
<as 'mcidas'>
cd mcidas2004/src
make <- using vendor-supplied compilers
-- or --
make VENDOR=-g77 <- using gcc/g77 on systems where this
combination is not 'vendor' (e.g., Sun,
HP-UX, IRIX, OSF/1).
If you are on a system like Linux, typing 'make' or 'make VENDOR=-g77'
are equivalent.
After the rebuild, reinstall the binaries:
make install.bin
>From: Valentijn Venus
>Sent: Thu 12/9/2004 23:40
>To: Tom Yoksas
>Subject: wavelet decompression ADDE server code
>Hi Tom,
>
>Update: there is another product made available by EUMETSAT (open-source) to
>decompress the images, which you can find at:
ftp://ftp.itc.nl/pub/venus/xRITDecompress.zip
>This archive contains the source-code for the xRITDecompress tool. The tool
>can be build under Windows and Linux (see build instructionsinn included
>readme.txt).
Thanks for the update. I just FTPed the file and will take a look
as soon as I can.
>Just to complicate matters, but yet more challenging!, first a few details of
>my setup. The compressed files are stored on a Windows share (NTFS), which
>needles to say doesn't allow symbolic references to a Linux formatted drive.
Right. You can access the Windows shared drive using Samba, can't you?
>i can add an additional drive or RAM-drive to my ADDE server (Fedora distro)
>that could temporarily contain the uncompressed output from
>xRITDecompress tool, and also the prologue and epilogue files that come
>with the Meteosat-8 wavelet compressed files, which i believe are neeeded
>for McIDAS to make a listing of available images in that ADDE group.
OK.
>However, once the user tells McIDAS to get and load a certain scene from
>that listing, the xRITDecompress tool should be triggered to read the
>associated XRIT-compressed files from the Windows share, and output
>the uncompressed data to the local (RAM) drive where also the prologue and
>epilogue files reside. McIDAS should then be 'fooled' in believing it is
>shouldn't try to read the data too fast, to allow the xRITDecompress tool
>to complete its tasks to avoid possible timing issues.
This sounds complicated. I will have to work my through the procedure/data
before being able to make an intelligent comment.
>Example data you can find at
>http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>under HRIT (unencrypted), and the wavelet compressed data in the
>above-referenced archive under \TestData.
OK, thanks for the pointer.
>We'll, that were my 2 cents. But i'm happy with any working alternative.
>
>I recall you told me once before, but could you send me the e-mail address
>of the person at Winsconsin responsible for granting access to GMS-5 ADDE
>data, since i have a Chinese PhD student coming over next week.
Sorry for the delay.
Cheers,
Tom
>________________________________
>From: Tom Yoksas [mailto:address@hidden]
>Sent: Tue 11/2/2004 21:27
>To: Valentijn Venus
>Cc: Tom Yoksas
>Subject: 20041028: NASA request for proposals (cont.)
>
>>From: "Valentijn Venus" <address@hidden>
>>Organization:
>>Keywords: 200410280726.i9S7Q2vV015003 McIDAS MSG wavlet
>
>Hi Venus,
>
>I know it must seem like I am ignoring your emails, but I just finished
>putting on this year's McIDAS workshop, helping out in the LDM workshop,
>writing two papers for the AMS conference, and creating a PowerPoint
>presentation for a trip for Chile (that I leave for on Saturday).
>
>>can you try to find time to repsond to my message included below?
>
>OK. The questions are:
>
>>When will you be able to look into adding that wavelet decompression
>>part to the ADDE server code?
>
>I will be in Chile for one week, and then in Barbados until November
>24 (both trips are for work), so I won't be able to look at what
>it will take to write an ADDE server for wavelet-compressed MSG
>data until about the beginning of December.
>
>>If succesful, how well does McIDAS
>>interface with such a fortran developed model (runtime). Would it be
>>possible to do this at pixel level?
>
>I don't know how to respond to this since I don't have a clear idea of
>what data would McIDAS would be run on. If the model output is GRIB
>data, then the XCD portion of McIDAS (or the gribdec.tar.Z bundle of
>the code that I make available) might be used to bring the model data
>into McIDAS. The McIDAS GRDIMG (or GRIB2IMG) command could then
>convert the model data into an image so one could use IMGOPER to create
>products.
>
>Is this what you had in mind?
>
>Cheers,
>
>Tom
>
>>Thanks,
>>Valentijn
>>
>>>
>>>Van: Tom Yoksas [mailto:address@hidden <mailto:address@hidden
> u>
>><mailto:address@hidden <mailto:address@hidden> > ]
>>>Verzonden: wo 8/18/2004 21:26
>>>Aan: Valentijn Venus
>>>CC: address@hidden; Harald van der Werff;
>>address@hidden
>>> .edu
>>>Onderwerp: 20040818: MSG-1 through ADDE (cont.)
>>>
>>>
>>>
>>>>From: "Valentijn Venus" <address@hidden>
>>>>Organization: ITC
>>>>Keywords: 200408161528.i7GFScaW025855
>>>
>>>Hi Valentijn,
>>>
>>>I just wanted to let you know that I received your email pointing
>>>me to the wavelet code. I will try to make some time to look into
>>>the effort it would take to incorporate the decompression into
>>>the MSG server, but this will probably have to wait until I return
>>>from Brazil.
>>>
>>>One thing that I need to know, however. You note:
>>>
>>>"The licensing
>>>agreement that we signed allows use for non-commercial and educational
>>>purposes only."
>>>
>>>Does your license then give me a right to look at the code and
>>>incorporate it into the Unidata McIDAS releaes? Or, do I need to
>>>follow the same path and sign a license agreement with EUMETSAT?
>>>
>>>Cheers,
>>>
>>>Tom
>>>
>>>>Clicking the following url
>>>>(ftp://ftp.itc.nl/pub/venus/PublicDecompWT.zip
>>>><ftp://ftp.itc.nl/pub/venus/Pu
> blicDecompWT.zip>
>><ftp://ftp.itc.nl/pub/venus/PublicDecompWT.zip
>><ftp://ftp.itc.nl/pub/venus/Publ
> icDecompWT.zip> > ) will provide you the
>>>>sources and documentation to the Public Decompress Wavelet Transform
>>>>library produced by VCS and published by EUMETSAT. The licensing
>>>>agreement that we signed allows use for non-commercial and educational
>>>>purposes only. The example provided in this WinZip archive is may not
>>be
>>>>usefull. Another, more ellaborate example is provided in the MSG
>>>>HRIT/LRIT code (http://meteosatlib.sourceforge.net/
>>>><http://meteosatlib.sourc
> eforge.net/>
>><http://meteosatlib.sourceforge.net/ <http://meteosatlib.sourceforge.net/> >
>>)
> which depends on
>>>>the same library for the MSG image decompression.
>>>>
>>>>Let me know if you need more help...
>>>>
>>>>
>>>>Valenitjn
>>>>
>>>>________________________________
>>>>
>>>>From: Valentijn Venus=3D20
>>>>Sent: Friday, August 13, 2004 10:13 PM
>>>>To: Unidata Support
>>>>Cc: address@hidden; Harald van der Werff;
>>>>address@hidden
>>>>Subject: RE: 20040809: MSG-1 through ADDE (cont.)
>>>>
>>>>
>>>>for your convenience i'v included a better (easier) link to the set of
>>>>example msg-1 data:
>>>>http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/=3D20
>>>><http://oiswww.eu
> metsat.org/WEBOPS/msg_images/20030509/=3D20>
>><http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/=3D20
>><http://oiswww.eum
> etsat.org/WEBOPS/msg_images/20030509/=3D20> >=20
>>>>=3D20
>>>>Don't bother about the "msg1_native.nat.bz2", which is the format
>>>>Marianne is working with. The notes that EUMETSAT provides with the
>>data
>>>>are included below:
>>>>=3D20
>>>>
>>>>HRIT (unencrypted)
>>>>
>>>>Each of these files has been bzip2
>>>><http://sources.redhat.com/bzip2/index.html
>><http://sources.redhat.com/bzip2/index.html
>><http://sources.redhat.com/bzip2/in
> dex.html> > > compressed and contains
>>>>identical prologue and epilogue files (the prologue and epilogue files
>>>>can be overwritten if all files are extracted into a single
>>directory).
>>>>Note that matching JPEG files are available above. =3D20
>>>>
>>>>________________________________
>>>>
>>>>From: Valentijn Venus
>>>>Sent: Fri 8/13/2004 21:59
>>>>To: Valentijn Venus; Unidata Support
>>>>Cc: address@hidden; Harald van der Werff;
>>>>address@hidden
>>>>Subject: RE: 20040809: MSG-1 through ADDE (cont.)
>>>>
>>>>
>>>>Hi Tom,
>>>>=3D20
>>>>just got word from a Cuban student a tornadao heading for the States
>>did
>>>>some serious damage to their Island. McIDAS provided proof of the
>>event.
>>>>Wonderful to have such a system in place!
>>>>=3D20
>>>>My problems with our MSG ADDE server disappeared partially after
>>setting
>>>>COMPRESS=3D3Dnone, and fully after equipping a faster machine with
>>McIDAS.
>>>>This answers my former questions, but a new one of more serious nature
>>>>arised (i think). When displaying an image, the frame in question
>>shows
>>>>just the metadata (sensor name, time of observation, etc.). The image
>>>>itself is not displayed. I believe it has to do with the fact that the
>>>>EUMETCAST data is compressed using a proprietary wavelet transform. We
>>>>have the sources (in c) from EUMETSAT to decompress them, and after
>>>>looking in the MSGT server-files i found no similair occurences of the
>>>code.
>>>>=3D20
>>>>Miguel Angel told me the other day that they first decompress the
>>>>segmented files, and then serve them to through their homebuild MSG
>>ADDE
>>>>server. This would however increase our storage requirements
>>>>significantly.
>>>>=3D20
>>>>The example data provided at
>>>>http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>>>><http://www.eum
> etsat.de/en/dps/news/msg-1_rect_image.html#hrit>
>><http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>><http://www.eume
> tsat.de/en/dps/news/msg-1_rect_image.html#hrit> >=20
>>>><http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>><http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>><http://www.eume
> tsat.de/en/dps/news/msg-1_rect_image.html#hrit> > > has
>>the
>>>>same compression applied i believe. Please let me know your thoughts
>>on
>>>>this.
>>>>=3D20
>>>>Cheers,
>>>>Valentijn
>>>>
>>>>________________________________
>>>>
>>>>From: Valentijn Venus
>>>>Sent: Tue 8/10/2004 17:02
>>>>To: Unidata Support
>>>>Cc: address@hidden
>>>>Subject: RE: 20040809: MSG-1 through ADDE (cont.)
>>>>
>>>>
>>>>
>>>>So my questions are:
>>>>
>>>>-Do you observe the same problem with the "Work" and "Doesn't work"
>>>>MSG-1 datasets on your McIDAS system?
>>>>-Are other developers of McIDAS (e.g. those who worked on the MSG
>>part)
>>>>aware of the problem, and possibly willing to find a solution?
>>>>-If negative, would you be willing to adjust the MSGX bit to get it to
>>>>work for the "Doesn't work" set of example data?
>>>>
>>>>
>>>>-----Original Message-----
>>>>From: Valentijn Venus
>>>>Sent: Tue 8/10/2004 16:49
>>>>To: Unidata Support
>>>>Cc: address@hidden
>>>>Subject: RE: 20040809: MSG-1 through ADDE (cont.)
>>>>
>>>>Hi Tom,
>>>>
>>>>i believe i've found the problem. The format we receieve is XRIT
>>alright
>>>>(so the MSGT argument should work), but along the way EUMETCAST has
>>made
>>>>a change in the segmentation. E.g. the HRV 11134 segments were devided
>>>>over 174 files, whereas the more recent segmentation sceme devides
>>them
>>>>over only 24 files. You can download corresponding sets of example
>>data
>>>>at the following adresses
>>>>(http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit):
>>>>
>>>>Works:
>>>>http://oiswww.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.bz2
>>>><http://oi
> swww.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.bz2>
>><http://oiswww.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.bz2
>><http://ois
> www.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.bz2> >
>>(7.3
>>>>mb)
>>>>Doesn't work:
>>>>http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/msg1_hrit_ch12.t
>>>><http:
> //oiswww.eumetsat.org/WEBOPS/msg_images/20030509/msg1_hrit_ch12.t>
>>ar
>><http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/msg1_hrit_ch12.ta
>>r>=20
>>>>.bz2 (40.3 mb)
>>>>
>>>>
>>>>The McIDAS commands below seem to work with the "Works" dataset:
>>>>DSSERVE ADD MSG/HRV MSGT TYPE=3D3DIMAGE
>>>>DIRFILE=3D3D/home/mcidas/data/msg/*/*/*/H*{HRV,EPI,PRO}* "High
>>resolution
>>>>visible channel (band 12).
>>>>DSSERVE ADD MSG/VISIR MSGT TYPE=3D3DIMAGE
>>>>DIRFILE=3D3D/home/mcidas/data/msg/*/*/*/H*MSG1*{VIS,IR,WV,EPI,PRO}*
>>"High
>>>>resolution visible and infrared channel (bands 1-11).
>>>>DSSERVE ADD MSG/ADMIN TEXT
>>>>INFO=3D3D/home/mcidas/data/msg/2004/08/08/H*MSG1*ADMIN* "METEOSAT-8
>>>>Administration Message.
>>>>
>>>>IMGDISP MSG/HRV.-1 1 MAG=3D3D-6 BAND=3D3D12
>>>>
>>>>Cheers! Valentijn
>>>>
>>>>-----Original Message-----
>>>>From: Unidata Support [mailto:address@hidden <mailto:support@unidat
> a.ucar.edu>
>><mailto:address@hidden <mailto:address@hidden> > ]
>>>>Sent: Mon 8/9/2004 22:09
>>>>To: Valentijn Venus
>>>>Cc: address@hidden
>>>>Subject: 20040809: MSG-1 through ADDE (cont.)
>>>>
>>>>>From: "Valentijn Venus" <address@hidden>
>>>>>Organization: ?
>>>>>Keywords: 200408050006.i7506ZaW006360 McIDAS MSG
>>>>
>>>>Hi Valentijn,
>>>>
>>>>Well, after three abstracts and a LOT of other stuff, I finally have
>>>>time
>>>>to get to your inquiry. Sorry for the wait...
>>>>
>>>>>another message to keep you up-to-date on my latest developments. at
>>>>the
>>>>>moment the ADDE server is working well using a sample of MSG-1 images
>>>>>provided by EUMETSAT.
>>>>
>>>>Which format are you using? The McIDAS-X distribution supports two
>>>>different file types for MSG data through two different servers:
>>>>
>>>>msgtadir.cp -- XRIT
>>>>msgtaget.cp -- XRIT
>>>>
>>>>msgxadir.cp -- ?? (native?)
>>>>msgxaget.cp -- ?? (native?)
>>>>
>>>>>The HRV data (band 12) are unencrypted and in Native format, and
>>>>>2003/12/12 13.30 consists of 176 segmented files (excl. PRO and PERI
>>>>>metadatailes).
>>>>
>>>>>A similair scene as we receive it contain only 24 (much bigger)
>>>>segments
>>>>>(filenaming looks similair), and when i try to serve this McIDAS
>>tells
>>>>me
>>>>>tere are no bands/data in the group.
>>>>>
>>>>>Have you ever encountered this problem?
>>>>
>>>>No, I havn't. I must add that I have not played around with the MSG
>>>>data all that much, so my not having experienced the problem you are
>>>>seeing means little or nothing.
>>>>
>>>>>From: "Valentijn Venus" <address@hidden>
>>>>>Date: Thu, 5 Aug 2004 23:46:32 +0200
>>>>
>>>>>Btw, how is McIDAS compiling in 64-bit for an AMD64 system?
>>>>
>>>>I built McIDAS on our dual Opteron 64-bit machine back in late
>>>>June/early
>>>>July and had no problems that I can recall. We have not keep this
>>build
>>>>around for testing since we have been experimenting with different
>>OSes
>>>>on the box (Fedora Core 1 for 64 bit; FreeBSD 5.2).
>>>>
>>>>>From: Valentijn Venus
>>>>>Sent: Wed 8/4/2004 23:36
>>>>
>>>>>If i understood well the 2004 McIDAS upgrade will read the raw,
>>>>transmitted
>>>>>METEOSAT 8 files. These we receive from EUMETSAT by a satellite dish
>>>>mounted
>>>>>on the top of our roof.
>>>>
>>>>Is this through EUMETCAST?
>>>>
>>>>>The server runs on a Windows XP OS and stores the
>>>>>segmented files received through a DVB system on a shared drive.
>>>>
>>>>OK. I have had two meeting with Volker Gartner, Head of EUMETSAT User
>>>>Services, about setting up an ADDE server for the METEOSAT data at
>>>>EUMETSAT. The idea is to get the folks at EUMETSAT using remote
>>access
>>>>methods first, then get the member state's researchers interested, and
>>>>then see if the service could be opened up. There are many steps and
>>>>pitfalls between the first effort and the goal, but I am hopeful that
>>>>we can make progress.
>>>>
>>>>>since i
>>>>>won't be able to participate in this years Workshop, i'm looking for
>>>>some
>>>>>documentation/guidance on how to set up an ADDE server for MSG-1 for
>>>>internal
>>>>>research/educational use.
>>>>
>>>>I think another of your emails shows that you got past this point even
>>>>though your earlier email showed a bit of a misunderstanding:
>>>>
>>>>>>Just added a couple of EUMESAT MSG-1 images using:
>>>>
>>>>>>DDSERVE MSG/HRV MSGT TYPE=3D3DIMAGE
>>>>DIRFILE=3D3D'/home/mcidas/data/H*MSG1*HRV*2004080112
>>>>00*'
>>>>
>>>>OK, this creates the dataset with group name MSG and descriptor HRV.
>>>>
>>>>>>McIDAS tells me the command completed succesfully. The i added the
>>>>ADDE to
>>>>>>the client routing table using:
>>>>
>>>>>>DATALOC ADD MSG_LOC ADDESERVER.ITC.NL
>>>>
>>>>Two things:
>>>>
>>>>- if you created the dataset locally, then you don't have to run
>>DATALOC
>>>> to locate it -- unless -- you want to access it through the remote
>>>> ADDE server interface
>>>>
>>>>- since the dataset you created has group name MSG, the DATALOC
>>>> command would be:
>>>>
>>>>DATALOC ADD MSG ADDESERVER.ITC.NL
>>>>
>>>> This also assumes that the fully qualified hostname of the ADDE
>>>> server machine is ADDESERVER.ITC.NL.
>>>>
>>>>>>Then i tried to display the data using:
>>>>
>>>>>>IMGDISP MSG_LOC/HRV.-1 1 MAG=3D3D-6 BAND=3D3D4
>>>>>>or
>>>>>>IMGDISP MSG_LOC/FD
>>>>
>>>>The first thing to do is verify that the ADDE group name is recognized
>>>>by the server:
>>>>
>>>>DSINFO IMAGE MSG_LOC
>>>>
>>>>If these return nothing, then you are asking for the wrong ADDE
>>dataset
>>>>group.
>>>>
>>>>>I could send you some sample files if that helps...
>>>>
>>>>At some point, I wouldn't mind getting sets of example data that works
>>>>and doesn't work so I can better understand the formats.
>>>>
>>>>>I also came across a message in the archive that mentioned a way to
>>>>>calculate satellite and sun angles for METEOSAT data (by Miguel
>>Angel).
>>>>>I would very much appreciate it for some radiative transfer
>>>>modelling....
>>>>
>>>>Yes. I believe that he sent along the program in his email. If
>>>>he didn't, it might be best to contact him directly to get his latest
>>>>version of the code.
>>>>
>>>>>>Also an updated DATALOC listing (ADDELIST.TXT) would be very
>>welcome.
>>>>
>>>>What would be more useful is the URL for the list of Publically
>>>>Accessible
>>>>ADDE servers:
>>>>
>>>>http://my.unidata.ucar.edu/content/software/mcidas/adde_servers.html
>>>><http://
> my.unidata.ucar.edu/content/software/mcidas/adde_servers.html>
>><http://my.unidata.ucar.edu/content/software/mcidas/adde_servers.html
>><http://m
> y.unidata.ucar.edu/content/software/mcidas/adde_servers.html> >=20
>>>>
>>>>Sending you the contents of ADDESITE.TXT would not give you a complete
>>>>listing of what servers are out there.
>>>>
>>>>Cheers,
>>>>
>>>>Tom
>>>>--
>>>>**********************************************************************
>>**
>>>>Unidata User Support UCAR Unidata
>>>>(303)497-8643 P.O.
>>Box
>>>>address@hidden Boulder, CO
>>>>----------------------------------------------------------------------
>>--
>>>>Unidata WWW Service
>>>>http://my.unidata.ucar.edu/content/support
>>>><http://my.unidata.ucar.edu/conten
> t/support>
>><http://my.unidata.ucar.edu/content/support
>><http://my.unidata.ucar.edu/content
>>>>----------------------------------------------------------------------
>>--
>>>>NOTE: All email exchanges with Unidata User Support are recorded in
>>the
>>>>Unidata inquiry tracking system and then made publically available
>>>>through the web. If you do not want to have your interactions made
>>>>available in this way, you must let us know in each email you send to
>>>>us.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>------_=3D_NextPart_001_01C483A5.B1EB5D89
>>>>Content-Type: text/x-vcard;
>>>> name=3D"Valentijn Venus.vcf"
>>>>Content-Transfer-Encoding: base64
>>>>Content-Description: Valentijn Venus.vcf
>>>>Content-Disposition: attachment;
>>>> filename=3D"Valentijn Venus.vcf"
>>>>
>>>>QkVHSU46VkNBUkQNClZFUlNJT046Mi4xDQpOOlZlbnVzO1ZhbGVudGlqbg0KRk46VmFsZW
>>50aWpu
>>>>IFZlbnVzDQpPUkc6O05SUw0KVElUTEU6TS5TYy4NClRFTDtXT1JLO1ZPSUNFOiszMSAoMC
>>k1MyA0
>>>>ODc0NTQ5DQpBRFI7V09SSzo7NC0xMzQ7UC5PLiBCb3ggNjtFbnNjaGVkZTs7NzUwMCBBQQ
>>0KTEFC
>>>>RUw7V09SSztFTkNPRElORz1RVU9URUQtUFJJTlRBQkxFOjQtMTM0PTBEPTBBUC5PLiBCb3
>>ggNj0w
>>>>RD0wQUVuc2NoZWRlIDc1MDAgQUENCkVNQUlMO1BSRUY7SU5URVJORVQ6dmVudXNAaXRjLm
>>5sDQpS
>>>>RVY6MjAwNDA1MjVUMDgzOTI2Wg0KRU5EOlZDQVJEDQo=3D
>>>>
>>>>------_=3D_NextPart_001_01C483A5.B1EB5D89--
>>>--
>>>+----------------------------------------------------------------------
>>-------
>>> +
>>>* Tom Yoksas UCAR Unidata
>>Program
>>> *
>>>* (303) 497-8642 (last resort) P.O.
>>Box 3000
>>> *
>>>* address@hidden Boulder, CO
>>80307
>>> *
>>>* Unidata WWW Service
>>http://www.unidata.ucar.edu/ <http://www.unidata.ucar.edu/>
>><http://www.unidat
> a.ucar.edu/ <http://www.unidata.ucar.edu/> >=20
>>> *
>>>+----------------------------------------------------------------------
>>-------
>>> +
>>>
>>>
>>>
>>--
>>+-----------------------------------------------------------------------
>>------+
>>* Tom Yoksas UCAR Unidata
>>Program *
>>* (303) 497-8642 (last resort) P.O. Box
>>3000 *
>>* address@hidden Boulder, CO
>>80307 *
>>* Unidata WWW Service
>>http://www.unidata.ucar.edu/* <http://www.unidata.ucar.edu/*>
>><http://www.unid
> ata.ucar.edu/* <http://www.unidata.ucar.edu/*> >=20
>>+-----------------------------------------------------------------------
>>------+
>>
>>
>>
>>------_=_NextPart_001_01C4BCBF.5EF284FE
>>Content-Type: text/html;
>> charset="us-ascii"
>>Content-Transfer-Encoding: quoted-printable
>>
>><!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
>><HTML><HEAD><TITLE>20040916: NASA request for proposals</TITLE>
>><META http-equiv=3DContent-Type content=3D"text/html; =
>>charset=3Dus-ascii">
>><META content=3D"MSHTML 6.00.3790.1218" name=3DGENERATOR></HEAD>
>><BODY>
>><DIV dir=3Dltr align=3Dleft><FONT face=3DArial color=3D#0000ff =
>>size=3D2><SPAN=20
>>class=3D093392407-28102004>Tom,</SPAN></FONT></DIV>
>><DIV dir=3Dltr align=3Dleft><FONT face=3DArial color=3D#0000ff =
>>size=3D2><SPAN=20
>>class=3D093392407-28102004></SPAN></FONT> </DIV>
>><DIV dir=3Dltr align=3Dleft><FONT face=3DArial color=3D#0000ff =
>>size=3D2><SPAN=20
>>class=3D093392407-28102004>can you try to find time to repsond to my =
>>message=20
>>included below? </SPAN></FONT></DIV>
>><DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
>>class=3D093392407-28102004></SPAN></FONT> </DIV>
>><DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
>>class=3D093392407-28102004>Thanks,</SPAN></FONT></DIV>
>><DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
>>class=3D093392407-28102004></SPAN></FONT> </DIV>
>><DIV><FONT face=3DArial color=3D#0000ff size=3D2><SPAN=20
>>class=3D093392407-28102004>Valentijn</SPAN></FONT></DIV>
>><DIV dir=3Dltr align=3Dleft><BR></DIV>
>><DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr align=3Dleft>
>><HR tabIndex=3D-1>
>><FONT face=3DTahoma size=3D2><B>From:</B> Valentijn Venus =
>><BR><B>Sent:</B> Friday,=20
>>September 17, 2004 11:32 PM<BR><B>To:</B> Tom Yoksas<BR><B>Subject:</B> =
>>RE:=20
>>20040916: NASA request for proposals <BR></FONT><BR></DIV>
>><DIV></DIV>
>><DIV id=3DidOWAReplyText47012 dir=3Dltr>
>><DIV dir=3Dltr><FONT color=3D#000000 size=3D2>Hi Tom,</FONT></DIV></DIV>
>><DIV dir=3Dltr><FONT size=3D2></FONT> </DIV>
>><DIV dir=3Dltr><FONT size=3D2>yes, the code is in fortran and isn't =
>>that old=20
>>all together (1993). Does a gaussian integration of CO2 assimilation in =
>>the=20
>>canopy at three different heights, accounting for diffuse and direct =
>>light and=20
>>LAI. Pretty interesting. PAR is still needed at hourly time =
>>intervals=20
>>though. Hope to start modelling PAR using cloud=20
>>properties estimated form Meteosat-8 data, based on an approach =
>>originally=20
>>developed for MODIS. When will you be able to look into adding that =
>>wavelet=20
>>decompression part to the ADDE server code? If succesful, how =
>>well does=20
>>McIDAS interface with such a fortran developed model (runtime). =
>>Would it be=20
>>possible to do this at pixel level?</FONT></DIV>
>><P><FONT size=3D2>Cheers,</FONT></P>
>><P><FONT size=3D2>Valentijn</P>
>><DIV dir=3Dltr><BR></DIV></FONT>
>><DIV dir=3Dltr><FONT size=3D2>
>><HR tabIndex=3D-1>
>></FONT></DIV>
>><DIV dir=3Dltr><FONT size=3D2><B>Van:</B> Tom Yoksas=20
>>[mailto:address@hidden <mailto:address@hidden> ]<BR><B>Verzon
> den:</B> vr 9/17/2004=20
>>18:55<BR><B>Aan:</B> Valentijn Venus<BR><B>CC:</B> Tom=20
>>Yoksas<BR><B>Onderwerp:</B> 20040916: NASA request for proposals=20
>><BR><BR></FONT></DIV>
>><DIV><BR>
>><P><FONT size=3D2>Hi Valentijn,<BR><BR>>how was your trip to =
>>Brazil?<BR><BR>It=20
>>was a LOT of fun and very productive, although I am paying the =
>>price<BR>by=20
>>digging myself out of a lot of work that piled up while I was gone.<BR>I =
>>could=20
>>have easily spent another 7-10 days there visiting with folks<BR>at =
>>various=20
>>univesities to let them know in more detail about accessing<BR>real-time =
>>data=20
>>through the IDD-Brazil, and to give them an idea of what<BR>they could =
>>do with=20
>>the display and analysis software we make<BR>available. The latter =
>>might=20
>>be a hard sell since GRaDS is being used<BR>literally all over=20
>>Brazil.<BR><BR>>We're enjoying the last sunny days of the=20
>>season,<BR>>rembering 'the brige too far' event of 1944 today and =
>>tomorrow=20
>>here in my<BR>>Arnhem. i'll head for Wagenigen University tomorrow to =
>>fetch=20
>>some source<BR>>code dating back to the 1970's for modelling diurnal =
>>CO2=20
>>assimilation in<BR>>crop canopies (developed on now rarely used =
>>Macintoshes=20
>>here in Europe).<BR><BR>Wow, code from the 1970s! I assume it is =
>>Fortran=20
>>IV...<BR><BR>>Hope to do some PAR modeling with Meteosat-8 data, =
>>relating=20
>>that to crop<BR>>growth with some port of the model i =
>>hope.<BR><BR>Sounds=20
>>interesting.<BR><BR>>I just saw the NASA request for proposals (see =
>>below)=20
>>and the following line<BR>>made me wonder if it is open to foreigners =
>>
>>(dutchmen): "promoting the<BR>>widespread use of the system and =
>>related NASA=20
>>data products"<BR><BR>I don't know. Perhaps sending an email to =
>>someone=20
>>listed on the web<BR>sites cited would be useful thing to =
>>do?<BR><BR>>If so,=20
>>this maybe the oppertunity to see if we can push our idea =
>>to<BR>>extend=20
>>Unidata sharing technlogies to the mainland. Let me know if<BR>>your=20
>>intersted in writing a proposal together.<BR><BR>I don't think that the =
>>intent=20
>>in this Request for Proposal fits with<BR>the idea of expanding =
>>real-time data=20
>>delivery to Europe. The RFP seems<BR>to be calling for educators =
>>to use=20
>>the GeoBrain system being developed<BR>at George Mason University and =
>>provide=20
>>feedback to its developers on<BR>what is needed to make it more =
>>useful. =20
>>Also, the funding level<BR>indicated "Each participant will receive =
>>$10,000 a=20
>>year for two years"<BR>indicates that the awards will be to individuals, =
>>not to=20
>>group<BR>efforts.<BR><BR>I can imagine that a funding opportunity will =
>>present=20
>>itself at some<BR>point, but this does not appear to be=20
>>it.<BR><BR>Cheers,<BR><BR>Tom<BR><BR>>This announcement is provided =
>>as a=20
>>community =
>>service.<BR>>*********************<BR>><BR>><BR>>Request=20
>>for Proposals<BR>><BR>>To Participate in the NASA-Sponsored =
>>Project=20
>>-<BR>><BR>>"NASA EOS Higher Education Alliance: Mobilization of =
>>NASA EOS=20
>>Data and<BR>>Information through Web Services and Knowledge =
>>Management=20
>>Technologies for<BR>>Higher Education Teaching and=20
>>Research"<BR>><BR>>Issued: September 15, 2004<BR>>Proposal Due: =
>>Oct 15,=20
>>2004 by 4:30 p.m. (EST)<BR>><BR>>Project =
>>Background<BR>><BR>>This is=20
>>one of the projects selected for funding through the =
>>NASA<BR>>Cooperative=20
>>Agreement Notice CAN-02-OES-01 issued on September 27,=20
>>2002<BR>>(see<BR>></FONT><A=20
>>href=3D"http://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/winn=
>><htt
> p://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/winn=>
>>ers.html"><FONT=20
>>size=3D2>http://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/win=
>><htt
> p://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/win=>
>>ners.html</FONT></A><FONT=20
>>size=3D2>).<BR>>The project represents part of NASA's efforts to =
>>create the=20
>>NASA Earth<BR>>Science Research, Education and Applications Solutions =
>>Network=20
>>(Earth<BR>>Science REASoN), a distributed network of data and =
>>information=20
>>providers<BR>>for earth science research, applications and education=20
>>(see<BR>></FONT><A=20
>>href=3D"http://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/inde=
>><htt
> p://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/inde=>
>>x.html"><FONT=20
>>size=3D2>http://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/ind=
>><htt
> p://research.hq.nasa.gov/code_y/nra/current/CAN-02-OES-01/ind=>
>>ex.html</FONT></A><FONT=20
>>size=3D2>).<BR>>In pursuit of its objectives in earth science =
>>research,=20
>>applications and<BR>>education, NASA is generating earth system data =
>>of=20
>>unprecedented quality<BR>>and quantity and developing data processing =
>>and=20
>>modeling capabilities to<BR>>transform these data into easily usable =
>>products=20
>>and valuable information.<BR>>The purpose of the NASA Earth Science =
>>REASoN is=20
>>to "afford solutions for<BR>>utilization of NASA assets and =
>>capabilities to=20
>>support science findings and<BR>>applications directed towards =
>>understanding=20
>>and predicting the future of<BR>>the Earth and developing policy and =
>>resource=20
>>management decision support<BR>>systems, and education tools to =
>>inspire and=20
>>train current and future<BR>>generations of =
>>scientists."<BR>><BR>>This=20
>>particular project involves the development of a=20
>>standard-compliant,<BR>>open, distributed, three-tier web information =
>>system=20
>>called GeoBrain. The<BR>>system will make peta-bytes of NASA EOS data =
>>and=20
>>information easily<BR>>accessible to users in the higher education =
>>community=20
>>and allow them to<BR>>dynamically and cooperatively develop =
>>interoperable,=20
>>web-executable<BR>>geospatial service modules and models for =
>>extracting=20
>>customized data and<BR>>information products. It will deliver a =
>>data-enhanced=20
>>geospatial learning<BR>>and research environment to the desktops of =
>>students=20
>>and professors.<BR>>Additional information about the project can be =
>>found at=20
>>the website<BR>></FONT><A href=3D"http://reason.laits.gmu.edu
>><http://reason
> .laits.gmu.edu> "><FONT=20
>>size=3D2>http://reason.laits.gmu.edu <http://reason.laits.gmu.edu>
>></FONT></A><
> FONT =
>>size=3D2>.<BR>><BR>>What=20
>>We Are Looking for?<BR>><BR>>To better meet the needs of the =
>>higher=20
>>education community and facilitate<BR>>the widespread adoption of =
>>GeoBrain=20
>>technology and NASA data in Earth<BR>>system science teaching and =
>>research,=20
>>we are looking for education partners<BR>>who teach courses and =
>>conduct=20
>>research that could significantly benefit<BR>>from the online =
>>availability of=20
>>remotely sensed images and other data<BR>>products acquired or =
>>developed by=20
>>NASA and a web-based data delivery,<BR>>analysis, and modeling system =
>>for=20
>>easy extraction of data and information<BR>>specifically tailored to =
>>user's=20
>>particular needs. The implementation of the<BR>>entire project will =
>>take five=20
>>years (6/1/2004 - 5/31/2009). Three proposals<BR>>will be selected =
>>for=20
>>funding as sub-contracts during the first year of this<BR>>project. A =
>>similar=20
>>call for proposals will be issued during the second and<BR>>the third =
>>year.=20
>>Each participant will receive $10,000 a year for two =
>>years.<BR>>Related data=20
>>and software products will be provided for your use free=20
>>of<BR>>charge.<BR>><BR>><BR>>The specific responsibilities =
>>of the=20
>>selected participants include<BR>><BR>>* helping the development =
>>team to=20
>>identify the user needs in the higher<BR>>education community and =
>>define the=20
>>specific requirements for the web-based<BR>>EOS data service=20
>>system,<BR>><BR>><BR>>* testing and evaluating the =
>>functionality of=20
>>GeoBrain and providing<BR>>feedback to the development team for =
>>improving the=20
>>capability and<BR>>performance of the =
>>system,<BR>><BR>><BR>>*=20
>>incorporating the use of our system and NASA data products into=20
>>your<BR>>teaching and research programs,<BR>><BR>><BR>>* =
>>promoting=20
>>the widespread use of the system and related NASA data =
>>products<BR>>in the=20
>>higher education community, and optionally,<BR>><BR>>* designing =
>>new Earth=20
>>system science courses at undergraduate or graduate<BR>>levels that =
>>take=20
>>advantage of the data-enhanced learning environment<BR>>provided by=20
>>GeoBrain.<BR>><BR>>Preparation and Submission of=20
>>Proposals<BR>><BR>>Your proposal should include (1) a detailed =
>>description=20
>>of how you will<BR>>make effective use of NASA data and information =
>>in your=20
>>teaching and<BR>>research, (2) a summary of your educational =
>>background and=20
>>research<BR>>experience that are directly relevant to the =
>>implementation of=20
>>this<BR>>project, (3) a brief description of your facility and =
>>equipment, (4)=20
>>an<BR>>annual breakdown budget, and (5) a copy of your current =
>>curriculum=20
>>vitae.<BR>>For instructional use, you may provide a description of =
>>the=20
>>existing and<BR>>possible new courses in which you can benefit from =
>>the=20
>>dissemination of<BR>>NASA data and information through GeoBrain and =
>>discuss=20
>>how you plan to use<BR>>such data in these courses. For research =
>>purpose, you=20
>>can describe how your<BR>>ongoing projects could be enhanced and what =
>>new=20
>>projects could be developed<BR>>as a result of easy access to NASA =
>>data and=20
>>information. The total length<BR>>of part 1-3 of your proposal should =
>>be no=20
>>more than 5 pages.<BR>><BR>>Selection of participants will be made =
>>before=20
>>November 1, 2004. The<BR>>expected starting date for the participants =
>>is=20
>>December 1, 2004. Please<BR>>prepare an annual budget for two years =
>>starting=20
>>from December 1, 2004. The<BR>>total amount of funding cannot exceed =
>>$20,000.=20
>>Please include a brief<BR>>justification for any unusual items in =
>your=20
>>budget. For each year, you need<BR>>to plan one trip to attend a NASA =
>>Earth=20
>>System Science Education for the<BR>>Twenty-First Century=20
>>meeting.<BR>><BR>>Please send your proposal as E-mail attachments =
>>to=20
>>Professor Liping Di at<BR>>address@hidden with cc to Professor ZONG-GUO =
>>XIA=20
>>at<BR>>address@hidden. Both MS Word and PDF files will be =
>>
>>acceptable.<BR>><BR>>For inquiry of this RFP, please contact the =
>>Principal=20
>>Investigator of this<BR>>project:<BR>><BR>>Professor Liping Di, =
>>
>>Director<BR>>Laboratory for Advanced Information Technology and =
>>Standards=20
>>(LAITS)<BR>>George Mason University<BR>>9801 Greenbelt Road, Suite =
>>
>>316-317<BR>>Lanham, MD 20706<BR>>Phone: (301) 552 - =
>>9496<BR>>Fax: (301)=20
>>552 - 9671<BR>>Email:=20
>>address@hidden<BR>><BR>><BR>>________________________________<BR>&g=
>>t;<BR>>Van:=20
>>Tom Yoksas [</FONT><A href=3D"mailto:address@hidden <mailto:yoksas@uni
> data.ucar.edu> "><FONT=20
>>size=3D2>mailto:address@hidden <mailto:address@hidden> </FONT
> ></A><FONT =
>>size=3D2>]<BR>>Verzonden:=20
>>wo 8/18/2004 21:26<BR>>Aan: Valentijn Venus<BR>>CC:=20
>>address@hidden; Harald van der Werff;=20
>>address@hidden<BR>> .edu<BR>>Onderwerp: 20040818: MSG-1 =
>>through ADDE=20
>>(cont.)<BR>><BR>><BR>><BR>>>From: "Valentijn Venus" =
>>
>><address@hidden><BR>>>Organization: =20
>>ITC<BR>>>Keywords: =
>>200408161528.i7GFScaW025855<BR>><BR>>Hi=20
>>Valentijn,<BR>><BR>>I just wanted to let you know that I received =
>>your=20
>>email pointing<BR>>me to the wavelet code. I will try to make =
>>some time=20
>>to look into<BR>>the effort it would take to incorporate the =
>>decompression=20
>>into<BR>>the MSG server, but this will probably have to wait =
>>until I=20
>>return<BR>>from Brazil.<BR>><BR>>One thing that I need to know, =
>>
>>however. You note:<BR>><BR>>"The licensing<BR>>agreement =
>>that we=20
>>signed allows use for non-commercial and educational<BR>>purposes=20
>>only."<BR>><BR>>Does your license then give me a right to look at =
>>the code=20
>>and<BR>>incorporate it into the Unidata McIDAS releaes? Or, do =
>>I need=20
>>to<BR>>follow the same path and sign a license agreement with=20
>>EUMETSAT?<BR>><BR>>Cheers,<BR>><BR>>Tom<BR>><BR>>>Cl=
>>icking=20
>>the following url<BR>>>(</FONT><A=20
>>href=3D"ftp://ftp.itc.nl/pub/venus/PublicDecompWT.zip
>><ftp://ftp.itc.nl/pub/ven
> us/PublicDecompWT.zip> "><FONT=20
>>size=3D2>ftp://ftp.itc.nl/pub/venus/PublicDecompWT.zip
>><ftp://ftp.itc.nl/pub/ve
> nus/PublicDecompWT.zip> </FONT></A><FONT =
>>size=3D2>)=20
>>will provide you the<BR>>>sources and documentation to the Public=20
>>Decompress Wavelet Transform<BR>>>library produced by VCS and =
>>published by=20
>>EUMETSAT. The licensing<BR>>>agreement that we signed allows use =
>>for=20
>>non-commercial and educational<BR>>>purposes only. The example =
>>provided in=20
>>this WinZip archive is may not be<BR>>>usefull. Another, more =
>>ellaborate=20
>>example is provided in the MSG<BR>>>HRIT/LRIT code (</FONT><A=20
>>href=3D"http://meteosatlib.sourceforge.net/
>><http://meteosatlib.sourceforge.net
> /> "><FONT=20
>>size=3D2>http://meteosatlib.sourceforge.net/
>><http://meteosatlib.sourceforge.ne
> t/> </FONT></A><FONT size=3D2>) =
>>which=20
>>depends on<BR>>>the same library for the MSG image=20
>>decompression.<BR>>><BR>>>Let me know if you need more=20
>>help...<BR>>><BR>>><BR>>>Valenitjn<BR>>><BR>>&=
>>gt;________________________________<BR>>><BR>>>From:=20
>>Valentijn Venus=3D20<BR>>>Sent: Friday, August 13, 2004 10:13=20
>>PM<BR>>>To: Unidata Support<BR>>>Cc:=20
>>address@hidden; Harald van der=20
>>Werff;<BR>>>address@hidden<BR>>>Subject: RE: =
>>20040809:=20
>>MSG-1 through ADDE (cont.)<BR>>><BR>>><BR>>>for your=20
>>convenience i'v included a better (easier) link to the set =
>>of<BR>>>example=20
>>msg-1 data:<BR>>></FONT><A=20
>>href=3D"http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/=3D20
>><http://ois
> www.eumetsat.org/WEBOPS/msg_images/20030509/=3D20> "><FON=
>>T=20
>>size=3D2>http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/=3D20
>><http://oi
> swww.eumetsat.org/WEBOPS/msg_images/20030509/=3D20> </FON=
>>T></A><BR><FONT=20
>>size=3D2>>>=3D20<BR>>>Don't bother about the =
>>"msg1_native.nat.bz2",=20
>>which is the format<BR>>>Marianne is working with. The notes that =
>>EUMETSAT=20
>>provides with the data<BR>>>are included=20
>>below:<BR>>>=3D20<BR>>><BR>>>HRIT=20
>>(unencrypted)<BR>>><BR>>>Each of these files has been=20
>>bzip2<BR>>><</FONT><A=20
>>href=3D"http://sources.redhat.com/bzip2/index.html
>><http://sources.redhat.com/b
> zip2/index.html> "><FONT=20
>>size=3D2>http://sources.redhat.com/bzip2/index.html
>><http://sources.redhat.com/
> bzip2/index.html> </FONT></A><FONT=20
>>size=3D2>> compressed and contains<BR>>>identical =
>>prologue and=20
>>epilogue files (the prologue and epilogue files<BR>>>can be =
>>overwritten if=20
>>all files are extracted into a single directory).<BR>>>Note that =
>>matching=20
>>JPEG files are available above.=20
>>=3D20<BR>>><BR>>>________________________________<BR>>>=
>><BR>>>From:=20
>>Valentijn Venus<BR>>>Sent: Fri 8/13/2004 21:59<BR>>>To: =
>>Valentijn=20
>>Venus; Unidata Support<BR>>>Cc: address@hidden; =
>>Harald=20
>>van der Werff;<BR>>>address@hidden<BR>>>Subject: =
>>RE:=20
>>20040809: MSG-1 through ADDE =
>>(cont.)<BR>>><BR>>><BR>>>Hi=20
>>Tom,<BR>>>=3D20<BR>>>just got word from a Cuban student a =
>>tornadao=20
>>heading for the States did<BR>>>some serious damage to their =
>>Island.=20
>>McIDAS provided proof of the event.<BR>>>Wonderful to have such a =
>>system=20
>>in place!<BR>>>=3D20<BR>>>My problems with our MSG ADDE =
>>server=20
>>disappeared partially after setting<BR>>>COMPRESS=3D3Dnone, and =
>>fully after=20
>>equipping a faster machine with McIDAS.<BR>>>This answers my =
>>former=20
>>questions, but a new one of more serious nature<BR>>>arised (i =
>>think).=20
>>When displaying an image, the frame in question shows<BR>>>just =
>>the=20
>>metadata (sensor name, time of observation, etc.). The =
>>image<BR>>>itself=20
>>is not displayed. I believe it has to do with the fact that=20
>>the<BR>>>EUMETCAST data is compressed using a proprietary wavelet=20
>>transform. We<BR>>>have the sources (in c) from EUMETSAT to =
>>decompress=20
>>them, and after<BR>>>looking in the MSGT server-files i found no =
>>similair=20
>>occurences of the<BR>>>code.<BR>>>=3D20<BR>>>Miguel =
>>Angel told=20
>>me the other day that they first decompress the<BR>>>segmented =
>>files, and=20
>>then serve them to through their homebuild MSG ADDE<BR>>>server. =
>>This=20
>>would however increase our storage=20
>>requirements<BR>>>significantly.<BR>>>=3D20<BR>>>The =
>>example=20
>>data provided at<BR>>></FONT><A=20
>>href=3D"http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>><http://w
> ww.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit> "><F=
>>ONT=20
>>size=3D2>http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>><http://
> www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit> </F=
>>ONT></A><BR><FONT=20
>>size=3D2>>><</FONT><A=20
>>href=3D"http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>><http://w
> ww.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit> "><F=
>>ONT=20
>>size=3D2>http://www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit
>><http://
> www.eumetsat.de/en/dps/news/msg-1_rect_image.html#hrit> </F=
>>ONT></A><FONT=20
>>size=3D2>> has the<BR>>>same compression applied i =
>>believe. Please=20
>>let me know your thoughts=20
>>on<BR>>>this.<BR>>>=3D20<BR>>>Cheers,<BR>>>Valent=
>>ijn<BR>>><BR>>>________________________________<BR>>><B=
>>R>>>From:=20
>>Valentijn Venus<BR>>>Sent: Tue 8/10/2004 17:02<BR>>>To: =
>>Unidata=20
>>Support<BR>>>Cc: =
>>address@hidden<BR>>>Subject: RE:=20
>>20040809: MSG-1 through ADDE=20
>>(cont.)<BR>>><BR>>><BR>>><BR>>>So my questions=20
>>are:<BR>>><BR>>>-Do you observe the same problem with the =
>>"Work" and=20
>>"Doesn't work"<BR>>>MSG-1 datasets on your McIDAS =
>>system?<BR>>>-Are=20
>>other developers of McIDAS (e.g. those who worked on the MSG=20
>>part)<BR>>>aware of the problem, and possibly willing to find a=20
>>solution?<BR>>>-If negative, would you be willing to adjust the =
>>MSGX bit=20
>>to get it to<BR>>>work for the "Doesn't work" set of example=20
>>data?<BR>>><BR>>><BR>>>-----Original=20
>>Message-----<BR>>>From: Valentijn Venus<BR>>>Sent: Tue =
>>8/10/2004=20
>>16:49<BR>>>To: Unidata Support<BR>>>Cc:=20
>>address@hidden<BR>>>Subject: RE: 20040809: MSG-1 =
>>through=20
>>ADDE (cont.)<BR>>><BR>>>Hi Tom,<BR>>><BR>>>i =
>>believe=20
>>i've found the problem. The format we receieve is XRIT =
>>alright<BR>>>(so=20
>>the MSGT argument should work), but along the way EUMETCAST has=20
>>made<BR>>>a change in the segmentation. E.g. the HRV 11134 =
>>segments were=20
>>devided<BR>>>over 174 files, whereas the more recent segmentation =
>>sceme=20
>>devides them<BR>>>over only 24 files. You can download =
>>corresponding sets=20
>>of example data<BR>>>at the following=20
>>adresses<BR>>>(http://www.eumetsat.de/en/dps/news/msg-1_rect_image.=
>><htt
> p://www.eumetsat.de/en/dps/news/msg-1_rect_image.=>
>>html#hrit):<BR>>><BR>>>Works:<BR>>></FONT><A=20
>>href=3D"http://oiswww.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.bz=
>><htt
> p://oiswww.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.bz=>
>>2"><FONT=20
>>size=3D2>http://oiswww.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.b=
>><htt
> p://oiswww.eumetsat.org/WEBOPS/msg_images/msg1_hrit_c12.tar.b=>
>>z2</FONT></A><FONT=20
>>size=3D2> (7.3<BR>>>mb)<BR>>>Doesn't =
>>work:<BR>>></FONT><A=20
>>href=3D"http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/msg1_hrit_c=
>><htt
> p://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/msg1_hrit_c=>
>>h12.tar"><FONT=20
>>size=3D2>http://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/msg1_hrit_=
>><htt
> p://oiswww.eumetsat.org/WEBOPS/msg_images/20030509/msg1_hrit_=>
>>ch12.tar</FONT></A><BR><FONT=20
>>size=3D2>>>.bz2 (40.3 mb)<BR>>><BR>>><BR>>>The =
>>McIDAS=20
>>commands below seem to work with the "Works" dataset:<BR>>>DSSERVE =
>>ADD=20
>>MSG/HRV MSGT=20
>>TYPE=3D3DIMAGE<BR>>>DIRFILE=3D3D/home/mcidas/data/msg/*/*/*/H*{HRV,=
>>EPI,PRO}*=20
>>"High resolution<BR>>>visible channel (band =
>>12).<BR>>>DSSERVE ADD=20
>>MSG/VISIR MSGT=20
>>TYPE=3D3DIMAGE<BR>>>DIRFILE=3D3D/home/mcidas/data/msg/*/*/*/H*MSG1*=
>>{VIS,IR,WV,EPI,PRO}*=20
>>"High<BR>>>resolution visible and infrared channel (bands=20
>>1-11).<BR>>>DSSERVE ADD MSG/ADMIN=20
>>TEXT<BR>>>INFO=3D3D/home/mcidas/data/msg/2004/08/08/H*MSG1*ADMIN*=20
>>"METEOSAT-8<BR>>>Administration =
>>Message.<BR>>><BR>>>IMGDISP=20
>>MSG/HRV.-1 1 MAG=3D3D-6 BAND=3D3D12<BR>>><BR>>>Cheers!=20
>>Valentijn<BR>>><BR>>>-----Original =
>>Message-----<BR>>>From:=20
>>Unidata Support [</FONT><A =
>>href=3D"mailto:address@hidden <mailto:address@hidden> "><FO
> NT=20
>>size=3D2>mailto:address@hidden <mailto:address@hidden> </FO
> NT></A><FONT =
>>size=3D2>]<BR>>>Sent:=20
>>Mon 8/9/2004 22:09<BR>>>To: Valentijn Venus<BR>>>Cc:=20
>>address@hidden<BR>>>Subject: 20040809: MSG-1 =
>>through ADDE=20
>>(cont.)<BR>>><BR>>>>From: "Valentijn Venus"=20
>><address@hidden><BR>>>>Organization: =
>>?<BR>>>>Keywords:=20
>>200408050006.i7506ZaW006360 McIDAS MSG<BR>>><BR>>>Hi=20
>>Valentijn,<BR>>><BR>>>Well, after three abstracts and a LOT =
>>of other=20
>>stuff, I finally have<BR>>>time<BR>>>to get to your =
>>inquiry. =20
>>Sorry for the wait...<BR>>><BR>>>>another message to keep =
>>you=20
>>up-to-date on my latest developments.=20
>>at<BR>>>the<BR>>>>moment the ADDE server is working well =
>>using a=20
>>sample of MSG-1 images<BR>>>>provided by=20
>>EUMETSAT.<BR>>><BR>>>Which format are you using? The =
>>McIDAS-X=20
>>distribution supports two<BR>>>different file types for MSG data =
>>through=20
>>two different servers:<BR>>><BR>>>msgtadir.cp --=20
>>XRIT<BR>>>msgtaget.cp -- XRIT<BR>>><BR>>>msgxadir.cp =
>>-- ??=20
>>(native?)<BR>>>msgxaget.cp -- ?? =
>>(native?)<BR>>><BR>>>>The=20
>>HRV data (band 12) are unencrypted and in Native format,=20
>>and<BR>>>>2003/12/12 13.30 consists of 176 segmented files =
>>(excl. PRO=20
>>and PERI<BR>>>>metadatailes).<BR>>><BR>>>>A =
>>similair=20
>>scene as we receive it contain only 24 (much=20
>>bigger)<BR>>>segments<BR>>>>(filenaming looks similair), =
>>and when=20
>>i try to serve this McIDAS tells<BR>>>me<BR>>>>tere are =
>>no=20
>>bands/data in the group.<BR>>>><BR>>>>Have you ever=20
>>encountered this problem?<BR>>><BR>>>No, I havn't. I =
>>must add=20
>>that I have not played around with the MSG<BR>>>data all that =
>>much, so my=20
>>not having experienced the problem you are<BR>>>seeing means =
>>little or=20
>>nothing.<BR>>><BR>>>>From: "Valentijn Venus"=20
>><address@hidden><BR>>>>Date: Thu, 5 Aug 2004 23:46:32=20
>>+0200<BR>>><BR>>>>Btw, how is McIDAS compiling in 64-bit =
>>for an=20
>>AMD64 system?<BR>>><BR>>>I built McIDAS on our dual Opteron =
>>64-bit=20
>>machine back in late<BR>>>June/early<BR>>>July and had no =
>>problems=20
>>that I can recall. We have not keep this build<BR>>>around =
>>for=20
>>testing since we have been experimenting with different =
>>OSes<BR>>>on the=20
>>box (Fedora Core 1 for 64 bit; FreeBSD =
>>5.2).<BR>>><BR>>>>From:=20
>>Valentijn Venus<BR>>>>Sent: Wed 8/4/2004=20
>>23:36<BR>>><BR>>>>If i understood well the 2004 McIDAS =
>>upgrade=20
>>will read the raw,<BR>>>transmitted<BR>>>>METEOSAT 8 =
>>files. These=20
>>we receive from EUMETSAT by a satellite=20
>>dish<BR>>>mounted<BR>>>>on the top of our=20
>>roof.<BR>>><BR>>>Is this through=20
>>EUMETCAST?<BR>>><BR>>>>The server runs on a Windows =
>>XP OS=20
>>and stores the<BR>>>>segmented files received through a DVB =
>>system on a=20
>>shared drive.<BR>>><BR>>>OK. I have had two meeting =
>>with=20
>>Volker Gartner, Head of EUMETSAT User<BR>>>Services, about setting =
>>up an=20
>>ADDE server for the METEOSAT data at<BR>>>EUMETSAT. The idea =
>>is to=20
>>get the folks at EUMETSAT using remote access<BR>>>methods first, =
>>then get=20
>>the member state's researchers interested, and<BR>>>then see if =
>>the=20
>>service could be opened up. There are many steps =
>>and<BR>>>pitfalls=20
>>between the first effort and the goal, but I am hopeful =
>>that<BR>>>we can=20
>>make progress.<BR>>><BR>>>>since i<BR>>>>won't =
>>be able=20
>>to participate in this years Workshop, i'm looking=20
>>for<BR>>>some<BR>>>>documentation/guidance on how to set =
>>up an=20
>>ADDE server for MSG-1=20
>>for<BR>>>internal<BR>>>>research/educational=20
>>use.<BR>>><BR>>>I think another of your emails shows that =
>>you got=20
>>past this point even<BR>>>though your earlier email showed a bit =
>>of a=20
>>misunderstanding:<BR>>><BR>>>>>Just added a couple of =
>EUMESAT=20
>>MSG-1 images using:<BR>>><BR>>>>>DDSERVE MSG/HRV MSGT=20
>>TYPE=3D3DIMAGE<BR>>>DIRFILE=3D3D'/home/mcidas/data/H*MSG1*HRV*20040=
>>80112<BR>>>00*'<BR>>><BR>>>OK,=20
>>this creates the dataset with group name MSG and descriptor=20
>>HRV.<BR>>><BR>>>>>McIDAS tells me the command =
>>completed=20
>>succesfully. The i added the<BR>>>ADDE to<BR>>>>>the =
>>client=20
>>routing table using:<BR>>><BR>>>>>DATALOC ADD MSG_LOC=20
>>ADDESERVER.ITC.NL<BR>>><BR>>>Two =
>>things:<BR>>><BR>>>- if=20
>>you created the dataset locally, then you don't have to run=20
>>DATALOC<BR>>> to locate it -- unless -- you want to access =
>>it=20
>>through the remote<BR>>> ADDE server=20
>>interface<BR>>><BR>>>- since the dataset you created has =
>>group name=20
>>MSG, the DATALOC<BR>>> command would=20
>>be:<BR>>><BR>>>DATALOC ADD MSG=20
>>ADDESERVER.ITC.NL<BR>>><BR>>> This also assumes that =
>>the fully=20
>>qualified hostname of the ADDE<BR>>> server machine is=20
>>ADDESERVER.ITC.NL.<BR>>><BR>>>>>Then i tried to =
>>display the=20
>>data using:<BR>>><BR>>>>>IMGDISP MSG_LOC/HRV.-1 1 =
>>MAG=3D3D-6=20
>>BAND=3D3D4<BR>>>>>or<BR>>>>>IMGDISP=20
>>MSG_LOC/FD<BR>>><BR>>>The first thing to do is verify that =
>>the ADDE=20
>>group name is recognized<BR>>>by the =
>>server:<BR>>><BR>>>DSINFO=20
>>IMAGE MSG_LOC<BR>>><BR>>>If these return nothing, then you =
>>are=20
>>asking for the wrong ADDE =
>>dataset<BR>>>group.<BR>>><BR>>>>I=20
>>could send you some sample files if that =
>>helps...<BR>>><BR>>>At some=20
>>point, I wouldn't mind getting sets of example data that =
>>works<BR>>>and=20
>>doesn't work so I can better understand the=20
>>formats.<BR>>><BR>>>>I also came across a message in the =
>>archive=20
>>that mentioned a way to<BR>>>>calculate satellite and sun =
>>angles for=20
>>METEOSAT data (by Miguel Angel).<BR>>>>I would very much =
>>appreciate it=20
>>for some radiative=20
>>transfer<BR>>>modelling....<BR>>><BR>>>Yes. I =
>>believe=20
>>that he sent along the program in his email. If<BR>>>he =
>>didn't, it=20
>>might be best to contact him directly to get his =
>>latest<BR>>>version of=20
>>the code.<BR>>><BR>>>>>Also an updated DATALOC listing =
>>
>>(ADDELIST.TXT) would be very welcome.<BR>>><BR>>>What would =
>>be more=20
>>useful is the URL for the list of=20
>>Publically<BR>>>Accessible<BR>>>ADDE=20
>>servers:<BR>>><BR>>></FONT><A=20
>>href=3D"http://my.unidata.ucar.edu/content/software/mcidas/adde_servers.h=
>><htt
> p://my.unidata.ucar.edu/content/software/mcidas/adde_servers.h=>
>>tml"><FONT=20
>>size=3D2>http://my.unidata.ucar.edu/content/software/mcidas/adde_servers.=
>><htt
> p://my.unidata.ucar.edu/content/software/mcidas/adde_servers.=>
>>html</FONT></A><BR><FONT=20
>>size=3D2>>><BR>>>Sending you the contents of ADDESITE.TXT =
>>would not=20
>>give you a complete<BR>>>listing of what servers are out=20
>>there.<BR>>><BR>>>Cheers,<BR>>><BR>>>Tom<BR>>&=
>>gt;--<BR>>>********************************************************=
>>****************<BR>>>****=20
>><<BR>>>Unidata User=20
>>Support =
>> &=
>>nbsp; =20
>>UCAR Unidata<BR>>>Program=20
>><<BR>>>(303)497-8643 &n=
>>bsp; &nb=
>>sp; &nbs=
>>p;  =
>>; =20
>>P.O. Box<BR>>>3000=20
>><<BR>>>address@hidden &nb=
>>sp; &nbs=
>>p;  =
>>; =20
>>Boulder, CO<BR>>>80307=20
>><<BR>>>---------------------------------------------------------=
>>---------------<BR>>>----=20
>><<BR>>>Unidata WWW Service<BR>>></FONT><A=20
>>href=3D"http://my.unidata.ucar.edu/content/support
>><http://my.unidata.ucar.edu/
> content/support> "><FONT=20
>>size=3D2>http://my.unidata.ucar.edu/content/support
>><http://my.unidata.ucar.edu
> /content/support> </FONT></A><FONT =
>>size=3D2> =20
>><<BR>>>---------------------------------------------------------=
>>---------------<BR>>>----=20
>><<BR>>>NOTE: All email exchanges with Unidata User Support are =
>>recorded=20
>>in the<BR>>>Unidata inquiry tracking system and then made =
>>publically=20
>>available<BR>>>through the web. If you do not want to have =
>>your=20
>>interactions made<BR>>>available in this way, you must let us know =
>>in each=20
>>email you send=20
>>to<BR>>>us.<BR>>><BR>>><BR>>><BR>>><BR>>=
>>><BR>>><BR>>>------_=3D_NextPart_001_01C483A5.B1EB5D89<BR>=
>>>>Content-Type:=20
>>text/x-vcard;<BR>>> =
>>name=3D"Valentijn=20
>>Venus.vcf"<BR>>>Content-Transfer-Encoding:=20
>>base64<BR>>>Content-Description: Valentijn=20
>>Venus.vcf<BR>>>Content-Disposition:=20
>>attachment;<BR>>> =
>>filename=3D"Valentijn=20
>>Venus.vcf"<BR>>><BR>>>QkVHSU46VkNBUkQNClZFUlNJT046Mi4xDQpOOlZ=
>>lbnVzO1ZhbGVudGlqbg0KRk46VmFsZW50aWpu<BR>>>IFZlbnVzDQpPUkc6O05SUw0K=
>>VElUTEU6TS5TYy4NClRFTDtXT1JLO1ZPSUNFOiszMSAoMCk1MyA0<BR>>>ODc0NTQ5D=
>>QpBRFI7V09SSzo7NC0xMzQ7UC5PLiBCb3ggNjtFbnNjaGVkZTs7NzUwMCBBQQ0KTEFC<BR>&g=
>>t;>RUw7V09SSztFTkNPRElORz1RVU9URUQtUFJJTlRBQkxFOjQtMTM0PTBEPTBBUC5PLiB=
>>Cb3ggNj0w<BR>>>RD0wQUVuc2NoZWRlIDc1MDAgQUENCkVNQUlMO1BSRUY7SU5URVJO=
>>RVQ6dmVudXNAaXRjLm5sDQpS<BR>>>RVY6MjAwNDA1MjVUMDgzOTI2Wg0KRU5EOlZDQ=
>>VJEDQo=3D<BR>>><BR>>>------_=3D_NextPart_001_01C483A5.B1EB5D8=
>>9--<BR>>--<BR>>+---------------------------------------------------=
>>--------------------------<BR>>=20
>>+<BR>>* Tom=20
>>Yoksas &=
>>nbsp; &n=
>>bsp; &nb=
>>sp; =20
>>UCAR Unidata Program<BR>> *<BR>>* (303) 497-8642 (last=20
>>resort) =
>> &=
>>nbsp; =20
>>P.O. Box 3000<BR>> *<BR>>*=20
>>address@hidden &n=
>>bsp; &nb=
>>sp; &nbs=
>>p; =20
>>Boulder, CO 80307<BR>> *<BR>>* Unidata WWW=20
>>Service =
>> &=
>>nbsp; =20
>></FONT><A href=3D"http://www.unidata.ucar.edu/ <http://www.unidata.ucar.edu/>
>>"
> ><FONT=20
>>size=3D2>http://www.unidata.ucar.edu/ <http://www.unidata.ucar.edu/>
>></FONT></A
> ><BR><FONT size=3D2>>=20
>>*<BR>>+---------------------------------------------------------------=
>>--------------<BR>>=20
>>+<BR>><BR>><BR>><BR>--<BR>+-------------------------------------=
>>----------------------------------------+<BR>*=20
>>Tom=20
>>Yoksas &=
>>nbsp; &n=
>>bsp; &nb=
>>sp; =20
>>UCAR Unidata Program *<BR>* (303) 497-8642 (last=20
>>resort) =
>> &=
>>nbsp; =20
>>P.O. Box 3000 *<BR>*=20
>>address@hidden &n=
>>bsp; &nb=
>>sp; &nbs=
>>p; =20
>>Boulder, CO 80307 *<BR>* Unidata WWW=20
>>Service =
>> &=
>>nbsp; =20
>></FONT><A href=3D"http://www.unidata.ucar.edu/*
>><http://www.unidata.ucar.edu/*>
> "><FONT=20
>>size=3D2>http://www.unidata.ucar.edu/* <http://www.unidata.ucar.edu/*>
>></FONT><
> /A><BR><FONT=20
>>size=3D2>+---------------------------------------------------------------=
>>--------------+<BR></FONT></P></DIV></BODY></HTML>
>>
>>------_=_NextPart_001_01C4BCBF.5EF284FE--
