[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: 20050711:IDD Model Feeds via Unidata

Hi John,

Comments in text...

---------------------------------------------------------------------

On Tue, 12 Jul 2005, John Cangialosi wrote:

> Hi Jeff,
>
> First, I'd like to say thank you very much for helping us out.
>
> I am very new with LDM and do not know much about details, but I can tell
> you how grib data is coming in our system.
>
> 1. Through LDM
> In the pqact.conf file we are getting grib data from RUC, NGM, ECMWF, AVN.
>  I believe this grib data is course and not the full fields, is that
> correct?

Yes, the resolution is less fine in the standard HDS/HRS feed in the LDM
via the IDD:..but the fields are "full" in the context that it contains
all the NOAAPORT data (that which is deemed operationally valuable by the
NWSFO's)

http://my.unidata.ucar.edu/content/software/ldm/ldm-6.0.14/basics/feedtypes/index.html

and

http://my.unidata.ucar.edu/content/software/ldm/ldm-6.0.14/basics/feedtypes/hds.html

>
> Here is a subset of what it looks like:
>
> 2005070200_nhmrf.grib    2005070700_prmrf.grib    2005071200_usmrf.grib
> 2005070200_ocean.grib    2005070700_ruc.grib      2005071201_ruc.grib
> 2005070200_prmrf.grib    2005070700_sst-a.grib    2005071202_ruc.grib
> 2005070200_ruc.grib      2005070700_sst-m.grib    2005071203_ruc.grib
> 2005070200_sst-a.grib    2005070700_sst-t.grib    2005071204_ruc.grib
> 2005070200_sst-m.grib    2005070700_usmrf.grib    2005071205_ruc.grib
> 2005070200_sst-t.grib    2005070701_ruc.grib      2005071206_ruc.grib
> 2005070200_usmrf.grib    2005070702_ruc.grib      2005071207_ruc.grib
> 2005070201_ruc.grib      2005070703_ruc.grib      2005071208_ruc.grib
> 2005070202_ruc.grib      2005070704_ruc.grib      2005071209_ruc.grib
> 2005070203_ruc.grib      2005070705_ruc.grib      2005071210_ruc.grib
> 2005070204_ruc.grib      2005070706_ruc.grib      2005071211_ruc.grib
> 2005070205_ruc.grib      2005070707_ruc.grib      2005071212_ngm-h.grib
> 2005070206_ruc.grib      2005070708_ruc.grib      2005071212_ngm-i.grib
> 2005070207_ruc.grib      2005070709_ruc.grib      2005071212_ngm-n.grib
> 2005070208_ruc.grib      2005070710_ruc.grib      2005071212_ngm-q.grib
> 2005070209_ruc.grib      2005070711_ruc.grib      2005071212_ruc.grib
> 2005070210_ruc.grib      2005070712_ecmwf_H.grib  2005071213_ruc.grib
>
> 2. FTP
> In the datatruck.conf file we are linking to ftp sites (right now only the
> NCEP site is working) to read in the full field grib data.
>
> Here is what this file looks like:
>
> # Set my defaults
> # remote user:                ftp remote user login name
> # remote password:    ftp remote login password
> # rmaxdays:           number of past days to mirror images. undefined means 
> all
> # mail_to:            email address to mail log events to
> # mail_err:           email address to mail problems to
> package=defaults
> #     rmaxdays=1
>       remote_user=anonymous
>       remote_password=address@hidden
> #     mail_to=address@hidden
>       mail_err=address@hidden
>
>       # DO NOT TOUCH ANY OF THE FOLLOWING ENTRIES
>       # Keep a log file in each updated directory
>       # Don't overwrite my datatruck log with the remote one.
>       # Don't pull back any of their datatruck temporary files.
>       # Don't touch anything whose name begins with a space!
>       exclude_patt=^\.\w|^#.*#|^lost+found/|(^|/)\
>
>       # Don't delete own mirror log
>       delete_excl=\.LOCK$|.mirror$|.mirror.old$
>       site=ftpprd.ncep.noaa.gov
>
> package=avn1
>       get_patt=gfs\........./gfs.t..z\.*
>       local_dir=/home/disk/wx/data/oso/gfs
>       remote_dir=/pub/data/nccf/com/gfs/prod
>
> package=avn2
>       get_patt=gfs\........./gdas.t..z\.pgrbf...
>       local_dir=/home/disk/wx/data/oso/gfs
>       remote_dir=/pub/data/nccf/com/gfs/prod
>
> package=eta104
>       get_patt=nam\........./nam.t..z\.grbgrd..\.tm00
>       local_dir=/home/disk/wx/data/oso/nam
>       remote_dir=/pub/data/nccf/com/nam/prod
>
> package=eta221
>       get_patt=nam\........./nam.t..z\.awip....\.tm00
>       local_dir=/home/disk/wx/data/oso/nam
>       remote_dir=/pub/data/nccf/com/nam/prod
>
> package=fnl
>       get_patt=sst\........./sst2dvar_grb_0.5
>       local_dir=/home/disk/wx/data/oso/fnl
>       remote_dir=/pub/data/nccf/com/gfs/prod
>
>
> What we would like to have is the full model grib fields (AVN, GFDL,
> NOGAPS, CMC) to run a regional model.  Is this attainable through LDM? or
> do we need to setup the datatruck.conf file to get them ftp'd in.


OK, here is the sticky wicket...both CMC and FNMOC offer a broader product
via ftp than they do via the LDM/IDD..so I suspect you would be happier
hitting their ftp servers rather than getting it via the IDD....I am more
than happy to set up the feed anyway so you can see if the data via the
LDM/IDD suits your needs (let me know if you want to do that)..I believe
that you will find that the resolution and products available via the
CONDUIT feed are what you will desire.

The GFS, NAM, and RUC are available in the CONDUIT feed

Please see:

http://my.unidata.ucar.edu/content/data/conduit/ldm_idd/index.html

for more info re the CONDUIT feed.

I have an "allow" in place for you for the CONDUIT feed on:

idd.unidata.ucar.edu


Please let me and/or support know how we can help you further.


Cheers,

Jeff Weber


>
> Thanks so much for your help,
>
> John Cangialosi
>
>
>
>
> > Hi Shuyi,
> >
> > Yes, I have been told (have not investigated myself) that the grids
> > available via ftp differ from the grids we deliver via the IDD..I have
> > been told that the ftp site has more grids...
> >
> > Yes, it sure is easier to work it through the ldm..:)
> >
> > I will check, and make available a list of the differences.
> >
> > I look forward to hearing back from John and working through this issue.
> >
> >
> > Cheers,
> >
> > Jeff
> > ---------------------------------------------------------------------
> > Jeff Weber                                    address@hidden        :
> > Unidata Program Center                        PH:303-497-8676        :
> > University Corp for Atmospheric Research      3300 Mitchell Ln       :
> > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
> > ---------------------------------------------------------------------
> >
> > On Mon, 11 Jul 2005, Shuyi Chen wrote:
> >
> >> Hi Jeff,
> >>
> >> Thanks for the info on CONDUIT feed.  Yes, dusky.rsmas.miami.edu
> >> is one of my systems.
> >>
> >> We have been given separate ftp sites for NOGAPS (FNMOC) and
> >> CMC (http://dd.weatheroffice.ec.gc.ca/grib/public/hires). However,
> >> I'd prefer the data flow through ldm if the correct grib data can
> >> be worked out since it's easier to automat the process than going
> >> to different ftp sites.
> >>
> >> John Cangialosi (I CC John on this) in my group has been working on
> >> the ldm feed and he will be able to tell you some of the details
> >> on the problems he had.  I appreciate your help.
> >>
> >> Thanks,
> >> Shuyi
> >>
> >> Shuyi S. Chen, Associate Professor
> >> RSMAS/University of Miami
> >> address@hidden
> >>
> >>
> >>
> >>
> >>
> >> > Hello Shuyi,
> >> >
> >> > Yes, we can help you ingest either or all of these models other
> >> > than the GFDL.
> >> >
> >> > Keep in mind that the output from the CMC (that we distribute) is
> >> > a regional version of the GEM output with an emphasis on the
> >> > northern portion of the hemisphere, also the grids from FNMOC
> >> > (NOGAPS model) is also a deprecated output with some fields
> >> > missing in some time frames.
> >> >
> >> > I suspect you will wish to bring in the hi-res CONDUIT feed of the
> >> > GFS.
> >> >
> >> > Please see:
> >> >
> >> > http://my.unidata.ucar.edu/content/data/conduit/ldm_idd/index.html
> >> >
> >> > This is the preferred choice for model initialization, as it has
> >> > higher resolution and fairly complete grids :)
> >> >
> >> > Please let me know if you would still like to "experiment" with
> >> > the FNMOC and CMC feeds and I will initiate the contact between
> >> > you and the
> >> > modeling centers.
> >> >
> >> >
> >> > I see that:
> >> >
> >> >                            dusky.rsmas.miami.edu [6.0.14]
> >> >                            sapodilla.rsmas.miami.edu [6.0.14]
> >> >
> >> > are currently running the LDM..is one of these yours?
> >> >
> >> > How do you want to process the data...?
> >> >
> >> > Simply file for use in native format, or decode to another format
> >> > for use?
> >> >
> >> > Let us know specifically what your desires are and we will walk
> >> > you through it..:)
> >> >
> >> >
> >> > Cheers,
> >> >
> >> > ps: I will be on vacation soon, so it is best to direct all
> >> > questions to:
> >> >
> >> > address@hidden
> >> >
> >> > as they will get answered even in my absence.
> >> >
> >> > Jeff
> >> > ---------------------------------------------------------------------
> >> > Jeff Weber                                    address@hidden
> >> >   : Unidata Program Center                        PH:303-497-8676
> >> >       : University Corp for Atmospheric Research      3300
> >> > Mitchell Ln       : http://www.unidata.ucar.edu/staff/jweber
> >> > Boulder,Co 80307-3000  :
> >> > ---------------------------------------------------------------------
> >> >
> >> > On Mon, 11 Jul 2005, Unidata Support wrote:
> >> >
> >> >>
> >> >> At 09:42 AM 7/11/2005, Shuyi Chen wrote:
> >> >> >Dear Mohan,
> >> >> >
> >> >> >It was nice seeing you in Boulder last week.
> >> >> >As I mentioned that we are trying to set up some high-res model
> >> >> forecasts for a NSF supported hurricane field program - RAINEX
> >> >> >(Hurricane Rainband and Intensity Change Experiment) starting
> >> >> >August at RSMAS/University of Miami.  We'd like to get some
> >> >> >operational global and regional model forecast fields as the
> >> >> >initial/lateral boundary conditions,
> >> >> >including GFS, GFDL, NOGAPS, and CMC (Canadian model), etc.
> >> >> >
> >> >> >However, we have some difficulties of getting the full model
> >> >> >fields through ldm, partly because we don't understand the
> >> >> >system well enough to tell where exactly the grib data from
> >> >> >each models are and how to set up ldm to do this on our system.
> >> >> So far we can only get GFS.
> >> >> >
> >> >> >Would you please let me know me if someone at UNIDATA could
> >> >> help us with this?
> >> >> >
> >> >> >Thanks,
> >> >> >Shuyi
> >> >>
> >> >>
> >> >> --
> >> >> ****************************************************************************
> >> >> < Unidata User Support                                    UCAR
> >> >> Unidata Program < (303)497-8643
> >> >>                 P.O. Box 3000 < address@hidden
> >> >> ----------------------------------------------------------------------------
> >> >> < Unidata WWW Service
> >> >> ----------------------------------------------------------------------------
> >> >> < NOTE: All email exchanges with Unidata User Support are
> >> >> recorded in the Unidata inquiry tracking system and then made
> >> >> publicly available through the web.  If you do not want to have
> >> >> your interactions made available in this way, you must let us
> >> >> know in each email you send to us.
> >> >>
> >> >> ------- End of Forwarded Message
> >>
> >>
> >>
> >
>
>
> --
>
>