Hi Devin,
The documentation for ingesting new grids
http://unidata.github.io/awips2/edex/new-grid/ appears to need updating for
EDEX 18.1.1-6 (also, this Ingest New Grid documentation doesn't need to be
followed for grids that are already being ingested, like NAM, GFS, and the
National Blend of Models). To follow the Ingest New Grid documentation, for
EDEX 18.1.1-6, the grid projection files are now located under:
/awips2/edex/data/utility/common_static/base/grib/grids (i.e. no longer
edex_static) The model definition files appear to be significantly changed in
18.1.1-6. /awips2/edex/data/utility/common_static/base/grid/ exists, but the
models subdirectory no longer exists, and I can't find the
gribModels_NCEP-7.xml file. Instead, it looks like the model definition is now
defined in
/awips2/edex/data/utility/common_static/base/grid/dataset/alias/grib.xml (i.e.
this added whatever name I associated with the GribModel Grid
name:center:subcenter numbers and added a new directory named as such to:
/awips2/edex/data/hdf5/grid) /awips2/edex/logs/edex-ingestGrib-YYYMMDD.log (and
therefore edex log grib) no longer appeared to confirm that the grib file
decodes. For the GRIB2 file I tested, confirmation of the grib file being
ingested was logged to /awips2/edex/logs/edex-ingest-YYYMMDD.log
However, this doesn't help troubleshoot the error you're seeing with grib
ingestion. To troubleshoot that, maybe try running the edex status command. You
should see pids for each aspect of EDEX. If you don't see this, try running the
edex restart command.
-Jason
_________________________________________
Jason N. T. Kaiser
Atmospheric Sciences Data Systems Administrator
Northern Vermont University-Lyndon
http://atmos.NorthernVermont.edu
-----Original Message-----
From: awips2-users-bounces@xxxxxxxxxxxxxxxx
<awips2-users-bounces@xxxxxxxxxxxxxxxx> On Behalf Of Devin Eyre
Sent: Friday, June 14, 2019 3:43 PM
To: awips2-users@xxxxxxxxxxxxxxxx; Devin Eyre <Devin.Eyre@xxxxxxxxxxxx>
Subject: Re: [awips2-users] EDEX grib ingest error
No directory named either
/awips2/edex/data/utility/edex_static/base/grib or
/awips2/edex/data/utility/edex_static/base/grid were created when I
installed edex. The EDEX user manual at
http://unidata.github.io/awips2/edex/new-grid/ has the directory named
both of these, and I'm sure one is a typo.
On Fri, 2019-06-14 at 19:22 +0000, Devin Eyre wrote:
> Looks like grib1 is working. The only directories in the
> /awips2/edex/data/hdf5/grid/ begin with FFG-
>
> On Fri, 2019-06-14 at 18:42 +0000, Devin Eyre wrote:
> > I just installed EDEX 18.1.1.-6el7, and grib ingestion isn't
> > working
> > at
> > all.
> >
> > The error I'm seeing in the edex-ingestGrib log file is this:
> > ERROR 2019-06-14 18:18:43,453 6514 [Ingest.GribDecode-1]
> > PythonDecoderFactory: Cannot instantiate
> > com.raytheon.edex.plugin.grib
> > decoder, GribDecoder products will not be decoded!
> > ERROR 2019-06-14 18:18:43,453 6515 [Ingest.GribDecode-1]
> > GribDecoder:
> > EDEX - Failed to decode grib file:
> > /awips2/data_store/grid/NationalBlend/NationalBlend_YVAC23_KWEA_141
> > 70
> > 0.
> > grib2
> > com.raytheon.edex.plugin.grib.exception.GribException: Failed to
> > decode
> > file:
> > [/awips2/data_store/grid/NationalBlend/NationalBlend_YVAC23_KWEA_14
> > 17
> > 00
> > .grib2]
> > at
> > com.raytheon.edex.plugin.grib.Grib2Decoder.decode(Grib2Decoder.java
> > :7
> > 8)
> > ~[com.raytheon.edex.plugin.grib.jar:na]
> > at
> > com.raytheon.edex.plugin.grib.GribDecoder.process(GribDecoder.java:
> > 77
> > )
> > ~[com.raytheon.edex.plugin.grib.jar:na]
> > at
> > org.apache.camel.component.bean.BeanProcessor.process(BeanProcessor
> > .j
> > av
> > a:103) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHe
> > lp
> > er
> > .java:109) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.component.bean.BeanProcessor.process(BeanProcessor
> > .j
> > av
> > a:69) [camel-core-2.18.3.jar:2.18.3]
> > at
> > com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessagePro
> > du
> > ce
> > r.java:439) [com.raytheon.uf.edex.esb.camel.jar:na]
> > at
> > org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateA
> > sy
> > nc
> > Processor.java:110) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.CamelInternalProcessor.process(CamelInte
> > rn
> > al
> > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.Pipeline.process(Pipeline.java:120)
> > [camel-
> > core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.Pipeline.process(Pipeline.java:83)
> > [camel-
> > core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHe
> > lp
> > er
> > .java:109) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.Pipeline.process(Pipeline.java:63)
> > [camel-
> > core-2.18.3.jar:2.18.3]
> > at
> > com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessagePro
> > du
> > ce
> > r.java:439) [com.raytheon.uf.edex.esb.camel.jar:na]
> > at
> > org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateA
> > sy
> > nc
> > Processor.java:110) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.CamelInternalProcessor.process(CamelInte
> > rn
> > al
> > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.TryProcessor.process(TryProcessor.java:1
> > 13
> > )
> > [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.TryProcessor.process(TryProcessor.java:8
> > 4)
> > [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHe
> > lp
> > er
> > .java:109) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.TryProcessor.process(TryProcessor.java:6
> > 8)
> > [camel-core-2.18.3.jar:2.18.3]
> > at
> > com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessagePro
> > du
> > ce
> > r.java:439) [com.raytheon.uf.edex.esb.camel.jar:na]
> > at
> > org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateA
> > sy
> > nc
> > Processor.java:110) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.CamelInternalProcessor.process(CamelInte
> > rn
> > al
> > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.CamelInternalProcessor.process(CamelInte
> > rn
> > al
> > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateA
> > sy
> > nc
> > Processor.java:97) [camel-core-2.18.3.jar:2.18.3]
> > at
> > org.apache.camel.component.jms.EndpointMessageListener.onMessage(En
> > dp
> > oi
> > ntMessageListener.java:112) [camel-jms-2.18.3.jar:2.18.3]
> > at
> > org.springframework.jms.listener.AbstractMessageListenerContainer.d
> > oI
> > nv
> > okeListener(AbstractMessageListenerContainer.java:721) [spring-jms-
> > 4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > org.springframework.jms.listener.AbstractMessageListenerContainer.i
> > nv
> > ok
> > eListener(AbstractMessageListenerContainer.java:681) [spring-jms-
> > 4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > org.springframework.jms.listener.AbstractMessageListenerContainer.d
> > oE
> > xe
> > cuteListener(AbstractMessageListenerContainer.java:651) [spring-
> > jms-
> > 4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > org.springframework.jms.listener.AbstractPollingMessageListenerCont
> > ai
> > ne
> > r.doReceiveAndExecute(AbstractPollingMessageListenerContainer.java:
> > 31
> > 3)
> > [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > org.springframework.jms.listener.AbstractPollingMessageListenerCont
> > ai
> > ne
> > r.receiveAndExecute(AbstractPollingMessageListenerContainer.java:25
> > 1)
> > [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > org.springframework.jms.listener.DefaultMessageListenerContainer$As
> > yn
> > cM
> > essageListenerInvoker.invokeListener(DefaultMessageListenerContaine
> > r.
> > ja
> > va:1164) [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > org.springframework.jms.listener.DefaultMessageListenerContainer$As
> > yn
> > cM
> > essageListenerInvoker.executeOngoingLoop(DefaultMessageListenerCont
> > ai
> > ne
> > r.java:1156) [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > org.springframework.jms.listener.DefaultMessageListenerContainer$As
> > yn
> > cM
> > essageListenerInvoker.run(DefaultMessageListenerContainer.java:1053
> > )
> > [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecuto
> > r.
> > ja
> > va:1142) [na:1.8.0_101]
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecut
> > or
> > .j
> > ava:617) [na:1.8.0_101]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_101]
> > Caused by: com.raytheon.edex.exception.DecoderException: Cannot
> > instantiate com.raytheon.edex.plugin.grib decoder, GribDecoder
> > products
> > will not be decoded!
> > at
> > com.raytheon.uf.edex.python.decoder.PythonDecoderFactory.makePython
> > De
> > co
> > der(PythonDecoderFactory.java:147)
> > ~[com.raytheon.uf.edex.python.decoder.jar:na]
> > at
> > com.raytheon.uf.edex.python.decoder.PythonDecoder.decode(PythonDeco
> > de
> > r.
> > java:102) ~[com.raytheon.uf.edex.python.decoder.jar:na]
> > at
> > com.raytheon.edex.plugin.grib.Grib2Decoder.decode(Grib2Decoder.java
> > :6
> > 7)
> > ~[com.raytheon.edex.plugin.grib.jar:na]
> > ... 35 common frames omitted
> >
> > There was no file named
> > /awips2/edex/data/utility/edex_static/base/distribution/grib.xml,
> > so
> > I
> > made one based on the example in
> > http://unidata.github.io/awips2/edex/data-distribution-files/ but
> > that
> > didn't fix the problem either.
> >
> > _______________________________________________
> > NOTE: All exchanges posted to Unidata maintained email lists are
> > recorded in the Unidata inquiry tracking system and made publicly
> > available through the web. Users who post to any of the lists we
> > maintain are reminded to remove any personal information that they
> > do not want to be made public.
> >
> >
> > awips2-users mailing list
> > awips2-users@xxxxxxxxxxxxxxxx
> > For list information, to unsubscribe, or change your membership
> > options, visit: http://www.unidata.ucar.edu/mailing_lists/
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web. Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
>
>
> awips2-users mailing list
> awips2-users@xxxxxxxxxxxxxxxx
> For list information, to unsubscribe, or change your membership
> options, visit: http://www.unidata.ucar.edu/mailing_lists/
_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web. Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.
awips2-users mailing list
awips2-users@xxxxxxxxxxxxxxxx
For list information, to unsubscribe, or change your membership options, visit:
http://www.unidata.ucar.edu/mailing_lists/
