Re: [awips2-users] EDEX grib ingest error

That problem was caused by not having a working g++ when running
 'yum groupinstall awips2-server'.  Apparently edexBridge gets compiled
as part of the package installation.  
After fixing that, I'm now getting a lot of the following errors in the
edex grib log:

ERROR 2019-06-19 18:35:27,256 0770 [EDEXMain] LevelDao: EDEX - Error
occurred looking up MasterLevel[LYRK]
org.hibernate.exception.GenericJDBCException: Could not open connection



On Sat, 2019-06-15 at 00:05 +0000, Kaiser, Jason N. wrote:
> Hi Devin,
> 
> The documentation for ingesting new grids 
> http://unidata.github.io/awips2/edex/new-grid/ appears to need
> updating for EDEX 18.1.1-6 (also, this Ingest New Grid documentation
> doesn't need to be followed for grids that are already being
> ingested, like NAM, GFS, and the National Blend of Models). To follow
> the Ingest New Grid documentation, for EDEX 18.1.1-6, the grid
> projection files are now located under:
> /awips2/edex/data/utility/common_static/base/grib/grids (i.e. no
> longer edex_static)  The model definition files appear to be
> significantly changed in 18.1.1-6.
> /awips2/edex/data/utility/common_static/base/grid/ exists, but the
> models subdirectory no longer exists, and I can't find the
> gribModels_NCEP-7.xml file. Instead, it looks like the model
> definition is now defined in
> /awips2/edex/data/utility/common_static/base/grid/dataset/alias/grib.
> xml (i.e. this added whatever name I associated with the GribModel
> Grid name:center:subcenter numbers and added a new directory named as
> such to: /awips2/edex/data/hdf5/grid) /awips2/edex/logs/edex-
> ingestGrib-YYYMMDD.log (and therefore edex log grib) no longer
> appeared to confirm that the grib file decodes. For the GRIB2 file I
> tested, confirmation of the grib file being ingested was logged to
> /awips2/edex/logs/edex-ingest-YYYMMDD.log
> 
> However, this doesn't help troubleshoot the error you're seeing with
> grib ingestion. To troubleshoot that, maybe try running the edex
> status command. You should see pids for each aspect of EDEX. If you
> don't see this, try running the edex restart command.
> 
> -Jason
> _________________________________________
> Jason N. T. Kaiser
> Atmospheric Sciences Data Systems Administrator
> Northern Vermont University-Lyndon
> http://atmos.NorthernVermont.edu
> 
> -----Original Message-----
> From: awips2-users-bounces@xxxxxxxxxxxxxxxx <
> awips2-users-bounces@xxxxxxxxxxxxxxxx> On Behalf Of Devin Eyre
> Sent: Friday, June 14, 2019 3:43 PM
> To: awips2-users@xxxxxxxxxxxxxxxx; Devin Eyre <
> Devin.Eyre@xxxxxxxxxxxx>
> Subject: Re: [awips2-users] EDEX grib ingest error
> 
> No directory named either
> /awips2/edex/data/utility/edex_static/base/grib or
> /awips2/edex/data/utility/edex_static/base/grid were created when I
> installed edex.  The EDEX user manual at
> http://unidata.github.io/awips2/edex/new-grid/ has the directory
> named
> both of these, and I'm sure one is a typo.
> 
> On Fri, 2019-06-14 at 19:22 +0000, Devin Eyre wrote:
> > Looks like grib1 is working.  The only directories in the
> > /awips2/edex/data/hdf5/grid/ begin with FFG-
> > 
> > On Fri, 2019-06-14 at 18:42 +0000, Devin Eyre wrote:
> > > I just installed EDEX 18.1.1.-6el7, and grib ingestion isn't
> > > working
> > > at
> > > all.
> > > 
> > > The error I'm seeing in the edex-ingestGrib log file is this:
> > > ERROR 2019-06-14 18:18:43,453 6514 [Ingest.GribDecode-1]
> > > PythonDecoderFactory: Cannot instantiate
> > > com.raytheon.edex.plugin.grib
> > > decoder, GribDecoder products will not be decoded!
> > > ERROR 2019-06-14 18:18:43,453 6515 [Ingest.GribDecode-1]
> > > GribDecoder:
> > > EDEX - Failed to decode grib file:
> > > /awips2/data_store/grid/NationalBlend/NationalBlend_YVAC23_KWEA_1
> > > 41
> > > 70
> > > 0.
> > > grib2
> > > com.raytheon.edex.plugin.grib.exception.GribException: Failed to
> > > decode
> > > file:
> > > [/awips2/data_store/grid/NationalBlend/NationalBlend_YVAC23_KWEA_
> > > 14
> > > 17
> > > 00
> > > .grib2]
> > >     at
> > > com.raytheon.edex.plugin.grib.Grib2Decoder.decode(Grib2Decoder.ja
> > > va
> > > :7
> > > 8)
> > > ~[com.raytheon.edex.plugin.grib.jar:na]
> > >     at
> > > com.raytheon.edex.plugin.grib.GribDecoder.process(GribDecoder.jav
> > > a:
> > > 77
> > > )
> > > ~[com.raytheon.edex.plugin.grib.jar:na]
> > >     at
> > > org.apache.camel.component.bean.BeanProcessor.process(BeanProcess
> > > or
> > > .j
> > > av
> > > a:103) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessor
> > > He
> > > lp
> > > er
> > > .java:109) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.component.bean.BeanProcessor.process(BeanProcess
> > > or
> > > .j
> > > av
> > > a:69) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessageP
> > > ro
> > > du
> > > ce
> > > r.java:439) [com.raytheon.uf.edex.esb.camel.jar:na]
> > >     at
> > > org.apache.camel.processor.DelegateAsyncProcessor.process(Delegat
> > > eA
> > > sy
> > > nc
> > > Processor.java:110) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.CamelInternalProcessor.process(CamelIn
> > > te
> > > rn
> > > al
> > > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.Pipeline.process(Pipeline.java:120)
> > > [camel-
> > > core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.Pipeline.process(Pipeline.java:83)
> > > [camel-
> > > core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessor
> > > He
> > > lp
> > > er
> > > .java:109) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.Pipeline.process(Pipeline.java:63)
> > > [camel-
> > > core-2.18.3.jar:2.18.3]
> > >     at
> > > com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessageP
> > > ro
> > > du
> > > ce
> > > r.java:439) [com.raytheon.uf.edex.esb.camel.jar:na]
> > >     at
> > > org.apache.camel.processor.DelegateAsyncProcessor.process(Delegat
> > > eA
> > > sy
> > > nc
> > > Processor.java:110) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.CamelInternalProcessor.process(CamelIn
> > > te
> > > rn
> > > al
> > > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.TryProcessor.process(TryProcessor.java
> > > :1
> > > 13
> > > )
> > > [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.TryProcessor.process(TryProcessor.java
> > > :8
> > > 4)
> > > [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessor
> > > He
> > > lp
> > > er
> > > .java:109) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.TryProcessor.process(TryProcessor.java
> > > :6
> > > 8)
> > > [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > com.raytheon.uf.edex.esb.camel.MessageProducer$2.process(MessageP
> > > ro
> > > du
> > > ce
> > > r.java:439) [com.raytheon.uf.edex.esb.camel.jar:na]
> > >     at
> > > org.apache.camel.processor.DelegateAsyncProcessor.process(Delegat
> > > eA
> > > sy
> > > nc
> > > Processor.java:110) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.CamelInternalProcessor.process(CamelIn
> > > te
> > > rn
> > > al
> > > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.CamelInternalProcessor.process(CamelIn
> > > te
> > > rn
> > > al
> > > Processor.java:197) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.processor.DelegateAsyncProcessor.process(Delegat
> > > eA
> > > sy
> > > nc
> > > Processor.java:97) [camel-core-2.18.3.jar:2.18.3]
> > >     at
> > > org.apache.camel.component.jms.EndpointMessageListener.onMessage(
> > > En
> > > dp
> > > oi
> > > ntMessageListener.java:112) [camel-jms-2.18.3.jar:2.18.3]
> > >     at
> > > org.springframework.jms.listener.AbstractMessageListenerContainer
> > > .d
> > > oI
> > > nv
> > > okeListener(AbstractMessageListenerContainer.java:721) [spring-
> > > jms-
> > > 4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > org.springframework.jms.listener.AbstractMessageListenerContainer
> > > .i
> > > nv
> > > ok
> > > eListener(AbstractMessageListenerContainer.java:681) [spring-jms-
> > > 4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > org.springframework.jms.listener.AbstractMessageListenerContainer
> > > .d
> > > oE
> > > xe
> > > cuteListener(AbstractMessageListenerContainer.java:651) [spring-
> > > jms-
> > > 4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > org.springframework.jms.listener.AbstractPollingMessageListenerCo
> > > nt
> > > ai
> > > ne
> > > r.doReceiveAndExecute(AbstractPollingMessageListenerContainer.jav
> > > a:
> > > 31
> > > 3)
> > > [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > org.springframework.jms.listener.AbstractPollingMessageListenerCo
> > > nt
> > > ai
> > > ne
> > > r.receiveAndExecute(AbstractPollingMessageListenerContainer.java:
> > > 25
> > > 1)
> > > [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > org.springframework.jms.listener.DefaultMessageListenerContainer$
> > > As
> > > yn
> > > cM
> > > essageListenerInvoker.invokeListener(DefaultMessageListenerContai
> > > ne
> > > r.
> > > ja
> > > va:1164) [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > org.springframework.jms.listener.DefaultMessageListenerContainer$
> > > As
> > > yn
> > > cM
> > > essageListenerInvoker.executeOngoingLoop(DefaultMessageListenerCo
> > > nt
> > > ai
> > > ne
> > > r.java:1156) [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > org.springframework.jms.listener.DefaultMessageListenerContainer$
> > > As
> > > yn
> > > cM
> > > essageListenerInvoker.run(DefaultMessageListenerContainer.java:10
> > > 53
> > > )
> > > [spring-jms-4.2.9.RELEASE.jar:4.2.9.RELEASE]
> > >     at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecu
> > > to
> > > r.
> > > ja
> > > va:1142) [na:1.8.0_101]
> > >     at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExec
> > > ut
> > > or
> > > .j
> > > ava:617) [na:1.8.0_101]
> > >     at java.lang.Thread.run(Thread.java:745) [na:1.8.0_101]
> > > Caused by: com.raytheon.edex.exception.DecoderException: Cannot
> > > instantiate com.raytheon.edex.plugin.grib decoder, GribDecoder
> > > products
> > > will not be decoded!
> > >     at
> > > com.raytheon.uf.edex.python.decoder.PythonDecoderFactory.makePyth
> > > on
> > > De
> > > co
> > > der(PythonDecoderFactory.java:147)
> > > ~[com.raytheon.uf.edex.python.decoder.jar:na]
> > >     at
> > > com.raytheon.uf.edex.python.decoder.PythonDecoder.decode(PythonDe
> > > co
> > > de
> > > r.
> > > java:102) ~[com.raytheon.uf.edex.python.decoder.jar:na]
> > >     at
> > > com.raytheon.edex.plugin.grib.Grib2Decoder.decode(Grib2Decoder.ja
> > > va
> > > :6
> > > 7)
> > > ~[com.raytheon.edex.plugin.grib.jar:na]
> > >     ... 35 common frames omitted
> > > 
> > > There was no file named
> > > /awips2/edex/data/utility/edex_static/base/distribution/grib.xml,
> > > so
> > > I
> > > made one based on the example in
> > > http://unidata.github.io/awips2/edex/data-distribution-files/ but
> > > that
> > > didn't fix the problem either.
> > > 
> > > _______________________________________________
> > > NOTE: All exchanges posted to Unidata maintained email lists are
> > > recorded in the Unidata inquiry tracking system and made publicly
> > > available through the web.  Users who post to any of the lists we
> > > maintain are reminded to remove any personal information that
> > > they
> > > do not want to be made public.
> > > 
> > > 
> > > awips2-users mailing list
> > > awips2-users@xxxxxxxxxxxxxxxx
> > > For list information, to unsubscribe, or change your membership
> > > options, visit: http://www.unidata.ucar.edu/mailing_lists/
> > 
> > _______________________________________________
> > NOTE: All exchanges posted to Unidata maintained email lists are
> > recorded in the Unidata inquiry tracking system and made publicly
> > available through the web.  Users who post to any of the lists we
> > maintain are reminded to remove any personal information that they
> > do not want to be made public.
> > 
> > 
> > awips2-users mailing list
> > awips2-users@xxxxxxxxxxxxxxxx
> > For list information, to unsubscribe, or change your membership
> > options, visit: http://www.unidata.ucar.edu/mailing_lists/
> 
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web.  Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
> 
> 
> awips2-users mailing list
> awips2-users@xxxxxxxxxxxxxxxx
> For list information, to unsubscribe, or change your membership
> options, visit: http://www.unidata.ucar.edu/mailing_lists/
  • 2019 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the awips2-users archives: