uggh..
I just built what I thought was a pretty bullet proof LDM server
2x Quad core, 8gb ram, 2 500gb SATA2 HDD's
64bit CentOS 5.5
after setting up the ldmadmin-pl.conf for 3gb of a queue ..
started it up, memory with in 30 minutes wax maxed out,
so I added 4 more for a total of 12gb..
took the server a little longer this time, abt 3 hrs,
now its running right at 10-11gb of memory..
is this normal ??
attached is my ldmd.conf, as I've read most memory usage can be traced to bad
REQUEST lines..
anybody give me some help??
Jeff Lake K8JSL
MichiganWxSystem.com
WeatherMichigan.net
#####
# $Id: ldmd.conf,v 1.18.12.5 2007/02/16 17:29:47 steve Exp $
# Sample ldmd.conf for ldm
####
#
# This is the main configuration file for the LDM server. All lines that start
# with a "#" sign are comments.
#
# To debug an LDM that hangs on start up, run the following from LDM home:
# % bin/rpc.ldmd -vl - -q data/ldm.pq etc/ldmd.conf
#
# If the LDM still hangs, comment out all lines in this file except noted
# allow line entry below, try again.
#
###############################################################################
# WARNING: Pathological Product-ID Patterns
###############################################################################
#
# The REQUEST and ACCEPT entries both have product-ID patterns that are regular
# expressions (RE-s). It is EXTREMELY IMPORTANT that these patterns not have a
# ".*" prefix because: 1) such a prefix accomplishes nothing (i.e., the set of
# possible matches is unaltered by the prefix); and 2) such a prefix causes the
# RE to take MUCH, MUCH LONGER TO EXECUTE (by 3 orders of magnitude in some
# cases). Therefore, DO NOT USE RE-s like
#
# ".*UFPBA"
#
# Instead, simply use
#
# "UFPBA"
#
# The regex(1) utility of this package can be used to examine the efficiency
# of an RE.
#
###############################################################################
# Include Statements
###############################################################################
#
# It's possible to include other files by uncommented-out statements
# like the following:
#
#INCLUDE pathname
#INCLUDE "pathname with spaces"
#
# Non-absolute pathnames are relative to the directory that contains the
# configuration-file with the include statement.
#
###############################################################################
# Exec Entries
###############################################################################
#
# Programs that can share a queue with rpc.ldmd server, these programs
# are started by the "exec" command and are in the same process group.
#
EXEC "pqact -v"
EXEC "pqact -f DDPLUS etc/pqactb.conf"
#
# rtstats uses the LDM to send product latency statistics to the UPC.
# For more info on rtstats please see the man page.
EXEC "rtstats -f ANY -h rtstats.unidata.ucar.edu"
#EXEC "rtstats -f ANY -h sasquatch.tamu.edu"
EXEC "pqsurf -p ^(S[AP]) -Q /usr/local/ldm/data/pqsurf.pq -d /usr/local/ldm
/usr/local/ldm/etc/pqsurf.conf"
#
###############################################################################
# Request Entries
###############################################################################
#
# Request data-products from upstream LDM-s. The syntax is
#
# REQUEST <feedset> <pattern> <host>[:<port>]
#
# where:
# <feedset> Is the union of feedtypes to request.
# <pattern> Is an extended regular-expression for the product-
# identifiers to match.
# <host> Is the host identifier: either a hostname or IP
# address in "dotted-quad" format.
# <port> Is the (optional) port on <host> to which to connect
# (the square brackets denote an option and should be
# omitted).
#
# If the same feedtype and pattern is requested from multiple hosts, then
# the host of the first such request will be the initial primary source
# of data-products (i.e., data-products will be rapidly sent using the
# HEREIS message) and the other hosts will initially be alternate sources of
# data-products (i.e., data will be sent using the COMMINGSOON and BLKDATA
# messages). The primary host will probably change over time -- depending on
# which host can deliver the data-products most quickly on average.
#
#REQUEST WMO ".*" initial-primary-host.some.domain:388
#REQUEST WMO ".*" initial-secondary-host.another.domain
#REQUEST WMO ".*" another-secondary-host.yet_another.domain:3152
REQUEST NEXRAD3 ".*" weather.admin.niu.edu:388
REQUEST NEXRAD3 ".*" bigbird.tamu.edu:388
#REQUEST NEXRAD2 ".*" bigbird.tamu.edu:388
REQUEST IDS|DDPLUS ".*" bigbird.tamu.edu:388
REQUEST IDS|DDPLUS ".*" sasquatch.tamu.edu:388
REQUEST IDS|DDPLUS ".*" idd.aos.wisc.edu:388
REQUEST IDS|DDPLUS ".*" weather.admin.niu.edu:388
REQUEST HDS "KWNS" bigbird.tamu.edu:388
REQUEST HDS "HAXA.. K..." bigbird.tamu.edu:388
REQUEST HDS "SDUS." bigbird.tamu.edu:388
REQUEST HDS "KWBQ" bigbird.tamu.edu:388
REQUEST HDS "L[A-Y]U." bigbird.tamu.edu:388
#REQUEST HDS "(RUC|SST)" bigbird.tamu.edu:388
#REQUEST HDS "(/mNAM|/mNMM).*#211" bigbird.tamu.edu:388
REQUEST HDS "H.[A-W]... K" bigbird.tamu.edu:388
#REQUEST HDS "\/GFS\/#211" bigbird.tamu.edu:388
#REQUEST HDS "KNHC" bigbird.tamu.edu:388
REQUEST NGRID "KNHC" bigbird.tamu.edu:388
REQUEST NGRID "KWNO" bigbird.tamu.edu:388
#REQUEST CONDUIT "KWNO" bigbird.tamu.edu:388
REQUEST NGRID "KNHC" idd.aos.wisc.edu:388
REQUEST NGRID "KWNO" idd.aos.wisc.edu:388
#REQUEST CONDUIT "KWNO" idd.aos.wisc.edu:388
REQUEST CONDUIT "YKUZ98" idd.aos.wisc.edu:388
## HURRICANE SECTOR GFS
#REQUEST HDS "\/GFS\/#201.*APCP" bigbird.tamu.edu:388
#REQUEST HDS "\/GFS\/#201.*PRMSL" bigbird.tamu.edu:388
REQUEST NGRID "KNHC" sasquatch.tamu.edu:388
#REQUEST CONDUIT "KWNO" bigbird.tamu.edu:388
#REQUEST CONDUIT "YKUZ98" bigbird.tamu.edu:388
REQUEST NGRID "KNHC" bigbird.tamu.edu:388
REQUEST HDS "KWNS" idd.aos.wisc.edu:388
REQUEST HDS "HAXA.. K..." idd.aos.wisc.edu:388
#REQUEST HDS "(RUC|SST)" idd.aos.wisc.edu:388
#REQUEST HDS "L[A-Y]U.*" idd.aos.wisc.edu:388
#REQUEST HDS "KWBQ" idd.aos.wisc.edu:388
#REQUEST HDS "SDUS.*" idd.aos.wisc.edu:388
#REQUEST HDS "\/GFS\/#211" idd.aos.wisc.edu:388
#REQUEST HDS "(/mNAM|/mNMM).*#211" idd.aos.wisc.edu:388
REQUEST NIMAGE ".*" bigbird.tamu.edu:388
REQUEST NIMAGE ".*" weather.admin.niu.edu:388
# northern hemi
#REQUEST NIMAGE "TIGF[01|02|05]" bigbird.tamu.edu:388
#REQUEST NIMAGE "TIGF[01|02|05]" weather.admin.niu.edu:388
# PR
#REQUEST NIMAGE "TIGQ0[1-5]" bigbird.tamu.edu:388
#REQUEST NIMAGE "TIGP0[1-5]" weather.admin.niu.edu:388
#REQUEST UNIWISC ".*" bigbird.tamu.edu:388
REQUEST FNEXRAD ".*" bigbird.tamu.edu:388
REQUEST FNEXRAD ".*" sasquatch.tamu.edu:388
#REQUEST FNEXRAD ".*" idd.aos.wisc.edu:388
# EMWIN BACKUP
REQUEST EXP ".*" ldm.aprsfl.net
# USPLN
REQUEST LIGHTNING ".*" ldm01.allisonhouse.com
REQUEST LIGHTNING ".*" ldm02.allisonhouse.com
##############################################################################
# Allow Entries
###############################################################################
#
# Give permission to downstream LDM-s to request data-products from your LDM.
#
# ALLOW <feedset> <hostname pattern> [<OK pattern> [<not pattern>]]
#
# where:
# <feedset> is the set of feedtypes for this entry
# <hostname pattern> is an extended regular-expression that
specifies
# which hosts are allowed to receive data-products
# whose feedtype is in <feedset>.
# <OK pattern> is an optional extended regular-expression
that
# a product-identifier must match in order to be
# sent to the requesting LDM. The default value
# is ".*".
# <not pattern> is an optional extended regular-expression
that
# a product-identifier must NOT match in order to
# be sent to the requesting LDM. If this field is
# empty, then such matching will be disabled for
# this entry.
#
# Under no circumstances comment out the next allow entry to localhost
# The LDM will NOT start if the entry is commented-out.
ALLOW ANY ^((localhost|loopback)|(127\.0\.0\.1\.?$)) .*
#
# Give permission to the Unidata Program Center
ALLOW ANY ^[a-z].*\.unidata\.ucar\.edu\.?$ .*
ALLOW ANY ^bigbird\.tamu\.edu$ .*
ALLOW ANY ^sasquatch\.tamu\.edu$ .*
ALLOW ANY ^wanderer.tamu.edu$ .*
ALLOW ANY ^n5jxs\.dsl\.tamu\.edu$ .*
ALLOW ANY ^64\.15\.155\.13$ .* ^EMWIN
ALLOW ANY ^64\.34\.161\.113$ .* ^EMWIN
ALLOW EXP ^.*\.edu$ .*
ALLOW IDS|DDPLUS ^.*\.wxdata\.us$ .*
ALLOW ANY ^67\.215\.181\.42$ .*
ALLOW ANY ^70\.38\.71\.84$ .*
ALLOW IDS|DDPLUS ^wxfeeds\.weatherserver\.net$ .*
#
###############################################################################
# Accept Entries
###############################################################################
# ACCEPT: Who can feed us without be requested by a REQUEST entry, currently
# this action is ONLY needed for WSI data
#
# ACCEPT <feedset> <pattern> <hostname pattern>
#
# ACCEPT anything from yourself
#
#ACCEPT ANY ".*" ^((localhost|loopback)|(127\.0\.0\.1\.?$))
#
# accept from your upstream site
#
# WSI is using ldm4 protocol so the accept is still required
#ACCEPT WSI
# .*
# ^[a-z].*\.uni\.wsicorp\.com$
#
###############################################################################
# End
###############################################################################
