Re: [ldm-users] high memory

I refuse to use NFS. It's even worse than ext3 for IO :)

-Tyler


On Tue, Oct 26, 2010 at 12:12 PM, Arthur A. Person <person@xxxxxxxxxxxxx> wrote:
> Robert,
>
> On Tue, 26 Oct 2010, Robert Mullenax wrote:
>
>> I personally think that most folks could benefit from spending less on
>> tons of RAM and instead going to SAS instead of SATA systems.
>> SATA is certainly better than old IDE, but if you have multiple feeds
>> coming in, decoding of data, and clients getting data via NFS,
>> then SAS is far better.
>
> agreed... except it's cost-prohibitive for large arrays.
>
>                           Art
>
>> -----Original Message-----
>> From: ldm-users-bounces@xxxxxxxxxxxxxxxx on behalf of Arthur A. Person
>> Sent: Tue 10/26/2010 8:31 AM
>> To: Jeff Lake - Admin
>> Cc: LDM Users
>> Subject: Re: [ldm-users] high memory
>>
>> Jeff,
>>
>> Depending on how heavily your system is loaded, you may be piling up too
>> much I/O onto one array.  The LDM queue itself can be pretty demanding of
>> the array, and then you have data coming off the disk out of the queue
>> again to be decoded (although some/most of that should be cached) and then
>> you're writing data back out to the array filing raw/decoded data.  It all
>> comes down the the number of I/O's/second your device can handle... if
>> it's just two SATA disks in a mirror, it's limited.  The first thing I
>> would try is moving your LDM queue to your third drive and then monitor
>> I/O's/second to the drives during peak use.
>>
>>                                Art
>>
>> On Tue, 26 Oct 2010, Jeff Lake - Admin wrote:
>>
>> >> Do you have separate system disk from data, or does everything run off
>> >> one
>> >> mirror?  How many disks are in your mirror?  Is your LDM queue running
>> >> off
>> >> the same array as the OS and data?
>> >>
>> >>                              Art
>> >>
>> >
>> > -sh-3.2$ df -h
>> > Filesystem            Size  Used Avail Use% Mounted on
>> > /dev/sda6             480G   88G  392G  18% /home2
>> > /dev/sda5             448G   72G  353G  17% /
>> > /dev/sda2             2.0G   36M  1.9G   2% /tmp
>> > /dev/sda1              99M   13M   81M  14% /boot
>> > tmpfs
>> >
>> > ldm, sql, and assorted scripts on /
>> > ldm queue and data directory on /home2
>> >
>> > I do have a 3rd drive that I haven't mounted yet
>> >
>> >
>>
>> Arthur A. Person
>> Research Assistant, System Administrator
>> Penn State Department of Meteorology
>> email:  person@xxxxxxxxxxxxx, phone:  814-863-1563
>>
>> _______________________________________________
>> ldm-users mailing list
>> ldm-users@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe,  visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>>
>>
>>
>
> Arthur A. Person
> Research Assistant, System Administrator
> Penn State Department of Meteorology
> email:  person@xxxxxxxxxxxxx, phone:  814-863-1563
> _______________________________________________
> ldm-users mailing list
> ldm-users@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit:
> http://www.unidata.ucar.edu/mailing_lists/
>



  • 2010 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: