LDM

Status Report: April - October 2010

Steve Emmerson

Strategic Focus Areas

The LDM group's work supports the following Unidata funding proposal focus areas:

  1. Broadening participation and expanding community services by providing near real-time atmospheric data for research and education

  2. Advancing data services by providing near real-time atmospheric data for research and education

  3. Developing and deploying useful tools by developing the software and providing it free of charge

  4. Enhancing user support services by providing free expert support for the software

  5. Providing leadership in cyberinfrastructure by being the #1 “advanced application” on Internet-II

  6. Promoting diversity by expanding opportunities by democratizing access to atmospheric data

Activities Since the Last Status Report

Alpha testing of LDM 6.9.0

Installed LDM 6.9.0 on Tom Yoksas' machine (Yakov). So far so, so good.

LDM chosen for studying virtual circuits

Dr. Malathi Veeraraghavan, professor of Electrical and Computer Engineering at the University of Virginia, has chosen the LDM as the subject of an NSF EAGER grant on the applicability of using virtual circuits for large-scale data distribution. The grant has been awarded and Steve Emmerson is a co-PI.

Work on the next-generation LDM

An end-to-end skeleton has been created that successfully distributes data using a peer-to-peer-based publish/subscribe system.

Planned Activities

Ongoing Activities

We plan to continue the following activities:

  • Deployment of LDM 6.9.0 on the Unidata Program Center's backend cluster

  • Release of LDM 6.9.0

  • Fall LDM training-workshop

  • Continue development of the next-generation LDM

New Activities

We plan to organize or take part in the following:

  • Provide advice to Jie Lie, Dr. Veeraraghavan's graduate student at the University of Virginia, on modifying the LDM to use virtual circuits.

Relevant Metrics

LDM metrics

The LDM data-rate on Internet-II is currently about 24 TB/week (or 3.4 TB/day, 140 GB/hr, 2.4 GB/min, 40 MB/s, 320 Mb/s). It has been observed to range up to as high as 34 TB/week during peak summer storm seasons.