Return to Skip Menu

Main Content

Computer scientists' paper among best in history of high-performance distributed computing


   

Mark Gardner, Heshan Lin, and Wu Feng Left to right: Mark Gardner, Heshan Lin, and Wu Feng


BLACKSBURG, Va., May 3, 2012 – A paper titled "MOON: MapReduce on Opportunistic Environments," authored by three current Virginia Tech researchers, Heshan Lin, research scientist, and Wu Feng, associate professor, both of the College of Engineering computer science department, and Mark Gardner of information technology, is included in the listing of the best 20 papers in the 20-year history of the ACM International Symposium on High-Performance Parallel and Distributed Computing.

A special proceedings issue containing these papers will be distributed at HPDC'12, the 21st to be held June 20 to 22 in Delft, the Netherlands. Omni-Press will produce the proceedings.

MOON is a software framework for processing and generating large data sets on dedicated and volunteered computers. In their paper, the authors described MOON as a robust improvement over MapReduce, a framework that supports the ubiquitous Google search engine as well as a myriad of scientific and engineering applications now.

What makes MOON more robust is its ability to run opportunistically on idle computing resources, like those found in university computing labs, as well as traditional datacenter resources.

According to Lin, when the traditional MapReduce is run on a computer framework like Condor, "it results in poor performance due to the volatility of the resources." Furthermore the data and task replication scheme adopted by the existing MapReduce framework can be "woefully inadequate" for resources with high unavailability, Lin attested.

"Our tests demonstrated that MOON delivers a three-fold performance improvement to Hadoop, an open-source implementation of MapReduce, in volatile, volunteer computing environment," added Feng, who holds a courtesy appointment with Virginia Tech's Bradley Department of Electrical and Computer Engineering and an Elizabeth and James E. Turner Jr. Faculty Fellowship.
Other authors of the paper, written in 2010, are Jeremy Archuleta, formerly of Virginia Tech, Xiaosong Ma of North Carolina State University, and Zhe Zhang of Oak Ridge National Laboratory.

To mark the first 20 years of the symposium, members of this high performance computing community were invited to nominate papers for this honor. A committee then selected the top group of 20 papers.

The College of Engineering at Virginia Tech is internationally recognized for its excellence in 14 engineering disciplines and computer science. The college's 6,000 undergraduates benefit from an innovative curriculum that provides a "hands-on, minds-on" approach to engineering education, complementing classroom instruction with two unique design-and-build facilities and a strong Cooperative Education Program. With more than 50 research centers and numerous laboratories, the college offers its 2,000 graduate students opportunities in advanced fields of study such as biomedical engineering, state-of-the-art microelectronics, and nanotechnology. Virginia Tech, the most comprehensive university in Virginia, is dedicated to quality, innovation, and results to the commonwealth, the nation, and the world.