Indiana University

Follow us on Facebook!

High Performance Parallel Computing with Clouds and Cloud Technologies

TitleHigh Performance Parallel Computing with Clouds and Cloud Technologies
Publication TypeBook Chapter
Year of Publication2010
Refereed DesignationUnknown
Refereed DesignationUnknown
Refereed DesignationUnknown
Refereed DesignationUnknown
AuthorsEkanayake, J., X. Qiu, T. Gunarathne, S. Beason, and G. C. Fox
Secondary AuthorsAhson, S. A., and M. Ilyas
Book TitleCloud Computing and Software Services: Theory and Techniques
PublisherCRC Press (Taylor and Francis)
Publication Languageeng
ISBN Number978-1-4398031-5-8
Abstract We present our experiences in applying, developing, and evaluating cloud and cloud technologies. First, we present our experience in applying Hadoop and DryadLINQ to a series of data/compute intensive applications and then compare them with a novel MapReduce runtime developed by us, named CGL-MapReduce, and MPI. Preliminary applications are developed for particle physics, bioinformatics, clustering, and matrix multiplication. We identify the basic execution units of the MapReduce programming model and categorize the runtimes according to their characteristics. MPI versions of the applications are used where the contrast in performance needs to be highlighted. We discuss the application structure and their mapping to parallel architectures of different types, and look at the performance of these applications. Next, we present a performance analysis of MPI parallel applications on virtualized resources.
URLhttp://grids.ucs.indiana.edu/ptliupages/publications/cloud_handbook_final-with-diagrams.pdf