sponsored byIEEEACMThe International Conference for High Performance 
Computing, Networking, Storage and Analysis
FacebookTwitterGoogle PlusLinkedInYouTubeFlickr

SCHEDULE: NOV 16-21, 2014

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Scaling MapReduce Vertically and Horizontally

SESSION: Cloud Computing I

EVENT TYPE: Papers, Best Student Paper Finalists

TIME: 2:00PM - 2:30PM

SESSION CHAIR: Rizos Sakellariou

AUTHOR(S):Ismail El-Helw, Rutger Hofman, Henri Bal



Glasswing is a MapReduce framework that uses OpenCL to exploit multi-core CPUs and accelerators. However, compute device capabilities vary significantly and require targeted optimization. Similarly, availability of memory, storage and interconnects impacts job performance. In this paper, we present and analyze how MapReduce applications can improve their horizontal and vertical scalability using a well controlled mixture of coarse- and fine-grained parallelism. We discuss the Glasswing pipeline and its ability to overlap computation, communication, memory transfers and disk access. We show how Glasswing adapts to the distinct capabilities of a variety of compute devices by employing fine-grained parallelism. We experimentally evaluated the performance of five applications and show that Glasswing outperforms Hadoop on a 64-node multi-core CPU cluster by factors between 1.2 and 4, and factors from 20 to 30 on a 23-node GPU cluster. Similarly, we show that Glasswing is at least 1.5x faster than GPMR on the GPU cluster.

Chair/Author Details:

Rizos Sakellariou (Chair) - University of Manchester

Ismail El-Helw - VU University Amsterdam

Rutger Hofman - VU University Amsterdam

Henri Bal - VU University Amsterdam

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

Paper provided by the ACM Digital Library

Paper also available from IEEE Computer Society