sponsored byIEEEACMThe International Conference for High Performance 
Computing, Networking, Storage and Analysis
FacebookTwitterGoogle PlusLinkedInYouTubeFlickr

SCHEDULE: NOV 16-21, 2014

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Two-Choice Randomized Dynamic I/O Scheduler for Object Storage Systems

SESSION: I/O and Dynamic Optimization


TIME: 4:00PM - 4:30PM


AUTHOR(S):Dong Dai, Yong Chen, Dries Kimpe, Robert Ross



Object storage is considered a promising solution for the next-generation (exascale) high performance computing platform due to its flexible and high performance object interface. However, delivering high burst-write throughput is still a critical challenge. Although deploying more storage servers can potentially provide higher throughput, it can be ineffective as the burst-write throughput is limited by a small number of possible stragglers. In this paper, we propose a two-choice randomized dynamic I/O scheduler to avoid stragglers and hence achieve high throughput. The contributions include: 1) we propose a two-choice randomized dynamic I/O scheduler with collaborative probe and preassign strategies; 2) we design and implement a redirect table and metadata maintainer to address the metadata management challenge introduced by dynamic I/O scheduling; and 3) we evaluate the proposed scheduler with both simulation and experimental tests in HPC cluster. The evaluation results confirmed the scalability and performance benefits of the proposed I/O scheduler.

Chair/Author Details:

John West (Chair) - Department of Defense HPC Modernization Program

Dong Dai - Texas Tech University

Yong Chen - Texas Tech University

Dries Kimpe - Argonne National Laboratory

Robert Ross - Argonne National Laboratory

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

Paper provided by the ACM Digital Library

Paper also available from IEEE Computer Society