sponsored byIEEEACMThe International Conference for High Performance 
Computing, Networking, Storage and Analysis
FacebookTwitterGoogle PlusLinkedInYouTubeFlickr

SCHEDULE: NOV 16-21, 2014

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Efficient Data Compression by Efficient Use of HDF5 Format

SESSION: Poster Reception


TIME: 5:15PM - 7:00PM

AUTHOR(S):Katsumi Hagita, Manabu Omiya, Takashi Honda, Masao Ogino

ROOM:New Orleans Theater Lobby


Recently, in the area of supercomputing, data transfer problem becomes significant. We proposed efficient data compression method without changing common API like HDF5. JHPCN-DF (Jointed Hierarchical Precision Compression Number - Data Format) is a compression method using Bit Segmentation and Huffman coding. For visualizations and analyses, lower bit of IEEE 754 format is used to be not necessary. The required bits can be determined by direct check to numerical precisions corresponding to visualizations and analyses. We evaluated data size of HDF5 files coordinated by the JPHCN-DF framework in various simulations such as plasma electromagnetic particle-in-cell simulations, finite element method, and phase separated polymer materials. We confirmed visualization software work well with HDF5 files coordinated by the JPHCN-DF framework. For visualization, data sizes of HDF5 file seem to be reduced to 1/5 of original HDF5 file. It is found that JHPCN-DF is effective for wide area of simulations and data sciences.

Chair/Author Details:

Katsumi Hagita - National Defense Academy

Manabu Omiya - Hokkaido University

Takashi Honda - ZEON Corporation

Masao Ogino - Nagoya University

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar