We describe the design and implementation of an application-level parallel I/O (PIO) library for the reading and writing of distributed arrays to several common scientific data formats. PIO provides the flexibility to control the number of I/O tasks through data rearrangement to an I/O friendly decomposition. This flexibility enables reductions in per task memory usage and improvements in disk I/O performance versus a serial I/O approach. We illustrate the impact various features within PIO have on memory usage and disk I/O bandwidth on a Cray XT5 system.
AbbasiHWolfMEisenhauserGKlaskySSchwanKZhengF (2009) Datastager: Scalable data staging services for petascale applications. In Proceedings of HPDC, pp. 39–48.
2.
AntypasKCalderACDubeyAFisherRGanapathyMKGallagherJB (2006) Scientific applications on the massively parallel BG/L machines. In Proceedings of PDPTA2006, pp. 292–298.
3.
ClyneJMininniPNortonARastM (2007) Interactive desktop analysis of high resolution simulations: application to turbulent plume dynamics and current sheet formation. New J Phys9: 301.
4.
ClyneJRastM (2005) A prototype discovery environment for analyzing and visualizing terascale turbulent fluid flow simulations. In Proceedings of Visualization and Data Analysis 2005.
5.
DennisJMLoftR (2009) Optimizing high-resolution climate variability experiments on the Cray XT4 and XT5 systems at NICS and NERSC. In Cray User Group (CUG09), Atlanta, GA.
6.
DocanCParasharMKlaskyS (2008) Enabling high speed asynchronous data extraction and transfer using DART. In Proceedings of the 17th International Symposium on High-Performance Distributed Computing (HPDC), Boston, MA. Los Alamitos, CA: IEEE Computer Society Press.
7.
HoffmanFMVertensteinMKitabataHWhiteJB III (2005) Vectorizing the Community Land Model. Int J High Perform Comput Appl19: 247–260.
8.
HunkeECLipscombWH (2008) CICE: the Los Alamos sea ice model documenation and software user’s manual version 4.0. Technical Report LA-CC-06-012, Los Alamos National Laboratory, T-3 Fluid Dynamics Group.
9.
JacobRLarsonJOngE (2005) MxN compunication and parallel interpolation in CCSM3 using the Model Coupling Toolkit. Int J High Perform Comput Appl19: 293–307.
10.
JinCKlaskySHodsonSYuWLofsteadJAbbasiH. (2008) Adaptive IO System (ADIOS). In Cray User Group (CUG08).
11.
JonesPWWorleyPHYoshidaYWhiteJB ILevesqueJ (2005) Practical performance portability in the Parallel Ocean Program (POP). Concurrency Comput Pract Exper17: 1317–1327.
12.
LarsonJJacobROngE (2005) The Model Coupling Toolkit: A new fortran90 toolkit for building multiphysics parallel coupled models. Int J High Perform Comput Appl19: 277–292.
13.
LiJLiaoWChoudharyARossRThakurRGroppW. (2003) Parallel netCDF: A high-performance scientific I/O interface. In In Proceedings of the ACM/IEEE Conference on Supercomputing (SC).
14.
LiaoWChoudharyA (2008) Dynamically adapting file domain partitioning methods for collective I/O based on underlying parallel file system locking protocols. In In Proceedings of the ACM/IEEE Conference on Supercomputing (SC), pp. 313–344.
15.
LofsteadJZhengFKlaskySSchwanK (2009) Adaptable, metadata rich IO methods for portable high performance IO. In In Proceedings of IPDPS’09, Rome, Italy.
16.
MPI Forum (1998) MPI-2: a message passing interface standard. High Performance Computing Applications12: 1–2.
17.
NealeRRichterJConleyAParkSLauritzenPGettelmanA (2010) Description of the NCAR Community Atmsophere Model (CAM 4.0). Technical Report NCAR/TN-???+STR, NationalCenter for Atmospheric Research.
18.
RewRKDavisGP (1990) The unidata netCDF: Software for scientific data access. In Sixth International Conference on Interactive Information and Processing Systems for Meteorology, Oceanography, and Hydrology. Anaheim, CA: American Meteorology Society, pp. 33–40.
19.
SmithRJonesPBrieglebBBryanFDanabasogluGDennisJ. (2010) The Parallel Ocean Program (POP) reference manual: Ocean component of the Community Climate System Model (CCSM). Technical Report LAUR-10-01853, Los Alamos National Laboratory.
ThakurRGroppWLuskE (1998) Data sieving and colletive I/O in ROMIO. In Proceedings of the Seventh Symposium on the Frontiers of Massively Parallel Computation. Los Alamitos, CA: IEEE Computer Society Press, pp. 182–189.
22.
TsengYDingC (2008) Efficient parallel I/O in Community Atmosphere Model (CAM). Int J High Perform Comput Appl22: 206–218.
