Computer Science – Distributed – Parallel – and Cluster Computing
Scientific paper
2003-06-11
Computer Science
Distributed, Parallel, and Cluster Computing
10 pages,7 figures
Scientific paper
Dataset storage, exchange, and access play a critical role in scientific applications. For such purposes netCDF serves as a portable and efficient file format and programming interface, which is popular in numerous scientific application domains. However, the original interface does not provide an efficient mechanism for parallel data storage and access. In this work, we present a new parallel interface for writing and reading netCDF datasets. This interface is derived with minimum changes from the serial netCDF interface but defines semantics for parallel access and is tailored for high performance. The underlying parallel I/O is achieved through MPI-IO, allowing for dramatic performance gains through the use of collective I/O optimizations. We compare the implementation strategies with HDF5 and analyze both. Our tests indicate programming convenience and significant I/O performance improvement with this parallel netCDF interface.
Choudhary Alok
Gropp William
Latham Rob
Li Jianwei
Liao Wei-keng
No associations
LandOfFree
Parallel netCDF: A Scientific High-Performance I/O Interface does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Parallel netCDF: A Scientific High-Performance I/O Interface, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Parallel netCDF: A Scientific High-Performance I/O Interface will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-408088