Empowering distributed workflow with the data capacitor: maximizing lustre performance across the wide area network
| Title | Empowering distributed workflow with the data capacitor: maximizing lustre performance across the wide area network |
| Publication Type | Conference Proceedings |
| Year of Publication | 2007 |
| Refereed Designation | Unknown |
| Refereed Designation | Unknown |
| Refereed Designation | Unknown |
| Refereed Designation | Unknown |
| Authors | Simms, S. C., G. G. Pike, S. Teige, B. Hammond, Y. Ma, L. L. Simms, C. Westneat, and D. A. Balog |
| Conference Name | The 2007 workshop on Service-oriented computing performance: aspects, issues, and approaches (SOCP '07) |
| Series Title | Proceedings of the 2007 workshop on Service-oriented computing performance: aspects, issues, and approaches |
| Pagination | 53-58 |
| Date Published | 06/26/2007 |
| Publisher | ACM |
| Conference Location | Monterey Bay, CA, USA |
| Publication Language | eng |
| ISBN | 978-1-59593-717-9 |
| Abstract | The Indiana University Data Capacitor is a 535 TB distributed parallel filesystem constructed for short to mid term storage of large research data sets. Spanning multiple, geographically distributed compute, storage, and visualization resources and showing unprecedented performance across the wide area network, the Data Capacitor's Lustre filesystem can be used as a powerful tool to accommodate loosely coupled, service oriented computing. In this paper we demonstrate single file/single client write performance from Oak Ridge National Laboratory to Indiana University in excess of 750 MB/s. We evaluate client parameters that will allow widely distributed services to achieve data transfer rates closely matching those of local services. Finally, we outline the tuning strategy used to maximize performance, and present the results of this tuning. |
| DOI | 10.1145/1272457.1272465 |
|
Copyright © 2012 The Trustees of Indiana University | Copyright Complaints