June 16-20, 2013

Leipzig, Germany

Presentation Details

Name: Exploring I/O Efficiencies in Large Scale HPC Systems
Time: Monday, June 17, 2013
5:20 PM - 5:40 PM
Room:   Hall 2
CCL - Congress Center Leipzig
Speakers:   Dave Fellinger, DataDirect Networks
Abstract:   Traditionally the I/O of a cluster has been implemented through the use of “gateway” nodes which are effectively file servers. These servers are utilized to provide a layer of data management servicing both the cluster nodes and the storage. As systems grow in scale the number of nodes in this service layer can become difficult to manage and simple processes like file level locking and metadata consolidation can present large challenges in parallel architectures. A method of data service implementation will be presented that simplifies this environment by eliminating both hard and soft layers in the data transfer chain. This environment can also be used in post processing and filtering to maximize the use of the network for both the cluster and the researcher and to reduce the complexity of the HPC environment.  
Program may be subject to changes.