DocumentCode :
1918654
Title :
Poster: Distributed Metadata Management for Exascale Parallel File System
Author :
Yamamoto, Keiji ; Hori, Atsushi ; Ishikawa, Yutaka
fYear :
2012
fDate :
10-16 Nov. 2012
Firstpage :
1438
Lastpage :
1438
Abstract :
In today´s supercomputer, most file systems provide scalable I/O bandwidth. But these systems cannot concurrent creation of millions to billions of files in a single directory. Toward exascale-era, we propose scalable metadata management method by using many metadata servers. Directory entry and inode are distributed by using consistent hashing. Directory entry and inode are stored as same MDS as possible. In many case, two request of lookup dentry and inode are merged into one request. In evaluation, our file system throughput is more than 490,000 file creates per second on 64 metadata servers and 2048 clients. Concurrent file creation time of 40 million is 42 second in a single directory.
fLanguage :
English
Publisher :
ieee
Conference_Titel :
High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:
Conference_Location :
Salt Lake City, UT
Print_ISBN :
978-1-4673-6218-4
Type :
conf
DOI :
10.1109/SC.Companion.2012.242
Filename :
6496025
Link To Document :
بازگشت