DocumentCode :
3227371
Title :
Parallel MATLAB for Extreme Virtual Memory
Author :
Kim, Hahn ; Kepner, Jeremy ; Kahn, Crystal
Author_Institution :
MIT Lincoln Laboratory, Lexington, MA
fYear :
2005
fDate :
2005
Firstpage :
381
Lastpage :
387
Abstract :
Many DoD applications have extreme memory requirements, often with data sets larger than memory on a single computer. Such data sets can be addressed with out-of-core methods, which use memory as a "window" to view a section of the data stored on disk at a time. The Parallel Matlab for eXtreme Virtual Memory (pMatlab XVM) library adds out-of-core extensions to the Parallel Matlab (pMatlab) library. The DARPA High Productivity Computing Systems’ HPCchallenge FFT benchmark has been implemented in C+MPI, pMatlab, pMatlab hand coded for out-of-core and pMatlab XVM. We found that 1) the performance of the C+MPI and pMatlab versions were comparable; 2) the out-of-core versions deliver 80% of the performance of the in-core versions; 3) the out-of-core versions were able to perform a 1 TB (64 billion point) FFT; and 4) the pMatlab XVM program was smaller, easier to implement and verify, and more efficient than its hand coded equivalent. We plan to apply pMatlab XVM to the full HPCchallenge benchmark suite. Using next generation hardware, problems sizes a factor of 100 to 1000 times larger should be feasible. We are also transitioning this technology to several DoD signal processing applications. Finally, the flexibility of pMatlab XVM allows hardware designers to experiment with FFT parameters in software before designing hardware for a real-time, ultra-long FFT.
Keywords :
FFT; HPCS; HPCchallenge; MATLAB; outof-core; parallel programming; Application software; Concurrent computing; Hardware; Laboratories; Libraries; MATLAB; Productivity; Signal processing; Signal processing algorithms; Software design; FFT; HPCS; HPCchallenge; MATLAB; outof-core; parallel programming;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Users Group Conference, 2005
Print_ISBN :
0-7695-2496-6
Type :
conf
DOI :
10.1109/DODUGC.2005.48
Filename :
1592173
Link To Document :
بازگشت