Title :
AC compiler for large data sequential processing using remote memory
Author :
Yoshimura, Shiyo ; Midorikawa, Hiroko
Author_Institution :
Grad. Sch. of Sci. & Technol., Seikei Univ., Tokyo, Japan
Abstract :
Prevailing 64bit-OS enables us to use a large memory address space in computer programming general. However, the actual physical memory becomes the limitation in utilizing it fully. When a program requires more memory than available physical memory in a computer, a traditional virtual memory system performs the page swap between a local hard disk and physical memory. Here, with the recent development in high-speed network, remote-memory access via networks becomes faster than accessing a local hard disk. We built the Distributed Large Memory System (DLM) to access vast remote memories in networks. The DLM is designed as a user-level software for high portability. The DLM provides a very large virtual memory using remote memories distributed over cluster nodes. This paper proposes a newly designed C compiler for the DLM. It provides an easy programming interface to use the abundant memory of the DLM with existing sequential programs, instead of developing parallel programs.
Keywords :
distributed memory systems; hard discs; paged storage; program compilers; software portability; storage area networks; C compiler; computer programming; distributed large memory system; high-speed network; large data sequential processing; large memory address space; local hard disk; page swap; physical memory; programming interface; remote memory access; sequential programs; software portability; user-level software; virtual memory system; word length 64 bit; Arrays; Dynamic scheduling; Hard disks; Memory management; Program processors; Resource management; Servers;
Conference_Titel :
Communications, Computers and Signal Processing (PacRim), 2011 IEEE Pacific Rim Conference on
Conference_Location :
Victoria, BC
Print_ISBN :
978-1-4577-0252-5
Electronic_ISBN :
1555-5798
DOI :
10.1109/PACRIM.2011.6032892