DocumentCode :
1994980
Title :
Introducing a Data Sliding Mechanism for Cooperative Caching in Manycore Architectures
Author :
Dahmani, Safae ; Cudennec, Loic ; Gogniat, Guy
Author_Institution :
Embedded Real Time Syst. Lab., CEA, Gif-sur-Yvette, France
fYear :
2013
fDate :
20-24 May 2013
Firstpage :
335
Lastpage :
344
Abstract :
In future micro-architectures, the increase of the number of cores and wire network complexity is leading to several performance degradation. These platforms are intended to process large amount of data. One of the biggest challenges for systems scalability is actually the memory wall: the memory latency is hardly increasing compared to technology expectations. Recent works explore potential software and hardware solutions mainly based on different caching schemes for addressing off-chip access issues. In this paper, we propose a new cooperative caching method improving the cache miss rate for many core micro-architectures. The work is motivated by some limitations of recent adaptive cooperative caching proposals. Elastic Cooperative caching (ECC), is a dynamic memory partitioning mechanism that allows sharing cache across cooperative nodes according to the application behavior. However, it is mainly limited with cache eviction rate in case of highly stressed neighborhood. Another system, the adaptive Set-Granular Cooperative Caching (ASCC), is based on finer set-based mechanisms for a better adaptability. However, heavy localized cache loads are not efficiently managed. In such a context, we propose a cooperative caching strategy that consists in sliding data through closer neighbors. When a cache receives a storing request of a neighbor´s private block, it spills the least recently used private data to a close neighbor. Thus, solicited saturated nodes slide local blocks to their respective neighbors to always provide free cache space. We also propose a new Priority-based Data Replacement policy to decide efficiently which blocks should be spilled, and a new mechanism to choose host destination called Best Neighbor selector. The first analytic performance evaluation shows that the proposed cache management policies reduce by half the average global communication rate. As frequent accesses are focused in the neighboring zones, it efficiently improves on-Chip traff- c. Finally, our evaluation shows that cache miss rate is enhanced: each tile keeps the most frequently accessed data 1-Hop close to it, instead of ejecting them Off-Chip. Proposed techniques notably reduce the cache miss rate in case of high solicitation of the cooperative zone, as it is shown in the performed experiments.
Keywords :
cache storage; granular computing; memory architecture; microprocessor chips; multiprocessing systems; ASCC; ECC; adaptive set-granular cooperative caching; application behavior; average global communication rate; best neighbor selector; cache eviction rate; cache management policies; cache miss rate improvement; cooperative nodes; data sliding mechanism; dynamic memory partitioning mechanism; elastic cooperative caching; many core microarchitectures; memory latency; off-chip access issues; on-chip traffic improvement; performance degradation; priority-based data replacement policy; set-based mechanisms; solicited saturated nodes; systems scalability; wire network complexity; Context; Cooperative caching; Distributed databases; Large Hadron Collider; Protocols; Radiation detectors; System-on-chip; Best Neighbor Selector; Cache Partitioning; Cooperative Caching; Data Sliding; Many-cores; Memory Hierarchy; Priority-Based Replacement Policy; Tiled Micro-architectures;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2013 IEEE 27th International
Conference_Location :
Cambridge, MA
Print_ISBN :
978-0-7695-4979-8
Type :
conf
DOI :
10.1109/IPDPSW.2013.205
Filename :
6650905
Link To Document :
بازگشت