Robust performance in hybrid-memory cooperative caches

• Our object placement policy (RaCC) manages cooperative caches based on DRAM + PCM.
• RaCC ranks/migrates/replaces objects in DRAM + PCM to improve the cache’s performance.
• We model and evaluate PRESS and Memcached in hybrid and non-hybrid memory systems.
• Storage device; memory performance; row-buffer + cache hit ratios affect performance.
• RaCC presents the most robust performance without increasing energy consumption.

Modern servers require large main memories, which so far have been enabled by increasing DRAM’s density. With DRAM’s scalability nearing its limit, Phase-Change Memory (PCM) is being considered as an alternative technology. PCM is denser, more scalable, and consumes lower idle power than DRAM, while exhibiting byte-addressability and access times in the nanosecond range. Still, PCM is slower than DRAM and has limited endurance. These characteristics prompted the study of hybrid memory systems, combining a small amount of DRAM and a large amount of PCM. In this paper, we leverage hybrid memories to improve the performance of cooperative memory caches in server clusters. Our approach entails a novel policy that exploits popularity information in placing objects across servers and memory technologies. Our results show that (1) DRAM-only and PCM-only memory systems do not perform well in all cases; and (2) when managed properly, hybrid memories always exhibit the best or close-to-best performance, with significant gains in many cases, without increasing energy consumption.