Parallel Performance Project Research Paper

Research Paper

On High-Bandwidth Data Cache Design for Multi-Issue Processors
Jude A. Rivers, Gary S. Tyson, Todd M. Austin, and Edward S. Davidson
Proceedings of the 30th IEEE/ACM International Symposium on Microarchitecture, December 1997

Abstract

Highly aggressive multi-issue processor designs of the past few years and projections for the next decade require that we redesign the operation of the cache memory sys tem. The number of instructions that must be processed (including incorrectly predicted ones) will approach 16 or more per cycle. Since memory operations account for about a third of all instructions executed, these systems will have to support multiple data references per cycle. In this paper, we explore reference stream characteristics to determine how best to meet the need for ever increasing access rates. We identify limitations of existing multi- ported cache designs and propose a new structure, the Locality-Based Interleaved Cache (LBIC), to exploit the characteristics of the data reference stream while approaching the economy of traditional multi-bank cache design. Experimental results show that the LBIC structure is capable of outperforming current multi-ported approaches.