Multimedia SPECmarks: A Performance Comparison of Multimedia Programs on Different Architectures

Hari Balakrishnan and Rahul Garg

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-96-926
December 1996

http://www2.eecs.berkeley.edu/Pubs/TechRpts/1996/CSD-96-926.pdf

The field of multimedia systems is becoming increasingly important in both the research and commercial worlds. Multimedia programs impose demanding and stringent requirements on all aspects of a computer system. However, there is a dearth of good benchmarks for such software, and there has been no rigorous performance comparison of different systems for such programs. In this paper, we describe a multimedia benchmark suite consisting of six programs and present the results of running these programs on five different systems. Our results show that in general, integer performance is not a good metric to use to predict multimedia performance. For these programs, performance on our DEC 5240 and HP 9000/730 had a high degree of correlation with SPECInt92, but varied between 48% and 118% for the DEC Alpha 3000/400 and between and 60% and 85% for the SPARCStation 20/51 we measured, relative to SPECInt92. Extensive cache simulations of three of these programs showed miss rates between less than 1% and 20% for different programs. However, based on a few microbenchmarks, we show that it is not cache behavior that causes degraded performance, but load delay cycles (on the Alpha), and inferior branch performance and software multiplication (on the Sparc).


BibTeX citation:

@techreport{Balakrishnan:CSD-96-926,
    Author = {Balakrishnan, Hari and Garg, Rahul},
    Title = {Multimedia SPECmarks:  A Performance Comparison of Multimedia Programs on Different Architectures},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {1996},
    Month = {Dec},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/1996/6210.html},
    Number = {UCB/CSD-96-926},
    Abstract = {The field of multimedia systems is becoming increasingly important in both the research and commercial worlds. Multimedia programs impose demanding and stringent requirements on all aspects of a computer system. However, there is a dearth of good benchmarks for such software, and there has been no rigorous performance comparison of different systems for such programs. In this paper, we describe a multimedia benchmark suite consisting of six programs and present the results of running these programs on five different systems. Our results show that in general, integer performance is not a good metric to use to predict multimedia performance. For these programs, performance on our DEC 5240 and HP 9000/730 had a high degree of correlation with SPECInt92, but varied between 48% and 118% for the DEC Alpha 3000/400 and between and 60% and 85% for the SPARCStation 20/51 we measured, relative to SPECInt92. Extensive cache simulations of three of these programs showed miss rates between less than 1% and 20% for different programs. However, based on a few microbenchmarks, we show that it is not cache behavior that causes degraded performance, but load delay cycles (on the Alpha), and inferior branch performance and software multiplication (on the Sparc).}
}

EndNote citation:

%0 Report
%A Balakrishnan, Hari
%A Garg, Rahul
%T Multimedia SPECmarks:  A Performance Comparison of Multimedia Programs on Different Architectures
%I EECS Department, University of California, Berkeley
%D 1996
%@ UCB/CSD-96-926
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/1996/6210.html
%F Balakrishnan:CSD-96-926