Windsor W. Hsu, Alan Jay Smith and Honesty C. Young

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-99-1071
November 1999

http://www2.eecs.berkeley.edu/Pubs/TechRpts/1999/CSD-99-1071.pdf

As improvements in processor performance continue to far outpace improvements in storage performance, I/O is increasingly the bottleneck in computer systems, especially in large database systems that manage huge amounts of data. The key to achieving good I/O performance is to thoroughly understand its characteristics. In this paper, we present a comprehensive analysis of the logical I/O reference behavior of the peak production database workloads from ten of the world's largest corporations by focusing on how these workloads respond to different techniques for caching, prefetching and write buffering. Our findings include several broadly applicable rules of thumb that describe how effective the various I/O optimization techniques are for the production workloads. For instance, our results indicate that the buffer pool miss ratio tends to be related to the ratio of buffer pool size to data size by an inverse square root rule. A similar fourth root rule relates the write miss ratio and the ratio of buffer pool size to data size.

In addition, we characterize the reference characteristics of workloads similar to the Transaction Processing Performance Council (TPC) benchmarks C (TPC-C) and D (TPC-D), which are de facto standard performance measures for on-line transaction processing (OLTP) systems and decision support systems (DSS) respectively. Since benchmarks such as TPC-C and TPC-D can only be used effectively if their strengths and limitations are understood, a major focus of our analysis is on identifying aspects of the benchmarks that stress the system differently than the production workloads. We discover that for the most part, the reference behavior of TPC-C and TPC-D fall within the range of behavior exhibited by the production workloads. However, there are some noteworthy exceptions that affect well-known I/O optimization techniques such as caching (LRU is further from the optimal for TPC-C while there is little sharing of pages between transactions for TPC-D), prefetching (TPC-C exhibits no significant sequentiality) and write buffering (write buffering is less effective for the TPC benchmarks). While the two TPC benchmarks generally complement one another in reflecting the characteristics of the production workloads, there remain aspects of the real workloads that are not represented by either of the benchmarks.

BibTeX citation:

@techreport{Hsu:CSD-99-1071,
    Author = {Hsu, Windsor W. and Smith, Alan Jay and Young, Honesty C.},
    Title = {I/O Reference Behavior of Production Database Workloads and the TPC Benchmarks - An Analysis at the Logical Level},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {1999},
    Month = {Nov},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/1999/5710.html},
    Number = {UCB/CSD-99-1071},
    Abstract = {As improvements in processor performance continue to far outpace improvements in storage performance, I/O is increasingly the bottleneck in computer systems, especially in large database systems that manage huge amounts of data. The key to achieving good I/O performance is to thoroughly understand its characteristics. In this paper, we present a comprehensive analysis of the logical I/O reference behavior of the peak production database workloads from ten of the world's largest corporations by focusing on how these workloads respond to different techniques for caching, prefetching and write buffering. Our findings include several broadly applicable rules of thumb that describe how effective the various I/O optimization techniques are for the production workloads. For instance, our results indicate that the buffer pool miss ratio tends to be related to the ratio of buffer pool size to data size by an inverse square root rule. A similar fourth root rule relates the write miss ratio and the ratio of buffer pool size to data size. <p>In addition, we characterize the reference characteristics of workloads similar to the Transaction Processing Performance Council (TPC) benchmarks C (TPC-C) and D (TPC-D), which are de facto standard performance measures for on-line transaction processing (OLTP) systems and decision support systems (DSS) respectively. Since benchmarks such as TPC-C and TPC-D can only be used effectively if their strengths and limitations are understood, a major focus of our analysis is on identifying aspects of the benchmarks that stress the system differently than the production workloads. We discover that for the most part, the reference behavior of TPC-C and TPC-D fall within the range of behavior exhibited by the production workloads. However, there are some noteworthy exceptions that affect well-known I/O optimization techniques such as caching (LRU is further from the optimal for TPC-C while there is little sharing of pages between transactions for TPC-D), prefetching (TPC-C exhibits no significant sequentiality) and write buffering (write buffering is less effective for the TPC benchmarks). While the two TPC benchmarks generally complement one another in reflecting the characteristics of the production workloads, there remain aspects of the real workloads that are not represented by either of the benchmarks.}
}

EndNote citation:

%0 Report
%A Hsu, Windsor W.
%A Smith, Alan Jay
%A Young, Honesty C.
%T I/O Reference Behavior of Production Database Workloads and the TPC Benchmarks - An Analysis at the Logical Level
%I EECS Department, University of California, Berkeley
%D 1999
%@ UCB/CSD-99-1071
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/1999/5710.html
%F Hsu:CSD-99-1071