D3: Declarative Distributed Debugging

Byung-Gon Chun, Kuang Chen, Gunho Lee, Randy H. Katz and Scott Shenker

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2008-27
March 31, 2008

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.pdf

Large-scale distributed systems, like MapReduce, are increasingly being used, but debugging such systems is still very difficult. In this paper, we propose D3, a new debugging system that answers diverse debugging queries by processing logs formally and efficiently. D3 specifies queries concisely in a declarative language and executes the queries in a distributed fashion, thereby lowering debugging overhead and bandwidth consumed. We demonstrate the effectiveness of our D3 design on a local cluster with Hadoop, an open-source MapReduce framework.


BibTeX citation:

@techreport{Chun:EECS-2008-27,
    Author = {Chun, Byung-Gon and Chen, Kuang and Lee, Gunho and Katz, Randy H. and Shenker, Scott},
    Title = {D3: Declarative Distributed Debugging},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {2008},
    Month = {Mar},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.html},
    Number = {UCB/EECS-2008-27},
    Abstract = {Large-scale distributed systems, like MapReduce, are increasingly being used, but debugging such systems is still very difficult. In this paper, we propose D3, a new debugging system that answers diverse debugging queries by processing logs formally and efficiently. D3 specifies queries concisely in a declarative language and executes the queries in a distributed fashion, thereby lowering debugging overhead and bandwidth consumed. We demonstrate the effectiveness of our D3 design on a local cluster with Hadoop, an open-source MapReduce framework.}
}

EndNote citation:

%0 Report
%A Chun, Byung-Gon
%A Chen, Kuang
%A Lee, Gunho
%A Katz, Randy H.
%A Shenker, Scott
%T D3: Declarative Distributed Debugging
%I EECS Department, University of California, Berkeley
%D 2008
%8 March 31
%@ UCB/EECS-2008-27
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.html
%F Chun:EECS-2008-27