Byung-Gon Chun and Kuang Chen and Gunho Lee and Randy H. Katz and Scott Shenker

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2008-27

March 31, 2008

Large-scale distributed systems, like MapReduce, are increasingly being used, but debugging such systems is still very difficult. In this paper, we propose D3, a new debugging system that answers diverse debugging queries by processing logs formally and efficiently. D3 specifies queries concisely in a declarative language and executes the queries in a distributed fashion, thereby lowering debugging overhead and bandwidth consumed. We demonstrate the effectiveness of our D3 design on a local cluster with Hadoop, an open-source MapReduce framework.

---

BibTeX citation:

@techreport{Chun:EECS-2008-27,
    Author= {Chun, Byung-Gon and Chen, Kuang and Lee, Gunho and Katz, Randy H. and Shenker, Scott},
    Title= {D3: Declarative Distributed Debugging},
    Year= {2008},
    Month= {Mar},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.html},
    Number= {UCB/EECS-2008-27},
    Abstract= {Large-scale distributed systems, like MapReduce, are increasingly being used, but debugging such systems is still very difficult. In this paper, we propose D3, a new debugging system that answers diverse debugging queries by processing logs formally and efficiently. D3 specifies queries concisely in a declarative language and executes the queries in a distributed fashion, thereby lowering debugging overhead and bandwidth consumed. We demonstrate the effectiveness of our D3 design on a local cluster with Hadoop, an open-source MapReduce framework.},
}

EndNote citation:

%0 Report
%A Chun, Byung-Gon 
%A Chen, Kuang 
%A Lee, Gunho 
%A Katz, Randy H. 
%A Shenker, Scott 
%T D3: Declarative Distributed Debugging
%I EECS Department, University of California, Berkeley
%D 2008
%8 March 31
%@ UCB/EECS-2008-27
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.html
%F Chun:EECS-2008-27