Byung-Gon Chun, Kuang Chen, Gunho Lee, Randy H. Katz and Scott Shenker
EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2008-27
March 31, 2008
http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.pdf
Large-scale distributed systems, like MapReduce, are increasingly being used, but debugging such systems is still very difficult. In this paper, we propose D3, a new debugging system that answers diverse debugging queries by processing logs formally and efficiently. D3 specifies queries concisely in a declarative language and executes the queries in a distributed fashion, thereby lowering debugging overhead and bandwidth consumed. We demonstrate the effectiveness of our D3 design on a local cluster with Hadoop, an open-source MapReduce framework.
BibTeX citation:
@techreport{Chun:EECS-2008-27, Author = {Chun, Byung-Gon and Chen, Kuang and Lee, Gunho and Katz, Randy H. and Shenker, Scott}, Title = {D3: Declarative Distributed Debugging}, Institution = {EECS Department, University of California, Berkeley}, Year = {2008}, Month = {Mar}, URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.html}, Number = {UCB/EECS-2008-27}, Abstract = {Large-scale distributed systems, like MapReduce, are increasingly being used, but debugging such systems is still very difficult. In this paper, we propose D3, a new debugging system that answers diverse debugging queries by processing logs formally and efficiently. D3 specifies queries concisely in a declarative language and executes the queries in a distributed fashion, thereby lowering debugging overhead and bandwidth consumed. We demonstrate the effectiveness of our D3 design on a local cluster with Hadoop, an open-source MapReduce framework.} }
EndNote citation:
%0 Report %A Chun, Byung-Gon %A Chen, Kuang %A Lee, Gunho %A Katz, Randy H. %A Shenker, Scott %T D3: Declarative Distributed Debugging %I EECS Department, University of California, Berkeley %D 2008 %8 March 31 %@ UCB/EECS-2008-27 %U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-27.html %F Chun:EECS-2008-27