Handling Churn in a DHT

Sean Rhea, Dennis Geels, Timothy Roscoe and John Kubiatowicz

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-03-1299
December 2003

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2003/CSD-03-1299.pdf

This paper addresses the problem of churn -- the continuous process of node arrival and departure -- in distributed hash tables (DHTs). We demonstrate through experiment that existing DHT implementations break down at churn levels observed in deployed peer-to-peer systems, contrary to simulation-based results. We present Bamboo, a DHT that handles high levels of churn, and discuss the manner in which it does so. We show that Bamboo is able to function effectively for median node session times as short as 1.4 minutes, while using less than 900 bytes/s/node of maintenance bandwidth in a 1000-node system. This churn rate is faster than that observed in real file-sharing systems such as Gnutella, Kazaa, Napster, and Overnet. Since Bamboo's bandwidth usage scales logarithmically in the number of nodes, we expect this cost to remain within the reach of dialup modems even for very large systems. Moreover, in simulated networks without churn, Bamboo achieves lookup performance comparable with Pastry, an existing DHT with a similar structure.


BibTeX citation:

@techreport{Rhea:CSD-03-1299,
    Author = {Rhea, Sean and Geels, Dennis and Roscoe, Timothy and Kubiatowicz, John},
    Title = {Handling Churn in a DHT},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {2003},
    Month = {Dec},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2003/6360.html},
    Number = {UCB/CSD-03-1299},
    Abstract = {This paper addresses the problem of churn -- the continuous process of node arrival and departure -- in distributed hash tables (DHTs). We demonstrate through experiment that existing DHT implementations break down at churn levels observed in deployed peer-to-peer systems, contrary to simulation-based results. We present Bamboo, a DHT that handles high levels of churn, and discuss the manner in which it does so. We show that Bamboo is able to function effectively for median node session times as short as 1.4 minutes, while using less than 900 bytes/s/node of maintenance bandwidth in a 1000-node system. This churn rate is faster than that observed in real file-sharing systems such as Gnutella, Kazaa, Napster, and Overnet. Since Bamboo's bandwidth usage scales logarithmically in the number of nodes, we expect this cost to remain within the reach of dialup modems even for very large systems. Moreover, in simulated networks without churn, Bamboo achieves lookup performance comparable with Pastry, an existing DHT with a similar structure.}
}

EndNote citation:

%0 Report
%A Rhea, Sean
%A Geels, Dennis
%A Roscoe, Timothy
%A Kubiatowicz, John
%T Handling Churn in a DHT
%I EECS Department, University of California, Berkeley
%D 2003
%@ UCB/CSD-03-1299
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2003/6360.html
%F Rhea:CSD-03-1299