THIS REPORT HAS BEEN WITHDRAWN

Vaishaal Shankar and Karl Krauth and Kailas Vodrahalli and Qifan Pu and Benjamin Recht and Ion Stoica and Jonathan Ragan-Kelley and Eric Jonas and Shivaram Venkataraman

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2021-3

February 19, 2021

http://www2.eecs.berkeley.edu/Pubs/TechRpts/Withdrawn/EECS-2021-3.pdf

Datacenter disaggregation provides numerous benefits to both the datacenter operator and the application designer. However switching from the server-centric model to a disaggregated model requires developing new programming abstractions that can achieve high performance while benefiting from the greater elasticity. To explore the limits of datacenter disaggregation, we study an application area that near-maximally benefits from current server-centric datacenters: dense linear algebra. We build NumPyWren, a system for linear algebra built on a disaggregated serverless programming model, and LAmbdaPACK, a companion domain-specific language designed for serverless execution of highly parallel linear algebra algorithms. We show that, for a number of linear algebra algorithms such as matrix multiply, singular value decomposition, Cholesky decomposition, and QR decomposition, NumPyWren's performance (completion time) is within a factor of 2 of optimized server-centric MPI implementations, and has up to 15% greater compute efficiency (total CPU-hours), while providing fault tolerance.

Advisors: Michael Jordan and Jonathan Ragan-Kelley

Author Comments: Wrong pdf file and author list, see this report for the updated url: http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-7.html

---