Jonah Sherman

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2017-232

December 18, 2017

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2017/EECS-2017-232.pdf

Spielman and Teng's nearly linear time algorithm for solving Laplacian systems was a breakthrough in combining techniques from discrete and continuous optimization. In this dissertation we adapt their approach to solve more general flow problems, overcoming long-standing barriers in continuous optimization. As a result we solve longstanding open questions in optimization by presenting nearly-linear time approximation algorithms for the undirected versions of several network flow problems, including \emph{maximum flow}, \emph{optimal transportation}, \emph{maximum concurrent multi-commodity flow}, and \emph{sparsest cut} problems.

Our contributions include two general tools. The first is a scheme for boosting the performance of iterative solvers for continuous optimization problems. These boosters use recursive composition to achieve residual error that decreases exponentially in the number of iterations of the solver.

The second is a technique for designing iterative solvers that bypasses the infamous $\ell_{\infty}$ barrier for strongly convex regularization. Instead we introduce the notion of an area convex regularizer, and show that such regularizers suffice in designing good iterative solvers. Moreover, we show how to design regularizers satisfying this weaker property for the problem of approximately solving $\A X \leq \B$ over right stochastic $X$, which in turn implies the algorithm for maximum concurrent multi-commodity flow.

Advisors: Umesh Vazirani

---

BibTeX citation:

@phdthesis{Sherman:EECS-2017-232,
    Author= {Sherman, Jonah},
    Title= {New Techniques for Continuous Optimization and Fast Algorithms for Flow},
    School= {EECS Department, University of California, Berkeley},
    Year= {2017},
    Month= {Dec},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2017/EECS-2017-232.html},
    Number= {UCB/EECS-2017-232},
    Abstract= {Spielman and Teng's nearly linear time algorithm for solving Laplacian systems was a breakthrough in combining techniques from discrete and continuous optimization. In this dissertation we adapt their approach to solve more general flow problems, overcoming long-standing barriers in continuous optimization.  As a result we solve longstanding open questions in optimization by presenting nearly-linear time approximation algorithms for the undirected versions of several network flow problems, including \emph{maximum flow}, \emph{optimal transportation}, \emph{maximum concurrent multi-commodity flow}, and \emph{sparsest cut} problems.  

Our contributions include two general tools. The first is a scheme for boosting the performance of iterative solvers for continuous optimization problems. These boosters use recursive composition to achieve residual error that decreases exponentially in the number of iterations of the solver.

The second is a technique for designing iterative solvers that bypasses the infamous $\ell_{\infty}$ barrier for strongly convex regularization.  Instead we introduce the notion of an area convex regularizer, and show that such regularizers suffice in designing good iterative solvers. Moreover, we show how to design regularizers satisfying this weaker property for the problem of approximately solving $\A X \leq \B$ over right stochastic $X$, which in turn implies the algorithm for maximum concurrent multi-commodity flow.},
}

EndNote citation:

%0 Thesis
%A Sherman, Jonah 
%T New Techniques for Continuous Optimization and Fast Algorithms for Flow
%I EECS Department, University of California, Berkeley
%D 2017
%8 December 18
%@ UCB/EECS-2017-232
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2017/EECS-2017-232.html
%F Sherman:EECS-2017-232