Sameer Pawar

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2013-215

December 17, 2013

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-215.pdf

An emerging challenge in recent years for engineers, researchers, and data scientists across the globe is to acquire, store, and analyze ever-increasing amounts of data. In the past decade, a new paradigm in data acquisition called ``compressed-sensing" has emerged to cope with this data explosion. Compressed sensing exploits the fact that in many applications, although the signal of interest has a large ambient dimension, the relevant information resides in a significantly lower dimensional space. For example, the Magnetic-Resonance-Imaging (MRI) data is sparse in the wavelet-domain. In this thesis, we consider the problem of computing a sparse Discrete-Fourier-Transform of a high-dimensional signal from its time-domain samples, as a representative example of compressed-sensing problems. We use this problem to investigate the tradeoff between the number of measurements, noise robustness, and the computational complexity of the recovery algorithm in compressed sensing problems.

We propose a new family of deterministic sparse sensing matrices, obtained by blending together diverse ideas from sparse graph codes, digital signal processing, and number-theoretic concepts like the Chinese-remainder-theorem (CRT). The specific sparse structure of the proposed family of measurement matrices further enables a Peeling-based Ultra-Low complexity algorithms for Sparse signal Estimation, that are accordingly dubbed PULSE algorithms. Further, using the CRT, we establish an intimate connection between the problem of computing a sparse DFT of a signal and decoding over an appropriately designed sparse graph code. This connection is then exploited 1) to design a sample efficient measurement matrix and a low-complexity peeling-style iterative recovery algorithm, and 2) to perform a rigorous analysis of the recovery algorithm by wielding powerful and well-established analytical tools like density-evolution, martingales, and expander graphs from the coding theory literature. In particular, we show that under some mild conditions a k-sparse n-length DFT of a signal can be computed using (nearly optimal) 4k measurements and O(k log k) computations. As a concrete example, when k=300, and n = 3.8 x 10^6, our algorithm achieves computational savings by a factor of more than 6000, and savings in the number of input samples by a factor of more than 3900 over the standard Fast-Fourier-Transform (FFT) algorithms. This can be a significant advantage in many existing applications and can enable new classes of applications that were not thought to be practical so far. Next, we extend these results to the case of noise-corrupted samples, computing sparse 2D-DFTs as well as to interpolation of multi-variate sparse polynomials over the complex field and finite fields. We also demonstrate an application of the proposed PULSE algorithm to acquire the Magnetic-Resonance-Imaging of the Brain. This provides some empirical evidence that PULSE algorithms are applicable for acquiring more realistic signals. The proposed sensing framework and the recovery algorithm are sample efficient and robust against observation noise. We believe that this framework provides a possible direction towards designing efficient and low-power engineering solutions for sparse signal acquisition.

Advisors: Kannan Ramchandran

---

BibTeX citation:

@phdthesis{Pawar:EECS-2013-215,
    Author= {Pawar, Sameer},
    Title= {PULSE: Peeling-based Ultra-Low complexity algorithms for Sparse signal Estimation},
    School= {EECS Department, University of California, Berkeley},
    Year= {2013},
    Month= {Dec},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-215.html},
    Number= {UCB/EECS-2013-215},
    Abstract= {An emerging challenge in recent years for engineers, researchers, and data scientists across the globe is to acquire, store, and analyze ever-increasing amounts of data. In the past decade, a new paradigm in data acquisition called ``compressed-sensing" has emerged to cope with this data explosion. Compressed sensing exploits the fact that in many applications, although the signal of interest has a large ambient dimension, the relevant information resides in a significantly lower dimensional space. For example, the Magnetic-Resonance-Imaging (MRI) data is sparse in the wavelet-domain. In this thesis, we consider the problem of computing a sparse Discrete-Fourier-Transform of a high-dimensional signal from its time-domain samples, as a representative example of compressed-sensing problems. We use this problem to investigate the tradeoff between the number of measurements, noise robustness, and the computational complexity of the recovery algorithm in compressed sensing problems. 

We propose a new family of deterministic sparse sensing matrices, obtained by blending together  diverse ideas from sparse graph codes, digital signal processing, and number-theoretic concepts like the Chinese-remainder-theorem (CRT). The specific sparse structure of the proposed family of measurement matrices further enables a Peeling-based Ultra-Low complexity algorithms for Sparse signal Estimation, that are accordingly dubbed PULSE algorithms. Further, using the CRT, we establish an intimate connection between the problem of computing a sparse DFT of a signal and decoding over an appropriately designed sparse graph code. This connection is then exploited 1) to design a sample efficient measurement matrix and a low-complexity peeling-style iterative recovery algorithm, and 2) to perform a rigorous analysis of the recovery algorithm by wielding powerful and well-established analytical tools like density-evolution, martingales, and expander graphs from the coding theory literature. In particular, we show that under some mild conditions a k-sparse n-length DFT of a signal can be computed using (nearly optimal) 4k measurements and O(k log k) computations. As a concrete example, when k=300, and n = 3.8 x 10^6, our algorithm achieves computational savings by a factor of more than 6000, and savings in the number of input samples by a factor of more than 3900 over the standard Fast-Fourier-Transform (FFT) algorithms. This can be a significant advantage in many existing applications and can enable new classes of applications that were not thought to be practical so far. Next, we extend these results to the case of noise-corrupted samples, computing sparse 2D-DFTs as well as to interpolation of multi-variate sparse polynomials over the complex field and finite fields. We also demonstrate an application of the proposed PULSE algorithm to acquire the Magnetic-Resonance-Imaging of the Brain. This provides some empirical evidence that PULSE algorithms are applicable for acquiring more realistic signals. The proposed sensing framework and the recovery algorithm are sample efficient and robust against observation noise. We believe that this framework provides a possible direction towards designing efficient and low-power engineering solutions for sparse signal acquisition.},
}

EndNote citation:

%0 Thesis
%A Pawar, Sameer 
%T PULSE: Peeling-based Ultra-Low complexity algorithms for Sparse signal Estimation
%I EECS Department, University of California, Berkeley
%D 2013
%8 December 17
%@ UCB/EECS-2013-215
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-215.html
%F Pawar:EECS-2013-215