Single-Shot 3D Microscopy: Optics and Algorithms Co-Design
Linda Liu
EECS Department, University of California, Berkeley
Technical Report No. UCB/EECS-2022-224
September 7, 2022
http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-224.pdf
Computational imaging involves simultaneously designing optical hardware and reconstruction software. Such a co-design framework brings together the best of both worlds for an imaging system. The goal is to develop a high-speed, high-resolution, and large field-of-view microscope that can detect 3D fluorescence signals from single image acquisition. To achieve this goal, I propose a new method called Fourier DiffuserScope, a single-shot 3D fluorescent microscope that uses a phase mask (i.e., a diffuser with random microlenses) in the Fourier plane to encode 3D information, then computationally reconstructs the volume by solving a sparsity-constrained inverse problem.
In this dissertation, I will discuss the design principles of the Fourier DiffuserScope from three perspectives: first-principles optics, compressed sensing theory, and physics-based machine learning. First, in the heuristic design, the phase mask consists of randomly placed microlenses with varying focal lengths; the random positions provide a larger field-of-view compared to a conventional microlens array, and the diverse focal lengths improve the axial depth range. I then build an experimental system that achieves less than 3 um lateral and 4 um axial resolution over a 1000x1000x280 um^3 volume. Lastly, we use a differentiable forward model of Fourier DiffuserScope in conjunction with a differentiable reconstruction algorithm to jointly optimize both the phase mask surface profile and the reconstruction parameters. We validate our method in 2D and 3D single-shot imaging, where the optimized diffuser demonstrates improved reconstruction quality compared to previous heuristic designs.
Advisors: Laura Waller
BibTeX citation:
@phdthesis{Liu:EECS-2022-224, Author= {Liu, Linda}, Title= {Single-Shot 3D Microscopy: Optics and Algorithms Co-Design}, School= {EECS Department, University of California, Berkeley}, Year= {2022}, Month= {Sep}, Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-224.html}, Number= {UCB/EECS-2022-224}, Abstract= {Computational imaging involves simultaneously designing optical hardware and reconstruction software. Such a co-design framework brings together the best of both worlds for an imaging system. The goal is to develop a high-speed, high-resolution, and large field-of-view microscope that can detect 3D fluorescence signals from single image acquisition. To achieve this goal, I propose a new method called Fourier DiffuserScope, a single-shot 3D fluorescent microscope that uses a phase mask (i.e., a diffuser with random microlenses) in the Fourier plane to encode 3D information, then computationally reconstructs the volume by solving a sparsity-constrained inverse problem. In this dissertation, I will discuss the design principles of the Fourier DiffuserScope from three perspectives: first-principles optics, compressed sensing theory, and physics-based machine learning. First, in the heuristic design, the phase mask consists of randomly placed microlenses with varying focal lengths; the random positions provide a larger field-of-view compared to a conventional microlens array, and the diverse focal lengths improve the axial depth range. I then build an experimental system that achieves less than 3 um lateral and 4 um axial resolution over a 1000x1000x280 um^3 volume. Lastly, we use a differentiable forward model of Fourier DiffuserScope in conjunction with a differentiable reconstruction algorithm to jointly optimize both the phase mask surface profile and the reconstruction parameters. We validate our method in 2D and 3D single-shot imaging, where the optimized diffuser demonstrates improved reconstruction quality compared to previous heuristic designs.}, }
EndNote citation:
%0 Thesis %A Liu, Linda %T Single-Shot 3D Microscopy: Optics and Algorithms Co-Design %I EECS Department, University of California, Berkeley %D 2022 %8 September 7 %@ UCB/EECS-2022-224 %U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-224.html %F Liu:EECS-2022-224