Publications

@phdthesis{Monakhova:EECS-2022-177,

title = {Physics-Informed Machine Learning for Computational Imaging},

author = {Kristina Monakhova},

url = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-177.html},

year  = {2022},

date = {2022-07-01},

urldate = {2022-07-01},

number = {UCB/EECS-2022-177},

school = {EECS Department, University of California, Berkeley},

abstract = {A key aspect of many computational imaging systems, from compressive cameras to low light photography, are the algorithms used to uncover the signal from encoded or noisy measurements. Some computational cameras encode higher-dimensional information (e.g. different wavelengths of light, 3D, time) onto a 2-dimensional sensor, then use algorithms to decode and recover this high-dimensional information. Others capture measurements that are extremely noisy, or degraded, and require algorithms to extract the signal and make the images usable by people, or by higher-level downstream algorithms. In each case, the algorithms used to decode and extract information from raw measurements are critical and necessary to make computational cameras function. Over the years the predominant methods, classic methods, to recover information from computational cameras have been based on minimizing an optimization problem consisting of a data term and hand-picked prior term. More recently, deep learning has been applied to these problems, but often has no way to incorporate known optical characteristics, requires large training datasets, and results in black-box models that cannot easily be interpreted. In this dissertation, we present physics-informed machine learning for computational imaging, which is a middle ground approach that combines elements of classic methods with deep learning. We show how to incorporate knowledge of the imaging system physics into neural networks to improve image quality and performance beyond what is feasible with either classic or deep methods for several computational cameras. We show several different ways to incorporate imaging physics into neural networks, including algorithm unrolling, differentiable optical models, unsupervised methods, and through generative adversarial networks. For each of these methods, we focus on a different computational camera with unique challenges and modeling considerations. First, we introduce an unrolled, physics-informed network that improves the quality and reconstruction time of lensless cameras, improving these cameras and showing photorealistic image quality on a variety of scenes. Building up on this, we demonstrate a new reconstruction network that can improve the reconstruction time for compressive, single-shot 3D microscopy with spatially-varying blur by 1,600X, enabling interactive previewing of the scene. In cases where training data is hard to acquire, we show that an untrained physics-informed network can improve image quality for compressive single-shot video and hyperspectral imaging without the need for training data. Finally, we design a physics-informed noise generator that can realistically synthesize noise at extremely high-gain, low-light settings. Using this learned noise model, we show how we can push a camera past its typical limit and take photorealistic videos at starlight levels of illumination for the first time. Each case highlights how using physics-informed machine learning can improve computational cameras and push them to their limits.},

keywords = {},

pubstate = {published},

tppubtype = {phdthesis}

}

A key aspect of many computational imaging systems, from compressive cameras to low light photography, are the algorithms used to uncover the signal from encoded or noisy measurements. Some computational cameras encode higher-dimensional information (e.g. different wavelengths of light, 3D, time) onto a 2-dimensional sensor, then use algorithms to decode and recover this high-dimensional information. Others capture measurements that are extremely noisy, or degraded, and require algorithms to extract the signal and make the images usable by people, or by higher-level downstream algorithms. In each case, the algorithms used to decode and extract information from raw measurements are critical and necessary to make computational cameras function. Over the years the predominant methods, classic methods, to recover information from computational cameras have been based on minimizing an optimization problem consisting of a data term and hand-picked prior term. More recently, deep learning has been applied to these problems, but often has no way to incorporate known optical characteristics, requires large training datasets, and results in black-box models that cannot easily be interpreted. In this dissertation, we present physics-informed machine learning for computational imaging, which is a middle ground approach that combines elements of classic methods with deep learning. We show how to incorporate knowledge of the imaging system physics into neural networks to improve image quality and performance beyond what is feasible with either classic or deep methods for several computational cameras. We show several different ways to incorporate imaging physics into neural networks, including algorithm unrolling, differentiable optical models, unsupervised methods, and through generative adversarial networks. For each of these methods, we focus on a different computational camera with unique challenges and modeling considerations. First, we introduce an unrolled, physics-informed network that improves the quality and reconstruction time of lensless cameras, improving these cameras and showing photorealistic image quality on a variety of scenes. Building up on this, we demonstrate a new reconstruction network that can improve the reconstruction time for compressive, single-shot 3D microscopy with spatially-varying blur by 1,600X, enabling interactive previewing of the scene. In cases where training data is hard to acquire, we show that an untrained physics-informed network can improve image quality for compressive single-shot video and hyperspectral imaging without the need for training data. Finally, we design a physics-informed noise generator that can realistically synthesize noise at extremely high-gain, low-light settings. Using this learned noise model, we show how we can push a camera past its typical limit and take photorealistic videos at starlight levels of illumination for the first time. Each case highlights how using physics-informed machine learning can improve computational cameras and push them to their limits.

Michael L. Whittaker; David Ren; Colin Ophus; Yugang Zhang; Laura Waller; Benjamin Gilbert; Jillian F. Banfield

Ion complexation waves emerge at the curved interfaces of layered minerals Journal Article

In: Nature Communications volume , vol. 13, iss. 1, 2022.

Abstract | Links | BibTeX | Tags: tomography

Regina Eckert

Robust 3D Quantitative Phase Imaging PhD Thesis

EECS Department, University of California, Berkeley, 2022.

Abstract | Links | BibTeX | Tags:

@phdthesis{Eckert:EECS-2022-29,

title = {Robust 3D Quantitative Phase Imaging},

author = {Regina Eckert},

url = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-29.html},

year  = {2022},

date = {2022-05-01},

urldate = {2022-05-01},

number = {UCB/EECS-2022-29},

school = {EECS Department, University of California, Berkeley},

abstract = {Biomedical research relies upon quantitative imaging methods to measure functional and structural data about microscopic organisms. Recently-developed quantitative phase imaging (QPI) methods use jointly designed optical and computational systems to recover structural quantitative phase information for biological samples. However, these methods have not seen wide adoption in biological research because the optical systems can be difficult to use and the computational algorithms often require expert operation for consistently high-quality results. QPI systems are usually developed under a computational imaging framework, where the optical measurement system is jointly designed with the computational reconstruction algorithm. Designing QPI systems for robust and practical real-world use is often difficult, however, because each imaging and computational configuration has unique and difficult-to-quantify practical implications for the end-user. 

 

In this dissertation, I present three frameworks for increasing the robustness and practicality of computational imaging systems, and I demonstrate the usefulness of these three frameworks by applying them to 2D and 3D quantitative phase imaging systems. First, algorithmic self-calibration directly recovers imaging system parameters from data measurements, doing away with the need for extensive pre-calibration steps and ensuring greater calibration accuracy for non-ideal, real-world systems. I present a robust and efficient self-calibration algorithm for angled coherent illumination, which has enabled new QPI system designs for 2D Fourier ptychographic microscopy (FPM) and 3D intensity optical diffraction tomography (ODT) that would have otherwise been infeasible. Second, increased measurement diversity better encodes useful information across measurements, which can reduce imaging system complexity, data requirements, and computation time. I present a novel pupil-coded intensity ODT system designed to increase measurement diversity of 3D refractive index (RI) information by including joint illumination- and detection-side coding for improved volumetric RI reconstructions. Finally, physics-based machine learning uses a data-driven approach to directly optimize imaging system parameters, which can improve imaging reconstructions and build intuition for better designs of complicated computational imaging systems. I show results from a physics-based machine learning algorithm to optimize pupil coding masks for 3D RI reconstructions of thick cell clusters in the pupil-coded intensity ODT system. 

 

In addition, I provide practical methods for the design, calibration, and operation of Fourier ptychography, intensity-only ODT, and pupil-coded intensity ODT microscopes to aid in the future development of robust QPI systems. I additionally present a validation of joint system pupil recovery using FPM and a comparison of the accuracy and computational complexity of coherent light propagation models that are commonly used in 3D quantitative phase imaging. I also compare field-based 3D RI reconstructions to intensity-based RI reconstructions, concluding that the proposed pupil-coded intensity ODT system captures similarly diverse phase information to field-based ODT microscopes. 

 

Throughout this work, I demonstrate that by using the frameworks of algorithmic self-calibration, increased system measurement diversity, and physics-based machine learning for computational imaging system design, we can develop more robust quantitative phase imaging systems that are practical for real-world use.},

keywords = {},

pubstate = {published},

tppubtype = {phdthesis}

}

Biomedical research relies upon quantitative imaging methods to measure functional and structural data about microscopic organisms. Recently-developed quantitative phase imaging (QPI) methods use jointly designed optical and computational systems to recover structural quantitative phase information for biological samples. However, these methods have not seen wide adoption in biological research because the optical systems can be difficult to use and the computational algorithms often require expert operation for consistently high-quality results. QPI systems are usually developed under a computational imaging framework, where the optical measurement system is jointly designed with the computational reconstruction algorithm. Designing QPI systems for robust and practical real-world use is often difficult, however, because each imaging and computational configuration has unique and difficult-to-quantify practical implications for the end-user.

In this dissertation, I present three frameworks for increasing the robustness and practicality of computational imaging systems, and I demonstrate the usefulness of these three frameworks by applying them to 2D and 3D quantitative phase imaging systems. First, algorithmic self-calibration directly recovers imaging system parameters from data measurements, doing away with the need for extensive pre-calibration steps and ensuring greater calibration accuracy for non-ideal, real-world systems. I present a robust and efficient self-calibration algorithm for angled coherent illumination, which has enabled new QPI system designs for 2D Fourier ptychographic microscopy (FPM) and 3D intensity optical diffraction tomography (ODT) that would have otherwise been infeasible. Second, increased measurement diversity better encodes useful information across measurements, which can reduce imaging system complexity, data requirements, and computation time. I present a novel pupil-coded intensity ODT system designed to increase measurement diversity of 3D refractive index (RI) information by including joint illumination- and detection-side coding for improved volumetric RI reconstructions. Finally, physics-based machine learning uses a data-driven approach to directly optimize imaging system parameters, which can improve imaging reconstructions and build intuition for better designs of complicated computational imaging systems. I show results from a physics-based machine learning algorithm to optimize pupil coding masks for 3D RI reconstructions of thick cell clusters in the pupil-coded intensity ODT system.

In addition, I provide practical methods for the design, calibration, and operation of Fourier ptychography, intensity-only ODT, and pupil-coded intensity ODT microscopes to aid in the future development of robust QPI systems. I additionally present a validation of joint system pupil recovery using FPM and a comparison of the accuracy and computational complexity of coherent light propagation models that are commonly used in 3D quantitative phase imaging. I also compare field-based 3D RI reconstructions to intensity-based RI reconstructions, concluding that the proposed pupil-coded intensity ODT system captures similarly diverse phase information to field-based ODT microscopes.

Throughout this work, I demonstrate that by using the frameworks of algorithmic self-calibration, increased system measurement diversity, and physics-based machine learning for computational imaging system design, we can develop more robust quantitative phase imaging systems that are practical for real-world use.

Gautam Gunjala

Towards diffraction-limited short-wavelength imaging systems PhD Thesis

EECS Department, University of California, Berkeley, 2022.

Abstract | Links | BibTeX | Tags:

@phdthesis{Gunjala:EECS-2022-117,

title = {Towards diffraction-limited short-wavelength imaging systems},

author = {Gautam Gunjala},

url = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-117.html},

year  = {2022},

date = {2022-05-01},

urldate = {2022-05-01},

number = {UCB/EECS-2022-117},

school = {EECS Department, University of California, Berkeley},

abstract = {Modern applications of optics, especially those which require shorter wavelengths of light, place ever-increasing demands on the performance of optical tools and systems. Working with extreme ultraviolet, soft x-ray and hard x-ray light poses complex limitations and challenges to diagnosing and maintaining diffraction-limited performance by measuring and controlling optical aberrations. By utilizing computational methods such as optimization and machine learning, we show that some of these limitations can be circumvented without sacrificing accuracy or precision. 

 

In this work, we discuss a method for aberration measurement that is based on an analysis of speckle images acquired in situ. By using a stationary random object, our method eliminates the need for precise manufacturing and alignment of a test target. Moreover, the method provides a full, dense characterization of the optical system under test using relatively few images. The method has been successfully applied to an EUV microscope system, and is shown to be accurate to within λ/180. We also discuss a method for aberration compensation via the characterization and control of an adaptive optical element for x-ray optical systems. Adaptive x-ray optics are a relatively new technology, and our work aims to enable their use within the specifications of synchrotron beamline systems. To this end, we demonstrate the ability to experimentally predict and control the behavior of the glancing-incidence deformable mirror surface to within 2 nm rms, allowing the application of sub-wavelength corrections to an incident wavefront.},

keywords = {},

pubstate = {published},

tppubtype = {phdthesis}

}

Ruiming Cao; Michael Kellman; David Ren; Regina Eckert; Laura Waller

Self-calibrated 3D differential phase contrast microscopy with optimized illumination Journal Article

In: Biomed. Opt. Express, vol. 13, no. 3, pp. 1671–1684, 2022.

Abstract | Links | BibTeX | Tags: Discrete Fourier transforms; Illumination design; Inverse problems; LED lighting; Phase contrast; Three dimensional imaging

Yi Xue; Laura Waller; Hillel Adesnik; Nicolas Pégard

Three-dimensional multi-site random access photostimulation (3D-MAP) Journal Article

In: eLife, vol. 2022, no. 11, pp. e73266, 2022.

Links | BibTeX | Tags: 3D imaging

Vivek Boominathan; Jacob T Robinson; Laura Waller; Ashok Veeraraghavan

Recent advances in lensless imaging Journal Article

In: Optica, vol. 9, no. 1, pp. 1–16, 2022.

Abstract | Links | BibTeX | Tags: Charge coupled devices; Image processing; Imaging systems; Three dimensional imaging; Vertical cavity surface emitting lasers; X ray imaging, lensless imaging

Kyrollos Yanny; Kristina Monakhova; Richard W Shuai; Laura Waller

Deep learning for fast spatially varying deconvolution Journal Article

In: Optica, vol. 9, no. 1, pp. 96–99, 2022.

Abstract | Links | BibTeX | Tags: 3D imaging, Hyperspectral imaging; Image quality; Imaging systems; Neural networks; Reconstruction algorithms; Three dimensional reconstruction, spatially-varying

Sylvain Gigan; Ori Katz; Hilton Barbosa de Aguiar; Esben Andresen; Alexandre Aubry; Jacopo Bertolotti; Emmanuel Bossy; Dorian Bouchet; Josh Brake; Sophie Brasselet; Yaron Bromberg; Hui Cao; Thomas Chaigne; Zhongtao Cheng; Won-Shik Choi; Tomas Cizmar; Meng Cui; Vincent Curtis; Hugo Defienne; Matthias Hofer; Ryoichi Horisaki; Roarke Horstmeyer; Na Ji; Aaron LaViolette; Jerome Mertz; Christophe Moser; Allard P. Mosk; Nicolas Pégard; Rafael Piestun; Sébastien Popoff; Dave Phillips; D Psaltis; Babak Rahmani; Herve Rigneault; Stefan Rotter; Lei Tian; Ivo M Vellekoop; Laura Waller; Lihong V Wang; Timothy Weber; Sheng Xiao; Chris Xu; Alexey Yamilov; Changhuei Yang; Hasan Yılmaz

Roadmap on Wavefront Shaping and deep imaging in complex media Journal Article

In: Journal of Physics: Photonics, 2022.

Abstract | Links | BibTeX | Tags:

Yonghuan David Ren

Three-Dimensional Phase Contrast Electron Tomography For Multiple Scattering Samples PhD Thesis

EECS Department, University of California, Berkeley, 2021.

Abstract | Links | BibTeX | Tags:

@phdthesis{Ren:EECS-2021-250,

title = {Three-Dimensional Phase Contrast Electron Tomography For Multiple Scattering Samples},

author = {Yonghuan David Ren},

url = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-250.html},

year  = {2021},

date = {2021-12-01},

urldate = {2021-12-01},

number = {UCB/EECS-2021-250},

school = {EECS Department, University of California, Berkeley},

abstract = {Three-dimensional (3D) electron tomography (ET) is used to understand the structure and properties of samples, for applications in chemistry, materials science, and biology. By illuminating the sample at many tilt angles using an electron probe and modelling the image formation model, 3D information can be reconstructed at a resolution beyond the optical diffraction limit. However, as samples become thicker and more scattering, simple image formation models assuming projections or single scattering are no longer valid, causing the reconstruction quality to degrade. In this work, we develop a framework that takes the non-linear image formation process into account by modelling multiple-scattering events between the electron probe and the sample. First, the general acquisition and inverse model to recover multiple-scattering samples is introduced. We mathematically derive both the forward multi-slice scattering method as well as the gradient calculations in order to solve the inverse problem with optimization. As well, with the addition of regularization, the framework is robust against low dose tomography applications. Second, we demonstrate in simulation the validity of our method by varying different experimental parameters such as tilt angles, defocus values and dosage. Next, we test our ET framework experimentally on a multiple-scattering Montemorillonite clay, a 2D material submerged in aqueous solution and vitrified under cryogenic temperature. The results demonstrate the ability to observe the electric double layer (EDL) of this material for the first time. Last but not least, because modern electron detectors have large pixel counts and current imaging applications require large volume reconstructions, we developed a distributed computing method that can be directly applied to our framework for seeing multiple-scattering samples. Instead of solving for the 3D sample on a single computer node, we utilize tens or hundreds of nodes on a compute cluster simultaneously, with each node solving for part of the volume. As a result, both high resolution sample features and macroscopic sample topology can be visualized at the same time.},

keywords = {},

pubstate = {published},

tppubtype = {phdthesis}

}

Three-dimensional (3D) electron tomography (ET) is used to understand the structure and properties of samples, for applications in chemistry, materials science, and biology. By illuminating the sample at many tilt angles using an electron probe and modelling the image formation model, 3D information can be reconstructed at a resolution beyond the optical diffraction limit. However, as samples become thicker and more scattering, simple image formation models assuming projections or single scattering are no longer valid, causing the reconstruction quality to degrade. In this work, we develop a framework that takes the non-linear image formation process into account by modelling multiple-scattering events between the electron probe and the sample. First, the general acquisition and inverse model to recover multiple-scattering samples is introduced. We mathematically derive both the forward multi-slice scattering method as well as the gradient calculations in order to solve the inverse problem with optimization. As well, with the addition of regularization, the framework is robust against low dose tomography applications. Second, we demonstrate in simulation the validity of our method by varying different experimental parameters such as tilt angles, defocus values and dosage. Next, we test our ET framework experimentally on a multiple-scattering Montemorillonite clay, a 2D material submerged in aqueous solution and vitrified under cryogenic temperature. The results demonstrate the ability to observe the electric double layer (EDL) of this material for the first time. Last but not least, because modern electron detectors have large pixel counts and current imaging applications require large volume reconstructions, we developed a distributed computing method that can be directly applied to our framework for seeing multiple-scattering samples. Instead of solving for the 3D sample on a single computer node, we utilize tens or hundreds of nodes on a compute cluster simultaneously, with each node solving for part of the volume. As a result, both high resolution sample features and macroscopic sample topology can be visualized at the same time.

Kristina Monakhova; Vi Tran; Grace Kuo; Laura Waller

Untrained networks for compressive lensless photography Journal Article

In: Opt. Express, vol. 29, no. 13, pp. 20913–20929, 2021.

Links | BibTeX | Tags: compressive imaging, compressive photography, high speed video, hyperspectral imaging, Hyperspectral imaging; Image quality; Imaging systems; Optical imaging; Phase imaging; Three dimensional imaging, learning-based

Henry Pinkard; Hratch Baghdassarian; Adriana Mujal; Ed Roberts; Kenneth H Hu; Daniel Haim Friedman; Ivana Malenica; Taylor Shagam; Adam Fries; Kaitlin Corbin; others

Learned adaptive multiphoton illumination microscopy for large-scale immune response imaging Journal Article

In: Nature communications, vol. 12, no. 1, pp. 1–14, 2021.

Links | BibTeX | Tags: learning-based, microscopy, multiphoton

Henry Pinkard; Nico Stuurman; Ivan E Ivanov; Nicholas M Anthony; Wei Ouyang; Bin Li; Bin Yang; Mark A Tsuchida; Bryant Chhun; Grace Zhang; others

Pycro-Manager: open-source software for customized and reproducible microscope control Journal Article

In: Nature Methods, vol. 18, no. 3, pp. 226–228, 2021.

Links | BibTeX | Tags: microsopy, open-source software

Stuart Sherwin; Isvar Cordova; Ryan Miyakawa; Markus Benk; Laura Waller; Andrew Neureuther; Patrick Naulleau

Picometer sensitivity metrology for EUV absorber phase Journal Article

In: Journal of Micro/Nanopatterning, Materials, and Metrology, vol. 20, no. 3, pp. 1 – 19, 2021.

Links | BibTeX | Tags: attenuated phase-shift mask, Carbon, Contamination, Etching, EUV absorber, extreme ultraviolet, mask three-dimensional, Metrology, Modulation, Multilayers, phase measurement, Phase shift keying, photomask contamination, Reflection, Reflectivity, Reflectometry

Stuart Sherwin; Isvar A Cordova; Ryan H Miyakawa; Markus P Benk; Laura Waller; Andrew R Neureuther; Patrick Naulleau

Picometer sensitivity metrology for EUV absorber phase Journal Article

In: Journal of Micro/Nanopatterning, Materials, and Metrology, vol. 20, no. 3, pp. 1 – 19, 2021.

Grace Kuo

Exploiting Randomness in Computational Cameras and Displays PhD Thesis

EECS Department, University of California, Berkeley, 2020.

Abstract | Links | BibTeX | Tags:

@phdthesis{Kuo:EECS-2020-218,

title = {Exploiting Randomness in Computational Cameras and Displays},

author = {Grace Kuo},

url = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2020/EECS-2020-218.html},

year  = {2020},

date = {2020-12-01},

number = {UCB/EECS-2020-218},

school = {EECS Department, University of California, Berkeley},

abstract = {Despite its desirability, capturing and displaying higher dimensional content is still a novelty since image sensors and display panels are inherently 2D. A popular option is to use scanning mechanisms to sequentially capture 3D data or display content at a variety of depths. This approach is akin to directly measuring (or displaying) the content of interest, which has low computational cost but sacrifices temporal resolution and requires complex physical hardware with moving parts. The exacting specifications on the hardware make it challenging to miniaturize these optical systems for demanding applications such as neural imaging in animals or head-mounted augmented reality displays. 

 

In this dissertation, I propose moving the burden of 3D capture from hardware into computation by replacing the physical scanning mechanisms with a simple static diffuser (a transparent optical element with pseudorandom thickness) and formulating image recovery as an optimization problem. First, I highlight the versatility of the diffuser by showing that it can replace a lens to create an easy-to-assemble, compact camera that is robust to missing pixels; although the raw data is not intelligible by a human, it contains information that we extract with optimization using an efficient physically-based model of the optics. Next, I show that the randomness of the diffuser makes the system well-suited for compressed sensing; we leverage this to recover 3D volumes from a single acquisition of raw data. Additionally, I extend our lensless 3D imaging system to fluorescence microscopy and introduce a new diffuser design with improved noise performance. Finally, I show how incorporating the diffuser in a 3D holographic display expands the field-of-view, and I demonstrate state-of-the-art performance by using perceptually inspired loss functions when optimizing the display panel pattern. These results show how randomness in the optical system in conjunction with optimization-based algorithms can both improve the physical form factor and expand the capabilities of cameras, microscopes, and displays.},

keywords = {},

pubstate = {published},

tppubtype = {phdthesis}

}

Despite its desirability, capturing and displaying higher dimensional content is still a novelty since image sensors and display panels are inherently 2D. A popular option is to use scanning mechanisms to sequentially capture 3D data or display content at a variety of depths. This approach is akin to directly measuring (or displaying) the content of interest, which has low computational cost but sacrifices temporal resolution and requires complex physical hardware with moving parts. The exacting specifications on the hardware make it challenging to miniaturize these optical systems for demanding applications such as neural imaging in animals or head-mounted augmented reality displays.

In this dissertation, I propose moving the burden of 3D capture from hardware into computation by replacing the physical scanning mechanisms with a simple static diffuser (a transparent optical element with pseudorandom thickness) and formulating image recovery as an optimization problem. First, I highlight the versatility of the diffuser by showing that it can replace a lens to create an easy-to-assemble, compact camera that is robust to missing pixels; although the raw data is not intelligible by a human, it contains information that we extract with optimization using an efficient physically-based model of the optics. Next, I show that the randomness of the diffuser makes the system well-suited for compressed sensing; we leverage this to recover 3D volumes from a single acquisition of raw data. Additionally, I extend our lensless 3D imaging system to fluorescence microscopy and introduce a new diffuser design with improved noise performance. Finally, I show how incorporating the diffuser in a 3D holographic display expands the field-of-view, and I demonstrate state-of-the-art performance by using perceptually inspired loss functions when optimizing the display panel pattern. These results show how randomness in the optical system in conjunction with optimization-based algorithms can both improve the physical form factor and expand the capabilities of cameras, microscopes, and displays.

121 entries « ‹ 1 of 5 › »

Filter by Type

Filter by Author

Publications

Publications