Spatial- and Fourier-domain ptychography for high-throughput bio-imaging

Bin Feng, Shaowei Jiang, Pengming Song, Tianbo Wang, Liming Yang, Ruihai Wang, Chengfei Guo, Andrew Maiden, Guoan Zheng

Published: 2023-05-28 DOI: 10.1038/s41596-023-00829-4

high-throughput

bio-imaging

ptychography

Fourier-domain

spatial-domain

AI 解读

Publisher Correction: A practical guide to large-scale docking

Thrombin generation test based on a 96-channel pipettor for evaluation of FXIa procoagulant activity in pharmaceuticals

Universal platform for the generation of thermostabilized GPCRs that crystallize in LCP

Probing the free-state solution behavior of drugs and their tendencies to self-aggregate into nano-entities

Fabrication and use of silicon hollow-needle arrays to achieve tissue nanotransfection in mouse tissue in vivo

Use of stable isotope-tagged thymidine and multi-isotope imaging mass spectrometry (MIMS) for quantification of human cardiomyocyte division

Graphene- and metal-induced energy transfer for single-molecule imaging and live-cell nanoscopy with (sub)-nanometer axial resolution

Analyzing somatic mutations by single-cell whole-genome sequencing

Transcriptome-wide measurement of poly(A) tail length and composition at subnanogram total RNA sensitivity by PAIso-seq

3D human induced pluripotent stem cell–derived bioengineered skeletal muscles for tissue, disease and therapy modeling

查看全部

Sections

Figures

References

First envisioned for determining crystalline structures, ptychography has become a useful imaging tool for microscopists. However, ptychography remains underused by biomedical researchers due to its limited resolution and throughput in the visible light r
Introduction
Materials for Procedure 1: FP
Materials for Procedure 2: spatial-domain CP
Procedure 1: FP
Procedure 2: spatial-domain CP
Troubleshooting
Timing
- Procedure 1: FP
- Procedure 2: Spatial-domain CP
Anticipated results
References
ACKNOWLEDGMENTS

Zheng, G., Horstmeyer, R. & Yang, C. Wide-field, high-resolution Fourier ptychographic microscopy. Nat. Photonics 7, 739 (2013).
Sayre, D. Some implications of a theorem due to Shannon. Acta Crystallogr. 5, 843–843 (1952).
Hoppe, W. Diffraction in inhomogeneous primary wave fields. 1. Principle of phase determination from electron diffraction interference. Acta Crystallogr 25, 495–501 (1969).
Guizar-Sicairos, M. & Thibault, P. Ptychography: a solution to the phase problem. Phys. Today 74, 42–48 (2021).
Faulkner, H. M. L. & Rodenburg, J. Movable aperture lensless transmission microscopy: a novel phase retrieval algorithm. Phys. Rev. Lett. 93, 023903 (2004).
Rodenburg, J. & Maiden, A. in Springer Handbook of Microscopy 819–904 (Springer, 2019).
Wang, T. et al. Optical ptychography for biomedical imaging: recent progress and future directions. Biomed. Opt. Express 14, 489–532 (2023).
Loetgering, L., Witte, S. & Rothhardt, J. Advances in laboratory-scale ptychography using high harmonic sources. Opt. Express 30, 4133–4164 (2022).
Pfeiffer, F. X-ray ptychography. Nat. Photonics 12, 9–17 (2018).
Jiang, Y. et al. Electron ptychography of 2D materials to deep sub-ångström resolution. Nature 559, 343–349 (2018).
Jiang, S. et al. Resolution-enhanced parallel coded ptychography for high-throughput optical imaging. ACS Photonics 8, 3261–3271 (2021).
Jiang, S. et al. High-throughput digital pathology via a handheld, multiplexed, and AI-powered ptychographic whole slide scanner. Lab Chip 22, 2657–2670 (2022).
Jiang, S. et al. Blood-coated sensor for high-throughput ptychographic cytometry on a Blu-ray disc. ACS Sens. 7, 1058–1067 (2022).
Jiang, S. et al. Ptychographic sensor for large-scale lensless microbial monitoring with high spatiotemporal resolution. Biosens. Bioelectron. 196, 113699 (2022).
Zheng, G., Shen, C., Jiang, S., Song, P. & Yang, C. Concept, implementations and applications of Fourier ptychography. Nat. Rev. Phys. 3, 207–223 (2021).
Pan, A., Zuo, C. & Yao, B. High-resolution and large field-of-view Fourier ptychographic microscopy and its applications in biomedicine. Rep. Prog. Phys. 83, 096101 (2020).
Konda, P. C. et al. Fourier ptychography: current applications and future promises. Opt. Express 28, 9603–9630 (2020).
Guo, K., Dong, S. & Zheng, G. Fourier ptychography for brightfield, phase, darkfield, reflective, multi-slice, and fluorescence imaging. IEEE J. Sel. Top. Quantum Electron. 22, 77–88 (2015).
Horstmeyer, R., Chung, J., Ou, X., Zheng, G. & Yang, C. Diffraction tomography with Fourier ptychography. Optica 3, 827–835 (2016).
Zuo, C., Sun, J., Li, J., Asundi, A. & Chen, Q. Wide-field high-resolution 3D microscopy with Fourier ptychographic diffraction tomography. Opt. Lasers Eng. 128, 106003 (2020).
Dong, S. et al. Aperture-scanning Fourier ptychography for 3D refocusing and super-resolution macroscopic imaging. Opt. Express 22, 13586–13599 (2014).
Holloway, J., Wu, Y., Sharma, M. K., Cossairt, O. & Veeraraghavan, A. SAVI: synthetic apertures for long-range, subdiffraction-limited visible imaging using Fourier ptychography. Sci. Adv. 3, e1602564 (2017).
Zhang, H. et al. Near-field Fourier ptychography: super-resolution phase retrieval via speckle illumination. Opt. Express 27, 7498–7512 (2019).
Xiang, M. et al. Coherent synthetic aperture imaging for visible remote sensing via reflective Fourier ptychography. Opt. Lett. 46, 29–32 (2021).
Wakonig, K. et al. X-ray Fourier ptychography. Sci. Adv. 5, eaav0282 (2019).
Zhang, F., Pedrini, G. & Osten, W. Phase retrieval of arbitrary complex-valued fields through aperture-plane modulation. Phys. Rev. A 75, 043805 (2007).
Maiden, A. M., Rodenburg, J. M. & Humphry, M. J. Optical ptychography: a practical implementation with useful resolution. Opt. Lett. 35, 2585–2587 (2010).
Song, P. et al. Super-resolution microscopy via ptychographic structured modulation of a diffuser. Opt. Lett. 44, 3645–3648 (2019).
Thibault, P. & Menzel, A. Reconstructing state mixtures from diffraction measurements. Nature 494, 68–71 (2013).
Batey, D. J., Claus, D. & Rodenburg, J. M. Information multiplexing in ptychography. Ultramicroscopy 138, 13–21 (2014).
Song, P. et al. Super-resolved multispectral lensless microscopy via angle-tilted, wavelength-multiplexed ptychographic modulation. Opt. Lett. 45, 3486–3489 (2020).
Shu, Y. et al. Adaptive optical quantitative phase imaging based on annular illumination Fourier ptychographic microscopy. PhotoniX 3, 1–15 (2022).
Thibault, P., Dierolf, M., Bunk, O., Menzel, A. & Pfeiffer, F. Probe retrieval in ptychographic coherent diffractive imaging. Ultramicroscopy 109, 338–343 (2009).
Guizar-Sicairos, M. & Fienup, J. R. Phase retrieval with transverse translation diversity: a nonlinear optimization approach. Opt. Express 16, 7264–7278 (2008).
Maiden, A. M. & Rodenburg, J. M. An improved ptychographical phase retrieval algorithm for diffractive imaging. Ultramicroscopy 109, 1256–1262 (2009).
Ou, X., Zheng, G. & Yang, C. Embedded pupil function recovery for Fourier ptychographic microscopy. Opt. Express 22, 4960–4972 (2014).
Song, P. et al. Full-field Fourier ptychography (FFP): spatially varying pupil modeling and its application for rapid field-dependent aberration metrology. APL Photonics 4, 050802 (2019).
Gustafsson, M. G. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. J. Microsc. 198, 82–87 (2000).
Liang, M. & Yang, C. Implementation of free-space Fourier ptychography with near maximum system numerical aperture. Opt. Express 30, 20321–20332 (2022).
Schiske, P. Image reconstruction by means of focus series. In Proc. 4th European Conference on Electron Microscopy, Rome, Italy (Tipografia poliglotta, 1968).
Bao, P., Zhang, F., Pedrini, G. & Osten, W. Phase retrieval using multiple illumination wavelengths. Opt. Lett. 33, 309–311 (2008).
Greenbaum, A. & Ozcan, A. Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy. Opt. Express 20, 3129–3143 (2012).
Luo, W., Zhang, Y., Feizi, A., Göröcs, Z. & Ozcan, A. Pixel super-resolution using wavelength scanning. Light Sci. Appl. 5, e16060–e16060 (2016).
Zuo, C. et al. Transport of intensity equation: a tutorial. Opt. Lasers Eng. 135, 106187 (2020).
Fienup, J. R. Phase retrieval algorithms: a comparison. Appl. Opt. 21, 2758–2769 (1982).
Bishara, W., Su, T.-W., Coskun, A. F. & Ozcan, A. Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution. Opt. Express 18, 11181–11191 (2010).
Xu, W., Jericho, M., Meinertzhagen, I. & Kreuzer, H. Digital in-line holography for biological applications. Proc. Natl Acad. Sci. USA 98, 11301–11305 (2001).
Guo, C. et al. Quantitative multi-height phase retrieval via a coded image sensor. Biomed. Opt. Express 12, 7173–7184 (2021).
Abels, E. & Pantanowitz, L. Current state of the regulatory trajectory for whole slide imaging devices in the USA. J. Pathol. Inform. 8, 23 (2017).
Bian, Z. et al. Autofocusing technologies for whole slide imaging and automated microscopy. J. Biophotonics 13, e202000227 (2020).
Wang, T. et al. Remote referencing strategy for high-resolution coded ptychographic imaging. Opt. Lett. 48, 485–488 (2023).
Chan, A. C. et al. Parallel Fourier ptychographic microscopy for high-throughput screening with 96 cameras (96 eyes). Sci. Rep. 9, 1–12 (2019).
Wakefield, D. L. et al. Cellular analysis using label-free parallel array microscopy with Fourier ptychography. Biomed. Opt. Express 13, 1312–1327 (2022).
Li, P. & Maiden, A. Lensless LED matrix ptychographic microscope: problems and solutions. Appl. Opt. 57, 1800–1806 (2018).
Horstmeyer, R., Ou, X., Zheng, G., Willems, P. & Yang, C. Digital pathology with Fourier ptychography. Comput. Med. Imaging Graph. 42, 38–43 (2015).
Williams, A. J. et al. Fourier ptychographic microscopy for filtration-based circulating tumor cell enumeration and analysis. J. Biomed. Opt. 19, 066007 (2014).
Chen, J. et al. Rapid full-color Fourier ptychographic microscopy via spatially filtered color transfer. Photonics Res. 10, 2410–2421 (2022).
Ou, X., Horstmeyer, R., Yang, C. & Zheng, G. Quantitative phase imaging via Fourier ptychographic microscopy. Opt. Lett. 38, 4845–4848 (2013).
Jiang, S. et al. Wide-field, high-resolution lensless on-chip microscopy via near-field blind ptychographic modulation. Lab Chip 20, 1058–1065 (2020).
Sun, J., Zuo, C., Zhang, J., Fan, Y. & Chen, Q. High-speed Fourier ptychographic microscopy based on programmable annular illuminations. Sci. Rep. 8, 1–12 (2018).
Tian, L. et al. Computational illumination for high-speed in vitro Fourier ptychographic microscopy. Optica 2, 904–911 (2015).
Chowdhury, S. et al. High-resolution 3D refractive index microscopy of multiple-scattering samples from intensity images. Optica 6, 1211–1219 (2019).
Guo, C. et al. Depth-multiplexed ptychographic microscopy for high-throughput imaging of stacked bio-specimens on a chip. Biosens. Bioelectron. 224, 115049 (2023).
Chung, J., Ou, X., Kulkarni, R. P. & Yang, C. Counting white blood cells from a blood smear using Fourier ptychographic microscopy. PloS ONE 10, e0133489 (2015).
Song, P. et al. Optofluidic ptychography on a chip. Lab Chip 21, 4549–4556 (2021).
Maiden, A. M., Humphry, M. J. & Rodenburg, J. Ptychographic transmission microscopy in three dimensions using a multi-slice approach. J. Opt. Soc. Am. A 29, 1606–1614 (2012).
Dong, S., Nanda, P., Shiradkar, R., Guo, K. & Zheng, G. High-resolution fluorescence imaging via pattern-illuminated Fourier ptychography. Opt. Express 22, 20856–20870 (2014).
Guo, K. et al. 13-fold resolution gain through turbid layer via translated unknown speckle illumination. Biomed. Opt. Express 9, 260–275 (2018).
Yeh, L.-H., Chowdhury, S. & Waller, L. Computational structured illumination for high-content fluorescence and phase microscopy. Biomed. Opt. Express 10, 1978–1998 (2019).
Dong, S., Nanda, P., Guo, K., Liao, J. & Zheng, G. Incoherent Fourier ptychographic photography using structured light. Photonics Res. 3, 19–23 (2015).
Ou, X., Horstmeyer, R., Zheng, G. & Yang, C. High numerical aperture Fourier ptychography: principle, implementation and characterization. Opt. Express 23, 3472–3491 (2015).
Sun, J., Zuo, C., Zhang, L. & Chen, Q. Resolution-enhanced Fourier ptychographic microscopy based on high-numerical-aperture illuminations. Sci. Rep. 7, 1–11 (2017).
Zheng, G. Fourier Ptychographic Imaging: A Matlab Tutorial (Morgan & Claypool Publishers, 2016).
Phillips, Z. F., Eckert, R. & Waller, L. Quasi-dome: a self-calibrated high-NA LED illuminator for Fourier ptychography. In Imaging Systems and Applications (Optica Publishing Group, 2017).
Pan, A. et al. Subwavelength resolution Fourier ptychography with hemispherical digital condensers. Opt. Express 26, 23119–23131 (2018).
Guo, K., Dong, S., Nanda, P. & Zheng, G. Optimization of sampling pattern and the design of Fourier ptychographic illuminator. Opt. Express 23, 6171–6180 (2015).
Yeh, L.-H. et al. Experimental robustness of Fourier ptychography phase retrieval algorithms. Opt. Express 23, 33214–33240 (2015).
Maiden, A., Johnson, D. & Li, P. Further improvements to the ptychographical iterative engine. Optica 4, 736–745 (2017).
Bian, Z., Dong, S. & Zheng, G. Adaptive system correction for robust Fourier ptychographic imaging. Opt. Express 21, 32400–32410 (2013).
Yang, L., Liu, Z., Zheng, G. & Chang, H. Batch-based alternating direction methods of multipliers for Fourier ptychography. Opt. Express 30, 34750–34764 (2022).
Dong, S., Shiradkar, R., Nanda, P. & Zheng, G. Spectral multiplexing and coherent-state decomposition in Fourier ptychographic imaging. Biomed. Opt. Express 5, 1757–1767 (2014).
Song, P. et al. Synthetic aperture ptychography: coded sensor translation for joint spatial-Fourier bandwidth expansion. Photonics Res. 10, 1624–1632 (2022).
Guizar-Sicairos, M., Thurman, S. T. & Fienup, J. R. Efficient subpixel image registration algorithms. Opt. Lett. 33, 156–158 (2008).
Bian, L. et al. Content adaptive illumination for Fourier ptychography. Opt. Lett. 39, 6648–6651 (2014).
Tian, L., Li, X., Ramchandran, K. & Waller, L. Multiplexed coded illumination for Fourier Ptychography with an LED array microscope. Biomed. Opt. Express 5, 2376–2389 (2014).
Fan, Y. et al. Efficient synthetic aperture for phaseless Fourier ptychographic microscopy with hybrid coherent and incoherent illumination. Laser Photonics Rev. 17, 2200201 (2023).
Dong, S., Bian, Z., Shiradkar, R. & Zheng, G. Sparsely sampled Fourier ptychography. Opt. Express 22, 5455–5464 (2014).
Song, P. et al. Freeform illuminator for computational microscopy. Intell. Comput. 2, 0015 (2023).

Spatial- and Fourier-domain ptychography for high-throughput bio-imaging

Supplementary information

推荐阅读