Live Iterative Ptychography with projection-based algorithms
Abstract: In this work, we demonstrate that the ptychographic phase problem can be solved in a live fashion during scanning, while data is still being collected. We propose a generally applicable modification of the widespread projection-based algorithms such as Error Reduction (ER) and Difference Map (DM). This novel variant of ptychographic phase retrieval enables immediate visual feedback during experiments, reconstruction of arbitrary-sized objects with a fixed amount of computational resources, and adaptive scanning. By building upon the Real-Time Iterative Spectrogram Inversion (RTISI) family of algorithms from the audio processing literature, we show that live variants of projection-based methods such as DM can be derived naturally and may even achieve higher-quality reconstructions than their classic non-live counterparts with comparable effective computational load.
- “Ptychography” In Springer Handbook of Microscopy Springer, 2019
- “Live Processing of Momentum-Resolved STEM Data for First Moment Imaging and Ptychography” In Microscopy and Microanalysis 27.5, 2021, pp. 1078–1092 DOI: 10.1017/S1431927621012423
- “Wigner Distribution Deconvolution Adaptation for Live Ptychography Reconstruction” In Microscopy and Microanalysis 29.3, 2023, pp. 994–1008 DOI: 10.1093/micmic/ozad021
- “Live Iterative Ptychography”, 2023 arXiv:2308.10674
- Andrew M. Maiden and John M. Rodenburg “An Improved Ptychographical Phase Retrieval Algorithm for Diffractive Imaging” In Ultramicroscopy 109.10, 2009, pp. 1256–1262
- Gerald T Beauregard, Xinglei Zhu and Lonce Wyse “An Efficient Algorithm for Real-Time Spectrogram Inversion” In Proceedings of the 8th International Conference on Digital Audio Effects, 2005, pp. 116–118
- Xinglei Zhu, Gerald T. Beauregard and Lonce L. Wyse “Real-Time Signal Estimation From Modified Short-Time Fourier Transform Magnitude Spectra” In IEEE Transactions on Audio, Speech and Language Processing 15.5, 2007, pp. 1645–1653 DOI: 10.1109/TASL.2007.899236
- Veit Elser “Phase Retrieval by Iterated Projections” In Journal of the Optical Society of America A 20.1, 2003, pp. 40
- V. Elser, I. Rankenburg and P. Thibault “Searching with Iterated Maps” In Proc. Nat. Acad. Sci. 104, 2007, pp. 418–423
- J.R. Fienup “Reconstruction of an Object from the Modulus of Its Fourier Transform” In Optics Letters 3.1 OSA, 1978, pp. 27–29
- “Deep Iterative Phase Retrieval for Ptychography” In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Singapore, Singapore: IEEE, 2022, pp. 1591–1595 DOI: 10.1109/ICASSP43922.2022.9746811
- D Russell Luke “Relaxed Averaged Alternating Reflections for Diffraction Imaging” In Inverse Problems. An International Journal on the Theory and Practice of Inverse Problems, Inverse Methods and Computerized Inversion of Data 21.1, 2004, pp. 37 DOI: 10.1088/0266-5611/21/1/004
- Nathanaël Perraudin, Peter Balazs and Peter L. Søndergaard “A Fast Griffin-Lim Algorithm”, 2013
- “PyNX: High-Performance Computing Toolkit for Coherent X-ray Imaging Based on Operators” In Journal of Applied Crystallography 53.5, 2020, pp. 1404–1413
- “A Computational Framework for Ptychographic Reconstructions” In Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 472.2196, 2016, pp. 20160640 DOI: 10.1098/rspa.2016.0640
- “A Flexible Online Framework for Projection-Based STFT Phase Retrieval”, 2023 arXiv:2309.07043
- Tal Peer, Simon Welker and Timo Gerkmann “Beyond Griffin-Lim: Improved Iterative Phase Retrieval for Speech” In 2022 International Workshop on Acoustic Signal Enhancement (IWAENC) IEEE, 2022, pp. 1–5
- “Acoustic Application of Phase Reconstruction Algorithms in Optics” In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Singapore, Singapore: IEEE, 2022, pp. 6212–6216 DOI: 10.1109/ICASSP43922.2022.9747423
- Oleh Melnyk “Phase Retrieval from Short-Time Fourier Measurements and Applications to Ptychography”, 2023
- “Signal Estimation from Modified Short-Time Fourier Transform” In IEEE Transactions on Acoustics, Speech, and Signal Processing 32.2, 1984, pp. 236–243
- “Signal Reconstruction from STFT Magnitude: A State of the Art” In International conference on digital audio effects (DAFx), 2011, pp. 375–386
- Jeffrey M Ede “Adaptive Partial Scanning Transmission Electron Microscopy with Reinforcement Learning” In Machine Learning: Science and Technology 2.4 IOP Publishing, 2021, pp. 045011
- “Probe Retrieval in Ptychographic Coherent Diffractive Imaging” In Ultramicroscopy 109.4, 2009, pp. 338–343
- “NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study” In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2017
- “NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results” In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2017
- “Optimization of Overlap Uniformness for Ptychography” In Optics Express 22.10, 2014, pp. 12634 DOI: 10.1364/OE.22.012634
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.