PCH-EM: A solution to information loss in the photon transfer method
Abstract: Working from a Poisson-Gaussian noise model, a multi-sample extension of the Photon Counting Histogram Expectation Maximization (PCH-EM) algorithm is derived as a general-purpose alternative to the Photon Transfer (PT) method. This algorithm is derived from the same model, requires the same experimental data, and estimates the same sensor performance parameters as the time-tested PT method, all while obtaining lower uncertainty estimates. It is shown that as read noise becomes large, multiple data samples are necessary to capture enough information about the parameters of a device under test, justifying the need for a multi-sample extension. An estimation procedure is devised consisting of initial PT characterization followed by repeated iteration of PCH-EM to demonstrate the improvement in estimate uncertainty achievable with PCH-EM; particularly in the regime of Deep Sub-Electron Read Noise (DSERN). A statistical argument based on the information theoretic concept of sufficiency is formulated to explain how PT data reduction procedures discard information contained in raw sensor data, thus explaining why the proposed algorithm is able to obtain lower uncertainty estimates of key sensor performance parameters such as read noise and conversion gain. Experimental data captured from a CMOS quanta image sensor with DSERN is then used to demonstrate the algorithm's usage and validate the underlying theory and statistical model. In support of the reproducible research effort, the code associated with this work can be obtained on the MathWorks File Exchange (Hendrickson et al., 2024).
- D. M. Hunten and C. J. Stump, “Performance of a silicon vidicon at low signal levels,” Appl. Opt., vol. 15, no. 12, pp. 3105–3110, Dec 1976.
- J. R. Janesick, personal communication (2024-01-27).
- M. Tompsett, G. Amelio, W. Bertram, R. Buckley, W. McNamara, J. Mikkelsen, and D. Sealer, “Charge-coupled imaging devices: Experimental results,” IEEE Transactions on Electron Devices, vol. 18, no. 11, pp. 992–996, 1971.
- C. Sequin, D. Sealer, W. Bertram, M. Tompsett, R. Buckley, T. Shankoff, and W. McNamara, “A charge-coupled area image sensor and frame store,” IEEE Transactions on Electron Devices, vol. 20, no. 3, pp. 244–252, 1973.
- E. R. Fossum, N. Teranishi, and A. J. P. Theuwissen, “Digital image sensor evolution and new frontiers,” Accepted for publication in: Annual Review of Vision Science, 2024.
- EMVA 1288 working group, “EMVA Standard 1288: Standard for characterization of image sensors and cameras, release 4.0 linear,” Jun. 2021.
- E. R. Fossum, J. Ma, S. Masoodian, L. Anzagira, and R. Zizza, “The quanta image sensor: Every photon counts,” Sensors, vol. 16, no. 8, 2016.
- J. Ma and E. R. Fossum, “Quanta image sensor jot with sub 0.3e- r.m.s. read noise and photon counting capability,” IEEE Electron Device Letters, vol. 36, no. 9, pp. 926–928, 2015.
- J. Ma, D. Starkey, A. Rao, K. Odame, and E. R. Fossum, “Characterization of quanta image sensor pump-gate jots with deep sub-electron read noise,” IEEE Journal of the Electron Devices Society, vol. 3, no. 6, pp. 472–480, 2015.
- M.-W. Seo, S. Kawahito, K. Kagawa, and K. Yasutomi, “A 0.27e-rms read noise 220-μ𝜇\muitalic_μv/e- conversion gain reset-gate-less CMOS image sensor with 0.11-μ𝜇\muitalic_μm CIS process,” IEEE Electron Device Letters, vol. 36, no. 12, pp. 1344–1347, 2015.
- S. Masoodian, A. Rao, J. Ma, K. Odame, and E. R. Fossum, “A 2.5 pj/b binary image sensor as a pathfinder for quanta image sensors,” IEEE Transactions on Electron Devices, vol. 63, no. 1, pp. 100–105, 2016.
- J. Ma, S. Chan, and E. R. Fossum, “Review of quanta image sensors for ultralow-light imaging,” IEEE Transactions on Electron Devices, vol. 69, no. 6, pp. 2824–2839, 2022.
- J. Tiffenberg, M. Sofo-Haro, A. Drlica-Wagner, R. Essig, Y. Guardincerri, S. Holland, T. Volansky, and T.-T. Yu, “Single-electron and single-photon sensitivity with a silicon skipper ccd,” Phys. Rev. Lett., vol. 119, p. 131802, Sep 2017.
- B. Cervantes-Vergara, S. Perez, J. D’Olivo, J. Estrada, D. Grimm, S. Holland, M. Sofo-Haro, and W. Wong, “Skipper-ccds: Current applications and future,” Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, vol. 1046, p. 167681, 2023.
- A. J. Lapi, M. Sofo-Haro, B. C. Parpillon, A. Birman, G. Fernandez-Moroni, L. Rota, F. A. Bessia, A. Gupta, C. C. Blanco, F. Chierchie, J. Segal, C. J. Kenney, A. Dragone, S. Li, D. Braga, A. Fenigstein, J. Estrada, and F. Fahim, “Skipper-in-cmos: Non-destructive readout with sub-electron noise performance for pixel detectors,” 2024.
- D. A. Starkey and E. R. Fossum, “Determining conversion gain and read noise using a photon-counting histogram method for deep sub-electron read noise image sensors,” IEEE Journal of the Electron Devices Society, vol. 4, no. 3, pp. 129–135, May 2016.
- N. A. W. Dutton, I. Gyongy, L. Parmesan, and R. K. Henderson, “Single photon counting performance and noise analysis of CMOS SPAD-based image sensors,” Sensors, vol. 16, no. 7, 2016.
- K. Nakamoto and H. Hotaka, “Efficient and accurate conversion-gain estimation of a photon-counting image sensor based on the maximum likelihood estimation,” Opt. Express, vol. 30, no. 21, pp. 37 493–37 506, Oct 2022.
- A. J. Hendrickson and D. P. Haefner, “Photon counting histogram expectation maximization algorithm for characterization of deep sub-electron read noise sensors,” IEEE Journal of the Electron Devices Society, vol. 11, pp. 367–375, 2023.
- A. Hendrickson and D.P. Haefner, “A comparative study of methods to estimate conversion gain in sub-electron and multi-electron read noise regimes,” Proc. SPIE 12533, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXXIV, 125330R, 2023.
- A. J. Hendrickson, D. P. Haefner, N. R. Shade, and E. R. Fossum, “Experimental verification of PCH-EM algorithm for characterizing DSERN image sensors,” IEEE Journal of the Electron Devices Society, vol. 11, pp. 376–384, 2023.
- A. J. Hendrickson, D. P. Haefner, S. H. Chan, N. R. Shade, and E. R. Fossum, “Multi-Sample PCH-EM Algorithm,” MATLAB Central File Exchange, 2024. [Online]. Available: https://www.mathworks.com/matlabcentral/fileexchange/158931-multi-sample-pch-em-algorithm
- B. Zhang, M. J. Fadili, J.-L. Starck, and J.-C. Olivo-Marin, “Multiscale variance-stabilizing transform for mixed-poisson-gaussian processes and its applications in bioimaging,” in 2007 IEEE International Conference on Image Processing, vol. 6, 2007, pp. VI – 233–VI – 236.
- S. Delpretti, F. Luisier, S. Ramani, T. Blu, and M. Unser, “Multiframe sure-let denoising of timelapse fluorescence microscopy images,” in 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 2008, pp. 149–152.
- B. Begovic, V. Stankovic, and L. Stankovic, “Contrast enhancement and denoising of poisson and gaussian mixture noise for solar images,” in 2011 18th IEEE International Conference on Image Processing, 2011, pp. 185–188.
- B. Bajić, J. Lindblad, and N. Sladoje, “Blind restoration of images degraded with mixed poisson-gaussian noise with application in transmission electron microscopy,” in 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), 2016, pp. 123–127.
- G. Fatima and P. Babu, “PGPAL: A monotonic iterative algorithm for phase-retrieval under the presence of poisson-gaussian noise,” IEEE Signal Processing Letters, vol. 29, pp. 533–537, 2022.
- D. A. Barmherzig and M. Eickenberg, “Low-photon holographic phase retrieval with poisson-gaussian denoising,” in Imaging and Applied Optics Congress 2022 (3D, AOA, COSI, ISA, pcAOP). Optica Publishing Group, 2022, p. CM2A.5.
- J. Hu, Z. Li, X. Xu, L. Shen, and J. A. Fessler, “Poisson-gaussian holographic phase retrieval with score-based image prior,” in NeurIPS 2023 Workshop on Deep Learning and Inverse Problems, 2023.
- S. E. Bohndiek, A. Blue, A. T. Clark, M. L. Prydderch, R. Turchetta, G. J. Royle, and R. D. Speller, “Comparison of methods for estimating the conversion gain of CMOS active pixel sensors,” IEEE Sensors Journal, vol. 8, no. 10, pp. 1734–1744, 2008.
- M. R. Gupta and Y. Chen, “Theory and use of the EM algorithm,” Foundations and Trends in Signal Processing, vol. 4, no. 3, pp. 223–296, 2011.
- A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” Journal of the Royal Statistical Society: Series B (Methodological), vol. 39, no. 1, pp. 1–22, 1977.
- I. Naim and D. Gildea, “Convergence of the EM algorithm for gaussian mixtures with unbalanced mixing coefficients,” arXiv preprint arXiv:1206.6427, 2012.
- B. P. Beecken and E. R. Fossum, “Determination of the conversion gain and the accuracy of its measurement for detector elements and arrays,” Appl. Opt., vol. 35, no. 19, pp. 3471–3477, Jul 1996.
- A. J. Hendrickson, “Centralized inverse-Fano distribution for controlling conversion gain measurement accuracy of detector elements,” J. Opt. Soc. Am. A, vol. 34, no. 8, pp. 1411–1423, Aug 2017.
- A. Hendrickson, D. P. Haefner, and B. L. Preece, “On the optimal measurement of conversion gain in the presence of dark noise,” J. Opt. Soc. Am. A, vol. 39, no. 12, pp. 2169–2185, Dec 2022.
- I. Pinelis, “Tests for determining membership of exponential family,” MathOverflow. [Online]. Available: https://mathoverflow.net/q/454976
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.