Papers
Topics
Authors
Recent
Search
2000 character limit reached

Inferring ECG from PPG for Continuous Cardiac Monitoring Using Lightweight Neural Network

Published 9 Dec 2020 in eess.SP | (2012.04949v5)

Abstract: This paper presents a computational solution that enables continuous cardiac monitoring through cross-modality inference of electrocardiogram (ECG). While some smartwatches now allow users to obtain a 30-second ECG test by tapping a built-in bio-sensor, these short-term ECG tests often miss intermittent and asymptomatic abnormalities of cardiac functions. It is also infeasible to expect persistently active user participation for long-term continuous cardiac monitoring in order to capture these and other types of cardiac abnormalities. To alleviate the need for continuous user attention and active participation, we design a lightweight neural network that infers ECG from the photoplethysmogram (PPG) signal sensed at the skin surface by a wearable optical sensor. We also develop a diagnosis-oriented training strategy to enable the neural network to capture the pathological features of ECG, aiming to increase the utility of reconstructed ECG signals for screening cardiovascular diseases (CVDs). We also leverage model interpretation to obtain insights from data-driven models, for example, to reveal some associations between CVDs and ECG/PPG and to demonstrate how the neural network copes with motion artifacts in the ambulatory application. The experimental results on three datasets demonstrate the feasibility of inferring ECG from PPG, achieving a high fidelity of ECG reconstruction with only about 40K parameters.

Authors (4)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. M. Heron, “Heart disease facts,” Nat. Vital Statist. Rep., vol. 68, no. 6, pp. 1–77, 2019.
  2. A. Torbal, E. Boersma, J. Kors, G. Herpen, J. Deckers, D. Kuip, B. Stricker, A. Hofman, and J. Witteman, “Incidence of recognized and unrecognized myocardial infarction in men and women aged 55 and older: The Rotterdam study,” Euro. Heart J., vol. 27, pp. 729–736, 2006.
  3. Q. Zhu, X. Tian, C. Wong, and M. Wu, “ECG reconstruction via PPG: A pilot study,” in Proc. IEEE EMBS Int. Conf. Biomed. Health Inform., 2019, pp. 1–4.
  4. ——, “Learning your heart actions from pulse: ECG waveform reconstruction from PPG,” IEEE Internet Things J., vol. 8, no. 23, pp. 16 734–16 748, 2021.
  5. M. V. Perez, K. W. Mahaffey, H. Hedlin, J. S. Rumsfeld, A. Garcia, T. Ferris, V. Balasubramanian, A. M. Russo, A. Rajmane, L. Cheung et al., “Large-scale assessment of a smartwatch to identify atrial fibrillation,” New Engl. J. Med., vol. 381, no. 20, pp. 1909–1917, 2019.
  6. K. Bruynseels, F. Santoni de Sio, and J. van den Hoven, “Digital twins in health care: Ethical implications of an emerging engineering paradigm,” Front. Genet., vol. 9, p. 31, 2018.
  7. N. Selvaraj, A. K. Jaryal, J. Santhosh, K. K. Deepak, and S. Anand, “Assessment of heart rate variability derived from finger-tip photoplethysmography as compared to electrocardiography,” J. Med. Eng. Technol., vol. 32, pp. 479–484, 2008.
  8. X. Tian, Q. Zhu, Y. Li, and M. Wu, “Cross-domain joint dictionary learning for ECG reconstruction from PPG,” in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2020, pp. 936–940.
  9. ——, “Cross-domain joint dictionary learning for ECG inference from PPG,” IEEE Internet Things J., vol. 10, no. 9, pp. 8140–8154, 2023.
  10. H. Chiu, H. Shuai, and P. C. P. Chao, “Reconstructing QRS complex from PPG by transformed attentional neural networks,” IEEE Sensors J., vol. 20, no. 20, pp. 12 374–12 383, 2020.
  11. K. Vo, E. K. Naeini, A. Naderi, D. Jilani, A. M. Rahmani, N. Dutt, and H. Cao, “P2E-WGAN: ECG waveform synthesis from PPG with conditional wasserstein generative adversarial networks,” in Proc. Annu. ACM Symp. Appl. Comput., 2021, pp. 1030–1036.
  12. Q. Tang, Z. Chen, R. Ward, C. Menon, and M. Elgendi, “PPG2ECGps: An end-to-end subject-specific deep neural network model for electrocardiogram reconstruction from photoplethysmography signals without pulse arrival time adjustments,” Bioeng., vol. 10, no. 6, 2023.
  13. Q. Tang, Z. Chen, Y. Guo, Y. Liang, R. Ward, C. Menon, and M. Elgendi, “Robust reconstruction of electrocardiogram using photoplethysmography: A subject-based model,” Frontiers in Physiology, vol. 13, 2022.
  14. E. Lan, “Performer: A novel PPG-to-ECG reconstruction transformer for a digital biomarker of cardiovascular disease detection,” in IEEE Winter Conf. Appl. Comput. Vis., 2023, pp. 1990–1998.
  15. R. Banerjee, A. Sinha, A. Dutta Choudhury, and A. Visvanathan, “PhotoECG: Photoplethysmography to estimate ECG parameters,” in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., 2014, pp. 4404–4408.
  16. P. Wang, C. Han, F. Yu, Y. Zheng, X. Huang, and L. Cui, “Rec-AUNet: Attentive unet for reconstruction of ECG from BCG,” in IEEE Int. Conf. Bioinfo. Biomed., 2022, pp. 1241–1248.
  17. Y. Cao, F. Li, H. Chen, X. liu, L. Zhang, and Y. Wang, “Guard your heart silently: Continuous electrocardiogram waveform monitoring with wrist-worn motion sensor,” Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., vol. 6, no. 3, 2022.
  18. D. Toda, R. Anzai, K. Ichige, R. Saito, and D. Ueki, “ECG signal reconstruction using FMCW radar and convolutional neural network,” in Proc. Int. Symp. Commun. Inf. Technol., 2021, pp. 176–181.
  19. A. Hannun, P. Rajpurkar, M. Haghpanahi, G. Tison, C. Bourn, M. Turakhia, and A. Ng, “Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network,” Nature Med., vol. 25, pp. 65–69, 2019.
  20. T. Yang, L. Yu, Q. Jin, L. Wu, and B. He, “Localization of origins of premature ventricular contraction by means of convolutional neural network from 12-lead ECG,” IEEE Trans. Bio-Med. Eng., vol. 65, no. 7, pp. 1662–1671, 2018.
  21. A. Sbrollini, M. C. De Jongh, C. C. T. Haar, R. W. Treskes, S. Man, L. Burattini, and C. A. Swenne, “Serial electrocardiography to detect newly emerging or aggravating cardiac pathology: A deep-learning approach,” Bio. Eng. Online, vol. 18, no. 1, p. 15, 2019.
  22. Y. Liang, Z. Chen, R. K. Ward, and M. Elgendi, “Photoplethysmography and deep learning: Enhancing hypertension risk stratification,” Biosensors, vol. 8, no. 4, p. 101, 2018.
  23. C. T. Arsene, R. Hankins, and H. Yin, “Deep learning models for denoising ECG signals,” in Proc. Eur. Signal Process. Conf., 2019, pp. 1–5.
  24. T. Golany and K. Radinsky, “PGANs: Personalized generative adversarial networks for ECG synthesis to improve patient-specific deep ECG classification,” in Proc. AAAI Conf. Artif. Intell., vol. 33, 2019, pp. 557–564.
  25. J. C. Ruiz-Rodríguez, A. Ruiz-Sanmartín, V. Ribas, J. Caballero, A. García-Roche, J. Riera, X. Nuvials, M. Nadal, O. Sola-Morales, J. Serra et al., “Innovative continuous non-invasive cuffless blood pressure monitoring based on photoplethysmography technology,” Intensive Care Med., vol. 39, no. 9, pp. 1618–1625, 2013.
  26. A. Reiss, I. Indlekofer, P. Schmidt, and K. Van Laerhoven, “Deep PPG: Large-scale heart rate estimation with convolutional neural networks,” Sensors, vol. 19, no. 14, p. 3079, 2019.
  27. C. Yu, Z. Gao, W. Zhang, G. Yang, S. Zhao, H. Zhang, Y. Zhang, and S. Li, “Multitask learning for estimating multitype cardiac indices in MRI and CT based on adversarial reverse mapping,” IEEE Trans. Neural Netw. Learn. Syst., vol. 32, no. 2, pp. 493–506, 2020.
  28. S. Wu, S. Wei, C. Chang, A. L. Swindlehurst, and J. Chiu, “A scalable open-set ECG identification system based on compressed CNNs,” IEEE Trans. Neural Netw. Learn. Syst., pp. 1–15, 2021.
  29. N. Trayanova and J. Rice, “Cardiac electromechanical models: From cell to organ,” Front. Physiol., vol. 2, 2011.
  30. X. Zhang, X. Zhou, M. Lin, and J. Sun, “Shufflenet: An extremely efficient convolutional neural network for mobile devices,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2018, pp. 6848–6856.
  31. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 770–778.
  32. J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2018, pp. 7132–7141.
  33. G. Hinton and S. T. Roweis, “Stochastic neighbor embedding,” in Proc. Adv. Neural Inf. Process. Syst., vol. 15, 2002, pp. 833–840.
  34. A. Johnson, T. Pollard, L. Shen, L. Lehman, M. Feng, M. Ghassemi, B. Moody, P. Szolovits, L. Celi, and R. Mark, “MIMIC-III, a freely accessible critical care database,” Sci. Data, vol. 3, p. 160035, 2016.
  35. M. Sundararajan, A. Taly, and Q. Yan, “Axiomatic attribution for deep networks,” in Proc. Int. Conf. Mach. Learn., 2017, pp. 3319–3328.
  36. “Clinical ECG Interpretation (eBook),” Availaible: https://ecgwaves.com/, Accessed: Dec. 10, 2021.
  37. P. Khosla, P. Teterwak, C. Wang, A. Sarna, Y. Tian, P. Isola, A. Maschinot, C. Liu, and D. Krishnan, “Supervised contrastive learning,” in Proc. Adv. Neural Inf. Process. Syst., vol. 33, 2020, pp. 18 661–18 673.
  38. J. Kim, J. K. Lee, and K. M. Lee, “Deeply-recursive convolutional network for image super-resolution,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1637–1645.
  39. N. Komodakis and S. Zagoruyko, “Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer,” in Proc. Int. Conf. Learn. Rep., 2017.
  40. A. Vest, Q. Li, C. Liu, S. Nemati, G. Da Poian, A. Shah, and G. Clifford, “An open source benchmarked toolbox for cardiovascular waveform and interval analysis,” Physiol. Meas., vol. 39, no. 10, 2018.
  41. M. A. F. Pimentel, A. E. W. Johnson, P. H. Charlton, D. Birrenkott, P. J. Watkinson, L. Tarassenko, and D. A. Clifton, “Toward a robust estimation of respiratory rate from pulse oximeters,” IEEE Trans. Biomed. Eng., vol. 64, no. 8, pp. 1914–1923, 2017.
  42. Z. Zhang, Z. Pi, and B. Liu, “TROIKA: A general framework for heart rate monitoring using wrist-type photoplethysmographic signals during intensive physical exercise,” IEEE Trans. on Biomed. Eng., vol. 62, no. 2, pp. 522–531, 2015.
  43. O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional networks for biomedical image segmentation,” in Proc. Int. Conf. Medical Image Comput. Comput.-Assist. Interv., 2015, pp. 234–241.
  44. J. Jiao, H. H. Permuter, L. Zhao, Y. Kim, and T. Weissman, “Universal estimation of directed information,” IEEE Trans. Inf. Theory, vol. 59, no. 10, pp. 6220–6242, 2013.
  45. S. H. Kim, D. W. Ryoo, and C. Bae, “Adaptive noise cancellation using accelerometers for the PPG signal from forehead,” in Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2007, pp. 2564–2567.
  46. P. Wagner, N. Strodthoff, R.-D. Bousseljot, D. Kreiseler, F. I. Lunze, W. Samek, and T. Schaeffter, “PTB-XL, a large publicly available electrocardiography dataset,” Sci. Data, vol. 7, no. 1, p. 154, 2020.
  47. E. Tjoa and C. Guan, “A survey on explainable artificial intelligence (XAI): Toward medical XAI,” IEEE Trans. Neural Netw. Learn. Syst., vol. 32, no. 11, pp. 4793–4813, 2021.
  48. J. Allen, K. Overbeck, G. Stansby, and A. Murray, “Photoplethysmography assessments in cardiovascular disease,” Meas. Control, vol. 39, no. 3, pp. 80–83, 2006.
  49. M. L. Neal and R. Kerckhoffs, “Current progress in patient-specific modeling,” Brief. Bioinform., vol. 11, no. 1, pp. 111–126, 2010.
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.