Multimodal Sleep Apnea Detection with Missing or Noisy Modalities
Abstract: Polysomnography (PSG) is a type of sleep study that records multimodal physiological signals and is widely used for purposes such as sleep staging and respiratory event detection. Conventional machine learning methods assume that each sleep study is associated with a fixed set of observed modalities and that all modalities are available for each sample. However, noisy and missing modalities are a common issue in real-world clinical settings. In this study, we propose a comprehensive pipeline aiming to compensate for the missing or noisy modalities when performing sleep apnea detection. Unlike other existing studies, our proposed model works with any combination of available modalities. Our experiments show that the proposed model outperforms other state-of-the-art approaches in sleep apnea detection using various subsets of available data and different levels of noise, and maintains its high performance (AUROC>0.9) even in the presence of high levels of noise or missingness. This is especially relevant in settings where the level of noise and missingness is high (such as pediatric or outside-of-clinic scenarios).
- Tensorflow: A system for large-scale machine learning. In 12th USENIX symposium on operating systems design and implementation (OSDI ), pages 265–283, Savannah, GA, USA, 2016. ACM.
- Efficient obstructive sleep apnea classification based on EEG signals. In 2015 Long Island Systems, Applications and Technology, pages 1–6. IEEE, 2015.
- Feature selection from nocturnal oximetry using genetic algorithms to assist in obstructive sleep apnoea diagnosis. Medical engineering & physics, 34(8):1049–1057, 2012.
- Gated multimodal units for information fusion. arXiv preprint arXiv:1702.01992, 2017.
- Sleep apnea detection from single-lead ECG: A comprehensive analysis of machine learning and deep learning algorithms. IEEE Transactions on Instrumentation and Measurement, 71:1–11, 2022.
- Dynamic changes in EEG spectra during obstructive apnea in children. Pediatric pulmonology, 29(5):359–365, 2000.
- Principles and practice of explainable machine learning. Frontiers in big Data, page 39, 2021.
- Sleep disordered breathing in children in a general population sample: prevalence and risk factors. Sleep, 32(6):731–736, 2009.
- A sleep apnea detection system based on a one-dimensional deep convolution neural network model using single-lead electrocardiogram. Sensors, 20(15):4157, 2020.
- Toward sleep apnea detection with lightweight multi-scaled fusion network. Knowledge-Based Systems, 247:108783, 2022.
- François Chollet et al. Keras. https://github.com/fchollet/keras, 2015.
- Gated attention fusion network for multimodal sentiment classification. Knowledge-Based Systems, 240:108107, 2022.
- Gated recurrent fusion with joint training framework for robust end-to-end speech recognition. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 29:198–209, 2020.
- Bringing at-home pediatric sleep apnea testing closer to reality: A multi-modal transformer approach. In Machine Learning for Healthcare Conference. PMLR, 2023.
- Cpfnet: Context pyramid fusion network for medical image segmentation. IEEE transactions on medical imaging, 39(10):3008–3018, 2020.
- Multimodal data fusion for systems improvement: A review. IISE Transactions, 54(11):1098–1116, 2022.
- Quantitative investigation of qrs detection rules using the mit/bih arrhythmia database. IEEE transactions on biomedical engineering, (12):1157–1165, 1986.
- Early detection of cardiovascular autonomic neuropathy: A multi-class classification model based on feature selection and deep learning feature fusion. Information Fusion, 77:70–80, 2022.
- Cmgfnet: A deep cross-modal gated fusion network for building extraction from very high-resolution remote sensing images. ISPRS journal of photogrammetry and remote sensing, 184:96–115, 2022.
- Sleep apnea: types, mechanisms, and clinical cardiovascular consequences. Journal of the American College of Cardiology, 69(7):841–858, 2017.
- Somnnet: An spo2 based deep learning network for sleep apnea detection in smartwatches. In 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pages 1961–1964. IEEE, 2021.
- Inflammatory aspects of sleep apnea and their cardiovascular consequences. Southern medical journal, 99(1):58–68, 2006.
- Sleep disordered breathing in children: a comprehensive clinical guide to evaluation and treatment. Springer Science & Business Media, 2012.
- Adam: A method for stochastic optimization, 2017.
- American academy of sleep medicine position paper for the use of a home sleep apnea test for the diagnosis of osa in children. Journal of Clinical Sleep Medicine, 13(10):1199–1203, 2017.
- Multimodal machine learning in precision health: A scoping review. npj Digital Medicine, 5(1):171, 2022.
- Role of sleep duration and quality in the risk and severity of type 2 diabetes mellitus. Archives of internal medicine, 166(16):1768–1774, 2006.
- Artifacts and noise removal for electroencephalogram (EEG): A literature review. In 2018 IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE), pages 326–332. IEEE, 2018.
- A large collection of real-world pediatric sleep studies. Scientific Data, 9(1):1–12, 2022.
- Anovit: Unsupervised anomaly detection and localization with vision transformer-based encoder-decoder. IEEE Access, 10:46717–46724, 2022. 10.1109/ACCESS.2022.3171559.
- Radar and camera early fusion for vehicle detection in advanced driver assistance systems. In Machine learning for autonomous driving workshop at the 33rd conference on neural information processing systems, volume 2, 2019.
- Hrishikesh Limaye and VV Deshmukh. Ecg noise sources and various noise removal techniques: A survey. International Journal of Application or Innovation in Engineering & Management, 5(2):86–92, 2016.
- Machine learning for multimodal electronic health records-based research: Challenges and perspectives. In Health Information Processing, pages 135–155. Springer Nature Singapore, 2023. ISBN 978-981-19-9865-2.
- Sleep: a health imperative. Sleep, 35(6):727–734, 2012.
- A new wearable system for home sleep apnea testing, screening, and classification. Sensors, 20(24):7014, 2020.
- Diagnosis and management of childhood obstructive sleep apnea syndrome. Pediatrics, 130(3):e714–e755, 2012.
- A randomized trial of adenotonsillectomy for childhood sleep apnea. N Engl J Med, 368:2366–2376, 2013.
- Probabilistic neural network approach for the detection of sahs from overnight pulse oximetry. Medical & biological engineering & computing, 51(3):305–315, 2013.
- Remo Mueller. Sleep data - national sleep research resource - nsrr, 2024. URL http://www.sleepdata.org/.
- A comprehensive survey on multimodal medical signals fusion for smart healthcare systems. Information Fusion, 76:355–375, 2021.
- End-to-end detection of a landing platform for offshore uavs based on a multimodal early fusion approach. Sensors, 23(5):2434, 2023.
- Single sensor techniques for sleep apnea diagnosis using deep learning. In 2017 IEEE international conference on healthcare informatics (ICHI), pages 524–529. IEEE, 2017.
- Sleep disorders. The American journal of medicine, 132(3):292–299, 2019.
- The apnea-ECG database. In Computers in Cardiology 2000. Vol. 27 (Cat. 00CH37163), pages 255–258. IEEE, 2000.
- Oxygen saturation and rr intervals feature selection for sleep apnea detection. Entropy, 17(5):2932–2957, 2015.
- The childhood adenotonsillectomy trial (chat): rationale, design, and challenges of a randomized controlled trial evaluating a standard surgical procedure in a pediatric population. Sleep, 34(11):1509–1517, 2011.
- Gated fusion network for single image dehazing. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3253–3261, 2018.
- Polysomnography. Handbook of clinical neurology, 160:381–392, 2019.
- Detection of sleep apnea using machine learning algorithms based on ECG signals: A comprehensive systematic review. Expert Systems with Applications, 187:115950, 2022.
- Symptoms of depression in individuals with obstructive sleep apnea may be amenable to treatment with continuous positive airway pressure. Chest, 128(3):1304–1309, 2005.
- Effects of cpap and mandibular advancement device treatment in obstructive sleep apnea patients: a systematic review and meta-analysis. Sleep and Breathing, 22:555–568, 2018.
- Multiscale deep neural network for obstructive sleep apnea detection using rr interval from single-lead ECG signal. IEEE Transactions on Instrumentation and Measurement, 70:1–13, 2021.
- Measuring sleep quality and efficiency with an activity monitoring device in comparison to polysomnography. Journal of clinical medicine research, 11(12):825, 2019.
- Multimodal deep learning for biomedical data fusion: a review. Briefings in Bioinformatics, 23(2):bbab569, 2022.
- Shahrad Taheri. The link between short sleep duration and obesity: we should recommend more sleep to prevent obesity. Archives of disease in childhood, 91(11):881–884, 2006.
- A deep learning-based decision support system for diagnosis of osas using ptt signals. Medical hypotheses, 127:15–22, 2019.
- Automatic detection of respiratory arrests in osa patients using ppg and machine learning techniques. Neural Computing and Applications, 28(10):2931–2945, 2017.
- Automated detection of obstructive sleep apnea events from a single-lead electrocardiogram using a convolutional neural network. Journal of medical systems, 42(6):1–8, 2018.
- A multicentric validation study of a novel home sleep apnea test based on peripheral arterial tonometry. Sleep, 45(5):zsac028, 2022.
- Sensor Fusion using Backward Shortcut Connections for Sleep Apnea Detection in Multi-Modal Data. In Proceedings of the Machine Learning for Health NeurIPS Workshop, volume 116 of Proceedings of Machine Learning Research, pages 112–125. PMLR, 13 Dec 2020.
- Automatic assessment of pediatric sleep apnea severity using overnight oximetry and convolutional neural networks. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pages 633–636. IEEE, 2020.
- An intelligent sleep apnea classification system based on EEG signals. Journal of medical systems, 43(2):36, 2019.
- Multi-view clustering via late fusion alignment maximization. In IJCAI, pages 3778–3784, 2019.
- Towards good practices for missing modality robust action recognition. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 37, pages 2776–2784, 2023.
- Real-time sleep apnea detection by classifier combination. IEEE Transactions on information technology in biomedicine, 16(3):469–477, 2012.
- Diagnosis of obstructive sleep apnea in children based on the xgboost algorithm using nocturnal heart rate and blood oxygen feature. American Journal of Otolaryngology, 44(2):103714, 2023.
- Detection of sleep apnea using deep neural networks and single-lead ECG signals. Biomedical Signal Processing and Control, 71:103125, 2022.
- Gated fusion network for joint image deblurring and super-resolution. arXiv preprint arXiv:1807.10806, 2018.
- A late fusion cnn for digital matting. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 7469–7478, 2019.
- Classification of sleep apnea based on EEG sub-band signal characteristics. Scientific Reports, 11(1):5824, 2021.
- Diagnosing major depressive disorder i: A psychometric evaluation of the dsm-iv symptom criteria. The Journal of nervous and mental disease, 194(3):158–163, 2006.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.