Distilling Missing Modality Knowledge from Ultrasound for Endometriosis Diagnosis with Magnetic Resonance Images
Abstract: Endometriosis is a common chronic gynecological disorder that has many characteristics, including the pouch of Douglas (POD) obliteration, which can be diagnosed using Transvaginal gynecological ultrasound (TVUS) scans and magnetic resonance imaging (MRI). TVUS and MRI are complementary non-invasive endometriosis diagnosis imaging techniques, but patients are usually not scanned using both modalities and, it is generally more challenging to detect POD obliteration from MRI than TVUS. To mitigate this classification imbalance, we propose in this paper a knowledge distillation training algorithm to improve the POD obliteration detection from MRI by leveraging the detection results from unpaired TVUS data. More specifically, our algorithm pre-trains a teacher model to detect POD obliteration from TVUS data, and it also pre-trains a student model with 3D masked auto-encoder using a large amount of unlabelled pelvic 3D MRI volumes. Next, we distill the knowledge from the teacher TVUS POD obliteration detector to train the student MRI model by minimizing a regression loss that approximates the output of the student to the teacher using unpaired TVUS and MRI data. Experimental results on our endometriosis dataset containing TVUS and MRI data demonstrate the effectiveness of our method to improve the POD detection accuracy from MRI.
- Antonio Simone Lagana et al., “Evaluation of m1 and m2 macrophages in ovarian endometriomas from women affected by endometriosis at different stages of the disease,” Gynecological Endocrinology, vol. 36, no. 5, pp. 441–444, 2020.
- “Delayed diagnosis of endometriosis disadvantages women in art: a retrospective population linked data study,” Human Reproduction, vol. 36, no. 12, pp. 3074–3082, 2021.
- Paolo Vercellini et al., “Endometriosis: pathogenesis and treatment,” Nature Reviews Endocrinology, vol. 10, no. 5, pp. 261–275, 2014.
- Krina T. Zondervan et al., “Endometriosis,” New England Journal of Medicine, vol. 382, no. 13, pp. 1244–1256, 2020, PMID: 32212520.
- Australian Institute of Health and Welfare, “Endometriosis in australia: prevalence and hospitalisations,” 2019, [Online; accessed 18-02-2022].
- Christian M Becker et al., “Eshre guideline: endometriosis,” Human reproduction open, vol. 2022, no. 2, pp. hoac009, 2022.
- Alison Deslandes et al., “Current status of transvaginal ultrasound accuracy in the diagnosis of deep infiltrating endometriosis before surgery: a systematic review of the literature,” Journal of Ultrasound in Medicine, vol. 39, no. 8, pp. 1477–1490, 2020.
- T Indrielle-Kelly et al., “Diagnostic accuracy of ultrasound and mri in the mapping of deep pelvic endometriosis using the international deep endometriosis analysis (idea) consensus,” BioMed research international, vol. 2020, 2020.
- Le Chi Chiu et al., “Predicting pouch of douglas obliteration using ultrasound and laparoscopic video sets: an interobserver and diagnostic accuracy study,” Journal of Ultrasound in Medicine, vol. 38, no. 12, pp. 3155–3161, 2019.
- Gabriel Maicas et al., “Deep learning to diagnose pouch of douglas obliteration with ultrasound sliding sign,” Reproduction and Fertility, vol. 2, no. 4, pp. 236–243, 2021.
- Stefano Guerriero et al., “Systematic approach to sonographic evaluation of the pelvis in women with suspected endometriosis, including terms, definitions and measurements: a consensus opinion from the international deep endometriosis analysis (idea) group,” Ultrasound in Obstetrics & Gynecology, vol. 48, no. 3, pp. 318–332, 2016.
- Anitha L Thalluri et al., “Mri findings in deep infiltrating endometriosis: a pictorial essay,” Journal of Medical Imaging and Radiation Oncology, vol. 61, no. 6, pp. 767–773, 2017.
- Milliam L Kataoka et al., “Posterior cul-de-sac obliteration associated with endometriosis: Mr imaging evaluation,” Radiology, vol. 234, no. 3, pp. 815–823, 2005.
- Kristina Arion et al., “Prediction of pouch of douglas obliteration: point-of-care ultrasound versus pelvic examination,” Journal of Minimally Invasive Gynecology, vol. 26, no. 5, pp. 928–934, 2019.
- Stefano Guerriero et al., “Artificial intelligence (ai) in the detection of rectosigmoid deep endometriosis,” European Journal of Obstetrics & Gynecology and Reproductive Biology, vol. 261, pp. 29–33, 2021.
- Minmin Yang et al., “Diagnostic efficacy of ultrasound combined with magnetic resonance imaging in diagnosis of deep pelvic endometriosis under deep learning,” The Journal of Supercomputing, vol. 77, no. 7, pp. 7598–7619, 2021.
- Geoffrey Hinton et al., “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, vol. 2, no. 7, 2015.
- Nikolaos Passalis et al., “Learning deep representations with probabilistic knowledge transfer,” in Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 268–284.
- Qi Dou et al., “Unpaired multi-modal segmentation via knowledge distillation,” IEEE transactions on medical imaging, vol. 39, no. 7, pp. 2415–2425, 2020.
- Hao Guan et al., “Mri-based alzheimer’s disease prediction via distilling the knowledge in multi-modal data,” NeuroImage, vol. 244, pp. 118586, 2021.
- Cheng Chen et al., “Learning with privileged multimodal knowledge for unimodal segmentation,” IEEE Transactions on Medical Imaging, vol. 41, no. 3, pp. 621–632, 2021.
- Kaiming He et al., “Masked autoencoders are scalable vision learners,” arXiv preprint arXiv:2111.06377, 2021.
- Alexey Dosovitskiy et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.