SegReg: Segmenting OARs by Registering MR Images and CT Annotations
Abstract: Organ at risk (OAR) segmentation is a critical process in radiotherapy treatment planning such as head and neck tumors. Nevertheless, in clinical practice, radiation oncologists predominantly perform OAR segmentations manually on CT scans. This manual process is highly time-consuming and expensive, limiting the number of patients who can receive timely radiotherapy. Additionally, CT scans offer lower soft-tissue contrast compared to MRI. Despite MRI providing superior soft-tissue visualization, its time-consuming nature makes it infeasible for real-time treatment planning. To address these challenges, we propose a method called SegReg, which utilizes Elastic Symmetric Normalization for registering MRI to perform OAR segmentation. SegReg outperforms the CT-only baseline by 16.78% in mDSC and 18.77% in mIoU, showing that it effectively combines the geometric accuracy of CT with the superior soft-tissue contrast of MRI, making accurate automated OAR segmentation for clinical practice become possible. See project website https://steve-zeyu-zhang.github.io/SegReg
- Mark Gormley, et al., “Reviewing the epidemiology of head and neck cancer: definitions, trends and risk factors,” British Dental Journal, vol. 233, no. 9, pp. 780–786, 2022.
- Dorothy M Gujral et al., “Patterns of failure, treatment outcomes and late toxicities of head and neck cancer in the current era of imrt,” Oral Oncology, vol. 86, pp. 225–233, 2018.
- Christopher Nutting, et al., “Dysphagia-optimised intensity-modulated radiotherapy versus standard intensity-modulated radiotherapy in patients with head and neck cancer (dars): a phase 3, multicentre, randomised, controlled trial,” The Lancet Oncology, vol. 24, no. 8, pp. 868–880, 2023.
- Jimmy J Caudell, et al., “The future of personalised radiotherapy for head and neck cancer,” The Lancet Oncology, vol. 18, no. 5, pp. e266–e273, 2017.
- Avraham Eisbruch, “Clinical aspects of imrt for head-and-neck cancer,” Medical Dosimetry, vol. 27, no. 2, pp. 99–104, 2002.
- Michael J Zelefsky, et al., “High dose radiation delivered by intensity modulated conformal radiotherapy improves the outcome of localized prostate cancer,” The Journal of urology, vol. 166, no. 3, pp. 876–881, 2001.
- Daniel Sapkaroski, et al., “A review of stereotactic body radiotherapy–is volumetric modulated arc therapy the answer?,” Journal of medical radiation sciences, vol. 62, no. 2, pp. 142–151, 2015.
- Paul M Harari, et al., “Emphasizing conformal avoidance versus target definition for imrt planning in head-and-neck cancer,” International Journal of Radiation Oncology* Biology* Physics, vol. 77, no. 3, pp. 950–958, 2010.
- Takaya Inagaki, et al., “Escalated maximum dose in the planning target volume improves local control in stereotactic body radiation therapy for t1-2 lung cancer,” Cancers, vol. 14, no. 4, pp. 933, 2022.
- Kavitha Srinivasan, et al., “Applications of linac-mounted kilovoltage cone-beam computed tomography in modern radiation therapy: A review,” Polish journal of radiology, vol. 79, pp. 181, 2014.
- Giacomo Reggiori, et al., “Cone beam ct pre-and post-daily treatment for assessing geometrical and dosimetric intrafraction variability during radiotherapy of prostate cancer,” Journal of Applied Clinical Medical Physics, vol. 12, no. 1, pp. 141–152, 2011.
- Dazhou Guo, et al., “Organ at risk segmentation for head and neck cancer using stratified learning and neural architecture search,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 4223–4232.
- J Stefoski Mikeljevic, et al., “Trends in postoperative radiotherapy delay and the effect on survival in breast cancer patients treated with conservation surgery,” British journal of cancer, vol. 90, no. 7, pp. 1343–1348, 2004.
- Houda Bahig, et al., “Clinical applications of mri in radiotherapy planning,” MRI for Radiotherapy: Planning, Delivery, and Response Assessment, pp. 55–70, 2019.
- Robert I Johnstone, et al., “Guidance on the use of mri for treatment planning in radiotherapy clinical trials,” The British Journal of Radiology, vol. 93, no. 1105, pp. 20190161, 2020.
- Mark HF Savenije, et al., “Clinical implementation of mri-based organs-at-risk auto-segmentation with convolutional networks for prostate radiotherapy,” Radiation oncology, vol. 15, pp. 1–12, 2020.
- Anne T Davis, et al., “Can ct scan protocols used for radiotherapy treatment planning be adjusted to optimize image quality and patient dose? a systematic review,” The British journal of radiology, vol. 90, no. 1076, pp. 20160406, 2017.
- Phil Prior, et al., “Is bulk electron density assignment appropriate for mri-only based treatment planning for lung cancer?,” Medical Physics, vol. 44, no. 7, pp. 3437–3443, 2017.
- Paul Keall, et al., “See, think, and act: real-time adaptive radiotherapy,” in Seminars in radiation oncology. Elsevier, 2019, vol. 29, pp. 228–235.
- Hao Tang, et al., “Clinically applicable deep learning framework for organs at risk delineation in ct images,” Nature Machine Intelligence, vol. 1, no. 10, pp. 480–491, 2019.
- Wenhui Lei, et al., “Automatic segmentation of organs-at-risk from head-and-neck ct using separable convolutional neural network with hard-region-weighted loss,” Neurocomputing, vol. 442, pp. 184–199, 2021.
- Brian B Avants, et al., “The insight toolkit image registration framework,” Frontiers in neuroinformatics, vol. 8, pp. 44, 2014.
- Stefan Klein, et al., “Elastix: a toolbox for intensity-based medical image registration,” IEEE transactions on medical imaging, vol. 29, no. 1, pp. 196–205, 2009.
- Dinggang Shen et al., “Hammer: hierarchical attribute matching mechanism for elastic registration,” IEEE transactions on medical imaging, vol. 21, no. 11, pp. 1421–1439, 2002.
- John Ashburner, “A fast diffeomorphic image registration algorithm,” Neuroimage, vol. 38, no. 1, pp. 95–113, 2007.
- Jue Jiang, et al., “Progressively refined deep joint registration segmentation (prorseg) of gastrointestinal organs at risk: Application to mri and cone-beam ct,” Medical Physics, vol. 50, no. 8, pp. 4758–4774, 2023.
- Gašper Podobnik, et al., “Han-seg: The head and neck organ-at-risk ct and mr segmentation dataset,” Medical physics, vol. 50, no. 3, pp. 1917–1927, 2023.
- Fabian Isensee, et al., “nnu-net: a self-configuring method for deep learning-based biomedical image segmentation,” Nature methods, vol. 18, no. 2, pp. 203–211, 2021.
- Gašper Podobnik, et al., “Multimodal ct and mr segmentation of head and neck organs-at-risk,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2023, pp. 745–755.
- Yao Zhang, et al., “Modality-aware mutual learning for multi-modal medical image segmentation,” in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part I 24. Springer, 2021, pp. 589–599.
- Brian B Avants, et al., “Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain,” Medical image analysis, vol. 12, no. 1, pp. 26–41, 2008.
- Tomaž Vrtovec, et al., “Auto-segmentation of organs at risk for head and neck radiotherapy planning: from atlas-based to deep learning methods,” Medical physics, vol. 47, no. 9, pp. e929–e950, 2020.
- Lena Maier-Hein, et al., “Bias: Transparent reporting of biomedical image analysis challenges,” Medical image analysis, vol. 66, pp. 101796, 2020.
- Stanislav Nikolov, et al., “Clinically applicable segmentation of head and neck anatomy for radiotherapy: deep learning algorithm development and validation study,” Journal of medical Internet research, vol. 23, no. 7, pp. e26151, 2021.
- Brian B Avants, et al., “A reproducible evaluation of ants similarity metric performance in brain image registration,” Neuroimage, vol. 54, no. 3, pp. 2033–2044, 2011.
- Raffaele Nuzzi, et al., “Ocular complications after radiation therapy: an observational study,” Clinical Ophthalmology, pp. 3153–3166, 2020.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.