Interactive Manipulation and Visualization of 3D Brain MRI for Surgical Training
Abstract: In modern medical diagnostics, magnetic resonance imaging (MRI) is an important technique that provides detailed insights into anatomical structures. In this paper, we present a comprehensive methodology focusing on streamlining the segmentation, reconstruction, and visualization process of 3D MRI data. Segmentation involves the extraction of anatomical regions with the help of state-of-the-art deep learning algorithms. Then, 3D reconstruction converts segmented data from the previous step into multiple 3D representations. Finally, the visualization stage provides efficient and interactive presentations of both 2D and 3D MRI data. Integrating these three steps, the proposed system is able to augment the interpretability of the anatomical information from MRI scans according to our interviews with doctors. Even though this system was originally designed and implemented as part of human brain haptic feedback simulation for surgeon training, it can also provide experienced medical practitioners with an effective tool for clinical data analysis, surgical planning and other purposes
- I. Despotović, B. Goossens, and W. Philips, “Mri segmentation of the human brain: Challenges, methods, and applications,” Computational and Mathematical Methods in Medicine, vol. 2015, p. 450341, Mar 2015. [Online]. Available: https://doi.org/10.1155/2015/450341
- J. F. Singh and V. Magudeeswaran, “Thresholding based method for segmentation of mri brain images,” in 2017 International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), 2017, pp. 280–283.
- G. E. Sujji, Y. Lakshmi, and G. W. Jiji, “Mri brain image segmentation based on thresholding,” International Journal of Advanced Computer Research, vol. 3, no. 1, p. 97, 2013.
- M. T. Nyo, F. Mebarek-Oudina, S. S. Hlaing, and N. A. Khan, “Otsu’s thresholding technique for mri image brain tumor segmentation,” Multimedia Tools and Applications, vol. 81, no. 30, pp. 43 837–43 849, Dec 2022. [Online]. Available: https://doi.org/10.1007/s11042-022-13215-1
- A. Fawzi, A. Achuthan, and B. Belaton, “Brain image segmentation in recent years: A narrative review,” Brain Sciences, vol. 11, no. 8, 2021. [Online]. Available: https://www.mdpi.com/2076-3425/11/8/1055
- Z. Akkus, A. Galimzianova, A. Hoogi, D. L. Rubin, and B. J. Erickson, “Deep learning for brain mri segmentation: State of the art and future directions,” Journal of Digital Imaging, vol. 30, no. 4, pp. 449–459, Aug 2017. [Online]. Available: https://doi.org/10.1007/s10278-017-9983-4
- B. Billot, D. N. Greve, O. Puonti, A. Thielscher, K. Van Leemput, B. Fischl, A. V. Dalca, and J. E. Iglesias, “Synthseg: Segmentation of brain MRI scans of any contrast and resolution without retraining,” Medical Image Analysis, vol. 86, p. 102789, 2023.
- B. Billot, Y. Colin, Magdamo Cheng, S. Das, and J. E. Iglesias, “Robust machine learning segmentation for large-scale analysis of heterogeneous clinical brain MRI datasets,” Proceedings of the National Academy of Sciences (PNAS), vol. 120, no. 9, pp. 1–10, 2023.
- W. E. Lorensen and H. E. Cline, “Marching cubes: A high resolution 3d surface construction algorithm,” in Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, ser. SIGGRAPH ’87. New York, NY, USA: Association for Computing Machinery, 1987, p. 163–169. [Online]. Available: https://doi.org/10.1145/37401.37422
- W. Schroeder, R. Maynard, and B. Geveci, “Flying edges: A high-performance scalable isocontouring algorithm,” in 2015 IEEE 5th Symposium on Large Data Analysis and Visualization (LDAV), 2015, pp. 33–40.
- A. Fedorov, R. Beichel, J. Kalpathy-Cramer, J. Finet, J.-C. Fillion-Robin, S. Pujol, C. Bauer, D. Jennings, F. Fennessy, M. Sonka, J. Buatti, S. Aylward, J. V. Miller, S. Pieper, and R. Kikinis, “3d slicer as an image computing platform for the quantitative imaging network,” Magnetic Resonance Imaging, vol. 30, no. 9, pp. 1323–1341, 2012, quantitative Imaging in Cancer. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0730725X12001816
- Research Imaging Institute - UT Health San Antonio, “Rii-mango/nifti-reader-js: A javascript nifti file format reader.2,” Nov 2023. [Online]. Available: https://github.com/rii-mango/NIFTI-Reader-JS
- Django, “Django (version 4.2) [computer software],” Oct 2023. [Online]. Available: https://www.djangoproject.com/
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.