Papers
Topics
Authors
Recent
Search
2000 character limit reached

A vascular synthetic model for improved aneurysm segmentation and detection via Deep Neural Networks

Published 27 Mar 2024 in eess.IV and cs.CV | (2403.18734v1)

Abstract: We hereby present a full synthetic model, able to mimic the various constituents of the cerebral vascular tree: the cerebral arteries, the bifurcations and the intracranial aneurysms. By building this model, our goal was to provide a substantial dataset of brain arteries which could be used by a 3D Convolutional Neural Network (CNN) to either segment or detect/recognize various vascular diseases (such as artery dissection/thrombosis) or even some portions of the cerebral vasculature, such as the bifurcations or aneurysms. In this study, we will particularly focus on Intra-Cranial Aneurysm (ICA) detection and segmentation. The cerebral aneurysms most often occur on a particular structure of the vascular tree named the Circle of Willis. Various studies have been conducted to detect and monitor the ICAs and those based on Deep Learning (DL) achieve the best performances. Specifically, in this work, we propose a full synthetic 3D model able to mimic the brain vasculature as acquired by Magnetic Resonance Angiography (MRA), and more particularly the Time Of Flight (TOF) principle. Among the various MRI modalities, the MRA-TOF allows to have a relatively good rendering of the blood vessels and is non-invasive (no contrast liquid injection). Our model has been designed to simultaneously mimic the arteries geometry, the ICA shape and the background noise. The geometry of the vascular tree is modeled thanks to an interpolation with 3D Spline functions, and the statistical properties of the background MRI noise is collected from MRA acquisitions and reproduced within the model. In this work, we thoroughly describe the synthetic vasculature model, we build up a neural network designed for ICA segmentation and detection, and finally, we carry out an in-depth evaluation of the performance gap gained thanks to the synthetic model data augmentation.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Time of flight 3d magnetic resonance angiography in the follow-up of coiled cerebral aneurysms. Interv Neuroradiol. 5, 127–37. doi:10.1177/159101999900500203.
  2. Analysis of blur measure operators for single image blur segmentation. Applied Sciences 8, 807–839.
  3. Computerized detection of intracranial aneurysms for three-dimensional mr angiography: Feature extraction of small protrusions based on a shape-based difference image technique. Medical physics 33, 394–401.
  4. Toward a 3d arterial tree bifurcation model for intra-cranial aneurysm detection and segmentation, in: IEEE International Conference on Pattern Recognition (ICPR), Montreal, QC, Canada. pp. 4500–4506.
  5. nndetection: a self-configuring method for medical object detection, in: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part V 24, Springer. pp. 530–539.
  6. Anatomical labeling of the circle of willis using maximum a posteriori probability estimation. IEEE Transactions on Medical Imaging 32, 1587–1599.
  7. Understanding the Pathophysiology of Intracranial Aneurysm: The ICAN Project. Neurosurgery 80, 621–626.
  8. Rare coding variants in angptl6 are associated with familial forms of intracranial aneurysm. American Journal of Human Genetics 102, 133–141.
  9. Learning from mouse CT-scan brain images to detect MRA-TOF human vasculatures, in: 43rd IEEE EMBC, pp. 2830–2834.
  10. Automated computer-assisted detection system for cerebral aneurysms in time-of-flight magnetic resonance angiography using fully convolutional network. BioMedical Engineering OnLine 19, 1–10.
  11. Towards automated brain aneurysm detection in tof-mra: Open data, weak labels, and anatomical knowledge. Neuroinformatics 21, 21–34.
  12. Algorithms for smoothing data with periodic and parametric splines. Computer Graphics and Image Processing 20, 171–184.
  13. Curve and surface fitting with splines. Monographs on Numerical Analysis 63, 427–428. doi:https://doi.org/10.2307/2153590.
  14. Performance of a deep-learning neural network to detect intracranial aneurysms from 3d tof-mra compared to human readers. Clinical neuroradiology 30, 591–598.
  15. Automated detection of intracranial aneurysms using skeleton-based 3d patches, semantic segmentation, and auxiliary classification for overcoming data imbalance in brain tof-mra. Scientific Reports 13, 12018.
  16. Vascusynth: Simulating vascular trees for generating volumetric image data with ground truth segmentation and tree analysis. Computerized Medical Imaging and Graphics 34, 605–616. doi:10.1016/j.compmedimag.2010.06.002.
  17. Hotpig: a novel graph-based 3-d image feature set and its applications to computer-assisted detection of cerebral aneurysms and lung nodules. International journal of computer assisted radiology and surgery 14, 2095–2107.
  18. Statistical and structural approaches to texture. Proceedings of the IEEE 67, 786–804.
  19. Detection and analysis of cerebral aneurysms based on x-ray rotational angiography - the cada 2020 challenge. Medical Image Analysis 77, 102333.
  20. A deep learning algorithm may automate intracranial aneurysm detection on mr angiography with high diagnostic performance. European Radiology 30, 5785–5793.
  21. A three-dimensional model for arterial tree representation, generated by constrained constructive optimization. Computers in Biology and Medicine 29, 19–38. URL: https://www.sciencedirect.com/science/article/pii/S0010482598000456, doi:https://doi.org/10.1016/S0010-4825(98)00045-6.
  22. Physiologically based modeling of 3-d vascular networks and ct scan angiography. IEEE Transactions on Medical Imaging 22, 248–257. doi:10.1109/TMI.2002.808357.
  23. Unruptured cerebral aneurysm, prediction of evolution : The UCAN project. Neurosurgery, Oxford University Press .
  24. Automated detection of intracranial aneurysms based on parent vessel 3d analysis. Medical Image Analysis 14, 149–159. URL: https://www.sciencedirect.com/science/article/pii/S1361841509001212, doi:https://doi.org/10.1016/j.media.2009.10.005.
  25. A fast algorithm for multilevel thresholding. Journal of Information Science and Engineering 17(5), 713–727.
  26. Using deep learning for an automatic detection and classification of the vascular bifurcations along the circle of willis. Medical Image Analysis , 102919URL: https://www.sciencedirect.com/science/article/pii/S1361841523001792, doi:https://doi.org/10.1016/j.media.2023.102919.
  27. Deep neural network-based computer-assisted detection of cerebral aneurysms in mr angiography. Journal of Magnetic Resonance Imaging 47, 948–953.
  28. Feasibility study of a generalized framework for developing computer-aided detection systems—a new paradigm. Journal of digital imaging 30, 629–639.
  29. Method for locating and characterizing bifurcations of a cerebral vascular tree, associated methods and devices. URL: https://patentscope.wipo.int/search/en/detail.jsf?docId=WO2020115162.
  30. Characterization of 3D bifurcations in micro-scan and MRA-TOF images of cerebral vasculature for prediction of intra-cranial aneurysms. Elsevier Computerized Medical Imaging and Graphics 84C.
  31. Deep learning–assisted diagnosis of cerebral aneurysms using the headxnet model. JAMA Network Open 2. URL: https://api.semanticscholar.org/CorpusID:174811733.
  32. Simultaneous segmentation and anatomical labeling of the cerebral vasculature. Medical Image Analysis 32, 201–215.
  33. U-Net: Convolutional networks for biomedical image segmentation, in: Medical Image Computing and Computer-Assisted Intervention (MICCAI), Springer. pp. 234–241.
  34. Diagnosing intracranial aneurysms with mr angiography: systematic review and meta-analysis. Stroke 45, 119–126.
  35. A clinically applicable deep-learning model for detecting intracranial aneurysm in computed tomography angiography images. Nature communications 11, 6090.
  36. Deep learning-based detection of intracranial aneurysms in 3D TOF-MRA. American Journal of Neuroradiology 40, 25–32.
  37. Best practices for convolutional neural networks applied to visual document analysis, in: Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings., pp. 958–963. doi:10.1109/ICDAR.2003.1227801.
  38. Convolutional neural networks for the detection and measurement of cerebral aneurysms on magnetic resonance angiography. Journal of digital imaging 32, 808–815.
  39. Radiation dose reduction opportunities in vascular imaging. Tomography 8, 2618–2638. doi:http://dx.doi.org/10.3390/tomography8050219.
  40. Macroscopic modeling of vascular systems, in: Dohi, T., Kikinis, R. (Eds.), Medical Image Computing and Computer-Assisted Intervention — MICCAI 2002, Springer Berlin Heidelberg, Berlin, Heidelberg. pp. 284–292.
  41. Combo loss: Handling input and output imbalance in multi-organ segmentation. Comput Med Imaging Graph 75, 24–33. doi:10.1016/j.compmedimag.2019.04.005.
  42. Comparing methods of detecting and segmenting unruptured intracranial aneurysms on TOF-MRAS: The ADAM challenge. NeuroImage 238, 118216.
  43. Deep learning for MR angiography: Automated detection of cerebral aneurysms. Radiology 290, 187–194. doi:10.1148/radiol.2018180901. pMID: 30351253.
  44. Machine learning and radiology. Medical image analysis 16, 933–951.
  45. Deep learning for detecting cerebral aneurysms with ct angiography. Radiology 298, 155–163.
  46. Computer-aided detection of intracranial aneurysms in mr angiography. Journal of digital imaging 24, 86–95.
  47. Automatic diagnosis based on spatial information fusion feature for intracranial aneurysm. IEEE Transactions on Medical Imaging 39, 1448–1458. doi:10.1109/TMI.2019.2951439.
  48. Genetics of intracranial aneurysms. Stroke 49, 780–787. doi:https://doi.org/10.1161/STROKEAHA.117.018152.
  49. 3D U-Net: Learning dense volumetric segmentation from sparse annotation, in: Medical Image Computing and Computer-Assisted Intervention (MICCAI), Springer International Publishing. pp. 424–432. arXiv:1606.06650.

Summary

  • The paper’s main contribution is a synthetic model that generates realistic 3D cerebral vasculature and aneurysms to improve CNN-based intracranial aneurysm detection.
  • It integrates precise 3D spline-based arterial geometry and MRA-TOF noise simulation to mimic the structural variability of human brain vessels.
  • Experimental results show that augmenting real data with synthetic patches increases lesion sensitivity from 75.6% to 88.97%, with a modest rise in false positives.

Synthetic Vascular Model for Aneurysm Detection

This paper introduces a comprehensive synthetic model designed to mimic the cerebral vascular tree, including arteries, bifurcations, and intracranial aneurysms (ICAs). The primary goal is to generate a substantial dataset of brain arteries for training 3D Convolutional Neural Networks (CNNs) to segment and detect vascular diseases, specifically ICAs, using Magnetic Resonance Angiography (MRA) Time-Of-Flight (TOF) imaging. The model aims to address the challenge of limited annotated datasets in medical imaging by providing a fully synthetic, customizable data source.

Model Design and Implementation

The synthetic vasculature model (Figure 1) consists of three main components: the geometry of the arteries, the surrounding MRA-TOF noise, and the modeled aneurysm. Figure 1

Figure 1: Overview of the global procedure, encompassing the training step using the synthetic images and the inference step.

Arteries Geometry

The geometry of the vascular tree is modeled using 3D spline functions, allowing for precise control over the shape, orientation, diameter, and tortuosity of the arteries. The process involves extracting 3D coordinates of the arteries' skeleton from segmented MRA-TOF volumes and fitting these centerlines using 3D splines. The polynomial coefficients of the splines are then altered to introduce slight distortions, mimicking the structural variability observed in human vasculature. The diameters of the arteries are determined using a vascular tree characterization tool, and the arteries are thickened by convolving the centerlines with a spherical kernel, the size of which is adapted to the corresponding diameter. Geometric distortions (elastic deformations) are applied to the 3D kernel before convolution to create realistic artery shapes. The model also allows for setting a target gray level amplitude for the arteries and introducing inhomogeneities by applying various kernels along the vessel's centerline.

MRA-TOF Noise

The model includes a detailed representation of the brain, composed of fluids and white/gray matter, all affected by background noise. The different brain components are separated using multi-threshold segmentation or Gaussian Mixture Models (GMMs). Each component can then be geometrically distorted before replicating its overlaying noise. The noise generation process involves creating a high-frequency Gaussian noise with an average set to the target 3D crop, which is then smoothed using a Gaussian filter to match the statistical properties of the target MRA-TOF portion.

Aneurysm Modeling

Synthetic aneurysms are incorporated into the model by first creating a simple 3D sphere, which is then distorted using elastic deformations. The aneurysm center is aligned onto the bisector between the two daughter arteries, with the distance from the aneurysm center to the bifurcation node computed based on the aneurysm radius, the average radius of the branches forming the bifurcation, and the angle formed by the two daughter arteries. A growth parameter allows for adjusting the shift from the aneurysm center to the vessel wall, enabling the modeling of various growth stages.

Figure 2 and Figure 3 show examples of the model's output, demonstrating the accurate representation of both bifurcations and aneurysms. Figure 2

Figure 2: Comparison between the modeled bifurcations and the Ground Truth crop from a MRA-TOF. We show the comparison on terms of both gray level voxels patches (leftmost panels) and 3D bifurcation layout (rightmost panels).

Figure 3

Figure 3: Comparison between the modeled bifurcations (bearing an aneurysm). In the upper sub-figures (3D representations), the aneurysm is represented in blue, the mother artery in green.

Experimental Evaluation

The synthetic model's effectiveness was evaluated by training a 3D U-Net CNN for ICA segmentation and detection. The dataset consisted of 190 MRA-TOFs scans of unruptured ICAs, divided into training and test sets. The training set was augmented with 998 synthetic patches generated by the model. Two experiments were conducted: one using only real MRA-TOF patches (Exp.#1) and another using a combination of real and synthetic patches (Exp.#2).

The results showed that the CNN trained with both real and synthetic patches (Exp.#2) achieved a significantly improved lesion-level sensitivity of 88.97%88.97\% compared to the CNN trained solely on real data (Exp.#1), which had a sensitivity of 75.60%75.60\% (Figure 4). Figure 4

Figure 4: Detection performance of the CNN using real data vs real and synthetic data.

The patient-level sensitivity also improved from 79.65%79.65\% in Exp.#1 to 91.36%91.36\% in Exp.#2. However, the false positive rate increased slightly from $0.22$ in Exp.#1 to $0.40$ in Exp.#2. The model's performance varied depending on the size and location of the aneurysms. Exp.#2 showed improved detection rates for small aneurysms (less than 2 mm) and for aneurysms located along the Middle Cerebral Artery (MCA) and Internal Carotid Artery.

Figure 5 shows the number of missed detections with respect to the aneurysms positions in the test dataset. Figure 5

Figure 5: Missed detections with respect to the aneurysms positions in the test dataset.

The Dice score for the detected aneurysms was comparable between the two experiments, with an average of 0.7585 for Exp.#1 and 0.7613 for Exp.#2 (Figure 6). Figure 6

Figure 6: Dice similarity coefficient of true ICAs.

Conclusion

The synthetic vasculature model provides a valuable tool for generating large datasets of realistic brain arteries and aneurysms, which can be used to train CNNs for ICA segmentation and detection. The results demonstrate that augmenting real MRA-TOF data with synthetic data can significantly improve the sensitivity of ICA detection, particularly for small aneurysms and aneurysms located in specific regions of the brain. While the addition of synthetic data may lead to a slight increase in the false positive rate, the overall improvement in sensitivity makes this approach a promising tool for assisting neuroradiologists in the detection of intracranial aneurysms. Future work may focus on refining the synthetic model to further reduce the false positive rate and to extend its applicability to other imaging modalities, such as CTA and DSA. The source code for the synthetic Vascular Models (VaMos) has been made available on a GitLab repository.

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.