Papers
Topics
Authors
Recent
Search
2000 character limit reached

Continuous and complete liver vessel segmentation with graph-attention guided diffusion

Published 1 Nov 2024 in eess.IV and cs.CV | (2411.00617v2)

Abstract: Improving connectivity and completeness are the most challenging aspects of liver vessel segmentation, especially for small vessels. These challenges require both learning the continuous vessel geometry and focusing on small vessel detection. However, current methods do not explicitly address these two aspects and cannot generalize well when constrained by inconsistent annotations. Here, we take advantage of the generalization of the diffusion model and explicitly integrate connectivity and completeness in our diffusion-based segmentation model. Specifically, we use a graph-attention module that adds knowledge about vessel geometry. Additionally, we perform the graph-attention at multiple-scales, thus focusing on small liver vessels. Our method outperforms five state-of-the-art medical segmentation methods on two public datasets: 3D-ircadb-01 and LiVS.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Survey on liver tumour resection planning system: steps, techniques, and parameters. Journal of Digital Imaging, 33(2):304–323, 2020.
  2. Memory-efficient 3d denoising diffusion models for medical image processing. In Medical Imaging with Deep Learning, 2023.
  3. How attentive are graph attention networks? In International Conference on Learning Representations, 2022.
  4. S. Cetin and G. Unal. A higher-order tensor vessel tractography for segmentation of vascular structures. IEEE Transactions on Medical Imaging, 34(10):2172–2185, 2015.
  5. Learning continuous image representation with local implicit image function. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8628–8638, 2021.
  6. Accurate vessel segmentation with constrained b-snake. IEEE Transactions on Image Processing, 24(8):2440–2455, 2015.
  7. Accurate liver vessel segmentation via active contour model with dense vessel candidates. Computer methods and programs in biomedicine, 166:61–75, 2018.
  8. Metastatic patterns of cancers: results from a large autopsy study. Archives of pathology & laboratory medicine, 132(6):931–939, 2008.
  9. Multiple hypothesis template tracking of small 3d vessel structures. Medical image analysis, 14(2):160–171, 2010.
  10. Laplacian salience-gated feature pyramid network for accurate liver vessel segmentation. IEEE Transactions on Medical Imaging, May 2023.
  11. A function for quality evaluation of retinal vessel segmentations. IEEE Transactions on Medical Imaging, 31(2):231–239, 2011.
  12. Swin unetr: Swin transformers for semantic segmentation of brain tumors in mri images. In International MICCAI Brainlesion Workshop, pages 272–284, September 2021.
  13. Denoising diffusion probabilistic models. In Advances in neural information processing systems, volume 33, pages 6840–6851, 2020.
  14. H.W. Huang. Influence of blood vessel on the thermal lesion formation during radiofrequency ablation for liver tumors. Medical physics, 40(7):073303, 2013.
  15. Robust liver vessel extraction using 3d u-net with variant dice loss function. Computers in Biology and Medicine, 101:153–162, 2018.
  16. Combining deep learning with anatomical analysis for segmentation of the portal vein for liver sbrt planning. Physics in Medicine & Biology, 62(23):8943, 2017.
  17. nnu-net: A self-configuring method for deep learning-based biomedical image segmentation. Nature methods, 18(2):203–211, 2021.
  18. Vesselnet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation. Computerized Medical Imaging and Graphics, 75:74–83, 2019.
  19. A benchmark framework for multiregion analysis of vesselness filters. IEEE Transactions on Medical Imaging, 41(12):3649–3662, 2022.
  20. 3d graph-connectivity constrained network for hepatic vessel segmentation. IEEE Journal of Biomedical and Health Informatics, 26(3):1251–1262, 2021.
  21. The immunological and metabolic landscape in primary and metastatic liver cancer. Nature Reviews Cancer, 21(9):541–557, 2021.
  22. Anatomy-aided deep learning for medical image segmentation: a review. Physics in Medicine & Biology, 66(11):11TR01, 2021.
  23. Understanding the effective receptive field in semantic image segmentation. Multimedia Tools and Applications, 77:22159–22171, 2018.
  24. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pages 10012–10022, 2021.
  25. Hepatocellular carcinoma. Nat Rev Dis Primers, 7(6), 2021.
  26. Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps. In S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 5775–5787. Curran Associates, Inc., 2022.
  27. Towards a guideline for evaluation metrics in medical image segmentation. BMC Research Notes, 15(1):210, 2022.
  28. A.Q. Nichol and P. Dhariwal. Improved denoising diffusion probabilistic models. In International Conference on Machine Learning, pages 8162–8171. PMLR, July 2021.
  29. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention, pages 234–241. Springer International Publishing, 2015.
  30. Graph refinement based airway extraction using mean-field networks and graph neural networks. Medical image analysis, 64:101751, 2020.
  31. Deep vessel segmentation by learning graphical connectivity. Medical Image Analysis, 58:101556, 2019.
  32. cldice-a novel topology-preserving loss function for tubular structure segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 16560–16569, 2021.
  33. Uncertainty-based graph convolutional networks for organ segmentation refinement. In Medical Imaging with Deep Learning, pages 755–769. PMLR, 2020.
  34. 3d image reconstruction for comparison of algorithm database: A patient specific anatomical and medical image database.
  35. Effects of enhancement on deep learning based hepatic vessel segmentation. Electronics, 10(10):1165, 2021.
  36. Graph-convolutional-network-based interactive prostate segmentation in mr images. Medical physics, 47(9):4164–4176, 2020.
  37. Graph Attention Networks. International Conference on Learning Representations, 2018.
  38. Transfusionnet: Semantic and spatial features fusion framework for liver tumor and vessel segmentation under jetsontx2. IEEE Journal of Biomedical and Health Informatics, 27(3):1173–1184, 2022.
  39. J.R. Weaver. Centrosymmetric (cross-symmetric) matrices, their basic properties, eigenvalues, and eigenvectors. The American Mathematical Monthly, 92(10):711–717, 1985.
  40. Diffusion models for implicit image segmentation ensembles. In International Conference on Medical Imaging with Deep Learning, pages 1336–1348. PMLR, December 2022.
  41. Medsegdiff: Medical image segmentation with diffusion probabilistic model. In Medical Imaging with Deep Learning, 2023.
  42. Hepatic vessel segmentation based on 3d swin-transformer with inductive biased multi-head self-attention. BMC Medical Imaging, 23(1):1–14, 2023.
  43. Diff-unet: A diffusion embedded network for volumetric segmentation. CoRR, 2023.
  44. Attention-guided deep neural network with multi-scale feature fusion for liver vessel segmentation. IEEE Journal of Biomedical and Health Informatics, 25(7):2629–2642, 2020.
  45. User-guided 3d active contour segmentation of anatomical structures: Significantly improved efficiency and reliability. Neuroimage, 31(3):1116–1128, Jul 2006.
  46. Graph attention network based pruning for reconstructing 3d liver vessel morphology from contrasted ct images. CoRR, 2020.
  47. Rethinking dice loss for medical image segmentation. In 2020 IEEE International Conference on Data Mining (ICDM), pages 851–860. IEEE, 2020.

Summary

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 0 likes about this paper.