Unsupervised Deformable Image Registration for Respiratory Motion Compensation in Ultrasound Images
Abstract: In this paper, we present a novel deep-learning model for deformable registration of ultrasound images and an unsupervised approach to training this model. Our network employs recurrent all-pairs field transforms (RAFT) and a spatial transformer network (STN) to generate displacement fields at online rates (apprx. 30 Hz) and accurately track pixel movement. We call our approach unsupervised recurrent all-pairs field transforms (U-RAFT). In this work, we use U-RAFT to track pixels in a sequence of ultrasound images to cancel out respiratory motion in lung ultrasound images. We demonstrate our method on in-vivo porcine lung videos. We show a reduction of 76% in average pixel movement in the porcine dataset using respiratory motion compensation strategy. We believe U-RAFT is a promising tool for compensating different kinds of motions like respiration and heartbeat in ultrasound images of deformable tissue.
- G. Renault, F. Tranquart, V. Perlbarg, A. Bleuzen, A. Herment, and F. Frouin, “A posteriori respiratory gating in contrast ultrasound for assessment of hepatic perfusion,” Physics in Medicine & Biology, vol. 50, no. 19, p. 4465, 2005.
- M. Averkiou, M. Lampaskis, K. Kyriakopoulou, D. Skarlos, G. Klouvas, C. Strouthos, and E. Leen, “Quantification of tumor microvascularity with respiratory gated contrast enhanced ultrasound for monitoring therapy,” Ultrasound in medicine & biology, vol. 36, no. 1, pp. 68–77, 2010.
- S. Mulé, N. Kachenoura, O. Lucidarme, A. De Oliveira, C. Pellot-Barakat, A. Herment, and F. Frouin, “An automatic respiratory gating method for the improvement of microcirculation evaluation: application to contrast-enhanced ultrasound studies of focal liver lesions,” Physics in Medicine & Biology, vol. 56, no. 16, p. 5153, 2011.
- Z. Teed and J. Deng, “RAFT: Recurrent all-pairs field transforms for optical flow,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II 16. Springer, 2020, pp. 402–419.
- C. Che, T. S. Mathai, and J. Galeotti, “Ultrasound registration: A review,” Methods, vol. 115, pp. 128–143, 2017.
- M. Jaderberg, K. Simonyan, A. Zisserman, and k. kavukcuoglu, “Spatial transformer networks,” in Advances in Neural Information Processing Systems, C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett, Eds., vol. 28. Curran Associates, Inc., 2015.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.