Papers
Topics
Authors
Recent
Search
2000 character limit reached

Robot-Assisted Deep Venous Thrombosis Ultrasound Examination using Virtual Fixture

Published 4 Jan 2024 in cs.RO and cs.CV | (2401.02539v1)

Abstract: Deep Venous Thrombosis (DVT) is a common vascular disease with blood clots inside deep veins, which may block blood flow or even cause a life-threatening pulmonary embolism. A typical exam for DVT using ultrasound (US) imaging is by pressing the target vein until its lumen is fully compressed. However, the compression exam is highly operator-dependent. To alleviate intra- and inter-variations, we present a robotic US system with a novel hybrid force motion control scheme ensuring position and force tracking accuracy, and soft landing of the probe onto the target surface. In addition, a path-based virtual fixture is proposed to realize easy human-robot interaction for repeat compression operation at the lesion location. To ensure the biometric measurements obtained in different examinations are comparable, the 6D scanning path is determined in a coarse-to-fine manner using both an external RGBD camera and US images. The RGBD camera is first used to extract a rough scanning path on the object. Then, the segmented vascular lumen from US images are used to optimize the scanning path to ensure the visibility of the target object. To generate a continuous scan path for developing virtual fixtures, an arc-length based path fitting model considering both position and orientation is proposed. Finally, the whole system is evaluated on a human-like arm phantom with an uneven surface.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. V. Kakkar, “Prevention of venous thrombosis and pulmonary embolism,” The American journal of cardiology, vol. 65, no. 6, pp. C50–C54, 1990.
  2. B. Kassaï, J.-P. Boissel, M. Cucherat, S. Sonie, N. R. Shah, and A. Leizorovicz, “A systematic review of the accuracy of ultrasound in the diagnosis of deep venous thrombosis in asymptomatic patients,” Thrombosis and haemostasis, vol. 91, no. 04, pp. 655–666, 2004.
  3. J. Guerrero, S. Salcudean, J. McEwen, B. Masri, and S. Nicolaou, “Deep venous thrombosis screening system using numerical measures,” in Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439), vol. 1, 2003, pp. 894–897 Vol.1.
  4. Z. Jiang, M. Grimm, M. Zhou, J. Esteban, W. Simson, G. Zahnd, and N. Navab, “Automatic normal positioning of robotic ultrasound probe based only on confidence map optimization and force measurement,” IEEE RAL, vol. 5, no. 2, pp. 1342–1349, 2020.
  5. M. W. Gilbertson and B. W. Anthony, “Force and position control system for freehand ultrasound,” IEEE Transactions on Robotics, vol. 31, no. 4, pp. 835–849, 2015.
  6. Z. Jiang, M. Grimm, M. Zhou, Y. Hu, J. Esteban, and N. Navab, “Automatic force-based probe positioning for precise robotic ultrasound acquisition,” IEEE Transactions on Industrial Electronics, vol. 68, no. 11, pp. 11 200–11 211, 2020.
  7. M. K. Welleweerd, A. G. de Groot, V. Groenhuis, F. J. Siepel, and S. Stramigioli, “Out-of-plane corrections for autonomous robotic breast ultrasound acquisitions,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 12 515–12 521.
  8. X. Ma, Z. Zhang, and H. K. Zhang, “Autonomous scanning target localization for robotic lung ultrasound imaging,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2021, pp. 9467–9474.
  9. Z. Jiang, Z. Li, M. Grimm, M. Zhou, M. Esposito, W. Wein, W. Stechele, T. Wendler, and N. Navab, “Autonomous robotic screening of tubular structures based only on real-time ultrasound imaging feedback,” IEEE TIE, vol. 69, no. 7, pp. 7064–7075, 2021.
  10. D. Huang, Y. Bi, N. Navab, and Z. Jiang, “Motion magnification in robotic sonography: enabling pulsation-aware artery segmentation,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2023, pp. 6565–6570.
  11. Z. Jiang, F. Duelmer, and N. Navab, “Dopus-net: Quality-aware robotic ultrasound imaging based on doppler signal,” IEEE Transactions on Automation Science and Engineering, 2023.
  12. Z. Jiang, Y. Bi, M. Zhou, Y. Hu, M. Burke et al., “Intelligent robotic sonographer: Mutual information-based disentangled reward learning from few demonstrations,” The International Journal of Robotics Research, 2023.
  13. Z. Jiang, S. E. Salcudean, and N. Navab, “Robotic ultrasound imaging: State-of-the-art and future perspectives,” Medical image analysis, p. 102878, 2023.
  14. B. Meng and J. Liu, “Robotic ultrasound scanning for deep venous thrombosis detection using rgb-d sensor,” in 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), 2015, pp. 482–486.
  15. T. Gold, A. Völz, and K. Graichen, “Model predictive interaction control for robotic manipulation tasks,” IEEE Transactions on Robotics, pp. 1–14, 2022.
  16. L. Halt, F. Pan, P. Tenbrock, A. Pott, and T. Seel, “A transferable force controller based on prescribed performance for contact establishment in robotic assembly tasks,” in 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), 2019, pp. 830–835.
  17. Y. Wu and X.-J. Xie, “Robust adaptive control for state-constrained nonlinear systems with input saturation and unknown control direction,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 51, no. 2, pp. 1192–1202, 2021.
  18. C. Yang, D. Huang, W. He, and L. Cheng, “Neural control of robot manipulators with trajectory tracking constraints and input saturation,” IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 9, pp. 4231–4242, 2021.
  19. Q. Huang, J. Lan, and X. Li, “Robotic arm based automatic ultrasound scanning for three-dimensional imaging,” IEEE Transactions on Industrial Informatics, vol. 15, no. 2, pp. 1173–1182, 2019.
  20. R. Goel, F. Abhimanyu, K. Patel, J. Galeotti, and H. Choset, “Autonomous ultrasound scanning using bayesian optimization and hybrid force control,” in 2022 International Conference on Robotics and Automation (ICRA), 2022, pp. 8396–8402.
  21. Z. Jiang, Y. Gao, L. Xie, and N. Navab, “Towards autonomous atlas-based ultrasound acquisitions in presence of articulated motion,” IEEE Robotics and Automation Letters, vol. 7, no. 3, pp. 7423–7430, 2022.
  22. S. A. Bowyer, B. L. Davies, and F. R. y Baena, “Active constraints/virtual fixtures: A survey,” IEEE Transactions on Robotics, vol. 30, no. 1, pp. 138–157, 2013.
  23. J. Feng, X. Li, X. Xiao, B. Ouyang, and J. Fang, “Virtual fixtures assistance for safe polyp dissection in minimally invasive robotic surgery,” in 2021 5th International Conference on Automation, Control and Robots (ICACR), 2021, pp. 150–155.
  24. Z. Li, A. Gordon, T. Looi, J. Drake, C. Forrest, and R. H. Taylor, “Anatomical mesh-based virtual fixtures for surgical robots,” in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020, pp. 3267–3273.
  25. J. Tan, Y. Li, B. Li, Y. Leng, J. Peng, J. Wu, B. Luo, X. Chen, Y. Rong, and C. Fu, “Automatic generation of autonomous ultrasound scanning trajectory based on 3d point cloud,” IEEE Transactions on Medical Robotics and Bionics, pp. 1–1, 2022.
  26. R. Tsai and R. Lenz, “A new technique for fully autonomous and efficient 3d robotics hand/eye calibration,” IEEE Transactions on Robotics and Automation, vol. 5, no. 3, pp. 345–358, 1989.
  27. L.-J. Zhang, R.-Q. Hu, and W.-M. Yi, “Research on force sensing for the end-load of industrial robot based on a 6-axis force/torque sensor,” Acta Autom. Sin, vol. 43, pp. 439–447, 2017.
  28. Z. Jiang, N. Danis, Y. Bi, M. Zhou, M. Kroenke, T. Wendler, and N. Navab, “Precise repositioning of robotic ultrasound: Improving registration-based motion compensation using ultrasound confidence optimization,” IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1–11, 2022.
  29. T. Gašpar, B. Nemec, J. Morimoto, and A. Ude, “Skill learning and action recognition by arc-length dynamic movement primitives,” Robotics and Autonomous Systems, vol. 100, pp. 225–235, 2018.
  30. R. Wang, Y. Wu, W. L. Chan, and K. P. Tee, “Dynamic movement primitives plus: For enhanced reproduction quality and efficient trajectory modification using truncated kernels and local biases,” in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, pp. 3765–3771.
  31. C. G. Atkeson, A. W. Moore, and S. Schaal, “Locally weighted learning,” Lazy learning, pp. 11–73, 1997.
  32. L. Koutras and Z. Doulgeri, “A correct formulation for the orientation dynamic movement primitives for robot control in the cartesian space,” in Proceedings of the Conference on Robot Learning, ser. Proceedings of Machine Learning Research, L. P. Kaelbling, D. Kragic, and K. Sugiura, Eds., vol. 100.   PMLR, 30 Oct–01 Nov 2020, pp. 293–302.
  33. T. Lee, R. Kashyap, and C. Chu, “Building skeleton models via 3-d medial surface axis thinning algorithms,” CVGIP: Graphical Models and Image Processing, vol. 56, no. 6, pp. 462–478, 1994.
  34. M. Dyck, A. Sachtler, J. Klodmann, and A. Albu-Schäffer, “Impedance control on arbitrary surfaces for ultrasound scanning using discrete differential geometry,” IEEE Robotics and Automation Letters, vol. 7, no. 3, pp. 7738–7746, 2022.
  35. Y. Cao, Y. Song, and C. Wen, “Practical tracking control of perturbed uncertain nonaffine systems with full state constraints,” Automatica, vol. 110, p. 108608, 2019.
  36. Z. Jiang, H. Wang, Z. Li, M. Grimm, M. Zhou, U. Eck, S. V. Brecht, T. C. Lueth, T. Wendler, and N. Navab, “Motion-aware robotic 3d ultrasound,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 12 494–12 500.
  37. F. Abhimanyu, A. L. Orekhov, J. Galeotti, and H. Choset, “Unsupervised deformable image registration for respiratory motion compensation in ultrasound images,” arXiv preprint arXiv:2306.13332, 2023.
  38. Z. Jiang, Y. Zhou, Y. Bi, M. Zhou, T. Wendler, and N. Navab, “Deformation-aware robotic 3d ultrasound,” IEEE Robotics and Automation Letters, vol. 6, no. 4, pp. 7675–7682, 2021.
  39. Z. Jiang, Y. Zhou, D. Cao, and N. Navab, “Defcor-net: Physics-aware ultrasound deformation correction,” Medical Image Analysis, vol. 90, p. 102923, 2023.
Citations (7)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up