Papers
Topics
Authors
Recent
Search
2000 character limit reached

Stitching Dynamic Movement Primitives and Image-based Visual Servo Control

Published 29 Oct 2021 in cs.RO, cs.SY, and eess.SY | (2111.00088v6)

Abstract: Utilizing perception for feedback control in combination with Dynamic Movement Primitive (DMP)-based motion generation for a robot's end-effector control is a useful solution for many robotic manufacturing tasks. For instance, while performing an insertion task when the hole or the recipient part is not visible in the eye-in-hand camera, a learning-based movement primitive method can be used to generate the end-effector path. Once the recipient part is in the field of view (FOV), Image-based Visual Servo (IBVS) can be used to control the motion of the robot. Inspired by such applications, this paper presents a generalized control scheme that switches between motion generation using DMPs and IBVS control. To facilitate the design, a common state space representation for the DMP and the IBVS systems is first established. Stability analysis of the switched system using multiple Lyapunov functions shows that the state trajectories converge to a bound asymptotically. The developed method is validated by two real world experiments using the eye-in-hand configuration on a Baxter research robot.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. E. Tunstel, A. Dani, C. Martinez, B. Blakeslee, J. Mendoza, R. Saltus, D. Trombetta, G. Rotithor, T. Fuhlbrigge, D. Lasko, and J. Wang, “Robotic wire pinning for wire harness assembly automation,” IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp. 1208–1215, 2020.
  2. A. J. Ijspeert, J. Nakanishi, and S. Schaal, “Learning attractor landscapes for learning motor primitives,” in Advances in Neural Information Processing Systems, 2003, pp. 1547–1554.
  3. F. Chaumette and S. Hutchinson, “Visual servo control. I. basic approaches,” IEEE Robotics & Automation Magazine, vol. 13, no. 4, pp. 82–90, 2006.
  4. G. López-Nicolás, N. R. Gans, S. Bhattacharya, C. Sagüés, J. J. Guerrero, and S. Hutchinson, “Homography-based control scheme for mobile robots with nonholonomic and field-of-view constraints,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 40, no. 4, pp. 1115–1127, 2009.
  5. N. R. Gans, G. Hu, K. Nagarajan, and W. E. Dixon, “Keeping multiple moving targets in the field-of-view of a mobile camera,” IEEE Transactions on Robotics, vol. 27, no. 4, pp. 822–828, 2011.
  6. I. Salehi, G. Rotithor, R. Saltus, and A. P. Dani, “Constrained image-based visual servoing using barrier functions,” in IEEE International Conference on Robotics and Automation, 2021, pp. 14 254–14 260.
  7. R. Wang, X. Zhang, Y. Fang, and B. Li, “Virtual-goal-guided rrt for visual servoing of mobile robots with fov constraint,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 52, no. 4, pp. 2073–2083, 2022.
  8. Y. Huang, M. Zhu, Z. Zheng, and K. H. Low, “Linear velocity-free visual servoing control for unmanned helicopter landing on a ship with visibility constraint,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 52, no. 5, pp. 2979–2993, 2022.
  9. F. Ke, Z. Li, H. Xiao, and X. Zhang, “Visual servoing of constrained mobile robots based on model predictive control,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 47, no. 7, pp. 1428–1438, 2017.
  10. D. Liberzon and A. S. Morse, “Basic problems in stability and design of switched systems,” IEEE Control Systems Magazine, vol. 19, no. 5, pp. 59–70, 1999.
  11. J. P. Hespanha and A. S. Morse, “Stability of switched systems with average dwell-time,” in Proceedings of the 38th IEEE Conference on Decision and Control, vol. 3, 1999, pp. 2655–2660.
  12. J. Daafouz, P. Riedinger, and C. Iung, “Stability analysis and control synthesis for switched systems: a switched Lyapunov function approach,” IEEE Transactions on Automatic Control, vol. 47, no. 11, pp. 1883–1887, 2002.
  13. J. P. Hespanha, “Uniform stability of switched linear systems: Extensions of LaSalle’s invariance principle,” IEEE Transactions on Automatic Control, vol. 49, no. 4, pp. 470–482, 2004.
  14. H. Lin and P. J. Antsaklis, “Stability and stabilizability of switched linear systems: a survey of recent results,” IEEE Transactions on Automatic Control, vol. 54, no. 2, pp. 308–322, 2009.
  15. M. S. Branicky, “Multiple Lyapunov functions and other analysis tools for switched and hybrid systems,” IEEE Transactions on Automatic Control, vol. 43, no. 4, pp. 475–482, 1998.
  16. R. Kamalapurkar, J. A. Rosenfeld, A. Parikh, A. R. Teel, and W. E. Dixon, “Invariance-like results for nonautonomous switched systems,” IEEE Transactions on Automatic Control, vol. 64, no. 2, pp. 614–627, 2018.
  17. D. Astolfi, R. Postoyan, and D. Nesic, “Uniting observers,” IEEE Transactions on Automatic Control, vol. 65, no. 7, pp. 2867–2882, 2020.
  18. C. Prieur and A. R. Teel, “Uniting local and global output feedback controllers,” IEEE Transactions on Automatic Control, vol. 56, no. 7, pp. 1636–1649, 2011.
  19. N. R. Gans and S. A. Hutchinson, “Stable visual servoing through hybrid switched-system control,” IEEE Transactions on Robotics, vol. 23, no. 3, pp. 530–540, 2007.
  20. A. Parikh, T.-H. Cheng, H.-Y. Chen, and W. E. Dixon, “A switched systems framework for guaranteed convergence of image-based observers with intermittent measurements,” IEEE Transactions on Robotics, vol. 33, no. 2, pp. 266–280, 2016.
  21. A. Parikh, R. Kamalapurkar, and W. E. Dixon, “Target tracking in the presence of intermittent measurements via motion model learning,” IEEE Transactions on Robotics, vol. 34, no. 3, pp. 805–819, 2018.
  22. A. Parikh, T.-H. Cheng, R. Licitra, and W. E. Dixon, “A switched systems approach to image-based localization of targets that temporarily leave the camera field of view,” IEEE Transactions on Control Systems Technology, vol. 26, no. 6, pp. 2149–2156, 2017.
  23. H. Chen, Z. I. Bell, P. Deptula, and W. E. Dixon, “A switched systems approach to path following with intermittent state feedback,” IEEE Transactions on Robotics, vol. 35, no. 3, pp. 725–733, 2019.
  24. C. G. Harris, Z. I. Bell, E. A. Doucette, J. W. Curtis, and W. E. Dixon, “Target tracking in the presence of intermittent measurements by a sparsely distributed network of stationary cameras,” in American Control Conference, 2020, pp. 3491–3496.
  25. H.-Y. Chen, Z. I. Bell, P. Deptula, and W. E. Dixon, “A switched systems framework for path following with intermittent state feedback,” IEEE Control Systems Letters, vol. 2, no. 4, pp. 749–754, 2018.
  26. S. Veer and I. Poulakakis, “Switched systems with multiple equilibria under disturbances: Boundedness and practical stability,” IEEE Transactions on Automatic Control, vol. 65, no. 6, pp. 2371–2386, 2020.
  27. G. Rotithor and A. P. Dani, “Combining motion primitives and image-based visual servo control,” in International Symposium on Flexible Automation.   American Society of Mechanical Engineers, 2020.
  28. G. Rotithor, D. Trombetta, R. Kamalapurkar, and A. P. Dani, “Full- and reduced-order observers for image-based depth estimation using concurrent learning,” IEEE Transactions on Control Systems Technology, vol. 29, no. 6, pp. 2647–2653, 2021.
  29. F. Chaumette, “Potential problems of stability and convergence in image-based and position-based visual servoing,” in The Confluence of Vision and Control.   Springer, 1998, pp. 66–78.
  30. D. Han, Q. Wei, Z. Li, and W. Sun, “Control of oriented mechanical systems: A method based on dual quaternion,” IFAC Proceedings Volumes, vol. 41, no. 2, pp. 3836–3841, 2008.
  31. A. Ude, B. Nemec, T. Petrić, and J. Morimoto, “Orientation in Cartesian space dynamic movement primitives,” IEEE International Conference on Robotics and Automation (ICRA), pp. 2997–3004, 2014.
  32. L. Vu, D. Chatterjee, and D. Liberzon, “Input-to-state stability of switched systems and switching adaptive control,” Automatica, vol. 43, no. 4, pp. 639–646, 2007.
  33. J. R. Klotz, A. Parikh, T. Cheng, and W. E. Dixon, “Decentralized synchronization of uncertain nonlinear systems with a reputation algorithm,” IEEE Transactions on Control of Network Systems, vol. 5, no. 1, pp. 434–445, 2018.
  34. J. Ye, S. Roy, M. Godjevac, and S. Baldi, “A switching control perspective on the offshore construction scenario of heavy-lift vessels,” IEEE Transactions on Control Systems Technology, vol. 29, no. 1, pp. 470–477, 2021.
Citations (3)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up