Papers
Topics
Authors
Recent
Search
2000 character limit reached

Cycloidal Quasi-Direct Drive Actuator Designs with Learning-based Torque Estimation for Legged Robotics

Published 22 Oct 2024 in cs.RO | (2410.16591v2)

Abstract: This paper presents a novel approach through the design and implementation of Cycloidal Quasi-Direct Drive actuators for legged robotics. The cycloidal gear mechanism, with its inherent high torque density and mechanical robustness, offers significant advantages over conventional designs. By integrating cycloidal gears into the Quasi-Direct Drive framework, we aim to enhance the performance of legged robots, particularly in tasks demanding high torque and dynamic loads, while still keeping them lightweight. Additionally, we develop a torque estimation framework for the actuator using an Actuator Network, which effectively reduces the sim-to-real gap introduced by the cycloidal drive's complex dynamics. This integration is crucial for capturing the complex dynamics of a cycloidal drive, which contributes to improved learning efficiency, agility, and adaptability for reinforcement learning.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (39)
  1. N. Kau, A. Schultz, N. Ferrante, and P. Slade, “Stanford doggo: An open-source, quasi-direct-drive quadruped,” in 2019 International conference on robotics and automation.   IEEE, 2019, pp. 6309–6315.
  2. G. Kenneally, A. De, and D. E. Koditschek, “Design principles for a family of direct-drive legged robots,” vol. 1, no. 2, pp. 900–907. [Online]. Available: http://ieeexplore.ieee.org/document/7403902/
  3. S. Seok, A. Wang, M. Y. Chuah, D. Otten, J. Lang, and S. Kim, “Design principles for highly efficient quadrupeds and implementation on the mit cheetah robot,” in 2013 IEEE International Conference on Robotics and Automation.   IEEE, 2013, pp. 3307–3312.
  4. T. Li, X. An, X. Deng, J. Li, and Y. Li, “A new tooth profile modification method of cycloidal gears in precision reducers for robots,” Applied Sciences, vol. 10, no. 4, 2020. [Online]. Available: https://www.mdpi.com/2076-3417/10/4/1266
  5. K. Lee, S. Hong, and J.-H. Oh, “Development of a lightweight and high-efficiency compact cycloidal reducer for legged robots,” vol. 21, no. 3, pp. 415–425. [Online]. Available: http://link.springer.com/10.1007/s12541-019-00215-9
  6. J. W. Sensinger and J. H. Lipsey, “Cycloid vs. harmonic drives for use in high ratio, single stage robotic transmissions,” in 2012 IEEE International Conference on Robotics and Automation.   IEEE, pp. 4130–4135. [Online]. Available: http://ieeexplore.ieee.org/document/6224739/
  7. R. Soni, D. Harnack, H. Isermann, S. Fushimi, S. Kumar, and F. Kirchner, “End-to-end reinforcement learning for torque based variable height hopping,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, Oct. 2023. [Online]. Available: http://dx.doi.org/10.1109/IROS55552.2023.10342187
  8. J. Hwangbo, J. Lee, A. Dosovitskiy, D. Bellicoso, V. Tsounis, V. Koltun, and M. Hutter, “Learning agile and dynamic motor skills for legged robots,” Science Robotics, vol. 4, no. 26, p. eaau5872, 2019. [Online]. Available: https://www.science.org/doi/abs/10.1126/scirobotics.aau5872
  9. T. Li, J. Zhou, X. Deng, J. Li, C. Xing, J. Su, and H. Wang, “A manufacturing error measurement methodology for a rotary vector reducer cycloidal gear based on a gear measuring center,” vol. 29, no. 7, p. 075006, publisher: IOP Publishing. [Online]. Available: https://iopscience.iop.org/article/10.1088/1361-6501/aac00a
  10. Y. Ye, R. B. Scharff, S. Long, C. Han, and D. Du, “Modelling of soft fiber-reinforced bending actuators through transfer learning from a machine learning algorithm trained from fem data,” Sensors and Actuators A: Physical, vol. 368, p. 115095, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0924424724000888
  11. Y. Tanaka, A. Schperberg, A. Zhu, and D. Hong, “Scaler-b: A multi-modal versatile robot for simultaneous locomotion and grasping,” in IEEE International Conference on Robotics and Automation @ 40 (ICRA@40).
  12. Y. Tanaka, Y. Shirai, X. Lin, A. Schperberg, H. Kato, A. Swerdlow, N. Kumagai, and D. Hong, “Scaler: A tough versatile quadruped free-climber robot,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2022, pp. 5632–5639.
  13. Y. Tanaka, Y. Shirai, Z. Lacey, X. Lin, J. Liu, and D. Hong, “An under-actuated whippletree mechanism gripper based on multi-objective design optimization with auto-tuned weights,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2021, pp. 6139–6146.
  14. Y. Liu, J. Shen, J. Zhang, X. Zhang, T. Zhu, and D. Hong, “Design and control of a miniature bipedal robot with proprioceptive actuation for dynamic behaviors,” in 2022 International Conference on Robotics and Automation (ICRA), 2022, pp. 8547–8553.
  15. T. Suzuki, M. Bando, K. Kawaharazuka, K. Okada, and M. Inaba, “Saqiel: Ultra-light and safe manipulator with passive 3d wire alignment mechanism,” IEEE Robotics and Automation Letters, vol. 9, no. 4, pp. 3720–3727, 2024.
  16. G. A. Pratt and M. M. Williamson, “Series elastic actuators,” in Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots, vol. 1, 1995, pp. 399–406 vol.1.
  17. B. Vanderborght, A. Albu-Schaeffer, A. Bicchi, E. Burdet, D. G. Caldwell, R. Carloni, M. Catalano, O. Eiberger, W. Friedl, G. Ganesh, M. Garabini, M. Grebenstein, G. Grioli, S. Haddadin, H. Hoppner, A. Jafari, M. Laffranchi, D. Lefeber, F. Petit, S. Stramigioli, N. Tsagarakis, M. Van Damme, R. Van Ham, L. C. Visser, and S. Wolf, “Variable impedance actuators: A review,” Robot. Auton. Syst., vol. 61, no. 12, p. 1601–1614, Dec. 2013. [Online]. Available: https://doi.org/10.1016/j.robot.2013.06.009
  18. Y. Zhao, S. Lin, Z. Zhu, and Z. Jia, “A bipedal wheel-legged robot with high-frequency force control by qausi-direct drive: Design and experiments,” in 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2022, pp. 58–63.
  19. G. Kenneally, A. De, and D. E. Koditschek, “Design principles for a family of direct-drive legged robots,” IEEE Robotics and Automation Letters, vol. 1, no. 2, pp. 900–907, 2016.
  20. J. Luo, S. Ye, J. Su, and B. Jin, “Prismatic quasi-direct-drives for dynamic quadruped locomotion with high payload capacity,” International Journal of Mechanical Sciences, vol. 235, p. 107698, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0020740322005793
  21. A. Bajpai, C. Carrasquillo, J. Carlson, J. Park, D. Iyengar, K. Herrin, A. J. Young, and A. Mazumdar, “Design and validation of a versatile high torque quasidirect drive hip exoskeleton,” IEEE/ASME Transactions on Mechatronics, vol. 29, no. 1, pp. 789–797, 2024.
  22. C. A. Pérez-Díaz, I. Muñoz, D. Martin-Hernández, C. Candelo-Zuluaga, I. Torres, J. Marsà, D. Sanz-Merodio, and M. López, “Design and experimental characterisation of a novel quasi-direct drive actuator for highly dynamic robotic applications,” in 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, pp. 183–189.
  23. P. L. García, S. Crispel, E. Saerens, T. Verstraten, and D. Lefeber, “Compact gearboxes for modern robotics: A review,” vol. 7, p. 103. [Online]. Available: https://www.frontiersin.org/article/10.3389/frobt.2020.00103/full
  24. M. Penčić, M. Čavić, and B. Borovac, “Development of the low backlash planetary gearbox for humanoid robots.” FME Transactions, vol. 45, no. 1, 2017.
  25. A. A. Hamza Tariq, Zhaksylyk Galym and C. Spitas, “Assessment of contact forces and stresses, torque ripple and efficiency of a cycloidal gear drive and its involute kinematical equivalent,” Mechanics Based Design of Structures and Machines, vol. 52, no. 3, pp. 1304–1323, 2024. [Online]. Available: https://doi.org/10.1080/15397734.2022.2144885
  26. T. G. Ling, M. F. Rahmat, and A. R. Husain, “System identification and control of an electro-hydraulic actuator system,” in 2012 IEEE 8th International Colloquium on Signal Processing and its Applications, 2012, pp. 85–88.
  27. W. Zhao, J. P. Queralta, and T. Westerlund, “Sim-to-real transfer in deep reinforcement learning for robotics: a survey,” in 2020 IEEE Symposium Series on Computational Intelligence (SSCI), 2020, pp. 737–744.
  28. A. Schperberg, Y. Tanaka, F. Xu, M. Menner, and D. Hong, “Real-to-sim: Predicting residual errors of robotic systems with sparse data using a learning-based unscented kalman filter,” in 2023 20th International Conference on Ubiquitous Robots, 2023, pp. 27–34.
  29. W. Zhu, X. Guo, D. Owaki, K. Kutsuzawa, and M. Hayashibe, “A survey of sim-to-real transfer techniques applied to reinforcement learning for bioinspired robots,” IEEE Transactions on Neural Networks and Learning Systems, vol. 34, no. 7, pp. 3444–3459, 2023.
  30. L. Xu and Y. Yang, “Dynamic modeling and contact analysis of a cycloid-pin gear mechanism with a turning arm cylindrical roller bearing,” Mechanism and Machine Theory, vol. 104, pp. 327–349, 2016. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0094114X16301239
  31. C.-F. Hsieh, “Dynamics Analysis of Cycloidal Speed Reducers With Pinwheel and Nonpinwheel Designs,” Journal of Mechanical Design, vol. 136, no. 9, p. 091008, 06 2014. [Online]. Available: https://doi.org/10.1115/1.4027850
  32. J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” 2014. [Online]. Available: https://arxiv.org/abs/1412.3555
  33. L. N. Smith and N. Topin, “Super-convergence: Very fast training of neural networks using large learning rates,” 2018. [Online]. Available: https://arxiv.org/abs/1708.07120
  34. Z. Zhang, “Improved adam optimizer for deep neural networks,” in 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS), 2018, pp. 1–2.
  35. T. Zhu, J. Hooks, and D. Hong, “Design, modeling, and analysis of a liquid cooled proprioceptive actuator for legged robots,” in 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), vol. 2.   IEEE, pp. 36–43. [Online]. Available: https://ieeexplore.ieee.org/document/8868596/
  36. D. Gebler and J. Holtz, “Identification and compensation of gear backlash without output position sensor in high-precision servo systems,” in IECON’98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No. 98CH36200), vol. 2.   IEEE, 1998, pp. 662–666.
  37. S. Yu, T.-H. Huang, X. Yang, C. Jiao, J. Yang, Y. Chen, J. Yi, and H. Su, “Quasi-direct drive actuation for a lightweight hip exoskeleton with high backdrivability and high bandwidth,” vol. 25, no. 4, pp. 1794–1802. [Online]. Available: https://ieeexplore.ieee.org/document/9095261/
  38. Y. Shirai, X. Lin, A. Schperberg, Y. Tanaka, H. Kato, V. Vichathorn, and D. Hong, “Simultaneous contact-rich grasping and locomotion via distributed optimization enabling free-climbing for multi-limbed robots,” in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems.   IEEE, 2022, pp. 13 563–13 570.
  39. A. Schperberg, Y. Shirai, X. Lin, Y. Tanaka, and D. Hong, “Adaptive force controller for contact-rich robotic systems using an unscented kalman filter,” in 2023 IEEE-RAS 23rd International Conference on Humanoid Robots, 2023.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up