Papers
Topics
Authors
Recent
Search
2000 character limit reached

A Passively Bendable, Compliant Tactile Palm with RObotic Modular Endoskeleton Optical (ROMEO) Fingers

Published 12 Apr 2024 in cs.RO | (2404.08227v1)

Abstract: Many robotic hands currently rely on extremely dexterous robotic fingers and a thumb joint to envelop themselves around an object. Few hands focus on the palm even though human hands greatly benefit from their central fold and soft surface. As such, we develop a novel structurally compliant soft palm, which enables more surface area contact for the objects that are pressed into it. Moreover, this design, along with the development of a new low-cost, flexible illumination system, is able to incorporate a high-resolution tactile sensing system inspired by the GelSight sensors. Concurrently, we design RObotic Modular Endoskeleton Optical (ROMEO) fingers, which are underactuated two-segment soft fingers that are able to house the new illumination system, and we integrate them into these various palm configurations. The resulting robotic hand is slightly bigger than a baseball and represents one of the first soft robotic hands with actuated fingers and a passively compliant palm, all of which have high-resolution tactile sensing. This design also potentially helps researchers discover and explore more soft-rigid tactile robotic hand designs with greater capabilities in the future. The supplementary video can be found here: https://youtu.be/RKfIFiewqsg

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. S. Q. Liu*, L. Z. Yañez*, and E. H. Adelson, “GelSight EndoFlex: A Soft Endoskeleton Hand with Continuous High-Resolution Tactile Sensing,” 2023 IEEE International Conference on Soft Robotics (RoboSoft), 2023.
  2. H. Park and D. Kim, “An open-source anthropomorphic robot hand system: HRI hand,” HardwareX, vol. 7, p. e00100, 2020.
  3. J. Zhou, X. Chen, U. Chang, J.-T. Lu, C. C. Y. Leung, Y. Chen, Y. Hu, and Z. Wang, “A Soft-Robotic Approach to Anthropomorphic Robotic Hand Dexterity,” IEEE Access, vol. 7, pp. 101 483–101 495, 2019.
  4. Y. Sun, Q. Zhang, and X. Chen, “Design and analysis of a flexible robotic hand with soft fingers and a changeable palm,” Advanced Robotics, vol. 34, no. 16, pp. 1041–1054, 2020.
  5. H. Wang, M. Totaro, and L. Beccai, “Toward perceptive soft robots: Progress and challenges,” Advanced Science, vol. 5, no. 9, p. 1800541, 2018.
  6. C.-H. Xiong, W.-R. Chen, B.-Y. Sun, M.-J. Liu, S.-G. Yue, and W.-B. Chen, “Design and Implementation of an Anthropomorphic Hand for Replicating Human Grasping Functions,” IEEE Transactions on Robotics, vol. 32, no. 3, pp. 652–671, 2016.
  7. J. Fras and K. Althoefer, “Soft Biomimetic Prosthetic Hand: Design, Manufacturing and Preliminary Examination,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 1–6.
  8. J. Zhou, J. Yi, X. Chen, Z. Liu, and Z. Wang, “BCL-13: A 13-DOF Soft Robotic Hand for Dexterous Grasping and In-Hand Manipulation,” IEEE Robotics and Automation Letters, vol. 3, no. 4, pp. 3379–3386, 2018.
  9. M. Tavakoli and A. T. de Almeida, “Adaptive under-actuated anthropomorphic hand: ISR-SoftHand,” in 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2014, pp. 1629–1634.
  10. A. Pagoli, F. Chapelle, J. A. Corrales, Y. Mezouar, and Y. Lapusta, “A Soft Robotic Gripper with an Active Palm and Reconfigurable Fingers for Fully Dexterous In-Hand Manipulation,” IEEE Robotics and Automation Letters, vol. 6, no. 4, pp. 7706–7713, 2021.
  11. H. Wang, F. J. Abu-Dakka, T. Nguyen Le, V. Kyrki, and H. Xu, “A Novel Soft Robotic Hand Design with Human-Inspired Soft Palm: Achieving a Great Diversity of Grasps,” IEEE Robotics & Automation Magazine, vol. 28, no. 2, pp. 37–49, 2021.
  12. Y. Li, Y. Wei, Y. Yang, and Y. Chen, “A novel versatile robotic palm inspired by human hand,” Engineering Research Express, vol. 1, no. 1, p. 015008, jul 2019. [Online]. Available: https://dx.doi.org/10.1088/2631-8695/ab2f69
  13. P. Capsi-Morales, G. Grioli, C. Piazza, A. Bicchi, and M. G. Catalano, “Exploring the Role of Palm Concavity and Adaptability in Soft Synergistic Robotic Hands,” IEEE Robotics and Automation Letters, vol. 5, no. 3, pp. 4703–4710, 2020.
  14. Y. Huang, X. Zhang, X. Chen, and J. Ota, “Vision-guided peg-in-hole assembly by Baxter robot,” Advances in Mechanical Engineering, vol. 9, no. 12, p. 1687814017748078, 2017.
  15. S. Lin, X. Jiang, and Y. Liu, “Cable manipulation with partially occluded vision feedback,” in 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2022, pp. 1245–1250.
  16. G. Büscher, M. Meier, G. Walck, R. Haschke, and H. J. Ritter, “Augmenting curved robot surfaces with soft tactile skin,” in 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015, pp. 1514–1519.
  17. A. Schmitz, P. Maiolino, M. Maggiali, L. Natale, G. Cannata, and G. Metta, “Methods and Technologies for the Implementation of Large-Scale Robot Tactile Sensors,” IEEE Transactions on Robotics, vol. 27, no. 3, pp. 389–400, 2011.
  18. K. C. Galloway, Y. Chen, E. Templeton, B. Rife, I. S. Godage, and E. J. Barth, “Fiber Optic Shape Sensing for Soft Robotics,” Soft Robotics, vol. 6, no. 5, pp. 671–684, 2019, pMID: 31241408.
  19. O. Shorthose, A. Albini, L. He, and P. Maiolino, “Design of a 3D-Printed Soft Robotic Hand with Integrated Distributed Tactile Sensing,” IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 3945–3952, 2022.
  20. H. Yang and W. Wu, “A review: Machine learning for strain sensor-integrated soft robots,” Frontiers in Electronic Materials, vol. 2, 2022. [Online]. Available: https://www.frontiersin.org/articles/10.3389/femat.2022.1000781
  21. Z. Lei, X. Deng, Y. Wang, Z. Li, X. Xiao, D. Han, F. Chen, and M. Li, “A Biomimetic Tactile Palm for Robotic Object Manipulation,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 11 500–11 507, 2022.
  22. S. Pohtongkam and J. Srinonchat, “Tactile Object Recognition for Humanoid Robots Using New Designed Piezoresistive Tactile Sensor and DCNN,” Sensors, vol. 21, no. 18, 2021. [Online]. Available: https://www.mdpi.com/1424-8220/21/18/6024
  23. S. Dong, W. Yuan, and E. H. Adelson, “Improved GelSight tactile sensor for measuring geometry and slip,” in 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2017, pp. 137–144.
  24. W. Yuan, S. Dong, and E. H. Adelson, “GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force,” Sensors, vol. 17, no. 12, 2017. [Online]. Available: https://www.mdpi.com/1424-8220/17/12/2762
  25. S. Wang, Y. She, B. Romero, and E. Adelson, “GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Finger,” 06 2021.
  26. M. H. Tippur and E. H. Adelson, “GelSight360: An Omnidirectional Camera-Based Tactile Sensor for Dexterous Robotic Manipulation,” in 2023 IEEE Conference of Soft Robotics (RoboSoft), April 2023.
  27. M. Lambeta, G. Kammerer, D. Jayaraman, R. Calandra, P.-W. Chou, S. Tian, B. Yang, B. Maloon, V. Most, D. Stroud, R. Santos, and A. Byagowi, “DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation,” IEEE Robotics and Automation Letters, vol. PP, pp. 1–1, 02 2020.
  28. J. Zhao and E. H. Adelson, “GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensing,” in 2023 International Conference on Intelligent Robots and Systems (IROS 2023), 2023.
  29. Y. She*, S. Q. Liu*, P. Yu*, and E. Adelson, “Exoskeleton-covered soft finger with vision-based proprioception and tactile sensing,” in 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 10 075–10 081.
  30. S. Q. Liu and E. H. Adelson, “GelSight Fin Ray: Incorporating Tactile Sensing into a Soft Compliant Robotic Gripper,” in 2022 IEEE 5th International Conference on Soft Robotics (RoboSoft), 2022, pp. 925–931.
  31. S. Q. Liu, Y. Ma, and E. H. Adelson, “GelSight Baby Fin Ray: A Compact, Compliant, Flexible Finger with High-Resolution Tactile Sensing,” in 2023 IEEE International Conference on Soft Robotics (RoboSoft), 03 2023.
  32. G. Bradski, “The OpenCV Library,” Dr. Dobb’s Journal of Software Tools, 2000.
  33. J. Doerner, “Fast Poisson Reconstruction in Python,” https://gist.github.com/jackdoerner/b9b5e62a4c3893c76e4c, 2014.
Citations (3)
View on Semantic Scholar

Summary

  • The paper proposes a compliant tactile palm design that increases contact area, stabilizing grasps through enhanced object manipulation.
  • The flexible illumination system, inspired by GelSight, employs RGB LED filaments to achieve high-resolution tactile sensing.
  • Integrating soft-rigid ROMEO fingers, the study demonstrates improved tactile feedback and grasp stability for diverse robotic applications.

A Passively Bendable, Compliant Tactile Palm with RObotic Modular Endoskeleton Optical (ROMEO) Fingers

The presented paper addresses a significant gap in the design of robotic hands by focusing on the development of a compliant tactile palm, alongside innovative ROMEO fingers that incorporate high-resolution tactile sensing. This research departs from the conventional focus on finger dexterity, leveraging insights from human hand anatomy to offer a more holistic approach to robotic grasping and object manipulation.

Overview of Contributions

The authors propose a novel hand architecture that merges a structurally compliant palm with modular tactile sensors, enabling enhanced contact area during object manipulation. This system integrates a flexible, low-cost illumination solution inspired by GelSight, a technology known for its efficacy in tactile sensing applications. The ROMEO fingers, characterized by their soft-rigid hybrid design, serve as a conduit for embedding the illumination and sensing modalities, effectively broadening the tactile capabilities of the palm.

Key contributions of this study are:

  • Development of a Compliant Tactile Palm: The palm's design incorporates material and structural compliance, modeled on human hand mechanics. It significantly improves object engagement by increasing contact surface area, thus stabilizing grasps.
  • Flexible Illumination System: A novel RGB LED filament-based illumination approach ensures consistent performance across various tactile surfaces, highlighting its adaptability for integration within different soft robotic configurations.
  • Integration of ROMEO Fingers: The robotic hand consisting of underactuated modular fingers underscores a significant advancement in tactile sensing. These components are seamlessly amalgamated into various palm configurations, supporting modular robotic designs.

Experimental Validation

The implementation of this robotic hand design demonstrates improved tactile sensing and grasp stability compared to traditional rigid robotic palms. Through a series of controlled experiments, including paint tests, the authors illustrate how the dual compliance of the palm elevates the tactile performance, achieving superior surface area coverage across various object shapes. Such tactile granularity is critical for nuanced tasks like texture recognition and in-hand manipulation.

Implications and Future Directions

The implications of this research extend both to practical applications and theoretical developments within robotics. Practically, these advancements facilitate the engineering of more dexterous and sensitive robotic systems capable of intricate tasks in fields such as automated sorting, delicate handling in manufacturing, and even surgical robotics. Theoretically, this study contributes to the growing body of work exploring soft-rigid interaction models, adding value to the discourse on emulating natural hand mechanics in robotic designs.

Looking forward, the proposed design invites investigations into more complex, scalable configurations that further incorporate active compliance and expand tactile feedback processing. Exploring algorithmic enhancements for tactile data interpretation could also augment tasks such as real-time object classification and adaptive manipulation strategies.

In conclusion, by drawing parallels from the anthropocentric understanding of touch and grasp, and adapting them for robotic use, this research paves the way for robust, sensitive robotic hands capable of a broad spectrum of applications. The advances encapsulated in this paper serve as a meaningful step toward integrating comprehensive tactile sensing into robotic systems.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up