Humanoid Robot RHP Friends: Seamless Combination of Autonomous and Teleoperated Tasks in a Nursing Context

Abstract: This paper describes RHP Friends, a social humanoid robot developed to enable assistive robotic deployments in human-coexisting environments. As a use-case application, we present its potential use in nursing by extending its capabilities to operate human devices and tools according to the task and by enabling remote assistance operations. To meet a wide variety of tasks and situations in environments designed by and for humans, we developed a system that seamlessly integrates the slim and lightweight robot and several technologies: locomanipulation, multi-contact motion, teleoperation, and object detection and tracking. We demonstrated the system's usage in a nursing application. The robot efficiently performed the daily task of patient transfer and a non-routine task, represented by a request to operate a circuit breaker. This demonstration, held at the 2023 International Robot Exhibition (IREX), conducted three times a day over three days.

• The paper demonstrates a seamless integration of autonomous and teleoperated tasks in a humanoid robot designed for nursing care.
• It outlines advanced locomanipulation, precise perception, and multi-contact motion planning to safely perform patient transfers.
• Empirical validations at IREX highlight the robot’s robust performance and potential to alleviate caregiver shortages.

Overview of Humanoid Robot RHP Friends: Autonomous and Teleoperated Integration in Nursing

The paper "Humanoid Robot RHP Friends: Seamless Combination of Autonomous and Teleoperated Tasks in a Nursing Context" outlines the design, development, and practical application of the RHP Friends humanoid robot in nursing settings. This research addresses the acute shortage of caregivers in Japan, leveraging robotic assistance to alleviate some of the burdens faced by human workers, particularly in tasks that can be both routine and unpredictable.

System Design and Capabilities

The RHP Friends robot is an agile and compact humanoid robot developed collaboratively by Kawasaki Heavy Industries (KHI), AIST, and CNRS. The design emphasizes safety, with a focus on maintaining a harmonious operation alongside human cohabitants. The robot integrates multiple advanced technologies to manage locomanipulation, multi-contact motions, and teleoperation.

• Locomanipulation: The robot effectively handles transfer support devices (TSD) necessary for moving patients. This is achieved through a carefully planned motion sequence, accommodating complex interactions between the robot and the dynamic nursing environment.
• Perception and Object Detection: The robot is equipped with an RGBD camera and a stereo camera to perform object detection and tracking. This capability is crucial for adjusting the robot's operations according to environmental changes, such as positions around a bed or wheelchair.
• Multi-contact Motion: The robot performs complex tasks requiring simultaneous use of legs and arms, such as climbing a step-ladder, utilizing advanced multi-contact motion planning techniques.
• Teleoperation Interface: Featuring a Head Mounted Display and motion tracking system, the teleoperation mode allows skilled operators to remotely control the robot for tasks that require nuanced human intervention.

Autonomous and Teleoperated Task Integration

RHP Friends exhibits its capabilities through demonstrations involving both routine and non-routine tasks. The routine task encompasses the autonomous handling of patient transfer from a bed to a wheelchair—a critical function in caregiving that reduces physical strain on human workers. The non-routine task, controlled via teleoperation, involves resetting a circuit breaker, demonstrating the robot's adaptability in high-skill scenarios.

Empirical Validation

The validation of the system was conducted through multiple live demonstrations at the 2023 International Robot Exhibition (IREX). The robot reliably performed the tasks multiple times per day, indicating the robustness and readiness of such a system for real-world applications. Though challenges were noted, particularly in wireless communication and real-time adjustments in dynamic settings, the system's core technologies functioned as designed.

Future Implications and Developments

The integration of autonomous and teleoperated systems represents a promising frontier in robotic nursing. Practical implications include mitigating caregiver shortages and improving patient care environments. The system could be scaled and adapted across different caregiving scenarios, offering modular capabilities to match emerging needs. Theoretical advances might involve enhancing machine learning techniques to preemptively recognize when to switch between autonomous and teleoperative modes, as well as improving the seamlessness of human-robot interaction in caregiving contexts.

In conclusion, the RHP Friends robot epitomizes a substantive advance in integrating intelligent robots into healthcare. While further optimizations are warranted to handle diverse environments and increase operational resilience, this research suggests significant potential in combining robotics with human expertise, paving the way for transformative changes in the nursing care industry.