Combining AR and ball-shape input interface to control remotely a robot-arm

Abstract: Robot arm technology has revolutionized the manufacturing industry, offering worker safety and productivity benefits. However, issues like unintended actions and difficulty in intuitive operation remain. This study proposes a remote-control system for robot arms that combines augmented reality (AR) and a multi-sensor interactive smart ball (PALL0) from Ai2Ai Corp. The AR application allows operators to synchronize the control of a virtual and physical robot arm using their hand and the PALL0 held in the hand.The AR application operates the robot arm by matching the position of its head with the operator's hand and the posture of the head with the acceleration and angular velocity of the PALL0. A button on the PALL0 controls the opening and closing of the gripper, while the physical robot arm also operates. The start and end of the operation, as well as the return of the robot arm to its initial posture, can be performed using buttons in the AR application.Future research should compare the method of controlling robot arms using PALL0 with other methods, such as those that use the movement of the body's upper or lower extremities, and invest resources in building the robot's digital twin to improve system portability.

Keywords: Robot Arm, Wearable Devices, Human Factors, Hci

DOI: 10.54941/ahfe1004628

Cite this paper:

​