Robot teleoperation system and method based on electromagnetic force feedback and augmented reality

Abstract

The invention provides a robot teleoperation system and method based on electromagnetic force feedback and augmented reality. The system comprises a natural control module and a natural feedback module. After fusing gesture text and voice text of an operator, the natural control module extracts a robot control instruction through an inference method to guide a virtual robot in moving, and a true remote robot copies movement of the virtual robot based on data sent by the internet. The natural feedback module comprises electromagnetic force feedback and vision feedback, through the electromagnetic force feedback, the operator can sense the force of the robot, and through the vision feedback, the operator can obverse the virtual robot in any direction. The system is adopted for remotely operating the robot, the stress condition and task execution process of the robot can be sensed in real time, the high immersion sense is achieved, the operation efficiency and accuracy are improved, and the system and method are suitable for non-professional operators and have universality, operability and a wide application range.

Description

technical field [0001] The invention belongs to the field of robot control, in particular to a robot remote control system and method based on electromagnetic force feedback and augmented reality. Background technique [0002] Teleoperation of robots allows robots to work in harsh environments that humans cannot reach. However, traditional methods usually observe the robot through video or 3D models, and lack force feedback, and have some disadvantages, such as limited vision, unfriendly interaction, lack of immersion, and low teleoperation efficiency. With the advent of the era of Industry 4.0, the application fields of robots are more common, and the frequency of use is becoming more and more frequent. On the one hand, operators should operate robots more conveniently and easier to master, so that operators can focus on tasks and improve operating efficiency; On the one hand, it provides natural and friendly interaction for the operator, so that the operator can feel the ...

AI Technical Summary

Problems solved by technology

However, these methods lack force feedback, resulting in insufficient immersion and precision of the operation, and the movement space of the human hand is limited by the measurement space of the device, and the problem of limited viewing angle still exists.

Images