Robot teleoperation system and method based on electromagnetic force feedback and augmented reality

An augmented reality and operating system technology, applied to instruments, manipulators, mechanical mode conversion, etc., can solve problems such as lack of force feedback, limited viewing angle, lack of immersion and lack of precision

Active Publication Date: 2020-02-21
SOUTH CHINA UNIV OF TECH
View PDF10 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods lack force feedback, resulting in insufficient immersion and precision of the operation, and the moveme...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot teleoperation system and method based on electromagnetic force feedback and augmented reality
  • Robot teleoperation system and method based on electromagnetic force feedback and augmented reality
  • Robot teleoperation system and method based on electromagnetic force feedback and augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0053] Robot teleoperation system based on electromagnetic force feedback and augmented reality, such as figure 1 As shown, including: natural control module, natural feedback module;

[0054] The natural control module includes a movable operating platform, a voice acquisition module, a virtual robot and a remote real robot; , extracting robot control instructions through inference method to guide the virtual robot movement, the virtual robot receives the robot control instructions and moves according to the instructions, and sends the motion data to the remote real robot through the Internet, and the remote real robot receives the data and replicates the virtual robot’s actions ;

[0055] The natural feedback module includes an electromagnetic force feedback module and a visual feedback module; the electromagnetic force feedback module is used to make the operator feel the force of the robot, and the visual feedback module is used to make the operator observe the virtual robo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

PropertyMeasurementUnit
Cone angleaaaaaaaaaa
Heightaaaaaaaaaa
Bottom radiusaaaaaaaaaa
Login to view more

Abstract

The invention provides a robot teleoperation system and method based on electromagnetic force feedback and augmented reality. The system comprises a natural control module and a natural feedback module. After fusing gesture text and voice text of an operator, the natural control module extracts a robot control instruction through an inference method to guide a virtual robot in moving, and a true remote robot copies movement of the virtual robot based on data sent by the internet. The natural feedback module comprises electromagnetic force feedback and vision feedback, through the electromagnetic force feedback, the operator can sense the force of the robot, and through the vision feedback, the operator can obverse the virtual robot in any direction. The system is adopted for remotely operating the robot, the stress condition and task execution process of the robot can be sensed in real time, the high immersion sense is achieved, the operation efficiency and accuracy are improved, and the system and method are suitable for non-professional operators and have universality, operability and a wide application range.

Description

technical field [0001] The invention belongs to the field of robot control, in particular to a robot remote control system and method based on electromagnetic force feedback and augmented reality. Background technique [0002] Teleoperation of robots allows robots to work in harsh environments that humans cannot reach. However, traditional methods usually observe the robot through video or 3D models, and lack force feedback, and have some disadvantages, such as limited vision, unfriendly interaction, lack of immersion, and low teleoperation efficiency. With the advent of the era of Industry 4.0, the application fields of robots are more common, and the frequency of use is becoming more and more frequent. On the one hand, operators should operate robots more conveniently and easier to master, so that operators can focus on tasks and improve operating efficiency; On the one hand, it provides natural and friendly interaction for the operator, so that the operator can feel the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B25J13/00B25J9/16G06F3/01G10L15/22G10L15/26
CPCB25J13/003B25J9/1602B25J9/1628B25J9/1697G06F3/016G06F3/017G10L15/26G10L15/22G10L2015/223Y02P90/02
Inventor 杜广龙
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products