Robot virtual reality synchronization system and synchronization method

A technology of virtual reality and synchronous system, applied in manipulators, program-controlled manipulators, manufacturing tools, etc., to achieve good interactivity, improve automation level and safety, and improve maintenance efficiency

Pending Publication Date: 2020-04-10
中国东方电气集团有限公司
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a robot virtual reality synchronization system to solve or improve the above-mentioned problems in view of the above-mentioned deficiencies in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot virtual reality synchronization system and synchronization method
  • Robot virtual reality synchronization system and synchronization method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] As a most basic embodiment of the system of the present invention, such as figure 1 A robot virtual reality synchronization system disclosed in this embodiment includes an MR glasses system, a virtual operation room and a robot with a robot control system; the virtual operation room includes a desktop control system electrically connected to the MR glasses system through a router , the desktop control system is also connected to the robot control system through the network; that is, the MR glasses system is connected to the robot control through the virtual operation room. According to actual use, a single set of MR glasses systems can be located in different places and a number of robot.

[0032] The MR glasses system includes MR glasses for wearing, a force feedback device and a pose capture device; both the force feedback device and the pose capture device are electrically connected to the MR glasses; the MR glasses are connected to the desktop control system data S...

Embodiment 2

[0035] As a preferred implementation of the system of the present invention, on the basis of Example 1, further, the robot includes a mechanical arm 1 arranged on a mobile platform 2 driven by a drive motor and a drive shaft, and the mobile platform 2 can realize The fast arrival of the robot.

[0036] Preferably, as figure 2 , the data acquisition module is arranged on the mechanical arm 1 of the robot, and the data acquisition module includes a six-axis force sensor 3 for collecting the output power of the drive shaft of the mechanical arm 1, and a three-dimensional image for completing all feature points of the equipment in the field of view A binocular camera 4 for measurement and a depth camera 5 for three-dimensional measurement and scanning of the device by using changes in incident light signals and reflected light signals. The six-axis force sensor 3 is installed on the drive shaft of the robot arm 1, the binocular camera 4 is installed on the mobile platform 2 of t...

Embodiment 3

[0039] As a most basic implementation of the method of the present invention, this embodiment discloses a method for synchronizing robot virtual reality, including the following steps:

[0040] Step 1, verify identity and log in through the desktop control system in the virtual operation room;

[0041] Step 2, use the MR glasses system to select the robot to be synchronously controlled in the system through the desktop control system and connect with its robot control system to obtain the robot's field of view, and use the force feedback device and pose capture device of the MR glasses system to communicate with the robot's The action unit is connected synchronously with the joint data of the robotic arm 1;

[0042] Step 3: Control the mobile platform 2 of the robot to move to the target position through the MR glasses system, measure the current environment and fault point working condition images through the depth camera 5 of the robot, construct and upload a 3D environment ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of robot intelligent control and discloses a robot virtual reality synchronization system and synchronization method. The system comprises an MR glasses system, a virtual operation room and a robot with a robot control system, wherein the virtual operation room comprises a desktop control system electrically connected with the MR glasses system througha router, the desktop control system is further connected with the robot control system through the network, the MR glasses system comprises MR glasses for wearing, a force feedback device and a posecapture device, the force feedback device and the pose capture device are electrically connected with the MR glasses, the MR glasses and the desktop control system synchronously display data, the robot control system comprises a remote operation and maintenance server, and a general controller, a wireless positioning module and a data acquisition module which are arranged on the robot, snd the remote operation and maintenance server is in control connection with the MR glasses system, the virtual operation room and the universal controller through the network.

Description

technical field [0001] The patent of the invention belongs to the technical field of robot intelligent control, and specifically relates to a robot virtual reality synchronization system and a synchronization method. Background technique [0002] An industrial robot is a multi-joint manipulator or a multi-degree-of-freedom machine device for the industrial field. It can perform work automatically and is a machine that realizes various functions by its own power and control capabilities. It can be commanded by humans or run according to pre-programmed programs. Modern industrial robots can also act according to the principles and programs formulated by artificial intelligence technology. [0003] With the rapid development of science and technology, virtual reality technology has begun to be applied to the control of industrial robots, especially in working environments where humans cannot or are inconvenient to operate, such as nuclear power environments. [0004] In the ex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B25J9/16B25J13/00
CPCB25J9/1602B25J9/1697B25J13/00
Inventor 石致远吴文亮李晋航陈兵殷庆文董娜冷志许辉
Owner 中国东方电气集团有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products