Electrified operation robot remote operator training system and method based on point cloud

A technology for live work and personnel training. It is used in manipulators, program-controlled manipulators, and manufacturing tools. It can solve problems such as mechanical arm damage and poor vision, and achieve the effects of increasing speed, improving effectiveness, and reducing quantity.

Active Publication Date: 2019-07-23
NANJING UNIV OF SCI & TECH
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the unstructured live working environment makes it difficult for the live working robot to achieve complete autonomous work, and operators still need to cooperate with the robot to complete the live working task.
[0003] Since the robot needs to carry out live work at high altitude, the operator can only use the image captur...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Electrified operation robot remote operator training system and method based on point cloud
  • Electrified operation robot remote operator training system and method based on point cloud
  • Electrified operation robot remote operator training system and method based on point cloud

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The point cloud-based remote operator training system for a live working robot of the present invention includes a depth camera, an industrial computer, and a main manipulator remote control lever with a force feedback function connected thereto, and an auxiliary mechanical arm remote control lever with a force feedback function such as figure 1 As shown, it is the Geomagic Touch six-dimensional tactile input and output device, which can provide the operator with a sense of force presence.

[0016] The depth camera is used to collect point cloud information of the actual working environment, and the industrial computer is used to establish a virtual working environment based on the point cloud information, including the virtual main manipulator, virtual auxiliary manipulator and other objects in the virtual environment, with force feedback The functional main manipulator remote control lever is used to control the movement of the virtual main manipulator, and the auxilia...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an electrified operation robot remote operator training system and method based on point cloud. The electrified operation robot remote operator training system comprises a depth camera, an industrial personal computer, a main mechanical arm remote operating rod and an auxiliary mechanical arm remote operating rod, wherein the main mechanical arm remote operating rod and theauxiliary mechanical arm remote operating rod are connected with the industrial personal computer and provided with a powerful feedback function. The method comprises the following steps of modelingan object in an electrified operating environment by the industrial personal computer, and storing a model into a model library of the industrial personal computer; acquiring the cloud information ofthe actual operating environment by the depth camera, and combining the model library to realize rapid three-dimensional reconstruction of an actual operation scene; a remote operator operates a mainmechanical arm remote operation rod with a force feedback function and an auxiliary mechanical arm remote operation rod, the industrial personal computer controls a virtual mechanical arm to perform corresponding movement according to the speed and direction of the tail end of the remote operation rod with the powerful feedback function, and a corresponding feedback operation result is sent to theremote operator. According to the electrified operation robot remote operator training system and method, the trained person has the force tele-presence, the effectiveness of training is improved, and direct operation is avoided, and the actual mechanical arm is prevented from being damaged.

Description

technical field [0001] The invention belongs to the field of remote operator training of live working robots, in particular to a system and method for remote operator training of live working robots based on point clouds. Background technique [0002] With the vigorous development of robot technology, the application of robots in modern production and life is becoming more and more extensive. At present, my country's high-voltage live work still uses the insulating glove method, requiring operators to climb high-voltage iron towers or carry out live work with the help of insulating bucket trucks. In order to avoid casualty accidents during live work, it is of great practical significance to use live work robots instead of manual power maintenance and repair work. However, the unstructured live working environment makes it difficult for the live working robot to achieve complete autonomous operation, and it still requires the operator to cooperate with the robot to complete ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): B25J13/08B25J9/16
CPCB25J9/1689B25J9/1612B25J13/089
Inventor 肖潇郭毓郭飞张冕吴钧浩蔡梁
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products