Teleoperation method and system for aerial work based on stereo vision and gesture control

A high-altitude operation, stereo vision technology, applied in the direction of program control manipulators, manipulators, manufacturing tools, etc., can solve the problem that it is difficult for operators to accurately judge the three-dimensional relationship of various parts at high altitude, interactive equipment is not easy to use, and the interactive mode is blunt, etc. Remote operation interactive experience, improve environmental immersion, and improve the effect of three-dimensional perception
CN111438673BActive Publication Date: 2022-04-22XI AN JIAOTONG UNIV
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
XI AN JIAOTONG UNIV
Publication Date
2022-04-22

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a high-altitude operation remote operation method and system based on stereo vision and gesture control. The PC terminal receives the real scene information of the high-altitude operation area collected by the binocular stereo camera, and displays it in a wearable stereoscopic display in real time; according to the wearable The three-dimensional real-scene working conditions displayed on the three-dimensional display, perform hand operations and track the movement information of hands and fingers in real time, and send the tracked hand and finger movement information to the PC terminal, and convert them into motion instructions of bionic manipulators after processing; bionic manipulators Receive and process the converted motion commands, and perform corresponding follow-up to complete the remote operation of high-altitude operations. The remote operation method and system combined with stereo vision and gesture control in the present invention can ensure the personal safety of personnel working at heights, improve the operator's three-dimensional perception of the real scene during remote operation, and at the same time enhance the interactive naturalness and immersion of remote operation .
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of high-altitude operation teleoperation, and in particular relates to a high-altitude operation teleoperation method and system based on stereo vision and gesture control. Background technique

[0002] In recent years, with the rapid development of economy, there are more and more high-rise buildings in our country. At present, high-altitude operations involve fields such as power maintenance, elevated construction, high-rise equipment installation, and cleaning. Operators are required to climb or stand on very high tower cranes for manual operations, which is very dangerous, and accidents may occur if they are not careful. , It will cause irreparable losses to society and enterprises, so it is especially necessary to replace spiders with robots to complete extremely dangerous high-altitude operations.

[0003] Most of the current high-altitude operation robots can only complete some simple and repetitive ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More