A robot manipulator control method based on multi-leapmotion virtual gesture fusion

Abstract

The invention discloses a robot mechanical arm control method based on multi-Leapmotion virtual gesture fusion. The robot mechanical arm control method comprises the following steps that 1, a gesturecollecting device is arranged; 2, Leapmotion sequence images for controlling gestures of a mechanical arm are collected on the basis of the gesture collecting device, and the gestures are recognized through a gesture recognizing model based on a core extreme learning machine; 3, through the scale factor of preset control gestures and the mechanical arm practical operation gestures, the mechanicalarm operation target destination is obtained; 4, the mechanical arm movement scheme is obtained; and 5, the optimal mechanical arm control scheme is selected. According to the scheme, gesture sequenceimages are collected by using a multi-Leapmotion sensor, the gesture images are fused by using a weighted fusion algorithm, and the very high fault tolerance is achieved; and a multi-Leapmotion gesture recognizing device is used, and compared with an existing mechanical arm demonstrator and somatosensory equipment, a control device is low in cost, high in controllability and high in accuracy degree.

Description

Technical field [0001] The invention belongs to the field of mechanical control, and particularly relates to a robot manipulator control method based on multiple Leapmotion virtual gesture fusion. Background technique [0002] With the development of artificial intelligence, human-computer interaction has attracted more and more attention. How to realize human-computer interaction in a simple, quick and low-cost way is one of the focuses of artificial intelligence research. [0003] In recent years, many solutions using wearable devices to realize human-computer interaction have emerged. Wearable devices use sensors to collect and transmit human body data to the controller to control the robot. Take the hand wearable device as an example. A wearable device that looks like a glove is worn by a person. The device has a variety of sensors, such as an angle sensor, a displacement sensor, and a force sensor. The sensor collects data from the hand and transmits the data to the controll...

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a robot manipulator control method based on the fusion of multiple Leapmotion virtual gestures, the purpose of which is to overcome the complicated problem in the prior art that wearable devices control the robot

Images