Non-contact control method of bionic manipulator based on learning of hand motion gestures

Abstract

The invention provides a non-contact control method for controlling a five-finger bionic manipulator through learning hand motion gestures and belongs to the field of intelligent control. According to the method, a three-dimensional hand modeling method with adaptivity is proposed, motion gestures of all joint points of a hand of a control worker are tracked according to a three-dimensional hand model, and a corresponding relationship between the motion gestures of the hand and action commands of the manipulator is established with a mapping algorithm, so that the control worker controls the five-finger manipulator in a natural mode. Under the condition of utilization of RGB-D images, the three-dimensional hand model is established to describe pose parameters of the joints of the hand, an improved APSO (adaptive particle swarm optimization) algorithm is proposed to solve the pose parameters, the rate of convergence of solution of high-dimensional parameters is effectively increased, limitation of wearable devices such as data gloves and the like is avoided, and the defects that a conventional control method based on a sensor can only acquires poses of part of joints of the hand and cannot be applicable to a bionic multi-fingered hand with high degree of freedom are overcome.

Description

technical field [0001] The invention belongs to the field of intelligent control, and relates to a non-contact control method for controlling a five-finger bionic manipulator by learning the motion posture of a human hand by using an RGB-D image as an input signal. Background technique [0002] With the continuous expansion of the application scope of robots, robots are playing an increasingly important role in the fields of industrial control and virtual assembly. At the same time, the scenarios and tasks of robot operations are becoming more and more complex. The robot's manipulator is the main device and tool for it to complete various tasks. Simple clamping devices and two-finger manipulators can no longer meet these application requirements. Manipulators are gradually developing into multi-finger, multi-joint and multi-degree-of-freedom mechanical dexterous hands. Although the current five-finger bionic mechanical dexterous hand is getting closer and closer to the human...

AI Technical Summary

Problems solved by technology

It avoids the limitations of wearing devices such as data gloves, and solves the problem that the existing sensor-based control method can only obtain the pose of some joints of the hand, and cannot be applied to bionic dexterous hands with high degrees of freedom.

Images