Intelligent capture method based on gestures and audio control

Abstract

The invention provides an intelligent capture algorithm based on gestures and audio control. The algorithm comprises following steps: (1) rapid positioning of gestures; (2) auxiliary positioning and attitude determination based on natural language understanding; (3) cutting of target objects; (4) route planning. The intelligent capture algorithm based on gestures and audio control has following beneficial effects: by using natural man-machine interaction technology based on intellisense, a robot can rapidly position a target object by finger pointing under help of audio information when a human hand points to the target object and sends an audio capture instruction containing object information and the robot can automatic plan a route to capture the object; then, when the robot approaches the target object, the position of the target object can be adjusted precisely according to an audio instruction; therefore, the robot can be controlled more flexibly and conveniently due to combination of audios and gestures and the robot can work in a more complex environment.

Description

technical field [0001] The invention belongs to the field of robot movement, in particular to an intelligent capture method based on gesture and voice control. Background technique [0002] In recent years, robots have been more and more applied to life and production. Especially in industrial production, where many human beings are not suitable to appear, the present invention uses robots to replace human beings to carry out operations to protect human beings from harm. In order to complete the task, the machine needs to be under the remote manual control of the human, or under the control of the preset program to complete the task. However, the data transmission bus used by teleoperation often hinders the work of the staff working with it, and the work efficiency in production will also be reduced due to these details. When the machine is working under the control of the preset program, there will also be some slight changes in environmental factors, which will lead to a...

AI Technical Summary

Problems solved by technology

When the machine is working under the control of the preset program, there will also be some slight changes in environmental factors, which will lead to a decrease in the working efficiency of the machine, and even cause devastating damage to the material and the machine.

At the same time, through the pre-set program, when people use instructions to operate, the working efficiency of the machine will also be greatly reduced, and sometimes the rotation angle of a certain joint of the machine will be greater than the threshold

At the same time, the path planning according to the preset value will cause the machine to hit some moving objects, damage the machine or damage the objects and people near the machine.

Images