Intelligent capture method based on gestures and audio control

A voice control and gesture technology, applied in voice analysis, voice recognition, character and pattern recognition, etc., can solve the problems of machine work efficiency decline, material machine damage, collision, etc.

Active Publication Date: 2016-11-16
SOUTH CHINA UNIV OF TECH
View PDF8 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the machine is working under the control of the preset program, there will also be some slight changes in environmental factors, which will lead to a decrease in the working efficiency of the machine, and even cause devastating damage to the material and the machine.
At the same time, through the pre-set program, when people use instructions to operat

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent capture method based on gestures and audio control
  • Intelligent capture method based on gestures and audio control
  • Intelligent capture method based on gestures and audio control

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0070] The present invention is based on gesture and voice control robot to carry out the intelligent capture method and comprises the following steps:

[0071] S1: Gesture quick positioning

[0072] S2: Auxiliary positioning and posture determination based on natural language understanding

[0073] S3: Segment and locate the target

[0074] S4: Road King Planning

[0075] The S1 step comprises the following steps:

[0076] In order to make the operator's control of the robot more flexible and convenient, and shorten the positioning time of the robot, this method adopts rapid positioning based on gestures. Using finger pointing, the robot can initially locate the target, and then finely adjust the target through voice control. As shown in Figure 1, the operator controls the robot through gestures and voice. Here, the present invention first acquires gesture information for use in subsequent positioning.

[0077] 5) Gesture acquisition

[0078] The RGB image and the depth...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an intelligent capture algorithm based on gestures and audio control. The algorithm comprises following steps: (1) rapid positioning of gestures; (2) auxiliary positioning and attitude determination based on natural language understanding; (3) cutting of target objects; (4) route planning. The intelligent capture algorithm based on gestures and audio control has following beneficial effects: by using natural man-machine interaction technology based on intellisense, a robot can rapidly position a target object by finger pointing under help of audio information when a human hand points to the target object and sends an audio capture instruction containing object information and the robot can automatic plan a route to capture the object; then, when the robot approaches the target object, the position of the target object can be adjusted precisely according to an audio instruction; therefore, the robot can be controlled more flexibly and conveniently due to combination of audios and gestures and the robot can work in a more complex environment.

Description

technical field [0001] The invention belongs to the field of robot movement, in particular to an intelligent capture method based on gesture and voice control. Background technique [0002] In recent years, robots have been more and more applied to life and production. Especially in industrial production, where many human beings are not suitable to appear, the present invention uses robots to replace human beings to carry out operations to protect human beings from harm. In order to complete the task, the machine needs to be under the remote manual control of the human, or under the control of the preset program to complete the task. However, the data transmission bus used by teleoperation often hinders the work of the staff working with it, and the work efficiency in production will also be reduced due to these details. When the machine is working under the control of the preset program, there will also be some slight changes in environmental factors, which will lead to a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G10L15/22G10L15/26
CPCG06F3/017G10L15/22G10L15/26G06V40/28
Inventor 杜广龙林思洁姜思君邵亨康陈燕娇黄凯鹏叶玉琦雷颖仪张平
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap