A voice and image compound interactive execution method and system for robots

An execution method and robot technology, applied in the field of robotics, can solve the problems of large amount of computation and high computational complexity, and achieve the effects of improving accuracy and robustness, effective interaction, and improving accurate recognition

Active Publication Date: 2020-07-10
青岛路腾智能装备科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the algorithms for dealing with interference problems such as occlusion often have the problems of high computational complexity and large amount of calculation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A voice and image compound interactive execution method and system for robots
  • A voice and image compound interactive execution method and system for robots
  • A voice and image compound interactive execution method and system for robots

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The specific implementations of the constant pressure tensioning device and the crawler robot according to the present invention will be described with reference to the accompanying drawings. The following detailed description and accompanying drawings serve to illustrate the principles of the present invention. The present invention is not limited to the described preferred embodiments, but the scope of the present invention is defined by the claims.

[0025] Such as Figure 1-3 As shown, a voice and image composite interactive execution method for a robot described in the present invention comprises the following steps:

[0026] Step 1: The robot detects the surrounding sounds and locates the sound source; that is, detects all the sounds around the robot;

[0027] Step 2: The robot detects the surrounding faces, locates the faces, compares and matches the location of the faces with the location of the sound source, filters out the interference sound source, prelimina...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to a voice and image composite interaction execution method and system for a robot. The method comprises: the step 1: a robot detects the surrounding sound, and the sound source is located; the step 2, the robot detects the human faces around, the human faces are located, the location of the human faces and the location of the sound source are compared and matched, the interference sound source is filtered, the voice sound source is initially determined, and a voice command is initially determined; the step 3, the robot detects the human objects around, the human objects are tracked, the limb command is identified and is compared and matched with the initially determined voice command, the interference sound command is filtered, and the effective user command is determined; and the step 4, the robot executes the corresponding operation according to the user command. The robot is able to accurately understand the user's command in a complex background and accurately identify the user command sent to the robot, and is higher in robustness, more intelligent, and more efficient for interaction with people.

Description

technical field [0001] The invention relates to the field of robots, in particular to a method and system for executing compound interactive voice and images for robots. Background technique [0002] In order to realize the interaction between the robot and the human user, some technologies in the prior art recognize user commands by voice. Due to the complex real environment, there are voice interference from other users and non-voice interference in the environment (such as TV, sound box, etc.). Sound source, etc.), multiple users send out voice signals, but some are sending voice commands to the robot, and some are doing conversations and other behaviors that have nothing to do with the robot. Therefore, the sound positioning results may include both the user who issued the voice command and the interfering sound source. Accurately locating the user's sound source from a complex environment containing interfering sound sources is a difficult point in voice command recogn...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G10L15/22G10L15/25G10L21/028
CPCG10L15/22G10L15/25G10L21/028G10L2015/223
Inventor 王运志
Owner 青岛路腾智能装备科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap