Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Speech interaction method, speech interaction device and robot

A voice interaction and robot technology, applied in the field of robotics, can solve the problems that robots cannot automatically stand, intelligence, and anthropomorphism need to be improved, and achieve the effect of being conducive to accurate acquisition and optimal pickup angle.

Active Publication Date: 2017-10-27
JIANGSU MUMENG INTELLIGENT TECH
View PDF5 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Relatively speaking, the robot cannot automatically position according to the speaker's voice direction, and the intelligence and anthropomorphism need to be improved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech interaction method, speech interaction device and robot
  • Speech interaction method, speech interaction device and robot
  • Speech interaction method, speech interaction device and robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] Embodiment 1 of the present invention provides a voice interaction method, which is applied to a robot. In the embodiment of the present invention, the robot is usually designed to be of a height similar to that of an ordinary adult, such as 165 centimeters in height. In order to facilitate sound pickup, a circular microphone array is usually used for sound pickup, such as a 6-mic solution. The array is placed at a certain position on the head, such as the top of the head, placed horizontally, and the main microphone (microphone No. 0) is located in the center of the front of the head; the microphone array The specified beam enhancement direction is in the 0° direction. After the sound signal is obtained through the microphone array, automatic speech recognition (ASR auto speech recognition) can be performed to locate the angle of the sound source and judge the sound energy. The speech recognition engine is waken up for a long time. It has two mechanisms: one is to st...

Embodiment 2

[0046] Embodiment 2 of the present invention provides a voice interaction method, which is applied to a robot. refer to figure 2 , which is a schematic flowchart of a voice interaction method provided by an embodiment of the present invention.

[0047] Step S2001: Receive a sound signal.

[0048] In the embodiment of the present invention, the robot is usually designed to be of a height similar to that of an ordinary adult, such as 165 centimeters in height. In order to facilitate the reception of sound signals, a circular microphone array is usually used for sound pickup, such as the 6-microphone solution. The array is located at a certain position on the head, such as the top of the head, placed horizontally, and the main microphone (microphone 0) is located in the center of the front of the head; the microphone The beam enhancement direction specified by the array is in the 0° direction.

[0049] Step S2002: Detect the energy of the sound signal, and determine whether t...

Embodiment 3

[0070] Embodiment 3 of the present invention provides a voice interaction device, refer to image 3 . The voice interaction device is applied to a robot, and includes: a sound pickup module 100 , an image acquisition module 120 , and an angle adjustment module 140 . The voice interaction method provided in the first and second embodiments above can be realized by the voice interaction device provided in this embodiment.

[0071] The sound pickup module 100 is used for judging whether the sound source angle of the received sound signal is within the preset sound source angle range of the robot.

[0072] The image acquisition module 120 is used to acquire an image when the sound source angle of the received sound signal is within the preset angle range of the robot, identify the angle of one or more faces in the image, and select the angle between the face angle and the robot. The face with the closest sound source angle is the speaker.

[0073] The angle adjustment module 14...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a speech interaction method, a speech interaction device and a robot. The method is applied to the robot, and comprises the steps of obtaining an image when the sound source angle of a received sound signal is in a preset angle range of the robot, and recognizing angles of one or more human faces in the image; selecting the person whose human face angle is the closest to the sound source angle as the speaking person; adjusting the angle of the robot to make the center of the face of the speaking person falls in the center of the front of the robot, so that the sound signal is responded to. According to the speech interaction method, the speech interaction device and the robot, the speech interaction function of the robot can be more intellectualized and personified.

Description

technical field [0001] The invention belongs to the field of robots, and in particular relates to a voice interaction method, a voice interaction device and a robot. Background technique [0002] With the rapid development of modern technology, the application range of intelligent robots is becoming wider and wider. Intelligent robots can be seen in homes, shopping malls, banks and other public places. [0003] The voice interaction between the robot and the speaker has always been an important part of the robot's intelligence and anthropomorphism. In addition to the interaction in the dialogue, the direction and position of the robot relative to the speaker are also very important manifestations of intelligence. [0004] In the process of voice interaction between the existing robot and the speaker, the speaker usually takes the initiative to stand in front of the robot to make the voice interaction smoother. Relatively speaking, the robot cannot automatically position its...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): B25J11/00G06K9/00G06K9/20G10L15/22G10L15/26
CPCG10L15/22G10L15/26B25J11/0005G10L2015/226G06V40/161G06V10/10
Inventor 蒋化冰陈岳峰廖凯齐鹏举方园米万珠舒剑吴琨管伟罗璇
Owner JIANGSU MUMENG INTELLIGENT TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com