Robot, control method thereof and computer readable storage medium

A control method and robot technology, applied in the field of image processing, can solve problems such as impoliteness, the inability of the robot to accurately judge the direction of the sound source, and the reduction of the user's human-computer interaction experience

Pending Publication Date: 2020-06-05
UBTECH ROBOTICS CORP LTD
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, when faced with a group of people or noise interference, the robot cannot accurately judge the direction of the sound source, resulting in the "impolite" behavior of "you talk to it, but it faces others", which reduces the human-computer interaction of the user. experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot, control method thereof and computer readable storage medium
  • Robot, control method thereof and computer readable storage medium
  • Robot, control method thereof and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the specific embodiments described here are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only some structures related to the present application are shown in the drawings but not all structures. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0026] The terms "first", "second", etc. in this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a robot, a control method thereof and a computer readable storage medium. The control method of the robot comprises the steps of: acquiring at least one piece of face information from collected to-be-detected images; acquiring at least one piece of corresponding lip information from the at least one piece of face information; inputting the at least one piece of lip information into a preset deep learning model to classify the at least one piece of lip information, so as to further determine a speaking face region of a speaker who is speaking; and controlling the robot to rotate to face the speaking face region, and starting a voice recognition function. By means of the control method, on one hand, the speaking user can be accurately positioned when multiple personsinteract at the same time, on the other hand, interference of noise on the robot can be avoided, and the man-machine interaction experience of the user is improved.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to a robot, a control method thereof, and a computer-readable storage medium. Background technique [0002] With the development and progress of artificial intelligence, human-computer interaction has become more and more widely used. Existing robots can obtain the user's voice information for processing, and complete the dialogue with the user. It mainly locates through the sound source to further determine the direction of the speaker, and turns to the speaker for voice dialogue. [0003] However, when faced with a group of people or noise interference, the robot cannot accurately judge the direction of the sound source, resulting in the "impolite" behavior of "you talk to it, but it faces others", which reduces the human-computer interaction of the user. experience. Contents of the invention [0004] In order to solve the above problems, the present applic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/171G06V40/161G06N3/044G06N3/045G06F18/24
Inventor 黄冠文程骏庞建新谭欢熊友军
Owner UBTECH ROBOTICS CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap