Speaking object determination method and device, electronic equipment and storage medium
A technology for determining methods and objects, applied in the field of robotics, can solve problems such as affecting user experience, unable to identify objects interacting with robots, unable to achieve effective interaction with speaking objects, etc., to achieve the effect of improving user experience
Pending Publication Date: 2021-06-11
UBTECH ROBOTICS CORP LTD
View PDF0 Cites 4 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0002] Robots generally realize the interaction with users through voice recognition. When a robot faces multiple users at the same time, it cannot recognize the object interacting with the robot only by the received voice, that is, it cannot determine the robot's speaking object, so that it cannot communicate with the speaking object. effective interaction, affecting user experience
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0061] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
[0062] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude one or more other features. , whole, step, operation, element, component and / or the presence or addition of a collection thereof.
[0063] When th...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention is suitable for the technical field of robots, and provides a speaking object determination method and device, electronic equipment and a storage medium. The speaking object determination method comprises the steps of obtaining face images in an initial image shot by a robot, determining lip shielding information and lip change information of each face image, and one piece of lip change information being change information of a lip in one face image relative to a lip in a reference image, and taking a user corresponding to the face image of which the lip shielding information indicates that the lip is not shielded and the lip change information meets a preset change condition as a speaking object of the robot. As the initial image shot by the robot is the image of the user in the visual angle of the robot, the user who is speaking in the visual angle of the robot can be determined according to the lip shielding information and the lip change information of each face image, so that the speaking object of the robot is determined, effective interaction with the speaking object is realized, and the user experience is improved.
Description
technical field [0001] The present application belongs to the technical field of robots, and in particular relates to a method, a device, an electronic device and a storage medium for determining a speaking object. Background technique [0002] Robots generally realize the interaction with users through voice recognition. When a robot faces multiple users at the same time, it cannot recognize the object interacting with the robot only by the received voice, that is, it cannot determine the robot's speaking object, so that it cannot communicate with the speaking object. effective interaction, affecting user experience. Contents of the invention [0003] In view of this, the embodiments of the present application provide a method, an apparatus, an electronic device, and a storage medium for determining a speaking object, which can determine the speaking object of a robot, thereby realizing effective interaction with the speaking object and improving user experience. [0004...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06K9/00
CPCG06V40/171G06V40/20
Inventor 黄冠文程骏庞建新谭欢
Owner UBTECH ROBOTICS CORP LTD