Unlock instant, AI-driven research and patent intelligence for your innovation.
Method and system for interactive identity identification and tracking based on multi-modal intelligent robot
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
An intelligent robot and identity authentication technology, which is applied in the field of intelligent robots, can solve problems such as lack of single-modal information, inability to recognize and track interactive identities, etc., and achieve the effect of improving recognition accuracy and efficiency
Active Publication Date: 2021-03-30
HENAN UNIVERSITY
View PDF5 Cites 0 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0004] The purpose of the present invention is to solve the problem of multi-modal identity recognition of intelligent robots, and provide a method and system for multi-modal identification and tracking of interactor identities of dialogue intelligent robots, which can solve the lack of single-modal information and cannot identify and track interactions identity issue
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0056] Such as figure 1 As shown, a kind of interactive identification and tracking method based on multimodal intelligent robot of the present invention comprises the following steps:
[0057] Step S101: collecting multi-channel information of interactive objects;
[0058] Step S102: using a deep neural network to extract activation features to form multi-modal features of multi-channel interactive information;
[0059] Step S103: using integrated learning of cross-modal probability cognition to identify the face image features and voiceprint features;
[0060] Step S104: Register and track the identity of the interactor identified by the cross-modal attribute.
Embodiment 2
[0062] Such as figure 2 As shown, another kind of interactive identification and tracking method based on multimodal intelligent robot of the present invention comprises the following steps:
[0063] Step S201: collecting multi-channel information MI of an interactive object, including:
[0064] As a possible implementation, the intelligent robot is an intelligent dialogue robot, including: a microphone array, a binocular camera, an infrared camera and a depth sensor;
[0065] Step S2011: collect the voiceprint and voice information VA of the interactor through the microphone array of the intelligent dialogue robot, and collect information for identifying the interaction identity and understanding the interaction intention;
[0066] Step S2012: Collect the face RGB image FV and body information of the interactor through the binocular camera of the intelligent dialogue robot, and collect information for identifying the interaction identity and understanding the interaction in...
Embodiment 3
[0086] Such as image 3 As shown, a kind of interactive identification and tracking system based on multimodal intelligent robot of the present invention comprises:
[0087] A multi-channel information collection module 301, configured to collect multi-channel information of interactive objects;
[0088] The multimodal feature extraction module 302 is used to extract activation features using a deep neural network to form multimodal features of multi-channel interactive information;
[0089] The cross-modal identity identification module 303 is used to identify the face image features and voiceprint features by adopting integrated learning of cross-modal probability cognition;
[0090] The interactive object registration tracking module 304 is configured to register and track the identity of the interactor identified by the cross-modal attribute.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
PUM
Login to View More
Abstract
The invention belongs to the field of intelligent robots, and in particular relates to a method for multimodal identification and tracking of interactor identities for intelligent dialogue robots, and in particular to an interactive identity identification and tracking method and system based on multimodal intelligent robots. The interactive identification and tracking method based on multi-modal intelligent robots includes: collecting multi-channel information of interactive objects; using deep neural network to extract activation features to form multi-modal features of multi-channel interactive information; using cross-modal probability cognition The integrated learning of face image features and voiceprint features is used for identity identification; the identity of interactors identified by cross-modal attributes is registered and tracked. The interactive identification and tracking system based on multi-modal intelligent robots includes: a multi-channel information collection module; a multi-modal feature extraction module; a cross-modal identity identification module; and an interactive object registration and tracking module. The invention can solve the problems of lack of single-mode information and failure to identify and track interactive identities.
Description
technical field [0001] The invention belongs to the field of intelligent robots, and in particular relates to a method for multimodal identification and tracking of interactor identities for intelligent dialogue robots, and in particular to a method and system for identifying and tracking interactive identities based on multimodal intelligent robots. Background technique [0002] With the development of computer technology and artificial intelligence, the research of intelligent robots has gradually entered into many service fields. Human-computer interaction is an important technical issue in the research of intelligent dialogue robots. When users interact with dialogue machines, only when intelligent dialogue robots recognize and memorize the information of the interlocutors participating in the interaction can they effectively understand the meaning of dialogue or interaction. At the same time, the historical information of the interactive participants records the user's ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to View More 
Login to View More