Multimodal interaction method and system applied to intelligent robots
A technology of intelligent robot and interaction method, which is applied in the field of multi-modal interaction applied to intelligent robots, can solve problems such as inconvenient voice mode, failure to meet user experience requirements, monotonous interaction mode, etc., and achieve the effect of improving user experience
Active Publication Date: 2020-06-02
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
This interaction method is relatively monotonous, and for some special users, the voice method is inconvenient, so it cannot meet the growing experience needs of users
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] The implementation of the present invention will be described in detail below in conjunction with the accompanying drawings and examples, so as to fully understand and implement the implementation process of how to apply technical means to solve technical problems and achieve corresponding technical effects in the present invention. The embodiments of the present application and the various features in the embodiments can be combined with each other under the premise of no conflict, and the formed technical solutions are all within the protection scope of the present invention.
[0023] Additionally, the steps shown in the flowcharts of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a multi-modal interaction method and system applied to an intelligent robot. The method includes: an image acquisition step of acquiring a depth image and a grayscale image of a hand performing a gesture action; a gesture classification and analysis step of analyzing the depth The image and the grayscale image are processed to analyze the gesture and attributes represented by the gesture; and the multimodal output step executes the multimodal output instruction corresponding to the gesture according to the analysis result. The present invention can realize multimodal interaction with the user by means of gesture recognition, thereby improving user experience.
Description
technical field [0001] The present invention relates to the field of intelligent robots, in particular to a multimodal interaction method and system applied to intelligent robots, Background technique [0002] With the gradual popularization of intelligent robot products, more intelligent robots have entered the family, becoming children's playmates and adults' housekeepers. [0003] In the prior art, in the process of multi-modal interaction with the user, the intelligent robot generally recognizes the user's voice command through voice recognition technology, and then performs corresponding multi-modal output according to the content of the command. This interaction method is relatively monotonous, and for some special users, the voice method is inconvenient, so it cannot meet the growing experience needs of users. [0004] Therefore, there is an urgent need to provide a novel multi-modal interaction method that can improve user experience and meet user needs. Contents ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06K9/00G06K9/62
CPCG06F3/017G06V40/107G06F18/2411
Inventor 丁超
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH