Multimode interaction method and system applied to intelligent robot
A technology of intelligent robot and interaction method, which is applied in the field of multi-modal interaction applied to intelligent robots, can solve problems such as inconvenient voice mode, monotonous interaction mode, and inability to meet user experience requirements, and achieve the effect of improving user experience
Active Publication Date: 2017-05-10
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF5 Cites 8 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
This interaction method is relatively monotonous, and for some special users, the voice method is inconvenient, so it cannot meet the growing experience needs of users
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0022] The implementation of the present invention will be described in detail below in conjunction with the accompanying drawings and examples, so as to fully understand and implement the implementation process of how to apply technical means to solve technical problems and achieve corresponding technical effects in the present invention. The embodiments of the present application and the various features in the embodiments can be combined with each other under the premise of no conflict, and the formed technical solutions are all within the protection scope of the present invention.
[0023] Additionally, the steps shown in the flowcharts of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a multimode interaction method and system applied to an intelligent robot. The method comprises an image obtaining step of obtaining a depth image and a grayscale image comprising a hand executing gesture actions, a posture classifying and analyzing step of processing the depth image and the grayscale image and analyzing postures represented by the gesture actions and attributes of the gesture actions, and a multimode output step of executing multimode output instructions corresponding to the gesture actions according to analysis results. According to the method and the system, multimode interaction with a user can be realized in a gesture identification manner, so that the user experience is improved.
Description
technical field [0001] The present invention relates to the field of intelligent robots, in particular to a multimodal interaction method and system applied to intelligent robots, Background technique [0002] With the gradual popularization of intelligent robot products, more intelligent robots have entered the family, becoming children's playmates and adults' housekeepers. [0003] In the prior art, in the process of multi-modal interaction with the user, the intelligent robot generally recognizes the user's voice command through voice recognition technology, and then performs corresponding multi-modal output according to the content of the command. This interaction method is relatively monotonous, and for some special users, the voice method is inconvenient, so it cannot meet the growing experience needs of users. [0004] Therefore, there is an urgent need to provide a novel multi-modal interaction method that can improve user experience and meet user needs. Contents ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00G06K9/62
CPCG06F3/017G06V40/107G06F18/2411
Inventor 丁超
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH