Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-mode interactive method and system related to application program of intelligent robot

A technology of intelligent robots and applications, applied in the field of intelligent robots, can solve problems such as reducing user experience, mismatching intentions, poor intelligence and anthropomorphism, etc.

Inactive Publication Date: 2017-06-13
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF5 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the uncertainty of the user's language and actions, these words and actions will have multiple meanings. When the robot receives the user's instructions issued in the above way, it cannot clarify the user's real purpose, and the executed instructions are often inconsistent with the user's intention. does not match
Therefore, the existing robots are poor in intelligence and anthropomorphism, and cannot accurately execute instructions related to the user's real intention, which reduces the user experience.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-mode interactive method and system related to application program of intelligent robot
  • Multi-mode interactive method and system related to application program of intelligent robot
  • Multi-mode interactive method and system related to application program of intelligent robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] figure 1 It is a schematic flowchart of a multimodal interaction method related to an application program of an intelligent robot according to Embodiment 1 of the present invention. In the intelligent robot operating system. Refer below figure 1 Each step of the embodiment of the present invention will be described. The method of this embodiment mainly includes the following steps.

[0031] In step S110, the user's multi-modal input instruction is received, and the multi-modal input instruction is analyzed.

[0032] Multimodal input instructions mainly come from instructions input by users, and these multimodal input instructions include text data, audio data, video data, image data, and program instructions for enabling the robot to output certain actions or execute software or hardware. Since the intelligent robot in the embodiment of the present invention is a robot that does not have hardware input devices such as a keyboard, a mouse, and a touch screen, and is s...

Embodiment 2

[0043] figure 2 It is a schematic flow chart of the multimodal interaction method related to the application program of the intelligent robot according to the second embodiment of the present invention. Similarly, the multimodal interaction method is preferably executed in the environment of the robot operating system, and the application program involved in it runs In this intelligent robot operating system. The method in this embodiment mainly includes the following steps, wherein the steps similar to those in Embodiment 1 are marked with the same reference numerals, and the specific content thereof will not be repeated, and only the different steps will be described in detail.

[0044] In step S110, the user's multi-modal input instruction is received, and the multi-modal input instruction is analyzed.

[0045] In step S120, filter and match user intentions based on the analysis results. Wherein the user intent includes the operation expression related to the application...

Embodiment 3

[0056] image 3 It is a schematic structural diagram of the multi-modal interaction system 3 related to the application program of the intelligent robot according to the third embodiment of the present invention. Such as image 3 As shown, the multimodal interaction system 3 of the embodiment of the present application mainly includes: a multimodal input instruction analysis module 310 , a user intention screening and matching module 320 , a target application acquisition module 330 and an application operation module 340 . The above-mentioned intelligent robot is installed with a robot operating system, and the application program runs in the robot operating system.

[0057] The multimodal input instruction analysis module 310 is configured to receive a user's multimodal input instruction and analyze the multimodal input instruction.

[0058] The user intention screening and matching module 320 is configured to perform screening and matching of user intentions based on anal...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a multi-mode interactive method and system related to an application program of an intelligent robot. The method comprises: receiving a multi-mode input instruction of a user, analyzing the multi-mode input instruction, and filtering and matching the user intention based on the analysis result, wherein the user intention comprises an operation expression related to the application program; and generating multi-mode intention confirmation information and outputting the information to the user so as to obtain an operation instruction for the target application. According to the method disclosed by the present invention, when the user sends a fuzzy instruction by voice or action, the robot can obtain the accurate instruction by outputting the intention confirmation information, and executes the application program operation corresponding to the instruction, so that the intelligence and anthropomorphism of the robot are improved.

Description

technical field [0001] The present invention relates to the field of intelligent robots, in particular to a multimodal interaction method and system related to application programs of intelligent robots, Background technique [0002] With the gradual popularization of intelligent robot products, more intelligent robots have entered the family, becoming children's playmates and adults' housekeepers. [0003] In the prior art, considering the convenience of intelligent robots, some intelligent robots do not include hardware input devices such as keyboards, mice, and touch screens. When users give commands to robots, they are often implemented through language or actions. . However, due to the uncertainty of the user's language and actions, these words and actions will have multiple meanings. When the robot receives the user's instructions issued in the above way, it cannot clarify the user's real purpose, and the executed instructions are often inconsistent with the user's in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/00
CPCG06N3/008
Inventor 郭家
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com