Children reading and interacting method and system based on an intelligent robot

A technology for intelligent robots and children's books, which is applied to instruments, computer components, character and pattern recognition, etc., can solve problems such as multi-modal interactive intelligent products and imperfect development of multi-modal interactive systems, and reduce The effect of reading difficulty and improving user experience

Inactive Publication Date: 2019-03-26
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF10 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, at present, the development of robot multimodal interaction systems related to intelligent robots is not yet perfect, and intelligent products based on children's books for multimodal interaction with users have not yet appeared.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Children reading and interacting method and system based on an intelligent robot
  • Children reading and interacting method and system based on an intelligent robot
  • Children reading and interacting method and system based on an intelligent robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0040] For clarity of expression, it is necessary to carry out the following explanations before the examples:

[0041] The intelligent robot mentioned in this invention supports multi-modal human-computer interaction, and has AI capabilities such as natural language understanding, visual perception, language and voice output, and emotional expression and action output; it can be configured with social attributes, personality attributes, character skills, etc., so that users can enjoy Intelligent and personalized smooth experience.

[0042] The intelligent robot obtains the user's multi-modal data, and with the support of the cloud brain's capabilities, it performs semantic understanding, visual recognition, cognitive computing, and emotional co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a child reading and interacting method based on an intelligent robot. wherein the intelligent robot is in an open state to obtain a reading instruction, and the child reading material is placed in an intelligent robot recognition range and comprises the following steps: tracking a hand action of a user in a recognizable range, recognizing a gesture of the user through a visual recognition capability, determining that the gesture has a reading intention, and determining to-be-recognized content in the child reading material to which the gesture points; Identifying text information and image information in the to-be-identified content, and performing text semantic understanding and image semantic understanding on the text information and the image information to obtaintarget object information contained in the to-be-identified content; And obtaining question and answer data matched with the target object information, generating multi-modal output data, receiving aresponse of the user to the multi-modal output data, and performing multi-round interaction with the user. The gesture of the user can be recognized, the content of the child reading material pointedby the gesture of the user is read, the use experience of the user is improved, and the reading difficulty of the child user is reduced.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a method and system for reading and interacting children's books based on intelligent robots. Background technique [0002] In conventional children's education, children's books are presented in the form of printed matter such as paper, and are read by children themselves or accompanied by parents. Because children users do not have a complete knowledge reserve, there are some difficulties in reading and learning children's books. It is difficult Fluent reading or comprehension of content in children's books. [0003] In addition, the development of multimodal interaction systems for robots is devoted to imitating human dialogue in an attempt to imitate human-human interaction between contexts. However, at present, the development of robot multimodal interaction systems related to intelligent robots is not yet perfect, and intelligent products based on children's books fo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G09B19/00
CPCG09B19/00G06V40/28G06V40/113G06V30/413
Inventor 俞晓君
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap