AR interest learning system and method based on entertainment interaction

A learning system and fun technology, applied in the field of AR fun learning system based on entertainment interaction, can solve problems such as single interactive experience, low fun of educational interactive programs and devices, so as to improve learning interest, solve low fun problems and interact Experience the effect of single problem and cost reduction

Inactive Publication Date: 2016-10-12
广东博士教育科技有限公司
View PDF11 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The present invention overcomes the deficiencies of the prior art, provides an AR interesting learning system and method based on entertainment interaction, and solves the problem of low interest and single interactive experience of current educational interactive programs and devices, and the system of this invention is simple to operate and low in cost. Low, convert some rigid abstract two-dimensional images into three-dimensional information, very suitable for children's multimedia interactive teaching, and has great advantages compared with the current highly interactive multimedia interactive teaching system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • AR interest learning system and method based on entertainment interaction
  • AR interest learning system and method based on entertainment interaction
  • AR interest learning system and method based on entertainment interaction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] like Figure 1-3 Shown, the present invention comprises a kind of fun learning system based on augmented reality, comprises:

[0041] At least one physical book page, each physical page corresponds to one identification information, and each identification information corresponds to one or more three-dimensional models and one or more audio information; physical book pages include but are not limited to teaching books, literacy cards, knowledge cards, teaching Appliances; and the identification information is also obtained by processing the patterns on teaching books, word cards, object cards, and teaching tools by the image recognition preprocessing program 1311.

[0042] The camera device is used to collect the image data of the physical book pages and the video images of the physical book pages in real time, and then provide the image information and video images to the program running device; the camera on the camera device can be composed of ordinary cameras, or ca...

Embodiment 2

[0052] This embodiment is preferably as follows on the basis of Embodiment 1: the program running device includes:

[0053] The recognition module is used to process and analyze the image data collected and transmitted by the camera device when the user places the physical book page in the collection range of the camera device, identify the identification information corresponding to the physical book page, and analyze the identification information The 3D model and audio information corresponding to the information are sequentially processed through image feature point extraction, feature point screening, feature point description, and image matching to realize image processing and recognition matching; the recognition module needs to identify physical book pages and analyze the corresponding 3D model and audio information , need as figure 2 A step of:

[0054] S301 The user creates image files of physical book pages, including but not limited to printed image files of teac...

Embodiment 3

[0096] This embodiment is preferably as follows on the basis of the above-mentioned embodiments: the 3D rendering module includes a model preprocessing module and a rendering module, and the model preprocessing module parses the FBX model file based on the Autodesk FBX SDK, abandons the model characteristics that are not supported by the mobile terminal, and exports the middle of the model file, the intermediate file of the model is read by the rendering module.

[0097] The recognition module includes an image recognition preprocessing unit and a mobile terminal recognition module. The image recognition preprocessing unit processes the image information of the physical book page to obtain the identification information of the physical book page. The recognition module receives the real-time image information of the physical book page collected by the camera device to obtain the identification information of the image , so as to obtain one or more 3D models and one or more audi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an AR interest learning system and method based on entertainment interaction. The system comprises at least one entity page, a camera device, a display device, and a program operation device. The method comprises steps of enabling an image recognition preprocessing unit to process the image data of the entity page; importing the image data of the entity page processed by the image recognition preprocessing unit and binding an image ID to a corresponding 3D model and audio information; starting the mobile end application program of the interest learning system, starting the camera device to acquire real world entity page image in real time and rendering areal world video image; enabling an identification module to identify the identifier information of the entity page; enabling a tracking module to compute the spatial position information of the entity page in real time to achieve AR experience. The above principle and method solve a problem of low interestingness and single interactive experience of a conventional education interactive program and device, and are easy to operate, low in cost, and very suitable for child multimedia interactive teaching.

Description

technical field [0001] The present invention relates to the technical field of multimedia interactive teaching systems, in particular to an entertainment interactive-based AR fun learning system and method. Background technique [0002] Augmented Reality (AR for short) is a technology in which real information and virtual information are superimposed. Using computer technology to superimpose virtual information in a certain spatial position in the real world in advance, users can see the virtual information superimposed in this spatial position in the real world. The virtual information and real information complement each other to enhance the user's understanding of things. Augmented reality uses computer graphics technology to generate virtual information that does not exist in the real environment; through computer vision technology and sensing technology, these virtual information are displayed in real time at a certain spatial position in the real world and integrated w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G09B5/14G06F3/01G06T19/00
CPCG09B5/14G06F3/011G06T19/00
Inventor 黄旋辉
Owner 广东博士教育科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products