Augmented reality-based Chinese Pinyin combination recognition and reading learning system and recognition and reading method

Abstract

The invention relates to an augmented reality-based Chinese Pinyin combination recognition and reading learning system. The augmented reality-based Chinese Pinyin combination recognition and reading learning system includes recognition and reading Pinyin cards with pinyin pictures, a Pinyin picture image recognition module, a Pinyin combination processing module, a Pinyin recognition and reading module and a multimedia module; the Pinyin picture image recognition module calls the Pinyin combination processing module to process obtained Pinyin data when encountering a plurality of Pinyin cards; the output end of the Pinyin picture image recognition module is connected with the input end of the Pinyin recognition and reading module, so that multimedia unit marks formed by initial consonant combinations and final vowel combinations of the Pinyin can be obtained from the recognition and reading Pinyin cards with the Pinyin pictures and are recognized; the output end of the Pinyin recognition and reading module is connected with the input end of the multimedia module, so that specific pronunciations of Pinyin combinations and multimedia images related to the pronunciations can be outputted; the recognition and reading Pinyin cards with the Pinyin pictures are cards printed with Pinyin initial consonant images or final vowel images; and each card is printed with a Pinyin picture with unique identification features.

Description

technical field [0001] The invention belongs to the technical field of augmented reality, and in particular relates to a Chinese phonetic alphabet combined recognition and reading learning system and method based on augmented reality. Background technique [0002] Augmented Reality (AR) technology is a new technology developed on the basis of virtual reality technology, and it is an important branch of virtual reality research. Augmented reality technology generates virtual objects that do not exist in the real environment by means of computer image technology and visualization technology, and accurately integrates the virtual objects into the real environment, and applies virtual information to the real world, thus presenting a realistic effect to the user. The ultimate goal of this technology is to integrate the virtual world into the real world on the screen and interact with it. Augmented reality has the following characteristics: one is the combination of virtual and r...

AI Technical Summary

Problems solved by technology

Although this invention provides a method for identifying pinyin using augmented reality technology and displaying related learning videos through the recognized letters, such a simple recognition call cannot make up for the effect of enhanced interaction in the process of pinyin learning, nor can it location, to realize the effective combination of real pinyin image and virtual image

Images