A method for automatic generation of teaching aids based on the fusion of virtual and real

Abstract

The invention belongs to the teaching application field of mixed reality technology, and provides a method for automatically generating teaching aids that integrate virtual reality, including: (1) information acquisition of real teaching environment; (2) generation of virtual teaching aids; (3) virtual teaching aids and real environment fusion. The teaching aid automatic generation method of virtual and real fusion in the present invention, around the demand of a new generation of intelligent teaching environment, proposes a real environment information collection, virtual teaching aid generation and integration with the real environment. The 3D real-time map of the teaching environment, the collection method of the teacher's interactive behavior and voice commands; according to the machine language, the hierarchical relationship between the virtual teaching aid model and its components is automatically generated; the virtual teaching aid model and its labeling information are dynamically rendered to realize the integration with the real teaching environment.

Description

technical field [0001] The invention belongs to the field of teaching application of mixed reality (Mixed Reality, MR) technology, and more specifically relates to a method for automatically generating teaching aids with fusion of virtual and real. Background technique [0002] Technologies such as 5G, VR / AR / MR, and holographic projection are profoundly changing the traditional teaching environment. Building a new generation of teaching environment that integrates virtual reality and online and offline has become a new mission for the future education model in the era of artificial intelligence. In the teaching process, virtual teaching aids can transform abstract knowledge into concrete and visualized content, reduce the difficulty for students to master complex and abstract concepts, and improve observation, practice and scientific thinking ability. The hybrid enhanced learning environment based on MR technology can build an interactive feedback information loop between vi...

AI Technical Summary

Problems solved by technology

[0003] However, there are still many problems in the generation of virtual teaching aids: (1) the form of expression is more complex. Compared with traditional teaching aids such as textbook pictures, blackboard hand-drawn graphics, and real objects, the presentation of 3D interactive models or panoramic videos is more complicated; (2) the generation of The method is not smart enough, creating virtual teaching aid models through 3D modeling and panoramic shooting, which limits the large-scale and normal use of teachers in teaching; (3) The interaction method is not natural enough, and the traditional mouse and keyboard interaction method aggravates the contextualized teaching Difficulties in scene creation, which no longer meet the requirements for the use of multi-modal interactive teaching resources

These defects limit the application of virtual teaching aids in normalized teaching

Images