A Reality Generation Method for Virtual Objects in Teaching Scenes

Abstract

The invention belongs to the teaching application field of mixed reality technology, and provides a method for generating a sense of reality of virtual objects in a teaching scene, including: (1) perception of teaching space: collecting depth data of the teaching space, and real-time perception of scene objects within the field of view (2) Realistic virtual object generation: by collecting the light intensity in the teaching scene, the lighting effect of virtual and real fusion is realized, and the shadow effect of the virtual object is generated in real time by using ShadowMap; (3) Dynamic interactive real effect generation: through the sight target , The interaction prompt setting of the virtual hand guides the teacher to use the multi-modal algorithm to complete the real-time interaction with the virtual object. The method of the invention proposes a scheme of environment perception, object generation and dynamic interaction, establishes a set of teaching environment perception scheme from depth data collection, space perception to environment understanding, and supports generation of realistic virtual objects and real-time interaction.

Description

technical field [0001] The invention belongs to the field of teaching application of mixed reality (Mixed Reality, MR) technology, and more specifically, relates to a method for generating a sense of reality of virtual objects in a teaching scene. Background technique [0002] Virtual reality (Virtual Reality, VR) technology is one of the three major technologies of information frontier technology. MR is a branch of VR technology. The MR equipment represented by HoloLens can not only realize the superposition of virtual and real scenes, but also track the user's position through various sensors, forming a network between users, learning resources and the real environment. An information loop with interactive feedback. The enhanced teaching scene based on MR technology can break certain limitations of using large screens or electronic whiteboards in existing classroom teaching, and effectively improve the learning effect; its immersion, interactivity and intelligence feature...

AI Technical Summary

Problems solved by technology

[0003] However, there are still many problems in enhancing the reality generation of virtual objects in teaching scenes: (1) virtual objects do not understand the real environment enough, users can perceive the teaching environment through MR equipment, but virtual objects lack corresponding capabilities; (2) ) Insufficient sense of reality, virtual objects often penetrate objects in the teaching space, and the light and shadow effects are unreal; Terminal location and mapping

These drawbacks limit the application of virtual objects in augmented teaching scenarios

Images