A multi-channel fusion display method of virtual learning environment for field practice teaching

Abstract

The invention belongs to the teaching application field of virtual reality technology, and provides a virtual learning environment multi-channel fusion display method for field practice teaching, including three steps of content generation, audio-visual channel fusion and multi-channel interaction design. According to the characteristics of the teaching content in the VR learning environment, the present invention establishes a set of generation methods from data collection, knowledge organization and scene switching; through the spatial rendering method, the synchronous update of the audio-visual channel is realized; the input and output priority of each interactive channel is evaluated Level assessment, to complete the multi-sensory collaborative interaction of learners in the VR learning environment. The present invention realizes the integrated display of the VR learning environment by adding auditory clues and multi-channel user interaction discrimination methods, which can enhance the sense of reality of the learning environment and improve the immersive experience of participants.

Description

technical field [0001] The invention belongs to the teaching application field of virtual reality (Virtual Reality, VR) technology, and more specifically relates to a multi-channel fusion display method of a virtual learning environment oriented to field practice teaching. Background technique [0002] Field practice is an important practical link in the training of professionals in geography, geology, biology and other disciplines. It is an important educational activity to train students to integrate theory with practice, master the basic knowledge and basic skills of the discipline, and improve their comprehensive quality and practical innovation ability. However, there are many problems in field practice at present, such as the lack of teachers with solid taxonomic foundation and rich field practice experience; there are many students in practice and the time is short, so it is difficult for teachers to provide "one-to-one" guidance; the practice content and mode are sing...

AI Technical Summary

Problems solved by technology

[0003] Although the current panoramic method can quickly build a realistic field practice VR learning environment, it cannot fully meet the actual needs of field practice teaching

For example, taking the field practice of biology as an example, VR panoramic video can capture images of communication behaviors, social behaviors, and reproductive behaviors between animals, but it is difficult to convey to learners the biological behaviors it metaphors, such as the vocalization mechanism of animals , sound signal characteristics, sound wave reception, processing and recognition are not easy to convey in the picture

Through multi-camera sound synchronization processing, learners can feel the sound differences in all directions, and the sound source changes of panoramic sound simulation can present natural and realistic effects, but this is a situation where the camera positions are relatively fixed, which is difficult to meet the requirements of field practice teaching The demand for all-round presentation of hearing

Images