A VR virtual reality multi-sensory interaction device for digital media teaching

Abstract

The application provides a VR virtual reality multi-sensory interaction device for digital media teaching, and relates to the technical field of virtual reality teaching equipment, and comprises a VR head-mounted device, a multi-sensory feedback module, a teaching scene generation module and an interaction control module; the multi-sensory feedback module comprises a tactile feedback unit, an olfactory feedback unit and a temperature feedback unit. Through high-resolution visual presentation of the VR head-mounted device and auditory feedback of the stereo sound earphone, in combination with vibration motor simulation material touch of the tactile glove, release of scene corresponding odor of the olfactory unit and adjustment of ambient temperature of the temperature feedback unit, a multi-dimensional sensory network covering vision, hearing, touch, smell and temperature is constructed. The application solves the problems of the existing teaching mode and the existing VR teaching technology, such as many limitations, difficulty in meeting the teaching demand of immersion and multi-sensory coordination, insufficient teaching immersion, single interaction mode, lack of scene authenticity and weak teaching pertinence.

Description

Technical Field

[0001] This invention relates to the field of virtual reality teaching equipment technology, and in particular to a VR virtual reality multi-sensory interactive device for digital media teaching. Background Technology

[0002] In the field of digital media education, traditional teaching methods mainly rely on teacher lectures combined with multimedia presentations. This teaching model suffers from limited teaching effectiveness due to insufficient practical experience of teachers, and students find it difficult to form an intuitive understanding of abstract concepts.

[0003] Application number CN202510025827.6 discloses a VR interactive experience device and its usage method. This invention uses a learning mastery calculation module to calculate the user's mastery level in real time using a formula, and dynamically adjusts the presentation frequency and time interval of content using an interval repetition algorithm. This allows learning content to be personalized according to the user's actual needs, avoiding the mechanical and monotonous nature of content display. This intelligent content delivery method not only improves the user's learning efficiency but also reduces learning fatigue caused by repetitive content, enabling users to maintain higher concentration and interest during the learning process. Through the comprehensive stimulation of multiple senses such as sight, hearing, and touch, it enhances the user's immersion, allowing users to experience and understand educational content more deeply in the VR environment. This helps to stimulate the user's emotional resonance, making the learning process more vivid and interesting, thereby significantly improving the user's memory effect.

[0004] Based on the above patent search and understanding of the application of VR virtual reality multi-sensory interaction in existing digital media teaching: In the field of digital media teaching, traditional teaching methods and existing VR teaching technologies have many limitations, making it difficult to meet the needs of immersive and multi-sensory collaborative teaching. Specifically, these limitations manifest as insufficient immersion, single interaction methods, lack of scene realism, and weak teaching relevance, which seriously restrict the improvement of teaching effectiveness.

[0005] Therefore, in view of this, we will study and improve the existing structure and its shortcomings, and provide a VR virtual reality multi-sensory interactive device for digital media teaching, in order to achieve a more practical value. Summary of the Invention

[0006] To address the aforementioned technical problems, this invention provides a VR virtual reality multi-sensory interaction device for digital media teaching. This addresses the numerous limitations of existing teaching methods and VR teaching technologies, which fail to meet the needs of immersive, multi-sensory collaborative teaching. Specifically, these limitations manifest as insufficient immersion, limited interaction methods, lack of scene realism, and weak teaching relevance, severely hindering the improvement of teaching effectiveness.

[0007] This invention provides a VR virtual reality multi-sensory interactive device for digital media teaching, specifically including: a VR headset, a multi-sensory feedback module, a teaching scene generation module, and an interactive control module; the multi-sensory feedback module includes a tactile feedback unit, an olfactory feedback unit, and a temperature feedback unit; the teaching scene generation module is used to generate a three-dimensional virtual teaching scene based on the teaching content; the interactive control module is used to receive user input and coordinate the work of each module.

[0008] Furthermore, the haptic feedback unit includes a wearable haptic glove, which has multiple built-in micro vibration motors and pressure sensors. The micro vibration motors are distributed in the fingers and palm of the haptic glove, and the pressure sensors are used to sense the user's touch pressure.

[0009] Furthermore, the olfactory feedback unit includes a replaceable scent box and a miniature fan. The scent box contains a variety of basic scent capsules, and the miniature fan can release different scents according to the virtual scene, with a scent switching response time of less than 0.5 seconds.

[0010] Furthermore, the temperature feedback unit includes a semiconductor cooling chip and a heating resistance wire. The semiconductor cooling chip and the heating resistance wire can simulate different ambient temperature changes, with a temperature adjustment range of 15-40℃ and a temperature change rate of 2℃ / second.

[0011] Furthermore, the teaching scenario generation module also includes a scenario adaptation unit, which can dynamically adjust the teaching scenario content according to student interaction, including student operation behavior, interaction response time, and operation accuracy.

[0012] Furthermore, the interactive control module includes a gesture recognition unit and a voice control unit. The gesture recognition unit includes an inertial measurement unit and an optical tracker. The voice control unit is used to recognize the user's voice commands to support multiple interaction methods.

[0013] Furthermore, it also includes a physiological monitoring module, which is used to monitor the user's heart rate, eye movement and brain wave signals in real time to obtain the user's physiological state information.

[0014] Furthermore, the physiological monitoring module is connected to the interactive control module and can automatically adjust the stimulation intensity of the virtual scene according to the user's physiological state. The stimulation intensity includes the intensity of visual, auditory, tactile, olfactory and temperature stimulation.

[0015] Furthermore, it also includes a teaching assessment module, which is used to record and analyze students' learning behaviors and performance data in the virtual environment. The learning behaviors and performance data include indicators such as interaction response time, operation accuracy, and attention concentration, and generates a visual report.

[0016] Furthermore, the VR headset communicates with the main control computer wirelessly, and is equipped with a high-resolution display screen and stereo headphones to present virtual visual and auditory information.

[0017] Compared with the prior art, the present invention has the following beneficial effects: By combining the high-resolution visual presentation of VR headsets with the auditory feedback of stereo headphones, the vibration motors of haptic gloves to simulate the tactile sensation of materials, the olfactory unit to release scene-specific odors, and the temperature feedback unit to adjust the ambient temperature, a multi-dimensional sensory network covering vision, hearing, touch, smell, and temperature is constructed. This allows students to obtain a near-realistic experience in a virtual environment, helping to transform abstract concepts into intuitive perceptions and strengthening memory and understanding.

[0018] The teaching scenario generation module has a built-in scenario adaptive unit that can dynamically adjust the virtual scenario content based on students' operation behavior, response time, and accuracy. In digital media design teaching, if students are slow to understand a certain modeling step, the system will automatically repeat the demonstration and simplify the operation difficulty to achieve "personalized teaching scenarios" and avoid the limitations of traditional teaching.

[0019] The interactive control module integrates a gesture recognition unit and a voice control unit, supporting natural gesture operation and voice commands. It breaks through the limitations of traditional keyboard and mouse interaction, conforms to the engineering design of human body interaction in reality and virtuality, lowers the operation threshold, and is especially suitable for the high-frequency real-time interaction needs in practical teaching.

[0020] The tactile gloves have built-in pressure sensors that can sense the user's touch force. Combined with the feedback from the micro vibration motor, the interaction is more realistic. The olfactory and temperature feedback responds in real time to changes in the virtual scene. In a virtual fire scenario, the gloves can release smoke and odors and raise the ambient temperature simultaneously, enhancing the sense of presence in emergency training and increasing students' active participation.

[0021] The physiological monitoring module collects signals such as heart rate, eye movement, and brain waves in real time, and links with the interactive control module to automatically adjust the intensity of virtual scene stimulation. When the student's heart rate is too fast or their attention is distracted, the system reduces the complexity of visual effects and weakens the intensity of tactile vibration to avoid learning fatigue caused by overload. If an increase in concentration is detected, the scene details and interaction difficulty are enhanced.

[0022] The teaching assessment module records data such as interaction response time, operation accuracy, and attention concentration, and generates a visual learning report. Teachers can use the report to analyze students' weaknesses and adjust their teaching plans accordingly.

[0023] The VR headset communicates with the main control computer wirelessly, eliminating the constraints of cables and allowing free movement within the classroom, making it suitable for collaborative group teaching. The system is compatible with diverse media formats such as 3D models, 360-degree videos, and interactive animations, allowing teachers to easily import existing teaching resources, reducing content development costs, and meeting the cross-platform and multi-format resource integration needs in digital media teaching.

[0024] Modular design and scalability: The multi-sensory feedback module adopts an independent unit design, which can be flexibly added, removed or replaced according to teaching needs, adapting to the differentiated teaching scenarios of different subjects, extending the applicable period of the device and reducing long-term teaching costs. Attached Figure Description

[0025] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings of the embodiments will be briefly described below.

[0026] In the attached diagram: Figure 1 A schematic diagram of the overall structure of a VR virtual reality multi-sensory interactive device for digital media teaching is shown. Figure 2 A schematic diagram of the tactile glove structure is shown; Figure 3 A flowchart illustrating the workflow is shown. Detailed Implementation

[0027] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0028] Unless otherwise defined, all terms (including technical and scientific terms) used in the embodiments of this disclosure shall have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It should also be understood that terms such as those defined in a common dictionary shall be interpreted as having a meaning consistent with their meaning in the context of the relevant art, and not as being interpreted in an idealized or highly formalized sense, unless expressly defined in the embodiments of this disclosure.

[0029] Example: As attached Figure 1 To be continued Figure 3 As shown: This invention provides a VR virtual reality multi-sensory interactive device for digital media teaching, comprising: a VR headset, a multi-sensory feedback module, a teaching scene generation module, and an interactive control module; the multi-sensory feedback module includes a tactile feedback unit, an olfactory feedback unit, and a temperature feedback unit; the teaching scene generation module is used to generate a three-dimensional virtual teaching scene based on the teaching content; the interactive control module is used to receive user input and coordinate the work of each module. The VR headset uses a dual-eye OLED display with a resolution of 3840×2160, a refresh rate of 120Hz, and a field of view of 110 degrees. It connects to the central control unit via an HDMI interface and can also communicate with the main control computer wirelessly. The central control unit runs a teaching content management system developed based on Unity3D to coordinate the work of various modules. Multi-sensory feedback module: Haptic feedback unit: Composed of miniature vibration motors distributed on the glove-type controller, with a vibration frequency range of 50-500Hz, which can simulate the touch of different materials. A pressure sensor is also installed inside the glove. Olfactory feedback unit: Contains 6 basic odor capsules, with release controlled by a micro air pump, and odor switching response time is less than 0.5 seconds; Temperature feedback unit: The temperature adjustment range is 15-40℃, and the temperature change rate is 2℃ / second, using a semiconductor cooling chip.

[0030] The haptic feedback unit includes a wearable haptic glove, which has multiple built-in micro vibration motors and pressure sensors. The micro vibration motors are distributed in the fingers and palm of the haptic glove, and the pressure sensors are used to sense the user's touch pressure.

[0031] The olfactory feedback unit includes a replaceable scent box and a miniature fan. The scent box contains various basic scent capsules, and the miniature fan can release different scents according to the virtual scene, with a scent switching response time of less than 0.5 seconds.

[0032] The temperature feedback unit includes a semiconductor cooling chip and a heating resistance wire. The semiconductor cooling chip and the heating resistance wire can simulate different ambient temperature changes, with a temperature adjustment range of 15-40℃ and a temperature change rate of 2℃ / second.

[0033] The teaching scenario generation module also includes a scenario adaptation unit, which can dynamically adjust the teaching scenario content based on student interaction, including student operation behavior, interaction response time, and operation accuracy.

[0034] The interactive control module includes a gesture recognition unit and a voice control unit. The gesture recognition unit includes an inertial measurement unit and an optical tracker. The voice control unit is used to recognize the user's voice commands to support multiple interaction methods.

[0035] It also includes a physiological monitoring module, which is used to monitor the user's heart rate, eye movement and brain wave signals in real time to obtain the user's physiological state information.

[0036] The physiological monitoring module is connected to the interactive control module and can automatically adjust the intensity of stimulation in the virtual scene according to the user's physiological state. The intensity of stimulation includes the intensity of visual, auditory, tactile, olfactory and temperature stimulation.

[0037] It also includes a teaching assessment module, which records and analyzes students' learning behavior and performance data in the virtual environment. The learning behavior and performance data includes indicators such as interaction response time, operation accuracy, and attention concentration, and generates visual reports.

[0038] The VR headset communicates with the main control computer wirelessly and is equipped with a high-resolution display and stereo headphones to present virtual visual and auditory information.

[0039] In use: This teaching device uses a central control unit as its core and constructs an immersive teaching scene through the collaborative operation of multiple modules. During operation, the central control unit synchronously generates visual, auditory, tactile, temperature, and odor signals according to the teaching content, forming a multi-dimensional sensory stimulation network. The positioning and tracking module captures the user's position and movement data in real time. The positioning and tracking module consists of four infrared cameras set in the four corners of the classroom and an IMU sensor built into the controller. The sampling frequency is 100Hz, and the positioning accuracy reaches 0.1mm. It drives the VR headset to present a dynamic 3D virtual scene and realize the visualization of the teaching content. When users interact with virtual objects, the multi-sensory feedback module triggers precise feedback based on the attributes of the interactive object: the tactile feedback unit simulates the tactile feel of the model material, such as the texture perception when 3D modeling in digital media teaching; the temperature feedback unit dynamically adjusts with the virtual environment temperature; the olfactory feedback unit releases corresponding odors in specific scenarios, such as the gas simulation in a chemical experiment scenario, comprehensively enhancing the immersive experience; the teaching scenario generation module adjusts the scenario content in real time based on student interaction data; and the interaction control module integrates input commands such as gestures and voice, coordinating the synchronous work of various functional modules.

[0040] In addition, the physiological monitoring module continuously tracks users' physiological indicators such as heart rate and pupil changes, and automatically adjusts the intensity of virtual scene stimulation to adapt to individual conditions; the teaching content management system supports the import of diverse media formats such as 3D models, 360-degree videos, and interactive animations, providing flexibility for the integration of teaching resources; the system's built-in teaching analysis module records data such as interaction response time, operation accuracy, and attention concentration in real time, and generates visual learning reports to help teachers optimize teaching plans.

[0041] The above are merely specific embodiments of this disclosure, but the scope of protection of this disclosure is not limited thereto. The scope of protection of this disclosure shall be determined by the scope of the claims.

Claims

1. A VR (Virtual Reality) multi-sensory interactive device for digital media teaching, characterized in that, include: VR headset, multi-sensory feedback module, teaching scene generation module, and interactive control module; The multi-sensory feedback module includes a tactile feedback unit, an olfactory feedback unit, and a temperature feedback unit; the teaching scene generation module is used to generate a three-dimensional virtual teaching scene based on the teaching content; and the interactive control module is used to receive user input and coordinate the work of each module.

2. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: The tactile feedback unit includes a wearable tactile glove, which incorporates multiple miniature vibration motors and pressure sensors.

3. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: The olfactory feedback unit includes a replaceable scent box and a miniature fan, which can release different scents according to the virtual scene.

4. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: The temperature feedback unit includes a semiconductor cooling chip and a heating resistance wire, which can simulate different ambient temperature changes.

5. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: The teaching scenario generation module also includes a scenario adaptive unit, which can dynamically adjust the teaching scenario content based on student interaction.

6. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: The interactive control module includes a gesture recognition unit and a voice control unit, supporting multiple interaction methods.

7. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: It also includes a physiological monitoring module for real-time monitoring of the user's heart rate, eye movement, and brain wave signals.

8. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 7, characterized in that: The physiological monitoring module is connected to the interactive control module and can automatically adjust the stimulation intensity of the virtual scene according to the user's physiological state.

9. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: It also includes a teaching assessment module for recording and analyzing students' learning behaviors and performance data in the virtual environment.

10. The VR virtual reality multi-sensory interactive device for digital media teaching as described in claim 1, characterized in that: The VR headset communicates with the main control computer wirelessly and is equipped with a high-resolution display screen and stereo headphones.

Images