A course training system in a naked eye 3D immersive environment

Abstract

The application discloses a course training system in a naked-eye 3D immersive environment, comprising a scene construction module, a biological information acquisition module, a user interaction module, a central control module and a scene interaction module; the scene construction module is used for constructing a naked-eye 3D environment; the biological information acquisition module is used for acquiring biological information of a user; the user interaction module is used for displaying the biological information and control commands of the central control module; the user interaction module is used for providing interaction options for the user; the central control module is used for receiving the biological information and performing preliminary analysis to obtain an analysis result; according to the analysis result, training content is selected and guided and played; the central control module is used for collecting and processing biological information emitted by the user in real time when the user is training, adjusting the training content according to the biological information and obtaining a statistical result; the scene interaction module is used for constructing different scenes according to the training content; and the scene interaction module is used for providing scene interaction functions for the user.

Description

Technical Field

[0001] This application relates to the field of bioinformatics processing, specifically to a course training system in a naked-eye 3D immersive environment. Background Technology

[0002] In today's fast-paced society, anxiety, depression, and other negative emotions have become serious problems that cannot be ignored. In the search for ways to alleviate these problems, mindfulness training and meditation practices have gradually come into focus. "Mindfulness" is defined as "intentional, non-judgmental attention or awareness of the present moment." The characteristics of mindfulness are calmness, non-judgment, and continuous awareness of bodily sensations, perceptions, emotional states, thoughts, and images. Kabat-Zinn, the founder of Mindfulness-Based Stress Reduction (MBSR), believes that this awareness allows us to consciously recognize the fact that our lives unfold in one present moment after another. Furthermore, brain training is gradually being accepted by modern people and has become a powerful tool for students to improve their learning abilities and academic performance. Brain training involves various courses and training games designed based on psychology and neuroscience. These training methods can help the brain improve reaction speed, enhance concentration, strengthen memory and cognitive abilities, thereby improving learning ability and academic performance.

[0003] However, current mindfulness and brain training either rely on VR glasses for immersion or use bulky monitoring devices. These methods lack the ability to provide real-time conversion and analysis, or to adjust course content based on user needs. Furthermore, the 3D motion sickness caused by VR glasses remains a significant technological hurdle. Summary of the Invention

[0004] This application utilizes projection equipment to construct a surround 3D scene effect, and at the same time adjusts the course content by monitoring the user's biometric information in real time, truly achieving "targeted treatment" and improving training effectiveness.

[0005] To achieve the above objectives, this application provides a course training system in a naked-eye 3D immersive environment, including: a scene construction module, a bio-information acquisition module, a user interaction module, a central control module, and a scene interaction module;

[0006] The scene construction module is connected to the central control module and is used to construct a naked-eye 3D environment;

[0007] The bio-information acquisition module is connected to the user interaction module and is used to collect the user's bio-information;

[0008] The user interaction module is connected to the central control module and is used to display the biological information and the control commands of the central control module; the user interaction module is also used to provide interactive options for the user;

[0009] The central control module is connected to the bio-information acquisition module and is used to receive the bio-information and perform preliminary analysis to obtain analysis results; based on the analysis results, it selects training content and guides and plays the training content; the central control module is also used to collect and process the bio-information emitted by the user during training in real time, adjust the training content based on the bio-information, and finally obtain statistical results.

[0010] The scene interaction module is connected to the central control module and is used to construct different scenes based on the training content; the scene interaction module is also used to provide scene interaction functions for users.

[0011] Preferably, the scene construction module includes: a visual environment construction unit and a sound environment construction unit;

[0012] The visual environment construction unit is used to construct a naked-eye 3D visual environment;

[0013] The sound environment construction unit is used to construct a stereo sound reverberation environment.

[0014] Preferably, the workflow of the bio-information acquisition module includes: collecting electrical signals of the bio-information emitted by the user; converting the electrical signals into digital signals and transmitting the digital signals to the user interaction module.

[0015] Preferably, the user interaction unit includes: a bio-information display unit and a system information indication unit;

[0016] The bio-information display unit is connected to the bio-information acquisition module and is used to display the acquired bio-information.

[0017] The system information indicator unit is connected to the central processing module and serves as the front-end display of the central processing module for displaying the training content and statistical results. The system information indicator unit is also used to provide users with an interface for selecting the training content.

[0018] Preferably, the workflow of the user interaction module includes: displaying the received digital signal on the bio-information display unit, and the user selecting training content through the system information indication unit based on the bio-information.

[0019] Preferably, the workflow of the central control module includes: firstly, performing preliminary analysis on the received biological information to obtain analysis results; based on the analysis results, selecting training content and transmitting the selected training content to the user interaction module for user selection; guiding and playing the training content selected by the user and collecting and processing the biological information emitted by the user during training in real time; adjusting the training content based on the biological information; and finally obtaining statistical results.

[0020] Preferably, the scene interaction module includes: an input device and an interaction unit;

[0021] Used to interact with the scene interaction module using the input device;

[0022] The interactive unit is used to construct different scenarios based on the training content and user needs.

[0023] Preferably, the workflow of the scene interaction module includes: when the training content requires the user to interact with the scene, the user interacts through the input device; at the same time, the interaction unit is used to construct different scenes according to different training content.

[0024] Compared with the prior art, the beneficial effects of this application are as follows:

[0025] This application, in addition to supporting traditional VR devices for scene construction, can also create 3D surround scenes using projection devices, avoiding the 3D motion sickness associated with VR devices. Simultaneously, it collects and analyzes the bio-information emitted by users in real time during training to adjust the course content. This truly achieves "training on demand" and maximizes training effectiveness. The course content, besides mindfulness, meditation, and brain training, can also include various courses on social life and employment, such as fire escape, virtual shopping, simulated mobile applications, practical applications for shared bicycles, and mobile payment. Attached Figure Description

[0026] To more clearly illustrate the technical solutions of this application, the drawings used in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is a schematic diagram of the system structure of Embodiment 1 of this application;

[0028] Figure 2 This is a schematic diagram of the device operation in Embodiment 2 of this application.

[0029] Figure 3This is a schematic diagram of the head-mounted monitoring device according to Embodiment 2 of this application. Detailed Implementation

[0030] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0031] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, this application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0032] Example 1

[0033] like Figure 1 The diagram shown is a schematic representation of the system structure of Embodiment 1 of this application, including: a scene construction module, a biological information acquisition module, a user interaction module, a central control module, and a scene interaction module. The scene construction module is connected to the central control module and is used to construct a naked-eye 3D environment; the biological information acquisition module is connected to the user interaction module and is used to collect the user's biological information; the user interaction module is connected to the central control module and is used to display the biological information and control commands from the central control module; the user interaction module also provides interactive options for the user; the central control module is connected to the biological information acquisition module and is used to receive biological information and perform preliminary analysis to obtain analysis results; based on the analysis results, it selects training content and guides and plays the training content; the central control module also collects and processes the biological information emitted by the user during training in real time, adjusts the training content based on the biological information, and finally obtains statistical results; the scene interaction module is connected to the central control module and is used to construct different scenes based on the training content; the scene interaction module also provides scene interaction functions for the user.

[0034] In addition, the scene construction module includes a visual environment construction unit and a sound environment construction unit; the visual environment construction unit is used to construct a naked-eye 3D visual environment; the sound environment construction unit is used to construct a stereo sound reverberation environment. The workflow of the bio-information acquisition module includes: collecting electrical signals of bio-information emitted by the user; converting the electrical signals into digital signals and transmitting the digital signals to the user interaction module. The user interaction unit includes a bio-information display unit and a system information indicator unit; the bio-information display unit is connected to the bio-information acquisition module and is used to display the acquired bio-information; the system information indicator unit is connected to the central processing module and serves as the front-end display for the central processing module, used for training content and statistical results; the system information indicator unit also provides users with an interface for selecting training content. The workflow of the user interaction module includes: displaying the received digital signals on the bio-information display unit, and the user selecting training content based on the bio-information through the system information indicator unit.

[0035] The workflow of the central control module includes: firstly, the received biological information is preliminarily analyzed to obtain analysis results; based on the analysis results, training content is selected and transmitted to the user interaction module for user selection; the user-selected training content is guided and played, and the biological information emitted by the user during training is collected and processed in real time; the training content is adjusted based on the biological information, and finally, statistical results are obtained.

[0036] The scene interaction module includes an input device and an interaction unit. The input device is used to interact with the scene interaction module. The interaction unit is used to construct different scenes based on training content and user needs. The workflow of the scene interaction module includes: when the training content requires user interaction with the scene, the user interacts through the input device; simultaneously, the interaction unit is used to construct different scenes based on different training content.

[0037] Example 2

[0038] The workflow of this application will be described in detail below with reference to Embodiment 2. Figure 2 As shown.

[0039] First, the user's biological information is collected using a biometric acquisition module. In this second embodiment, a head-mounted monitoring device is used, such as... Figure 3 As shown. It should be emphasized that this second embodiment uses a head-mounted device and the biological information collected is brainwaves; however, different biological information collected using other devices with the same function, such as heart rate and respiratory rate, should also fall within the protection scope of this application.

[0040] In the head-mounted monitoring device used in this second embodiment, there are three electrode points that collect the user's electrical signals by contacting the microcurrent in the user's forehead. The collected electrical signals are converted into digital signals by an internally integrated chip and then transmitted to the user interaction module and the central processing module.

[0041] After receiving the digital signals transmitted from the monitoring device, the central processing module performs a preliminary analysis of the user's biometric information and recommends training content based on the analysis results. The training content includes both course mode and game mode content. Subsequently, the central processing module displays the processing results and the course content selection interface through the system information display unit.

[0042] Users select training content through the user interaction module. In this second embodiment, the user interaction module also has the function of storing user information. In this embodiment, the user interaction module adopts a tablet computer and a touch screen all-in-one machine. Its functions include: users can log in to their own accounts to obtain course progress information to determine their training progress. After the training content is determined, the scene interaction module controls the scene construction module to construct a 3D immersive scene according to the training content.

[0043] The scene construction module includes a visual environment construction unit and a sound environment construction unit. In this second embodiment, the visual construction unit uses several projectors arranged around the room; simultaneously, stereo surround sound is used in conjunction with the projected scene to create a naked-eye 3D effect. Furthermore, in this second embodiment, the stereo surround sound is also used to play course content. It should be noted that this second embodiment uses projectors as the visual construction unit, while other devices with the same function, such as naked-eye 3D immersive CAVE projectors, LED screens, LCD screens, and other devices that can achieve the same effect, should also fall within the protection scope of this application.

[0044] After the training officially begins, the monitoring device starts monitoring the user's brainwave information in real time and transmits it to the central control module. The central control module analyzes and processes the bio-information to guide the overall playback progress of the training content and simultaneously modify the training strategy. Its logic includes: adjusting the playback speed of the course when the collected brainwave signals reach a certain threshold. The user is kept in a relaxed state at all times, which can be determined by the frequency of the collected brainwave signal fluctuations. In this second embodiment, the central control module is a desktop computer equipped with processing software; in addition to a desktop computer, it can also be other terminal devices.

[0045] Furthermore, the training content mentioned in this second embodiment also includes game mode content, which requires the user to interact with the scene. Users complete these activities through input devices, including tablets, VR controllers, motion-sensing cameras, depth-sensing cameras, and Xbox motion controllers. After the user completes the input, the scene interaction module changes the scene based on the user's input information to complete the game mode content.

[0046] The embodiments described above are merely preferred embodiments of this application and are not intended to limit the scope of this application. Any modifications and improvements made to the technical solutions of this application by those skilled in the art without departing from the spirit of this application shall fall within the protection scope defined by the claims of this application.

Claims

1. A course training system in a naked-eye 3D immersive environment, characterized in that, include: The system includes a scene construction module, a bio-information acquisition module, a user interaction module, a central control module, and a scene interaction module. The scene construction module is connected to the central control module and is used to construct a naked-eye 3D environment; the scene construction module includes: a visual environment construction unit and a sound environment construction unit; The visual environment construction unit is used to construct a naked-eye 3D visual environment; The sound environment construction unit is used to construct a stereo sound reverberation environment; The bio-information acquisition module is connected to the user interaction module and is used to acquire the user's bio-information. The workflow of the bio-information acquisition module includes: collecting the electrical signals of the bio-information emitted by the user; converting the electrical signals into digital signals and transmitting the digital signals to the user interaction module. The user interaction module is connected to the central control module and is used to display the biological information and the control commands of the central control module; the user interaction module is also used to provide interactive options for the user; The central control module is connected to the bio-information acquisition module and is used to receive the bio-information and perform preliminary analysis to obtain analysis results; based on the analysis results, it selects training content and guides and plays the training content; the central control module is also used to collect and process the bio-information emitted by the user during training in real time, adjust the training content based on the bio-information, and finally obtain statistical results; the workflow of the central control module includes: firstly, performing preliminary analysis on the received bio-information to obtain analysis results; based on the analysis results, selecting training content and transmitting the selected training content to the user interaction module for the user to choose; guiding and playing the training content selected by the user and collecting and processing the bio-information emitted by the user during training in real time, adjusting the training content based on the bio-information, and finally obtaining statistical results; The scene interaction module is connected to the central control module and is used to construct different scenes according to the training content. The scene interaction module is also used to provide scene interaction functions for users. The workflow of the scene interaction module includes: when the training content requires the user to interact with the scene, the user interacts through an input device; at the same time, the interaction unit is used to construct different scenes according to different training content. After the training officially begins, the monitoring device starts to monitor the brainwave information emitted by the user in real time and transmits it to the central control module. The central control module analyzes and processes the biological information to guide the playback progress of the overall training content and modify the training strategy in a synchronous manner. Its logical process includes: when the collected brainwave signals reach a certain threshold, the playback speed of the course is adjusted.

2. The course training system in a naked-eye 3D immersive environment according to claim 1, characterized in that, The user interaction unit includes: a bioinformatics display unit and a system information indication unit; The bio-information display unit is connected to the bio-information acquisition module and is used to display the acquired bio-information. The system information indicator unit is connected to the central control module and serves as the front-end display of the central control module for displaying the training content and statistical results. The system information indicator unit is also used to provide users with an interface for selecting the training content.

3. The course training system in a naked-eye 3D immersive environment according to claim 2, characterized in that, The workflow of the user interaction module includes: displaying the received digital signal on the bio-information display unit, and the user selecting training content through the system information indication unit based on the bio-information.

4. The course training system in a naked-eye 3D immersive environment according to claim 1, characterized in that, The scene interaction module includes: an input device and an interaction unit; Used to interact with the scene interaction module using the input device; The interactive unit is used to construct different scenarios based on the training content and user needs.

Images