A coal mine scenario-based training system based on VR

Abstract

The present application relates to a kind of coal mine situational training system based on VR, including naked eye 3D teaching system, VR practical training system, teacher central control system, background management system.Through the system of the present application, teacher central control system provides the demonstration control function about coal mine situational course for teacher and the management function to the virtual content shown in the VR practical training system of student, naked eye 3D teaching system provides naked eye 3D experience environment for teacher and student, creates immersive interactive teaching environment for teacher and student, student carries out practical exercise using VR practical training system, forms "teaching" and "learning" full immersive situational training, increases the interestingness of training, improves training effect.

Description

Technical Field

[0001] This invention relates to the field of virtual reality training technology, and more specifically, to a VR-based scenario-based training system for coal mines. Background Technology

[0002] Safety production education and training, as a crucial aspect of coal mine safety management, bears the important responsibility of strengthening professional skills training and enhancing safety awareness. Currently, most coal mining enterprises employ traditional "lecture-style" training, centered on the teacher. This often results in dry content, poor interactivity, low trainee participation, and ultimately, ineffective training. With the development of intelligent construction and digital transformation in coal mines, the application of new technologies provides necessary means to improve professional capabilities and safety production management. Utilizing VR technology for scenario-based training in coal mines can further enhance employees' interest in learning, help them master safety production knowledge, standardize work procedures, and improve safety awareness.

[0003] Inventing virtual content

[0004] The technical problem to be solved by the present invention is to provide a VR-based contextualized training system for coal mines, which aims to solve at least one of the above-mentioned technical problems.

[0005] In a first aspect, the technical solution of the present invention to solve the above-mentioned technical problems is as follows: a VR-based contextualized training system for coal mines, comprising:

[0006] The system includes a naked-eye 3D teaching system, a VR training system, a teacher control system, and a back-end management system. The naked-eye 3D teaching system and the VR training system communicate through the back-end management system and the teacher control system.

[0007] The teacher control system is used to provide teachers with demonstration control functions for coal mine scenario courses and management functions for virtual content displayed in the VR training system for students, so that the teacher can select the virtual content of the coal mine scenario course currently being taught for the students and send the virtual content of the coal mine scenario course to the naked-eye 3D teaching system and the VR training system.

[0008] The VR training system is used to display virtual content about coal mine scenario courses to trainees and to obtain the trainees' operational actions based on the practical scenarios in the virtual content for practical exercises.

[0009] The naked-eye 3D teaching system is used to display the virtual content of the coal mine scenario course, so that the teacher can interact with the naked-eye 3D teaching system to explain the virtual content. It is also used to acquire and display the practical operation screen of the students and the teaching screen of the teacher during the teaching process. The practical operation screen includes the operation action.

[0010] The back-end management system is used to manage coal mine scenario courses, teacher accounts, and student accounts.

[0011] The beneficial effects of this invention are as follows: the teacher control system provides teachers with demonstration control functions for coal mine scenario courses and management functions for virtual content displayed in the VR training system for students; the naked-eye 3D teaching system provides teachers and students with a naked-eye 3D experience environment, creating an immersive interactive teaching environment for teachers and students; students use the VR training system for practical exercises, forming a fully immersive scenario-based training of "teaching" and "learning", increasing the fun of training and improving training effectiveness.

[0012] Based on the above technical solution, the present invention can be further improved as follows.

[0013] Furthermore, the naked-eye 3D teaching system is also used to adjust the virtual content based on the student's hands-on practice screen and / or the teacher's teaching screen.

[0014] Furthermore, the naked-eye 3D teaching system includes a curved screen projection system and a motion capture system;

[0015] The motion capture system is used to acquire the practical operation footage of the student and the teaching footage of the teacher during the teaching process, and to adjust the virtual content based on the practical operation footage of the student and / or the teaching footage of the teacher.

[0016] The curved screen projection system is used to display the virtual content, practical operation scenes, teaching scenes, and adjusted virtual content of the coal mine scenario course.

[0017] Furthermore, the motion capture system is specifically used for:

[0018] The system tracks and acquires the student's first position and first posture during practical exercises, as well as the teacher's second position and second posture during the teaching process. The practical exercise screen includes the first position and first posture, and the teaching screen includes the second position and second posture.

[0019] The virtual content is adjusted based on the student's first change information and / or the teacher's second change information, wherein the first change information includes the first position and the first posture, and the second change information includes the second position and the second posture.

[0020] Furthermore, if the virtual content of the coal mine scenario course includes audio, the naked-eye 3D teaching system also includes an audio playback system, which is used to play the audio in the virtual content of the coal mine scenario course.

[0021] Furthermore, the teacher control system includes a course teaching control unit and a student virtual content control unit;

[0022] The course teaching control unit is used to provide teachers with demonstration control functions for coal mine scenario courses, and to send the virtual content of the coal mine scenario courses to the naked-eye 3D teaching system and the VR training system.

[0023] The virtual content management unit for students is used to manage the virtual content displayed in the VR training system for students, so that the teacher can select the virtual content of the coal mine scenario course currently being taught for the students.

[0024] Furthermore, the VR training system includes a VR wireless all-in-one headset;

[0025] The VR wireless all-in-one headset is used to display virtual content about coal mine scenario courses to students wearing the VR wireless all-in-one headset.

[0026] Furthermore, the VR training system also includes a control controller:

[0027] The control handle is used to acquire the operational actions of the trainee during practical exercises based on the real-world scenarios in the virtual content.

[0028] Furthermore, the coal mine scenario courses include VR training courses such as coal mine production operation process training courses, production equipment disassembly and assembly training courses, and underground emergency rescue training courses.

[0029] Furthermore, the system also includes an operation control panel, which is used to receive operation instructions from users for virtual objects in the coal mine scenario course, so as to perform the operation corresponding to the operation instructions on the virtual objects. The user is a student or a teacher.

[0030] Additional aspects and advantages of this application will be set forth in part in the description which follows, and will become apparent from the description or may be learned by practice of this application. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments of the present invention will be briefly introduced below.

[0032] Figure 1 This is a schematic diagram of the structure of a VR-based contextualized training system for coal mines, provided as an embodiment of the present invention. Detailed Implementation

[0033] The principles and features of the present invention are described below. The examples given are only for explaining the present invention and are not intended to limit the scope of the present invention.

[0034] The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of the present invention will now be described with reference to the accompanying drawings.

[0035] The solution provided in this invention can be applied to any application scenario requiring VR training. This invention provides a possible implementation, such as... Figure 1 As shown, a VR-based scenario-based training system for coal mines is provided, including a naked-eye 3D teaching system, a VR training system, a teacher control system, and a back-end management system. The naked-eye 3D teaching system and the VR training system communicate through the back-end management system and the teacher control system.

[0036] The teacher control system is used to provide teachers with demonstration control functions for coal mine scenario courses and management functions for virtual content displayed in the VR training system for students, so that the teacher can select the virtual content of the coal mine scenario course currently being taught for the students and send the virtual content of the coal mine scenario course to the naked-eye 3D teaching system and the VR training system.

[0037] The VR training system is used to display virtual content about coal mine scenario courses to trainees and to obtain the trainees' operational actions based on the practical scenarios in the virtual content for practical exercises.

[0038] The naked-eye 3D teaching system is used to display the virtual content of the coal mine scenario course, so that the teacher can interact with the naked-eye 3D teaching system to explain the virtual content. It is also used to acquire and display the practical operation screen of the students and the teaching screen of the teacher during the teaching process. The practical operation screen includes the operation action.

[0039] The back-end management system is used to manage coal mine scenario courses, teacher accounts, and student accounts.

[0040] Based on this solution, teachers can select the desired coal mine scenario course for training, display it through a naked-eye 3D teaching system, and present it to all trainees through a VR training system. Trainees can view the virtual content of the coal mine scenario course through the VR training system, allowing them to immerse themselves in the coal mine scenario. Teachers can first interact with the naked-eye 3D teaching system to explain the virtual content. At this point, teachers can use the naked-eye 3D teaching system to provide unified explanations and guidance to all trainees. All trainees learn the training course projected by the teacher together, understand the basic concepts and processes of the training content, and establish an overall understanding. Then, trainees conduct practical exercises based on the virtual content. The naked-eye 3D teaching system acquires and displays the practical exercise footage. Teachers interact with the naked-eye 3D teaching system through the practical exercise footage to generate and display teaching screens. These teaching screens guide trainees (projecting typical problems onto a curved screen for unified guidance; providing more effective guidance and feedback based on common and individual problems encountered by trainees), thus achieving the training objectives.

[0041] Optionally, the above systems can be connected via a local area network (LAN) to enable network communication.

[0042] Optionally, the aforementioned teacher control system and back-end management system can be deployed on tablet devices for easy operation by teachers, while the VR training system can be deployed in VR all-in-one machines for easy use by students.

[0043] Optionally, different coal mine scenario courses can be offered for different training programs, including but not limited to VR training courses on coal mine production operation processes, production equipment disassembly and assembly, and underground emergency rescue. The virtual content will vary depending on the training course.

[0044] Optionally, the back-end management system is used to manage different coal mine scenario courses, different teacher accounts, and different student accounts. Only teachers or students who have passed account verification can use the training system involved in this solution to ensure system security.

[0045] For each coal mine scenario course, the virtual content involved in the course includes virtual objects. These virtual objects are objects related to the coal mine scenario. They can be physical equipment, such as high and low voltage switchgear, scraper centrifuges, and switch cabinets, or they can be virtual objects, such as coal mine workers.

[0046] Furthermore, the practical exercises for trainees can include operations on virtual objects, such as the operations involved in the standard operating procedures for power outage and restoration of high and low voltage switchgear, the power outage and restoration operations of switchgear; the disassembly and assembly operations of scraper centrifuges, and the manual disassembly and assembly operations of various components of scraper centrifuges, etc.

[0047] Optionally, the naked-eye 3D teaching system is also used to adjust the virtual content based on the student's hands-on practice screen and / or the teacher's teaching screen.

[0048] Optionally, the naked-eye 3D teaching system includes a curved screen projection system and a motion capture system;

[0049] The motion capture system is used to acquire the practical operation footage of the student and the teaching footage of the teacher during the teaching process, and to adjust the virtual content based on the practical operation footage of the student and / or the teaching footage of the teacher.

[0050] The curved screen projection system is used to display the virtual content, practical operation scenes, teaching scenes, and adjusted virtual content of the coal mine scenario course.

[0051] Optionally, the aforementioned curved screen projection system can be an LED curved screen projection system, which may include a curved projection screen. Virtual content can be displayed on the curved projection screen at an image resolution greater than a set value. Through high-resolution image projection, users can experience a three-dimensional effect, as if they were in a real-world scene. This immersive visual experience allows trainees to better understand and experience the training content.

[0052] Optionally, the motion capture system is specifically used for:

[0053] The system tracks and acquires the student's first position and first posture during practical exercises, as well as the teacher's second position and second posture during the teaching process. The practical exercise screen includes the first position and first posture, and the teaching screen includes the second position and second posture.

[0054] The virtual content is adjusted based on the student's first change information and / or the teacher's second change information, wherein the first change information includes the first position and the first posture, and the second change information includes the second position and the second posture.

[0055] Optionally, the motion capture system described above may include multiple infrared optical positioning interactive cameras (also referred to as infrared cameras) and a set of wireless optical control handles. Teachers use the wireless handles to operate the system and capture their teaching actions. The infrared cameras are deployed around the curved projection screen to dynamically capture the teacher's second change information and the student's first change information, completing the interactive operation. In other words, the motion capture system can dynamically acquire teaching and practical operation images through the infrared cameras, and all images and operations are based on virtual content.

[0056] Specifically, for teachers, the direction and distance of their movement can be calculated based on the second change information, and the direction and distance of the three-dimensional scene in the virtual content can be adjusted accordingly to achieve the purpose of dynamically adjusting the projected image.

[0057] Similarly, for trainees, the direction and distance of their movement can be calculated based on the initial change information, and the direction and distance of the 3D scene in the virtual content can be adjusted accordingly to dynamically adjust the projected image. This enhances the comprehensiveness and realism of the training.

[0058] Optionally, if the virtual content of the coal mine scenario course includes audio, the naked-eye 3D teaching system further includes an audio playback system (which may also be called a sound system) for playing the audio in the virtual content of the coal mine scenario course.

[0059] Optionally, the teacher control system includes a course teaching control unit and a student virtual content control unit;

[0060] The course teaching control unit is used to provide teachers with demonstration control functions for coal mine scenario courses, including control of display parameters such as display mode, demonstration speed, number of demonstrations, and display screen size of coal mine scenario courses, and to send the virtual content of the coal mine scenario course to the naked-eye 3D teaching system and the VR training system.

[0061] The virtual content management unit for students is used to manage the virtual content displayed in the VR training system for students, so that the teacher can select the virtual content of the coal mine scenario course currently being taught for the students.

[0062] Optionally, the VR training system includes a VR wireless all-in-one headset;

[0063] The VR wireless all-in-one headset is used to display virtual content about coal mine scenario courses to students wearing the VR wireless all-in-one headset.

[0064] Optionally, the VR training system also includes a control controller:

[0065] The control handle is used to acquire the operational actions of the trainee during practical exercises based on the real-world scenarios in the virtual content.

[0066] Optionally, the system further includes an operation control panel, which is used to receive operation instructions from a user for virtual objects in the coal mine scenario course, so as to perform the operation corresponding to the operation instructions on the virtual objects. The user is a student or a teacher.

[0067] Virtual content can include virtual objects, allowing users to interact with them, operate control panels, and conduct simulated training. This interactivity enables users to actively participate in the training process, deepening their understanding and mastery of knowledge and skills.

[0068] The control panel and virtual objects are both located within the 3D scene corresponding to the virtual content. For example, in an emergency drill for a fire in a coal mine, if an injured person is encountered, a control panel will pop up to allow the user to choose whether to provide medical assistance.

[0069] This training system adheres to national requirements regarding coal mine safety training outlines and assessment standards. It simulates various complex underground working environments for miners to undergo pre-job operational and safety training. Leveraging visualization advantages reduces training costs and shortens teaching time.

[0070] The training system provided by this solution eliminates the need for actual hands-on training in coal mines. By developing 3D scenarios that simulate the real underground working environment of coal mines, trainees can immerse themselves in various real coal mine scenarios through VR devices.

[0071] The main training scenarios may include:

[0072] 1. Work Process Training: Covering all production stages, including pre-operation checks, startup, and shutdown, for each job type. The work processes for each job type are systematically demonstrated through animation.

[0073] 2. Equipment working principle and disassembly / assembly: Master the working principle of the main equipment and the skills of disassembly and assembly;

[0074] 3. Risk Management and Emergency Rescue: Immersive simulation of disaster (fire, gas outburst, water inrush, etc.) scene and self-rescue and mutual rescue, and comprehensive mastery of emergency skills.

[0075] In addition, the VR training system and naked-eye 3D teaching system involved in this solution can run all course content and use the same interaction logic.

[0076] Compared with existing technologies, this solution has the following advantages:

[0077] Combining naked-eye 3D training with VR training can provide students with a more comprehensive and personalized training experience. Teachers can provide unified instruction and monitor students' learning progress, while students can engage in in-depth learning and practical exercises in their own virtual environment.

[0078] The above description is merely a preferred embodiment of the present invention and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of disclosure in this invention is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this invention.

Claims

1. A VR-based scenario-based training system for coal mines, characterized in that, It includes a naked-eye 3D teaching system, a VR training system, a teacher control system, and a back-end management system. The naked-eye 3D teaching system and the VR training system communicate through the back-end management system and the teacher control system. The teacher control system is used to provide teachers with demonstration control functions for coal mine scenario courses and management functions for virtual content displayed in the VR training system for students, so that the teacher can select the virtual content of the coal mine scenario course currently being taught for the students and send the virtual content of the coal mine scenario course to the naked-eye 3D teaching system and the VR training system. The VR training system is used to display virtual content about coal mine scenario courses to trainees and to obtain the trainees' operational actions based on the practical scenarios in the virtual content for practical exercises. The naked-eye 3D teaching system is used to display the virtual content of the coal mine scenario course, so that the teacher can interact with the naked-eye 3D teaching system to explain the virtual content. It is also used to acquire and display the practical operation screen of the students and the teaching screen of the teacher during the teaching process. The practical operation screen includes the operation action. The back-end management system is used to manage coal mine scenario courses, teacher accounts, and student accounts; The naked-eye 3D teaching system includes a curved screen projection system and a motion capture system; The motion capture system is used to track and acquire in real time the first position and first posture of the student during practical exercises, and the second position and second posture of the teacher during the teaching process. The practical exercise screen includes the first position and the first posture, and the teaching screen includes the second position and the second posture. Based on the first change information of the student and / or the second change information of the teacher, the virtual content is adjusted. The first change information includes the first position and the first posture, and the second change information includes the second position and the second posture. The curved screen projection system is used to display the virtual content, practical operation scenes, teaching scenes, and adjusted virtual content of the coal mine scenario course; The motion capture system includes multiple infrared cameras and a set of wireless optical control handles. Teachers use the wireless handles to operate the system to capture their teaching actions. The infrared cameras are deployed around the curved projection screen to dynamically capture the second change information of the teacher and the first change information of the students. For teachers, the direction and distance of their movement are calculated based on the second change information, and the direction and distance of the three-dimensional scene in the virtual content are adjusted accordingly to achieve the purpose of dynamically adjusting the projected image; For trainees, the direction and distance of their movement are calculated based on the first change information, and the direction and distance of the three-dimensional scene in the virtual content are adjusted accordingly to achieve the purpose of dynamically adjusting the projected image.

2. The system according to claim 1, characterized in that, If the virtual content of the coal mine scenario course includes audio, the naked-eye 3D teaching system also includes an audio playback system, which is used to play the audio in the virtual content of the coal mine scenario course.

3. The system according to claim 1 or 2, characterized in that, The teacher control system includes a course teaching control unit and a student virtual content control unit; The course teaching control unit is used to provide teachers with demonstration control functions for coal mine scenario courses, and to send the virtual content of the coal mine scenario courses to the naked-eye 3D teaching system and the VR training system. The virtual content management unit for students is used to manage the virtual content displayed in the VR training system for students, so that the teacher can select the virtual content of the coal mine scenario course currently being taught for the students.

4. The system according to claim 1 or 2, characterized in that, The VR training system includes a VR wireless all-in-one headset; The VR wireless all-in-one headset is used to display virtual content about coal mine scenario courses to students wearing the VR wireless all-in-one headset.

5. The system according to claim 4, characterized in that, The VR training system also includes a control controller: The control handle is used to acquire the operational actions of the trainee during practical exercises based on the real-world scenarios in the virtual content.

6. The system according to claim 1 or 2, characterized in that, The coal mine scenario courses include VR training courses on coal mine production operation processes, production equipment disassembly and assembly, and underground emergency rescue.

7. The system according to claim 1 or 2, characterized in that, The system also includes an operation control panel, which is used to receive operation instructions from users for virtual objects in the coal mine scenario course, so as to perform the operation corresponding to the operation instructions on the virtual objects. The user is a student or a teacher.

Images