Immersive panoramic teaching training system and method
Through the immersive panoramic teaching and training system, combining multimedia and human-computer interaction equipment, the actual work scenarios are simulated, and the problem of the lack of interaction and immersion of the existing multimedia teaching and training system is solved, the teaching quality and efficiency are improved, and the practical combat of students is enhanced. ability.
Patent Information
- Application Number
- CN202411088024.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-08
- Publication Date
- 2024-12-06
AI Technical Summary
The existing multimedia teaching and training system lacks interactivity and immersion, resulting in poor quality and low efficiency of teaching and training, which cannot effectively stimulate students' interest and enthusiasm in learning, and the content organization is incoherent, so it is impossible to effectively combine technology with actual work content.
Provide an immersive panoramic teaching and training system, combining multimedia display equipment, human-computer interaction equipment and main control equipment, and realizes the situational teaching control command, virtual training control command, training playback control command, interface display control command and interactive control command. Real-time interaction between users and virtual teaching environments, simulate actual work scenarios, and enhance students' practical combat capabilities.
It improves the quality and efficiency of teaching training, enhances students' interest and participation in learning, enables students to better master technical concepts and apply them to actual work, and realizes systematic and coherent presentation of teaching content.
Smart Images

Figure CN119091709A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of teaching and training, and in particular to an immersive panoramic teaching and training system and method. Background Art
[0002] With the advancement of science and technology, multimedia technology and human-computer interaction technology are being used more and more widely in the field of teaching and training. Multimedia teaching and training has become an important part of modern teaching and training.
[0003] However, although the traditional multimedia teaching and training system can provide rich visual information, it lacks sufficient interactivity and immersion, making the teaching and training effect unsatisfactory and unable to fully stimulate students' interest and enthusiasm in learning.
[0004] Specifically, the multimedia equipment on the market focuses too much on technical training in terms of training content design, such as hardware operation and the use of software and information systems, while ignoring the importance of combining technology with actual work content such as case handling and investigation. This "technology-based, concept-assisted" training method may result in trainees mastering the technology but being unable to flexibly apply it in actual work, thus failing to achieve the ultimate purpose of training.
[0005] In addition, existing multimedia devices have not formed a systematic, coherent and comprehensive framework for the organization and presentation of teaching content. For example, teachers may not have a comprehensive grasp of the teaching content and fail to effectively integrate multimedia resources such as pictures and videos, resulting in the teaching content appearing messy and unable to effectively attract and maintain the attention of students.
[0006] In summary, the existing technology has the problems of poor teaching and training quality and low efficiency due to the limitations of multimedia equipment. Summary of the invention
[0007] The present invention provides an immersive panoramic teaching and training system and method, which are used to solve the defects of poor teaching and training quality and low efficiency caused by the limitation of multimedia equipment in the prior art, and realize immersive panoramic teaching and training with good quality and high efficiency.
[0008] The present invention provides an immersive panoramic teaching and training system, including a multimedia display device, a human-computer interaction device and a main control device;
[0009] The main control device is used to generate a control instruction according to an operation; the operation includes one of a user's input to the human-computer interaction device, a user's operation on the multimedia display device, and an action of the multimedia display device;
[0010] The multimedia display device is used to display at least one of an interface, a virtual scene and a video according to the control instructions; the control instructions include scenario teaching control instructions, virtual training control instructions, training playback control instructions, interface display control instructions and interactive control instructions;
[0011] The situational teaching control instructions are used to control the multimedia display device to display teaching videos so as to provide virtual technology teaching to users; the virtual training control instructions are used to control the multimedia display device to display situational teaching virtual scenes or situational assessment virtual scenes so as to provide immersive practical teaching or assessment to users; the training playback control instructions are used to control the multimedia display device to play back training history videos saved by users; the interface display control instructions are used to control the multimedia display device to display the interface; and the interactive control instructions are used to interact with the display of the multimedia display device.
[0012] According to an immersive panoramic teaching and training system provided by the present invention, the multimedia display device is a touch screen;
[0013] Correspondingly, the interface includes a display panel selection interface, a teaching video selection interface, a scenario training interface, a teaching video control interface, a training interface, a scenario teaching control interface, a scenario assessment control interface, a training result details interface, a training playback interface, and a training playback video control interface;
[0014] Wherein, the section selection interface includes a scenario teaching button and a scenario training button, the scenario teaching button is associated with the interface display control instruction of the teaching video selection interface, and the scenario training button is associated with the interface display control instruction of the scenario training interface;
[0015] The teaching video selection interface includes a plurality of teaching video buttons, and the teaching video buttons are associated with interface display control instructions of the teaching video control interface corresponding to the teaching video;
[0016] The scenario training interface includes a training button and a training playback button; the training button is associated with an interface display control instruction of the training interface, and the training playback button is associated with an interface display control instruction of the training playback interface;
[0017] The training interface includes a trainer selection button, a training course selection button, a start assessment button and a start teaching button; the start teaching button is associated with an interface display control instruction of the scenario teaching control interface, and the start assessment button is associated with an interface display control instruction of the scenario assessment control interface;
[0018] The training playback interface includes a training history selection button and a start playback button; the start playback button is associated with an interface display control instruction of the training playback video control interface;
[0019] The training result details interface includes at least one of a save button and a cancel / close button; the cancel / close button is associated with an interface display control instruction of the scenario training interface;
[0020] The teaching video control interface, the scenario teaching control interface, the scenario assessment control interface and the training playback video control interface all include interactive control buttons, and the interactive control buttons are associated with the interactive control instructions.
[0021] According to an immersive panoramic teaching training system provided by the present invention, the scenario teaching control instruction is generated in response to the user clicking the teaching video button on the teaching video selection interface;
[0022] The virtual training control instruction is generated in response to the user clicking the trainer selection button and the training course selection button on the training interface to select a trainer and a course, and then continuing to click the start assessment button or the start teaching button;
[0023] The training playback control instruction is generated in response to the user clicking the training history selection button on the training playback interface to select a training history and then continuing to click the start playback button.
[0024] According to an immersive panoramic teaching and training system provided by the present invention, the multimedia display device is a tri-fold screen, and the tri-fold screen includes a first display screen, a second display screen and a third display screen;
[0025] The first display screen is used to display the teaching video according to the scenario teaching control instruction; the second display screen is used to display the scenario teaching virtual scene or the scenario assessment virtual scene according to the virtual training control instruction, and to display the interface according to the interface display control instruction; the third display screen is used to display the training history video according to the training playback control instruction;
[0026] The interface includes a training result details interface, and the training result details interface includes at least one of a save button and a cancel / close button.
[0027] According to an immersive panoramic teaching and training system provided by the present invention, the scenario teaching control instructions, the virtual training control instructions, the training playback control instructions and the interactive control instructions are acquired according to the human-computer interaction device.
[0028] According to an immersive panoramic teaching and training system provided by the present invention, the human-computer interaction device includes a speech recognition device and a Bluetooth device.
[0029] According to an immersive panoramic teaching and training system provided by the present invention, the interface display control instruction of the training performance details interface is generated in response to the multimedia display device displaying that the scenario teaching is completed or that the scenario evaluation is completed.
[0030] The present invention also provides an immersive panoramic teaching training method, comprising the following steps:
[0031] Acquire an operation, and generate a control instruction according to the operation; the operation includes one of a user input to a human-computer interaction device, a user operation on a multimedia display device, and an action of the multimedia display device;
[0032] Controlling at least one of a display interface, a virtual scene and a video of the multimedia display device according to the control instruction;
[0033] The control instructions include scenario teaching control instructions, virtual training control instructions, training playback control instructions, interface display control instructions and interactive control instructions;
[0034] The situational teaching control instructions are used to control the multimedia display device to display teaching videos so as to provide virtual technology teaching to users; the virtual training control instructions are used to control the multimedia display device to display situational teaching virtual scenes or situational assessment virtual scenes so as to provide immersive practical teaching or assessment to users; the training playback control instructions are used to control the multimedia display device to play back training history videos saved by users; the interface display control instructions are used to control the multimedia display interface; and the interactive control instructions are used to interact with the display of the multimedia display device.
[0035] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the immersive panoramic teaching and training method as described above when executing the program.
[0036] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the immersive panoramic teaching and training method as described above is implemented.
[0037] The present invention also provides a computer program product, including a computer program, which implements the immersive panoramic teaching and training method as described above when executed by a processor.
[0038] The immersive panoramic teaching and training system and method provided by the present invention include a multimedia display device, a human-computer interaction device and a main control device; the main control device is used to generate a control instruction according to an operation; the operation includes one of the user's input to the human-computer interaction device, the user's operation on the multimedia display device and the action of the multimedia display device; the multimedia display device is used to display at least one of an interface, a virtual scene and a video according to the control instruction; the control instruction includes a scenario teaching control instruction, a virtual training control instruction, a training playback control instruction, an interface display control instruction and an interaction control instruction; the scenario teaching control instruction is used to control the multimedia display device to display a teaching video to conduct virtual technology teaching to the user; the virtual training control instruction is used to control the multimedia display device to display a scenario teaching virtual scene or a scenario assessment virtual scene to conduct immersive actual combat teaching or assessment to the user; the training playback control instruction is used to control the multimedia display device to play back the training history video saved by the user; the interface display control instruction is used to control the multimedia display device to display an interface; and the interaction control instruction is used to interact with the display of the multimedia display device.
[0039] The present invention realizes real-time interactive training between users and virtual teaching environments through multimedia display devices, human-computer interaction devices and main control devices. It can not only train students to master technical concepts through teaching videos, but also conduct actual combat simulations with situational teaching virtual scenes and situational assessment virtual scenes, so that students can have a corresponding degree of mastery of actual combat, thereby realizing immersive panoramic teaching and training with good quality and high efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0041] Figure 1 It is a structural schematic diagram of the immersive panoramic teaching and training method provided by the present invention;
[0042] Figure 2 It is one of the flow charts of the immersive panoramic teaching and training method provided by the present invention;
[0043] Figure 3 This is the second flow chart of the immersive panoramic teaching and training method provided by the present invention;
[0044] Figure 4 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION
[0045] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0046] Combine the following Figure 1-Figure 3 Describe the immersive panoramic teaching training system and method of the present invention, such as Figure 1 As shown, the system includes a multimedia display device 110 , a human-computer interaction device 120 and a main control device 130 .
[0047] The main control device 130 is used to generate a control instruction according to an operation; the operation includes one of a user's input to the human-computer interaction device 120 , a user's operation on the multimedia display device 130 , and an action of the multimedia display device 110 .
[0048] The multimedia display device 110 is used to display at least one of an interface, a virtual scene and a video according to the control instructions; the control instructions include situational teaching control instructions, virtual training control instructions, training playback control instructions, interface display control instructions and interactive control instructions.
[0049] In order to provide a new and immersive teaching method, the present invention integrates existing multimedia equipment and combines multimedia teaching technology with interactive equipment. The immersive panoramic teaching training system provided by the present invention has broad application prospects for improving students' learning effect and participation.
[0050] It should be noted that the interface, virtual scene and video used for display all include the hot content customized and developed by the present invention on the basis of the constructed virtual simulation scene, with the purpose of focusing on the legalization and standardization of the execution process in actual work. It should be emphasized that the hot content mentioned in the present invention is jointly discussed and developed with relevant authoritative units, including standard scenario handling teaching content and hot scenario handling training content, which is a special content more suitable for student teaching and training.
[0051] Based on the above embodiments, the videos mentioned in the present invention include teaching videos and training history videos, the virtual scenes include situational teaching virtual scenes and situational assessment virtual scenes, and the interface at least includes a training performance details interface.
[0052] Among them, the teaching video includes the standardized knowledge points of various scenario handling processes for users, the knowledge points of various emergency handling measures during user inspection work, the knowledge points of common scenario handling methods and techniques for users, and the standardized use of equipment and related handling tools by users during scenario handling, and teaches users on the above content.
[0053] The content of the scenario teaching virtual scene and the scenario assessment virtual scene is the same, but the usage is different; the specific content includes: using the fine model created by 3D modeling software and importing appropriate materials and maps, building scenes that meet the relevant disposal plots in Unity and simulating the lighting, reflection and texture effects of the real world to create an immersive virtual scene. According to the above design scenes, simulate several common disposal scenarios and various situations in the disposal process. Through virtual reality technology, let users familiarize themselves with and master the law enforcement process and skills before actual operation, and conduct immersive practical teaching and assessment for users.
[0054] In addition, it should be noted that the training history video is a historical video saved by the user of the scenario assessment based on the scenario assessment virtual scene. The training result details interface is used to display the user's scenario teaching or scenario assessment results in the scenario teaching virtual scene or scenario assessment virtual scene.
[0055] The embodiments of the present invention combine technology with actual work contents such as case handling and detection, so as to solve the problem of poor teaching and training quality caused by the existing teaching and training system's training method of "technology-based and concept-assisted".
[0056] Furthermore, the situational teaching control instructions are used to control the multimedia display device to display teaching videos so as to provide virtual technology teaching to users; the virtual training control instructions are used to control the multimedia display device to display situational teaching virtual scenes or situational assessment virtual scenes so as to provide immersive practical teaching or assessment to users; the training playback control instructions are used to control the multimedia display device to play back training history videos saved by users; the interface display control instructions are used to control the multimedia display device to display the interface; and the interaction control instructions are used to interact with the display of the multimedia display device.
[0057] It should be noted that the generation method of the scenario teaching control instruction, the virtual training control instruction, and the training playback control instruction is related to the type of the multimedia display device 110, including one of the user's input to the human-computer interaction device 120, the user's operation on the multimedia display device 130, and the action of the multimedia display device 110. The generation method of the interactive control instruction is related to the type of the multimedia display device 110, including one of the user's input to the human-computer interaction device 120, and the user's operation on the multimedia display device 130. The interface display control instruction is generated according to the user's operation on the multimedia display device 130 or the action of the multimedia display device 110.
[0058] The present invention can respond to user instructions in real time and can achieve in-depth interaction between the user and the displayed content, thereby improving the quality and efficiency of teaching and training, and improving the problem that the existing teaching and training system lacks sufficient interactivity and immersion.
[0059] In some embodiments, Figure 2 As shown, the interface display control instruction of the training performance details interface is generated in response to the multimedia display device 110 displaying that the scenario teaching is completed or that the scenario evaluation is completed.
[0060] The multimedia display device 110 includes two display modes: a touch screen and a tri-fold screen.
[0061] The following describes the touch screen display mode of the multimedia display device 110. In some embodiments, the multimedia display device 110 is a touch screen;
[0062] Correspondingly, the interface includes a display panel selection interface, a teaching video selection interface, a scenario training interface, a teaching video control interface, a training interface, a scenario teaching control interface, a scenario assessment control interface, a training result details interface, a training playback interface, and a training playback video control interface;
[0063] Wherein, the section selection interface includes a scenario teaching button and a scenario training button, the scenario teaching button is associated with the interface display control instruction of the teaching video selection interface, and the scenario training button is associated with the interface display control instruction of the scenario training interface;
[0064] The teaching video selection interface includes a plurality of teaching video buttons, and the teaching video buttons are associated with interface display control instructions of the teaching video control interface corresponding to the teaching video;
[0065] The scenario training interface includes a training button and a training playback button; the training button is associated with an interface display control instruction of the training interface, and the training playback button is associated with an interface display control instruction of the training playback interface;
[0066] The training interface includes a trainer selection button, a training course selection button, a start assessment button and a start teaching button; the start teaching button is associated with an interface display control instruction of the scenario teaching control interface, and the start assessment button is associated with an interface display control instruction of the scenario assessment control interface;
[0067] The training playback interface includes a training history selection button and a start playback button; the start playback button is associated with an interface display control instruction of the training playback video control interface;
[0068] The training result details interface includes at least one of a save button and a cancel / close button; the cancel / close button is associated with an interface display control instruction of the scenario training interface;
[0069] The teaching video control interface, the scenario teaching control interface, the scenario assessment control interface and the training playback video control interface all include interactive control buttons, and the interactive control buttons are associated with the interactive control instructions.
[0070] Specifically, Figure 2 As shown, the user can generate control instructions by touching the multimedia display device 110, thereby controlling the display content of the multimedia display device 110 and deeply interacting with the content displayed by the multimedia display device 110.
[0071] Specifically, in the touch screen display mode, the section selection interface is first displayed. There are two buttons on the section selection interface, namely, a scenario teaching button and a scenario training button. The scenario teaching button is associated with the interface display control instruction of the teaching video selection interface, and the scenario training button is associated with the interface display control instruction of the scenario training interface, which are used to select scenario teaching and scenario training, respectively. In other words, selecting the scenario teaching button will generate an interface display control instruction for entering the teaching video selection interface, which controls the multimedia display device 110 to display the teaching video selection interface. Correspondingly, selecting the scenario training button will generate an interface display control instruction for entering the scenario training interface, which controls the multimedia display device 110 to display the scenario training interface.
[0072] The teaching video selection interface includes a plurality of teaching video buttons, which are associated with the interface display control instructions of the teaching video control interface of the corresponding teaching video. In other words, selecting a teaching video button will generate an interface display control instruction for entering the corresponding teaching video control interface, which controls the multimedia display device 110 to display the teaching video control interface of each pre-stored teaching video.
[0073] For the teaching video control interface, it includes multiple interactive control buttons, which are associated with interactive control instructions. When the user clicks the interactive control button, the associated interactive control instruction is triggered, and the relevant interactions are performed according to the interactive instruction information (the relevant interactive functions include play, pause, fast forward, fast rewind, module jump and dragging progress bar, etc.) until the teaching video is finished playing.
[0074] It should be noted that after the teaching video is played, you can return to the home page and wait, or return to the teaching video selection interface, and the present invention does not limit this. It should be pointed out that in the touch screen display mode, the home page is a section selection interface.
[0075] For the scenario training interface, it includes a training button and a training playback button. The training button is associated with the interface display control instruction of the training interface, and the training playback button is associated with the interface display control instruction of the training playback interface. In other words, selecting the training button will generate an interface display control instruction for entering the training interface, which controls the multimedia display device 110 to display the training interface. Selecting the training playback button will generate an interface display control instruction for entering the training playback interface, which controls the multimedia display device 110 to display the training playback interface.
[0076] The training interface includes a trainer selection button, a training course selection button, a start assessment button, and a start teaching button. The trainer selection button is used to select different trainers, and the training course selection button is used to select different training courses. In other words, selecting the trainer selection button generates a control instruction that can control the multimedia display device 110 to display pre-stored trainers. Selecting the training course selection button generates a control instruction that can control the multimedia display device 110 to display pre-stored training courses.
[0077] In addition, the start teaching button is associated with the interface display control instruction of the scenario teaching control interface, and the start evaluation button is associated with the interface display control instruction of the scenario evaluation control interface. That is, clicking the start teaching button will generate an interface display control instruction for entering the scenario teaching control interface, which controls the multimedia display device 110 to display the scenario teaching control interface. Clicking the start evaluation button will generate an interface display control instruction for entering the scenario evaluation control interface, which controls the multimedia display device 110 to display the scenario evaluation control interface.
[0078] It should be pointed out that before clicking the Start Teaching button or the Start Assessment button, you need to first select the personnel and courses.
[0079] For the situational teaching control interface / situational assessment control interface, it includes multiple interactive control buttons, which are associated with interactive control instructions. When the user clicks the interactive control button, the associated interactive control instruction is triggered, and related interactions are performed according to the interactive instruction information (related interactive functions include pause, continue, designated plot jump, and voice semantic recognition interaction, etc.) until the situational teaching / situational assessment is completed.
[0080] When the scenario teaching is completed, the interface display control instruction of the training result details interface is triggered, which controls the multimedia display device 110 to display the training result details interface. At this time, the training result details interface may only include a close button. The close button is associated with the interface display control instruction of the scenario training interface.
[0081] When the scenario assessment is completed, the interface display control instruction of the training result details interface is triggered, and it controls the multimedia display device 110 to display the training result details interface. At this time, the training result details interface includes a save button and a cancel / close button, and the cancel / close button is associated with the interface display control instruction of the scenario training interface. In other words, clicking the cancel / close button will generate an interface display control instruction for entering the scenario training interface, and it controls the multimedia display device 110 to display the scenario training interface. Clicking the save button will save the playback video of the current training and upload the assessment data.
[0082] In some embodiments, in response to the saving being completed, an interface display control instruction for entering the scenario training interface is triggered, which controls the multimedia display device 110 to display the scenario training interface.
[0083] The training playback interface includes a training history selection button and a start playback button. The training history selection button is used to select the training history video you want to view. The start playback button is associated with the interface display control instruction of the training playback video control interface. That is, clicking the start playback button will generate an interface display control instruction for entering the training playback video control interface, which controls the multimedia display device 110 to display the training playback video control interface.
[0084] It should be noted that before clicking the Start Playback button, you need to first select the training history video you want to view.
[0085] For the training playback video control interface, it includes multiple interactive control buttons, which are associated with interactive control instructions. When the user clicks the interactive control button, the associated interactive control instruction is triggered, and the relevant interactions are performed according to the interactive instruction information (the relevant interactive functions include play, pause, fast forward, fast rewind and dragging progress bar, etc.) until the training history video (or training playback video) is played.
[0086] When the training history video (or training playback video) is finished playing, the interface display control instruction of the training playback interface is triggered, which controls the multimedia display device 110 to display the training playback interface.
[0087] In some embodiments, the scenario teaching control instruction is generated in response to the user clicking the teaching video button on the teaching video selection interface;
[0088] The virtual training control instruction is generated in response to the user clicking the trainer selection button and the training course selection button on the training interface to select a trainer and a course, and then continuing to click the start assessment button or the start teaching button;
[0089] The training playback control instruction is generated in response to the user clicking the training history selection button on the training playback interface to select a training history and then continuing to click the start playback button.
[0090] Specifically, when clicking the teaching video button generates an interface display control instruction for entering the corresponding teaching video control interface, a scenario teaching control instruction is also generated. The scenario teaching control instruction controls the multimedia display device 110 to play and display the corresponding teaching video.
[0091] Correspondingly, when clicking the start teaching button generates an interface display control instruction for entering the situational teaching control interface, a virtual training control instruction is also generated. The virtual training control instruction controls the multimedia display device 110 to display the situational teaching virtual scene corresponding to the trainee selected in the previous step and the training course.
[0092] Naturally, when clicking the start assessment button generates an interface display control instruction for entering the scenario assessment control interface, a virtual training control instruction will also be generated. The virtual training control instruction controls the multimedia display device 110 to display the scenario assessment virtual scene corresponding to the trainee selected in the previous step and the training course.
[0093] Correspondingly, when clicking the training history selection button generates an interface display control instruction for entering the training playback video control interface, a training playback control instruction will also be generated. The training playback control instruction controls the multimedia display device 110 to play and display the training playback video (or training history video) corresponding to the training history selected in the previous step.
[0094] In addition, it should be noted that in any interface, if no button is selected or clicked, or the currently displayed task has been completed, you can return to the home page and wait.
[0095] The following is an explanation of the tri-fold screen display mode of the multimedia display device 110. The multimedia display device is a tri-fold screen, and the tri-fold screen includes a first display screen, a second display screen, and a third display screen;
[0096] The first display screen is used to display the teaching video according to the scenario teaching control instruction; the second display screen is used to display the scenario teaching virtual scene or the scenario assessment virtual scene according to the virtual training control instruction, and to display the interface according to the interface display control instruction; the third display screen is used to display the training history video according to the training playback control instruction;
[0097] The interface includes a training result details interface, and the training result details interface includes at least one of a save button and a cancel / close button.
[0098] Specifically, Figure 2 As shown, the three-fold screen can display three contents at the same time, namely, teaching video, scenario teaching virtual scene or scenario assessment virtual scene, and training history video. Specifically, the first display screen displays the teaching video according to the scenario teaching control instruction, and the second display screen displays the scenario teaching virtual scene or scenario assessment virtual scene according to the virtual training control instruction; the third display screen is used to display the training history video according to the training playback control instruction. In addition, the second display screen can also display the interface according to the interface display control instruction.
[0099] It should be emphasized that for the three-fold screen display mode, the interface includes a training result details interface, which is displayed on the second display screen.
[0100] Specifically, if Figure 2 As shown, when the scenario teaching is completed, the interface display control instruction of the training result details interface is triggered, and when the scenario evaluation is completed, the interface display control instruction of the training result details interface is triggered. It should be noted that the function mode of the interface display control instruction of the training result details interface and the related contents of the display mode of the related buttons and the touch screen are not described in detail in the present invention.
[0101] In some embodiments, the situational teaching control instructions, the virtual training control instructions, the training playback control instructions and the interaction control instructions are acquired according to the human-computer interaction device.
[0102] Furthermore, the human-computer interaction device includes a speech recognition device and a Bluetooth device.
[0103] Specifically, in the three-fold screen display mode, the situational teaching control instructions, virtual training control instructions, training playback control instructions and the interactive control instructions are obtained according to the user's input to the voice recognition device or the input to the Bluetooth device.
[0104] It should be noted that, in any display content, if no instruction is received or the current display task has been completed, the standby animation can be automatically played in the default state.
[0105] The immersive panoramic teaching and training system provided by the present invention comprises a multimedia display device, a human-computer interaction device and a main control device; the main control device is used to generate a control instruction according to an operation; the operation comprises one of a user's input to the human-computer interaction device, a user's operation on the multimedia display device and an action of the multimedia display device; the multimedia display device is used to display at least one of an interface, a virtual scene and a video according to the control instruction; the control instruction comprises a scenario teaching control instruction, a virtual training control instruction, a training playback control instruction, an interface display control instruction and an interaction control instruction; the scenario teaching control instruction is used to control the multimedia display device to display a teaching video so as to conduct virtual technology teaching to the user; the virtual training control instruction is used to control the multimedia display device to display a scenario teaching virtual scene or a scenario assessment virtual scene so as to conduct immersive actual combat teaching or assessment to the user; the training playback control instruction is used to control the multimedia display device to play back a training history video saved by the user; the interface display control instruction is used to control the multimedia display device to display an interface; the interaction control instruction is used to interact with the display of the multimedia display device. The present invention realizes real-time interactive training between users and virtual teaching environments through multimedia display devices, human-computer interaction devices and main control devices. It can not only train students to master technical concepts through teaching videos, but also conduct actual combat simulations with situational teaching virtual scenes and situational assessment virtual scenes, so that students can have a corresponding degree of mastery of actual combat, thereby realizing immersive panoramic teaching and training with good quality and high efficiency.
[0106] The immersive panoramic teaching training method provided by the present invention is described below. The immersive panoramic teaching training method described below and the immersive panoramic teaching training system described above can be referred to each other. Figure 3 As shown, the method comprises the following steps:
[0107] The present invention also provides an immersive panoramic teaching training method, comprising the following steps:
[0108] Step 310: obtaining an operation, and generating a control instruction according to the operation; the operation includes one of a user input to a human-computer interaction device, a user operation on a multimedia display device, and an action of the multimedia display device;
[0109] Step 320: Controlling the multimedia display device to display at least one of an interface, a virtual scene, and a video according to the control instruction;
[0110] The control instructions include scenario teaching control instructions, virtual training control instructions, training playback control instructions, interface display control instructions and interactive control instructions;
[0111] The situational teaching control instructions are used to control the multimedia display device to display teaching videos so as to provide virtual technology teaching to users; the virtual training control instructions are used to control the multimedia display device to display situational teaching virtual scenes or situational assessment virtual scenes so as to provide immersive practical teaching or assessment to users; the training playback control instructions are used to control the multimedia display device to play back training history videos saved by users; the interface display control instructions are used to control the multimedia display interface; and the interactive control instructions are used to interact with the display of the multimedia display device.
[0112] According to an immersive panoramic teaching and training method provided by the present invention, the multimedia display device is a touch screen;
[0113] Correspondingly, the interface includes a display panel selection interface, a teaching video selection interface, a scenario training interface, a teaching video control interface, a training interface, a scenario teaching control interface, a scenario assessment control interface, a training result details interface, a training playback interface, and a training playback video control interface;
[0114] Wherein, the section selection interface includes a scenario teaching button and a scenario training button, the scenario teaching button is associated with the interface display control instruction of the teaching video selection interface, and the scenario training button is associated with the interface display control instruction of the scenario training interface;
[0115] The teaching video selection interface includes a plurality of teaching video buttons, and the teaching video buttons are associated with interface display control instructions of the teaching video control interface corresponding to the teaching video;
[0116] The scenario training interface includes a training button and a training playback button; the training button is associated with an interface display control instruction of the training interface, and the training playback button is associated with an interface display control instruction of the training playback interface;
[0117] The training interface includes a trainer selection button, a training course selection button, a start assessment button and a start teaching button; the start teaching button is associated with an interface display control instruction of the scenario teaching control interface, and the start assessment button is associated with an interface display control instruction of the scenario assessment control interface;
[0118] The training playback interface includes a training history selection button and a start playback button; the start playback button is associated with an interface display control instruction of the training playback video control interface;
[0119] The training result details interface includes at least one of a save button and a cancel / close button; the cancel / close button is associated with an interface display control instruction of the scenario training interface;
[0120] The teaching video control interface, the scenario teaching control interface, the scenario assessment control interface and the training playback video control interface all include interactive control buttons, and the interactive control buttons are associated with the interactive control instructions.
[0121] According to an immersive panoramic teaching training method provided by the present invention, the scenario teaching control instruction is generated in response to the user clicking the teaching video button on the teaching video selection interface;
[0122] The virtual training control instruction is generated in response to the user clicking the trainer selection button and the training course selection button on the training interface to select a trainer and a course, and then continuing to click the start assessment button or the start teaching button;
[0123] The training playback control instruction is generated in response to the user clicking the training history selection button on the training playback interface to select a training history and then continuing to click the start playback button.
[0124] According to an immersive panoramic teaching and training method provided by the present invention, the multimedia display device is a tri-fold screen, and the tri-fold screen includes a first display screen, a second display screen and a third display screen;
[0125] The first display screen is used to display the teaching video according to the scenario teaching control instruction; the second display screen is used to display the scenario teaching virtual scene or the scenario assessment virtual scene according to the virtual training control instruction, and to display the interface according to the interface display control instruction; the third display screen is used to display the training history video according to the training playback control instruction;
[0126] The interface includes a training result details interface, and the training result details interface includes at least one of a save button and a cancel / close button.
[0127] According to an immersive panoramic teaching training method provided by the present invention, the scenario teaching control instructions, the virtual training control instructions, the training playback control instructions and the interactive control instructions are acquired according to the human-computer interaction device.
[0128] According to an immersive panoramic teaching and training method provided by the present invention, the human-computer interaction device includes a speech recognition device and a Bluetooth device.
[0129] According to an immersive panoramic teaching and training method provided by the present invention, the interface display control instruction of the training performance details interface is generated in response to the multimedia display device displaying that the scenario teaching is completed or that the scenario evaluation is completed.
[0130] The immersive panoramic teaching and training method provided by the present invention generates a control instruction according to the operation by acquiring an operation; the operation includes one of the user's input to a human-computer interaction device, the user's operation to a multimedia display device, and the action of the multimedia display device; the multimedia display device is controlled to display at least one of an interface, a virtual scene, and a video according to the control instruction; wherein the control instruction includes a scenario teaching control instruction, a virtual training control instruction, a training playback control instruction, an interface display control instruction, and an interaction control instruction; the scenario teaching control instruction is used to control the multimedia display device to display a teaching video to conduct virtual technology teaching to the user; the virtual training control instruction is used to control the multimedia display device to display a scenario teaching virtual scene or a scenario assessment virtual scene to conduct immersive practical teaching or assessment to the user; the training playback control instruction is used to control the multimedia display device to play back a training history video saved by the user; the interface display control instruction is used to control the multimedia display interface; and the interaction control instruction is used to interact with the display of the multimedia display device. The present invention realizes real-time interactive training between users and virtual teaching environments through multimedia display devices, human-computer interaction devices and main control devices. It can not only train students to master technical concepts through teaching videos, but also conduct actual combat simulations with situational teaching virtual scenes and situational assessment virtual scenes, so that students can have a corresponding degree of mastery of actual combat, thereby realizing immersive panoramic teaching and training with good quality and high efficiency.
[0131] Figure 4 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 4As shown, the electronic device may include: a processor (processor) 410, a communication interface (Communications Interface) 420, a memory (memory) 430 and a communication bus 440, wherein the processor 410, the communication interface 420, and the memory 430 communicate with each other through the communication bus 440. The processor 410 can call the logic instructions in the memory 430 to execute the immersive panoramic teaching training method, which includes: obtaining an operation and generating a control instruction according to the operation; the operation includes one of the user's input to the human-computer interaction device, the user's operation on the multimedia display device and the action of the multimedia display device; according to the control instruction, the multimedia display device is controlled to display at least one of the interface, virtual scene and video; wherein the control instruction includes a scenario teaching control instruction, a virtual training control instruction, a training playback control instruction, an interface display control instruction and an interaction control instruction; the scenario teaching control instruction is used to control the multimedia display device to display the teaching video to conduct virtual technology teaching to the user; the virtual training control instruction is used to control the multimedia display device to display a scenario teaching virtual scene or a scenario assessment virtual scene to conduct immersive practical teaching or assessment to the user; the training playback control instruction is used to control the multimedia display device to play back the training history video saved by the user; the interface display control instruction is used to control the multimedia display interface; the interaction control instruction is used to interact with the display of the multimedia display device.
[0132] In addition, the logic instructions in the above-mentioned memory 430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0133] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the immersive panoramic teaching and training methods provided by the above methods, the method comprising: obtaining an operation, and generating a control instruction according to the operation; the operation includes one of the user's input to a human-computer interaction device, the user's operation on a multimedia display device, and the action of the multimedia display device; according to the control instruction, the multimedia display device is controlled to display at least one of an interface, a virtual scene, and a video; wherein the control instruction includes a scenario teaching control instruction, a virtual training control instruction, a training playback control instruction, an interface display control instruction, and an interaction control instruction; the scenario teaching control instruction is used to control the multimedia display device to display a teaching video to conduct virtual technology teaching to the user; the virtual training control instruction is used to control the multimedia display device to display a scenario teaching virtual scene or a scenario assessment virtual scene to conduct immersive practical teaching or assessment to the user; the training playback control instruction is used to control the multimedia display device to play back the training history video saved by the user; the interface display control instruction is used to control the multimedia display interface; and the interaction control instruction is used to interact with the display of the multimedia display device.
[0134] On the other hand, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it is implemented to execute the immersive panoramic teaching training method provided by the above-mentioned methods, the method comprising: obtaining an operation, and generating a control instruction according to the operation; the operation includes one of the user's input to the human-computer interaction device, the user's operation on the multimedia display device and the action of the multimedia display device; according to the control instruction, the multimedia display device is controlled to display at least one of an interface, a virtual scene and a video; wherein the control instruction includes a scenario teaching control instruction, a virtual training control instruction, a training playback control instruction, an interface display control instruction and an interaction control instruction; the scenario teaching control instruction is used to control the multimedia display device to display a teaching video to conduct virtual technology teaching to the user; the virtual training control instruction is used to control the multimedia display device to display a scenario teaching virtual scene or a scenario assessment virtual scene to conduct immersive practical teaching or assessment to the user; the training playback control instruction is used to control the multimedia display device to play back the training history video saved by the user; the interface display control instruction is used to control the multimedia display interface; the interaction control instruction is used to interact with the display of the multimedia display device.
[0135] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0136] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.
[0137] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. An immersive panoramic teaching and training system, characterized in that: Including multimedia display equipment, human-computer interaction equipment and main control equipment; The main control device is used to generate a control instruction according to an operation; the operation includes one of a user's input to the human-computer interaction device, a user's operation on the multimedia display device, and an action of the multimedia display device; The multimedia display device is used to display at least one of an interface, a virtual scene and a video according to the control instructions; the control instructions include scenario teaching control instructions, virtual training control instructions, training playback control instructions, interface display control instructions and interactive control instructions; The situational teaching control instructions are used to control the multimedia display device to display teaching videos so as to provide virtual technology teaching to users; the virtual training control instructions are used to control the multimedia display device to display situational teaching virtual scenes or situational assessment virtual scenes so as to provide immersive practical teaching or assessment to users; the training playback control instructions are used to control the multimedia display device to play back training history videos saved by users; the interface display control instructions are used to control the multimedia display device to display the interface; and the interactive control instructions are used to interact with the display of the multimedia display device.
2. The immersive panoramic teaching and training system according to claim 1, characterized in that: The multimedia display device is a touch screen; Correspondingly, the interface includes a display panel selection interface, a teaching video selection interface, a scenario training interface, a teaching video control interface, a training interface, a scenario teaching control interface, a scenario assessment control interface, a training result details interface, a training playback interface, and a training playback video control interface; Wherein, the section selection interface includes a scenario teaching button and a scenario training button, the scenario teaching button is associated with the interface display control instruction of the teaching video selection interface, and the scenario training button is associated with the interface display control instruction of the scenario training interface; The teaching video selection interface includes a plurality of teaching video buttons, and the teaching video buttons are associated with interface display control instructions of the teaching video control interface corresponding to the teaching video; The scenario training interface includes a training button and a training playback button; the training button is associated with an interface display control instruction of the training interface, and the training playback button is associated with an interface display control instruction of the training playback interface; The training interface includes a trainer selection button, a training course selection button, a start assessment button and a start teaching button; the start teaching button is associated with an interface display control instruction of the scenario teaching control interface, and the start assessment button is associated with an interface display control instruction of the scenario assessment control interface; The training playback interface includes a training history selection button and a start playback button; the start playback button is associated with an interface display control instruction of the training playback video control interface; The training result details interface includes at least one of a save button and a cancel / close button; the cancel / close button is associated with an interface display control instruction of the scenario training interface; The teaching video control interface, the scenario teaching control interface, the scenario assessment control interface and the training playback video control interface all include interactive control buttons, and the interactive control buttons are associated with the interactive control instructions.
3. The immersive panoramic teaching and training system according to claim 2, characterized in that: The scenario teaching control instruction is generated in response to the user clicking the teaching video button on the teaching video selection interface; The virtual training control instruction is generated in response to the user clicking the trainer selection button and the training course selection button on the training interface to select a trainer and a course, and then continuing to click the start assessment button or the start teaching button; The training playback control instruction is generated in response to the user clicking the training history selection button on the training playback interface to select a training history and then continuing to click the start playback button.
4. The immersive panoramic teaching and training system according to claim 1, characterized in that: The multimedia display device is a tri-fold screen, and the tri-fold screen includes a first display screen, a second display screen and a third display screen; The first display screen is used to display the teaching video according to the scenario teaching control instruction; the second display screen is used to display the scenario teaching virtual scene or the scenario assessment virtual scene according to the virtual training control instruction, and to display the interface according to the interface display control instruction; the third display screen is used to display the training history video according to the training playback control instruction; The interface includes a training result details interface, and the training result details interface includes at least one of a save button and a cancel / close button.
5. The immersive panoramic teaching and training system according to claim 4, characterized in that: The scenario teaching control instruction, the virtual training control instruction, the training playback control instruction and the interaction control instruction are acquired according to the human-computer interaction device.
6. The immersive panoramic teaching and training system according to claim 1, characterized in that: The human-computer interaction device includes a voice recognition device and a Bluetooth device.
7. The immersive panoramic teaching and training system according to claim 1, characterized in that: The interface display control instruction of the training performance details interface is generated in response to the multimedia display device displaying that the scenario teaching is completed or displaying that the scenario evaluation is completed.
8. An immersive panoramic teaching and training method, used to control the system according to any one of claims 1 to 7, characterized in that: The method comprises: Acquire an operation, and generate a control instruction according to the operation; the operation includes one of a user input to a human-computer interaction device, a user operation on a multimedia display device, and an action of the multimedia display device; Controlling at least one of a display interface, a virtual scene and a video of the multimedia display device according to the control instruction; The control instructions include scenario teaching control instructions, virtual training control instructions, training playback control instructions, interface display control instructions and interactive control instructions; The situational teaching control instructions are used to control the multimedia display device to display teaching videos so as to provide virtual technology teaching to users; the virtual training control instructions are used to control the multimedia display device to display situational teaching virtual scenes or situational assessment virtual scenes so as to provide immersive practical teaching or assessment to users; the training playback control instructions are used to control the multimedia display device to play back training history videos saved by users; the interface display control instructions are used to control the multimedia display interface; and the interactive control instructions are used to interact with the display of the multimedia display device.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the immersive panoramic teaching and training method as described in claim 8 is implemented.
10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the immersive panoramic teaching and training method as claimed in claim 8 is implemented.
