An interactive virtual simulation method and system for civil aviation emergency drills

Through the interactive virtual simulation method, the continuous occurrence of multiple dangerous situations is simulated, the problem of insufficient simulation in the existing technology is solved, and the high simulation drill and real-time scoring of civil aviation accidents are achieved, which improves the drill effect.

CN118690582BActive Publication Date: 2024-11-08SHENZHEN RENAN CONSULTING SERVICES CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411155766.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-22
Publication Date
2024-11-08
Estimated Expiration
2044-08-22

AI Technical Summary

Technical Problem

The existing civil aviation simulation drill methods are difficult to simulate the scenes of multiple dangerous situations one after another, and the simulation is insufficient, making it difficult to achieve continuous drills and effective scoring of multiple dangerous situations.

Method used

Design an interactive virtual simulation method for civil aviation emergency drills. By obtaining drill scripts, determine the time point of the danger, send it to the simulation terminal for simulation, command personnel make dispatch instructions based on the video, command and score in real time, and reviewers score the drill process. , until all dangerous situations are handled.

Benefits of technology

Continuous drills for multiple dangerous situations in civil aviation accidents have been achieved, simulation is improved, and reviewers are allowed to timely score command, simulation and execution personnel during the exercise, and the drill effect is optimized.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118690582B_ABST
    Figure CN118690582B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of computers, and in particular to an interactive virtual simulation method and system for civil aviation emergency drills, wherein the method enables corresponding simulated personnel to perform corresponding dangerous situation simulations at each occurrence time point according to a preset drill script, and displays the simulated video to a commanding personnel in real time so that the commanding personnel can mobilize executive personnel to handle the dangerous situation, and can display the processing process to the commanding personnel in real time so that the commanding personnel can perform real-time command; when the next occurrence time point is reached, the command end can determine the division of the display screen according to the completion status of the previous dangerous situation; in the present application, continuous drills of multiple dangerous situations in civil aviation accidents are realized, with higher simulation, and the reviewers can score the commanding personnel, simulated personnel and executive personnel during the exercise to reflect the effect of the drill.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computers, and in particular to an interactive virtual simulation method and system for civil aviation emergency drills. Background Art

[0002] Civil aviation simulation drills refer to a type of simulation training activity conducted in the field of civil aviation, which aims to improve the emergency response and coordination capabilities of crew members, air traffic controllers and ground service personnel to ensure that they can effectively respond and handle emergencies or specific events when they occur;

[0003] Civil aviation accidents often involve the occurrence of multiple dangerous situations. The existing civil aviation drill method can only conduct separate drills for one dangerous situation at a time, but it is difficult to conduct drills in scenarios where multiple dangerous situations occur one after another. The simulation of the drill is insufficient, and it is difficult to achieve the goal of the drill. Summary of the invention

[0004] Based on this, it is necessary to provide an interactive virtual simulation method for civil aviation emergency drills to address the above problems.

[0005] The embodiment of the present invention is implemented as follows: an interactive virtual simulation method for civil aviation emergency drills is applied to a command end, and the method includes:

[0006] S1: Obtain the drill script and determine the occurrence time of each dangerous situation from the drill script;

[0007] S2: Send each occurrence time point to the corresponding simulation end, so that the simulation personnel corresponding to the simulation end simulate the corresponding dangerous situation at the occurrence time point;

[0008] S3: At the first occurrence time point, a simulated video of the simulation terminal corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatching instruction according to the simulated dangerous situation in the simulated video;

[0009] S4: Identify the instruction object of the dispatch instruction, and send the dispatch instruction to the execution end corresponding to the instruction object, so that the instruction object executes the dispatch instruction;

[0010] S5: Acquire and display the execution video of the execution end, so that the command personnel can send real-time instructions to the instruction object according to the simulation video and the execution video, and then conduct real-time command on the instruction object;

[0011] S6: Storing and sending the simulation video, execution video, dispatching instructions and various real-time instructions to the review end, so that the reviewer can score the simulation personnel, command personnel and instruction objects;

[0012] S7: At the next occurrence time point, determine whether the simulated dangerous situation that has occurred has been handled;

[0013] S8: If the simulated danger that has occurred has been handled, the video corresponding to the simulated danger that has occurred is removed, and the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0014] S9: If the simulated danger that has occurred has not been processed, a corresponding number of display areas are divided according to the number of simulated dangers that need to be processed, and the video corresponding to each simulated danger that has occurred is moved into one display area. For the remaining display area, the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0015] S10: Repeat steps S7 to S9 until all simulated dangerous situations are handled and the drill ends.

[0016] In one embodiment, the present invention provides an interactive virtual simulation system for civil aviation emergency drills, the system comprising:

[0017] At least one analog terminal for capturing analog video;

[0018] At least one execution terminal, used for collecting execution video;

[0019] At least one review terminal for reviewers to rate the simulator, the commander, and the command object;

[0020] The command end communicates with each simulation end, execution end and review end, and is used to execute the interactive virtual simulation method for civil aviation emergency drills.

[0021] The present invention provides an interactive virtual simulation method and system for civil aviation emergency drills, wherein the method comprises obtaining a drill script, determining the occurrence time point of each dangerous situation from the drill script; sending each occurrence time point to a corresponding simulation end, so that a simulated person corresponding to the simulation end simulates the corresponding dangerous situation at the occurrence time point; at the first occurrence time point, obtaining and displaying a simulated video of the simulation end corresponding to the current occurrence time point, so that a commanding person can make a dispatching instruction according to the simulated dangerous situation in the simulated video; identifying an instruction object of the dispatching instruction, so as to send the dispatching instruction to an execution end corresponding to the instruction object, so that the instruction object executes the dispatching instruction; obtaining and displaying an execution video of the execution end, so that the commanding person can send a real-time instruction to the instruction object according to the simulation video and the execution video, and then conduct real-time command on the instruction object; storing and sending the simulation video, the execution video, the dispatching instruction and each real-time instruction to the review end, so that the reviewing person can score the simulated person, the commanding person and the instruction object; at the next occurrence time point, judging whether the simulated dangerous situation that has occurred is in a The handling is completed; if the simulated dangerous situation that has occurred has been handled, the video corresponding to the simulated dangerous situation that has occurred is removed, and the simulated video of the simulated end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make dispatch instructions based on the simulated dangerous situation in the simulated video, and then execute the above steps; if the simulated dangerous situation that has occurred has not been handled, a corresponding number of display areas are divided according to the number of simulated dangerous situations that need to be handled, and the video corresponding to each simulated dangerous situation that has occurred is moved into a display area. For the remaining display area, the simulated video of the simulated end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make dispatch instructions based on the simulated dangerous situation in the simulated video, and then execute the above steps; repeat the above steps until all simulated dangerous situations are handled and the exercise is completed; in the present application, continuous drills of multiple dangerous situations in civil aviation accidents are realized, which has higher simulation, and enables the reviewers to score the commanders, simulation personnel and execution personnel during the exercise, so as to realize timely evaluation of each person participating in the exercise. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A first flow chart of an interactive virtual simulation method for civil aviation emergency drills provided in one embodiment;

[0023] Figure 2 A second flow chart of an interactive virtual simulation method for civil aviation emergency drills provided in one embodiment;

[0024] Figure 3 A module flow chart of an interactive virtual simulation device for civil aviation emergency drills provided in one embodiment;

[0025] Figure 4A schematic diagram of the composition of an interactive virtual simulation system for civil aviation emergency drills provided in one embodiment;

[0026] Figure 5 1 is a block diagram of the internal structure of a command terminal in an embodiment. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0028] It is understood that the terms "first", "second", etc. used in the present invention may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script without departing from the scope of the present invention.

[0029] like Figure 1-Figure 2 As shown, in one embodiment, an interactive virtual simulation method for civil aviation emergency drills is proposed and applied to a command end. The method includes:

[0030] S1: Obtain the drill script and determine the occurrence time of each dangerous situation from the drill script;

[0031] S2: Send each occurrence time point to the corresponding simulation end, so that the simulation personnel corresponding to the simulation end simulate the corresponding dangerous situation at the occurrence time point;

[0032] S3: At the first occurrence time point, a simulated video of the simulation terminal corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatching instruction according to the simulated dangerous situation in the simulated video;

[0033] S4: Identify the instruction object of the dispatch instruction, and send the dispatch instruction to the execution end corresponding to the instruction object, so that the instruction object executes the dispatch instruction;

[0034] S5: Acquire and display the execution video of the execution end, so that the command personnel can send real-time instructions to the instruction object according to the simulation video and the execution video, and then conduct real-time command on the instruction object;

[0035] S6: Storing and sending the simulation video, execution video, dispatching instructions and various real-time instructions to the review end, so that the reviewer can score the simulation personnel, command personnel and instruction objects;

[0036] S7: At the next occurrence time point, determine whether the simulated dangerous situation that has occurred has been handled;

[0037] S8: If the simulated danger that has occurred has been handled, the video corresponding to the simulated danger that has occurred is removed, and the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0038] S9: If the simulated danger that has occurred has not been processed, a corresponding number of display areas are divided according to the number of simulated dangers that need to be processed, and the video corresponding to each simulated danger that has occurred is moved into one display area. For the remaining display area, the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0039] S10: Repeat steps S7 to S9 until all simulated dangerous situations are handled and the drill ends.

[0040] In this embodiment, this method is executed in the command end, which can be an independent physical server or terminal, or a server cluster composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud servers, cloud databases, cloud storage and CDN. In an exercise, there are several groups of simulated personnel (a group of simulated personnel has several simulated personnel, such as 5), and each group of simulated personnel simulates at least one simulated dangerous situation (for example, creating a fire, casualties, etc.), and each group of simulated personnel is provided with a corresponding simulation terminal for conveying instructions to the simulated personnel, shooting videos and transmitting the videos to the command end. The simulation terminal is held by one of the simulated personnel in the group. And it moves with the movement of the simulated personnel; furthermore, there are several groups of execution personnel, each group of execution personnel performs at least one task corresponding to a simulated dangerous situation (such as firefighting, rescuing the wounded), and each group of execution personnel is equipped with an execution terminal, which is used to convey instructions to the execution personnel, shoot videos and transmit the videos to the command terminal. The execution terminal is held by an execution personnel of the group and moves with the movement of the execution personnel; the review terminal can receive and play the audio and video sent by the command terminal, so that the reviewers can make scores in time based on the audio and video; the execution terminal, the review terminal and the simulation terminal can be smart phones, tablet computers, laptops but are not limited to these; the execution terminal, the review terminal and the simulation terminal all communicate with the command terminal.

[0041] In this embodiment, the command end also includes a display screen, a speaker, and a voice sensor; the command end can display simulation videos and execution videos to the commander through the display screen, play video audio through the speaker, receive voice commands made by the commander through the voice sensor, and then recognize the voice commands.

[0042] In this embodiment, the execution video of the execution end is obtained and displayed so that the command personnel can send real-time instructions to the instruction object based on the simulation video and the execution video, and then the real-time command of the instruction object includes: split-screen display of the simulation video and the execution video; monitoring whether the execution personnel have reached the location where the simulated danger occurs; if the execution personnel have not reached the location where the simulated danger occurs, the split-screen display of the simulation video and the execution video is maintained; if the execution personnel have reached the location where the simulated danger occurs, the execution video is displayed in full screen; wherein, monitoring whether the execution personnel have reached the location where the simulated danger occurs includes: identifying the simulation personnel in the simulation video and identifying the execution personnel in the execution video; monitoring whether the execution personnel appear in the simulation video and the execution video at the same time; if so, the execution personnel have reached the location where the simulated danger occurs, and if not, the execution personnel have not reached the location where the simulated danger occurs.

[0043] In this application, users can input drill scripts into the command end, so that the command end can obtain the drill scripts. At the same time, the command end distributes the drill scripts to each simulation end, so that the simulation personnel can clearly know the time points for their simulations. According to the preset drill scripts, the corresponding simulation personnel are mobilized to simulate the corresponding dangerous situations at each time point, and the simulation videos are displayed to the command personnel in real time, so that the command personnel can mobilize the executive personnel to deal with the dangerous situations, and the processing process can be displayed to the command personnel in real time, so that the command personnel can give real-time commands. Furthermore, the simulation videos, execution videos and relevant instructions made by the command personnel can be sent to the review end, so that the reviewers can score the performances of the three parties respectively. When the next occurrence time point is reached, the command end can determine the division of the display screen according to the completion status of the previous dangerous situation, so as to ensure that the display of each unfinished dangerous situation can be maintained, so that the command personnel can conduct simultaneous command of multiple dangerous situations, and then complete the command of all dangerous situations; in the present application, continuous drills of multiple dangerous situations in civil aviation accidents are realized, with higher simulation, and the assessors can score the command personnel, simulation personnel and executors during the exercise, and realize timely evaluation of all personnel participating in the exercise, so as to let all parties know the effectiveness of their task execution, and timely discover deficiencies, and then optimize and improve, so as to effectively achieve the effect of the exercise.

[0044] As a preferred embodiment, the dispatch instruction and the real-time instruction are voice instructions given by the commander; identifying the instruction object of the dispatch instruction to send the dispatch instruction to the execution end corresponding to the instruction object so that the instruction object executes the dispatch instruction includes:

[0045] Identify the dispatching instructions and perform voice analysis on the dispatching instructions to obtain object keywords;

[0046] Match the object keyword with the name of each execution end;

[0047] The executor of the successfully matched execution end is taken as the instruction object, and a dispatch instruction is sent to the execution end, so that the execution end plays the dispatch instruction to the instruction object, and then the instruction object moves to the location where the simulated danger occurs according to the dispatch instruction.

[0048] Acquiring and displaying the execution video of the execution end so that the commander can send real-time instructions to the instruction object based on the simulation video and the execution video, and then conducting real-time instructions on the instruction object includes:

[0049] In the process of displaying the execution video, real-time instructions given by the commander are received in real time;

[0050] When any real-time instruction is received, the real-time instruction is forwarded to the corresponding execution end, so that the execution end plays the real-time instruction to the instruction object, and then the instruction object executes the task according to the real-time instruction.

[0051] In this embodiment, the name of each execution end is preset in the command end, such as the fire end. For example, the command personnel issues a dispatch order "firefighters go to the first location to extinguish the fire", and the two words "firefighters" match the fire end, so the dispatch order is sent to the fire end to make the firefighters go to the first location; further, the command personnel can send further instructions to the execution end in real time, that is, real-time instructions, to further direct the actions of the execution end.

[0052] As a preferred embodiment, the simulation video includes the video recording time point of each frame, the execution video includes the video recording time point of each frame, and storing and sending the simulation video, the execution video, the dispatch instruction and each real-time instruction to the review end includes:

[0053] storing the analog video and the video recording time point of each frame of the analog video;

[0054] storing the execution video and the video recording time point of each frame of the execution video;

[0055] Storing the dispatch instruction and the instruction time point when the dispatch instruction is identified;

[0056] Storing each real-time instruction and the instruction time point when each real-time instruction is identified;

[0057] The dispatch instruction is embedded into the simulation video, and the instruction time point of the dispatch instruction is aligned with the video recording time point of the simulation video, so that when the simulation video is played to the frame corresponding to the instruction time point, the dispatch instruction is played at the same time;

[0058] Each real-time instruction is embedded in the execution video, and the instruction time point of each real-time instruction is aligned with the video recording time point of the simulation video, so that when the execution video plays the corresponding frame of each instruction time point, the corresponding real-time instruction is played at the same time;

[0059] The simulation video with the dispatch instructions embedded and the execution video with the real-time instructions embedded are sent to the review end.

[0060] In this embodiment, the reviewers can learn about the performance of the simulation personnel and the execution personnel based on the simulation video and the execution video, and then score them; furthermore, by embedding dispatch instructions and real-time instructions into the video, the reviewers can learn about the content of the commander's command and the appropriateness of the timing of the command, and then score them.

[0061] As a preferred embodiment, determining whether the simulated dangerous situation that has occurred has been handled includes:

[0062] For each simulated dangerous situation that has occurred, determine whether a task completion report made by a corresponding executor has been received, wherein the task completion report is a voice report made by the executor to the corresponding execution end;

[0063] If the task completion report made by the corresponding executor has been received, the simulated dangerous situation has been handled;

[0064] If the task completion report is not received from the corresponding executor, the simulated dangerous situation has not been handled.

[0065] While executing step 9, the following steps are also included:

[0066] Monitor whether the simulated dangerous situations that have occurred have been handled;

[0067] When any simulated danger situation that has occurred has been handled, the video corresponding to the simulated danger situation that has occurred will be removed;

[0068] Re-divide the corresponding display area according to the number of remaining simulated dangerous situations;

[0069] The remaining videos corresponding to each simulated dangerous situation are moved into a display area for display.

[0070] In this embodiment, it is possible to monitor in real time whether any simulated dangerous situations have been handled, and to promptly clear the handled simulated dangerous situations to ensure that other simulated dangerous situations have sufficient display space, to ensure the viewing effect of the commanders, and to reduce the impact on the commanders' commands.

[0071] As a preferred embodiment, if the simulated dangerous situation that has occurred has not been completely handled, it also includes:

[0072] monitoring whether a delay request from a commander is received, wherein the delay request includes a delay duration;

[0073] If a delay request is received, the score reduction factor is determined based on the delay duration and displayed to the commander;

[0074] When receiving the confirmation information from the commander, the current occurrence time point is postponed by the delay time to obtain a new occurrence time point;

[0075] When a new occurrence time point is reached, it is determined whether the simulated dangerous situation that has occurred has been handled, and steps S8 to S9 are executed.

[0076] If a delay request is received from the commander, the simulated hazard corresponding to the previous time point of the delayed occurrence will be used as the target hazard. After receiving the commander's score on the target hazard from the reviewer, the score will be multiplied by the score reduction factor.

[0077] The score reduction factor is calculated according to the following formula:

[0078]

[0079] in, is the score reduction factor, For the delay duration, The time interval between the time point that needs to be delayed and the last time point.

[0080] In this embodiment, sometimes, multiple videos of simulated dangerous situations are displayed simultaneously on the display screen of the command end, making the commander overwhelmed. At this time, the commander can issue a delay request to postpone the subsequent event point so that he has sufficient time to deal with the previous simulated dangerous situation; and because the request delay indicates that the commander's command efficiency and command ability are lacking, the score reduction coefficient is set to reduce the score accordingly (the reduction ratio is related to the extension time), so that the final score can better represent the commander's true level, that is, it is more meaningful for reference.

[0081] like Figure 3 As shown, in one embodiment, an interactive virtual simulation device for civil aviation emergency drills is provided, the device comprising:

[0082] The first acquisition module is used to acquire the drill script and determine the occurrence time of each dangerous situation from the drill script;

[0083] The first sending module is used to send each occurrence time point to the corresponding simulation end, so that the simulation personnel corresponding to the simulation end simulate the corresponding dangerous situation at the occurrence time point;

[0084] The first processing module is used to obtain and display the simulated video of the simulation end corresponding to the current occurrence time point at the first occurrence time point, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video;

[0085] A second sending module, used for identifying the instruction object of the dispatch instruction, so as to send the dispatch instruction to the execution end corresponding to the instruction object, so that the instruction object executes the dispatch instruction;

[0086] The second acquisition module is used to acquire and display the execution video of the execution end, so that the command personnel can send real-time instructions to the instruction object based on the simulation video and the execution video, and then conduct real-time command on the instruction object;

[0087] The third sending module is used to store and send the simulation video, execution video, dispatching instructions and various real-time instructions to the review end, so that the reviewer can score the simulation personnel, command personnel and instruction objects;

[0088] The second processing module is used to determine whether the simulated dangerous situation that has occurred has been handled at the next occurrence time point;

[0089] The third processing module is used to remove the video corresponding to the simulated dangerous situation that has occurred if the simulated dangerous situation has been handled, obtain and display the simulated video of the simulated end corresponding to the current occurrence time point, so that the commander can make a dispatch instruction according to the simulated dangerous situation in the simulated video, and execute steps S4 to S6;

[0090] The fourth processing module is used for dividing the display areas into a corresponding number according to the number of simulated dangerous situations that need to be processed, if the simulated dangerous situation that has occurred has not been processed, and moving the video corresponding to each simulated dangerous situation that has occurred into one display area, and for the remaining display area, obtaining and displaying the simulated video of the simulated end corresponding to the current occurrence time point, so that the commander can make a dispatch instruction according to the simulated dangerous situation in the simulated video, and executing steps S4 to S6;

[0091] The fifth processing module is used to repeatedly execute steps S7 to S9 until all simulated dangerous situations are processed and the drill ends.

[0092] The process of each module realizing its own function in the interactive virtual simulation device for civil aviation emergency drill provided in this embodiment can be specifically referred to the aforementioned Figure 1 The description of the illustrated embodiment will not be repeated here.

[0093] like Figure 4 As shown, in one embodiment, an interactive virtual simulation system for civil aviation emergency drills is provided, the system comprising:

[0094] At least one analog terminal for capturing analog video;

[0095] At least one execution terminal, used for collecting execution video;

[0096] At least one review terminal for reviewers to rate the simulator, the commander, and the command object;

[0097] The command end communicates with each simulation end, execution end and review end, and is used to execute the interactive virtual simulation method for civil aviation emergency drills.

[0098] In this embodiment, the command end cooperates with the simulation end, the execution end and the review end to realize continuous drills of multiple dangerous situations in civil aviation accidents, with higher simulation, and enables the reviewers to score the command personnel, simulation personnel and execution personnel during the exercise, and to realize timely evaluation of each person participating in the exercise, so that all parties can know the effectiveness of their task execution, discover deficiencies in time, and then optimize and improve, so as to achieve the actual effect of the exercise.

[0099] Figure 5 FIG. 2 shows an internal structure diagram of a command terminal in an embodiment. Figure 5 As shown, the command end includes a processor, a memory, a network interface, an input device and a display screen connected through a system bus. Among them, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the command end stores an operating system and may also store a computer program. When the computer program is executed by the processor, the processor can implement the interactive virtual simulation method for civil aviation emergency drills provided in an embodiment of the present invention. The internal memory may also store a computer program. When the computer program is executed by the processor, the processor can execute the interactive virtual simulation method for civil aviation emergency drills provided in an embodiment of the present invention. The display screen of the command end may be a liquid crystal display screen or an electronic ink display screen, and the input device of the command end may be a touch layer covering the display screen, or a button, trackball or touchpad provided on the shell of the command end, or an external keyboard, touchpad or mouse, etc.

[0100] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present invention, and does not constitute a limitation on the command end to which the scheme of the present invention is applied. The specific command end may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0101] In one embodiment, the interactive virtual simulation device for civil aviation emergency drills provided by the embodiment of the present invention can be implemented in the form of a computer program. The computer program can be used in Figure 5The memory of the command terminal can store various program modules constituting the interactive virtual simulation device for civil aviation emergency drills, for example, Figure 3 The computer program composed of the program modules enables the processor to execute the steps of the interactive virtual simulation method for civil aviation emergency drills of various embodiments of the present invention described in this specification.

[0102] For example, Figure 5 The command end shown can be Figure 3 The first acquisition module in the interactive virtual simulation device for civil aviation emergency drills shown executes step S1; the command end may execute step S2 through the first sending module; the command end may execute step S3 through the first processing module; the command end may execute step S4 through the second sending module; the command end may execute step S5 through the second acquisition module; the command end may execute step S6 through the third sending module; the command end may execute step S7 through the second processing module; the command end may execute step S8 through the third processing module; the command end may execute step S9 through the fourth processing module; the command end may execute step S10 through the fifth processing module.

[0103] In one embodiment, a command end is provided, the command end comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program:

[0104] S1: Obtain the drill script and determine the occurrence time of each dangerous situation from the drill script;

[0105] S2: Send each occurrence time point to the corresponding simulation end, so that the simulation personnel corresponding to the simulation end simulate the corresponding dangerous situation at the occurrence time point;

[0106] S3: At the first occurrence time point, a simulated video of the simulation terminal corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatching instruction according to the simulated dangerous situation in the simulated video;

[0107] S4: Identify the instruction object of the dispatch instruction, and send the dispatch instruction to the execution end corresponding to the instruction object, so that the instruction object executes the dispatch instruction;

[0108] S5: Acquire and display the execution video of the execution end, so that the command personnel can send real-time instructions to the instruction object according to the simulation video and the execution video, and then conduct real-time command on the instruction object;

[0109] S6: Storing and sending the simulation video, execution video, dispatching instructions and various real-time instructions to the review end, so that the reviewer can score the simulation personnel, command personnel and instruction objects;

[0110] S7: At the next occurrence time point, determine whether the simulated dangerous situation that has occurred has been handled;

[0111] S8: If the simulated danger that has occurred has been handled, the video corresponding to the simulated danger that has occurred is removed, and the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0112] S9: If the simulated danger that has occurred has not been processed, a corresponding number of display areas are divided according to the number of simulated dangers that need to be processed, and the video corresponding to each simulated danger that has occurred is moved into one display area. For the remaining display area, the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0113] S10: Repeat steps S7 to S9 until all simulated dangerous situations are handled and the drill ends.

[0114] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor performs the following steps:

[0115] S1: Obtain the drill script and determine the occurrence time of each dangerous situation from the drill script;

[0116] S2: Send each occurrence time point to the corresponding simulation end, so that the simulation personnel corresponding to the simulation end simulate the corresponding dangerous situation at the occurrence time point;

[0117] S3: At the first occurrence time point, a simulated video of the simulation terminal corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatching instruction according to the simulated dangerous situation in the simulated video;

[0118] S4: Identify the instruction object of the dispatch instruction, and send the dispatch instruction to the execution end corresponding to the instruction object, so that the instruction object executes the dispatch instruction;

[0119] S5: Acquire and display the execution video of the execution end, so that the command personnel can send real-time instructions to the instruction object according to the simulation video and the execution video, and then conduct real-time command on the instruction object;

[0120] S6: Storing and sending the simulation video, execution video, dispatching instructions and various real-time instructions to the review end, so that the reviewer can score the simulation personnel, command personnel and instruction objects;

[0121] S7: At the next occurrence time point, determine whether the simulated dangerous situation that has occurred has been handled;

[0122] S8: If the simulated danger that has occurred has been handled, the video corresponding to the simulated danger that has occurred is removed, and the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0123] S9: If the simulated danger that has occurred has not been processed, a corresponding number of display areas are divided according to the number of simulated dangers that need to be processed, and the video corresponding to each simulated danger that has occurred is moved into one display area. For the remaining display area, the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6;

[0124] S10: Repeat steps S7 to S9 until all simulated dangerous situations are handled and the drill ends.

[0125] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0126] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0127] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0128] The above-mentioned embodiments only express several implementation methods of the present invention, and the description is relatively specific and detailed, but it cannot be understood as limiting the scope of the present invention. It should be pointed out that for ordinary technicians in this field, several modifications and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention.

Claims

1. An interactive virtual simulation method for civil aviation emergency drills, applied to a command end, characterized in that: The method comprises: S1: Obtain the drill script and determine the occurrence time of each dangerous situation from the drill script; S2: Send each occurrence time point to the corresponding simulation end, so that the simulation personnel corresponding to the simulation end simulate the corresponding dangerous situation at the occurrence time point; S3: At the first occurrence time point, a simulated video of the simulation terminal corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatching instruction according to the simulated dangerous situation in the simulated video; S4: Identify the instruction object of the dispatch instruction, and send the dispatch instruction to the execution end corresponding to the instruction object, so that the instruction object executes the dispatch instruction; S5: Acquire and display the execution video of the execution end, so that the command personnel can send real-time instructions to the instruction object according to the simulation video and the execution video, and then conduct real-time command on the instruction object; S6: Storing and sending the simulation video, execution video, dispatching instructions and various real-time instructions to the review end, so that the reviewer can score the simulation personnel, command personnel and instruction objects; S7: At the next occurrence time point, determine whether the simulated dangerous situation that has occurred has been handled; S8: If the simulated danger that has occurred has been handled, the video corresponding to the simulated danger that has occurred is removed, and the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6; S9: If the simulated danger that has occurred has not been processed, a corresponding number of display areas are divided according to the number of simulated dangers that need to be processed, and the video corresponding to each simulated danger that has occurred is moved into one display area. For the remaining display area, the simulated video of the simulation end corresponding to the current occurrence time point is obtained and displayed, so that the commander can make a dispatch instruction according to the simulated danger in the simulated video, and execute steps S4 to S6; S10: Repeat steps S7 to S9 until all simulated dangerous situations are processed and the drill ends; The dispatching instruction and the real-time instruction are voice instructions given by the commanding personnel; identifying the instruction object of the dispatching instruction to send the dispatching instruction to the execution end corresponding to the instruction object so that the instruction object executes the dispatching instruction includes: Identify the dispatching instructions and perform voice analysis on the dispatching instructions to obtain object keywords; Match the object keyword with the name of each execution end; The executor of the successfully matched execution end is taken as the instruction object, and a dispatch instruction is sent to the execution end, so that the execution end plays the dispatch instruction to the instruction object, and then the instruction object moves to the occurrence location of the simulated danger according to the dispatch instruction; Acquiring and displaying the execution video of the execution end so that the commander can send real-time instructions to the instruction object based on the simulation video and the execution video, and then conducting real-time instructions on the instruction object includes: In the process of displaying the execution video, real-time instructions given by the commander are received in real time; When any real-time instruction is received, the real-time instruction is forwarded to the corresponding execution end, so that the execution end plays the real-time instruction to the instruction object, and then the instruction object executes the task according to the real-time instruction; The simulation video includes the video recording time point of each frame, and the execution video includes the video recording time point of each frame. The storage and sending of the simulation video, execution video, dispatch instructions and various real-time instructions to the review end include: storing the analog video and the video recording time point of each frame of the analog video; storing the execution video and the video recording time point of each frame of the execution video; Storing the dispatch instruction and the instruction time point when the dispatch instruction is identified; Storing each real-time instruction and the instruction time point when each real-time instruction is identified; The dispatch instruction is embedded into the simulation video, and the instruction time point of the dispatch instruction is aligned with the video recording time point of the simulation video, so that when the simulation video is played to the frame corresponding to the instruction time point, the dispatch instruction is played at the same time; Each real-time instruction is embedded in the execution video, and the instruction time point of each real-time instruction is aligned with the video recording time point of the simulation video, so that when the execution video plays the corresponding frame of each instruction time point, the corresponding real-time instruction is played at the same time; The simulation video with the dispatch instructions embedded and the execution video with the real-time instructions embedded are sent to the review end.

2. The method according to claim 1, characterized in that Determining whether the simulated dangerous situation that has occurred has been handled includes: For each simulated dangerous situation that has occurred, determine whether a task completion report made by a corresponding executor has been received, wherein the task completion report is a voice report made by the executor to the corresponding execution end; If the task completion report made by the corresponding executor has been received, the simulated dangerous situation has been handled; If the task completion report is not received from the corresponding executor, the simulated dangerous situation has not been handled.

3. The method according to claim 2, characterized in that While executing step 9, the following steps are also included: Monitor whether the simulated dangerous situations that have occurred have been handled; When any simulated danger situation that has occurred has been handled, the video corresponding to the simulated danger situation that has occurred will be removed; Re-divide the corresponding display area according to the number of remaining simulated dangerous situations; The remaining videos corresponding to each simulated dangerous situation are moved into a display area for display.

4. The method according to claim 1, characterized in that: If the simulated dangerous situation has not been handled, it also includes: monitoring whether a delay request from a commander is received, wherein the delay request includes a delay duration; If a delay request is received, the score reduction factor is determined based on the delay duration and displayed to the commander; When receiving the confirmation information from the commander, the current occurrence time point is postponed by the delay time to obtain a new occurrence time point; When a new occurrence time point is reached, it is determined whether the simulated dangerous situation that has occurred has been handled, and steps S8 to S9 are executed.

5. The method according to claim 4, characterized in that If a delay request is received from the commander, the simulated hazard corresponding to the previous time point of the delayed occurrence time point will be used as the target hazard. After receiving the commander's score on the target hazard from the reviewer, the score will be multiplied by the score reduction coefficient. The score reduction factor is calculated according to the following formula: in, is the score reduction factor, For the delay duration, The time interval between the time point that needs to be delayed and the last time point.

6. An interactive virtual simulation system for civil aviation emergency drills, characterized in that: The system comprises: At least one analog terminal for capturing analog video; At least one execution terminal, used for collecting execution video; At least one review terminal for reviewers to rate the simulator, the commander, and the command object; The command end communicates with each simulation end, execution end and review end, and is used to execute the interactive virtual simulation method for civil aviation emergency drills as described in any one of claims 1-5.