Emergency plan deduction method and device and medium

By combining remote operation and on-site operation recognition technology, image and voice recognition are used to perform emergency plan deduction, the problems of complexity and verification difficulty of emergency plan deduction in the existing technology are solved, and efficient and accurate emergency plan deduction and drill results are achieved. .

CN119106982APending Publication Date: 2024-12-10CHINA UNITED NETWORK COMM GRP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411103142.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-12
Publication Date
2024-12-10

AI Technical Summary

Technical Problem

The existing emergency plan deduction methods are difficult to effectively perform emergency plan deduction for information systems, especially in complex on-site environments, which lacks unified visualization entrances and intelligent verification, resulting in poor drill results.

Method used

Provide an emergency plan deduction method and device, through the combination of remote operation and on-site operation, use image and speech recognition technology to identify operation instructions and results, and calculate scores based on weight values, provide visual deduction process and result verification, and build emergency plan Process for intelligent verification.

Benefits of technology

提高了应急演练的准确性和效率,提供了统一的可视化入口,确保演练按照预期推进,并通过智能验证提升了演练效果,减少了应急操作失误。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119106982A_ABST
    Figure CN119106982A_ABST
Patent Text Reader

Abstract

The invention provides an emergency plan deduction method and device and a medium, and relates to the technical field of information, and the method comprises the steps: executing an emergency plan deduced this time, which comprises the steps: responding to the execution of a certain remote operation action node, obtaining a picture of the remote operation from a remote control system, responding to the execution of a certain field operation action node, and obtaining a picture of the remote operation from a remote control system; the voice and the picture of the field operation are obtained from the field monitoring system, and the voice is dictated by the field operation personnel; identifying the picture of each remote operation to obtain each remote operation instruction and each remote operation result, identifying the voice of each field operation to obtain each field operation action and each field operation result, and identifying the picture of each field operation to verify each field operation action and each field operation result; and evaluating the execution effect of the deduced emergency plan according to each remote operation instruction, each remote operation result, each field operation action and each field operation result. According to the invention, the emergency plan deduction of the information system can be effectively carried out.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure at least relates to the field of information technology, and in particular to an emergency plan deduction method, an emergency plan deduction device, and a computer-readable storage medium. Background Art

[0002] In the information society, network and system security is often related to people's daily work and life, and the incidence of security failures is higher. The emergency response methods and the environment are complex and diverse, requiring cooperation from multiple parties such as on-site operation and maintenance personnel, system maintenance personnel, and scheduling and coordination personnel. Due to the different environments and required tools, the simulation of emergency plans is very difficult. Summary of the invention

[0003] The technical problem to be solved by the present disclosure is to provide an emergency plan deduction method, an emergency plan deduction device and a computer-readable storage medium in view of the above-mentioned shortcomings, so as to solve the problem of how to effectively conduct emergency plan deduction of an information system.

[0004] In a first aspect, the present disclosure provides an emergency plan simulation method, the method comprising:

[0005] The emergency plan for executing this exercise includes:

[0006] In response to executing a certain remote operation action node, the screen of the remote operation is obtained from the remote control system.

[0007] In response to executing a certain on-site operation action node, the voice and picture of the on-site operation are obtained from the on-site monitoring system, and the voice is spoken by the on-site operator;

[0008] Identify the screen of each remote operation to obtain each remote operation instruction and each remote operation result,

[0009] Recognize the voice of each on-site operation to obtain the action and result of each on-site operation.

[0010] Identify the screen of each on-site operation to verify each on-site operation action and each on-site operation result;

[0011] The execution effect of the emergency plan of this exercise was evaluated based on the remote operation instructions and the results of each remote operation, as well as the on-site operation actions and the results of each on-site operation.

[0012] Furthermore, the method also includes constructing an emergency plan for this exercise, including:

[0013] According to this deduction task, select a start node, several action nodes, several condition nodes and an end node;

[0014] Set the title and introduction of this emergency plan simulation in the start node;

[0015] In each action node, set the title, attribute, executor, operation content and expected result of the node. The attribute is remote operation or on-site operation, the executor is the name and contact information of the remote operator or on-site operator, and the operation content and expected result are described in text.

[0016] Set the ending words of this emergency plan simulation in the ending node;

[0017] Use conditional nodes to connect the three types of nodes above, and set the judgment condition for executing the next node in the conditional node.

[0018] Furthermore, the screen of each remote operation is identified to obtain each remote operation instruction and each remote operation result, specifically including:

[0019] Identify, in each remote operation screen, a first interface screenshot of a remote operator inputting a remote operation command to the remote control system, and a second interface screenshot of a remote operation result returned by the remote control system after the controlled device executes the input remote operation command;

[0020] Identify key characters of the remote operation instruction in each first interface screenshot, compare the first similarity between the key characters of the remote operation instruction and the operation content characters in the corresponding node, and determine that the remote operation instruction hits in response to the first similarity being greater than a first threshold;

[0021] Identify the remote operation result key characters in each second interface screenshot, compare the second similarity between the remote operation result key characters and the expected result characters in the corresponding node, and determine that the remote operation result is a hit in response to the second similarity being greater than a second threshold.

[0022] Furthermore, the voice of each on-site operation is recognized to obtain each on-site operation action and each on-site operation result, specifically including:

[0023] Recognize the speech of each on-site operation to obtain the key characters of the on-site operation action and the key characters of the on-site operation result spoken by the on-site operator;

[0024] The third similarity between each on-site operation action key character and the operation content character in the corresponding node, and between each on-site operation result key character and the expected result character in the corresponding node is compared.

[0025] Furthermore, the screens of each on-site operation are identified to verify each on-site operation action and each on-site operation result, including:

[0026] Identify the screens of each on-site operation to obtain the analysis results of the on-site operation actions performed by the on-site operators and the analysis results of the on-site operation results displayed by the on-site operated equipment;

[0027] Comparing the fourth similarity between each on-site operation action key character and the corresponding on-site operation action analysis result, and between each on-site operation result key character and the corresponding on-site operation result analysis result;

[0028] In response to a third similarity being greater than a third threshold and a corresponding fourth similarity being greater than a first search threshold, it is determined that the on-site operation action and the on-site operation result hit.

[0029] Furthermore, based on the remote operation instructions and the remote operation results, as well as the on-site operation actions and the on-site operation results, the execution effect of the emergency plan of this simulation is evaluated, including:

[0030] The first score of each remote operation instruction and each remote operation result is obtained according to the following formula:

[0031]

[0032] Wherein, X1 is the number of hit remote operation instructions, X is the total number of remote operation instructions, Y1 is the number of hit remote operation results, Y is the total number of remote operation results, a is the first weight value, and b is the second weight value;

[0033] The second score of each on-site operation action and each on-site operation result is obtained according to the following formula:

[0034]

[0035] Among them, Z1 is the number of hit on-site operation actions and on-site operation results, and Z is the total number of on-site operation actions and on-site operation results;

[0036] The total score of the emergency plan execution in this exercise is obtained according to the following formula:

[0037] Total execution score = (first score × c + second score × d)

[0038] Among them, c is the third weight value, and d is the fourth weight value.

[0039] Furthermore, the evaluation of the implementation effect of the emergency plan in this exercise also includes:

[0040] A comparison log corresponding to the executor of each action node and the first similarity and the second similarity, or the third similarity and the fourth similarity, is formed.

[0041] Furthermore, the method also includes visually displaying the entire simulation process of the emergency plan of this simulation, including:

[0042] Visually display the title and introduction of this emergency plan simulation, and display all nodes in sequence;

[0043] Receive a click instruction for the start node and obtain the corresponding start time;

[0044] According to the judgment conditions in the conditional node, transfer to the next node in turn, and obtain the transfer time of each node;

[0045] In response to the transferred node being an action node, the title of this emergency plan simulation is visually displayed, all nodes are displayed in order, and the title, attributes, executor, operation content, expected results, and remote operation screen or on-site operation screen of the current action node are displayed;

[0046] Until the end node is reached, the title, end words, comparison log of each action node and the total execution score of this emergency plan simulation are displayed visually;

[0047] Receive a click instruction for the end node and obtain the corresponding end time.

[0048] In a second aspect, the present disclosure provides an emergency plan simulation device, the device comprising:

[0049] The execution unit is used to execute the emergency plan of this exercise, including:

[0050] In response to executing a certain remote operation action node, the screen of the remote operation is obtained from the remote control system.

[0051] In response to executing a certain on-site operation action node, the voice and picture of the on-site operation are obtained from the on-site monitoring system, and the voice is spoken by the on-site operator;

[0052] The identification unit is connected to the execution unit and is used for:

[0053] Identify the screen of each remote operation to obtain each remote operation instruction and each remote operation result,

[0054] Recognize the voice of each on-site operation to obtain the action and result of each on-site operation.

[0055] Identify the screen of each on-site operation to verify each on-site operation action and each on-site operation result;

[0056] The evaluation unit is connected to the identification unit and is used to evaluate the execution effect of the emergency plan of this simulation based on each remote operation instruction and each remote operation result, as well as each on-site operation action and each on-site operation result.

[0057] In a third aspect, the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the emergency plan deduction method as described above is implemented.

[0058] The present invention provides an emergency plan simulation method, an emergency plan simulation device and a computer-readable storage medium. According to the characteristics of the information system, the emergency plan is divided into two major contents: remote operation and on-site operation. The operation screen of the remote operation is identified to obtain the content and result of the remote operation. The operation content and result of the on-site operation are collected orally by the on-site operator, and the authenticity is judged by monitoring screen recognition, so as to obtain a comprehensive and accurate information system emergency plan simulation result. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] Figure 1 is a flow chart of an emergency plan deduction method according to an embodiment of the present disclosure;

[0060] Figure 2 It is an architecture diagram of an emergency plan deduction method according to an embodiment of the present disclosure;

[0061] Figure 3 is a schematic diagram of an interaction exercise of an emergency plan deduction method according to an embodiment of the present disclosure;

[0062] Figure 4 It is a large-screen schematic diagram of a rehearsal process of an emergency plan rehearsal method according to an embodiment of the present disclosure;

[0063] Figure 5 It is a schematic diagram of a large screen for evaluating the drill results of an emergency plan deduction method according to an embodiment of the present disclosure;

[0064] Figure 6 It is a structural schematic diagram of an emergency plan simulation device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0065] In order to enable those skilled in the art to better understand the technical solution of the present disclosure, the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

[0066] It should be understood that the specific embodiments and drawings described herein are only used to explain the present disclosure rather than to limit the present disclosure.

[0067] It can be understood that, in the absence of conflict, the various embodiments of the present disclosure and the various features in the embodiments can be combined with each other.

[0068] It can be understood that, for the convenience of description, the drawings of the present disclosure only show parts related to the present disclosure, while parts irrelevant to the present disclosure are not shown in the drawings.

[0069] It can be understood that each unit and module involved in the embodiments of the present disclosure may correspond to only one physical structure, or may be composed of multiple physical structures, or multiple units and modules may be integrated into one physical structure.

[0070] It will be understood that, in the absence of conflict, the functions and steps marked in the flowcharts and block diagrams of the present disclosure may occur in an order different from that marked in the drawings.

[0071] It is understood that the flowcharts and block diagrams of the present disclosure illustrate the possible architectures, functions, and operations of the systems, devices, equipment, and methods according to the various embodiments of the present disclosure. Each box in the flowchart or block diagram may represent a unit, module, program segment, or code, which contains executable instructions for implementing the specified functions. Moreover, each box or combination of boxes in the block diagram and flowchart may be implemented by a hardware-based system that implements the specified functions, or may be implemented by a combination of hardware and computer instructions.

[0072] It can be understood that the units and modules involved in the embodiments of the present disclosure can be implemented by software or hardware, for example, the units and modules can be located in a processor.

[0073] Embodiment 1:

[0074] like Figure 1 As shown, the present disclosure provides an emergency plan simulation method, the method comprising:

[0075] S1: Execute the emergency plan for this exercise, including:

[0076] In response to executing a certain remote operation action node, the screen of the remote operation is obtained from the remote control system.

[0077] In response to executing a certain on-site operation action node, the voice and picture of the on-site operation are obtained from the on-site monitoring system, and the voice is spoken by the on-site operator;

[0078] S2:

[0079] Identify the screen of each remote operation to obtain each remote operation instruction and each remote operation result,

[0080] Recognize the voice of each on-site operation to obtain the action and result of each on-site operation.

[0081] Identify the screen of each on-site operation to verify each on-site operation action and each on-site operation result;

[0082] S3: Evaluate the execution effect of the emergency plan of this exercise based on the remote operation instructions and results, as well as the on-site operation actions and results.

[0083] In this embodiment, according to the characteristics of the information system, the emergency plan is divided into two major contents: remote operation and on-site operation. For remote operation, the operation screen is identified to obtain the content and results of the remote operation. For on-site operation, the operation content and results verbally stated by the on-site operator are collected, and the authenticity is judged by monitoring screen recognition. In this way, a comprehensive and accurate information system emergency plan simulation result can be obtained. The two major contents of remote operation and on-site operation are set as action nodes with different attributes to better control the process of emergency plan drills.

[0084] More specifically, in order to improve the ability and level of emergency response, agencies and enterprises at all levels often test and verify the feasibility and effectiveness of various emergency plans through simulation exercises. The current emergency plan drills lack support for the way emergency drills are promoted, cannot ensure that the drills are carried out as expected, and lack verification and evaluation of the drill results; the drill scenarios are single, and the requirements for the drill environment and tools are low. In the face of more complex and diverse drill requirements in the handling methods and environments, such as network and system failures, it requires on-site, remote system maintenance, scheduling and coordination, and other multi-party cooperation, and fails to provide a unified visual entrance, which makes it difficult to guarantee the effectiveness of the drills.

[0085] In view of this, this embodiment proposes a visual intelligent emergency plan deduction method, which provides a unified visual entrance for the emergency plan deduction of complex scenarios, and controls the deduction process and intelligently verifies the results of the drill. The method includes: plan process control, drill personnel interaction, large-screen drill display and automatic verification of results. First, the emergency plan process is configured, and the overall deduction process is constructed by editing and combining nodes. Then, based on video access and remote connection, interaction is established with the drill site and the system operation interface, and real-time feedback on the drill process is provided. At the same time, the drill results are automatically verified and comprehensively scored based on voice, image and text recognition. Finally, the drill process and the drill process of the current link are displayed on a customized large screen as a viewing interface for the audience.

[0086] In one embodiment, the method further includes constructing an emergency plan for the current exercise, including:

[0087] According to this deduction task, select a start node, several action nodes, several condition nodes and an end node;

[0088] Set the title and introduction of this emergency plan simulation in the start node;

[0089] In each action node, set the title, attribute, executor, operation content and expected result of the node. The attribute is remote operation or on-site operation, the executor is the name and contact information of the remote operator or on-site operator, and the operation content and expected result are described in text.

[0090] Set the ending words of this emergency plan simulation in the ending node;

[0091] Use conditional nodes to connect the three types of nodes above, and set the judgment condition for executing the next node in the conditional node.

[0092] In this embodiment, a visual intelligent emergency plan deduction method architecture is designed as follows: Figure 2 As shown, the architecture is based on the process engine, voice engine, image recognition engine and intelligent verification engine. Based on the said base, the plan director operates the emergency plan simulation process module, the system personnel (remote operators) operate the system operation module, and the on-site personnel (on-site operators) operate the on-site operation module. The drill UI (user interface) is set for the audience to watch, and the drill process and results are displayed on the large screen of the emergency plan simulation. The plan director is generally the general person in charge or leader of the emergency drill, who summarizes the plan, configures supervision, and promotes and controls the process of the emergency drill.

[0093] The specific steps of the method include:

[0094] Step 1. Construct the emergency plan simulation process: The emergency plan simulation process module consists of four types of nodes: start, action, condition, and end. The overall simulation process is constructed by dragging, connecting, and configuring the four types of nodes. Each simulation has one and only one start and end node. The start node contains the start time and the emergency plan simulation introduction. The start time is the time when the operator actually clicks the start obtained by the system. The end node contains the end time and the emergency plan simulation end words. The end time is the time when the operator actually clicks the end obtained by the system. The end needs to be clicked to verify the actual operation content. The action node contains the node title, execution time, executor, executor contact information (in order to let the people watching the drill know who is operating and who can be contacted. If changes are required, they can be changed before the drill), step content, system operation module (that is, the attribute is remote operation), and on-site operation module (that is, the attribute is on-site operation). Among them, the node title, executor, executor contact information, and step content are configuration items based on the emergency plan. The step content contains the operation description, operation instructions, and corresponding expected results of each step. The execution time is obtained by the system. The system operation module is used to remotely connect to the operating equipment during the drill and present the system operation interface, while the on-site operation module is used to access the mobile terminal of the on-site personnel through video to present the on-site situation. The condition node contains the judgment condition and the subsequent action node executed when the corresponding condition is met. Based on the execution result of the previous node, the next action node to be executed is selected according to the configured judgment condition. System personnel and on-site personnel can access the large screen of the drill process through their mobile phones to grasp the current progress of the drill and determine whether they need to operate according to the current progress.

[0095] Step 2: Exercise interaction: Through step 1, a complete emergency plan simulation process can be constructed. During the exercise, system personnel need to provide real-time feedback on the content of the operation interface through the system operation module, and on-site personnel need to transmit the on-site images back in real time through the on-site operation module. The exercise interaction process is as follows: Figure 3 As shown. The actors in the drill are divided into system personnel and on-site personnel. System personnel and operators independently complete their own emergency response tasks and have their own emergency plans. Some of the links are also written by system or operator personnel, summarized by the general person in charge, and can be operated according to the plan. System personnel log in to the corresponding equipment and software system to perform command operations (the drill uses a laboratory environment that simulates actual production. Command operations are performed in this environment without affecting actual production). The platform uses the remote connection terminal information pre-configured in the current link (such as the terminal IP (Internet Protocol) address, remote access port, etc. To ensure information security, the account password is collected through other means) to establish a remote connection with the terminal used by the system personnel, and present the system personnel's operation screen in real time. On-site personnel are personnel who check the environment and perform on-site operations on site, such as checking the operation of equipment, temperature and humidity in the computer room, power supply, smoke detection, water immersion and surrounding environment, etc. They take corresponding measures for on-site problems, such as cooling down in case of high temperature, supplying power in case of power outage, restarting or replacing parts in case of equipment failure. Emergency drills for computer rooms and equipment are part of the network and system security guarantee. The platform establishes a video connection with the mobile terminal of the on-site personnel through the pre-configured on-site executor in the current link, and presents the on-site situation in real time. The site is generally a computer room, but there are also outdoor placement points or optical cable manholes and poles of communication infrastructure.

[0096] In one embodiment, identifying each remote operation screen in S2 to obtain each remote operation instruction and each remote operation result specifically includes:

[0097] Identify, in each remote operation screen, a first interface screenshot of a remote operator inputting a remote operation command to the remote control system, and a second interface screenshot of a remote operation result returned by the remote control system after the controlled device executes the input remote operation command;

[0098] Identify key characters of the remote operation instruction in each first interface screenshot, compare the first similarity between the key characters of the remote operation instruction and the operation content characters in the corresponding node, and determine that the remote operation instruction hits in response to the first similarity being greater than a first threshold;

[0099] Identify the remote operation result key characters in each second interface screenshot, compare the second similarity between the remote operation result key characters and the expected result characters in the corresponding node, and determine that the remote operation result is a hit in response to the second similarity being greater than a second threshold.

[0100] In one embodiment, the recognition of the voice of each on-site operation in S2 to obtain each on-site operation action and each on-site operation result specifically includes:

[0101] Recognize the speech of each on-site operation to obtain the key characters of the on-site operation action and the key characters of the on-site operation result spoken by the on-site operator;

[0102] The third similarity between each on-site operation action key character and the operation content character in the corresponding node, and between each on-site operation result key character and the expected result character in the corresponding node is compared.

[0103] In one embodiment, the screen of each on-site operation is identified in S2 to verify each on-site operation action and each on-site operation result, specifically including:

[0104] Identify the screens of each on-site operation to obtain the analysis results of the on-site operation actions performed by the on-site operators and the analysis results of the on-site operation results displayed by the on-site operated equipment;

[0105] Comparing the fourth similarity between each on-site operation action key character and the corresponding on-site operation action analysis result, and between each on-site operation result key character and the corresponding on-site operation result analysis result;

[0106] In response to a third similarity being greater than a third threshold and a corresponding fourth similarity being greater than a fourth threshold, it is determined that the on-site operation action and the on-site operation result hit.

[0107] In one embodiment, S3: evaluating the execution effect of the emergency plan of this simulation according to each remote operation instruction and each remote operation result, and each on-site operation action and each on-site operation result, specifically including:

[0108] The first score of each remote operation instruction and each remote operation result is obtained according to the following formula:

[0109]

[0110] Wherein, X1 is the number of hit remote operation instructions, X is the total number of remote operation instructions, Y1 is the number of hit remote operation results, Y is the total number of remote operation results, a is the first weight value, and b is the second weight value;

[0111] The second score of each on-site operation action and each on-site operation result is obtained according to the following formula:

[0112]

[0113] Among them, Z1 is the number of hit on-site operation actions and on-site operation results, and Z is the total number of on-site operation actions and on-site operation results;

[0114] The total score of the emergency plan execution in this exercise is obtained according to the following formula:

[0115] Total execution score = (first score × c + second score × d)

[0116] Among them, c is the third weight value, and d is the fourth weight value.

[0117] In one implementation, evaluating the execution effect of the emergency plan of this simulation in S3 specifically includes:

[0118] A comparison log corresponding to the executor of each action node and the first similarity and the second similarity, or the third similarity and the fourth similarity, is formed.

[0119] In this embodiment, the specific steps of the method also include: Step 3, verification of drill results: The verification of drill results is achieved through two methods, namely, voice recognition and image and text recognition, such as through voice recognition of on-site operations and results orally stated by on-site personnel, and through image recognition of operation instructions and results of the system interface.

[0120] For example, a remote operation has 5 steps. The first step is to log in to the XX device. The second to fourth steps are to input the operation instructions, and the fifth step is to exit. After the command is entered, the network device will return the corresponding result. The platform can obtain the operator's instructions and results by remotely connecting and taking screenshots at regular intervals. Set the image text recognition scoring weight according to the proportion of steps that contain operation instructions in the step content. For example, the instruction operation weight can be set to a, a=0.6, and the remote operation result weight can be set to b, b=0.4. When the system personnel completes the instruction input, the result verification module automatically captures the operation instructions and result images (such as screenshots of the remote connection operation interface), extracts the instructions and results through image text recognition, and compares them with the operation instructions and expected results in the link step content configured when creating the process. Compare the actual operation instructions and results of the image text recognition, calculate the hit rate, and score 0-100 based on the hit rate, such as:

[0121]

[0122] The hit rate calculation is just a simple calculation example. The calculation formula can be designed in a variety of ways. Its essence is to compare the similarity between the actually recognized characters and the preset characters to obtain the accuracy of the remote operation action and whether the execution result meets expectations.

[0123] For the part that is not a command operation, the on-site operations and results orally described by the on-site personnel are converted into text through voice recognition to determine the overlap rate between the operation description and the expected results in the step content, such as on-site operations and results: "I am XXX, I am currently in the XX computer room. As the temperature in the computer room is too high, we are now transporting ice cubes prepared in advance to the computer room to help cool it down. After X minutes, the temperature in the computer room drops below X degrees." Operation description and results: The on-site personnel transported ice cubes to the computer room to cool it down, and it is expected to drop below X degrees. A score of 0-100 is given based on the overlap rate, such as:

[0124]

[0125] Again, this overlap ratio calculation is just a simple calculation example, and the calculation formula can be designed in a variety of ways.

[0126] The weighted sum of the scoring results (hit rate and overlap rate) of the system personnel and the on-site personnel is the comprehensive scoring result of this link. The average value of the score of each link (a link is an action node constructed in step 1) is the evaluation result of the overall exercise. In addition, the comparison results involved in the scoring process are recorded in a log to facilitate the review of this exercise (including the evaluation executor). The comparison log can contain the same characters of the system operation hit instructions, the same results and the on-site operation, the result description and the pre-configured comparison.

[0127] The key to scoring and evaluating the drill results is to distinguish between remote operations and on-site operations, and to obtain accurate actual operation actions and actual operation results based on the characteristics of remote operations and on-site operations, so as to compare them with the required operation actions and expected operation results preset by the system, and to evaluate the effect of the drill. At the same time, the evaluation of the drill effect for different executors (comparison logs) can be obtained, which can be used as a basis for the subsequent formulation of training plans, etc.

[0128] In one embodiment, the method further includes visually displaying the entire simulation process of the emergency plan simulated in this simulation, including:

[0129] Visually display the title and introduction of this emergency plan simulation, and display all nodes in sequence;

[0130] Receive a click instruction for the start node and obtain the corresponding start time;

[0131] According to the judgment conditions in the conditional node, transfer to the next node in turn, and obtain the transfer time of each node;

[0132] In response to the transferred node being an action node, the title of this emergency plan simulation is visually displayed, all nodes are displayed in order, and the title, attributes, executor, operation content, expected results, and remote operation screen or on-site operation screen of the current action node are displayed;

[0133] Until the end node is reached, the title, end words, comparison log of each action node and the total execution score of this emergency plan simulation are displayed visually;

[0134] Receive a click instruction for the end node and obtain the corresponding end time.

[0135] In this embodiment, the method further includes the following specific steps: Step 4: Creating a large screen for viewers: Various information about the drill, including the drill theme, overall process, content of the current drill session, and execution status, need to be presented to the audience in a unified window, which is achieved by creating a large screen for viewers. Figure 4 As shown, the audience screen presents the overall process of the emergency plan simulation based on the emergency plan simulation process constructed in step one through large-screen rendering, highlights the current link through dynamic effects, extracts the configuration information of the current link node and outputs it to the link title, attributes and step content; with the help of the rehearsal interaction system in step two, the system operation interface and on-site pictures are embedded in the large screen, and the system operation and on-site situation of the executor of the current link are displayed in real time. Figure 4 In the emergency plan simulation flow chart, it is the overall execution progress, the link title and attributes and step content are pre-set content, and the system operation interface and on-site pictures are the operations performed by the system personnel and on-site personnel according to the emergency drill tasks received. Figure 4 As shown in the figure, after the current link is executed according to the steps, the operation score and comparison log can be output through the drill result verification module in step 3. Figure 5 As shown, after the entire drill is completed, the final evaluation score is output and the comparison log and link score are presented according to the link. The comparison log will mark the matching hit part or miss part.

[0136] The present embodiment provides a visual intelligent emergency plan deduction method, which provides a unified visual entry for the emergency plan deduction of complex scenarios through the rehearsal process control, operation interaction module, rehearsal display large screen and AI (Artificial Intelligence) automatic verification, and controls the rehearsal process, intelligently verifies the rehearsal results, and ensures that the rehearsal is carried out as expected and the rehearsal effect is improved. With the help of the visual intelligent emergency plan deduction method of this embodiment, the emergency rehearsal effect of complex scenarios can be effectively improved, helping to discover problems in emergency disposal, reducing 90% of emergency operation errors, and doubling the rehearsal efficiency for emergency rehearsal personnel.

[0137] This embodiment includes the following technical advantages: a three-layer architecture of a visual intelligent emergency plan simulation method is proposed: a base, a platform backend, and a drill UI, which involves four main modules, namely, a drill process control, an operation interaction module, a drill display screen, and AI automatic verification; a method for constructing an emergency plan simulation process is proposed, and the overall simulation process is constructed by dragging, connecting, and configuring four nodes: start, action, condition, and end; process design content for four nodes is proposed, including the attributes and data acquisition of each node; a drill interaction method and system design are proposed, including operators, interaction content, connection methods, etc.; a method for verifying drill results is proposed, including two AI recognition methods, a scoring method, log records, etc.; a method for evaluating system personnel operations is proposed, including the calculation of command and result hit rates; a method for evaluating on-site personnel operations is proposed, including the calculation of the overlap rate of operation and result descriptions; a large-screen design from the audience's perspective is proposed, including the layout, content, and association with other modules of the large screen for the drill process and the large screen for evaluating drill results.

[0138] Embodiment 2:

[0139] like Figure 6 As shown, the present disclosure provides an emergency plan simulation device, the device comprising:

[0140] Execution unit 1 is used to execute the emergency plan of this exercise, including:

[0141] In response to executing a certain remote operation action node, the screen of the remote operation is obtained from the remote control system.

[0142] In response to executing a certain on-site operation action node, the voice and picture of the on-site operation are obtained from the on-site monitoring system, and the voice is spoken by the on-site operator;

[0143] The identification unit 2 is connected to the execution unit 1 and is used for:

[0144] Identify the screen of each remote operation to obtain each remote operation instruction and each remote operation result,

[0145] Recognize the voice of each on-site operation to obtain the action and result of each on-site operation.

[0146] Identify the screen of each on-site operation to verify each on-site operation action and each on-site operation result;

[0147] The evaluation unit 3 is connected to the identification unit 2, and is used to evaluate the execution effect of the emergency plan of this simulation according to each remote operation instruction and each remote operation result, as well as each on-site operation action and each on-site operation result.

[0148] In one embodiment, the device further includes a construction unit connected to the execution unit 1, and configured to construct an emergency plan for this simulation, including:

[0149] The node selection unit is used to select a start node, several action nodes, several condition nodes and an end node according to the current deduction task;

[0150] A first setting unit, connected to the node selection unit, is used to set the title and introduction of this emergency plan simulation in the start node;

[0151] The second setting unit is connected to the first setting unit and is used to set the title, attribute, executor, operation content and expected result of each action node, wherein the attribute is remote operation or on-site operation, the executor is the name and contact information of the remote operator or on-site operator, and the operation content and expected result are described in text;

[0152] A third setting unit, connected to the second setting unit, is used to set the end words of this emergency plan deduction in the end node;

[0153] The fourth setting unit is connected to the third setting unit, and is used to connect the above three nodes using conditional nodes, and to set a judgment condition for executing the next node in the conditional nodes.

[0154] In one embodiment, the recognition unit 2 includes a remote screen recognition unit, which is used to recognize the screen of each remote operation to obtain each remote operation instruction and each remote operation result, specifically including:

[0155] A screenshot distinguishing unit, used to distinguish between a first interface screenshot of a remote operator inputting a remote operation instruction to the remote control system and a second interface screenshot of a remote operation result returned by the controlled device after executing the input remote operation instruction, displayed by the remote control system, in each remote operation screen;

[0156] A remote command identification unit connected to the screenshot distinguishing unit, configured to identify key characters of remote operation commands in each first interface screenshot, compare a first similarity between the key characters of the remote operation commands and characters of operation content in a corresponding node, and determine that the remote operation command is a hit in response to the first similarity being greater than a first threshold;

[0157] The remote result recognition unit is connected to the screenshot distinguishing unit, and is used to recognize the remote operation result key characters in each second interface screenshot, compare the second similarity between the remote operation result key characters and the expected result characters in the corresponding node, and determine that the remote operation result is a hit in response to the second similarity being greater than a second threshold.

[0158] In one embodiment, the recognition unit 2 includes a live voice recognition unit, which is used to recognize the voice of each live operation to obtain each live operation action and each live operation result, specifically including:

[0159] The on-site voice recognition unit is used to recognize the voice of each on-site operation to obtain the key characters of the on-site operation action and the key characters of the on-site operation result spoken by the on-site operator;

[0160] The third character comparison unit is connected to the on-site speech recognition unit and is used to compare the third similarity between each on-site operation action key character and the operation content character in the corresponding node, and between each on-site operation result key character and the expected result character in the corresponding node.

[0161] In one embodiment, the recognition unit 2 includes a scene picture recognition unit, which is used to recognize the scene of each scene operation to verify each scene operation action and each scene operation result, specifically including:

[0162] The on-site picture identification unit is used to identify the pictures of each on-site operation to obtain the analysis results of the on-site operation actions performed by the on-site operators and the analysis results of the on-site operation results displayed by the on-site operated equipment;

[0163] The fourth character comparison unit is connected to the scene picture recognition unit and is used to compare the fourth similarity between each on-site operation action key character and the corresponding on-site operation action analysis result, and each on-site operation result key character and the corresponding on-site operation result analysis result;

[0164] The third hit judgment unit is connected to the third comparison character unit and the fourth comparison character unit, and is used to judge that the on-site operation action and the on-site operation result hit in response to a third similarity being greater than a third threshold and a corresponding fourth similarity being greater than a fourth threshold.

[0165] In one embodiment, the evaluation unit 3 specifically includes:

[0166] The first scoring unit is used to obtain a first score for each remote operation instruction and each remote operation result according to the following formula:

[0167]

[0168] Wherein, X1 is the number of hit remote operation instructions, X is the total number of remote operation instructions, Y1 is the number of hit remote operation results, Y is the total number of remote operation results, a is the first weight value, and b is the second weight value;

[0169] The second scoring unit is used to obtain a second score for each on-site operation action and each on-site operation result according to the following formula:

[0170]

[0171] Among them, Z1 is the number of hit on-site operation actions and on-site operation results, and Z is the total number of on-site operation actions and on-site operation results;

[0172] The total scoring unit is connected to the first scoring unit and the second scoring unit, and is used to obtain the total execution score of the emergency plan of this exercise according to the following formula:

[0173] Total execution score = (first score × c + second score × d)

[0174] Among them, c is the third weight value, and d is the fourth weight value.

[0175] In one implementation, the evaluation unit 3 specifically includes:

[0176] The comparison log unit is used to form a comparison log corresponding to the executor of each action node and the first similarity and the second similarity, or the third similarity and the fourth similarity.

[0177] In one embodiment, the device further includes a visualization unit for visually displaying the entire simulation process of the emergency plan simulated in this simulation, including:

[0178] The first display unit is connected to the construction unit and is used to visually display the title and introduction of this emergency plan simulation, as well as to display all nodes in sequence;

[0179] A start unit, connected to the first display unit, for receiving a click instruction on the start node and obtaining a corresponding start time;

[0180] The flow unit is connected to the start unit and is used to sequentially transfer to the next node according to the judgment conditions in the conditional node and obtain the transfer time of each node;

[0181] The second display unit is connected to the execution unit 1, and is used to visually display the title of this emergency plan simulation in response to the transferred node being an action node, and to display all nodes in sequence, as well as the title, attributes, executor, operation content, expected results, and remote operation screen or on-site operation screen of the current action node;

[0182] The third display unit is connected to the evaluation unit and is used to visualize the title, ending words, comparison log of each action node and the total execution score of this emergency plan simulation until the end node is entered;

[0183] The ending unit is connected to the third display unit and is used to receive a click instruction on the ending node and obtain the corresponding ending time.

[0184] Embodiment 3:

[0185] Embodiment 3 of the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the emergency plan simulation method as described in Embodiment 1 is implemented, or the emergency plan simulation device as described in Embodiment 2 is implemented.

[0186] The computer-readable storage medium includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules or other data). Computer-readable storage media include, but are not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable read only memory), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer.

[0187] In addition, the present disclosure may also provide a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor runs the computer program stored in the memory, the processor executes the emergency plan deduction method as described in Example 1. The computer device may be the emergency plan deduction device as described in Example 2.

[0188] The memory is connected to the processor, the memory may be a flash memory or a read-only memory or other memory, and the processor may be a central processing unit or a single-chip microcomputer.

[0189] Embodiments 1-3 of the present disclosure provide an emergency plan simulation method, an emergency plan simulation device, and a computer-readable storage medium. According to the characteristics of the information system, the emergency plan is divided into two major contents: remote operation and on-site operation. The operation screen of the remote operation is identified to obtain the content and results of the remote operation. For the on-site operation, the operation content and results verbally stated by the on-site operator are collected, and the authenticity is judged by monitoring screen recognition, so as to obtain a comprehensive and accurate information system emergency plan simulation result.

[0190] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present disclosure, but the present disclosure is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and substance of the present disclosure, and these modifications and improvements are also considered to be within the scope of protection of the present disclosure.

Claims

1. A method for deducing emergency plans. It is characterized in that The method comprises: The emergency plan for executing this exercise includes: In response to executing a certain remote operation action node, the screen of the remote operation is obtained from the remote control system. In response to executing a certain on-site operation action node, the voice and picture of the on-site operation are obtained from the on-site monitoring system, and the voice is spoken by the on-site operator; Identify the screen of each remote operation to obtain each remote operation instruction and each remote operation result, Recognize the voice of each on-site operation to obtain the action and result of each on-site operation. Identify the screen of each on-site operation to verify each on-site operation action and each on-site operation result; The execution effect of the emergency plan of this exercise was evaluated based on the remote operation instructions and the results of each remote operation, as well as the on-site operation actions and the results of each on-site operation.

2. The method according to claim 1, It is characterized in that The method also includes constructing an emergency plan for the exercise, including: According to this deduction task, select a start node, several action nodes, several condition nodes and an end node; Set the title and introduction of this emergency plan simulation in the start node; In each action node, set the title, attribute, executor, operation content and expected result of the node. The attribute is remote operation or on-site operation, the executor is the name and contact information of the remote operator or on-site operator, and the operation content and expected result are described in text. Set the ending words of this emergency plan simulation in the ending node; Use conditional nodes to connect the three types of nodes above, and set the judgment condition for executing the next node in the conditional node.

3. The method according to claim 2, It is characterized in that Identify the screen of each remote operation to obtain each remote operation instruction and each remote operation result, including: Identify, in each remote operation screen, a first interface screenshot of a remote operator inputting a remote operation command to the remote control system, and a second interface screenshot of a remote operation result returned by the remote control system after the controlled device executes the input remote operation command; Identify key characters of the remote operation instruction in each first interface screenshot, compare the first similarity between the key characters of the remote operation instruction and the operation content characters in the corresponding node, and determine that the remote operation instruction hits in response to the first similarity being greater than a first threshold; Identify the remote operation result key characters in each second interface screenshot, compare the second similarity between the remote operation result key characters and the expected result characters in the corresponding node, and determine that the remote operation result is a hit in response to the second similarity being greater than a second threshold.

4. The method according to claim 3, It is characterized in that Recognize the voice of each on-site operation to obtain each on-site operation action and each on-site operation result, including: Recognize the voice of each on-site operation to obtain the key characters of the on-site operation action and the key characters of the on-site operation result spoken by the on-site operator; The third similarity between each on-site operation action key character and the operation content character in the corresponding node, and between each on-site operation result key character and the expected result character in the corresponding node is compared.

5. The method according to claim 4, It is characterized in that Identify the screens of each on-site operation to verify each on-site operation action and each on-site operation result, including: Identify the screens of each on-site operation to obtain the analysis results of the on-site operation actions performed by the on-site operators and the analysis results of the on-site operation results displayed by the on-site operated equipment; Comparing the fourth similarity between each on-site operation action key character and the corresponding on-site operation action analysis result, and between each on-site operation result key character and the corresponding on-site operation result analysis result; In response to a third similarity being greater than a third threshold and a corresponding fourth similarity being greater than a fourth threshold, it is determined that the on-site operation action and the on-site operation result hit.

6. The method according to claim 5, It is characterized in that Based on the remote operation instructions and results, as well as the on-site operation actions and results, the execution effect of the emergency plan in this exercise was evaluated, including: The first score of each remote operation instruction and each remote operation result is obtained according to the following formula: Wherein, X1 is the number of hit remote operation instructions, X is the total number of remote operation instructions, Y1 is the number of hit remote operation results, Y is the total number of remote operation results, a is the first weight value, and b is the second weight value; The second score of each on-site operation action and each on-site operation result is obtained according to the following formula: Among them, Z1 is the number of hit on-site operation actions and on-site operation results, and Z is the total number of on-site operation actions and on-site operation results; The total score of the emergency plan execution in this exercise is obtained according to the following formula: Total execution score = (first score × c + second score × d) Among them, c is the third weight value, and d is the fourth weight value.

7. The method according to claim 6, It is characterized in that Evaluate the implementation effect of the emergency plan of this exercise, including: A comparison log corresponding to the executor of each action node and the first similarity and the second similarity, or the third similarity and the fourth similarity, is formed.

8. The method according to claim 7, It is characterized in that The method also includes visually displaying the entire simulation process of the emergency plan of this simulation, including: Visually display the title and introduction of this emergency plan simulation, and display all nodes in sequence; Receive a click instruction for the start node and obtain the corresponding start time; According to the judgment conditions in the conditional node, transfer to the next node in turn, and obtain the transfer time of each node; In response to the transferred node being an action node, the title of this emergency plan simulation is visually displayed, all nodes are displayed in order, and the title, attributes, executor, operation content, expected results, and remote operation screen or on-site operation screen of the current action node are displayed; Until the end node is reached, the title, end words, comparison log of each action node and the total execution score of this emergency plan simulation are displayed visually; Receive a click instruction for the end node and obtain the corresponding end time.

9. An emergency plan simulation device, It is characterized in that The device comprises: The execution unit is used to execute the emergency plan of this exercise, including: In response to executing a certain remote operation action node, the screen of the remote operation is obtained from the remote control system. In response to executing a certain on-site operation action node, the voice and picture of the on-site operation are obtained from the on-site monitoring system, and the voice is spoken by the on-site operator; The identification unit is connected to the execution unit and is used for: Identify the screen of each remote operation to obtain each remote operation instruction and each remote operation result, Recognize the voice of each on-site operation to obtain the action and result of each on-site operation. Identify the screen of each on-site operation to verify each on-site operation action and each on-site operation result; The evaluation unit is connected to the identification unit and is used to evaluate the execution effect of the emergency plan of this simulation based on each remote operation instruction and each remote operation result, as well as each on-site operation action and each on-site operation result.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the emergency plan deduction method according to any one of claims 1 to 8 is implemented.