Risk alarm method and device, computer equipment, storage medium and program product

Abstract

The invention relates to a risk alarm method and device, computer equipment, a storage medium and a program product. The method comprises the steps of obtaining behavior image information of an electric power worker and comprehensive operation information of the electric power worker during operation, then performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information, performing semantic analysis on the image analysis information and the comprehensive operation information, and obtaining a semantic analysis result; and finally, comparing the operation behavior description information with the target standard operation behavior information to obtain a comparison result, and generating risk alarm information based on the comparison result, so that automatic supervision on the power operation behavior can be realized. And the risk alarm information is generated based on the behavior image information and the comprehensive operation information, various data information can be fused, and the accuracy of the risk alarm information is improved.

Description

Technical Field

[0001] The present application relates to the field of power safety technology, and in particular to a risk alarm method, device, computer equipment, storage medium and program product. Background Art

[0002] With the rapid development of modern society and the continuous improvement of people's living standards, the demand for electricity is growing, and the safe and stable operation of the power system has become particularly important. In the power system, personal safety is the primary consideration. Since power operations are highly dangerous and complex, involving dangerous factors such as high voltage, high temperature, and high magnetic fields, improper operation or equipment failure can easily cause casualties. Therefore, it is extremely important to identify the dangers that occur in power operations.

[0003] However, the current method of identifying hazards that occur during power operations has the problem of low accuracy. Summary of the invention

[0004] Based on this, it is necessary to provide a risk alarm method, device, computer equipment, storage medium and program product that can improve the accuracy of identifying hazards occurring in power operations in response to the above technical problems.

[0005] In a first aspect, the present application provides a risk alarm method. The method comprises:

[0006] Obtaining behavioral image information of the power operator and comprehensive operation information of the power operator during operation;

[0007] Performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information;

[0008] Performing semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information;

[0009] The operation behavior description information is compared with the target standard operation behavior information to obtain a comparison result, and risk alarm information is generated based on the comparison result.

[0010] In one embodiment, the operation behavior description information is compared with the target standard operation behavior information to obtain a comparison result, including:

[0011] Determine key information in the operation behavior description information; the key information includes at least one of the following: working status information of the power equipment, temperature information, time information, and working status information of the power operator;

[0012] Determine the similarity between the key information and the standard work behavior information stored in the knowledge base;

[0013] The operation behavior description information is compared with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

[0014] In one embodiment, the generating risk warning information based on the comparison result includes:

[0015] When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than a preset matching degree, generating first risk alarm information, and sending the first risk alarm information to the working equipment of the power operator;

[0016] When the comparison result indicates that the degree of match between the operation behavior description information and the target standard operation behavior information is less than a preset degree of match, a second risk alarm message is generated and the second risk alarm message is sent to the working equipment of the power operator and the monitoring equipment of the supervisor.

[0017] In one embodiment, the step of obtaining behavioral image information of electric power workers includes:

[0018] At preset time intervals, behavioral image information of the power operator is obtained from an image acquisition device disposed in the environment where the power operator is located.

[0019] In one embodiment, performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information includes:

[0020] The behavior image information is used as the input of an image recognition model to obtain the image analysis information output by the image recognition model; the image recognition model is obtained by training a convolutional neural network model based on historical behavior image data.

[0021] In one embodiment, the image analysis information and the comprehensive operation information are semantically analyzed to obtain operation behavior description information, including:

[0022] The image analysis information and the comprehensive operation information are used as inputs of a semantic analysis model to obtain the operation behavior description information output by the semantic analysis model; the semantic analysis model is obtained by training a natural language processing model based on historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information.

[0023] In a second aspect, the present application also provides a risk alarm device. The device comprises:

[0024] An acquisition module is used to acquire the behavior image information of the power operator and the comprehensive operation information of the power operator during operation;

[0025] An image analysis module, used to perform image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information;

[0026] A semantic analysis module, used for performing semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information;

[0027] The comparison module is used to compare the operation behavior description information with the target standard operation behavior information to obtain a comparison result, and generate risk alarm information based on the comparison result.

[0028] In a third aspect, the present application further provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any of the above methods when executing the computer program.

[0029] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which implements the steps of any of the above methods when executed by a processor.

[0030] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the steps of any of the above methods when executed by a processor.

[0031] The above-mentioned risk alarm method, device, computer equipment, storage medium and program product obtain the behavioral image information of the power operator and the comprehensive operation information of the power operator during operation, and then perform image analysis on the behavioral image information to obtain image analysis information corresponding to the behavioral image information, perform semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information, and finally compare the operation behavior description information with the target standard operation behavior information to obtain a comparison result, and generate risk alarm information based on the comparison result, so as to realize automated supervision of power operation behavior, and jointly generate risk alarm information based on the behavioral image information and the comprehensive operation information, and can also integrate multiple data information to improve the accuracy of risk alarm information. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 is an internal structure diagram of a computer device provided in an embodiment of the present application;

[0033] Figure 2 It is a flowchart of a risk alarm method provided in an embodiment of the present application;

[0034] Figure 3 It is a flowchart of a method for determining a comparison result provided in an embodiment of the present application;

[0035] Figure 4It is a flowchart of a method for generating risk alarm information provided by an embodiment of the present application;

[0036] Figure 5 It is a flowchart of a comprehensive personal risk alarm method provided in an embodiment of the present application;

[0037] Figure 6 It is a structural block diagram of a risk alarm device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0039] With the rapid development of modern society and the continuous improvement of people's living standards, the demand for electricity is growing, and the safe and stable operation of the power system has become particularly important. In the power system, personal safety is the primary consideration. Since power operations are highly dangerous and complex, involving dangerous factors such as high voltage, high temperature, and high magnetic fields, improper operation or equipment failure can easily cause casualties. Therefore, it is extremely important to identify the dangers that occur in power operations.

[0040] However, the current method of identifying hazards that occur during power operations has the problem of low accuracy.

[0041] The risk alarm method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Figure 1 is an internal structure diagram of a computer device provided in an embodiment of the present application. The computer device may be a server, and its internal structure diagram may be as follows Figure 1 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a risk alarm method is implemented.

[0042] Those skilled in the art will understand that Figure 1The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0043] In one embodiment, Figure 2 As shown, Figure 2 is a flow chart of a risk alarm method provided in an embodiment of the present application, which can be applied to Figure 1 The computer device comprises the following steps:

[0044] S201, obtaining behavior image information of power workers and comprehensive operation information of power workers during operation.

[0045] Optionally, an image acquisition device can be set up in the working environment of the power workers. The image acquisition device collects behavioral image information of the power workers once at a preset time interval and sends the collected behavioral image information to a computer device used to execute the risk alarm method.

[0046] Alternatively, an image acquisition device set in the working environment where the power operator is located can collect behavioral image information of the power operator and store the collected behavioral image information. The computer device executing the risk alarm method can send an image acquisition request to the image acquisition device once every preset time interval. After receiving the image acquisition request, the image acquisition device sends the most recently collected behavioral image information to the computer device used to execute the risk alarm method.

[0047] For example, the comprehensive operation information of the power operator during operation may include the power operator's mobile phone number, weather information, operation type information, the number of operators, operation shift information, operation time information, etc.

[0048] In a possible implementation, a risk alarm device may be constructed, which includes an acquisition module and a data storage module. The acquisition module is used to acquire behavioral image information of power workers and comprehensive operation information of power workers during operation. After the acquisition module acquires the behavioral image information and comprehensive operation information, the acquired behavioral image information and comprehensive operation information may be stored in the data storage module.

[0049] S202: Perform image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information.

[0050] On the basis of the above embodiment, the risk alarm device also includes an image analysis module, which can obtain behavioral image information from the data storage module and then perform image analysis on the behavioral image information to obtain image analysis information corresponding to the behavioral image information.

[0051] Optionally, the behavior image information can be used as an input to an image recognition model to obtain image analysis information output by the image recognition model. The image recognition model is obtained by training a convolutional neural network model based on historical behavior image data.

[0052] The convolutional neural network model includes, for example, any one of the LeNet model, the AlexNet model, and the ResNet model.

[0053] Exemplarily, performing image analysis on the behavioral image information to obtain image analysis information corresponding to the behavioral image information may include, for example: analyzing the working time of the power workers according to the behavioral image information of the power workers at different times; analyzing the working start time of the power workers according to the behavioral image information of the power workers at different times; analyzing the wearable devices and working tools of the power workers according to the behavioral image information of the power workers at different times; analyzing the fatigue of the power workers according to the behavioral image information of the power workers at different times; analyzing the size of the on-site working space of the power workers according to the behavioral image information of the power workers at different times, etc.

[0054] S203, performing semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information.

[0055] Based on the above embodiment, the risk alarm device also includes a semantic analysis module, which can obtain comprehensive operation information from the data storage module and image analysis information from the image analysis module, and then perform semantic analysis on the image analysis information and comprehensive operation information to obtain operation behavior description information.

[0056] Optionally, the image analysis information and the comprehensive operation information can be used as inputs of a semantic analysis model to obtain operation behavior description information output by the semantic analysis model. The semantic analysis model is obtained by training a natural language processing model based on historical image analysis information and comprehensive operation information corresponding to the historical image analysis information.

[0057] In the embodiment of the present application, the operation behavior description information includes a text description of the image analysis information and the comprehensive operation information. For example, power operator A worked continuously for three hours in an environment with a temperature of 36°C.

[0058] S204, comparing the operation behavior description information with the target standard operation behavior information to obtain a comparison result, and generating risk alarm information based on the comparison result.

[0059] Optionally, the target standard operation behavior information may be any one of the standard operation behavior information stored in the knowledge base.

[0060] In one embodiment, the similarities between the operation behavior description information and the plurality of standard operation behavior information stored in the knowledge base may be determined respectively, and at least one standard operation behavior information with the highest similarity is used as the target standard operation behavior information.

[0061] Optionally, the standard operating behavior information stored in the knowledge base may be, but is not limited to, operating specifications, safety regulations, standard fault handling procedures, etc. of various power equipment.

[0062] In a possible implementation, the operation behavior description information is compared with the target standard operation behavior information to obtain a comparison result. The risk alarm information generated based on the comparison result can be achieved in the following manner:

[0063] The operation behavior description information is compared with the target standard operation behavior information. If the comparison result is that the operation behavior description information is consistent with the target standard operation behavior information, it means that there is no abnormality in the operation behavior description information; if the comparison result is that the operation behavior description information is inconsistent with the target standard operation behavior information, it means that there is an abnormality in the operation behavior description information, and then a risk alarm information is generated.

[0064] For example, if the target standard operating behavior information is "before maintenance work, the circuit breaker should be in the open state", and the operating behavior description information is "the circuit breaker is in the unopened state", then the operating behavior description information does not match the target standard operating behavior information, and there is an abnormality in the operating behavior description information, so a risk alarm message "Warning: Circuit breaker XX is not in the open state, please operate the open circuit immediately and perform safety confirmation" is generated.

[0065] In an embodiment of the present application, by obtaining behavioral image information of power workers and comprehensive work information of power workers during their operations, image analysis is then performed on the behavioral image information to obtain image analysis information corresponding to the behavioral image information, semantic analysis is performed on the image analysis information and the comprehensive work information to obtain work behavior description information, and finally the work behavior description information is compared with the target standard work behavior information to obtain a comparison result, and risk alarm information is generated based on the comparison result, thereby enabling automated supervision of power operation behaviors, and risk alarm information is jointly generated based on the behavioral image information and the comprehensive work information, and a variety of data information can be integrated to improve the accuracy of risk alarm information.

[0066] Reference Figure 3 , Figure 3 1 is a flow chart of a comparison result determination method provided in an embodiment of the present application. This embodiment involves a possible implementation method of how to compare the operation behavior description information with the target standard operation behavior information to obtain the comparison result. Based on the above embodiment, the above S204 includes the following steps:

[0067] S301, determining key information in the job behavior description information.

[0068] Among them, the key information includes at least one of the following: the name of the power equipment, the working status information of the power equipment, temperature information, time information, and the working status information of the power operator.

[0069] Optionally, keywords in the job behavior description information can be extracted based on the TF-IDF (Term Frequency-Inverse Document Frequency) algorithm, and the extracted keywords can be used as key information in the job behavior description information. Alternatively, a number of job behavior description information containing key information annotations can be used as a training set, a classification model can be trained based on the training set, and then the key information in the job behavior description information can be determined through the trained classification model.

[0070] Exemplarily, if the operation behavior description information is "the circuit breaker is in an unopened state", which includes the name of the power equipment "circuit breaker" and the working status information of the power equipment "unopened", then the key information in the operation behavior description information "the circuit breaker is in an unopened state" includes "circuit breaker" and "unopened".

[0071] S302, determining the similarity between the key information and the standard operation behavior information stored in the knowledge base.

[0072] In one embodiment, the similarities between the key information in the job behavior description information and the plurality of standard job behavior information stored in the knowledge base may be determined respectively.

[0073] S303: Compare the operation behavior description information with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

[0074] Optionally, at least one standard operation behavior information with the highest similarity can be used as the target standard operation behavior information, and then the operation behavior description information can be compared with the target standard operation behavior information. If the comparison result is that the operation behavior description information is consistent with the target standard operation behavior information, then it means that there is no abnormality in the operation behavior description information; if the comparison result is that the operation behavior description information is inconsistent with the target standard operation behavior information, then it means that there is an abnormality in the operation behavior description information, and then risk alarm information is generated.

[0075] In the embodiment of the present application, the key information in the operation behavior description information is determined, the similarity between the key information and the standard operation behavior information stored in the knowledge base is determined, and the operation behavior description information is compared with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result. In the embodiment of the present application, at least one target standard operation behavior information that is most relevant to the operation behavior description information in the standard operation behavior information can be determined based on the key information in the operation behavior description information, and then the comparison result is determined for the operation behavior description information and the target standard operation behavior information, which improves the pertinence of determining the comparison result and reduces the amount of data in the comparison process, thereby saving computing resources and increasing computing speed, and can also reduce the interference of irrelevant information in the knowledge base and improve the accuracy of the comparison result.

[0076] Reference Figure 4 , Figure 4 1 is a flow chart of a method for generating risk alarm information provided by an embodiment of the present application. This embodiment involves a possible implementation method of how to generate risk alarm information based on the comparison result. Based on the above embodiment, the above S204 further includes the following steps:

[0077] S401, when the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than the preset matching degree, a first risk alarm information is generated and the first risk alarm information is sent to the working equipment of the power operation personnel.

[0078] In a possible implementation, the operation behavior description information can be compared with the target standard operation behavior information, and the matching degree between the operation behavior description information and the target standard operation behavior information can be determined. If the matching degree between the operation behavior description information and the target standard operation behavior information is not less than the preset matching degree, it means that the risk level of the operation behavior description information is low, so the first risk alarm information is generated, and the first risk alarm information is sent to the working equipment of the power operator, so as to indicate that the current operation of the power operator is abnormal through the first risk alarm information.

[0079] S402, when the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, a second risk alarm information is generated, and the second risk alarm information is sent to the working equipment of the power operation personnel and the monitoring equipment of the supervisor.

[0080] In a possible implementation, the operation behavior description information can be compared with the target standard operation behavior information, and the matching degree between the operation behavior description information and the target standard operation behavior information can be determined. If the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, it means that the risk level of the operation behavior description information is high, so the second risk alarm information is generated, and the second risk alarm information is sent to the working equipment of the power operator, so as to indicate to the power operator and the supervisor that the current operation has a greater risk through the second risk alarm information.

[0081] In the embodiment of the present application, when the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than the preset matching degree, the first risk alarm information is generated and sent to the work equipment of the power operator. When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, the second risk alarm information is generated and sent to the work equipment of the power operator and the monitoring equipment of the supervisor. When the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, that is, when there is a greater risk in the current operation, in addition to sending the risk alarm information to the power operator, it is also necessary to send it to the supervisor. The supervisor can take emergency measures based on the second risk alarm information, thereby further reducing the probability of danger.

[0082] Based on the above embodiment, the above acquisition of behavior image information of power workers can be achieved through the following steps:

[0083] At preset time intervals, behavioral image information of the power operator is obtained from an image acquisition device disposed in the environment where the power operator is located.

[0084] Optionally, an image acquisition device can be set in the working environment where the power operator is located, and the image acquisition device can collect behavioral image information of the power operator and store the collected behavioral image information. The computer device that executes the risk alarm method can send an image acquisition request to the image acquisition device once every preset time interval. After receiving the image acquisition request, the image acquisition device sends the behavioral image information collected in the most recent preset time to the computer device used to execute the risk alarm method.

[0085] In the embodiment of the present application, the behavior image information of the power workers is obtained from the image acquisition device set in the environment where the power workers are located at each preset time interval, so that the behavior image information can be analyzed regularly to timely discover potential safety hazards and abnormal operation behaviors, thereby improving the safety of the power system. In addition, the regular acquisition of the behavior image information of the power workers realizes the automated analysis and processing of the image information, thereby improving the working efficiency and accuracy of the power system.

[0086] Based on the above embodiment, the above S202 can be implemented in the following manner:

[0087] The behavioral image information is used as the input of the image recognition model to obtain the image analysis information output by the image recognition model.

[0088] Among them, the image recognition model is obtained by training the convolutional neural network model based on historical behavior image data.

[0089] Exemplarily, the historical behavior image information and the standard image analysis information corresponding to the historical behavior image information can be used as a training set for the convolutional neural network model, and then the convolutional neural network model is trained based on the training set. The parameters of the convolutional neural network model are continuously optimized based on the gradient descent algorithm with the goal of minimizing the loss function to improve the accuracy of image analysis. Finally, the convolutional neural network model with optimized parameters is used as an image recognition model.

[0090] In an embodiment of the present application, behavioral image information is used as the input of an image recognition model to obtain image analysis information output by the image recognition model. Image analysis is performed based on a pre-trained image recognition model, thereby improving the accuracy of image analysis and further improving the accuracy of risk alarm information generated based on the image analysis information.

[0091] Based on the above embodiment, the above S203 can be implemented in the following manner:

[0092] The image analysis information and the comprehensive operation information are used as the input of the semantic analysis model to obtain the operation behavior description information output by the semantic analysis model.

[0093] Among them, the semantic analysis model is obtained by training the natural language processing model based on the historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information.

[0094] Exemplarily, the historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information can be used as a training set for the natural language processing model. The natural language processing model is then trained based on the training set. The parameters of the natural language processing model are continuously optimized based on the gradient descent algorithm with the goal of minimizing the loss function to improve the accuracy of semantic analysis. Finally, the natural language processing model with optimized parameters is used as a semantic analysis model.

[0095] In an embodiment of the present application, image analysis information and comprehensive operation information are used as inputs of a semantic analysis model to obtain operation behavior description information output by the semantic analysis model. Semantic analysis is performed based on a pre-trained semantic analysis model, thereby improving the accuracy of the semantic analysis and further improving the accuracy of the risk alarm information generated based on the operation behavior description information.

[0096] Reference Figure 5 , Figure 5 : is a flowchart of a comprehensive personal risk alarm method provided by an embodiment of the present application. The method comprises the following steps:

[0097] S501, acquiring behavior image information of power workers from an image acquisition device disposed in the environment where the power workers are located at intervals of a preset time.

[0098] S502, using the behavior image information as input of an image recognition model to obtain image analysis information output by the image recognition model.

[0099] S503, obtaining comprehensive operation information of the power operation personnel during operation.

[0100] S504, using the image analysis information and the comprehensive operation information as inputs of the semantic analysis model to obtain the operation behavior description information output by the semantic analysis model.

[0101] S505, determining the similarity between the key information and the standard operation behavior information stored in the knowledge base.

[0102] S506: Compare the operation behavior description information with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

[0103] S507, when the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than the preset matching degree, a first risk alarm information is generated and the first risk alarm information is sent to the working equipment of the power operation personnel.

[0104] S508, when the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, a second risk alarm information is generated, and the second risk alarm information is sent to the working equipment of the power operation personnel and the monitoring equipment of the supervisor.

[0105] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0106] Based on the same inventive concept, the embodiment of the present application also provides a risk alarm device for implementing the risk alarm method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more risk alarm device embodiments provided below can refer to the limitations on the risk alarm method above, and will not be repeated here.

[0107] In one embodiment, Figure 6 As shown, Figure 6 600 is a structural block diagram of a risk alarm device provided in an embodiment of the present application. The device 600 includes:

[0108] The acquisition module 601 is used to acquire the behavior image information of the power operation personnel and the comprehensive operation information of the power operation personnel during operation.

[0109] The image analysis module 602 is used to perform image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information.

[0110] The semantic analysis module 603 is used to perform semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information.

[0111] The comparison module 604 is used to compare the operation behavior description information with the target standard operation behavior information to obtain a comparison result, and generate risk alarm information based on the comparison result.

[0112] In one embodiment, the comparison module 604 includes:

[0113] The first determination unit is used to determine key information in the operation behavior description information; the key information includes at least one of the following: working status information of the power equipment, temperature information, time information, and working status information of the power operation personnel.

[0114] The second determining unit is used to determine the similarity between the key information and the standard operation behavior information stored in the knowledge base.

[0115] The comparison unit is used to compare the operation behavior description information with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

[0116] In one embodiment, the comparison module 604 further includes:

[0117] The first generating unit is used to generate first risk alarm information when the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than a preset matching degree, and send the first risk alarm information to the working equipment of the power operation personnel.

[0118] The second generating unit is used to generate second risk alarm information when the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is less than a preset matching degree, and send the second risk alarm information to the working equipment of the power operation personnel and the monitoring equipment of the supervisor.

[0119] In one embodiment, the acquisition module 601 includes:

[0120] The acquisition unit is used to acquire the behavior image information of the power operator from the image acquisition device set in the environment where the power operator is located at each preset time interval.

[0121] In one embodiment, the image analysis module 602 includes:

[0122] The image analysis unit is used to use the behavior image information as the input of the image recognition model to obtain the image analysis information output by the image recognition model; the image recognition model is obtained by training the convolutional neural network model based on the historical behavior image data.

[0123] In one embodiment, the semantic analysis module 603 includes:

[0124] The semantic analysis unit is used to use the image analysis information and the comprehensive operation information as the input of the semantic analysis model to obtain the operation behavior description information output by the semantic analysis model; the semantic analysis model is obtained by training the natural language processing model based on the historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information.

[0125] Each module in the above risk alarm device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each module.

[0126] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0127] Obtaining behavioral image information of power workers and comprehensive operation information of power workers during operation;

[0128] Performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information;

[0129] Perform semantic analysis on the image analysis information and the comprehensive operation information to obtain the operation behavior description information;

[0130] The operation behavior description information is compared with the target standard operation behavior information to obtain a comparison result, and risk alarm information is generated based on the comparison result.

[0131] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0132] Determine key information in the operation behavior description information; the key information includes at least one of the following: working status information of power equipment, temperature information, time information, and working status information of power operation personnel;

[0133] Determine the similarity between key information and standard work behavior information stored in the knowledge base;

[0134] The operation behavior description information is compared with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

[0135] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0136] When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than the preset matching degree, a first risk alarm information is generated, and the first risk alarm information is sent to the working equipment of the power operation personnel;

[0137] When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, a second risk alarm information is generated and sent to the working equipment of the power operation personnel and the monitoring equipment of the supervisor.

[0138] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0139] At preset time intervals, behavioral image information of the power operator is obtained from an image acquisition device disposed in the environment where the power operator is located.

[0140] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0141] The behavioral image information is used as the input of the image recognition model to obtain the image analysis information output by the image recognition model; the image recognition model is obtained by training the convolutional neural network model based on the historical behavioral image data.

[0142] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0143] The image analysis information and the comprehensive operation information are used as inputs of the semantic analysis model to obtain the operation behavior description information output by the semantic analysis model; the semantic analysis model is obtained by training the natural language processing model based on the historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information.

[0144] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0145] Obtaining behavioral image information of power workers and comprehensive operation information of power workers during operation;

[0146] Performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information;

[0147] Perform semantic analysis on the image analysis information and the comprehensive operation information to obtain the operation behavior description information;

[0148] The operation behavior description information is compared with the target standard operation behavior information to obtain a comparison result, and risk alarm information is generated based on the comparison result.

[0149] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0150] Determine key information in the operation behavior description information; the key information includes at least one of the following: working status information of power equipment, temperature information, time information, and working status information of power operation personnel;

[0151] Determine the similarity between key information and standard work behavior information stored in the knowledge base;

[0152] The operation behavior description information is compared with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

[0153] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0154] When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than the preset matching degree, a first risk alarm information is generated, and the first risk alarm information is sent to the working equipment of the power operation personnel;

[0155] When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, a second risk alarm information is generated and sent to the working equipment of the power operation personnel and the monitoring equipment of the supervisor.

[0156] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0157] At preset time intervals, behavioral image information of the power operator is obtained from an image acquisition device disposed in the environment where the power operator is located.

[0158] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0159] The behavioral image information is used as the input of the image recognition model to obtain the image analysis information output by the image recognition model; the image recognition model is obtained by training the convolutional neural network model based on the historical behavioral image data.

[0160] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0161] The image analysis information and the comprehensive operation information are used as inputs of the semantic analysis model to obtain the operation behavior description information output by the semantic analysis model; the semantic analysis model is obtained by training the natural language processing model based on the historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information.

[0162] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0163] Obtaining behavioral image information of power workers and comprehensive operation information of power workers during operation;

[0164] Performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information;

[0165] Perform semantic analysis on the image analysis information and the comprehensive operation information to obtain the operation behavior description information;

[0166] The operation behavior description information is compared with the target standard operation behavior information to obtain a comparison result, and risk alarm information is generated based on the comparison result.

[0167] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0168] Determine key information in the operation behavior description information; the key information includes at least one of the following: working status information of power equipment, temperature information, time information, and working status information of power operation personnel;

[0169] Determine the similarity between key information and standard work behavior information stored in the knowledge base;

[0170] The operation behavior description information is compared with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

[0171] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0172] When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than the preset matching degree, a first risk alarm information is generated, and the first risk alarm information is sent to the working equipment of the power operation personnel;

[0173] When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is less than the preset matching degree, a second risk alarm information is generated and sent to the working equipment of the power operation personnel and the monitoring equipment of the supervisor.

[0174] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0175] At preset time intervals, behavioral image information of the power operator is obtained from an image acquisition device disposed in the environment where the power operator is located.

[0176] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0177] The behavioral image information is used as the input of the image recognition model to obtain the image analysis information output by the image recognition model; the image recognition model is obtained by training the convolutional neural network model based on the historical behavioral image data.

[0178] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0179] The image analysis information and the comprehensive operation information are used as inputs of the semantic analysis model to obtain the operation behavior description information output by the semantic analysis model; the semantic analysis model is obtained by training the natural language processing model based on the historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information.

[0180] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0181] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0182] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A risk alarm method, characterized in that: The method comprises: Acquiring behavioral image information of power workers and comprehensive operation information of the power workers during operation; Performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information; Performing semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information; The operation behavior description information is compared with the target standard operation behavior information to obtain a comparison result, and risk warning information is generated based on the comparison result.

2. The method according to claim 1, characterized in that The comparing the operation behavior description information with the target standard operation behavior information to obtain a comparison result includes: Determine key information in the operation behavior description information; the key information includes at least one of the following: working status information of power equipment, temperature information, time information, and working status information of power operation personnel; Determining the similarity between the key information and the standard operation behavior information stored in the knowledge base; The operation behavior description information is compared with the target standard operation behavior information corresponding to the highest similarity to obtain a comparison result.

3. The method according to claim 2, characterized in that The generating risk warning information based on the comparison result includes: When the comparison result indicates that the matching degree between the operation behavior description information and the target standard operation behavior information is not less than a preset matching degree, generating first risk alarm information, and sending the first risk alarm information to the working equipment of the power operator; When the comparison result indicates that the degree of match between the operation behavior description information and the target standard operation behavior information is less than a preset degree of match, a second risk alarm information is generated and sent to the working equipment of the power operator and the monitoring equipment of the supervisor.

4. The method according to claim 1, characterized in that The obtaining of behavior image information of electric power workers includes: At intervals of a preset time, behavioral image information of the power operator is obtained from an image acquisition device disposed in the environment where the power operator is located.

5. The method according to any one of claims 1 to 4, characterized in that: The performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information includes: The behavior image information is used as the input of an image recognition model to obtain the image analysis information output by the image recognition model; the image recognition model is obtained by training a convolutional neural network model based on historical behavior image data.

6. The method according to any one of claims 1 to 4, characterized in that: The performing semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information includes: The image analysis information and the comprehensive operation information are used as inputs of a semantic analysis model to obtain the operation behavior description information output by the semantic analysis model; the semantic analysis model is obtained by training a natural language processing model based on historical image analysis information and the comprehensive operation information corresponding to the historical image analysis information.

7. A risk alarm device, characterized in that: The device comprises: An acquisition module, used to acquire behavioral image information of electric power workers and comprehensive operation information of the electric power workers during operation; An image analysis module, used for performing image analysis on the behavior image information to obtain image analysis information corresponding to the behavior image information; A semantic analysis module, used for performing semantic analysis on the image analysis information and the comprehensive operation information to obtain operation behavior description information; The comparison module is used to compare the operation behavior description information with the target standard operation behavior information to obtain a comparison result, and generate risk alarm information based on the comparison result.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images