Electric power field operation safety control device and method
By setting up data acquisition, communication and calculation control modules on the power site, using video recognition algorithms to identify behaviors in the operation video and compare action tags, the problem that the existing technology cannot effectively ensure the safety of power operations is solved, and real-time safety monitoring and early warning of power operations is achieved.
Patent Information
- Application Number
- CN202411936369.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-26
- Publication Date
- 2025-05-02
AI Technical Summary
The existing technology cannot effectively ensure that the behavior of power on-site operators meets safety standards, cannot identify and alert violations in a timely manner, and the behavior recognition technology is not perfect enough.
It provides a power field operation safety control device, including a data acquisition module, a communication module and a calculation control module, and uses a video recognition algorithm to identify the operation video, and issue a safety warning by comparing the recognition results and action tags.
Real-time and accurate identification of the behavior of power field workers, determine whether the operation is compliant and issue safety warnings, ensuring the safety of power field operations.
Smart Images

Figure CN119919876A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of power operation safety, and in particular to a power on-site operation safety management and control device and method. Background Art
[0002] Electricity is a country's energy artery, and its safe and stable operation plays a vital role in the stable development of the country's economy and the continuous and stable power supply of the power grid. The safety awareness and skill levels of power field operators vary greatly, and various problems are prone to occur during the operation process. If they are not discovered, stopped, and corrected in time, serious accidents will occur, thus affecting subsequent production work and the safe and stable operation of the power grid.
[0003] The existing technology of power field operation safety management and control mainly has the following problems: ① Although the conventional safety control measures for power field operations at home and abroad have standardized the operating sequence and behavior of operators to a certain extent, they cannot guarantee whether the behavior of on-site operators truly meets the standards; ② Although the behavior of on-site operators can be manually supervised, its judgment is affected by the subjective factors of the supervisor, and it is impossible to effectively and timely warn of violations; ③ For most behavioral actions, even the same action has different forms of expression. There are many types of actions, and each type has many variants, which brings a lot of trouble to the research on behavior recognition. The current behavior recognition technology still needs to be further improved to meet the needs of actual applications. Summary of the invention
[0004] The purpose of the present invention is to provide a safety management and control device and method for power site operations, which is used to solve the problems that the existing technology cannot ensure that power operations comply with safety standards, cannot effectively and timely issue alarms, and the identification technology is not perfect. It can accurately identify the behavior of power site operators in real time, determine whether the operation is compliant and issue safety warnings, thereby ensuring the safety of power site operations.
[0005] In order to achieve the above-mentioned object, in a first aspect, the present invention provides a power field operation safety control device, including a data acquisition module, a communication module and a calculation control module; the calculation control module is provided with a video recognition algorithm, and the video recognition algorithm includes a convolution layer, a time shift module and a non-local operation operator module; The data acquisition module is used to collect operation videos at the power site; The communication module is used to receive the standard operation behavior specifications sent by the cloud or server, and the calculation control module is used to convert the standard operation behavior specifications into action tags; The computing control module is used to identify the operation video through the video recognition algorithm, and then compare the recognition result with the action label, and issue a safety warning when the comparison result shows that the recognition result and the action label do not match.
[0006] According to a power field operation safety management and control device provided by the present invention, the standard operation behavior specification includes an operation ticket or a work ticket.
[0007] According to a power field operation safety management and control device provided by the present invention, the data acquisition module is a plurality of high-definition cameras arranged at the power field.
[0008] According to a power field operation safety management and control device provided by the present invention, the communication module is a wireless communication module, and the wireless communication module includes a wireless communication chip with a diversity reception function.
[0009] According to the electric power field operation safety management and control device provided by the present invention, the communication module is also used to upload the identification result and the comparison result to the cloud or server.
[0010] According to the present invention, a power field operation safety management and control device further includes a power module, which is used to supply power to the data acquisition module, the communication module and the calculation control module.
[0011] According to a power field operation safety management and control device provided by the present invention, the identification result does not match the action label, including: missed operation, wrong operation and out-of-sequence operation.
[0012] In a second aspect, the present invention further provides a method for safety management and control of electric power field operations, which is applied to the electric power field operation safety management and control device of the first aspect, and the method comprises: The data acquisition module collects operation videos at the power site; The communication module receives standard operating behavior specifications issued by the cloud or server; The calculation control module converts the standard operation behavior specifications into action labels; The computing control module uses a video recognition algorithm to identify the operation video, then compares the recognition result with the action label, and issues a safety warning when the comparison result shows that the recognition result and the action label do not match.
[0013] According to a method for safety management and control of electric power field operations provided by the present invention, a computing control module identifies an operation video through a video recognition algorithm, including: Step S41, performing time modeling through a time shift module, and obtaining global context information through a non-local operation operator module; Step S42, extracting frames from the operation video to obtain multiple pictures; Step S43: extracting picture features from multiple pictures through a convolutional layer to obtain a feature map; Step S44, input the feature map into the time shift module and the non-local operation operator module respectively, extract the time feature and the long-distance feature respectively, fuse the feature map, the time feature and the long-distance feature and then input them into the convolution layer; Step S45, repeat steps S42 to S44 multiple times to obtain the motion trajectory, morphological changes and time continuity in the operation video, and then form a comprehensive description of the operation behavior.
[0014] A method for safety management and control of electric power field operations provided by the present invention also includes: a communication module uploading the identification result and the comparison result to the cloud or server.
[0015] The technical solution of the present invention has at least the following technical effects: The present invention provides a power field operation safety control device and method, which collects power field operation videos through a data acquisition module, receives standard operation behavior specifications issued by the cloud or server through a communication module, converts the standard operation behavior specifications into action tags through a calculation control module, and recognizes the operation video through a video recognition algorithm, and then compares the recognition result with the action tag, and issues a safety warning when the comparison result shows that the recognition result does not match the action tag. The present invention recognizes the behavior of power field operators in real time and accurately, determines whether the operation is compliant, and issues a safety warning, thereby ensuring the safety of power field operations. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0017] In the attached picture: Figure 1 This is a structural block diagram of the power field operation safety control device of the present invention; Figure 2 A schematic diagram of the process of performing time modeling for the time shift module of the present invention; Figure 3 A schematic diagram of the process of the video recognition algorithm of the present invention identifying the operation video; Figure 4 It is a schematic diagram of a specific embodiment of the method for safety management and control of power field operations of the present invention. DETAILED DESCRIPTION
[0018] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0019] Some embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0020] See also Figure 1 , an embodiment of the present invention provides a power field operation safety control device, including a data acquisition module, a communication module and a calculation control module; the calculation control module is provided with a video recognition algorithm, and the video recognition algorithm includes a convolution layer, a temporal shift module (TSM, Temporal Shift Module) and a non-local operation operator module (Non-local); The data acquisition module is used to collect operation videos at the power site; The communication module is used to receive the standard operation behavior specifications sent by the cloud or server, and the calculation control module is used to convert the standard operation behavior specifications into action tags; The computing control module is used to identify the operation video through the video recognition algorithm, and then compare the recognition result with the action label, and issue a safety warning when the comparison result shows that the recognition result and the action label do not match.
[0021] Specifically, as a key component of the entire power site operation safety management and control device, the data acquisition module can be a plurality of high-definition cameras installed at the power site. The installation density of the plurality of high-definition cameras is determined according to the demand to ensure coverage of the entire power site. The module is specifically responsible for comprehensive and accurate data collection of video information during power site operations, and can efficiently capture power site operation behaviors in real time through high-definition video streams captured by high-definition cameras.
[0022] Standard operating behavior specifications may include operation tickets or work tickets. A work ticket is a written order that allows work on electrical equipment and system software, and is also a written basis for implementing technical measures to ensure safety; an operation ticket is a written basis for electrical operations in the power system, including dispatching instruction tickets and substation operation tickets. Work tickets are used during maintenance; operation tickets are used when starting and stopping equipment and switching systems. The identification result does not match the action label, including: missed operations, wrong operations, and operations that are not in sequence.
[0023] The communication module is also used to upload the recognition results and the comparison results to the cloud or server. The communication module can be a wireless communication module, and the wireless communication module includes a wireless communication chip with a diversity reception function. The wireless communication module can receive the output signal of the computing control module and transmit it wirelessly to the cloud and / or server.
[0024] Specifically, the device also includes a storage module and a power module. The storage module can be an SD card for storing an operating system, a development platform, a video recognition algorithm, and supporting software (including hardware drivers and software, etc.). The power management module is used to power each module and can include a power management chip, which converts an external power supply into the power required by the data acquisition module, the computing control module, and the communication module through an adapter, thereby powering them.
[0025] The calculation and control module is responsible for receiving and deeply analyzing all kinds of collected data, and accurately identifying the specific operation behaviors of power field operators through complex reasoning and calculation processes. On this basis, the calculation and control module also undertakes the task of comprehensive monitoring and coordination of the operating status of each module, ensuring that each module can work together efficiently and orderly according to the established logic and process, thereby achieving precise control and optimized management of the operation of the entire device. The working principle of the calculation and control module is as follows: First, time modeling is performed, such as Figure 2 As shown in the figure, the process mainly includes shifting the original image offline and online in sequence, and performing temporal modeling by moving the feature map in the time dimension. Among them, c represents the channel dimension, t represents the time dimension, and h and w represent the spatial resolution. The time shift module achieves powerful temporal modeling capabilities and supports both offline and online video recognition without increasing the amount of additional calculations.
[0026] Then, a non-local operation operator module is introduced, which allows each pixel to interact with other pixels in the image and obtains global context information by calculating the similarity between them. This can effectively capture the long-range dependencies between pixels, thereby improving the performance of image understanding. The non-local operation operator module determines the weights between pixels or regions by calculating the similarity between them, and uses these weights to perform weighted summation on pixels or regions to obtain global context information.
[0027] Secondly, if Figure 3As shown in the figure, the operation video is framed to obtain multiple pictures; the convolution layer is used to extract picture features from the multiple pictures to obtain a feature map; then, the feature map is input into the time transfer module and the non-local operation operator module respectively to extract the time feature and the long-distance feature respectively; finally, the feature map, time feature and long-distance feature information are fused and then enter the next convolution layer; the above steps are repeated many times to obtain the motion trajectory, morphological changes and time continuity in the operation video, and then form a comprehensive description of the operation behavior.
[0028] It should be noted that the time shift module is a video network recognition algorithm with low computational complexity and can efficiently complete human action recognition in videos. The use of the time shift module can not only solve the spatiotemporal feature extraction problem in video-level tasks, but also has a low model training cost. Through the calculation control module, all captured feature information can be deeply integrated and accurately judged efficiently. In this process, the calculation control module will carefully analyze the key features such as motion trajectory, morphological changes and time continuity in the operation video, and then integrate this information to form a comprehensive description of the operation behavior.
[0029] Finally, the description of the operation behavior is compared with the action label. If there is a mismatch, a safety warning is issued. Through careful comparison and analysis, it is possible to accurately identify whether the specific behavior shown in the operation video meets the preset alarm conditions. Once a mismatch is confirmed, that is, the behavior action in the operation video does not match a preset action label, the behavior recognition alarm mechanism will be immediately triggered, and an alarm will be issued in time, thereby achieving rapid response and monitoring of specific operation behaviors.
[0030] Based on the same inventive concept, another embodiment of the present invention provides a method for safety management and control of electric power field operations, which is applied to the electric power field operation safety management and control device of the aforementioned embodiment, and the method includes: Step S1, the data acquisition module collects the operation video of the power site; Step S2: The communication module receives the standard operating behavior specification issued by the cloud or server; Step S3: The calculation control module converts the standard operation behavior specification into an action label; Step S4: The computing control module recognizes the operation video through a video recognition algorithm, and then compares the recognition result with the action label, and issues a safety warning when the comparison result shows that the recognition result does not match the action label.
[0031] Specifically, the computing control module recognizes the operation video through a video recognition algorithm, including: Step S41, performing time modeling through a time shift module, and obtaining global context information through a non-local operation operator module; Step S42, extracting frames from the operation video to obtain multiple pictures; Step S43: extracting picture features from multiple pictures through a convolutional layer to obtain a feature map; Step S44, input the feature map into the time shift module and the non-local operation operator module respectively, extract the time feature and the long-distance feature respectively, fuse the feature map, the time feature and the long-distance feature and then input them into the convolution layer; Step S45, repeat steps S42 to S44 multiple times to obtain the motion trajectory, morphological changes and time continuity in the operation video, and then form a comprehensive description of the operation behavior, that is, the recognition result.
[0032] In some embodiments, the power field operation safety management and control method further includes: Step S5: The communication module uploads the recognition result and the comparison result to the cloud or server, thereby assisting the security control personnel in their control work.
[0033] Figure 4 This is a specific embodiment of the power field operation safety management and control method of the present invention, and the specific process is as follows: On the one hand, the communication module receives the operation ticket and work ticket information sent by the cloud or server, and the calculation and control module converts the operation ticket and work ticket information into action labels that can be recognized by the computer; on the other hand, the data acquisition module collects the operation video of the power site, performs time modeling through the time shift module, introduces the non-local operation operator module to obtain the global context information, and then uses the convolution layer to extract the feature map from the operation video, and uses the time shift module and the non-local operation operator module to extract the time feature information and the long-distance feature information respectively, and enters the convolution layer after fusion to finally obtain the recognition result; then judge whether the recognition result matches the action label. If it is completely matched, the recognition result is uploaded to the cloud or server. If it does not match, such as missing operation, wrong operation or out of sequence operation, a safety warning is issued and the recognition result and comparison result are uploaded to the cloud or server.
[0034] In summary, the present invention provides a device and method for safety control of electric power field operations, which includes a data acquisition module, a communication module and a calculation control module; the calculation control module is provided with a video recognition algorithm, and the video recognition algorithm includes a convolution layer, a time shift module and a non-local operation operator module; the data acquisition module is used to collect the operation video of the electric power field; the communication module is used to receive the standard operation behavior specification issued by the cloud or server, and the calculation control module is used to convert the standard operation behavior specification into an action label; the calculation control module is used to identify the operation video through the video recognition algorithm, and then compare the recognition result with the action label, and issue a safety warning when the comparison result is that the recognition result does not match the action label. The present invention can accurately identify the behavior of electric power field operators in real time, judge whether the operation is compliant, and issue a safety warning, so as to ensure the safety of electric power field operations.
[0035] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the embodiments disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A power field operation safety control device, characterized in that: It includes a data acquisition module, a communication module and a calculation control module; the calculation control module is provided with a video recognition algorithm, and the video recognition algorithm includes a convolution layer, a time shift module and a non-local operation operator module; The data acquisition module is used to collect operation videos at the power site; The communication module is used to receive the standard operation behavior specification issued by the cloud or server, and the calculation control module is used to convert the standard operation behavior specification into an action tag; The computing control module is used to identify the operation video through the video recognition algorithm, and then compare the recognition result with the action label, and issue a safety warning when the comparison result shows that the recognition result does not match the action label.
2. The power field operation safety control device according to claim 1 is characterized in that: The standard operating behavior specifications include operation tickets or work tickets.
3. The power field operation safety control device according to claim 1, characterized in that: The data acquisition module is a plurality of high-definition cameras arranged at the power site.
4. The power field operation safety control device according to claim 1, characterized in that: The communication module is a wireless communication module, and the wireless communication module includes a wireless communication chip with a diversity reception function.
5. The power field operation safety control device according to claim 1, characterized in that: The communication module is also used to upload the recognition result and the comparison result to the cloud or server.
6. The power field operation safety control device according to claim 1, characterized in that: It also includes a power supply module, which is used to supply power to the data acquisition module, the communication module and the calculation control module.
7. The power field operation safety control device according to claim 1, characterized in that: The recognition result does not match the action label, including: missed operation, wrong operation and out-of-sequence operation.
8. A method for safety management and control of power field operations, characterized in that: Applied to the power field operation safety control device according to any one of claims 1 to 7, the method comprises: The data acquisition module collects operation videos at the power site; The communication module receives standard operating behavior specifications issued by the cloud or server; The calculation control module converts the standard operation behavior specification into an action label; The computing control module recognizes the operation video through a video recognition algorithm, and then compares the recognition result with the action label, and issues a safety warning when the comparison result shows that the recognition result does not match the action label.
9. The method for safety management and control of electric power field operations according to claim 8, characterized in that: The computing control module recognizes the operation video through a video recognition algorithm, including: Step S41, performing time modeling through a time shift module, and obtaining global context information through a non-local operation operator module; Step S42, extracting frames from the operation video to obtain multiple pictures; Step S43: extracting picture features from multiple pictures through a convolutional layer to obtain a feature map; Step S44, inputting the feature map into the time shift module and the non-local operation operator module respectively, extracting the time feature and the long-distance feature respectively, fusing the feature map, the time feature and the long-distance feature and then entering the convolution layer; Step S45, repeat steps S42 to S44 multiple times to obtain the motion trajectory, morphological changes and time continuity in the operation video, and then form a comprehensive description of the operation behavior.
10. The method for safety management and control of electric power field operations according to claim 8, characterized in that: Also includes: The communication module uploads the recognition result and the comparison result to the cloud or server.