Substation illegal behavior identification method and device, electronic equipment and storage medium

Abstract

The present disclosure provides a substation violation behavior identification method and device, electronic equipment and storage medium, relates to the power system security technology field, through adopting the composite electromagnetic shielding sensing device to realize the synchronous collection of optical image and infrared thermal imaging data in the strong electromagnetic interference environment, the cross-modal correlation matrix is constructed based on the two types of data to suppress the metal reflection interference and accurately extract the violation behavior characteristics, and after identifying the violation, the audible and visual warning is generated first, and the access control locking instruction is issued through the communication bus, the communication bus state can be monitored in real time, when the communication is abnormal or the instruction confirmation fails, the hardware isolation circuit is directly used to cut off the power supply loop of the access control electromagnetic lock to realize the physical forced rejection, so that the problems that the data collection is distorted due to the strong electromagnetic interference in the prior art, the violation behavior identification is not accurate, and the access control instruction is only issued through the communication bus, the instruction execution fails due to the communication abnormality, and the dangerous area violation behavior cannot be effectively rejected.

Description

Technical Field

[0001] This disclosure relates to the field of power system security technology, and in particular to a method and device for identifying violations in substations, electronic equipment, and storage medium. Background Technology

[0002] Substation security, as a core component of the power industry's safety assurance, is widely used for controlling violations in high-voltage equipment areas. With the development of smart grids, related technologies, through the collaborative operation of optical sensing, edge computing, and network communication, have constructed an intelligent system from data acquisition to remote alarms. Specifically, this system covers the entire process from image acquisition and feature extraction to command issuance, including key aspects such as video monitoring, algorithm recognition, and audible and visual warnings, aiming to improve operational safety.

[0003] However, the related technologies directly use a single visible light sensor and serial soft alarm logic without considering the breakdown effect of strong electromagnetic pulses on CMOS sensors and the optical distortion caused by metal reflection. This may lead to a sharp drop in the image signal-to-noise ratio, causing the algorithm to fail, or physical interception may be delayed due to network latency and communication packet loss, thus failing to achieve hardware-level safety closed-loop rejection when transient violations occur, seriously threatening the safety of power grid operation. Summary of the Invention

[0004] This disclosure provides a method, apparatus, electronic device, and storage medium for identifying violations in substations. Its main purpose is to at least partially address one of the technical problems in related technologies.

[0005] According to a first aspect of this disclosure, a method for identifying violations in substations is provided, comprising:

[0006] Using a composite electromagnetic shielding sensing device, optical image data and infrared thermal imaging data of the target area are simultaneously collected in a strong electromagnetic interference environment. A cross-modal correlation matrix is ​​constructed based on optical image data and infrared thermal imaging data to suppress metal reflection interference and extract features of violations. When a violation is detected, an audible and visual warning signal is generated and a locking command is sent to the access control device via the communication bus. The communication status of the communication bus is monitored in real time. If a communication abnormality or command confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through the hardware isolation circuit to achieve physical forced rejection.

[0007] According to a second aspect of this disclosure, a substation violation identification device is provided, comprising: The acquisition unit is used to simultaneously acquire optical image data and infrared thermal imaging data of the target area in a strong electromagnetic interference environment through a composite electromagnetic shielding sensing device. The building unit is used to construct a cross-modal correlation matrix based on optical image data and infrared thermal imaging data in order to suppress metal reflection interference and extract the characteristics of illegal behavior; The generation unit is used to generate an audible and visual warning signal when a violation is detected and to send a locking command to the access control device via the communication bus. The monitoring unit is used to monitor the communication status of the communication bus in real time. If a communication abnormality or command confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through the hardware isolation circuit to achieve physical forced rejection.

[0008] According to a third aspect of this disclosure, an electronic device is provided, comprising: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect above.

[0009] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions, wherein the computer instructions are configured to cause the computer to perform the method described in the first aspect above.

[0010] According to a fifth aspect of this disclosure, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the method described in the first aspect above.

[0011] The substation violation identification method, device, electronic equipment, and storage medium disclosed herein achieve simultaneous acquisition of optical images and infrared thermal imaging data under strong electromagnetic interference by employing a composite electromagnetic shielding sensing device. It can also construct a cross-modal correlation matrix based on these two types of data to suppress metal reflection interference and accurately extract violation characteristics. Upon identification of a violation, it first generates an audible and visual warning and issues an access control locking command via the communication bus. Simultaneously, it can monitor the communication bus status in real time. In case of communication abnormalities or command confirmation failures, it directly cuts off the power supply circuit of the access control electromagnetic lock through a hardware isolation circuit to achieve physical forced rejection. Therefore, it solves the problems in existing technologies where strong electromagnetic interference causes data acquisition distortion, metal reflection interference leads to inaccurate violation identification, and relying solely on the communication bus to issue access control commands is prone to command execution failure due to communication abnormalities, making it unable to effectively reject violations in dangerous areas. It achieves the technical effect of accurate identification of violations under strong electromagnetic interference, reliable execution of access control commands, and a multi-layered effective rejection of violations in dangerous areas, completely keeping operators out of dangerous areas.

[0012] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0013] The accompanying drawings are provided to better understand this solution and do not constitute a limitation of this disclosure. Wherein: Figure 1 A flowchart illustrating a method for identifying violations in a substation, provided as an embodiment of this disclosure; Figure 2 This is a schematic diagram of the structure of a substation violation identification device provided in an embodiment of the present disclosure; Figure 3 A schematic block diagram of an example electronic device provided for embodiments of this disclosure. Detailed Implementation

[0014] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0015] The following description, with reference to the accompanying drawings, outlines a method and apparatus for identifying violations in substations, an electronic device, and a storage medium according to embodiments of this disclosure.

[0016] Figure 1 This is a flowchart illustrating a method for identifying violations in a substation, as provided in an embodiment of this disclosure.

[0017] like Figure 1 As shown, the method includes the following steps: Step 101: Using a composite electromagnetic shielding sensing device, optical image data and infrared thermal imaging data of the target area are simultaneously acquired under strong electromagnetic interference environment.

[0018] In the embodiments of this disclosure, the composite electromagnetic shielding sensing device, through its own electromagnetic shielding architecture, counteracts the interference of electromagnetic signals on the data acquisition unit in a strong electromagnetic interference environment. It initiates the acquisition process according to a preset synchronous acquisition sequence, simultaneously acquiring dual-modal data of optical and infrared thermal imaging of the target area. This achieves precise matching of optical image data and infrared thermal imaging data in both time and spatial dimensions. The optical image data carries the visual morphological features of the target area, while the infrared thermal imaging data carries the temperature distribution features. The acquired data is transmitted in real time to the subsequent data analysis and processing module as raw input data for cross-modal feature analysis and violation behavior identification. For example, this composite electromagnetic shielding sensing device can integrate an imaging lens with an electromagnetic shielding structure, paired with an optical image acquisition sensor and an infrared thermal imaging sensor. Both sensors initiate acquisition with the same trigger signal, acquiring noise-free optical image raw current data and infrared thermal imaging raw current data in a high-voltage switchgear operating environment with strong electromagnetic interference, ensuring the effectiveness of the acquired data.

[0019] Step 102: Construct a cross-modal correlation matrix based on optical image data and infrared thermal imaging data to suppress metal reflection interference and extract features of violations.

[0020] In the embodiments of this disclosure, optical image data and infrared thermal imaging data, which are synchronously acquired and transmitted in real time in step 101, are received. These two types of modal data are used as core basic data sources. According to preset feature dimensions and spatial location mapping rules, a cross-modal correlation matrix is ​​constructed, with one-to-one correspondence between optical image features and infrared thermal imaging features. This matrix becomes the core data carrier for interference suppression and feature extraction, establishing a quantitative correlation between the two modal data. After completing the construction of the cross-modal correlation matrix, the data analysis and processing module performs cross-modal verification on abnormal visual feature regions in the optical image data based on the correlation mapping relationship of the two modal data in the matrix. By matching the infrared thermal imaging features of the corresponding spatial location, it determines whether the abnormal region is metal reflection interference. Then, based on the correlation parameters of the matrix, image feature correction is performed on the regions determined to be metal reflection interference, achieving targeted suppression of metal reflection interference. After interference suppression is completed, the module continues to extract feature information representing violations in the work scenario from the dual-modal fusion features after interference elimination, based on the cross-modal correlation matrix and combined with preset feature extraction algorithms and violation behavior feature dimension requirements, forming a standardized violation behavior feature set. For example, a spatial correspondence between the brightness features of optical images and the temperature gradient features of infrared thermal imaging can be established based on the cross-modal correlation matrix. If the brightness of a certain area of ​​the optical image is abnormally high, while the temperature gradient of the corresponding infrared area is consistent with the environment, it is determined to be metal reflection interference and the area is subjected to high light suppression processing. Then, typical violation characteristics such as not wearing protective equipment are extracted from the corrected cross-modal features.

[0021] Step 103: When the characteristics of the violation are detected, an audible and visual warning signal is generated and a locking command is sent to the access control device via the communication bus.

[0022] In the embodiments of this disclosure, the data is comprehensively compared with preset violation behavior feature matching rules and identification judgment standards to accurately determine whether there is a violation in the target area. When the judgment result indicates that a violation behavior feature has been identified, the data analysis and processing module simultaneously initiates the generation and issuance process of dual-path instructions, executing the issuance of audible and visual warning and access control locking instructions respectively. The data analysis and processing module first generates an audible and visual warning signal according to preset signal specifications and triggering rules. This signal is transmitted in real time to the matching audible and visual warning execution device, which then implements the audible and visual warning action according to the signal instructions, realizing immediate violation reminders to on-site personnel. At the same time, the data analysis and processing module generates a standardized access control locking instruction. After the instruction is format-encapsulated and verified according to the general transmission protocol of the communication bus, the encapsulated access control locking instruction is sent to the access control device in the corresponding dangerous area through the preset communication bus. After receiving the instruction, the access control device enters the execution preparation stage of access control locking according to the instruction content. For example, when the data analysis and processing module identifies the violation of workers not wearing safety helmets, it immediately generates an audible and visual warning signal that meets the requirements of the industrial site environment and triggers the on-site warning equipment to work. At the same time, the access control command is encapsulated according to the RS485 bus transmission protocol and sent to the access control equipment in the high-voltage work area through the RS485 communication bus, thus completing the standardized transmission and distribution of the command.

[0023] Step 104: Monitor the communication status of the communication bus in real time. If a communication abnormality or instruction confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through the hardware isolation circuit to achieve physical forced rejection.

[0024] In the embodiments of this disclosure, the core monitoring inputs are the transmission status of the communication bus and the instruction feedback data from the access control device. During execution, the data analysis and processing module continuously monitors the communication status of the communication bus, such as link connectivity and data transmission integrity, at a preset monitoring frequency. Simultaneously, it receives feedback data from the access control device regarding issued access control lock instructions and verifies whether valid instruction confirmation feedback has been received. This module has built-in rules for determining communication anomalies and instruction confirmation failures. If communication anomalies such as link interruption or data packet loss are detected on the communication bus, or if instruction confirmation feedback from the access control device is not received within a preset time limit (indicating instruction confirmation failure), the data analysis and processing module immediately sends a hardware trigger control signal to the hardware control module. Upon receiving this signal, the hardware control module drives the integrated hardware isolation circuit to perform a switching action. The hardware isolation circuit directly physically cuts off the power supply circuit of the access control electromagnetic lock. This cutting action does not rely on the transmission link of the communication bus; it directly achieves physical forced rejection of the access control electromagnetic lock from the power supply level, ensuring the effective implementation of the access control lock instruction. For example, the data analysis and processing module monitors the transmission status of the RS485 communication bus in real time. If no confirmation frame is detected from the access control device within a preset time limit, a trigger signal is immediately sent to the hardware isolation circuit. This activates the mainboard optical SSR relay as the execution unit of the hardware isolation circuit, and directly cuts off the drive power of the access control electromagnetic lock through an independent hard wire, thereby achieving physical forced locking of the access control.

[0025] The substation violation identification method disclosed herein utilizes a composite electromagnetic shielding sensing device to simultaneously acquire optical images and infrared thermal imaging data under strong electromagnetic interference. It can also construct a cross-modal correlation matrix based on these two types of data to suppress metal reflection interference and accurately extract violation characteristics. Upon identification of a violation, it first generates an audible and visual warning and issues an access control locking command via the communication bus. Simultaneously, it can monitor the communication bus status in real time. In case of communication anomalies or command confirmation failures, it directly cuts off the power supply circuit of the access control electromagnetic lock via a hardware isolation circuit to achieve physical forced rejection. Therefore, it solves the problems in existing technologies where strong electromagnetic interference causes data acquisition distortion, metal reflection interference leads to inaccurate violation identification, and relying solely on the communication bus to issue access control commands is prone to command execution failure due to communication anomalies, making it unable to effectively reject violations in dangerous areas. This method achieves the technical effect of accurate violation identification under strong electromagnetic interference, reliable execution of access control commands, and a multi-layered effective rejection of violations in dangerous areas, completely keeping operators out of dangerous areas.

[0026] In the embodiments involved in this application, there are various feasible specific implementation methods. To clearly and completely illustrate the technical solutions of this disclosure, the implementation methods listed below are merely exemplary and do not constitute a limitation on the scope of protection of this disclosure. That is, in addition to the implementation methods described below, other implementation methods that can be obtained by those skilled in the art based on the technical content disclosed in this disclosure through reasonable logical analysis, reasoning, or limited experimentation should also be covered within the scope of protection of this disclosure. The following specifically describes some exemplary implementation methods: As a specific embodiment of this disclosure, based on the basic scheme, a composite electromagnetic shielding sensing device is used to simultaneously acquire optical image data and infrared thermal imaging data of the target area under strong electromagnetic interference. This is further defined as follows: driving an optical camera and an infrared sensor to work synchronously under strong electromagnetic interference to acquire optical image data and infrared thermal imaging data of the target area respectively; performing real-time noise detection and filtering on the optical image data and infrared thermal imaging data to output noise-free optical image data and infrared thermal imaging data. The composite electromagnetic shielding sensing device includes a double-layer heterogeneous electromagnetic shielding structure and a transparent conductive film coated on the surface of the optical window and grounded at the same potential.

[0027] Specifically, the main control module of the composite electromagnetic shielding sensing device outputs a synchronous clock trigger signal, simultaneously driving the integrated optical camera and infrared sensor to start data acquisition in the same sequence. Both simultaneously capture images and perform thermal imaging scans of the same target area, independently acquiring raw optical image data and raw infrared thermal imaging data respectively. This composite electromagnetic shielding sensing device is equipped with a double-layer heterogeneous electromagnetic shielding structure, which consists of double-layer shielding cavities made of different electromagnetic shielding materials, providing physical electromagnetic protection for the optical camera, infrared sensor, and internal acquisition circuitry. Furthermore, the surface of the device's optical window is coated with a transparent conductive film, which is equipotentially grounded to effectively absorb and guide electromagnetic radiation signals from environments with strong electromagnetic interference. The device's signal processing unit then performs real-time noise detection on the acquired raw dual-modal data. It identifies electromagnetic noise in the optical image data through pixel grayscale value mutation analysis and identifies interference noise in the infrared thermal imaging data through temperature value discreteness detection. An adaptive filtering algorithm is then used to selectively filter the two types of noisy data, ultimately outputting noise-free optical image data and infrared thermal imaging data. In other alternative implementations, the transparent conductive film can be made of different transparent conductive materials such as ITO and AZO, and the filtering algorithm can be replaced with conventional algorithms in the field such as Gaussian filtering and median filtering, all of which can achieve the same noise reduction effect.

[0028] By using a double-layer heterogeneous electromagnetic shielding structure and a grounded transparent conductive film to block electromagnetic interference at the hardware level, and then combining real-time noise detection and filtering to eliminate noise at the software level, a hardware-software integrated anti-interference acquisition solution is formed. This solution avoids the impact of strong electromagnetic interference on data acquisition from the source, and significantly improves the acquisition accuracy and purity of optical and infrared thermal imaging data.

[0029] As a specific implementation of this disclosure, based on the basic scheme, a cross-modal correlation matrix is ​​constructed based on optical image data and infrared thermal imaging data to suppress metal reflection interference and extract violation behavior features. This is further defined as follows: spatially aligning the photometric distribution features in the optical image data with the temperature gradient distribution features in the infrared thermal imaging data to construct a cross-modal thermal-photometric correlation matrix; detecting the brightness value of the optical image data and the temperature gradient value of the infrared thermal imaging data in the image region; when a region is detected to have an extremely high brightness value but an extremely low temperature gradient value, determining that the region is cold reflection from the device rather than a heat-generating entity; dynamically adjusting the green channel weight in the color space based on the determination result to neutralize white light reflection, and extracting violation behavior features after suppressing reflection interference at the bottom layer.

[0030] Specifically, the module first performs pixel-level spatial alignment processing on the photometric distribution characteristics of the optical image data and the temperature gradient distribution characteristics of the infrared thermal imaging data. Based on a unified pixel coordinate system for the target region, a one-to-one spatial mapping relationship between the two features is established. Using this as the data foundation, a cross-modal thermo-photometric correlation matrix containing both photometric and temperature gradient information is constructed. Each element in the matrix corresponds to the optical brightness value and infrared temperature gradient value at the same spatial location in the target region. The module then traverses the matrix to complete feature detection region by region, setting preset brightness and temperature gradient thresholds. When the optical brightness value of a region exceeds the brightness threshold and the corresponding infrared temperature gradient value is lower than the temperature gradient threshold, the region is directly determined to be a metallic reflective area formed by cold reflection from the device, rather than an actual heat-generating entity. The module then converts the optical image data of this region to a color space and dynamically calculates a weight adjustment coefficient based on the degree of brightness anomaly in the reflective area. This adjusts the green channel weight of the region to neutralize the highlight effect caused by white light reflection. After accurately suppressing reflective interference at the bottom layer, the module extracts the violation behavior feature set from the interference-free cross-modal thermo-photometric correlation matrix. In other alternative implementations, the color space can be HSV, HSL or other conventional types in the art, and the green channel weight adjustment can be achieved by linear or nonlinear algorithms, both of which can achieve the technical effect of suppressing reflection.

[0031] Accurate association of dual features is achieved through pixel-level spatial alignment, and accurate identification of device cold reflection is achieved through dual threshold judgment of brightness and temperature gradient. Combined with dynamic adjustment of the weight of the green channel in the color space, targeted suppression of reflection interference is completed, effectively avoiding interference of reflection areas on feature extraction, and significantly improving the accuracy of feature extraction of violations.

[0032] As a specific implementation of this disclosure, based on the basic scheme, the weight of the green channel in the color space is dynamically adjusted according to the judgment result to neutralize white light reflection. After suppressing reflection interference at the bottom layer, the violation behavior feature is extracted. It is further defined as follows: obtaining the benchmark weight parameter, the reflection sensitivity coefficient parameter, and the modal balance constant parameter as calculation parameters; weighting the brightness value detected in the optical image data, the temperature gradient value detected in the infrared thermal imaging data, and the calculation parameters to obtain the dynamic weight adjustment factor of the green channel; using the dynamic weight adjustment factor of the green channel to adjust the weight of the green channel in the color space, generating a feature map that suppresses metal reflection interference, and judging the operator's head without a safety helmet as a violation behavior feature based on the improved target detection model on the feature map.

[0033] Specifically, the module first retrieves pre-calibrated baseline weight parameters, reflectivity coefficient parameters, and modal balance constant parameters as the core calculation parameters for dynamic adjustment of the green channel weight. These parameters can be pre-configured based on the metallic reflectivity characteristics of the work environment with strong electromagnetic interference. The module extracts the optical image brightness value and the corresponding infrared thermal imaging temperature gradient value of the identified metallic reflective area. These two types of detection values, along with the aforementioned calculation parameters, are substituted into a weighted calculation logic to obtain the dynamic weight adjustment factor for the green channel. This factor is positively correlated with the brightness value of the reflective area and negatively correlated with the temperature gradient value. Subsequently, the module uses this dynamic weight adjustment factor to precisely quantify and adjust the basic weight of the green channel in the reflective area of ​​the color space, suppressing the proportion of green channels in high-brightness pixels to neutralize white light reflection. The adjusted optical features are then fused with infrared features to generate a pure feature map free from metallic reflective interference. Finally, the module inputs this feature map into an improved target detection model, which performs feature detection and matching on the operator's head area. The feature of the operator's head not wearing a safety helmet, as determined by the model, is extracted as the core violation feature. In other alternative implementations, the improved target detection model can be an improved YOLO series, Faster R-CNN, or other models. The weighted calculation logic can also adopt linear or nonlinear operation methods, all of which can achieve the same reflection suppression and feature extraction effects.

[0034] By using a standardized parameter system and weighted calculation, the weight of the green channel is dynamically adjusted quantitatively, replacing the subjective weight adjustment method. Combined with the improved target detection model for accurate detection of clean feature maps, the suppression accuracy of metal reflection is greatly improved, while the confidence and accuracy of identifying violations are also enhanced.

[0035] As a specific implementation of this disclosure, based on the basic solution, when the characteristics of a violation are identified, an audible and visual warning signal is generated and a locking command is sent to the access control device via a communication bus. This is further specified as follows: at the instant the characteristics of the violation are identified, an anti-noise buzzer is triggered to emit a warning sound that penetrates ambient noise, and a high signal-to-noise ratio directional voice broadcasting device is simultaneously activated to play a preset warning message; an access control locking command is sent to the access control device via an industrial communication bus, and the command transmission is completed within a preset response time to achieve the initial rejection of the violator.

[0036] Specifically, after identifying and determining the characteristics of the violation, a hardware trigger signal is generated the instant the determination result is output. This signal is simultaneously transmitted to an anti-noise buzzer and a high signal-to-noise ratio directional voice broadcasting device. Upon receiving the signal, the anti-noise buzzer immediately emits a warning sound at a specific frequency. This frequency is adapted to the complex noise environment of the industrial site and can effectively penetrate environmental noise to provide an auditory warning. The directional voice broadcasting device is simultaneously activated and plays a pre-stored standardized warning message to the target work area, achieving precise voice reminders. Meanwhile, the data analysis and processing module standardizes and encapsulates the access control locking command according to the transmission protocol of the industrial communication bus. The encapsulated command is then directed to the access control device via the industrial communication bus. The command transmission process strictly adheres to a preset millisecond-level response time threshold, ensuring that the complete transmission of the command and reception by the access control device are completed within this threshold, thereby achieving the initial refusal to allow unauthorized personnel to enter the dangerous area. In other alternative implementations, the industrial communication bus can be RS485, Modbus, or other conventional industrial bus types in the field. The warning audio rate of the noise-canceling buzzer and the warning content of the directional voice broadcast can be flexibly configured according to the needs of the work scenario, and both can achieve the same warning and initial rejection effect.

[0037] By triggering an anti-noise buzzer and a high signal-to-noise ratio directional voice broadcasting device to achieve dual auditory warnings, the effective transmission of warning information in complex industrial noise environments is ensured. Combined with the preset response time command transmission of the industrial communication bus, the rapid issuance and execution of access control locking commands are realized, which greatly improves the timeliness of on-site violation warnings and the effectiveness of initial rejection.

[0038] As a specific implementation of this disclosure, based on the basic scheme, the communication status of the communication bus is monitored in real time. If a communication abnormality or command confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through a hardware isolation circuit to achieve physical forced denial. It is further specified that: after the locking command is issued through the communication bus, the return frame status of the communication bus is continuously monitored to determine whether an acknowledgment frame has been received; if the communication bus is detected to be affected by electromagnetic pulse interference, resulting in communication packet loss or failure to receive an acknowledgment frame, it is determined to be a communication abnormality or command confirmation failure; the optocoupler-isolated solid-state relay on the main control board is turned on, and the drive power supply circuit of the access control electromagnetic lock is directly cut off through an independent hard wire to complete the physical forced denial.

[0039] Specifically, after issuing an access control lock command via the industrial communication bus, a continuous monitoring process for the communication bus return frames is immediately initiated. Following the transmission sequence of the communication bus, feedback data on the bus is captured in real time, and the frame structure is parsed to determine whether a command confirmation frame has been received from the access control device. This module has built-in communication anomaly detection logic. If, during monitoring, data packet loss or frame structure corruption is detected due to strong electromagnetic pulse interference on the communication bus, or if a valid confirmation frame is not received within a preset time limit, it is directly determined as a communication anomaly or command confirmation failure. After the determination result is generated, the module immediately sends a conduction signal to the hardware isolation circuit, driving the optocoupler-isolated solid-state relay on the system's main control board to close. Through an industrial hardwire link completely independent of the communication bus, the power supply circuit for the access control electromagnetic lock is directly cut off, achieving physical forced denial of access control at the hardware level. In other optional implementations, the optocoupler-isolated solid-state relay can be replaced with other optocoupler-type isolated relays, and the independent hardwire can be made of flame-retardant and anti-interference industrial cable, all achieving the same physical disconnection effect.

[0040] By continuously monitoring the return frames of the communication bus, the communication status can be accurately determined. Combined with the isolation drive of the optocoupler-isolated solid-state relay and the physical disconnection of the independent hard wire, the impact of electromagnetic interference on the hardware control link is avoided, ensuring the reliability of the power supply circuit disconnection action of the access control electromagnetic lock and realizing the accurate triggering of physical forced denial in communication abnormal scenarios.

[0041] It should be noted that the embodiments of this disclosure may include multiple steps. For ease of description, these steps are numbered, but these numbers are not a limitation on the execution time slots or execution order between the steps; these steps can be implemented in any order, and the embodiments of this disclosure do not limit this.

[0042] Corresponding to the aforementioned method for identifying violations in substations, this disclosure also proposes a device for identifying violations in substations. Since the device embodiments of this disclosure correspond to the method embodiments described above, details not disclosed in the device embodiments can be referred to the method embodiments described above, and will not be repeated here.

[0043] Figure 2 This is a schematic diagram of the structure of a substation violation identification device provided in an embodiment of this disclosure, as shown below. Figure 2 As shown, it includes: The acquisition unit 21 is used to simultaneously acquire optical image data and infrared thermal imaging data of the target area under strong electromagnetic interference environment through a composite electromagnetic shielding sensing device. The construction unit 22 is used to construct a cross-modal correlation matrix based on optical image data and infrared thermal imaging data in order to suppress metal reflection interference and extract the characteristics of illegal behavior. The generation unit 23 is used to generate an audible and visual warning signal and send a locking command to the access control device via the communication bus when the characteristics of the violation are detected. The monitoring unit 24 is used to monitor the communication status of the communication bus in real time. If a communication abnormality or instruction confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through the hardware isolation circuit to achieve physical forced rejection.

[0044] It should be noted that the foregoing explanation of the method embodiments also applies to the apparatus of this embodiment, and the principle is the same, so it is not limited in this embodiment.

[0045] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0046] Figure 3 A schematic block diagram of an example electronic device 300 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0047] like Figure 3As shown, the electronic device 300 includes a computing unit 301, which can perform various appropriate actions and processes based on a computer program stored in ROM (Read-Only Memory) 302 or a computer program loaded from storage unit 308 into RAM (Random Access Memory) 303. The RAM 303 may also store various programs and data required for the operation of the electronic device 300. The computing unit 301, ROM 302, and RAM 303 are interconnected via a bus 304. An I / O (Input / Output) interface 305 is also connected to the bus 304.

[0048] Multiple components in electronic device 300 are connected to I / O interface 305, including: input unit 306, such as keyboard, mouse, etc.; output unit 307, such as various types of displays, speakers, etc.; storage unit 308, such as disk, optical disk, etc.; and communication unit 309, such as network card, modem, wireless transceiver, etc. Communication unit 309 allows electronic device 300 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0049] The computing unit 301 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 301 include, but are not limited to, CPUs (Central Processing Units), GPUs (Graphics Processing Units), various special-purpose AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, DSPs (Digital Signal Processors), and any suitable processor, controller, microcontroller, etc. The computing unit 301 performs the various methods and processes described above, such as the substation violation identification method. For example, in some embodiments, the substation violation identification method can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as storage unit 308. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 300 via ROM 302 and / or communication unit 309. When the computer program is loaded into RAM 303 and executed by the computing unit 301, one or more steps of the methods described above can be performed. Alternatively, in other embodiments, the computing unit 301 may be configured to perform the aforementioned substation violation identification method by any other suitable means (e.g., by means of firmware).

[0050] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application-Specific Standard Products), SOCs (System-on-Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0051] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0052] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, RAM, ROM, EPROM (Electrically Programmable Read-Only Memory) or flash memory, optical fiber, CD-ROM (Compact Disc Read-Only Memory), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0053] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0054] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include LANs (Local Area Networks), WANs (Wide Area Networks), the Internet, and blockchain networks.

[0055] Computer systems can include clients and servers. Clients and servers are generally geographically separated and typically interact via communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. A server can be a cloud server, also known as a cloud computing server or cloud host, a hosting product within the cloud computing service system that addresses the shortcomings of traditional physical hosts and VPS (Virtual Private Server) services, such as high management difficulty and weak business scalability. Servers can also be servers for distributed systems or servers incorporating blockchain technology.

[0056] It's important to note that artificial intelligence (AI) is the study of enabling computers to simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, and planning). It encompasses both hardware and software technologies. AI hardware technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, and big data processing. AI software technologies primarily include computer vision, speech recognition, natural language processing, machine learning / deep learning, big data processing, and knowledge graph technologies.

[0057] The various numerical designations such as "first," "second," etc., used in this disclosure are merely for ease of description and are not intended to limit the scope of the embodiments of this disclosure, nor do they indicate a sequential order.

[0058] At least one of the features described in this disclosure can also be described as one or more, and multiple features can be two, three, four or more, and this disclosure does not impose any limitations. In the embodiments of this disclosure, for a technical feature, the technical features in that technical feature are distinguished by "first", "second", "third", "A", "B", "C" and "D", etc., and there is no sequential order or size order among the technical features described by "first", "second", "third", "A", "B", "C" and "D".

[0059] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0060] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A method for identifying violations in substations, characterized in that, include: Using a composite electromagnetic shielding sensing device, optical image data and infrared thermal imaging data of the target area are simultaneously collected in a strong electromagnetic interference environment. A cross-modal correlation matrix is ​​constructed based on the optical image data and the infrared thermal imaging data to suppress metal reflection interference and extract features of violations. When the characteristics of the violation are detected, an audible and visual warning signal is generated and a locking command is sent to the access control device via the communication bus. The communication status of the communication bus is monitored in real time. If a communication abnormality or command confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through the hardware isolation circuit to achieve physical forced rejection.

2. The method according to claim 1, characterized in that, The composite electromagnetic shielding sensing device includes a double-layer heterogeneous electromagnetic shielding structure and a transparent conductive film plated on the surface of the optical window and grounded at the same potential. The method of simultaneously acquiring optical image data and infrared thermal imaging data of the target area through a composite electromagnetic shielding sensing device under strong electromagnetic interference environment includes: The optical camera and infrared sensor are driven to work synchronously in a strong electromagnetic interference environment to acquire optical image data and infrared thermal imaging data of the target area, respectively. The optical image data and infrared thermal imaging data are subjected to real-time noise detection and filtering to output noise-free optical image data and infrared thermal imaging data.

3. The method according to claim 1, characterized in that, The step of constructing a cross-modal correlation matrix based on the optical image data and the infrared thermal imaging data to suppress metal reflection interference and extract violation behavior features includes: Spatially align the photometric distribution features in the optical image data with the temperature gradient distribution features in the infrared thermal imaging data to construct a cross-modal thermo-photometric correlation matrix. The brightness value of optical image data and the temperature gradient value of infrared thermal imaging data in the detection image area are used. When a certain area is detected to have an extremely high brightness value but an extremely low temperature gradient value, it is determined that the area is cold reflection of the device rather than a heat-generating entity. Based on the judgment results, the weight of the green channel is dynamically adjusted in the color space to neutralize white light reflection, and the characteristics of the violation are extracted after suppressing the reflection interference at the bottom layer.

4. The method according to claim 3, characterized in that, The process involves dynamically adjusting the green channel weight in the color space based on the judgment result to neutralize white light reflection, and extracting violation behavior features after suppressing reflection interference at the bottom layer, including: The baseline weight parameters, reflectivity coefficient parameters, and modal equilibrium constant parameters are obtained as calculation parameters. The dynamic weight adjustment factor of the green channel is obtained by weighting the brightness value detected in the optical image data, the temperature gradient value detected in the infrared thermal imaging data, and the calculation parameters. The weight of the green channel in the color space is adjusted by the dynamic weight adjustment factor of the green channel to generate a feature map that suppresses the interference of metal reflection. Based on the improved target detection model, the feature map is used to determine the feature of the operator's head not having a safety helmet as a violation feature.

5. The method according to claim 1, characterized in that, When the violation is detected, an audible and visual warning signal is generated, and a locking command is sent to the access control device via the communication bus, including: The noise-canceling buzzer is triggered the moment the characteristics of the violation are detected, emitting a warning sound that penetrates the ambient noise, and the high signal-to-noise ratio directional voice broadcasting device is activated simultaneously to play the preset warning message; Access control lock commands are sent to access control devices via industrial communication bus, and the command transmission is completed within a preset response time to achieve initial rejection of unauthorized personnel.

6. The method according to claim 1, characterized in that, The system monitors the communication status of the communication bus in real time. If a communication abnormality or command confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through a hardware isolation circuit to achieve physical forced denial, including: After issuing a lock command via the communication bus, continuously monitor the status of the return frames on the communication bus to determine whether an acknowledgment frame has been received. If electromagnetic pulse interference is detected on the communication bus, resulting in packet loss or failure to receive acknowledgment frames, it is determined to be a communication abnormality or command acknowledgment failure. The optocoupler-isolated solid-state relay on the main control board of the conduction system directly cuts off the power supply circuit of the access control electromagnetic lock through an independent hard wire to achieve physical forced rejection.

7. A substation violation identification device, characterized in that, include: The acquisition unit is used to simultaneously acquire optical image data and infrared thermal imaging data of the target area in a strong electromagnetic interference environment through a composite electromagnetic shielding sensing device. The construction unit is used to construct a cross-modal correlation matrix based on the optical image data and the infrared thermal imaging data, so as to suppress metal reflection interference and extract the characteristics of illegal behavior; The generation unit is used to generate an audible and visual warning signal and send a locking command to the access control device via a communication bus when the violation behavior characteristics are detected. The monitoring unit is used to monitor the communication status of the communication bus in real time. If a communication abnormality or command confirmation failure is detected, the power supply circuit of the access control electromagnetic lock is directly cut off through the hardware isolation circuit to achieve physical forced rejection.

8. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.

9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-6.

10. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method according to any one of claims 1-6.

Images