A power transmission line multi-objective thermal imaging intelligent monitoring method and system

Abstract

The application provides a kind of transmission line multi-purpose thermal imaging intelligent monitoring method and system, comprising: according to real-time environmental parameter, determine the light condition of transmission line channel environment;According to the light condition, adaptively switch and call corresponding visible light camera to carry out video acquisition, to obtain the panoramic visible light image in transmission line channel;Synchronous call thermal imaging camera gathers the thermal radiation image of transmission line channel;Determine the fusion monitoring image with temperature information label;Based on the preset intelligent analysis model, the fusion monitoring image is analyzed cooperatively, to determine the abnormal situation of transmission line channel;If it is determined that the channel is abnormal, a first control instruction is generated;If it is determined that the thermal defect is abnormal, a second control instruction is generated;The category, location, evidence image and associated data of abnormal situation are uploaded to the monitoring center.The application can effectively improve the automation, intelligent level and long-term operation reliability of transmission line monitoring.

Description

Technical Field

[0001] This application relates to the field of online monitoring technology for power facilities, and more specifically, to a multi-view thermal imaging intelligent monitoring method and system for transmission lines. Background Technology

[0002] As the main artery of power transmission, the safe operation of transmission lines directly affects the reliability and stability of the power grid. Transmission lines typically traverse complex geographical environments and are exposed to the elements for extended periods, facing various external threats and internal hazards. External threats mainly include intrusion by construction machinery, hanging foreign objects, and wildfire smoke; internal hazards include defects that can lead to failures, such as overheating of conductor joints, insulator deterioration, and corrosion of hardware.

[0003] Currently, monitoring of power transmission lines mainly relies on manual inspections, fixed-point video surveillance, or single-sensor monitoring. Manual inspections are inefficient, time-consuming, and costly, and it is difficult to achieve real-time monitoring around the clock; fixed-point video surveillance has a limited field of view and blind spots, and conventional visible light cameras are ineffective at night or in inclement weather; while single thermal imaging monitoring can detect heating defects, it cannot identify external intruders and is susceptible to environmental interference that can cause false alarms.

[0004] Existing technologies also include devices that combine visible light and thermal imaging, but these are mostly limited to simple dual-light switching displays or independent parallel analysis, lacking deep data fusion and intelligent collaboration. For different anomaly types, the same early warning and handling procedures are typically used, failing to achieve differentiated and precise responses. Furthermore, existing monitoring devices have high power consumption and insufficient continuous operation capability in field scenarios relying on solar power.

[0005] Therefore, there is an urgent need for a power transmission line monitoring solution that can achieve all-weather, fully automatic, and intelligent monitoring, and accurately identify and differentiate various anomalies. Summary of the Invention

[0006] The present invention aims to overcome the shortcomings of the prior art and provide a multi-view thermal imaging intelligent monitoring method and system for transmission lines. This invention addresses the technical problems in the prior art, such as the single monitoring method, inability to coordinate and integrate multi-source information, difficulty in simultaneously and effectively identifying external intrusions and internal thermal defects, lack of differentiated intelligent response mechanisms for different types of anomalies, resulting in low monitoring efficiency, high false alarm rate, delayed response, and insufficient continuous operation capability in outdoor solar power supply scenarios.

[0007] In a first aspect, the present invention provides a multi-view thermal imaging intelligent monitoring method for transmission lines, the method comprising: Monitor and acquire real-time environmental parameters of the transmission line corridor, and determine the lighting conditions of the transmission line corridor environment based on the real-time environmental parameters; Based on the lighting conditions, the corresponding visible light camera is adaptively switched and invoked to perform video acquisition in order to obtain a panoramic visible light image of the power transmission line channel; Simultaneously, a thermal imaging camera is invoked to acquire thermal radiation images of the power transmission line channel; The panoramic visible light image and the thermal radiation image are spatiotemporally registered and fused to determine a fused monitoring image with temperature information annotations; Based on a preset intelligent analysis model, the fused monitoring images are analyzed collaboratively to determine abnormal conditions of the transmission line channel; the abnormal conditions include channel abnormalities caused by external intruders or external intrusion events, and thermal defect abnormalities caused by overheating or deterioration of line components. If the channel is determined to be abnormal, a first control command is generated to control the PTZ camera to perform wide-area tracking and monitoring of the dynamic target. If a thermal defect is identified as an anomaly, a second control command is generated to control the PTZ camera to locate the defective component and activate optical zoom to obtain detailed feature images. The categories, locations, evidence images, and associated data of the aforementioned anomalies are encapsulated into structured alarm information, encrypted, and then uploaded to the monitoring center via a wireless network.

[0008] Preferably, the real-time environmental parameters include at least light intensity; then, the step of adaptively switching and calling the corresponding visible light camera according to the light conditions includes: When the light intensity is higher than the first preset threshold, the first visible light camera is invoked to collect data, and the image resolution of the first visible light camera is not less than 4608×3456. When the light intensity is lower than the second preset threshold, the second visible light camera is switched and activated to collect data. The second visible light camera is a low-light camera based on a 1 / 1.8-inch starlight-level sensor.

[0009] Preferably, the synchronous invocation of a thermal imaging camera to acquire thermal radiation images of the transmission line channel includes: The thermal imaging camera is used to scan the transmission line channel to obtain infrared radiation data of the conductors, insulators and fittings within the transmission line channel; Based on the infrared radiation data, a thermal radiation image reflecting the surface temperature distribution of circuit components is determined.

[0010] Preferably, the step of collaboratively analyzing the fused monitoring images to determine the abnormal conditions of the transmission line corridor includes: Using the intelligent analysis model, based on the visible light portion of the fused monitoring image, at least one of construction machinery, hanging foreign objects, and smoke / fire can be identified to determine the channel anomaly. The intelligent analysis model identifies hot spots with temperatures exceeding safety thresholds or abnormal temperature rise rates based on the thermal imaging portion of the fused monitoring image. Combined with component location mapping, it determines the thermal defect anomaly and the defective component to which it belongs.

[0011] Preferably, before determining the thermal defect anomaly and executing the second control command, the method further includes: Based on the fused monitoring images, suspected defective components with abnormal temperatures were initially located; The PTZ camera is controlled to acquire high-definition visible light detail images of the suspected defective components, and the high-definition visible light detail images are analyzed to determine whether there are appearance defects such as insulator damage, metal corrosion, or broken wire strands. Based on the temperature information obtained from the analysis of the thermal imaging portion in the fused monitoring image, and the judgment result of the appearance defect obtained from the analysis of the high-definition visible light detail image, the final confirmation conclusion and risk level of the thermal defect anomaly are determined. The second control command is executed based on the final confirmation conclusion; The risk level is used to perform at least one of the following operations: Adjust the second control command to take pictures of the defective components with different risk levels using corresponding variable magnification; Adjust the content of the alarm information to include the risk level as a key field. Adjust the priority of data uploads to the monitoring center, prioritizing the upload of high-risk alarm information.

[0012] Preferably, it further includes: The first control command controls the PTZ camera to rotate horizontally or vertically at a speed of not less than 20° / second, so as to achieve continuous tracking and monitoring of the dynamic target; The second control command controls the PTZ camera to position itself on the defective component and activates an optical zoom function of no less than 20x to acquire a microscopic feature image of the defective component.

[0013] Preferably, the method further includes an energy-saving monitoring strategy: When no anomalies are detected, control each camera to perform periodic inspections according to a preset low-frequency cruise path and maintain a low power consumption state. The high-power tracking, scaling, and data stream uploading operations corresponding to the first or second control command are only initiated after an abnormal situation is identified.

[0014] Secondly, the present invention provides a multi-view thermal imaging intelligent monitoring system for power transmission lines, comprising: The illumination condition determination module is configured to monitor and acquire real-time environmental parameters of the transmission line channel, and determine the illumination conditions of the transmission line channel environment based on the real-time environmental parameters. The panoramic visible light image acquisition module is configured to adaptively switch and call the corresponding visible light camera to perform video acquisition according to the lighting conditions, so as to acquire panoramic visible light images within the power transmission line channel. The thermal radiation image acquisition module is configured to synchronously call a thermal imaging camera to acquire thermal radiation images of the transmission line channel; The fusion monitoring image determination module is configured to perform spatiotemporal registration and fusion of the panoramic visible light image and the thermal radiation image to determine a fusion monitoring image with temperature information annotation; The abnormal situation determination module is configured to perform collaborative analysis on the fused monitoring images based on a preset intelligent analysis model to determine the abnormal situation of the transmission line channel; the abnormal situation includes channel abnormalities caused by external intruders or external intrusion events, and thermal defect abnormalities caused by overheating or deterioration of line components; The first control command generation module is configured to generate a first control command if the channel is determined to be abnormal, and control the PTZ camera to perform wide-area tracking and monitoring of the dynamic target. The second control command generation module is configured to generate a second control command if a thermal defect is determined to be abnormal, and to control the PTZ camera to locate the defective component and start optical zoom to obtain detailed feature images. The upload module is configured to encapsulate the category, location, evidence images, and associated data of the abnormal situation into structured alarm information, and then upload it to the monitoring center via a wireless network after encryption.

[0015] Thirdly, the present invention provides a readable medium including executable instructions, which, when executed by a processor of an electronic device, cause the electronic device to perform any of the methods described in the first aspect.

[0016] Fourthly, the present invention provides an electronic device including a processor and a memory storing execution instructions, wherein when the processor executes the execution instructions stored in the memory, the processor performs the method as described in any of the first aspects.

[0017] This invention provides a multi-view thermal imaging intelligent monitoring method and system for power transmission lines. By combining multi-sensor adaptive collaboration, deep data fusion, and intelligent analysis models, and introducing a differentiated response mechanism based on anomaly type and a risk classification strategy, it achieves accurate identification and low false alarm monitoring of anomalies in power transmission line channels and thermal defects in components. It automatically switches visible light acquisition modes according to illumination conditions, ensuring all-weather monitoring capabilities. It automatically triggers wide-area tracking or fixed-point detailed evidence collection for different anomaly types, achieving intelligent and accurate response. Through secondary verification and risk assessment of thermal defects, it improves the reliability of alarm information and supports tiered handling. Its overall low-power design and energy-saving strategy make it particularly suitable for solar-powered outdoor environments, thereby effectively improving the automation, intelligence, and long-term operational reliability of power transmission line monitoring.

[0018] The further effects of the aforementioned non-conventional preferred method will be explained below in conjunction with specific embodiments. Attached Figure Description

[0019] To more clearly illustrate the embodiments of the present invention or the existing technical solutions, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a schematic diagram of a multi-view thermal imaging intelligent monitoring method for power transmission lines according to an embodiment of the present invention; Figure 2 This is a schematic diagram of another intelligent monitoring method for multi-view thermal imaging of transmission lines provided in an embodiment of the present invention; Figure 3 This is a schematic diagram of the composition of a multi-view thermal imaging intelligent monitoring system for power transmission lines according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0022] As the main artery of power transmission, the safe operation of transmission lines directly affects the reliability and stability of the power grid. Transmission lines typically traverse complex geographical environments and are exposed to the elements for extended periods, facing various external threats and internal hazards. External threats mainly include intrusion by construction machinery, hanging foreign objects, and wildfire smoke; internal hazards include defects that can lead to failures, such as overheating of conductor joints, insulator deterioration, and corrosion of hardware.

[0023] Currently, monitoring of power transmission lines mainly relies on manual inspections, fixed-point video surveillance, or single-sensor monitoring. Manual inspections are inefficient, time-consuming, and costly, and it is difficult to achieve real-time monitoring around the clock; fixed-point video surveillance has a limited field of view and blind spots, and conventional visible light cameras are ineffective at night or in inclement weather; while single thermal imaging monitoring can detect heating defects, it cannot identify external intruders and is susceptible to environmental interference that can cause false alarms.

[0024] Existing technologies also include devices that combine visible light and thermal imaging, but these are mostly limited to simple dual-light switching displays or independent parallel analysis, lacking deep data fusion and intelligent collaboration. For different anomaly types, the same early warning and handling procedures are typically used, failing to achieve differentiated and precise responses. Furthermore, existing monitoring devices have high power consumption and insufficient continuous operation capability in field scenarios relying on solar power.

[0025] Therefore, there is an urgent need for a power transmission line monitoring solution that can achieve all-weather, fully automatic, and intelligent monitoring, and accurately identify and differentiate various anomalies.

[0026] In view of this, the present invention provides a multi-view thermal imaging intelligent monitoring method for power transmission lines. See also... Figure 1 The image shows a specific embodiment of a multi-view thermal imaging intelligent monitoring method for transmission lines provided by the present invention. In this embodiment, the multi-view thermal imaging intelligent monitoring method for transmission lines includes:

[0027] Step 101: Monitor and acquire real-time environmental parameters of the transmission line corridor, and determine the lighting conditions of the transmission line corridor environment based on the real-time environmental parameters; Specifically, in this embodiment, the transmission line corridor refers to a three-dimensional spatial area of ​​a certain width and height defined on both sides of the conductor to ensure the safe operation of overhead transmission lines, according to regulations. Construction work, plant growth, or the presence of structures that may affect line safety are typically prohibited or restricted within this area, which is the target spatial range for monitoring in this invention. Real-time environmental parameters refer to a dataset reflecting the current physical state of the corridor, collected in real time by sensors integrated into the monitoring device (such as light sensors and temperature and humidity sensors). The core parameter is "light intensity." By reading this light intensity data and comparing it with a preset threshold, the current lighting conditions of the corridor (such as "strong light during the day," "weak light at dawn and dusk," or "low light at night") are objectively determined. This determination is the direct basis for triggering subsequent adaptive imaging strategies.

[0028] Step 102: Adaptively switch and call the corresponding visible light camera according to the lighting conditions to acquire video images of the power transmission line channel. Furthermore, this step implements an adaptive strategy for all-weather imaging needs. Adaptive switching refers to the system autonomously deciding and selecting the optimal imaging sensor and parameter configuration based on the lighting conditions determined in step 101. When the lighting conditions are determined to be strong (i.e., the light intensity is higher than a first preset threshold), a first visible light camera optimized for daytime is activated. This camera has a high-resolution image sensor with at least 16 million pixels, capable of outputting color images with a resolution of at least 4608×3456 to capture rich spatial and textural details within the channel. When the lighting conditions are determined to be low (i.e., the light intensity is lower than a second preset threshold), the system automatically switches to a second visible light camera optimized for nighttime. This camera uses a 1 / 1.8-inch starlight-level image sensor with extremely high light sensitivity, capable of outputting clear images with at least 2 million pixels (1920×1080) even in weak ambient light, effectively overcoming night vision challenges. Through this mechanism, the system can continuously acquire "panoramic visible light images" covering the main range of the channel under different lighting conditions, providing a stable and reliable visual data source for subsequent analysis.

[0029] Step 103: Synchronously call the thermal imaging camera to acquire thermal radiation images of the power transmission line channel; Furthermore, in this step, "synchronous invocation" emphasizes aligning the data acquisition cycles of visible light and thermal imaging in time series to ensure temporal consistency between the two data streams, laying the foundation for subsequent fusion processing. Specifically, the system controls a thermal imaging camera to scan the target transmission line channel. This camera, through its infrared focal plane array detector, receives and quantifies the infrared energy radiated from the surfaces of key power equipment within the channel (mainly including conductors, insulator strings, and various clamps, grading rings, and other hardware), forming raw infrared radiation data. Subsequently, based on the principles of radiation thermometry and internal calibration parameters, this radiation data is converted into a two-dimensional matrix reflecting the absolute or relative temperature of the equipment surface and visualized as a thermal radiation image. This image, in pseudo-color or grayscale format, visually displays the temperature distribution of various components within the channel, serving as core data for detecting internal thermal defects.

[0030] Step 104: Perform spatiotemporal registration and fusion of the panoramic visible light image and the thermal radiation image to determine the fused monitoring image with temperature information annotation; Furthermore, "spatiotemporal registration" is a crucial preprocessing step that addresses the spatial and temporal asynchrony of data caused by differences in sensor physical location, viewing angle, resolution, and acquisition timing. By pre-obtaining spatial transformation parameters based on techniques such as checkerboard calibration and feature point matching, and combining them with a unified timestamp, the two images are mapped to the same spatiotemporal coordinate system. "Fusion" refers to the use of pixel-level, feature-level, or decision-level fusion algorithms, based on registration, to organically combine the rich texture, color, and contour information of the visible light image with the precise temperature information of the thermal radiation image. The resulting "fused monitoring image" is a multimodal data carrier; each spatial location or target area not only contains visual features but also is associated with a corresponding temperature value, achieving information complementarity and enhancement.

[0031] Step 105: Based on the preset intelligent analysis model, perform collaborative analysis on the fused monitoring images to determine the abnormal conditions of the transmission line channel; the abnormal conditions include channel abnormalities caused by external intrusions or external intrusion events, and thermal defect abnormalities caused by overheating or deterioration of line components. Furthermore, the intelligent analysis model in this embodiment refers to an artificial intelligence model trained on large-scale labeled data and deployed on edge computing devices, which adopts a dual-branch collaborative architecture to process fused images. The model architecture includes two parallel branches: a visible light analysis branch (based on a deep convolutional neural network, such as YOLO or a variant of Faster R-CNN) is responsible for detecting and identifying targets such as construction machinery, hanging foreign objects, and smoke from the RGB components; the thermal imaging analysis branch is responsible for identifying "hot spots" with temperatures exceeding the threshold or abnormal temperature rise from the temperature matrix. The two branches interact and fuse information at a higher level through network layers (such as feature splicing or attention modules), enabling the model to comprehensively utilize visual and temperature features for integrated reasoning. The sample library used for model training consists of massive historical monitoring data, and each "fused monitoring image" is precisely labeled manually, including the category and location of visible light targets, the location and temperature value of hot spots, and the specific component identification corresponding to the defects.

[0032] Through this collaborative analysis process, the model interprets the input image and outputs structured analysis results to identify anomalies. For example, for channel anomalies: identifying construction machinery intrusion, foreign object hanging, or fire incidents, it determines them as external safety threats; for thermal defect anomalies: identifying abnormal overheating in components such as conductor joints and insulators, and combining this with a pre-set "component location mapping" relationship (a database of digital ledgers and spatial coordinates), it precisely locates the specific "defective component" (such as "XX line XX tower B phase large side conductor splice pipe"), determining it as a potential internal equipment hazard.

[0033] Step 106: If the channel is determined to be abnormal, generate the first control command to control the PTZ camera to perform wide-area tracking and monitoring of the dynamic target; Furthermore, when the intelligent analysis determines that the channel is abnormal, the system immediately enters an emergency response mode for dynamic or large-scale targets. The system automatically generates a "first control command," which is a set of control logic designed for continuous tracking of moving targets. Its main function is to drive the pan-tilt system (PTZ camera) carrying the camera to rotate horizontally or vertically at an angular velocity of no less than 20° / second. The control objective is to keep "dynamic targets" such as intruding construction machinery, floating foreign objects, or spreading smoke and fire continuously and stably in the center area of ​​the monitoring screen, achieving "wide-area tracking and monitoring." This mode focuses on the complete recording of the dynamic development process of the event and the continuous grasp of the macro situation.

[0034] Step 107: If it is determined to be a thermal defect anomaly, a second control command is generated to control the PTZ camera to locate the defective component and start optical zoom to obtain detailed feature images. Furthermore, for thermal defect anomalies, the system initiates a more refined point-to-point evidence collection and enhanced decision-making process. First, based on the defective component location information given in step 105, the system generates a "second control command." This command first guides the pan-tilt unit to precisely align the camera (pan-tilt camera) equipped with a high-magnification optical lens with the "defective component." Subsequently, the optical zoom function is activated, adjusting the focal length to no less than 20x to obtain detailed or microscopic feature images of the component, thereby clearly presenting microscopic morphologies such as cracks on the surface of insulators, corrosion of composite jackets, melting of metal parts, or the state of broken strands in conductors.

[0035] In some cases, before generating the final second control command, the system can execute an enhanced verification and decision-making sub-process: First, based on the fused monitoring images, it initially locates suspected components with abnormal temperatures; then, it controls the PTZ camera to acquire high-definition visible light detail images of the suspected component and analyzes whether there are "appearance defects" such as insulator damage, metal corrosion and burns, or wire strand breakage; then, it comprehensively judges the temperature information (such as overheating and temperature rise curves) provided by thermal imaging analysis and the analysis results of appearance defects, generating a decision output that includes a final confirmation conclusion (e.g., confirmed fault, suspected fault, normal) and a risk level (e.g., high, medium, low). The final second control command will be executed based on this confirmation conclusion. The risk level will be directly used to guide subsequent operations, including: a) adjusting command parameters: using higher optical magnification for high-risk defects to obtain finer microscopic features; b) enriching alarm content: incorporating the risk level as a key field into the alarm information in a structured manner; c) optimizing transmission strategy: giving high-risk alarm information a higher network transmission priority to ensure that it is uploaded to the monitoring center first.

[0036] The hardware foundation upon which this method relies is a highly integrated multi-sensor intelligent monitoring device. At the core of this device is a pan-tilt mechanism capable of continuous 360° horizontal rotation and ±90° vertical rotation. This pan-tilt mechanism integrates multiple imaging units, collectively forming a multi-view system:

[0037] Panoramic Monitoring Unit: This unit comprises two fixed visible light cameras dedicated to acquiring a panoramic view of the passageway. Specifically, it includes:

[0038] The first visible light camera: a camera used to monitor the line passage during the day, with a pixel count of no less than 16 million and a resolution of no less than 4608×3456, responsible for providing high-definition panoramic color images under sufficient lighting conditions.

[0039] The second visible light camera: a line passage camera used for monitoring at night, employing a 1 / 1.8-inch starlight-level sensor with no less than 2 million pixels and a resolution of no less than 1920×1080, responsible for providing usable panoramic images in low-light environments.

[0040] The two systems are automatically switched and activated by the system based on ambient lighting conditions, working together to achieve all-weather panoramic visualization monitoring of the passage.

[0041] Thermal imaging monitoring unit: This refers to the thermal imaging camera in this embodiment, with a resolution of 384×256, a focal length of 13mm, and a temperature measurement range of -20℃ to +120℃. This unit works synchronously with the aforementioned visible light camera, independently acquiring infrared radiation from the power transmission line channel and generating a temperature distribution image (thermal radiation image).

[0042] Tracking and detail capture unit: This refers to the PTZ camera in this embodiment, which has a resolution of at least 2 megapixels and supports optical zoom of at least 20x. This camera is directly mounted on the PTZ mechanism and rotates with the PTZ. Its core function is to execute control commands from the system.

[0043] When the system determines that the channel is abnormal, it receives the first control command and rotates rapidly with the PTZ to perform wide-area tracking and monitoring of the dynamic target.

[0044] When the system determines that there is a thermal defect, it receives a second control command, the gimbal precisely aligns itself with the defective part, and activates its optical zoom function to obtain a detailed feature image.

[0045] The pan-tilt unit (PTZ) serves as the support and motion mechanism; the first and second visible light cameras are fixed to the device for environmentally adaptive panoramic acquisition; the thermal imaging camera is fixed to the device for temperature sensing; and the PTZ camera is mounted on the pan-tilt unit and can flexibly rotate and zoom for active tracking and close-up shots. All these components are integrated into one unit and work collaboratively through a unified control system and intelligent analysis platform to realize the multi-view thermal imaging intelligent monitoring method described in this invention.

[0046] Step 108: Encapsulate the category, location, evidence images, and related data of the abnormal situation into structured alarm information, encrypt it, and upload it to the monitoring center via wireless network.

[0047] Further, this step completes the standardized encapsulation and secure reporting of monitoring information. Evidence images refer to the tracking video stream and detailed feature images acquired in steps 106 and 107. Associated data includes at least the timestamp of the anomaly, the device's own identification code, GPS / BeiDou positioning information, measured temperature data, and assessed risk level. The system encapsulates these discrete information elements into a complete, structured alarm message according to a predefined communication protocol format. To ensure data security during transmission over public wireless networks, the alarm message is encrypted using the device's built-in security encryption chip before transmission. Finally, via 4G / 5G or other wireless networks, using transmission protocols compliant with power industry standards, the encrypted alarm message is reliably uploaded to the remote monitoring center's main station system, thus completing a closed loop from on-site perception, intelligent analysis, decision response to central alarm.

[0048] As can be seen from the above technical solution, the beneficial effects of this embodiment are as follows: First, the mechanism of adaptively switching cameras based on lighting conditions ensures all-weather, high-quality visual monitoring capabilities of power transmission line channels under different weather conditions, eliminating monitoring blind spots; Second, through the synchronous acquisition, spatiotemporal registration, and deep fusion of visible light and thermal imaging data, a multimodal perception foundation with complementary information is constructed, providing reliable data support for subsequent accurate analysis; Furthermore, based on the intelligent analysis model of dual-branch collaboration, the fused images are interpreted in an integrated manner, which can effectively distinguish and accurately identify channel anomalies such as external mechanical intrusion and foreign object suspension, and thermal defects such as overheating and deterioration of internal components, significantly reducing the false alarm and missed alarm rates of single sensor monitoring; On this basis, the system triggers differentiated response strategies for wide-area tracking monitoring and fixed-point variable-magnification evidence collection for dynamic channel anomalies and static thermal defects, respectively, realizing intelligent optimization of monitoring resources and response actions. In particular, through secondary verification and risk classification of thermal defects, the accuracy of alarm information and decision support value are further improved.

[0049] Figure 1 The embodiments shown are merely basic examples of the method of the present invention. Other preferred embodiments of the method can be obtained by making certain optimizations and extensions based on them.

[0050] like Figure 2 The image shows another specific embodiment of the multi-view thermal imaging intelligent monitoring method for transmission lines according to the present invention. This embodiment is a further description based on the foregoing embodiments. In this embodiment, the method includes the following steps:

[0051] Step 201: When no abnormality is detected, control each camera to perform periodic inspections according to the preset low-frequency cruise path and maintain a low power consumption state. Specifically, this embodiment further elaborates on the energy-saving monitoring strategy. This step is the core strategy for achieving energy-saving operation in the method of the previous embodiment. "No anomaly detected" means that after analyzing the continuously acquired fused monitoring images, the intelligent analysis model does not output any judgment results regarding channel anomalies or thermal defects, and the system is in the routine monitoring phase. The preset low-frequency cruise path is one or more sets of pan-tilt-zoom (PTZ) trajectory programs pre-configured within the system. This program defines the camera's rotation sequence, dwell points, and dwell time in the horizontal and vertical directions. Its scanning frequency (e.g., rotating one preset position per minute) is significantly lower than the speed during emergency response, aiming to achieve basic coverage inspection of transmission line channels with lower energy consumption costs. Periodic inspection refers to the system automatically starting the cruise path according to a set time interval (e.g., performing a complete cruise every 30 minutes) to perform a panoramic scan. During this patrol mission, the system simultaneously activates a low-power state, a series of coordinated hardware and software power-saving measures: including but not limited to adjusting the frame rate and resolution of the visible light camera to the lowest level to maintain basic monitoring functions, temporarily disabling the high refresh rate mode of the thermal imaging camera, running the core processor in power-saving mode, significantly reducing the frequency of local data storage and processing, and keeping the 4G communication module in standby or low-speed heartbeat connection state. Through these steps, the system can significantly reduce overall power consumption during most event-free periods, which is crucial for field deployment environments relying on limited energy sources such as solar power and batteries, directly extending the system's sustainable operating time.

[0052] Step 202: Only after an abnormal situation is determined will the high-power tracking, scaling and data stream uploading operations corresponding to the first control command or the second control command be initiated.

[0053] Furthermore, this step describes the intelligent switching mechanism of the system from low-power cruise mode to high-power event response mode. Identifying an anomaly is the sole condition for triggering this mode switch, directly stemming from the deterministic judgment result output by the intelligent analysis model in step 105. Once an anomaly is confirmed, the system immediately exits the low-power state and precisely initiates a set of high-energy-consuming operations matching the anomaly type (channel anomaly or thermal defect anomaly). These operations are strongly correlated with the aforementioned control commands: if it is a channel anomaly, the "high-power tracking" operation corresponding to the "first control command" is executed, i.e., driving the gimbal to rotate rapidly and continuously at a speed of no less than 20° / second to continuously track the dynamic target; during this process, the motor drive and high-speed image processing consume a large amount of power. If it is a thermal defect anomaly, the "high-power zoom" operation corresponding to the "second control command" is executed, i.e., controlling the optical lens to perform high-magnification zoom and focus, while the gimbal performs precise positioning; under this precise operation, the power consumption of the motor and lens servo system surges. Regardless of the type of anomaly, the "data stream upload operation" will be initiated simultaneously. This means the system will activate the high-speed data transmission channel of the 4G / 5G module, continuously uploading event-related real-time video streams, high-definition detailed images, structured alarm information, and other data streams to the monitoring center at a high bitrate. The power consumption of the network communication module in this mode is significantly higher than in standby mode. This step embodies the precise energy management concept of on-demand power supply, strictly concentrating limited high-power resources on handling critical events that require immediate response. This ensures critical monitoring performance while optimizing and balancing the overall system energy consumption.

[0054] As can be seen from the above technical solutions, the beneficial effects of this embodiment are: the present invention combines the energy-saving strategy of low-power cruise and event-triggered high-power operation, ensuring the long-term stable operation of the entire system in the field solar power supply scenario, thereby comprehensively improving the automation and intelligence level of transmission line status monitoring and the efficiency of operation and maintenance management.

[0055] This invention also provides a multi-view thermal imaging intelligent monitoring system for power transmission lines. See also... Figure 3 The image shows a specific embodiment of a multi-view thermal imaging intelligent monitoring system for power transmission lines provided by the present invention. This embodiment of the system is used to execute... Figures 1-2 The physical apparatus of the method. Its technical solution is essentially the same as the embodiments described above, and the corresponding descriptions in the embodiments above also apply to this embodiment. The system includes:

[0056] The illumination condition determination module 301 is configured to monitor and acquire real-time environmental parameters of the transmission line channel, and determine the illumination conditions of the transmission line channel environment based on the real-time environmental parameters. The panoramic visible light image acquisition module 302 is configured to adaptively switch and call the corresponding visible light camera to acquire video according to the lighting conditions in order to obtain panoramic visible light images within the power transmission line channel. The thermal radiation image acquisition module 303 is configured to synchronously call a thermal imaging camera to acquire thermal radiation images of the power transmission line channel; The fusion monitoring image determination module 304 is configured to perform spatiotemporal registration and fusion of panoramic visible light images and thermal radiation images to determine a fusion monitoring image with temperature information annotations. The abnormal situation determination module 305 is configured to perform collaborative analysis on the fused monitoring images based on a preset intelligent analysis model to determine the abnormal situation of the transmission line channel; the abnormal situation includes channel abnormalities caused by external intruders or external intrusion events, and thermal defect abnormalities caused by overheating or deterioration of line components. The first control command generation module 306 is configured to generate a first control command if a channel abnormality is determined, and control the PTZ camera to perform wide-area tracking and monitoring of the dynamic target. The second control command generation module 307 is configured to generate a second control command if a thermal defect is determined to be abnormal, and to control the PTZ camera to locate the defective component and start optical zoom to obtain detailed feature images. The upload module 308 is configured to encapsulate the category, location, evidence images, and related data of the abnormal situation into structured alarm information, which is then encrypted and uploaded to the monitoring center via a wireless network.

[0057] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. At the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and a memory. The memory may include main memory, such as high-speed random-access memory (RAM), or it may also include non-volatile memory, such as at least one disk storage device. Of course, the electronic device may also include other hardware required for other services.

[0058] The processor, network interface, and memory can be interconnected via an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus, etc. Buses can be categorized as address buses, data buses, and other types. For ease of representation, Figure 4 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0059] Memory is used to store instructions for execution. Specifically, instructions for execution are computer programs that can be executed. Memory can include main memory and non-volatile memory, and it provides the processor with execution instructions and data.

[0060] In one possible implementation, the processor reads the corresponding execution instructions from non-volatile memory into main memory and then executes them. Alternatively, it can obtain the corresponding execution instructions from other devices to form a multi-view thermal imaging intelligent monitoring device for power transmission lines at the logical level. The processor executes the execution instructions stored in the memory to implement the multi-view thermal imaging intelligent monitoring method for power transmission lines provided in any embodiment of the present invention.

[0061] The above is as described in the present invention. Figure 3 The method executed by the multi-view thermal imaging intelligent monitoring system for power transmission lines provided in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed through integrated logic circuits in the processor's hardware or through software instructions. The processor can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this invention. The general-purpose processor can be a microprocessor or any conventional processor.

[0062] The steps of the method disclosed in the embodiments of this invention can be directly manifested as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.

[0063] This invention also proposes a readable medium storing execution instructions. When these instructions are executed by a processor of an electronic device, the device can perform a multi-view thermal imaging intelligent monitoring method for transmission lines provided in any embodiment of this invention, specifically for executing, as... Figure 1 , Figure 2 The method shown.

[0064] The electronic devices in the foregoing embodiments may be computers.

[0065] Those skilled in the art will understand that embodiments of the present invention can be provided as methods or computer program products. Therefore, the present invention can be implemented in a completely hardware embodiment, a completely software embodiment, or a combination of software and hardware.

[0066] The various embodiments in this invention are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0067] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0068] The above are merely embodiments of the present invention and are not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of the present invention should be included within the scope of the claims of the present invention.

Claims

1. A multi-view thermal imaging intelligent monitoring method for transmission lines, characterized in that, The method includes: Monitor and acquire real-time environmental parameters of the transmission line corridor, and determine the lighting conditions of the transmission line corridor environment based on the real-time environmental parameters; Based on the lighting conditions, the corresponding visible light camera is adaptively switched and invoked to perform video acquisition in order to obtain a panoramic visible light image of the power transmission line channel; Simultaneously, a thermal imaging camera is invoked to acquire thermal radiation images of the power transmission line channel; The panoramic visible light image and the thermal radiation image are spatiotemporally registered and fused to determine a fused monitoring image with temperature information annotations; Based on a preset intelligent analysis model, the fused monitoring images are analyzed collaboratively to determine abnormal conditions of the transmission line channel; the abnormal conditions include channel abnormalities caused by external intruders or external intrusion events, and thermal defect abnormalities caused by overheating or deterioration of line components. If the channel is determined to be abnormal, a first control command is generated to control the PTZ camera to perform wide-area tracking and monitoring of the dynamic target. If a thermal defect is identified as an anomaly, a second control command is generated to control the PTZ camera to locate the defective component and activate optical zoom to obtain detailed feature images. The categories, locations, evidence images, and associated data of the aforementioned anomalies are encapsulated into structured alarm information, encrypted, and then uploaded to the monitoring center via a wireless network.

2. The method according to claim 1, characterized in that, The real-time environmental parameters include at least light intensity; therefore, the step of adaptively switching and calling the corresponding visible light camera according to the light conditions includes: When the light intensity is higher than the first preset threshold, the first visible light camera is invoked to collect data, and the image resolution of the first visible light camera is not less than 4608×3456. When the light intensity is lower than the second preset threshold, the second visible light camera is switched and activated to collect data. The second visible light camera is a low-light camera based on a 1 / 1.8-inch starlight-level sensor.

3. The method according to claim 1, characterized in that, The synchronous call to a thermal imaging camera to acquire thermal radiation images of the power transmission line channel includes: The thermal imaging camera is used to scan the transmission line channel to obtain infrared radiation data of the conductors, insulators and fittings within the transmission line channel; Based on the infrared radiation data, a thermal radiation image reflecting the surface temperature distribution of circuit components is determined.

4. The method according to claim 1, characterized in that, The collaborative analysis of the fused monitoring images to determine the abnormal conditions of the transmission line corridor includes: Using the intelligent analysis model, based on the visible light portion of the fused monitoring image, at least one of construction machinery, hanging foreign objects, and smoke / fire can be identified to determine the channel anomaly. The intelligent analysis model identifies hot spots with temperatures exceeding safety thresholds or abnormal temperature rise rates based on the thermal imaging portion of the fused monitoring image. Combined with component location mapping, it determines the thermal defect anomaly and the defective component to which it belongs.

5. The method according to claim 4, characterized in that, Before determining the thermal defect anomaly and executing the second control command, the method further includes: Based on the fused monitoring images, suspected defective components with abnormal temperatures were initially located; The PTZ camera is controlled to acquire high-definition visible light detail images of the suspected defective components, and the high-definition visible light detail images are analyzed to determine whether there are appearance defects such as insulator damage, metal corrosion, or broken wire strands. Based on the temperature information obtained from the analysis of the thermal imaging portion in the fused monitoring image, and the judgment result of the appearance defect obtained from the analysis of the high-definition visible light detail image, the final confirmation conclusion and risk level of the thermal defect anomaly are determined. The second control command is executed based on the final confirmation conclusion; The risk level is used to perform at least one of the following operations: Adjust the second control command to take pictures of the defective components with different risk levels using corresponding variable magnification; Adjust the content of the alarm information to include the risk level as a key field. Adjust the priority of data uploads to the monitoring center, prioritizing the upload of high-risk alarm information.

6. The method according to claim 1, characterized in that, Also includes: The first control command controls the PTZ camera to rotate horizontally or vertically at a speed of not less than 20° / second, so as to achieve continuous tracking and monitoring of the dynamic target; The second control command controls the PTZ camera to position itself on the defective component and activates an optical zoom function of no less than 20x to acquire a microscopic feature image of the defective component.

7. The method according to claim 1, characterized in that, The method also includes an energy-saving monitoring strategy: When no anomalies are detected, control each camera to perform periodic inspections according to a preset low-frequency cruise path and maintain a low power consumption state. The high-power tracking, scaling, and data stream uploading operations corresponding to the first or second control command are only initiated after an abnormal situation is identified.

8. A multi-view thermal imaging intelligent monitoring system for power transmission lines, characterized in that, include: The illumination condition determination module is configured to monitor and acquire real-time environmental parameters of the transmission line channel, and determine the illumination conditions of the transmission line channel environment based on the real-time environmental parameters. The panoramic visible light image acquisition module is configured to adaptively switch and call the corresponding visible light camera to perform video acquisition according to the lighting conditions, so as to acquire panoramic visible light images within the power transmission line channel. The thermal radiation image acquisition module is configured to synchronously call a thermal imaging camera to acquire thermal radiation images of the transmission line channel; The fusion monitoring image determination module is configured to perform spatiotemporal registration and fusion of the panoramic visible light image and the thermal radiation image to determine a fusion monitoring image with temperature information annotation; The abnormal situation determination module is configured to perform collaborative analysis on the fused monitoring images based on a preset intelligent analysis model to determine the abnormal situation of the transmission line channel; the abnormal situation includes channel abnormalities caused by external intruders or external intrusion events, and thermal defect abnormalities caused by overheating or deterioration of line components; The first control command generation module is configured to generate a first control command if the channel is determined to be abnormal, and control the PTZ camera to perform wide-area tracking and monitoring of the dynamic target. The second control command generation module is configured to generate a second control command if a thermal defect is determined to be abnormal, and to control the PTZ camera to locate the defective component and start optical zoom to obtain detailed feature images. The upload module is configured to encapsulate the category, location, evidence images, and associated data of the abnormal situation into structured alarm information, and then upload it to the monitoring center via a wireless network after encryption.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method of any one of claims 1 to 7.

10. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the method described in any one of claims 1 to 7.

Images