Heavy machinery detection alarm system in power transmission line
The system addresses the challenge of real-time hazard detection in power transmission lines by using image processing and neural networks to identify heavy machinery, ensuring timely alerts and minimizing damage.
Patent Information
- Application Number
- CN202411321241.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-01-22
- Filing Date
- 2024-09-23
- Publication Date
- 2024-12-13
AI Technical Summary
Existing manual inspections of power transmission lines are inadequate for real-time monitoring and alarming of potential hazards, particularly from heavy machinery, leading to potential damage and instability.
A system comprising a content monitoring device for full-color image acquisition, order mapping devices for image processing, and a BP neural network for identifying heavy machinery, coupled with data transmission to a remote server for real-time alerts and positioning data.
Enables real-time detection and alerting of heavy machinery near power transmission lines, minimizing damage by issuing warnings and transmitting location data to a remote server.
Abstract
Description
Technical Field
[0001] The invention relates to the field of electric power alarm, and in particular to a heavy machinery detection alarm system in a power transmission line. Background Art
[0002] Strengthen the daily maintenance of transmission lines. When inspecting high-voltage transmission lines, line inspectors carefully observe the possible problems of power lines: such as the position of the wires, the tightness of the steel wire clamp bolts, the inspection of the wires, the integrity of the wire insulators, the height of the trees in the line channel, etc. This can also timely discover problems and deal with the problems found in a timely manner to avoid the occurrence of tower collapse, pole collapse and line break accidents.
[0003] However, the distribution area of transmission lines is relatively wide, and manual inspections cannot provide real-time monitoring and real-time alarms for various subdivided dangerous situations in transmission lines across a large area. For example, when construction is carried out in the environment where a certain transmission line is located, if there is heavy machinery directly under the transmission line, it may cause damage to the transmission line, and then damage the transmission line, and finally cause the transmission line to be unable to operate stably.
[0004] Prior art CN116958704A discloses a method, device and equipment for classifying and training a model of a transmission line underlying surface environment. The model training method includes: collecting and annotating transmission line environmental images to obtain a transmission line environmental classification data set; dividing the transmission line environmental classification data set into a transmission line underlying surface environment classification model training set and a test set; constructing a two-dimensional convolutional neural network model with a coupled attention mechanism as an initial transmission line underlying surface environment classification model, and using the training set to train the initial transmission line underlying surface environment classification model; the initial transmission line underlying surface environment classification model includes: a two-dimensional convolutional layer, an activation layer, an attention mechanism layer, a maximum pooling layer and a fully connected layer; evaluating the training results according to the test set to obtain a transmission line underlying surface environment classification model. By constructing a network model with a coupled attention mechanism, the generation of a transmission line underlying surface environment classification model with high recognition accuracy and efficiency is achieved. Summary of the invention
[0005] The applicant proposes a heavy machinery detection and alarm system in a power transmission line in the present invention, the system comprising: Content monitoring device, used for performing full-color picture acquisition of the environment where the power transmission line is located, so as to obtain and output corresponding directional full-color pictures; The order mapping device comprises a real-time filtering device, a sharpening processing device and a cubic interpolation device arranged between the real-time filtering device and the sharpening processing device, wherein the real-time filtering device is connected to the content monitoring device and is used to perform Gaussian high-pass filtering processing on the received directional full-color picture to obtain and output a corresponding real-time filtered image, the cubic interpolation device is used to perform cubic polynomial interpolation processing on the received real-time filtered image to obtain and output a corresponding cubic interpolation image, and the sharpening processing device is used to perform USM filter-based sharpening processing on the received cubic interpolation image to obtain and output a corresponding instant sharpened image; A first acquisition device is connected to the order mapping device, and is used to detect the mean square error of each brightness value corresponding to each pixel point of each image area in the received instant sharpened image, and when the mean square error is less than a set mean square error limit, the image area is judged to be a background image area, otherwise, the image area is judged to be a foreground image area; a second acquisition device, connected to the first acquisition device, for inputting the total number of pixels occupied by the foreground image area and the red-green component values, black-white component values, and yellow-blue component values of each pixel in the foreground image area in the LAB space into the BP neural network that has completed multiple trainings to run the BP neural network that has completed multiple trainings, and obtaining an existence mark indicating whether there is heavy machinery in the foreground image area output by the BP neural network that has completed multiple trainings; a third acquisition device, connected to the second acquisition device, for issuing a heavy machinery non-detection command when no heavy machinery exists in each foreground image area in the instant sharpened image, and for issuing a heavy machinery warning message when heavy machinery exists in a certain foreground image area in the instant sharpened image; A data transmission device, connected to the third acquisition device, for sending the received heavy machinery warning information and the positioning data of the location of the power transmission line to a remote power management server through a wireless communication link; Among them, in the BP neural network after completing multiple trainings, the number of trainings is proportional to the total number of pixels of the instant sharpened image.
[0006] The technical solution proposed in the present invention can, based on targeted visual data analysis, issue a heavy machinery non-detection command when it is determined that no heavy machinery exists in each foreground image area in the instant sharpened image corresponding to the on-site image captured of the transmission line. It is also used to issue a heavy machinery warning message when heavy machinery exists in a certain foreground image area in the instant sharpened image, and send the received heavy machinery warning information together with the positioning data of the location of the transmission line to a remote power management server through a wireless communication link, thereby minimizing the damage caused to the transmission line by heavy machinery. DETAILED DESCRIPTION
[0007] The implementation scheme of the heavy machinery detection and alarm system in the power transmission line of the present invention will be described in detail below.
[0008] Implementation A According to embodiment A of the present invention, a heavy machinery detection and alarm system in a power transmission line is shown, and the system comprises: Content monitoring device, used for performing full-color picture acquisition of the environment where the power transmission line is located, so as to obtain and output corresponding directional full-color pictures; For example, the content monitoring device includes a CCD sensor unit or a CMOS sensor unit, which is used to perform full-color image acquisition of the environment where the power transmission line is located, so as to obtain and output a corresponding directional full-color image; The order mapping device comprises a real-time filtering device, a sharpening processing device and a cubic interpolation device arranged between the real-time filtering device and the sharpening processing device, wherein the real-time filtering device is connected to the content monitoring device and is used to perform Gaussian high-pass filtering processing on the received directional full-color picture to obtain and output a corresponding real-time filtered image, the cubic interpolation device is used to perform cubic polynomial interpolation processing on the received real-time filtered image to obtain and output a corresponding cubic interpolation image, and the sharpening processing device is used to perform USM filter-based sharpening processing on the received cubic interpolation image to obtain and output a corresponding instant sharpened image; A first acquisition device is connected to the order mapping device, and is used to detect the mean square error of each brightness value corresponding to each pixel point of each image area in the received instant sharpened image, and when the mean square error is less than a set mean square error limit, the image area is judged to be a background image area, otherwise, the image area is judged to be a foreground image area; a second acquisition device, connected to the first acquisition device, for inputting the total number of pixels occupied by the foreground image area and the red-green component values, black-white component values, and yellow-blue component values of each pixel in the foreground image area in the LAB space into the BP neural network that has completed multiple trainings to run the BP neural network that has completed multiple trainings, and obtaining an existence mark indicating whether there is heavy machinery in the foreground image area output by the BP neural network that has completed multiple trainings; a third acquisition device, connected to the second acquisition device, for issuing a heavy machinery non-detection command when no heavy machinery exists in each foreground image area in the instant sharpened image, and for issuing a heavy machinery warning message when heavy machinery exists in a certain foreground image area in the instant sharpened image; A data transmission device, connected to the third acquisition device, for sending the received heavy machinery warning information and the positioning data of the location of the power transmission line to a remote power management server through a wireless communication link; Among them, in the BP neural network after completing multiple trainings, the number of trainings is proportional to the total number of pixels of the instant sharpened image; Among them, sending the received heavy machinery warning information and the positioning data of the location of the transmission line to the remote power management server through a wireless communication link includes: entering the received heavy machinery warning information and the positioning data of the location of the transmission line into IP data packet, and then sending the IP data packet to the remote power management server through a wireless communication link.
[0009] Implementation Plan B According to embodiment B of the present invention, a heavy machinery detection and alarm system in a power transmission line is shown, which may include the following components: Content monitoring device, used for performing full-color picture acquisition of the environment where the power transmission line is located, so as to obtain and output corresponding directional full-color pictures; The order mapping device comprises a real-time filtering device, a sharpening processing device and a cubic interpolation device arranged between the real-time filtering device and the sharpening processing device, wherein the real-time filtering device is connected to the content monitoring device and is used to perform Gaussian high-pass filtering processing on the received directional full-color picture to obtain and output a corresponding real-time filtered image, the cubic interpolation device is used to perform cubic polynomial interpolation processing on the received real-time filtered image to obtain and output a corresponding cubic interpolation image, and the sharpening processing device is used to perform USM filter-based sharpening processing on the received cubic interpolation image to obtain and output a corresponding instant sharpened image; A first acquisition device is connected to the order mapping device, and is used to detect the mean square error of each brightness value corresponding to each pixel point of each image area in the received instant sharpened image, and when the mean square error is less than a set mean square error limit, the image area is judged to be a background image area, otherwise, the image area is judged to be a foreground image area; a second acquisition device, connected to the first acquisition device, for inputting the total number of pixels occupied by the foreground image area and the red-green component values, black-white component values, and yellow-blue component values of each pixel in the foreground image area in the LAB space into the BP neural network that has completed multiple trainings to run the BP neural network that has completed multiple trainings, and obtaining an existence mark indicating whether there is heavy machinery in the foreground image area output by the BP neural network that has completed multiple trainings; a third acquisition device, connected to the second acquisition device, for issuing a heavy machinery non-detection command when no heavy machinery exists in each foreground image area in the instant sharpened image, and for issuing a heavy machinery warning message when heavy machinery exists in a certain foreground image area in the instant sharpened image; A data transmission device, connected to the third acquisition device, for sending the received heavy machinery warning information and the positioning data of the location of the power transmission line to a remote power management server through a wireless communication link; an anti-vibration processing mechanism, which is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device; Among them, the anti-vibration processing mechanism is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device, including: the anti-vibration processing mechanism is used to perform anti-vibration processing on the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively.
[0010] Implementation Plan C According to embodiment C of the present invention, a heavy machinery detection and alarm system in a power transmission line is shown, which may include the following components: Content monitoring device, used for performing full-color picture acquisition of the environment where the power transmission line is located, so as to obtain and output corresponding directional full-color pictures; The order mapping device comprises a real-time filtering device, a sharpening processing device and a cubic interpolation device arranged between the real-time filtering device and the sharpening processing device, wherein the real-time filtering device is connected to the content monitoring device and is used to perform Gaussian high-pass filtering processing on the received directional full-color picture to obtain and output a corresponding real-time filtered image, the cubic interpolation device is used to perform cubic polynomial interpolation processing on the received real-time filtered image to obtain and output a corresponding cubic interpolation image, and the sharpening processing device is used to perform USM filter-based sharpening processing on the received cubic interpolation image to obtain and output a corresponding instant sharpened image; A first acquisition device is connected to the order mapping device, and is used to detect the mean square error of each brightness value corresponding to each pixel point of each image area in the received instant sharpened image, and when the mean square error is less than a set mean square error limit, the image area is judged to be a background image area, otherwise, the image area is judged to be a foreground image area; a second acquisition device, connected to the first acquisition device, for inputting the total number of pixels occupied by the foreground image area and the red-green component values, black-white component values, and yellow-blue component values of each pixel in the foreground image area in the LAB space into the BP neural network that has completed multiple trainings to run the BP neural network that has completed multiple trainings, and obtaining an existence mark indicating whether there is heavy machinery in the foreground image area output by the BP neural network that has completed multiple trainings; a third acquisition device, connected to the second acquisition device, for issuing a heavy machinery non-detection command when no heavy machinery exists in each foreground image area in the instant sharpened image, and for issuing a heavy machinery warning message when heavy machinery exists in a certain foreground image area in the instant sharpened image; A data transmission device, connected to the third acquisition device, for sending the received heavy machinery warning information and the positioning data of the location of the power transmission line to a remote power management server through a wireless communication link; a synchronization control mechanism, which is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device; Among them, the synchronization control mechanism is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device, including: the synchronization control mechanism is used to respectively realize the synchronization control operation between the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device.
[0011] Next, the specific structure of the heavy machinery detection and alarm system in the power transmission line of the present invention will be further described.
[0012] In the heavy machinery detection alarm system in the power transmission line according to any embodiment of the present invention: Using a content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device to obtain output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device respectively; Wherein, using the content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively comprises: performing filtering operations on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively; Wherein, using the content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively includes: performing a sharpening operation on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively; Wherein, using the content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively includes: performing an enhancement operation on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively; And wherein, using a content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively includes: performing a point image restoration operation on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively.
[0013] In addition, in the heavy machinery detection and alarm system in the transmission line, the received heavy machinery warning information and the positioning data of the location of the transmission line are entered into IP data, and then the IP data packet is sent to a remote power management server through a wireless communication link, including: the remote power management server is a cloud computing server or a blockchain server to manage multiple transmission lines at the same time.
[0014] The outstanding substantive features of the technical solution of the present invention are: First: detecting the mean square error of each brightness value corresponding to each pixel point of each image area in the received instant sharpened image, and when the mean square error is less than a set mean square error limit, determining that the image area is a background image area, otherwise, determining that the image area is a foreground image area; Second: inputting the total number of pixels occupied by the foreground image area and the red-green component values, black-white component values and yellow-blue component values of each pixel in the foreground image area in the LAB space into the BP neural network that has completed multiple trainings to run the BP neural network that has completed multiple trainings, and obtaining the presence identification indicating whether there is heavy machinery in the foreground image area output by the BP neural network that has completed multiple trainings; Third: when no heavy machinery exists in each foreground image area in the instant sharpened image, a heavy machinery non-detection command is issued, and when heavy machinery exists in a certain foreground image area in the instant sharpened image, a heavy machinery warning message is issued, and the received heavy machinery warning message is sent together with the positioning data of the location of the transmission line to a remote power management server through a wireless communication link, so as to minimize the damage caused by heavy machinery to the transmission line; Fourth: After completing multiple trainings, in the BP neural network, the number of trainings is proportional to the total number of pixels of the instant sharpened image, so as to realize the customized construction of the BP neural network.
[0015] The heavy machinery detection and alarm system in the power transmission line of the present invention can solve the technical problem of the lack of targeted detection mechanism for the safety hazards caused by heavy machinery existing at the power transmission line site in the prior art. Based on targeted visual data analysis, when it is determined that there is no heavy machinery in each foreground image area in the instant sharpened image corresponding to the image collected at the power transmission line site, a heavy machinery non-detection command can be issued. Otherwise, a heavy machinery warning message can be issued, and the received heavy machinery warning message and the positioning data of the location of the transmission line can be sent to a remote power management server through a wireless communication link.
[0016] Although the present invention has been described in detail in conjunction with certain preferred embodiments, it is apparent that many alternatives, modifications and variations are apparent to those skilled in the art considering the above description. Therefore, it is contemplated that the appended claims will include any such alternatives, modifications and variations that fall within the true scope and spirit of the present invention.
Claims
1. A heavy machinery detection and alarm system for power transmission lines, It is characterized in that The system comprises: Content monitoring device, used for performing full-color picture acquisition of the environment where the power transmission line is located, so as to obtain and output corresponding directional full-color pictures; The order mapping device comprises a real-time filtering device, a sharpening processing device and a cubic interpolation device arranged between the real-time filtering device and the sharpening processing device, wherein the real-time filtering device is connected to the content monitoring device and is used to perform Gaussian high-pass filtering processing on the received directional full-color picture to obtain and output a corresponding real-time filtered image, the cubic interpolation device is used to perform cubic polynomial interpolation processing on the received real-time filtered image to obtain and output a corresponding cubic interpolation image, and the sharpening processing device is used to perform USM filter-based sharpening processing on the received cubic interpolation image to obtain and output a corresponding instant sharpened image; A first acquisition device is connected to the order mapping device, and is used to detect the mean square error of each brightness value corresponding to each pixel point of each image area in the received instant sharpened image, and when the mean square error is less than a set mean square error limit, the image area is judged to be a background image area, otherwise, the image area is judged to be a foreground image area; a second acquisition device, connected to the first acquisition device, for inputting the total number of pixels occupied by the foreground image area and the red-green component values, black-white component values, and yellow-blue component values of each pixel in the foreground image area in the LAB space into the BP neural network that has completed multiple trainings to run the BP neural network that has completed multiple trainings, and obtaining an existence mark indicating whether there is heavy machinery in the foreground image area output by the BP neural network that has completed multiple trainings; a third acquisition device, connected to the second acquisition device, for issuing a heavy machinery non-detection command when no heavy machinery exists in each foreground image area in the instant sharpened image, and for issuing a heavy machinery warning message when heavy machinery exists in a certain foreground image area in the instant sharpened image; A data transmission device, connected to the third acquisition device, for sending the received heavy machinery warning information and the positioning data of the location of the power transmission line to a remote power management server through a wireless communication link; Among them, in the BP neural network after completing multiple trainings, the number of trainings is proportional to the total number of pixels of the instant sharpened image.
2. The heavy machinery detection and alarm system for power transmission lines as claimed in claim 1, Features: The method of sending the received heavy machinery warning information and the positioning data of the location of the transmission line to a remote power management server via a wireless communication link includes: entering the received heavy machinery warning information and the positioning data of the location of the transmission line into IP data packets, and then sending the IP data packets to the remote power management server via a wireless communication link.
3. The heavy machinery detection and alarm system for power transmission lines as claimed in claim 2, It is characterized in that The system further comprises: an anti-vibration processing mechanism, which is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device; Among them, the anti-vibration processing mechanism is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device, including: the anti-vibration processing mechanism is used to perform anti-vibration processing on the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively.
4. The heavy machinery detection alarm system in the power transmission line according to claim 2, It is characterized in that The system further comprises: a synchronization control mechanism, which is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device; Among them, the synchronization control mechanism is arranged near the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device and is respectively connected to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device, including: the synchronization control mechanism is used to respectively realize the synchronization control operation between the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device.
5. The heavy machinery detection and alarm system in the power transmission line according to any one of claims 2 to 4, Features: A content correction mechanism is used to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively.
6. The heavy machinery detection and alarm system for power transmission lines as claimed in claim 5, Features: Using a content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively includes: performing filtering operations on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively.
7. The heavy machinery detection and alarm system for power transmission lines as claimed in claim 5, Features: Using a content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device respectively includes: performing a sharpening operation on the output data of the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device respectively.
8. The heavy machinery detection and alarm system for power transmission lines as claimed in claim 5, Features: Using a content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device respectively includes: performing an enhancement operation on the output data of the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device, and the third acquisition device respectively.
9. The heavy machinery detection and alarm system for power transmission lines as claimed in claim 5, Features: Using a content correction mechanism to perform image data processing on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively includes: performing a point image restoration operation on the output data of the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device to obtain the output processing data corresponding to the order mapping device, the first acquisition device, the second acquisition device and the third acquisition device respectively.
Citation Information
Patent Citations
Power transmission line underlying surface environment classification and model training method, device and equipment
CN116958704A
Safety hazard detection system and method for high-voltage transmission line
CN108307146A
Detection method and device for preventing mechanical invasion of power transmission line
CN112183337A
Power transmission line inspection method, device and equipment and storage medium
CN114724268A
Power transmission line invasion state analysis system
CN116485770A
