Transmission line ice thickness detection method based on UAV image processing

Through the drone image processing technology, the maximum inter-class variance method and the connection domain feature extraction method are used, combined with the vertical line approximation method, the problem of low applicability and accuracy in the detection of ice-covered thickness of transmission lines is solved, and the complexity is achieved Accurate detection in the environment.

CN114677428BActive Publication Date: 2024-11-08YIKONG UAV TECHNOLOGY (JIANGXI) CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202210320448.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-29
Publication Date
2024-11-08
Estimated Expiration
2042-03-29

AI Technical Summary

Technical Problem

The prior art has problems of poor applicability and low accuracy in the detection of ice-covered thickness of transmission lines, especially in the images collected by the camera, which is difficult to accurately. Extract edges and calculate thickness.

Method used

Using a drone-based image processing method, the original RGB image is converted into grayscale image, and the maximum inter-class variance method is used for initial segmentation, and the transmission line ice-covered information is extracted in combination with the feature parameters of the connection domain, and a vertical line approximation method is proposed to obtain. Ice thickness.

Benefits of technology

It realizes accurate extraction of the ice-covered edge of the transmission line in complex environments and accurately calculates the thickness, which is significantly better than the commonly used mean filtering and median filtering algorithms, and improves the accuracy and stability of detection.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114677428B_ABST
    Figure CN114677428B_ABST
Patent Text Reader

Abstract

The transmission line ice thickness detection method based on UAV image processing, first, convert the original transmission line ice RGB image collected by the UAV into a grayscale image; use the maximum inter-class variance method to perform initial segmentation on the grayscale image to complete the preprocessing of the original image; combine the transmission line ice information and the connected domain feature parameters of the background noise to extract the transmission line ice information; finally, propose a vertical line approximation method to obtain the thickness value of the vertical line direction of the iced transmission line, and calculate the ice thickness. The method of the invention can more accurately and timely reflect the ice state of the transmission line, thereby providing strong technical support for guiding ice melting work and preventing ice accidents.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of ice thickness detection for power transmission lines, and in particular relates to a method for detecting ice thickness for power transmission lines based on unmanned aerial vehicle (UAV) image processing. Background Art

[0002] As an important part of the power grid, the safe and stable operation of transmission lines is related to the reliability of power supply and the development of the national economy. However, my country's transmission lines are widely distributed, with complex operating conditions, and are exposed to the wild all year round. They are easily affected by macroclimate, microtopography and micrometeorological conditions, causing icing, dancing and other accidents, leading to line power outages, bringing many inconveniences to people's production and life, and in serious cases, huge economic losses. Therefore, it is particularly important to detect the ice thickness of transmission lines.

[0003] At present, the monitoring methods of ice thickness of transmission lines mainly include manual line inspection method, image recognition method, sag measurement method and embedded sensor method. Among them: image recognition method has become a research hotspot for transmission line ice monitoring due to its low initial investment, low operation and maintenance cost, high degree of automation and accurate monitoring data. The current detection methods for ice thickness of transmission lines still have problems such as poor applicability and low accuracy, such as: ①, because the ice-covered transmission lines in the original image captured by the camera generally have a certain angle with the horizontal or vertical direction in the image, it is difficult to obtain the maximum radial thickness more accurately. ②, when the transmission line is located in a complex environment with staggered gray levels or the ice image is blurred, the edge detection result contains many pseudo edges. Therefore, it is difficult to accurately extract the edges of ice-covered transmission lines and accurately calculate the ice thickness in the prior art. Summary of the invention

[0004] In order to solve the above technical problems, the present invention provides a method for detecting the ice thickness of transmission lines based on UAV image processing. This method can more accurately and timely reflect the icing status of transmission lines, thereby providing strong technical support for guiding ice melting work and preventing icing accidents, and has certain application prospects.

[0005] The technical solution adopted by the present invention is:

[0006] A transmission line ice thickness detection method based on UAV image processing is proposed. First, the original transmission line ice RGB image collected by the UAV is converted into a grayscale image; the maximum inter-class variance method is used to perform initial segmentation on the grayscale image to complete the preprocessing of the original image; the transmission line ice information and the connected domain feature parameters of the background noise are combined to extract the transmission line ice information; finally, a vertical line approximation method is proposed to obtain the thickness value of the vertical line direction of the iced transmission line and calculate the ice thickness.

[0007] The preprocessing refers to: graying the original RGB image of ice-covered transmission lines collected by the drone to obtain a gray image, and performing initial segmentation on the gray image using the maximum inter-class variance method to obtain an image after initial segmentation.

[0008] The ice-covered transmission line information refers to: further combining the initially segmented image with the connected domain feature parameters of the ice-covered transmission line information and the background noise to separate the ice-covered transmission line target and the background noise. The invention proposes a method for extracting ice-covered transmission line targets based on connected domain features, which has very small errors and stable results, and is significantly better than the commonly used mean filtering algorithm and median filtering algorithm.

[0009] The method for calculating the ice thickness of the transmission line is specifically as follows: a thinning operation is performed on the left transmission line in the ice-covered transmission line image to obtain a skeleton line with a single pixel width, and then a Canny algorithm is used to check the neighborhood of each pixel in the image, and the change of the adjacent first-order directional derivative is used to detect the change law of the grayscale in the neighborhood of the pixel. If a significant change in the grayscale occurs, it can be inferred that the pixel falls within the edge range of the image; the edge information of the ice on the transmission line is determined by searching for edge pixels close to the skeleton pixels in the skeleton direction, and the ice thickness of the transmission line is calculated based on the skeleton line and the ice edge line of the ice-covered transmission line.

[0010] The method for detecting ice thickness of transmission lines based on UAV image processing includes the following steps:

[0011] Step 1: Based on the transmission line image taken by drone inspection, the original RGB image of ice coverage on the transmission line is converted into a grayscale image;

[0012] Step 2: Use the maximum inter-class variance method to perform initial threshold segmentation on the grayscale image obtained in step 1;

[0013] Step 3: Adopt the ice-covered transmission line target extraction method based on connected domain features, combine the ice-covered transmission line information and the connected domain feature parameters of the background noise, and further separate the ice-covered transmission line target and the background noise;

[0014] Step 4: Use the vertical line approximation method to obtain the thickness value of the ice-covered transmission line in the vertical direction, and then calculate the ice thickness.

[0015] In step 1, the original RGB image of ice covering the transmission line is converted into a grayscale image using the average method. The average method formula is shown in formula (1):

[0016] F(i,j)=[R(i,j)+G(i,j)+B(i,j)] / 3 (1);

[0017] Where: R(i,j), G(i,j), B(i,j) are the pixel values ​​of the R, G, and B components of the RGB image pixel (i,j); F(i,j) is the pixel value of the grayscale image pixel (i,j).

[0018] In step 2, the maximum inter-class variance method is a threshold segmentation method with simple calculation and strong adaptability, which is specifically as follows:

[0019] Let f(m,n) be the gray value of the M×N image at point (m,n), and the gray level be k, then the range of f(m,n) is [0, k-1]; let p(i) be the frequency of gray value i in the image, then:

[0020]

[0021] M is the total number of pixels in the template including the current pixel, N is the total number of pixels in the image, i is the gray value, and f(m,n) is the gray value of the M×N image at point (m,n).

[0022] When the selected threshold is the gray value t, the target object and the background are segmented by comparing f(m,n) with the threshold t. The proportions of the target object and the background in the image are:

[0023]

[0024] w0(t) represents the ratio of the target object to the background in the image when the gray value at point (m,n) of the M×N image is less than or equal to the threshold, p(i) is the frequency of gray value i in the image, and t is the selected threshold gray value.

[0025]

[0026] w1(t) represents the ratio of the target object to the background in the image when the gray value at the point (m,n) of the M×N image is greater than the threshold.

[0027] The means are:

[0028]

[0029] u0(t) represents the mean value of the M×N image when the gray value at point (m,n) is less than or equal to the threshold.

[0030]

[0031] u1(t) represents the mean value of the M×N image when the grayscale value at point (m,n) is greater than the threshold.

[0032] The total mean of the target and background is:

[0033] u=w0(t)u0(t)+w1(t)u1(t) (7);

[0034] Then the between-class variance is:

[0035] E=w0(t)(u0(t)-u) 2 +w1(t)(u1(t)-u) 2 (8);

[0036] u represents the total mean of the target and background.

[0037] The gray value t when the between-class variance E reaches its maximum value is the optimal threshold to be selected.

[0038] In step 3, an ice-covered transmission line target extraction method based on connected domain features is used to further separate the ice-covered transmission line target and background noise. This method constructs a connected domain by analyzing the grayscale value changes of the grayscale image of the ice-covered transmission line, counts the characteristics of the ice-covered connected domain of the transmission line and the background information connected domain, analyzes the difference between the two, sets the corresponding parameter threshold to separate the ice-covered transmission line from the background information, and obtains a binary image with only the ice-covered transmission line information.

[0039] By observing the image after threshold segmentation, the connected domain area (P) of the ice-covered transmission line information and the background noise is significantly different, with the former being much larger than the latter. Therefore, the present invention selects the connected domain area as the characteristic parameter of the ice-covered transmission line information.

[0040] The formula for the area of ​​the connected domain is shown in formula (9):

[0041] P = ∫f(x,y)dx (9);

[0042] Where f(x,y) represents the pixel at coordinate (x,y) in the connected domain N.

[0043] In step 4, the method first needs to obtain the skeleton line of the edge of the ice-covered transmission line, that is, a group of central pixels of the ice-covered section with the length and direction information of the ice-covered transmission line. Ideally, the diameter of the ice-covered transmission line in the direction perpendicular to the skeleton tangent is the minimum distance between the two edges of the ice-covered transmission line. However, since the extracted skeleton line is not an ideal mathematical smooth curve, but a curve discretely arranged in pixels, a method of using a vertical line approximation in a certain curve area to obtain the ice thickness is proposed.

[0044] Figure 7 This is a schematic diagram of the pixel-level arrangement of ice on transmission lines. Figure 7 It can be seen that the extracted skeleton line is not an ideal mathematically smooth curve, and it is difficult to find a suitable curve equation to represent the ice-covered skeleton line of the transmission line.

[0045] In step 4, a total of 7 points O adjacent to point O0 in the pixel diagram are selected. i The line between (i=0,1,2,3) is approximated as the tangent line corresponding to the skeleton line. Since the transmission line ice image is a discrete point matrix with m rows and n columns, when i is too large, the straight line in this section cannot be approximated to the slope of the skeleton line. When i is too small, the error caused by the pixel arrangement is large. According to the resolution analysis of the currently designed detection equipment, when i=3, the straight line is used as the approximate tangent line of the skeleton line, and the obtained ice thickness of the transmission line in the vertical direction is the thickness corresponding to the point on the skeleton line with the smallest error.

[0046] The step 4 comprises the following steps:

[0047] S4.1: Use edge detection method to locate pixels of ice skeleton and ice edge of transmission line, and record the coordinates of all pixels with gray value of 0 after ice thinning and edge extraction of transmission line;

[0048] S4.2: Calculate the thickness of any point O on the skeleton line, and search for points P1(x, y) and P2(x, y) 3 pixels apart on the ice skeleton line of the transmission line with point O as the center along the skeleton line in two directions. Obtain the approximate skeleton line slope k = (y2-y1) / (x2-x1) through points P1 and P2, and use the equation of the straight line as the approximate tangent equation of the ice skeleton curve of the transmission line at point O;

[0049] S4.3: Based on the slope k, the equation of the vertical line passing through point O is obtained as y=(-1 / k)*x+(1 / k)*x i +y i , record the intersection point O(x i ,y i )、O'(x k ,y k ), then the pixel width of the transmission line after ice coating is:

[0050]

[0051] x i 、x k represents the abscissa and y of the intersection points O and O' i ,y k Indicates the ordinate of the intersection points O and O'.

[0052] S4.4: By installing a high-precision GPS navigation and positioning system on a drone carrying a high-definition camera, the spatial position and shape of the drone can be fixed, so that the position and shape of the camera are consistent when collecting images before and after the transmission line is covered with ice. In this way, the transmission line is in the same position in the images collected twice. If the diameter of the transmission line is known to be R, the thickness of the ice covering the transmission line D is:

[0053]

[0054] Where d0 is the pixel width of the transmission line in the image before ice coating, and d1 is the pixel width of the transmission line in the image after ice coating.

[0055] The present invention provides a method for detecting ice thickness on transmission lines based on UAV image processing, and the technical effects are as follows:

[0056] 1) The present invention first converts the original RGB image into a grayscale image, which can effectively improve the image processing speed and ice thickness calculation efficiency.

[0057] 2) When the transmission line is located in a complex environment with staggered gray levels or the ice-covered image is blurred, the edge detection result contains many pseudo edges. The method of the present invention can achieve accurate extraction of the edge of the ice-covered transmission line and accurate calculation of the ice thickness.

[0058] 3) The ice-covered transmission line target extraction method based on connected domain features of the present invention has a very small error in ice-covered transmission line target extraction and a stable result, which is significantly better than the commonly used mean filtering algorithm and median filtering algorithm.

[0059] 4) Since the extracted skeleton line is not an ideal mathematically smooth curve, in order to obtain the maximum radial thickness more accurately, the present invention proposes a vertical line approximation method to obtain the thickness value of the ice-covered transmission line in the vertical direction, so as to obtain the ice thickness. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 This is a flow chart of the ice thickness detection method for transmission lines based on UAV image processing.

[0061] Figure 2 is the initial segmentation image of the maximum inter-class variance method.

[0062] FIG3( a ) is a diagram showing the effect of extracting ice-covered transmission line information using the method of the present invention;

[0063] Figure 3(b) is a diagram showing the effect of extracting ice-covered transmission line information using mean filtering;

[0064] Figure 3(c) shows the effect of median filtering to extract ice-covered transmission line information.

[0065] Figure 4 Schematic diagram of ice-covered transmission line skeleton extraction.

[0066] Figure 5 Schematic diagram of edge extraction of ice-covered transmission lines.

[0067] Figure 6 Schematic diagram of ice thickness on transmission lines.

[0068] Figure 7 Schematic diagram of the pixel-level arrangement of ice covering the transmission line.

[0069] Figure 8 This is an image showing uneven local ice thickness.

[0070] Fig. 9 This is a map of the pixel width of actual ice-covered transmission lines.

[0071] Fig.10 Error map for ice-covered transmission line width calculation. DETAILED DESCRIPTION

[0072] Transmission line ice thickness detection method based on UAV image processing, such as Figure 1 The following steps are shown:

[0073] Step 1: Based on the transmission line image taken by drone inspection, the original RGB image of ice coverage on the transmission line is converted into a grayscale image;

[0074] Step 2: Use the maximum inter-class variance method to perform initial threshold segmentation on the grayscale image obtained in step 1;

[0075] Step 3: Adopt the ice-covered transmission line target extraction method based on connected domain features, combine the ice-covered transmission line information and the connected domain feature parameters of the background noise, and further separate the ice-covered transmission line target and the background noise;

[0076] Step 4: Use the vertical line approximation method to obtain the thickness value of the ice-covered transmission line in the vertical direction, and then calculate the ice thickness.

[0077] In step 1, the original image is collected by drone inspection and aerial photography, and then the original image is grayed to obtain a grayscale image. The image captured on-site at the power transmission line is generally a color image. The color of each pixel in a color image is composed of three independent components: red (R), green (G), and blue (B), so an RGB image is represented by a three-dimensional array in a computer, and each array stores the R, G, and B components of the image respectively. If the color image is processed directly, the three components of R, G, and B of the image need to be processed, which places high demands on the computer's CPU, memory, and other hardware, and greatly reduces the speed of image processing. Considering that the present invention only extracts the edge contour of the wire and has no requirements on the color of the image, it only needs to process the grayscale image. The present invention uses the average method to convert the original RGB image into a grayscale image. The average method formula is shown in formula (1).

[0078] F(i,j)=[R(i,j)+G(i,j)+B(i,j)] / 3 (1);

[0079] Where: R(i,j), G(i,j), B(i,j) are the pixel values ​​of the R, G, and B components of the RGB image pixel (i,j); F(i,j) is the pixel value of the grayscale image pixel (i,j)

[0080] In step 2, the maximum inter-class variance method is used to perform initial threshold segmentation on the grayscale image obtained in step 1, and the following is obtained: Figure 2 The segmented image.

[0081] Image segmentation is an important issue in image processing and a classic problem in computer vision research. Image understanding in computer vision includes target detection, feature extraction and target recognition, all of which depend on the quality of segmentation. The threshold method is a simple and effective segmentation method. Its biggest feature is that it is simple to calculate, so it has also been widely used. It uses the difference in grayscale characteristics between the target to be extracted and the background in the image to regard the image as a combination of two types of areas with different grayscale levels. The key to the threshold segmentation method lies in the selection of the threshold. There are many methods for selecting the threshold, such as maximum inter-class variance threshold segmentation, adaptive threshold segmentation, maximum entropy threshold segmentation method and iterative threshold segmentation. The present invention uses the maximum inter-class variance method, which is simple to calculate, highly adaptable and the most widely used, to perform image segmentation.

[0082] The maximum inter-class variance method is an adaptive threshold determination method. The algorithm assumes that image pixels can be divided into background and target parts according to the threshold. Then, the optimal threshold is calculated to distinguish the two types of pixels so that the distinction between the two types of pixels is maximized.

[0083] Let f(m,n) be the gray value of the M×N image at point (m,n), and the gray level be k, then the range of f(m,n) is [0, k-1]; let p(i) be the frequency of gray value i in the image, then:

[0084]

[0085] M is the total number of pixels in the template including the current pixel, N is the total number of pixels in the image, i is the gray value, and f(m,n) is the gray value of the M×N image at point (m,n).

[0086] When the selected threshold is the gray value t, the target object and the background are segmented by comparing f(m,n) with the threshold t. The proportions of the target object and the background in the image are:

[0087]

[0088] w0(t) represents the ratio of the target object to the background in the image when the gray value at point (m,n) of the M×N image is less than or equal to the threshold, p(i) is the frequency of gray value i in the image, and t is the selected threshold gray value.

[0089]

[0090] w1(t) represents the ratio of the target object to the background in the image when the gray value at the point (m,n) of the M×N image is greater than the threshold.

[0091] The means are:

[0092]

[0093] u0(t) represents the mean value of the M×N image when the gray value at point (m,n) is less than or equal to the threshold.

[0094]

[0095] u1(t) represents the mean value of the M×N image when the grayscale value at point (m,n) is greater than the threshold.

[0096] The total mean of the target and background is:

[0097] u=w0(t)u0(t)+w1(t)u1(t) (7);

[0098] Then the between-class variance is:

[0099] E=w0(t)(u0(t)-u) 2 +w1(t)(u1(t)-u) 2 (8);

[0100] u represents the total mean of the target and background.

[0101] The gray value t when the between-class variance E reaches its maximum value is the optimal threshold to be selected.

[0102] In step 3, it is easy to see from the image after threshold segmentation that the background noise and the ice-covered transmission line have different morphological characteristics. The noise information is mainly manifested in small and randomly scattered blocks, while the ice-covered transmission line is large in area and has certain linearity and directionality. In order to achieve the purpose of eliminating noise information, image segmentation is performed based on the threshold. The present invention adopts an ice-covered transmission line target extraction method based on connected domain features to further separate the ice-covered transmission line target and background noise. This method constructs a connected domain for grayscale change points, counts the features of the ice-covered connected domain of the transmission line and the background information connected domain, analyzes the difference between the two, sets the corresponding parameter threshold to separate the ice-covered transmission line and the background information, and obtains a binary image with only the ice-covered transmission line information.

[0103] The connected domain is an image region composed of target pixels with the same pixel value and adjacent positions in the image. Different connected domain feature parameters are defined according to the connected domain geometric properties, mainly including the connected domain area P, the minimum circumscribed rectangle aspect ratio T and the farthest distance L in the connected domain. By observing the image after threshold segmentation, it is found that the connected domain area P of the ice transmission line information and the background noise has obvious differences, and the former is much larger than the latter. Therefore, the present invention selects the connected domain area as the feature parameter of the ice-covered transmission line information, and its value can be calculated according to formula (9):

[0104] P = ∫f(x,y)dx (9);

[0105] Where f(x,y) represents the pixel at coordinate (x,y) in the connected domain N.

[0106] After grayscale processing, threshold segmentation, and connected domain area calculation of 20 randomly taken transmission line ice images, it was found that the connected domain area of ​​ice-covered transmission lines is greater than 2000 pixels, while the connected domain area of ​​background noise is concentrated between 100 and 160 pixels. i Afterwards, P i The connected domain that is smaller than the set threshold of 2000 and all pixels in the domain are assigned a value of 0 can effectively remove the background noise.

[0107] As shown in Figure 3(a), Figure 3(b), and Figure 3(c), the method used in the present invention is compared with the traditional and Gaussian filtering algorithms for the extraction of ice information on transmission lines. In order to test the detection effect of the method used in the present invention, a validity coefficient is proposed as an evaluation parameter for the binary image after the extraction of ice-covered transmission lines. It is defined as the ratio of the area of ​​the residual background connected domain to the area of ​​the total connected domain in the binary image. The larger the value, the greater the error and the worse the extraction effect. It is compared with the commonly used transmission line ice image filtering and segmentation methods: mean filtering algorithm and two-dimensional histogram filtering algorithm. 20 randomly taken ice-covered transmission line images are processed, and the results are shown in Table 1.

[0108] Table 1 Comparison of extraction effects of ice-covered transmission lines

[0109]

[0110] It can be seen from Table 1 above that the extraction error of the ice-covered transmission line extraction algorithm adopted by the present invention is very small, and the result is stable, which is significantly better than the commonly used mean filtering algorithm and median filtering algorithm.

[0111] In step 4, since the ice-covered transmission line in the original image captured by the camera generally has a certain angle with the horizontal or vertical direction in the image, in order to more accurately obtain the maximum radial thickness, the present invention proposes a vertical line approximation method to obtain the vertical thickness value of the ice-covered transmission line. The method first needs to obtain the skeleton line of the edge of the ice-covered transmission line.

[0112] The ice-covered transmission line skeleton is a set of pixel points with length and direction information, such as Figure 4 As shown in the figure, the present invention performs a thinning operation on the left transmission line in the ice-covered transmission line image to obtain a skeleton line with a single pixel width. The edge of the ice-covered transmission line is a collection of two outer edge pixels containing thickness information. The present invention uses the canny algorithm to check the neighborhood of each pixel in the image, and uses the change of the adjacent first-order directional derivative to detect the change law of the grayscale in the neighborhood of the pixel. If there is a significant change in the grayscale, it can be inferred that the pixel falls within the edge range of the image. Figure 5 As shown, the edge information of ice-covered transmission lines is determined by searching for edge pixels close to skeleton pixels in the skeleton direction, and the ice-covered thickness of the transmission lines is calculated based on the extracted skeleton lines and ice-covered edge lines of the ice-covered transmission lines.

[0113] Ideally, the ice thickness of the transmission line in the direction of the vertical skeleton tangent is the minimum distance between the two edges of the transmission line ice. However, due to the continuous change of the tangent direction of the transmission line ice curve, it is difficult to find a suitable curve equation to represent the skeleton line of the transmission line ice. Moreover, the extracted skeleton line is not an ideal mathematical smooth curve, but a curve arranged discretely in pixels. Even if the transmission line ice thickness in the direction of the skeleton vertical line is obtained, it may not be the minimum thickness of the transmission line ice. Accordingly, the present invention proposes a method of obtaining the transmission line ice thickness by using a vertical line approximation method in a certain curve area.

[0114] Pixel Request Figure 6 When calculating the tangent line equation at point O0, select the 7 points above and below it that are adjacent to it. i The line between (i=0,1,2,3) is approximated as the tangent line corresponding to the skeleton line. Since the transmission line ice-covered image is a discrete point matrix of m rows and n columns, when i is too large, the straight line in this section cannot be approximated to the slope of the skeleton line. When i is too small, the error caused by the pixel arrangement is large. According to the resolution analysis of the detection equipment we currently designed, when i=3, the ice-covered thickness of the transmission line in the vertical direction obtained by using this straight line as the approximate tangent line of the skeleton line is the thickness corresponding to the point on the skeleton line, which has the smallest error.

[0115] The edge detection method is used to locate the pixels of the transmission line ice skeleton and the transmission line ice edge, and the coordinates of all pixels with a grayscale value of 0 after the transmission line ice thinning and edge extraction operations are statistically recorded. If the thickness of any point O on the skeleton line is calculated, point P1(x, y) and point P2(x, y) 3 pixels apart on the transmission line ice skeleton line are searched along the skeleton line in two directions with point O as the center of the circle. The approximate skeleton line slope k = (y2-y1) / (x2-x1) is obtained through points P1 and P2, and the straight line equation is used as the approximate tangent equation of the transmission line ice skeleton curve at point O. According to the slope k, the equation of the perpendicular line passing through point O is obtained, and the intersection point O(x2) of the perpendicular line and the two edge lines of the transmission line ice is recorded. i ,y i )、O'(x k ,y k ), then the pixel width of the transmission line after ice coating is:

[0116]

[0117] By installing a high-precision GPS navigation and positioning system on a drone carrying a high-definition camera, the spatial position and shape of the drone can be fixed, so that the position and shape of the camera are consistent when collecting images before and after the transmission line is covered with ice. In this way, the transmission line is in the same position in the images collected twice before and after. If the diameter of the transmission line is known to be R, the thickness of the ice covering the transmission line D is:

[0118]

[0119] Where d0 is the pixel width of the transmission line in the image before ice coating, and d1 is the pixel width of the transmission line in the image after ice coating.

[0120] Verification example:

[0121] In order to verify the accuracy of the vertical line approximation method for calculating the ice thickness of transmission lines, the aforementioned image graying and threshold segmentation are first used to preprocess Figure 3, and the ice-covered transmission line target extraction method based on connected domain features is used to extract the ice-covered transmission line targets. Figure 8 The pixel width of the ice-covered transmission line shown in Figure 3 was measured by artificial detection method, and the actual pixel width of the ice-covered transmission line in Figure 3 was accurately measured. The results are shown in Fig. 9 As shown, the results will be used to evaluate the calculation accuracy of the Hough transform method and the vertical line approximation method.

[0122] like Fig.10 The figure shows the calculation error of the pixel width of ice-covered transmission lines by the Hough transform method and the vertical line approximation method. A positive value indicates that the calculation result is larger than the actual pixel width of the ice-covered transmission line, and a negative value indicates that the calculation result is smaller than the actual pixel width of the ice-covered transmission line. Fig.10It can be seen that the maximum error of the Hough transform method in solving the pixel width of the ice-covered transmission line can reach -8 pixels, while the actual pixel width of the ice-covered transmission line here is 50 pixels. It can be seen that the Hough transform method may obtain a pixel width of the ice-covered transmission line with an error of 16% locally. The errors of the vertical line approximation method are all concentrated in (-1,1) pixels, and the error in solving the pixel width of each point of the ice-covered transmission line is small, and the variance is only 0.31. By calculating the average error of the two methods, it can be obtained that the average error of the Hough transform method of 2.24 pixels is significantly greater than the average error of the vertical line approximation method of 0.47 pixels. The latter's calculation accuracy of the pixel width of the ice-covered transmission line is about 79% higher than that of the former.

[0123] The calculation error △D of ice thickness on transmission lines can be expressed as:

[0124]

[0125] Where: h0 is the actual pixel width of the ice-covered transmission line in the image, and h1 is the calculated pixel width of the ice-covered transmission line.

[0126] From the above formula, it can be obtained that the calculation error △D of the ice thickness of the transmission line is proportional to the size of |h0-h1|, and |h0-h1| represents the error size of the calculated value of the pixel width of the ice on the transmission line. The larger its value, the greater the calculation error of the ice thickness of the transmission line. It can be seen that when the vertical line approximation method is used to calculate the ice thickness of the transmission line, its calculation accuracy will be significantly better than the Hough transform method.

Claims

1. A method for detecting ice thickness on transmission lines based on UAV image processing, characterized in that The following steps are involved: Step 1: Based on the transmission line image taken by drone inspection, the original RGB image of ice coverage on the transmission line is converted into a grayscale image; Step 2: Use the maximum inter-class variance method to perform initial threshold segmentation on the grayscale image obtained in step 1; Step 3: Adopt the ice-covered transmission line target extraction method based on connected domain features, combine the ice-covered transmission line information and the connected domain feature parameters of the background noise, and further separate the ice-covered transmission line target and the background noise; Step 4: Use the vertical line approximation method to obtain the thickness value of the vertical direction of the ice-covered transmission line, and then calculate the ice thickness; in step 1, the average method is used to convert the original transmission line ice RGB image into a grayscale image. The average method formula is shown in formula (1): F(i,j)=[R(i,j)+G(i,j)+B(i,j)] / 3 (1); Where: R(i,j), G(i,j), B(i,j) are the pixel values ​​of the R, G, and B components of the RGB image pixel (i,j); F(i,j) is the pixel value of the grayscale image pixel (i,j); In step 2, the maximum inter-class variance method is specifically as follows: Let f(m,n) be the gray value of the M×N image at point (m,n), and the gray level be k, then the range of f(m,n) is [0, k-1]; let p(i) be the frequency of gray value i in the image, then: M is the total number of pixels in the M×N image including the current pixel, N is the total number of pixels in the image, i is the grayscale value, and f(m,n) is the grayscale value of the M×N image at point (m,n); When the selected threshold is the gray value t, the target object and the background are segmented by comparing f(m,n) with the threshold t; the proportions of the target object and the background in the image are: w0(t) represents the ratio of the target object to the background in the image when the gray value at point (m,n) of the M×N image is less than or equal to the threshold, p(i) is the frequency of gray value i in the image, and t is the selected threshold gray value; w1(t) represents the ratio of the target object to the background in the image when the gray value at the point (m,n) of the M×N image is greater than the threshold; The means are: u0(t) represents the mean value of the M×N image when the gray value at point (m,n) is less than or equal to the threshold; u1(t) represents the mean value of the M×N image when the gray value at point (m,n) is greater than the threshold; The total mean of the target and background is: u=w0(t)u0(t)+w1(t)u1(t) (7); Then the between-class variance is: E=w0(t)(u0(t)-u) 2 +w1(t)(u1(t)-u) 2 (8); u represents the total mean of the target and background; The gray value t when the inter-class variance E reaches the maximum value is the optimal threshold to be selected; In the step 3, an ice-covered transmission line target extraction method based on connected domain features is used to further separate the ice-covered transmission line target and background noise; this method constructs a connected domain by analyzing the grayscale value changes of the grayscale image of the ice-covered transmission line, counts the characteristics of the ice-covered connected domain of the transmission line and the background information connected domain, analyzes the difference between the two, sets the corresponding parameter threshold to separate the ice-covered transmission line and the background information, and obtains a binary image with only the ice-covered transmission line information; By observing the image after threshold segmentation, the connected domain area (P) of the ice-covered transmission line information and the background noise is significantly different, with the former being much larger than the latter. Therefore, the connected domain area is selected as the characteristic parameter of the ice-covered transmission line information. The formula for the area of ​​the connected domain is shown in formula (9): P = ∫f(x,y)dx (9); Where f(x,y) represents the pixel at coordinate (x,y) in the connected domain N; In step 4, a total of 7 points O adjacent to point O0 in the pixel diagram are selected. i The line between (i=0,1,2,3) is approximated as the tangent corresponding to the skeleton line. Since the transmission line ice image is a discrete point matrix of m rows and n columns, when i is too large, the straight line segment in this section cannot be approximated to the slope of the skeleton line. When i is too small, the error caused by the pixel arrangement is large. When i=3, the straight line segment is used as the approximate skeleton line tangent, and the ice thickness of the transmission line in the vertical direction is obtained, which has the smallest error as the thickness corresponding to the point on the skeleton line.

2. According to claim 1, the method for detecting ice thickness of transmission lines based on drone image processing is characterized in that: The step 4 comprises the following steps: S4.1: Use edge detection method to locate pixels of ice skeleton and ice edge of transmission line, and record the coordinates of all pixels with gray value of 0 after ice thinning and edge extraction of transmission line; S4.2: Calculate the thickness of any point O on the skeleton line, and search for points P1(x, y) and P2(x, y) 3 pixels apart on the ice skeleton line of the transmission line with point O as the center along the skeleton line in two directions. Obtain the approximate skeleton line slope k = (y2-y1) / (x2-x1) through points P1 and P2, and use the equation of the straight line as the approximate tangent equation of the ice skeleton curve of the transmission line at point O; S4.3: Based on the slope k, the equation of the vertical line passing through point O is obtained as y=(-1 / k)*x+(1 / k)*x i +y i , record the intersection point O(x i ,y i )、O'(x k ,y k ), then the pixel width of the transmission line after ice coating is: x i 、x k represents the abscissa and y of the intersection points O and O' i ,y k represents the ordinate of the intersection points O and O'; S4.4: A high-precision GPS navigation and positioning system is installed on a drone carrying a high-definition camera to fix the spatial position and shape of the drone, so that the position and shape of the camera are consistent when collecting images before and after the transmission line is covered with ice. In this way, the transmission line is in the same position in the images collected twice before and after. If the diameter of the transmission line is known to be R, the thickness of the ice covering the transmission line D is: Where d0 is the pixel width of the transmission line in the image before ice coating, and d1 is the pixel width of the transmission line in the image after ice coating.

Citation Information

Patent Citations

  • Transmission line ice coating status detection method based on image

    CN101793501A

  • Measurement method for lead / ground wire icing thickness of transmission line based on video variation analysis

    CN102252623A

  • Power transmission line icing thickness detection method based on image processing

    CN112070717A

  • Power transmission line icing monitoring method and system based on image processing mode

    CN112365475A