Image edge detection method based on adaptive extended state observer

Through adaptive expansion state observer and multi-direction differential signal processing, combined with non-maximum suppression and double-threshold method, the misjudgment and phase lag problems of image edge detection in the noise environment in the prior art are solved, and a higher level is achieved detection accuracy and noise immunity.

CN119006504AInactive Publication Date: 2024-11-22SOUTH CHINA UNIV OF TECH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411471208.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-22
Publication Date
2024-11-22
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

When processing noise-containing images, the existing image edge detection method has poor noise resistance and is prone to misjudgment of high-frequency noise points as edge points. The numerical differentiation leads to phase lag, and the accuracy is not high.

Method used

Using an image edge detection method based on an adaptive expansion state observer (ESO), noise filtering and derivative are integrated, gradient and noise intensity are calculated through first-order and second-order differential signals, bandwidth of ESO is adjusted, and differentials are calculated in multiple directions. The signal, combined with non-maximum suppression and double-threshold method, achieves edge detection.

Benefits of technology

It improves the accuracy and noise resistance of edge detection, reduces noise misjudgment, enhances the detection accuracy and coherence of image edges, and reduces the impact of phase hysteresis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119006504A_ABST
    Figure CN119006504A_ABST
Patent Text Reader

Abstract

The invention discloses an image edge detection method based on an adaptive extended state observer, and the method employs ESO as an image noise filtering operator (filter) and a differential operator (differentiator) at the same time, and is higher in detection precision and better in anti-noise capability. The gain coefficient of the ESO is selected by adopting an optimized pole assignment method, so that the numerical stability is ensured more favorably, and the method is more suitable for filtering noise in the image and improving the image edge detection capability. A self-adaptive learning mechanism is introduced, the ESO bandwidth is adjusted according to the gradient, the position of a noise point is determined according to the noise estimation value, and good edge detectability can be obtained under different noise intensity conditions. Aiming at the problem that the shape of the edge of the image may be irregular, performing edge detection from multiple directions to obtain multi-direction edge information; and aiming at the phase lag problem of unidirectional differential, a bidirectional differential averaging method is adopted to counteract the influence of the phase lag, so that the detection precision is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and in particular to an image edge detection method based on an adaptive extended state observer. Background Art

[0002] In actual image processing problems, the edge of an image, as a basic feature of the image, contains important information about the image and is widely used in fields such as image segmentation and target recognition. Typical edge detection methods detect edge points based on the first-order or second-order derivatives of the image, mainly differential edge detection operators such as Robert, Sobel, Prewitt, Canny, Log and Laplacian. These edge detection algorithms have been developed to be relatively mature, but the effect of processing noisy images is still not ideal, the anti-noise ability is poor, and high-frequency noise points are easily misjudged as edge points. In order to remove noise, most edge detection algorithms will first perform smoothing preprocessing on the image, but image smoothing can easily cause edge information loss. In addition, there is a phase lag problem in edge detection based on numerical differentiation, resulting in low accuracy. Therefore, direct edge detection in noisy images is of great significance in the field of image processing. Summary of the invention

[0003] The purpose of the present invention is to overcome the shortcomings and disadvantages of the prior art, and to provide an image edge detection method based on an adaptive extended state observer, which integrates the filtering and derivation of noise, introduces the idea of ​​an extended state observer (ESO) to extract the edge of an image with noise, and the method can automatically adjust the filter bandwidth parameter according to the size of the noise, effectively solving the problem that the edge detection effect of the traditional edge detection method is sensitive to noise, and realizes accurate detection of the image edge and effective suppression of noise.

[0004] To achieve the above object, the technical solution provided by the present invention is: an image edge detection method based on an adaptive extended state observer, comprising the following steps: The gradient of the image to be detected is calculated by the first-order differential signal obtained by ESO, and the bandwidth of ESO is changed according to the gradient. The bandwidth of ESO is adjusted by the real-time value of the image grayscale change rate estimated by the third-order ESO. The second-order differential signal obtained by ESO is used to estimate the noise intensity of the image and determine the location of the extreme noise point; The above ESO is applied to calculate the differentials of image pixels from multiple directions to reduce the influence of the initial direction on the edge position. The gradient of the image is obtained through forward and reverse multi-directional synthesis, and the image is filtered according to the position of the noise point. The non-maximum suppression method is used to accurately locate edge points, and the double threshold method is used to determine the edge lines to obtain the final edge image.

[0005] Compared with the prior art, the present invention has the following advantages and beneficial effects: 1. The present invention innovatively uses ESO as both an image noise filtering operator (filter) and a differential operator (differentiator) to achieve noise-resistant edge detection, which has higher detection accuracy and better noise resistance than existing edge detection methods.

[0006] 2. The optimized pole configuration method is used to select the gain coefficient of ESO. Compared with the traditional bandwidth method, it is more conducive to ensuring numerical stability and is more suitable for filtering noise in the image and improving the image edge detection capability.

[0007] 3. An adaptive learning mechanism is introduced to adjust the bandwidth of ESO according to the gradient size and determine the position of the noise point according to the noise estimation value, so as to achieve good edge detection under different noise intensity conditions.

[0008] 4. To address the problem that the shape of the image edge may be irregular, edge detection is performed from multiple directions to obtain multi-directional edge information; to address the phase lag problem caused by unidirectional differentiation, the method of averaging bidirectional (forward and reverse) differentiation is used to offset the influence of phase lag, thereby improving detection accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 Flow chart of the method of the present invention.

[0010] Figure 2 This is a sample image of the original image with noise.

[0011] Figure 3a is the horizontal (0°) direction gradient image.

[0012] Figure 3b It is a 45° directional gradient image.

[0013] Figure 3c is the vertical (90°) directional gradient image.

[0014] Figure 3d It is a 135° directional gradient image.

[0015] Figure 4 An image synthesized from gradient images in four directions.

[0016] Figure 5 This is the algorithm flow chart of non-maximum suppression and double threshold processing.

[0017] Figure 6 It is the edge image after non-maximum suppression and double threshold processing. DETAILED DESCRIPTION

[0018] The present invention is further described in detail below in conjunction with embodiments and drawings, but the embodiments of the present invention are not limited thereto.

[0019] like Figure 1 As shown, this embodiment discloses an image edge detection method based on an adaptive extended state observer. First, Step 001 is executed to input an image to be edge detected, such as Figure 2 The original image is contaminated by noise. In order to verify the denoising performance of the algorithm, Gaussian noise with a variance of 0.5% and salt and pepper noise with a density of 0.5% are added to the original grayscale image. Enter Step 002, perform gradient detection on the original image, and perform bidirectional adaptive ESO gradient detection from four directions to obtain the following Figure 3a-3d Four gradient images of different orientations are taken, and the gradient amplitude and direction of the image pixels are obtained by combining these four images, such as Figure 4 Then go to Step 003 and Step 004. Figure 5 The algorithm flow is Figure 4 The image is subjected to non-maximum suppression and double threshold segmentation edge connection to obtain the following Figure 6 The final edge image is shown, and the edge image is output through Step 005.

[0020] In the image processing of Step 002, the Figure 2 The first-order differential signal is obtained by bidirectionally averaging the first-order differential signal, wherein the first-order differential signal is extracted by a third-order ESO, and the discrete form of the third-order ESO is: (1); The nonlinear function , The definition is as follows: (2); (3); In the formula, and are the current pixel and the next pixel respectively. is the integration step length; is the input of the signal, that is, the gray value of the pixel in a certain direction in the image; is the grayscale tracking output of the pixel at the current moment, is the grayscale tracking output of the pixel at the next moment, is the first-order differential output of the grayscale of the pixel at the current moment, is the first-order differential output of the grayscale of the pixel at the next moment, is the second-order differential output of the grayscale of the pixel at the current moment, It is the second-order differential output of the grayscale of the pixel at the next moment; is the input control quantity, which is used as the differentiator for image processing , is the control gain, due to If it is 0, the control gain does not need to be considered in subsequent calculations; is the tracking error of ESO, that is, the difference between the gray value estimated by ESO and the gray value of the actual image; nonlinear function , To quickly control the optimal comprehensive function, , , is the gain coefficient of ESO; , Parameter representing the exponential change of the error; Represents the size of the linear change area of ​​the observation error, and its value range is ; , , The value of plays a key role in the observation capability and disturbance estimation capability of ESO. The present invention adopts an optimized pole configuration method to select the gain coefficient of ESO. , and , reduce the interference of high-frequency noise in the image and improve the accuracy of image edge detection. The characteristic polynomial of the observation error matrix of the third-order ESO , expressed as: (4); In the formula, is the Laplace operator, and the optimized poles obtained through experiments are , , , that is: (5); From formula (4) and formula (5), the gain coefficient of ESO can be obtained as: (6); In the formula, is the bandwidth of the ESO, which determines the tracking speed and noise immunity of the ESO. Figure 2 , take the ESO parameter as the integration step = 0.02, bandwidth =40, then the gain coefficient of ESO =104, =2000, =6400; nonlinear function , In =0.9, =0.45, =0.1.

[0021] When ESO has made one observation of the current image pixel position, the first-order differential signal is used To adjust the bandwidth The size of ESO is adjusted to achieve adaptive adjustment of ESO, which is very effective in filtering Gaussian noise.

[0022] (7); In the formula, is the upper limit of ESO bandwidth, is the lower limit of ESO bandwidth, is the maximum value of the grayscale change rate of the image, is the minimum value of the grayscale change rate of the image. These parameters are determined offline; It is the real-time value of the image grayscale change rate estimated by ESO.

[0023] First, select an initial bandwidth large enough offline , apply ESO for edge detection. If the image edge is clear and the noise points are basically filtered out, the noise point filtering and differentiation are good at this time. Can be determined as , and it is desirable =0.707 , the corresponding edge for , Desirable 10% of =0.1 ; If the initial bandwidth If the image edge cannot be guaranteed to be clear, you can increase it by 20% until the image edge is clear. Although the image edge is clear, there are many noise points. You can reduce it by 15% until the image edge is clear. After completing the ESO parameters, complete the edge detection of the image. Figure 2 , initial bandwidth =40, at the edge Value =600.

[0024] At the same time, using the second-order differential signal To determine the position of extreme noise points, if the current pixel satisfies the conditions shown in the following formula, it is a noise point. This method is particularly effective for salt and pepper noise.

[0025] (8); In the formula, is the dimensionless proportional factor, and the second-order differential signal Equivalent to The total change of the same dimension, To determine the threshold of noise, these parameters were determined offline; It is the real-time value of the rate of change of the image grayscale change rate estimated by ESO.

[0026] Dimensional Scale Factor Can be any non-zero positive number, usually , realize the dimensional conversion of the second-order differential signal; threshold Can be taken first The value of is increased by 50% until the noise point is accurately located and the subsequent filtering can effectively filter out the noise point. Figure 2 , scaling factor =0.5, threshold =2500.

[0027] Apply the above ESO to extract the first-order differential signal of the original image from four directions. The origin of the image coordinate system is located in the upper left corner of the image, and the horizontal direction is axis (0°), right is the positive direction, vertical direction is axis (90°), with downward being the positive direction. Assume Represents image pixels Gray value, point represents the tracking starting point, then the initial condition of ESO is: the input signal , Tracking starting point Gray value, signal tracking output , the first-order differential output of the signal , the second-order differential output of the signal .

[0028] For each pixel in the image First, perform forward traversal from the horizontal (0°), 45°, vertical (90°) and 135° directions, and apply ESO to obtain the first-order differential signal , , and .

[0029] Traverse from left to right in the horizontal (0°) direction and take is the gray value in the horizontal direction, we get: (9); In the formula, is the grayscale tracking output of the current pixel point traversed horizontally, It is the grayscale tracking output of the pixel point at the next moment of horizontal traversal; is the first-order differential output of the grayscale of the pixel at the current moment traversed horizontally, It is the first-order differential output of the grayscale of the pixel point at the next moment of horizontal traversal; is the second-order differential output of the grayscale of the pixel at the current moment traversed horizontally, It is the second-order differential output of the grayscale of the pixel point at the next moment of horizontal traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the right; Pixel points when traversing horizontally The gradient of Traverse from the upper right corner to the lower left corner in the 45° direction and take is the gray value in the 45° direction, we get: (10); In the formula, It is the grayscale tracking output of the pixel at the current moment traversed in the 45° direction. It is the grayscale tracking output of the pixel point at the next moment of traversal in the 45° direction; It is the first-order differential output of the grayscale of the pixel at the current moment traversed in the 45° direction. It is the first-order differential output of the grayscale of the pixel point at the next moment of traversal in the 45° direction; It is the second-order differential output of the grayscale of the pixel at the current moment traversed in the 45° direction. It is the second-order differential output of the grayscale of the pixel point at the next moment of traversal in the 45° direction; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the left and whose vertical coordinate moves one grid downward; Pixel points when traversing in the 45° direction The gradient of Traverse from top to bottom in the vertical (90°) direction and take is the gray value in the vertical direction, we get: (11); In the formula, is the grayscale tracking output of the current pixel point traversed in the vertical direction, It is the grayscale tracking output of the pixel point at the next moment of vertical traversal; is the first-order differential output of the grayscale of the pixel at the current moment traversed in the vertical direction, It is the first-order differential output of the grayscale of the pixel point at the next moment of vertical traversal; is the second-order differential output of the grayscale of the pixel at the current moment traversed in the vertical direction, It is the second-order differential output of the grayscale of the pixel point at the next moment of vertical traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose vertical coordinate moves down one grid; Pixel points when traversing vertically The gradient of Traverse from the upper left corner to the lower right corner in the 135° direction and take is the gray value in the 135° direction, we get: (12); In the formula, It is the grayscale tracking output of the pixel at the current moment of traversal in the 135° direction. It is the grayscale tracking output of the pixel point at the next moment of traversal in the 135° direction; It is the first-order differential output of the grayscale of the pixel at the current moment traversed in the 135° direction. It is the first-order differential output of the grayscale of the pixel point at the next moment of traversal in the 135° direction; It is the second-order differential output of the grayscale of the pixel at the current moment traversed in the 135° direction. It is the second-order differential output of the grayscale of the pixel point at the next moment of traversal in the 135° direction; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The grayscale value of the pixel whose horizontal coordinate moves one grid to the right and whose vertical coordinate moves one grid downward; Pixel points when traversing in the 135° direction The gradient of Then traverse backward from four directions to obtain the first-order differential signal , , and ; Traverse from right to left in the horizontal (0°) direction and take is the horizontally reversed grayscale value, we get: (13); In the formula, is the grayscale tracking output of the current pixel point in the horizontal reverse traversal, It is the grayscale tracking output of the pixel point at the next moment of horizontal reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of horizontal reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of horizontal reverse traversal; is the second-order differential output of the grayscale of the pixel at the current moment of horizontal reverse traversal, It is the second-order differential output of the grayscale of the pixel point at the next moment of horizontal reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the left; Pixel point when traversing horizontally in reverse The gradient of Traverse from the lower left corner to the upper right corner in the 45° direction and take is the gray value of the 45° reverse direction, we get: (14); In the formula, It is the grayscale tracking output of the pixel at the current moment of the 45° reverse traversal. It is the grayscale tracking output of the pixel point at the next moment of 45° reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of the 45° reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of 45° reverse traversal; It is the second-order differential output of the grayscale of the pixel at the current moment of the 45° reverse traversal. It is the second-order differential output of the grayscale of the pixel point at the next moment of 45° reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the right and whose vertical coordinate moves one grid upward; Pixel point when traversing in reverse at 45° The gradient of Traverse from bottom to top in the vertical (90°) direction and take is the vertically reversed grayscale value, we get: (15); In the formula, is the grayscale tracking output of the current pixel point in the vertical reverse traversal, It is the grayscale tracking output of the pixel point at the next moment of vertical reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of vertical reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of vertical reverse traversal; is the second-order differential output of the grayscale of the pixel at the current moment of vertical reverse traversal, It is the second-order differential output of the grayscale of the pixel point at the next moment of vertical reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel point that moves one grid upward on the vertical coordinate; Pixel point when traversing vertically in reverse direction The gradient of Traverse from the lower right corner to the upper left corner in the 135° direction and take is the gray value of the 135° reverse direction, we get: (16); In the formula, It is the grayscale tracking output of the pixel at the current moment of the 135° reverse traversal. It is the grayscale tracking output of the pixel point at the next moment of the 135° reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of the 135° reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of the 135° reverse traversal; It is the second-order differential output of the grayscale of the pixel at the current moment of the 135° reverse traversal. It is the second-order differential output of the grayscale of the pixel point at the next moment of the 135° reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The grayscale value of the pixel whose horizontal coordinate moves one grid to the left and whose vertical coordinate moves one grid upward; Pixel point when traversing in reverse direction at 135° gradient.

[0030] The differential signals obtained by the forward and reverse traversals are averaged to eliminate the error caused by the phase lag and obtain the average gradient in the four directions. , , and , the gradient image corresponding to each direction is as follows Figure 3a-Figure 3b shown.

[0031] (17); (18); (19); (20); Usually, the gradient amplitude is calculated using the calculation formula such as formula (21), but the calculation cost of the square and square root is large. Therefore, the present invention takes the absolute value of the gradient components in the four directions and sums them to calculate the gradient amplitude of the entire image, as shown in formula (22). The gradient amplitude image synthesized in the four directions is as follows: Figure 4 shown.

[0032] (twenty one); (twenty two); In the formula, Represents image pixels The gradient value of horizontal 0° and vertical 90° is obtained by the following formula: It is expressed as: (twenty three); The gradient directions of 45° and 135° are obtained by the following formula, and their phases are It is expressed as: (twenty four); According to the previously determined extreme noise point positions, these noise points are filtered on the gradient magnitude image.

[0033] (25); In the formula, the set Indicates that the filter window size is 3×3, , All are collections Any value in is the gray value of the noise point. is the gray value of the 8-neighborhood point of the noise point, To take the median value, is the gray value of the noise point after filtering.

[0034] In the image processing of Step 003, the non-maximum suppression method is used to accurately locate the edge feature points. Figure 5In the non-maximum suppression method, the gradient amplitude image is input in Step 501; then the gradient normal vector is calculated from four directions in Step 502. When the gradient changes to show the edge, due to the wide change area, the gradient normal vector needs to be calculated in the horizontal, vertical, 45° and 135° directions; then enter Step 503 to determine whether it is a local maximum in the normal direction. If so, enter Step 504 to retain the current pixel point, otherwise enter Step 505 to suppress the grayscale value of the current pixel point to 0. Then traverse the entire image in Step 506, only retain the pixels with the local maximum value in the edge direction, and output the non-maximum suppression image. Through multi-directional non-maximum suppression, the blurring effect caused by edge detection is eliminated, making the edge of the target image clearer and more detailed.

[0035] In the image processing of Step 004, the double threshold method is used to determine the edge connection line. After the non-maximum suppression processing, although the edge information of the target image is significantly improved, when extracting the edge line, due to some interference factors, the edge may be discontinuous. In order to make the edge information of the image clearer and ensure the coherence of the edge, according to Figure 5 The double threshold edge determination algorithm uses two thresholds for the image after non-maximum suppression. and The image is segmented by thresholding and edge connection is performed. In Step 507, the image pixel points are determined. The gradient magnitude Is it greater than the high threshold? ; If yes, then go to Step 510, the point must be an edge point and is retained; if not, then go to Step 508, where the gradient amplitude is determined Is it between two thresholds, that is, If yes, then go to Step 509 to perform connectivity analysis on the 8-neighborhood of the pixel to find the point Is there a pixel point greater than the high threshold in the 8 neighboring pixels of , if yes, then go to Step 510, the current pixel point is an edge pixel point, used to connect strong edge points, otherwise go to Step 511, the current pixel point is not an edge point, it is regarded as an isolated noise point and removed. In Step 508, if the gradient amplitude is Less than low threshold , then enter Step 511, the current pixel point must not be an edge point, and its grayscale value is suppressed to 0. Finally, through Step 512, the grayscale value of the edge point is set to 255, and the grayscale value of the non-edge point is set to 0, forming an edge contour, and obtaining a binary edge image as the final edge image. Figure 4 , apply a high threshold =70, low threshold = 30 double threshold processing and edge connection, the obtained edge image is as follows Figure 6 As shown. Figure 2 and Figure 6 It can be seen that Figure 6 Very well extracted Figure 2 The edge of the image is filtered out, which not only filters out a lot of noise in the image, but also retains the texture information and local features of the image.

[0036] The above embodiments are preferred implementation modes of the present invention, but the implementation modes of the present invention are not limited to the above embodiments. Any other changes, modifications, substitutions, combinations, and simplifications that do not deviate from the spirit and principles of the present invention should be equivalent replacement methods and are included in the protection scope of the present invention.

Claims

1. An image edge detection method based on an adaptive extended state observer, characterized in that: The following steps are involved: The gradient of the image to be detected is calculated by the first-order differential signal obtained by ESO, and the bandwidth of ESO is changed according to the gradient. The bandwidth of ESO is adjusted by the real-time value of the image grayscale change rate estimated by the third-order ESO. The second-order differential signal obtained by ESO is used to estimate the noise intensity of the image and determine the location of the extreme noise point; The above ESO is applied to calculate the differentials of image pixels from multiple directions to reduce the influence of the initial direction on the edge position. The gradient of the image is obtained through forward and reverse multi-directional synthesis, and the image is filtered according to the position of the noise point. The non-maximum suppression method is used to accurately locate edge points, and the double threshold method is used to determine the edge lines to obtain the final edge image.

2. The image edge detection method based on adaptive extended state observer according to claim 1, characterized in that: The first-order differential signal of the image to be detected is extracted from the horizontal, 45°, vertical and 135° directions in both directions, and the first-order differential signal of the two directions is averaged. The first-order differential signal is extracted by the third-order ESO. The discrete form of the third-order ESO is: (1); The nonlinear function , The definition is as follows: (2); (3); In the formula, and are the current pixel and the next pixel respectively. is the integration step length; is the input of the signal, that is, the gray value of the pixel in a certain direction in the image; is the grayscale tracking output of the pixel at the current moment, is the grayscale tracking output of the pixel at the next moment, is the first-order differential output of the grayscale of the pixel at the current moment, is the first-order differential output of the grayscale of the pixel at the next moment, is the second-order differential output of the grayscale of the pixel at the current moment, It is the second-order differential output of the grayscale of the pixel at the next moment; is the input control quantity, which is used as the differentiator for image processing , is the control gain, due to If it is 0, the control gain does not need to be considered in subsequent calculations; is the tracking error of ESO, that is, the difference between the gray value estimated by ESO and the gray value of the actual image; Nonlinear functions , To quickly control the optimal comprehensive function, , , is the gain coefficient of ESO; , Parameter representing the exponential change of the error; Represents the size of the linear change area of ​​the observation error, and its value range is ; , , The value of plays a key role in the observation capability and disturbance estimation capability of ESO. The optimal pole configuration method is used to select the gain coefficient of ESO. , and , reduce the interference of high-frequency noise in the image and improve the accuracy of image edge detection; the characteristic polynomial of the observation error matrix of the third-order ESO , expressed as: (4); In the formula, is the Laplace transform operator, and the optimized poles obtained through experiments are , , , that is: (5); From formula (4) and formula (5), the gain coefficient of ESO is: (6); In the formula, It is the bandwidth of the ESO that determines the tracking speed and noise immunity of the ESO.

3. The image edge detection method based on adaptive extended state observer according to claim 2 is characterized in that: When ESO has made one observation of the current image pixel position, the first-order differential signal is used To adjust the bandwidth of ESO The size of can realize the adaptive adjustment of ESO, as shown in the following formula (7): (7); In the formula, is the upper limit of ESO bandwidth, is the lower limit of ESO bandwidth, is the maximum value of the image grayscale change rate, is the minimum value of the grayscale change rate of the image, the first-order differential signal It is the real-time value of the image grayscale change rate estimated by ESO.

4. The image edge detection method based on adaptive extended state observer according to claim 3 is characterized in that: parameter , , and Through offline determination, first select an initial bandwidth offline , apply ESO for edge detection. If the image edge is clear and the noise points are filtered out, then Can be determined as , and can take =0.707 , the corresponding edge for , Can take 10% of =0.1 ; If the initial bandwidth If the image edge cannot be guaranteed to be clear, the bandwidth can be increased by 20% until the image edge is clear. Although the image edge is clear, there are many noise points, which can be reduced by 15% until the image edge is clear.

5. The image edge detection method based on adaptive extended state observer according to claim 4 is characterized in that: If the current pixel satisfies the condition shown in the following formula (8), it is an extreme noise point; (8); In the formula, is the dimensionless proportional factor, and the second-order differential signal Equivalent to The total change of the same dimension, To determine the noise threshold, the second-order differential signal is the real-time value of the rate of change of the image grayscale change rate estimated by ESO, Contains noise intensity information.

6. The image edge detection method based on adaptive extended state observer according to claim 5, characterized in that: The dimension scale factor Can be any non-zero positive number, take , realize the dimensional conversion of the second-order differential signal; threshold Can take first The value of is increased by 50% until the noise point is accurately located and the subsequent filtering can effectively filter out the noise point.

7. The image edge detection method based on adaptive extended state observer according to claim 6, characterized in that: ESO is used to extract the first-order differential signal of the image to be edge detected from four directions. The origin of the image coordinate system is located in the upper left corner of the image, and the horizontal direction is The axis is 0°, the right is the positive direction, and the vertical direction is The axis is 90°, with downward being the positive direction; assuming Represents image pixels Gray value, point represents the tracking starting point, then the initial condition of ESO is: the input signal , Tracking starting point Gray value, signal tracking output , the first-order differential output of the signal , the second-order differential output of the signal ; For each pixel in the image First, perform forward traversal from the horizontal direction (0°, 45°, vertical direction (90°, and 135°) respectively, and apply ESO to obtain the first-order differential signal , , and ; Traverse from left to right in the horizontal direction, that is, in the 0° direction, and take is the gray value in the horizontal direction, we get: (9); In the formula, is the grayscale tracking output of the current pixel point traversed horizontally, It is the grayscale tracking output of the pixel point at the next moment of horizontal traversal; is the first-order differential output of the grayscale of the pixel at the current moment traversed horizontally, It is the first-order differential output of the grayscale of the pixel point at the next moment of horizontal traversal; is the second-order differential output of the grayscale of the pixel at the current moment traversed horizontally, It is the second-order differential output of the grayscale of the pixel point at the next moment of horizontal traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the right; Pixel points when traversing horizontally The gradient of Traverse from the upper right corner to the lower left corner in the 45° direction and take is the gray value in the 45° direction, we get: (10); In the formula, It is the grayscale tracking output of the pixel at the current moment traversed in the 45° direction. It is the grayscale tracking output of the pixel point at the next moment of traversal in the 45° direction; It is the first-order differential output of the grayscale of the pixel at the current moment traversed in the 45° direction. It is the first-order differential output of the grayscale of the pixel point at the next moment of traversal in the 45° direction; It is the second-order differential output of the grayscale of the pixel at the current moment traversed in the 45° direction. It is the second-order differential output of the grayscale of the pixel point at the next moment of traversal in the 45° direction; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the left and whose vertical coordinate moves one grid downward; Pixel points when traversing in the 45° direction The gradient of Traverse vertically from top to bottom at 90°. is the gray value in the vertical direction, we get: (11); In the formula, is the grayscale tracking output of the current pixel point traversed in the vertical direction, It is the grayscale tracking output of the pixel point at the next moment of vertical traversal; is the first-order differential output of the grayscale of the pixel at the current moment traversed in the vertical direction, It is the first-order differential output of the grayscale of the pixel point at the next moment of vertical traversal; is the second-order differential output of the grayscale of the pixel at the current moment traversed in the vertical direction, It is the second-order differential output of the grayscale of the pixel point at the next moment of vertical traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose vertical coordinate moves down one grid; Pixel points when traversing vertically The gradient of Traverse from the upper left corner to the lower right corner in the 135° direction and take is the gray value in the 135° direction, we get: (12); In the formula, It is the grayscale tracking output of the pixel at the current moment of traversal in the 135° direction. It is the grayscale tracking output of the pixel point at the next moment of traversal in the 135° direction; It is the first-order differential output of the grayscale of the pixel at the current moment traversed in the 135° direction. It is the first-order differential output of the grayscale of the pixel point at the next moment of traversal in the 135° direction; It is the second-order differential output of the grayscale of the pixel at the current moment traversed in the 135° direction. It is the second-order differential output of the grayscale of the pixel point at the next moment of traversal in the 135° direction; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The grayscale value of the pixel whose horizontal coordinate moves one grid to the right and whose vertical coordinate moves one grid downward; Pixel points when traversing in the 135° direction The gradient of Then traverse backward from four directions to obtain the first-order differential signal , , and ; Traverse from right to left in the horizontal direction, that is, in the 0° direction, and take is the horizontally reversed grayscale value, we get: (13); In the formula, is the grayscale tracking output of the current pixel point in the horizontal reverse traversal, It is the grayscale tracking output of the pixel point at the next moment of horizontal reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of horizontal reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of horizontal reverse traversal; is the second-order differential output of the grayscale of the pixel at the current moment of horizontal reverse traversal, It is the second-order differential output of the grayscale of the pixel point at the next moment of horizontal reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the left; Pixel point when traversing horizontally in reverse The gradient of Traverse from the lower left corner to the upper right corner in the 45° direction and take is the gray value of the 45° reverse direction, we get: (14); In the formula, It is the grayscale tracking output of the pixel at the current moment of the 45° reverse traversal. It is the grayscale tracking output of the pixel point at the next moment of 45° reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of the 45° reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of 45° reverse traversal; It is the second-order differential output of the grayscale of the pixel at the current moment of the 45° reverse traversal. It is the second-order differential output of the grayscale of the pixel point at the next moment of 45° reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel whose horizontal coordinate moves one grid to the right and whose vertical coordinate moves one grid upward; Pixel point when traversing in the reverse direction at 45° The gradient of Traverse vertically, i.e., 90°, from bottom to top. is the vertically reversed grayscale value, we get: (15); In the formula, is the grayscale tracking output of the current pixel point in the vertical reverse traversal, It is the grayscale tracking output of the pixel point at the next moment of vertical reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of vertical reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of vertical reverse traversal; is the second-order differential output of the grayscale of the pixel at the current moment of vertical reverse traversal, It is the second-order differential output of the grayscale of the pixel point at the next moment of vertical reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The gray value of the pixel point that moves one grid upward on the vertical coordinate; Pixel point when traversing vertically in reverse direction The gradient of Traverse from the lower right corner to the upper left corner in the 135° direction and take is the gray value of the 135° reverse direction, we get: (16); In the formula, It is the grayscale tracking output of the pixel at the current moment of the 135° reverse traversal. It is the grayscale tracking output of the pixel point at the next moment of the 135° reverse traversal; is the first-order differential output of the grayscale of the pixel at the current moment of the 135° reverse traversal, It is the first-order differential output of the grayscale of the pixel point at the next moment of the 135° reverse traversal; It is the second-order differential output of the grayscale of the pixel at the current moment of the 135° reverse traversal. It is the second-order differential output of the grayscale of the pixel point at the next moment of the 135° reverse traversal; is the input of the signal at the current moment, that is, the grayscale value of the current pixel; is the input of the signal at the next moment, that is, the grayscale value of the next pixel; The grayscale value of the pixel whose horizontal coordinate moves one grid to the left and whose vertical coordinate moves one grid upward; Pixel point when traversing in reverse direction at 135° The gradient of The differential signals obtained by the forward and reverse traversals are averaged to eliminate the error caused by the phase lag and obtain the average gradient in the four directions. , , and , as shown below: (17); (18); (19); (20); The absolute values ​​of the gradient components in the four directions are taken and summed to obtain the gradient amplitude of the entire image, and the gradient amplitude image is obtained. As shown in formula (21), the gradient amplitude synthesized in the four directions is As shown below: (21); The gradient directions of horizontal 0° and vertical 90° are obtained by the following formula, and their phase It is expressed as: (22); The gradient directions of 45° and 135° are obtained by the following formula, and their phases are It is expressed as: (23); According to the previously determined extreme noise point positions, these noise points are filtered on the gradient magnitude image, as shown in the following formula: (24); In the formula, the set Indicates that the filter window size is 3×3, , All are collections Any value in is the gray value of the noise point. is the gray value of the 8-neighborhood point of the noise point, To take the median value, is the gray value of the noise point after filtering.

8. The image edge detection method based on adaptive extended state observer according to claim 7, characterized in that: The non-maximum suppression method is used to accurately locate edge points, as follows: For the gradient amplitude image, the gradient normal vector is calculated from four directions. When the gradient changes to show an edge, due to the wide change area, the gradient normal vector needs to be calculated in the horizontal, 45°, vertical and 135° directions. In the normal direction, it is determined whether it is a local maximum. If so, the current pixel point is retained, otherwise the grayscale value of the current pixel point is suppressed to 0; then the entire image is traversed, only the pixels with the local maximum value in the edge direction are retained, and a non-maximum suppressed image is output; finally, through multi-directional non-maximum suppression, the blurring effect caused by edge detection is eliminated, making the edge of the target image clearer and more detailed.

9. The image edge detection method based on adaptive extended state observer according to claim 8, characterized in that: The double threshold method is used to determine the edge connection line, as follows: After non-maximum suppression, although the edge information of the target image is significantly improved, the edge may be discontinuous due to some interference factors when extracting the edge line. In order to make the edge information of the image clearer and ensure the continuity of the edge, two thresholds are used for the image after non-maximum suppression. , Perform threshold segmentation and edge connection; first, determine the image pixel points The gradient magnitude Is it greater than the high threshold? If yes, then the point must be an edge point and is retained. If not, the gradient amplitude is determined. Is it between two thresholds? , Between If so, then the 8-neighborhood of the pixel is subjected to connectivity analysis to find the pixel Are there any pixels in the 8 neighboring pixels greater than the high threshold? If there is a pixel point, the current pixel point is an edge pixel point, which is used to connect strong edge points. Otherwise, the current pixel point is not an edge point and is regarded as an isolated noise point to be removed. If the gradient amplitude Less than low threshold , then the current pixel is definitely not an edge point, and its grayscale value is suppressed to 0; finally, the grayscale value of the edge point is set to 255, and the grayscale value of the non-edge point is set to 0 to form an edge contour, and a binary edge image is obtained as the final edge image.

Citation Information

Patent Citations

  • Edge detection method based on fractional-order signal processing

    CN101841642A

  • Power transmission device image edge detection method, device and system

    CN109360217A

  • An improved Canny image edge detection method with noise immunity

    CN109410230A

  • ESO-based autonomous underwater robot execution mechanism fault diagnosis method

    CN114035550A

  • Design method of extended state observer based on single-input fuzzy system

    CN115826403A