A concrete crack identification method based on image processing

Abstract

The present invention relates to the field of image processing technology, and in particular to a method for identifying concrete cracks based on image processing, comprising: obtaining an image to be analyzed, determining an image state of the image to be analyzed based on an estimated comparison deviation value and a noise pollution degree, and determining an image processing method based on the image state; in hierarchical segmentation processing, determining the number of segmentation pixel values ​​based on a crack complexity coefficient, determining a segmentation pixel value selection method based on a pixel value correlation coefficient, and determining a selection optimization method based on a recognition difficulty coefficient and a segmentation interaction value under the condition that initial selection is completed; in apparent segmentation processing, determining a segmentation area based on a combination of associated anomalies, and adjusting the area of ​​the segmentation area based on an edge influence coefficient; determining an image refinement method based on a segmentation area type, and determining a crack area based on an abnormal area in the refined image under the condition that image refinement is completed; the present invention can improve crack recognition accuracy.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and in particular to a concrete crack recognition method based on image processing. Background Art

[0002] The presence of cracks in concrete walls poses a huge safety hazard. These cracks affect the strength and stiffness of concrete, leading to a decrease in bearing capacity. Therefore, accurate detection of concrete cracks is of vital importance to ensuring the safety and stability of concrete structures. However, in the actual crack detection process, due to the large number of image texture features, some non-crack textures are often mistakenly identified as cracks, resulting in crack identification accuracy that is difficult to meet actual needs. Therefore, how to process images to improve crack identification accuracy is a technical problem that needs to be urgently solved by technicians in this field.

[0003] Chinese patent publication number CN113744185A discloses a method for segmenting apparent cracks in concrete based on deep learning and image processing, comprising: obtaining a digital image of concrete with cracks on the surface, annotating the cracks, and processing the annotated results to obtain a crack mask image; dividing the masked concrete apparent digital image into a training set and a validation set, and then cutting it into sub-images; constructing a coarse segmentation model for apparent cracks, and training the model using the training set; cutting the apparent digital image of the concrete to be tested into sub-images, and inputting them into the coarse segmentation model; interpolating the original image to be tested and the coarse segmentation result image to obtain a refined segmentation result image; and obtaining the contour of the refined segmentation result image. It can be seen that the above technical solution has the following problems: the image processing method in the crack recognition process is single, and it is impossible to adaptively process the image according to the actual state of the image, resulting in poor crack recognition accuracy. Summary of the Invention

[0004] To this end, the present invention provides a concrete crack recognition method based on image processing to overcome the problem that the image processing method in the crack recognition process in the prior art is single and cannot adaptively process the image according to the actual state of the image, resulting in poor crack recognition accuracy.

[0005] To achieve the above objectives, the present invention provides a concrete crack identification method based on image processing, comprising:

[0006] Acquire an image to be analyzed, determine an image state of the image to be analyzed based on an estimated comparison deviation value and a noise pollution degree, and determine an image processing method based on the image state, wherein the image processing method includes hierarchical segmentation processing and appearance segmentation processing;

[0007] In the hierarchical segmentation process, the number of segmentation pixel values ​​is determined according to the crack complexity coefficient, and the segmentation pixel value selection method is determined according to the pixel value correlation coefficient. Under the condition that the initial selection is completed, the selection optimization method is determined according to the recognition difficulty coefficient and the segmentation interaction value;

[0008] The segmentation pixel value selection method is to select the segmentation pixel value according to the feature reference value or the associated threshold value, and the selection optimization method is to delete the segmentation pixel value or increase the segmentation pixel value;

[0009] In the apparent segmentation process, the segmentation region is determined according to the associated anomaly combination, and the area of ​​the segmentation region is adjusted according to the edge influence coefficient;

[0010] Determining an image refinement method according to the segmentation region type, wherein the image refinement method is to determine whether to perform zero-value processing on the pixel point according to the neighborhood state of the pixel point, and determining a pixel optimization method according to the differential correlation coefficient, wherein the pixel optimization method is eigenvalue pixel optimization or mean pixel optimization;

[0011] When image refinement is completed, the crack area is determined based on the abnormal area in the refined image.

[0012] Furthermore, determining an image processing method according to the image state includes:

[0013] If the image status is that the estimated comparison deviation value is greater than or equal to the preset estimated comparison deviation value or the noise pollution level is greater than or equal to the preset noise pollution level, the image processing method is hierarchical segmentation processing;

[0014] If the image status is that the estimated comparison deviation value is less than the preset estimated comparison deviation value and the noise pollution level is less than the preset noise pollution level, the image processing method is the appearance segmentation processing.

[0015] Furthermore, the method for confirming the estimated comparison deviation value includes:

[0016] If the pixel fluctuation value is greater than or equal to the preset pixel fluctuation value, an estimated comparison deviation value is determined based on the position outlier and the pixel fluctuation value;

[0017] If the pixel fluctuation value is less than the preset pixel fluctuation value, the estimated comparison deviation value is determined according to the recognition deviation coefficient.

[0018] Furthermore, the number of segmentation pixel values ​​is determined according to the crack complexity coefficient, and the segmentation pixel value selection method is determined according to the pixel value correlation coefficient;

[0019] If the pixel value correlation coefficient is less than the preset pixel value correlation coefficient, the segmentation pixel value selection method is to select the segmentation pixel value according to the feature reference value;

[0020] If the pixel value correlation coefficient is greater than or equal to the preset pixel value correlation coefficient, the segmentation pixel value is selected according to the correlation threshold;

[0021] The number of segmented pixel values ​​is positively correlated with the crack complexity coefficient.

[0022] Furthermore, the optimization method is determined based on the recognition difficulty coefficient and the segmentation interaction value, including:

[0023] If the recognition difficulty coefficient is greater than or equal to the preset recognition difficulty coefficient or the segmentation interaction value is less than the preset segmentation interaction value, the optimization method is to increase the segmentation pixel value;

[0024] If the recognition difficulty coefficient is less than the preset recognition difficulty coefficient and the segmentation interaction value is greater than or equal to the preset segmentation interaction value, the optimization method selected is to delete the segmentation pixel value.

[0025] Furthermore, the segmentation region is determined according to the associated anomaly combination, and the area of ​​the segmentation region is increased and adjusted according to the edge influence coefficient;

[0026] The increase in the area of ​​a single segmented region is positively correlated with the edge influence coefficient corresponding to the segmented region.

[0027] Furthermore, the image refinement method is determined according to the segmentation region type, including:

[0028] For one type of segmented area, the image refinement method is to determine the pixel optimization method based on the differential correlation coefficient;

[0029] For the second-class segmentation area, the image refinement method is to determine whether to perform zero-value processing on the pixel point based on the neighborhood status of the pixel point.

[0030] Furthermore, judging whether to perform zero-value processing on the pixel point according to the neighborhood state of the pixel point includes:

[0031] For a single pixel,

[0032] If the neighborhood state is that the boundary correlation degree is greater than or equal to the preset boundary correlation degree or the characteristic coefficient is greater than or equal to the preset characteristic coefficient, the pixel point is processed as 0;

[0033] If the neighborhood state is that the boundary correlation degree is less than the preset boundary correlation degree and the characteristic coefficient is less than the preset characteristic coefficient, no 0 value processing is performed on the pixel point.

[0034] Furthermore, a pixel optimization method is determined based on the differential correlation coefficient, including:

[0035] For a single pixel,

[0036] If the differential correlation coefficient is less than the preset differential correlation coefficient, the pixel optimization method is eigenvalue pixel optimization;

[0037] If the differential correlation coefficient is greater than or equal to the preset differential correlation coefficient, the pixel optimization method is mean pixel optimization.

[0038] Furthermore, the confirmation method of the differential correlation coefficient includes:

[0039] If the mutation coefficient is greater than or equal to the preset mutation coefficient, the differential correlation coefficient is determined according to the angle disorder value and the mutation degree;

[0040] If the mutation coefficient is less than the preset mutation coefficient, the differential correlation coefficient is determined according to the proximity difference.

[0041] Compared with the prior art, the beneficial effect of the present invention lies in that, in the technical solution of the present invention, the image state of the image to be analyzed is determined based on the estimated comparison deviation value and the noise pollution degree, and the noise situation and recognition difficulty of the image to be analyzed are effectively reflected through the estimated comparison deviation value and the noise pollution degree, and then different image processing methods are adaptively selected according to the image state, thereby avoiding the problem of poor crack recognition accuracy caused by the single image processing method in the prior art, and being able to reduce noise pollution through multi-level processing to improve the detail recognition ability of the image to be analyzed, thereby improving the recognition accuracy of cracks in the image to be analyzed.

[0042] Furthermore, the present invention effectively reflects the degree of correlation between pixel points corresponding to each pixel value in the image to be analyzed through the pixel value correlation coefficient, and then determines the segmentation pixel value selection method based on the pixel value correlation coefficient, which can better retain the detailed information of the cracks, and effectively reflects the complexity of the selected segmentation pixel values ​​through the recognition difficulty coefficient and the segmentation interaction value, and dynamically adjusts the number of segmentation pixel values ​​to ensure that complex areas have sufficient segmentation details and simple areas are not over-segmented, thereby improving the recognition accuracy of cracks.

[0043] Furthermore, the present invention determines the segmentation area based on the associated anomaly combination, which can ensure the integrity of the segmentation area and avoid the appearance of broken or discontinuous areas in the segmentation results. The edge influence coefficient effectively reflects the edge characteristics of the segmentation area, and then dynamically adjusts the segmentation area, which can ensure the complete retention of crack detail information and thus improve the accuracy of crack identification.

[0044] Furthermore, the present invention determines the image refinement method according to the segmentation area type, which can cope with the refinement requirements of different types of segmentation areas and improve the stability of crack recognition. Through the neighborhood status of the pixel point, it can accurately judge whether to perform 0 value processing on the pixel point to avoid over-refinement or under-refinement. According to the differential correlation coefficient, the appropriate optimization method is selected to adapt to the refinement requirements of different areas, and thus can effectively deal with noise interference and improve the accuracy of concrete crack recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 Schematic diagram of a concrete crack identification method based on image processing according to the present invention;

[0046] Figure 2 This is a flow chart of the present invention for determining an image processing method according to an image state;

[0047] Figure 3 This is a flow chart of a method for determining segmentation pixel value selection based on pixel value correlation coefficients according to the present invention;

[0048] Figure 4 This is a flow chart of the present invention for determining an image refinement method according to the segmented region type. DETAILED DESCRIPTION

[0049] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are merely used to explain the present invention and are not intended to limit the present invention.

[0050] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.

[0051] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside", and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the accompanying drawings. This is only for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0052] Furthermore, it should be noted that, in the description of the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood in a broad sense. For example, they may refer to fixed connections, detachable connections, or integral connections; mechanical connections or electrical connections; direct connections or indirect connections through an intermediate medium; and internal communication between two components. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on specific circumstances.

[0053] See also Figures 1 to 4 As shown, the present invention provides a concrete crack identification method based on image processing, comprising:

[0054] Acquire an image to be analyzed, determine an image state of the image to be analyzed based on an estimated comparison deviation value and a noise pollution degree, and determine an image processing method based on the image state, wherein the image processing method includes hierarchical segmentation processing and appearance segmentation processing;

[0055] In the hierarchical segmentation process, the number of segmentation pixel values ​​is determined according to the crack complexity coefficient, and the segmentation pixel value selection method is determined according to the pixel value correlation coefficient. Under the condition that the initial selection is completed, the selection optimization method is determined according to the recognition difficulty coefficient and the segmentation interaction value;

[0056] The segmentation pixel value selection method is to select the segmentation pixel value according to the feature reference value or the associated threshold value, and the selection optimization method is to delete the segmentation pixel value or increase the segmentation pixel value;

[0057] In the apparent segmentation process, the segmentation region is determined according to the associated anomaly combination, and the area of ​​the segmentation region is adjusted according to the edge influence coefficient;

[0058] Determining an image refinement method according to the segmentation region type, wherein the image refinement method is to determine whether to perform zero-value processing on the pixel point according to the neighborhood state of the pixel point, and determining a pixel optimization method according to the differential correlation coefficient, wherein the pixel optimization method is eigenvalue pixel optimization or mean pixel optimization;

[0059] When image refinement is completed, the crack area is determined based on the abnormal area in the refined image.

[0060] The application scenario of the present invention is the identification of cracks in an image to be analyzed. In the present invention, the image to be analyzed is an image of a portion of a concrete wall surface photographed by a camera perpendicular to the concrete wall surface and then subjected to grayscale processing. The specific model of the camera is not limited and the user can select it according to their needs. The grayscale processing converts the color image of the portion of the concrete wall surface photographed by the camera perpendicular to the concrete wall surface into a grayscale image through OpenCV. This is content that is easy for those skilled in the art to understand and will not be described in detail. The image to be analyzed contains a number of pixels, and the pixel value corresponding to a single pixel is greater than or equal to 0 and less than or equal to 255.

[0061] In the present invention, several historical records are correspondingly provided, and any historical record records the estimated comparison deviation value, noise pollution degree, pixel fluctuation value, pixel value correlation coefficient and recognition difficulty coefficient, etc. in the historical process of crack identification in the image to be analyzed at least once, and each historical record corresponds to a qualified mark, which records whether the crack identification process meets the user's requirements. The qualified mark can be recorded manually. It is understandable that the user can determine whether the crack identification process meets the requirements based on self-set indicators. The self-set indicators can be but are not limited to the error recognition index, which will not be described in detail here. Among them, the error recognition index is the number of times the cracks in the image to be analyzed are incorrectly identified;

[0062] The image refinement completion condition is that the segmented regions are processed by the image refinement method and the reorganization of the refined segmented regions is completed; the refined segmented regions are the segmented regions processed by the image refinement method; and the refined image is the image generated after the reorganization of the refined segmented regions.

[0063] The reorganization process for the first-class segmented regions processed by image thinning and the second-class segmented regions processed by image thinning are different;

[0064] When recombining the first-class segmented regions processed by image thinning, the first-class segmented regions are aligned to the same coordinate system by image registration technology, and the pixel value of each pixel in the merged image is in the range of [0, 250]. This is easy to understand for those skilled in the art and will not be described in detail.

[0065] When recombining the two-category segmented regions processed by image thinning, the segmented regions are spliced ​​according to their positions in the image to be analyzed. If a single pixel in the image to be analyzed corresponds to multiple two-category segmented regions, the average value of the pixel values ​​corresponding to the pixel in each of the two-category segmented regions corresponding to the pixel is used as the pixel value of the pixel; if a single pixel in the image to be analyzed corresponds to a single two-category segmented region, the pixel value corresponding to the pixel in the two-category segmented region corresponding to the pixel is used as the pixel value of the pixel;

[0066] When determining the crack region based on the abnormal region in the refined image, each abnormal region in the refined image is regarded as the crack region;

[0067] The initial selection completion condition is that the segmentation pixel values ​​selected by the segmentation pixel value selection method reach the number of segmentation pixel values;

[0068] The image to be analyzed and the refined image contain several abnormal areas. A single abnormal area is an area containing several pixels. The pixel values ​​of each pixel in the abnormal area are greater than 0 and the pixel values ​​of the adjacent pixels corresponding to the abnormal area are all 0. The method for confirming adjacent pixels is as follows: for a single abnormal area in a single image, each pixel in the abnormal area is recorded as a target pixel, the other pixels except the target pixel are recorded as reference pixels, and the reference pixels adjacent to the target pixel are recorded as the adjacent pixels corresponding to the abnormal area.

[0069] Specifically, the image processing method is determined according to the image status, including:

[0070] If the image status is that the estimated comparison deviation value is greater than or equal to the preset estimated comparison deviation value or the noise pollution level is greater than or equal to the preset noise pollution level, the image processing method is hierarchical segmentation processing;

[0071] If the image status is that the estimated comparison deviation value is less than the preset estimated comparison deviation value and the noise pollution level is less than the preset noise pollution level, the image processing method is the appearance segmentation processing.

[0072] The image state includes a first image state and a second image state. The first image state is that the estimated comparison deviation value is greater than or equal to the preset estimated comparison deviation value or the noise pollution degree is greater than or equal to the preset noise pollution degree. The second image state is that the estimated comparison deviation value is less than the preset estimated comparison deviation value and the noise pollution degree is less than the preset noise pollution.

[0073] Noise pollution degree = (number of abnormal areas in the image to be analyzed whose reference value is less than the preset reference value) / (total number of abnormal areas in the image to be analyzed), where the reference value is the total number of pixels contained in a single abnormal area;

[0074] The user can determine the values ​​of the preset estimated comparison deviation value, the preset noise pollution level and the preset number reference value according to the actual application scenario. The smaller the values ​​of the preset estimated comparison deviation value and the preset noise pollution level, the greater the user's need to adopt hierarchical segmentation processing. A preset estimated comparison deviation value and a preset noise pollution level are provided. The historical records of the user adopting apparent segmentation processing are detected, and the average value of the estimated comparison deviation values ​​corresponding to the historical records that can meet the user's needs is recorded as the preset estimated comparison deviation value. The average value of the noise pollution levels corresponding to the historical records that can meet the user's needs is recorded as the preset noise pollution level. The larger the value of the preset number reference value, the greater the user's need to determine the degree of noise influence in the image to be analyzed. A preset number reference value is provided, and the preset number reference value is 15.

[0075] Specifically, the methods for confirming the estimated comparison deviation value include:

[0076] If the pixel fluctuation value is greater than or equal to the preset pixel fluctuation value, an estimated comparison deviation value is determined based on the position outlier and the pixel fluctuation value;

[0077] If the pixel fluctuation value is less than the preset pixel fluctuation value, the estimated comparison deviation value is determined according to the recognition deviation coefficient.

[0078] The pixel fluctuation value is the standard deviation of the pixel quantity values ​​corresponding to each pixel value, and the pixel values ​​are 0, 1, 2, 3, ..., 250. The pixel quantity value is confirmed by recording a single pixel value as the target value, and the pixel value corresponding to the target value is the total number of pixel points in the image to be analyzed whose pixel values ​​are the target value;

[0079] The value of the preset pixel fluctuation value can be determined by the user according to the actual application scenario. The larger the value of the preset pixel fluctuation value, the greater the user's need to determine the estimated comparison deviation value based on the recognition deviation coefficient. A value of the preset pixel fluctuation value is provided, and the historical records of the user determining the estimated comparison deviation value based on the recognition deviation coefficient are detected. The average value of the pixel fluctuation values ​​corresponding to the historical records that can meet the user's needs is recorded as the preset pixel fluctuation value;

[0080] If the pixel fluctuation value is greater than or equal to the preset pixel fluctuation value, the estimated comparison deviation value = position outlier + pixel fluctuation value;

[0081] If the pixel fluctuation value is less than the preset pixel fluctuation value, the estimated comparison deviation value and the recognition deviation coefficient are positively correlated;

[0082] The position outlier degree is the average of the outlier coefficients corresponding to each pixel value. For a single pixel value, the pixel value is recorded as the first target value. The outlier coefficient corresponding to the first target value is the number of pixel values ​​corresponding to each pixel point in the reference rectangle corresponding to the first target value. The reference rectangle is the minimum rectangle in the image to be analyzed that can contain all the pixel points corresponding to the single pixel value.

[0083] The recognition deviation coefficient is confirmed by recording the historical records in the historical records that have the same pixel fluctuation value as the image to be analyzed and are processed using apparent segmentation as the first record. The recognition deviation coefficient = (the total number of first records - the number of first records that can meet user needs) / (the total number of first records).

[0084] Specifically, the number of segmentation pixel values ​​is determined according to the crack complexity coefficient, and the segmentation pixel value selection method is determined according to the pixel value correlation coefficient;

[0085] If the pixel value correlation coefficient is less than the preset pixel value correlation coefficient, the segmentation pixel value selection method is to select the segmentation pixel value according to the feature reference value;

[0086] If the pixel value correlation coefficient is greater than or equal to the preset pixel value correlation coefficient, the segmentation pixel value is selected according to the correlation threshold;

[0087] The number of segmented pixel values ​​is positively correlated with the crack complexity coefficient.

[0088] The pixel values ​​in the image to be analyzed are 0, 1, 2, ..., 250, and the pixel values ​​other than 0 and 250 are recorded as the pixel values ​​to be selected, and the number of split pixel values ​​is the number of the selected pixel values ​​to be selected;

[0089] The crack complexity coefficient = 1 / (the average value of the distance coefficients corresponding to each abnormal area in the image to be analyzed). The distance coefficient corresponding to a single abnormal area is the average value of the shortest distances from the center point corresponding to the abnormal area to the center points of all other abnormal areas except the abnormal area. The center point corresponding to a single abnormal area is the center of the circumscribed circle corresponding to the abnormal area.

[0090] The pixel value correlation coefficient is the average value of the correlation thresholds corresponding to the pixel values ​​to be selected. The correlation threshold corresponding to a single pixel value to be selected = (the number of pixel values ​​to be selected corresponding to each pixel point in the reference rectangle corresponding to the pixel value to be selected) / (the total number of pixel values ​​to be selected appearing in the image to be analyzed);

[0091] The value of the preset pixel value correlation coefficient can be determined by the user according to the actual application scenario. The larger the value of the preset pixel value correlation coefficient, the greater the user's demand for selecting segmentation pixel values ​​based on the feature reference value. A value of the preset pixel value correlation coefficient is provided, and the historical records of selecting segmentation pixel values ​​based on the correlation threshold are detected. The average value of the pixel value correlation coefficients corresponding to the historical records that can meet the user's needs is recorded as the preset pixel value correlation coefficient.

[0092] The characteristic reference value is confirmed in the following manner: for a single pixel value to be selected, the pixel value to be selected is recorded as the second target value, and the pixel values ​​adjacent to the second target value are recorded as adjacent pixel values. The characteristic reference value corresponding to the second target value = |(the sum of the number of pixels corresponding to each adjacent pixel value / 2) - (the number of pixels corresponding to the second target value)|;

[0093] The segmentation pixel value selection method is to select the segmentation pixel value according to the feature reference value, and select the pixel value to be selected as the segmentation pixel value in descending order of the feature reference value until the number of segmentation pixel values ​​is reached;

[0094] The segmentation pixel value selection method is to select the segmentation pixel value according to the associated threshold, and select the pixel value to be selected as the segmentation pixel value in descending order according to the associated threshold until the number of segmentation pixel values ​​is reached.

[0095] Specifically, the optimization method is determined based on the recognition difficulty coefficient and the segmentation interaction value, including:

[0096] If the recognition difficulty coefficient is greater than or equal to the preset recognition difficulty coefficient or the segmentation interaction value is less than the preset segmentation interaction value, the optimization method is to increase the segmentation pixel value;

[0097] If the recognition difficulty coefficient is less than the preset recognition difficulty coefficient and the segmentation interaction value is greater than or equal to the preset segmentation interaction value, the optimization method selected is to delete the segmentation pixel value.

[0098] The selected segmentation pixel values, 0, and 250 are recorded as segmentation values. For a single segmentation value, the segmentation value is recorded as the target segmentation value. The segmentation value adjacent to the target segmentation value and with a larger pixel value than the target segmentation value is recorded as the adjacent segmentation value. (target segmentation value, adjacent segmentation value) is recorded as an interval segment.

[0099] The recognition difficulty coefficient is the maximum value of the sub-difficulty coefficients corresponding to each interval paragraph. The method for confirming the sub-difficulty coefficient is as follows: for a single interval paragraph, record the interval paragraph as the target paragraph, record each pixel value contained in the target paragraph as the paragraph value, and the sub-difficulty coefficient corresponding to the target paragraph is the absolute value of the difference between the maximum and minimum values ​​of the uniformity coefficient corresponding to each paragraph value. The method for confirming the uniformity coefficient is as follows: for a single paragraph value, detect each pixel point corresponding to the paragraph value and record it as an analysis point. The uniformity coefficient corresponding to the paragraph value is the average value of the point reference values ​​corresponding to each analysis point. The point reference value corresponding to a single analysis point is the average value of the shortest distance from the analysis point to other analysis points except the analysis point.

[0100] The segmentation interaction value is the maximum value of the sub-interaction coefficients corresponding to each interval paragraph. The method for confirming the sub-interaction coefficient is as follows: for a single interval paragraph, the interval paragraph is recorded as the first paragraph, and the interval paragraph adjacent to the first paragraph is recorded as the second paragraph. The sub-interaction coefficient corresponding to the first paragraph = similarity coefficient - interval reference value, where the interval reference value is the number of pixel values ​​contained in the first paragraph. The similarity coefficient = 1 / |the larger value of the sub-difficulty coefficients corresponding to each second paragraph - the sub-difficulty coefficient corresponding to the first paragraph|;

[0101] The values ​​of the preset recognition difficulty coefficient and the preset segmentation interaction value can be determined by the user according to the actual application scenario. The smaller the value of the preset recognition difficulty coefficient and the larger the value of the preset segmentation interaction value, the greater the user's demand for increasing the segmentation pixel value. A preset recognition difficulty coefficient and a preset segmentation interaction value are provided. The historical records of deleting segmentation pixel values ​​are detected, and the average value of the recognition difficulty coefficients corresponding to the historical records that can meet the user's needs is recorded as the preset recognition difficulty coefficient, and the average value of the segmentation interaction values ​​corresponding to the historical records that can meet the user's needs is recorded as the preset segmentation interaction value.

[0102] When the optimization method is to increase the segmentation pixel value, the eigenvalue corresponding to the segmentation area whose comprehensive evaluation value is greater than the preset comprehensive evaluation value is used as the increased segmentation pixel value; the method for confirming the eigenvalue is that, for a single segmentation area, the segmentation area is recorded as the target segmentation area, the reference value corresponding to the target segmentation area = (the sum of the two segmentation pixel values ​​corresponding to the target segmentation area) / 2, and the eigenvalue corresponding to the target segmentation area is the minimum pixel value greater than or equal to the reference value corresponding to the target segmentation area;

[0103] When the optimization method is selected as deleting segmented pixel values, the segmented pixel values ​​with radiation coefficients greater than the preset radiation coefficients will be deleted;

[0104] Comprehensive evaluation value = recognition difficulty coefficient + segmentation interaction value. The radiation coefficient is determined as follows: for a single segmented pixel value, the radiation coefficient = 1 / (the absolute value of the difference between the sub-difficulty coefficients of the two interval segments corresponding to the segmented pixel value). The two interval segments corresponding to a single segmented pixel value are the interval segment where the segmented pixel value is located and the interval segment adjacent to the segmented pixel value.

[0105] The values ​​of the preset comprehensive evaluation value and the preset radiation coefficient can be determined by the user according to the actual application scenario. The smaller the value of the preset comprehensive evaluation value, the greater the user's demand for increasing the segmented pixel value. A value of the preset comprehensive evaluation value is provided, and the historical records of increasing the segmented pixel value are detected. The average value of the comprehensive evaluation values ​​corresponding to the historical records that can meet the user's needs is recorded as the preset comprehensive evaluation value. The smaller the value of the preset radiation coefficient, the greater the user's demand for deleting the segmented pixel value. A value of the preset radiation coefficient is provided, and the historical records of deleting the segmented pixel value are detected. The average value of the radiation coefficients corresponding to the historical records that can meet the user's needs is recorded as the preset radiation coefficient.

[0106] It can be understood that by selecting an optimization method, a number of split pixel values ​​can be obtained. For a single split pixel value, the split pixel value is recorded as a target split pixel value, and split pixel values ​​adjacent to the target split pixel value and having a larger pixel value than that corresponding to the target split pixel value are recorded as neighboring split pixel values. (target split pixel value, neighboring split pixel value) is recorded as a split segment, and each split segment corresponds to a segmented area. A single segmented area only includes pixel points corresponding to pixel values ​​in the image to be analyzed whose pixel values ​​are in the interval of (target split pixel value, neighboring split pixel value).

[0107] The method for confirming the divided pixel value includes:

[0108] When the optimization method is selected to increase the segmentation pixel value, the pixel value increased by increasing the segmentation pixel value and each segmentation value are recorded as the segmentation pixel value;

[0109] When the optimization method is selected to delete the segmentation pixel value, the segmentation value remaining after deleting the segmentation pixel value is recorded as the partitioning pixel value.

[0110] Specifically, the segmentation region is determined according to the associated anomaly combination, and the area of ​​the segmentation region is increased and adjusted according to the edge influence coefficient;

[0111] The increase in the area of ​​a single segmented region is positively correlated with the edge influence coefficient corresponding to the segmented region.

[0112] wherein, in determining the segmented area according to the associated abnormal combination, an association analysis is performed on each abnormal area in the image to be analyzed; when an association analysis is performed on a single abnormal area, the abnormal area is recorded as a target abnormal area, and other abnormal areas except the target abnormal area are recorded as reference abnormal areas; a collection of reference abnormal areas whose distance reference value from the target abnormal area is less than a preset distance reference value and the target abnormal area is recorded as an associated abnormal combination; and the association analysis is continued for each abnormal area that has not been subjected to the association analysis until each abnormal area is recorded in the associated abnormal combination; and the minimum rectangle that can contain each abnormal area corresponding to the single associated abnormal combination is recorded as a segmented area;

[0113] The distance reference value is the length of the line connecting the center points corresponding to the two abnormal areas. The preset distance reference value can be determined by the user according to the actual application scenario. The greater the user's demand for improving the accuracy of crack identification, the smaller the preset distance reference value. A preset distance reference value is provided, and the preset distance reference value is 10 cm.

[0114] Edge influence coefficient = (number of pixels with pixel values ​​greater than 0 in the edge area) / (total number of pixels in the edge area); the edge area is the area between the inner rectangle boundary and the segmentation area boundary, the inner rectangle is located inside the segmentation area and is similar to the segmentation area, and the shortest distances from each side of the inner rectangle to the corresponding reference side are equal. The method for confirming the reference side is to record a single side of the inner rectangle as the target side, and the reference side corresponding to the target side is the side of the four sides corresponding to the segmentation area that is parallel to the target side and closest to the target side; the shortest distance from each side of the inner rectangle to the corresponding reference side is the first reference distance, and the value of the first reference distance can be determined by the user according to actual needs. A value of the first reference distance is provided, which is one-fifth of the length of the shorter side of the segmentation area; the segmentation area boundary is the four sides of a single segmentation area; the inner rectangle boundary and the outer rectangle boundary are the four sides of the inner rectangle and the outer rectangle respectively;

[0115] When the area of ​​the segmented region is increased and adjusted according to the edge influence coefficient, the increased area of ​​the single segmented region is the area between the boundary of the outer rectangle and the boundary of the segmented region. The outer rectangle is located outside the segmented region and is similar to the segmented region, and the shortest distances from each side of the outer rectangle to the corresponding first reference side are all equal. The method for confirming the first reference side is to record a single side of the outer rectangle as the first target side, and the first reference side corresponding to the first target side is the side of the four sides corresponding to the segmented region that is parallel to the first target side and closest to the first target side.

[0116] The area after the segmentation area is increased and adjusted according to the edge influence coefficient is used as the adjusted segmentation area. It should be noted that if the outer rectangle is all inside the edge of the image to be analyzed, the outer rectangle is used as the segmentation area; if part of the outer rectangle is outside the edge of the image to be analyzed, the area of ​​the outer rectangle that exceeds the image to be analyzed is deleted, and the remaining area of ​​the outer rectangle is used as the segmentation area.

[0117] Specifically, the image refinement method is determined according to the segmentation region type, including:

[0118] For one type of segmented area, the image refinement method is to determine the pixel optimization method based on the differential correlation coefficient;

[0119] For the second-category segmentation area, the image refinement method is to determine whether to perform zero-value processing on the pixel point based on the neighborhood status of the pixel point.

[0120] The first type of segmented regions are segmented regions obtained through hierarchical segmentation processing, and the second type of segmented regions are adjusted segmented regions obtained through apparent segmentation processing.

[0121] Specifically, judging whether to perform zero-value processing on a pixel point based on the neighborhood state of the pixel point includes:

[0122] For a single pixel,

[0123] If the neighborhood state is that the boundary correlation degree is greater than or equal to the preset boundary correlation degree or the characteristic coefficient is greater than or equal to the preset characteristic coefficient, the pixel point is processed as 0;

[0124] If the neighborhood state is that the boundary correlation degree is less than the preset boundary correlation degree and the characteristic coefficient is less than the preset characteristic coefficient, no 0 value processing is performed on the pixel point.

[0125] The neighborhood state of the pixel point is determined according to the boundary correlation degree and the characteristic coefficient. The neighborhood state of the pixel point includes a first neighborhood state and a second neighborhood state. The first neighborhood state is that the boundary correlation degree is greater than or equal to the preset boundary correlation degree or the characteristic coefficient is greater than or equal to the preset characteristic coefficient. The second neighborhood state is that the boundary correlation degree is less than the preset boundary correlation degree and the characteristic coefficient is less than the preset characteristic coefficient.

[0126] The boundary correlation degree is confirmed by recording a single pixel point as the target point and the number of associated points with the same pixel value as the target point as the boundary correlation degree. The single associated point corresponding to the target point is the pixel point whose line connecting it to the target point does not pass through any other pixel points except the associated point and the target point. The characteristic coefficient is the average value of the shortest distance from each associated point with the same pixel value as the target point to the target point.

[0127] The values ​​of the preset boundary correlation degree and the preset characteristic coefficient can be determined by the user according to the actual application scenario. The larger the values ​​of the preset boundary correlation degree and the preset characteristic coefficient, the greater the demand for zero-value processing for the pixel points. The values ​​of the preset boundary correlation degree and the preset characteristic coefficient are provided, and the historical records of zero-value processing for the pixel points are detected. The average value of the boundary correlation degrees corresponding to the historical records that can meet the user's needs is recorded as the preset boundary correlation degree, and the average value of the characteristic coefficients corresponding to the historical records that can meet the user's needs is recorded as the preset characteristic coefficient;

[0128] When the pixel point is processed as 0 value, the pixel value of the pixel point is changed to 0. When the pixel point is not processed as 0 value, the pixel value of the pixel point remains unchanged.

[0129] Specifically, the pixel optimization method is determined according to the differential correlation coefficient, including:

[0130] For a single pixel,

[0131] If the differential correlation coefficient is less than the preset differential correlation coefficient, the pixel optimization method is eigenvalue pixel optimization;

[0132] If the differential correlation coefficient is greater than or equal to the preset differential correlation coefficient, the pixel optimization method is mean pixel optimization.

[0133] The value of the preset differential correlation coefficient can be determined by the user according to the actual application scenario. The larger the value of the preset differential correlation coefficient, the greater the user's demand for eigenvalue pixel optimization. A value of the preset differential correlation coefficient is provided, and the historical records of eigenvalue pixel optimization are detected. The average value of the differential correlation coefficients corresponding to the historical records that can meet the user's needs is recorded as the preset differential correlation coefficient.

[0134] When the pixel optimization method is eigenvalue pixel optimization, for a single pixel point, the pixel value of the pixel point is changed to a eigenvalue, where the eigenvalue is the average value of the pixel values ​​corresponding to the associated points in the reference lines corresponding to the pixel point whose gradient mean is less than the preset gradient mean.

[0135] When the pixel optimization method is mean pixel optimization, for a single pixel point, the pixel value of the pixel point is changed to the average value of the pixel values ​​corresponding to the associated points corresponding to the pixel point;

[0136] The gradient mean corresponding to a single reference line corresponding to a single pixel point is the standard deviation of the pixel values ​​corresponding to each pixel point contained in the reference line. The value of the preset gradient mean can be determined by the user according to the actual application scenario. The greater the user's demand for image processing accuracy, the smaller the value of the preset gradient mean. A preset gradient mean value is provided, and the historical records of eigenvalue pixel optimization are detected. The average value of the gradient means corresponding to the historical records that can meet the user's needs is recorded as the preset gradient mean.

[0137] Specifically, the confirmation methods of the differential correlation coefficient include:

[0138] If the mutation coefficient is greater than or equal to the preset mutation coefficient, the differential correlation coefficient is determined according to the angle disorder value and the mutation degree;

[0139] If the mutation coefficient is less than the preset mutation coefficient, the differential correlation coefficient is determined according to the proximity difference.

[0140] Among them, if the mutation coefficient is greater than or equal to the preset mutation coefficient, the differential correlation coefficient = 1 / (angle disorder value + mutation degree);

[0141] If the mutation coefficient is less than the preset mutation coefficient, the differential correlation coefficient is negatively correlated with the adjacent difference;

[0142] The method for confirming the mutation coefficient is to record a single pixel point and its corresponding associated points as analysis points, and record the standard deviation of the pixel values ​​corresponding to each analysis point as the mutation coefficient;

[0143] The value of the preset mutation coefficient can be determined by the user according to the actual application scenario. The larger the value of the preset mutation coefficient, the greater the user's need to determine the differential correlation coefficient based on the proximity difference. A preset mutation coefficient value is provided, and the historical records of the user determining the differential correlation coefficient based on the angle disorder value and the mutation degree are detected. The minimum value of the mutation coefficient corresponding to the historical records that can meet the user's needs is recorded as the preset mutation coefficient;

[0144] The angle confusion value is determined by recording the associated point whose pixel difference with the analysis point is greater than the preset pixel difference as the target associated point. The angle confusion value = (the angle corresponding to the minimum angle of the gradient line with the analysis point as the endpoint and which can contain the corresponding target associated points) / (the number of target associated points);

[0145] The mutation degree is the maximum value of the pixel difference between the analysis point and each associated point. The pixel difference between a single associated point and the analysis point is the absolute value of the difference between the pixel value corresponding to the associated point and the pixel value corresponding to the analysis point. The value of the preset pixel difference can be determined by the user according to the actual application scenario. The greater the user's demand for improved image processing accuracy, the smaller the value of the preset pixel difference. A preset pixel difference value is provided, and the preset pixel difference value is 50.

[0146] Neighborhood difference = (maximum value among the pixel means corresponding to each reference line corresponding to the analysis point) - (minimum value among the pixel means corresponding to each reference line corresponding to the analysis point);

[0147] The reference lines are the gradient lines located in the analysis area corresponding to the analysis point. The analysis area is a circle with the analysis point as the center and the reference length as the radius. The reference length is positively correlated with the mutation coefficient corresponding to the analysis point. The pixel mean corresponding to a single reference line is the average of the pixel values ​​corresponding to the pixels through which the reference line passes. The gradient line is confirmed in that, for a single pixel, the ray with the position of the pixel as the endpoint and passing through the position of the single associated point corresponding to the pixel is the gradient line. It can be understood that the number of gradient lines corresponding to a single pixel is the same as the number of associated points corresponding to the pixel.

[0148] Thus far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art may make equivalent changes or substitutions to the relevant technical features, and the technical solutions after such changes or substitutions will fall within the scope of protection of the present invention.

[0149] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that the present invention is susceptible to various modifications and variations. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be within the scope of protection of the present invention.

Claims

1. A concrete crack identification method based on image processing, characterized in that: include: Acquire an image to be analyzed, determine an image state of the image to be analyzed based on an estimated comparison deviation value and a noise pollution degree, and determine an image processing method based on the image state, wherein the image processing method includes hierarchical segmentation processing and appearance segmentation processing; In the hierarchical segmentation process, the number of segmentation pixel values ​​is determined according to the crack complexity coefficient, and the segmentation pixel value selection method is determined according to the pixel value correlation coefficient. Under the condition that the initial selection is completed, the selection optimization method is determined according to the recognition difficulty coefficient and the segmentation interaction value; The segmentation pixel value selection method is to select the segmentation pixel value according to the feature reference value or the associated threshold value, and the selection optimization method is to delete the segmentation pixel value or increase the segmentation pixel value; In the apparent segmentation process, the segmentation region is determined according to the associated anomaly combination, and the area of ​​the segmentation region is adjusted according to the edge influence coefficient; Determining an image refinement method according to the segmentation region type, wherein the image refinement method is to determine whether to perform zero-value processing on the pixel point according to the neighborhood state of the pixel point, and determining a pixel optimization method according to the differential correlation coefficient, wherein the pixel optimization method is eigenvalue pixel optimization or mean pixel optimization; When image refinement is completed, the crack area is determined based on the abnormal area in the refined image; Determine the image processing method based on the image status, including: If the image status is that the estimated comparison deviation value is greater than or equal to the preset estimated comparison deviation value or the noise pollution level is greater than or equal to the preset noise pollution level, the image processing method is hierarchical segmentation processing; If the image status is that the estimated comparison deviation value is less than the preset estimated comparison deviation value and the noise pollution level is less than the preset noise pollution level, the image processing method is the appearance segmentation processing; The image refinement method is determined based on the segmentation region type, including: For one type of segmented area, the image refinement method is to determine the pixel optimization method based on the differential correlation coefficient; For the second-class segmentation area, the image refinement method is to determine whether to perform zero-value processing on the pixel point based on the neighborhood status of the pixel point; The first type of segmented regions are segmented regions obtained through hierarchical segmentation processing, and the second type of segmented regions are adjusted segmented regions obtained through apparent segmentation processing.

2. The concrete crack identification method based on image processing according to claim 1, characterized in that: Methods for confirming the estimated comparison deviation value include: If the pixel fluctuation value is greater than or equal to the preset pixel fluctuation value, an estimated comparison deviation value is determined based on the position outlier and the pixel fluctuation value; If the pixel fluctuation value is less than the preset pixel fluctuation value, the estimated comparison deviation value is determined according to the recognition deviation coefficient.

3. The concrete crack identification method based on image processing according to claim 1, characterized in that: The number of segmentation pixel values ​​is determined according to the crack complexity coefficient, and the segmentation pixel value selection method is determined according to the pixel value correlation coefficient; If the pixel value correlation coefficient is less than the preset pixel value correlation coefficient, the segmentation pixel value selection method is to select the segmentation pixel value according to the feature reference value; If the pixel value correlation coefficient is greater than or equal to the preset pixel value correlation coefficient, the segmentation pixel value is selected according to the correlation threshold; The number of segmented pixel values ​​is positively correlated with the crack complexity coefficient.

4. The concrete crack identification method based on image processing according to claim 3 is characterized in that: The optimization method is determined based on the recognition difficulty coefficient and segmentation interaction value, including: If the recognition difficulty coefficient is greater than or equal to the preset recognition difficulty coefficient or the segmentation interaction value is less than the preset segmentation interaction value, the optimization method is to increase the segmentation pixel value; If the recognition difficulty coefficient is less than the preset recognition difficulty coefficient and the segmentation interaction value is greater than or equal to the preset segmentation interaction value, the optimization method selected is to delete the segmentation pixel value.

5. The concrete crack identification method based on image processing according to claim 4 is characterized in that: Determine the segmentation area based on the associated anomaly combination, and increase the area of ​​the segmentation area based on the edge influence coefficient; The increase in the area of ​​a single segmented region is positively correlated with the edge influence coefficient corresponding to the segmented region.

6. The concrete crack identification method based on image processing according to claim 1, characterized in that: Determine whether to perform zero-value processing on a pixel based on its neighborhood status, including: For a single pixel, If the neighborhood state is that the boundary correlation degree is greater than or equal to the preset boundary correlation degree or the characteristic coefficient is greater than or equal to the preset characteristic coefficient, the pixel point is processed as 0; If the neighborhood state is that the boundary correlation degree is less than the preset boundary correlation degree and the characteristic coefficient is less than the preset characteristic coefficient, no 0 value processing is performed on the pixel point.

7. The concrete crack identification method based on image processing according to claim 1, characterized in that: Determine the pixel optimization method based on the differential correlation coefficient, including: For a single pixel, If the differential correlation coefficient is less than the preset differential correlation coefficient, the pixel optimization method is eigenvalue pixel optimization; If the differential correlation coefficient is greater than or equal to the preset differential correlation coefficient, the pixel optimization method is mean pixel optimization.

8. The concrete crack identification method based on image processing according to claim 7 is characterized in that: The confirmation methods of differential correlation coefficient include: If the mutation coefficient is greater than or equal to the preset mutation coefficient, the differential correlation coefficient is determined according to the angle disorder value and the mutation degree; If the mutation coefficient is less than the preset mutation coefficient, the differential correlation coefficient is determined according to the proximity difference.

Images