Speckle-free three-dimensional DIC monitoring method and system for concrete rust expansion damage
By using SIFT operator in DIC technology to extract the natural texture characteristics of concrete, and improve the analysis algorithm, we realize three-dimensional DIC monitoring without speckle, solving the problems of high cost and low accuracy of artificial speckle production in the existing technology, and improving concrete Accuracy and application efficiency of structural rust swelling damage monitoring.
Patent Information
- Application Number
- CN202410077820.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-18
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2044-01-18
AI Technical Summary
The existing DIC technology requires manual speckle production in concrete structures, with high time and labor costs, and low measurement accuracy without speckle, which limits its application in actual engineering.
The scale-invariant feature transformation (SIFT) operator is used to extract the natural texture features of concrete, improve the DIC analysis algorithm, and estimate the displacement and first-order displacement gradient through the affine mapping transformation relationship before and after the deformation of the feature point, and perform iterative optimization to achieve spotlessness. 3D DIC monitoring.
It improves the DIC measurement accuracy, realizes high-precision monitoring of rust-swelling damage to concrete structural steel bars without manual speckle production, solves the cost-effective bottleneck of traditional methods, and promotes the application of DIC technology in actual engineering.
Smart Images

Figure CN117929408B_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of concrete damage monitoring, and in particular relates to a speckle-free three-dimensional DIC monitoring method and system for concrete rust expansion damage. Background Art
[0002] Digital image registration (DIC) technology has been used in the fields of concrete crack detection and structural deformation monitoring. It has many advantages such as non-contact, high precision, simple device, and real-time full-field monitoring. Since steel corrosion can cause concrete expansion deformation and cracking damage, DIC can be used to monitor rust expansion damage and invert the steel corrosion distribution to achieve the diagnosis of steel corrosion. The basic principle of DIC is to analyze the images before and after the deformation of the object to determine the displacement and deformation.
[0003] The inventors found that DIC image measurement generally requires artificial creation of speckles on the surface of an object, which is time-consuming and labor-intensive and difficult to apply to actual engineering structures, limiting the actual engineering application of DIC. If speckles are not created and DIC measurement is performed directly using the natural texture of concrete, the measurement accuracy is greatly reduced due to the lack of obvious grayscale contrast in the image. Summary of the invention
[0004] In order to overcome the shortcomings of the above-mentioned prior art, the present invention provides a speckle-free three-dimensional DIC monitoring method and system for concrete rust expansion damage, which uses a scale-invariant feature transform (SIFT) operator to extract the natural texture features of concrete, improve the DIC analysis algorithm, and improve the DIC measurement accuracy, thereby realizing speckle-free measurement of steel bar rust expansion damage.
[0005] To achieve the above objectives, one or more embodiments of the present invention provide the following technical solutions:
[0006] A first aspect of the present invention provides a speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage.
[0007] The method for monitoring concrete rust expansion damage without speckle three-dimensional DIC includes the following steps:
[0008] Collect surface images of concrete structure corrosion process;
[0009] The image of the concrete structure before deformation is used as the reference image, and the SIFT operator is used to extract the concrete surface feature points of the reference image and the image after deformation, and the affine mapping transformation relationship between the feature points before and after deformation is obtained;
[0010] Using the affine mapping transformation relationship between the feature points before and after deformation, the coordinates of any point in the reference image in the deformed image are estimated, and the displacement and first-order displacement gradient of the two are calculated;
[0011] The obtained displacement and first-order displacement gradient are iteratively optimized to obtain the final displacement and first-order displacement gradient, and then the final deformation value.
[0012] A second aspect of the present invention provides a speckle-free three-dimensional DIC monitoring system for concrete rust expansion damage.
[0013] Concrete rust expansion damage speckle-free 3D DIC monitoring system, including:
[0014] The image acquisition module is configured to: acquire surface images of the concrete structure during corrosion;
[0015] The feature point extraction and affine mapping transformation relationship solving module is configured to: use the image of the concrete structure before deformation as a reference image, use the SIFT operator to extract the concrete surface feature points of the reference image and the image after deformation, and obtain the affine mapping transformation relationship between the feature points before and after deformation;
[0016] The displacement and first-order displacement gradient obtaining module is configured to: estimate the coordinates of any point in the reference image in the deformed image by using the affine mapping transformation relationship between the feature points before and after deformation, and obtain the displacement and first-order displacement gradient of the two;
[0017] The estimation module is configured to: iteratively optimize the obtained displacement and first-order displacement gradient to obtain the optimized displacement and first-order displacement gradient, and obtain the final deformation value.
[0018] The third aspect of the present invention provides a computer-readable storage medium having a program stored thereon, which, when executed by a processor, implements the steps in the speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage as described in the first aspect of the present invention.
[0019] The fourth aspect of the present invention provides an electronic device, comprising a memory, a processor, and a program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps in the speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage as described in the first aspect of the present invention are implemented.
[0020] One or more of the above technical solutions have the following beneficial effects:
[0021] The present invention provides a speckle-free three-dimensional DIC monitoring method and system for concrete rust expansion damage. By utilizing the natural texture features of concrete, a speckle-free DIC monitoring method for steel bar rust expansion damage in concrete structure is proposed for the first time. The scale-invariant feature transform (SIFT) operator is used to extract the natural texture features of concrete, and the DIC analysis algorithm is improved to realize full-field deformation measurement. Even without artificially generated random speckles, better DIC measurement accuracy can be obtained, thus solving the technical bottleneck of the traditional DIC measurement method that requires artificially generated speckles.
[0022] The present invention uses the SIFT operator to extract the concrete surface feature points of the reference image and the deformed image, obtains the affine mapping transformation relationship between the feature points before and after deformation, estimates the coordinates of any point in the reference image in the deformed image, and obtains the displacement and first-order displacement gradient of the two; iteratively optimizes the obtained displacement and first-order displacement gradient to obtain the optimized displacement and first-order displacement gradient, and obtains the final deformation value.
[0023] Advantages of additional aspects of the present invention will be given in part in the following description, and in part will become obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.
[0025] Figure 1 This is a flow chart of the method of the first embodiment.
[0026] Figure 2 Schematic diagram of concrete surface image acquisition.
[0027] Figure 3 These are the reference image and deformed image of the speckle-free 3D DIC analysis method for concrete deformation. DETAILED DESCRIPTION
[0028] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.
[0029] It should be noted that the terms used herein are for describing specific embodiments only and are not intended to be limiting of exemplary embodiments according to the present invention.
[0030] In the absence of conflict, the embodiments of the present invention and the features of the embodiments may be combined with each other.
[0031] Embodiment 1
[0032] This embodiment discloses a speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage.
[0033] like Figure 1 , Figure 3 As shown in the figure, the speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage includes the following steps:
[0034] Collect surface images of concrete structure corrosion process;
[0035] The image of the concrete structure before deformation is used as the reference image, and the SIFT operator is used to extract the concrete surface feature points of the reference image and the image after deformation, and the affine mapping transformation relationship between the feature points before and after deformation is obtained;
[0036] Using the affine mapping transformation relationship between the feature points before and after deformation, the coordinates of any point in the reference image in the deformed image are estimated, and the displacement and first-order displacement gradient of the two are calculated;
[0037] The obtained displacement and first-order displacement gradient are iteratively optimized to obtain the optimized displacement and first-order displacement gradient, and the final deformation value is obtained.
[0038] Step S201: Figure 2 As shown, a monitoring area is selected and two cameras are used to simultaneously capture images of the surface of the concrete structure during the corrosion process;
[0039] It can be understood that the concrete structure in this embodiment includes a concrete specimen, and a steel bar is arranged in the concrete specimen. A set area on the surface of the concrete structure is selected as the monitoring area, and the monitoring area is photographed by a camera.
[0040] Step S202: Figure 3 As shown, a reference image and a deformed image are input, and a region of interest (Region of Interest) is selected.
[0041] Figure 3 (a) and Figure 3 (b) in the figure are the reference image and the deformed image, respectively, where the solid line frame is the monitoring area and the dotted line frame is the selected area of interest.
[0042] Step S203: Use SIFT operator to extract concrete surface feature points and match them to obtain the coordinates of the feature points before and after deformation, P and i =(x i ,y i ) T and Q i =(x′ i ,y′ i ) T , i=1,2…,N.
[0043] like Figure 3 (a) and Figure 3 As shown in (b), there are multiple points in the selected monitoring area and interest area, which are multiple feature points extracted.
[0044] The extraction process specifically includes the following steps:
[0045] (1) Scale space extreme value detection: Search images in all scale spaces and identify potential interest points that are invariant to scale and selection through Gaussian derivative functions.
[0046] (2) Feature point positioning: At each candidate position, a fine-tuned model is fitted to determine the position scale, and key points are selected based on their stability.
[0047] (3) Feature direction assignment: Based on the local gradient direction of the image, one or more directions are assigned to each key point position. All subsequent operations transform the direction, scale, and position of the key point to provide invariance of these features.
[0048] (4) Feature point description: In the neighborhood around each feature point, the local gradients of the image are measured at a selected scale, and these gradients are transformed into a representation that allows relatively large local shape deformations and illumination changes.
[0049] The above extraction process of steps (1) to (4) is prior art and will not be described in detail here.
[0050] Step S204: Introduce P i and Q i The six-degree-of-freedom affine mapping transformation between the feature points can be solved by solving the following linear equations based on the coordinates of the feature points before and after deformation, and the affine mapping transformation parameters a1, a2, …, a6 can be determined.
[0051]
[0052] Step S205: Using the affine mapping relationship before and after the feature point deformation, estimate Figure 3 As shown, any point t in the source area of the reference image before deformation is (x, y) T The coordinates in the target area after deformation are s = (x′, y′) T , the interpolation function uses a first-order shape function, and the corresponding displacement (u0, v0, w0) and the first-order displacement gradient (u x,0 ,u y,0 ,u z,0 );
[0053] Step S206: Using the displacement (u0, v0, w0) and the first-order displacement gradient (u x,0 ,u y,0 ,u z,0 ) as the initial value, and the IC-GN (Inverse Compositional Gauss-Newton) algorithm is used for iterative analysis.
[0054] When C LSThe iteration ends when the minimum is reached, and the final displacement (u, v, w) and the first-order displacement gradient (u x ,u y ,u z );
[0055]
[0056] Where f and g are the grayscale intensity values of the reference image and the deformed image, respectively. m and g m are the average gray intensity values of the reference image and the deformed image, respectively.
[0057] The concrete rust expansion damage non-speckle three-dimensional DIC monitoring method provided in this embodiment:
[0058] (1) The SIFT operator is used to extract the surface features of concrete, which improves the measurement accuracy of speckle-free DIC.
[0059] (2) DIC measurement can be performed without artificially creating speckles, and good measurement accuracy can be achieved, which can realize the practical engineering application of DIC;
[0060] (3) The speckle-free DIC method was used for the first time to monitor concrete rust expansion damage, achieving non-contact full-field deformation measurement, which is economical and efficient.
[0061] Embodiment 2
[0062] This embodiment discloses a speckle-free three-dimensional DIC monitoring system for concrete rust expansion damage.
[0063] Concrete rust expansion damage speckle-free 3D DIC monitoring system, including:
[0064] The image acquisition module is configured to: acquire surface images of the concrete structure during corrosion;
[0065] The feature point extraction and affine mapping transformation relationship solving module is configured to: use the image of the concrete structure before deformation as a reference image, use the SIFT operator to extract the concrete surface feature points of the reference image and the image after deformation, and obtain the affine mapping transformation relationship between the feature points before and after deformation;
[0066] The displacement and first-order displacement gradient obtaining module is configured to: estimate the coordinates of any point in the reference image in the deformed image by using the affine mapping transformation relationship between the feature points before and after deformation, and obtain the displacement and first-order displacement gradient of the two;
[0067] The estimation module is configured to: iteratively optimize the obtained displacement and first-order displacement gradient to obtain the optimized displacement and first-order displacement gradient, and obtain the final deformation value.
[0068] Embodiment 3
[0069] The purpose of this embodiment is to provide a computer-readable storage medium.
[0070] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage as described in Example 1 of the present disclosure.
[0071] Embodiment 4
[0072] The purpose of this embodiment is to provide an electronic device.
[0073] An electronic device includes a memory, a processor, and a program stored in the memory and executable on the processor. When the processor executes the program, the steps in the speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage as described in Example 1 of the present disclosure are implemented.
[0074] The steps involved in the apparatuses of the above embodiments 2, 3 and 4 correspond to the method embodiment 1, and the specific implementation methods can refer to the relevant description part of embodiment 1. The term "computer-readable storage medium" should be understood as a single medium or multiple media including one or more instruction sets; it should also be understood to include any medium that can store, encode or carry an instruction set for execution by a processor and enable the processor to execute any method in the present invention.
[0075] Those skilled in the art should understand that the modules or steps of the present invention described above can be implemented by a general-purpose computer device, or alternatively, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. The present invention is not limited to any specific combination of hardware and software.
[0076] Although the above describes the specific implementation mode of the present invention in conjunction with the accompanying drawings, it is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art on the basis of the technical solution of the present invention without creative work are still within the scope of protection of the present invention.
Claims
1. A speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage, characterized in that: The following steps are involved: Collect surface images of concrete structure corrosion process; The image of the concrete structure before deformation is used as the reference image, and the SIFT operator is used to extract the concrete surface feature points of the reference image and the image after deformation, and the affine mapping transformation relationship between the feature points before and after deformation is obtained; Using the affine mapping transformation relationship between the feature points before and after deformation, the coordinates of any point in the reference image in the deformed image are estimated, and the displacement and first-order displacement gradient of the two are calculated; Iteratively optimize the obtained displacement and first-order displacement gradient to obtain the optimized displacement and first-order displacement gradient, and obtain the final deformation value; The step of obtaining the affine mapping transformation relationship before and after the feature point deformation specifically includes: After extracting the concrete surface feature points of the reference image and the deformed image, matching the concrete surface feature points of the reference image and the deformed image is performed to obtain the coordinates of the feature points before and after deformation; Introduce the six-degree-of-freedom affine mapping transformation between the coordinates of the feature points before and after deformation, solve and determine the affine mapping transformation parameters, and determine the affine mapping transformation relationship before and after the feature points are deformed; Solve the following linear equations to determine the affine mapping transformation parameters a1, a2, …, a6: Among them, P i =(x i ,y i ) T and Q i =(x i ′,y i ′) T are the coordinates of the feature points before and after deformation, i=1,2…,N; The step of obtaining the displacement and first-order displacement gradient of the two specifically includes: The first-order shape function is used as the interpolation function to obtain the displacement (u0, v0, w0) and the first-order displacement gradient (u x,0 ,u y,0 ,u z,0 ); The displacement (u0, v0, w0) and the first-order displacement gradient (u x,0 ,u t,0 ,u z,0 ) as the initial value, and the IC-GN algorithm is used for iterative analysis. LS The iteration is terminated when the minimum is reached, and the final displacement and first-order displacement gradient are obtained; Among them, f and g are the grayscale intensity values of the reference image and the deformed image, respectively. m and g m are the average grayscale intensity values of the reference image and the deformed image, respectively. ROI is the region of interest. (x, y) is the coordinate of any point in the ROI of the reference image; (x', y') is the corresponding coordinate of the point (x, y) in the deformed image.
2. The method for monitoring concrete rust expansion damage without speckle three-dimensional DIC according to claim 1, characterized in that: The method also includes selecting regions of interest of the reference image and the deformed image, and selecting concrete surface feature points within the regions of interest.
3. The method for monitoring concrete rust expansion damage without speckle 3D DIC according to claim 1, characterized in that: The SIFT operator is used to extract the feature points of the concrete surface, including: Search images across all scales to identify potential points of interest that are invariant to scale and selection; At the location of each candidate interest point, determine the location scale and locate the feature point; Based on the local gradient direction of the image, one or more directions are assigned to each feature point position to perform feature direction assignment; In the neighborhood around each feature point, the local gradient of the image is measured at a selected scale and the gradient is transformed into a representation that describes the feature point.
4. The concrete rust expansion damage non-speckle three-dimensional DIC monitoring system is characterized by: include: The image acquisition module is configured to: acquire surface images of the concrete structure during corrosion; The feature point extraction and affine mapping transformation relationship solving module is configured to: use the image of the concrete structure before deformation as a reference image, use the SIFT operator to extract the concrete surface feature points of the reference image and the image after deformation, and obtain the affine mapping transformation relationship between the feature points before and after deformation; The step of obtaining the affine mapping transformation relationship before and after the feature point deformation specifically includes: After extracting the concrete surface feature points of the reference image and the deformed image, matching the concrete surface feature points of the reference image and the deformed image is performed to obtain the coordinates of the feature points before and after deformation; Introduce the six-degree-of-freedom affine mapping transformation between the coordinates of the feature points before and after deformation, solve and determine the affine mapping transformation parameters, and determine the affine mapping transformation relationship before and after the feature points are deformed; Solve the following linear equations to determine the affine mapping transformation parameters a1, a2, …, a6: Among them, P i =(x i ,y i ) T and Q i =(x i ′,y i ′) T are the coordinates of the feature points before and after deformation, i=1,2…,N; The displacement and first-order displacement gradient obtaining module is configured to: estimate the coordinates of any point in the reference image in the deformed image by using the affine mapping transformation relationship between the feature points before and after deformation, and obtain the displacement and first-order displacement gradient of the two; The step of obtaining the displacement and first-order displacement gradient of the two specifically includes: The first-order shape function is used as the interpolation function to obtain the displacement (u0, v0, w0) and the first-order displacement gradient (u x,0 ,u y,0 ,u z,0 ); The displacement (u0, v0, w0) and the first-order displacement gradient (u x,0 ,u y,0 ,u z,0 ) as the initial value, and the IC-GN algorithm is used for iterative analysis. LS The iteration is terminated when the minimum is reached, and the final displacement and first-order displacement gradient are obtained; Among them, f and g are the grayscale intensity values of the reference image and the deformed image, respectively. m and g m are the average grayscale intensity values of the reference image and the deformed image, respectively. ROI is the region of interest. (x, y) is the coordinate of any point in the ROI of the reference image. (x', y') is the corresponding coordinate of the point (x, y) in the deformed image. The estimation module is configured to: iteratively optimize the obtained displacement and first-order displacement gradient to obtain the optimized displacement and first-order displacement gradient, and obtain the final deformation value.
5. A computer-readable storage medium having a program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method for speckle-free three-dimensional DIC monitoring of concrete rust expansion damage as described in any one of claims 1 to 3 are implemented.
6. An electronic device comprising a memory, a processor, and a program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps in the speckle-free three-dimensional DIC monitoring method for concrete rust expansion damage as described in any one of claims 1 to 3 are implemented.
Citation Information
Cited By
Dic displacement field dynamic correction method and system based on lightweight convolutional network
CN120451712B
