Binocular camera and LiDAR combined concrete curved surface structure crack positioning and analysis method
By combining binocular cameras and LiDAR technology, three-dimensional crack positioning and analysis of concrete curved surface structures are achieved, which solves the problem that traditional methods cannot accurately obtain three-dimensional information, and improves detection efficiency and accuracy.
Patent Information
- Application Number
- CN202411058481.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-02
- Publication Date
- 2024-11-15
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Traditional image-based crack detection methods cannot accurately obtain the three-dimensional crack information of concrete curved surface structure, especially at non-positive shooting angles.
Combining binocular cameras and LiDAR technology, the three-dimensional positioning and analysis of cracks is realized through multi-angle image acquisition, point cloud data reconstruction, crack recognition model and semantic segmentation model, and the cracks are calculated by using triangulation method and Laplace constraint shrinkage algorithm. Three-dimensional coordinates and dimensions.
The precise positioning and analysis of cracks in concrete structures is realized, more complete three-dimensional spatial information is provided, the limitations of traditional methods are overcome, and the detection efficiency and accuracy are improved.
Smart Images

Figure CN118967813A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of machine vision technology, and in particular to a method for locating and analyzing cracks in a concrete curved surface structure by combining a binocular camera and LiDAR. Background Art
[0002] The loss of durability of concrete structures during service can cause huge economic and social losses. In recent years, the frequent collapse of concrete structures has further highlighted the importance of monitoring the health of in-service infrastructure and performing timely maintenance. Therefore, by detecting cracks in concrete structures and accurately locating them, effective maintenance management can be carried out at the early stage of damage, significantly extending the service life of infrastructure and reducing the occurrence of accidents.
[0003] With the rapid development of science and technology, many emerging technologies have reduced the cost of inspection and maintenance, while also greatly improving work efficiency. The method of crack detection has evolved from the initial manual contact inspection to modern automated non-contact inspection. In particular, the continuous development of computer vision has led the industry to adopt digital image processing technology to detect cracks. This technology combines high-resolution image acquisition and computer vision analysis to automatically identify cracks, greatly improving detection efficiency and accuracy.
[0004] However, due to the limitations of camera resolution and algorithm recognition accuracy, image-based methods can usually only detect partial areas of the structure and cannot directly provide information about the three-dimensional position and actual size of the crack. In addition, when the object is a curved structure or the shooting angle is tilted, crack quantification based on two-dimensional images is often not accurate enough. Summary of the invention
[0005] The present invention provides a method for locating and analyzing cracks in a concrete curved surface structure by combining a binocular camera and LiDAR, so as to solve the technical problems that the traditional image-based crack detection method cannot accurately obtain complete crack information and the crack information analysis is inaccurate under non-orthographic shooting angles.
[0006] In order to solve the above technical problems, the present invention provides the following technical solutions:
[0007] On the one hand, the present invention provides a method for locating and analyzing cracks in a concrete curved surface structure by combining a binocular camera and LiDAR, the method for locating and analyzing cracks in a concrete curved surface structure comprising:
[0008] The images of the concrete curved surface structure to be inspected are collected from multiple different angles using a binocular camera to obtain multi-angle images of the concrete curved surface structure to be inspected;
[0009] Based on the multi-angle images of the concrete curved surface structure to be detected, the complete crack contour is obtained;
[0010] Using LiDAR to collect point cloud data of the concrete curved surface structure to be detected, and based on the point cloud data collected by LiDAR, using a three-dimensional reconstruction method to obtain a three-dimensional point cloud model of the concrete curved surface structure to be detected;
[0011] Mapping the complete crack contour line into the three-dimensional point cloud model to achieve three-dimensional positioning of the crack;
[0012] The crack size is calculated based on the mapping result of the complete crack contour line in the three-dimensional point cloud model.
[0013] Furthermore, the method of obtaining a complete crack contour line based on the multi-angle image of the concrete curved surface structure to be detected includes:
[0014] Train crack recognition model and semantic segmentation model;
[0015] Use the trained crack recognition model to perform crack recognition on the multi-angle images of the concrete curved surface structure to be detected acquired by the binocular camera, and detect the images containing cracks;
[0016] Use the trained semantic segmentation model to perform semantic segmentation on the crack-containing images detected by the crack recognition model, and extract the crack contour lines in each crack-containing image;
[0017] The crack contours belonging to the same crack in different images are spliced to obtain a complete crack contour.
[0018] Furthermore, the step of splicing the crack contour lines belonging to the same crack in different images to obtain a complete crack contour line includes:
[0019] Based on the position information of the binocular camera when shooting, all images containing the cracks to be stitched are determined;
[0020] For images containing cracks to be spliced, feature point search is performed based on the crack features, and feature points belonging to the same crack in different images are matched to form paired feature points;
[0021] The overlapping areas of the images are matched based on paired feature points to perform crack stitching.
[0022] Furthermore, mapping the complete crack contour line to the three-dimensional point cloud model to achieve three-dimensional positioning of the crack includes:
[0023] Based on the parallax information of the binocular camera, the position coordinates of the complete crack contour line in the three-dimensional space are calculated by using a triangulation method, and the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of the three-dimensional point cloud model are unified into the same coordinate system;
[0024] In the coordinate system, the attributes of the point cloud surrounded by the complete crack contour line in the three-dimensional point cloud model are defined as cracks, and the attributes of the remaining other point clouds are defined as backgrounds, thereby achieving three-dimensional positioning of the cracks.
[0025] Furthermore, after defining the attributes of the point cloud surrounded by the complete crack contour line in the three-dimensional point cloud model as cracks and defining the attributes of the remaining other point clouds as background, the method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR further includes:
[0026] The point cloud of crack attributes and the point cloud of background attributes are distinguished by different colors to achieve three-dimensional positioning of the crack in the three-dimensional point cloud model.
[0027] Furthermore, the position coordinates of the complete crack contour line in three-dimensional space are calculated using a triangulation method based on the parallax information of the binocular camera, including:
[0028] Firstly, the internal parameters of the binocular camera and the triangulation method are used to calculate the coordinates of the crack contour line in three-dimensional space. Then, the position information of the binocular camera is used to verify the coordinates of the crack contour line.
[0029] Furthermore, the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of the three-dimensional point cloud model are unified into the same coordinate system, including:
[0030] According to the positional relationship between the binocular camera and the LiDAR during shooting, the three-dimensional coordinate system of the crack contour line obtained by the binocular camera and the three-dimensional coordinate system of the point cloud model are calibrated, and the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of each point cloud in the three-dimensional point cloud model are unified into the same world coordinate system.
[0031] Further, based on the mapping result of the complete crack contour line in the three-dimensional point cloud model, the crack size is calculated, including:
[0032] Extracting a point cloud of crack attributes from the three-dimensional point cloud model, and fitting the point cloud of the same crack to form a crack skeleton line based on a Laplace-constrained shrinkage algorithm;
[0033] Based on the fitted crack skeleton line, the length and width of each crack are calculated and analyzed.
[0034] On the other hand, the present invention further provides an electronic device, comprising a processor and a memory; wherein the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the above method.
[0035] In yet another aspect, the present invention further provides a computer-readable storage medium, wherein at least one instruction is stored in the storage medium, and the instruction is loaded and executed by a processor to implement the above method.
[0036] The beneficial effects brought about by the technical solution provided by the present invention include at least:
[0037] The present invention takes into account the possibility that the concrete structure may be a curved surface component, and adopts a binocular camera and a LiDAR data acquisition device, combining the multi-angle images of the concrete curved surface structure acquired by the binocular camera and the point cloud data of the concrete curved surface structure collected by the LiDAR, and realizes the effective integration of the image and the point cloud data through the triangulation technology and the acquisition equipment posture information, so as to obtain the complete crack morphology. This method fully reflects the spatial characteristics of the acquisition target, and can not only accurately locate the cracks, but also use the point cloud data to conduct in-depth analysis and calculation of the cracks, thereby realizing the precise positioning and analysis of the cracks in the concrete structure. Compared with the traditional image analysis method, the present invention can provide more complete three-dimensional spatial information of the cracks, thereby overcoming the limitations of the traditional method in three-dimensional information processing. It effectively improves the accuracy and efficiency of the positioning and analysis of the cracks in the concrete structure. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0039] Figure 1 It is a schematic diagram of the execution flow of a method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR provided in an embodiment of the present invention;
[0040] Figure 2 It is a system block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0041] In order to make the objectives, technical solutions and advantages of the present invention more clear, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.
[0042] First of all, it should be noted that in the embodiments of the present invention, words such as "exemplarily" and "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" in the present invention should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "exemplarily" is intended to present the concept in a concrete way. In addition, in the embodiments of the present invention, the meaning expressed by "and / or" can be both, or it can be either of the two.
[0043] First embodiment
[0044] In view of the problem that the traditional image-based crack detection method cannot accurately obtain complete crack information, and the crack information analysis is inaccurate under non-orthogonal shooting angles, this embodiment provides a method for locating and analyzing cracks in a concrete curved surface structure by combining a binocular camera and LiDAR. The method can be implemented by an electronic device, which can be a terminal or a server. The execution process of the method is as follows: Figure 1 As shown, the following steps are included:
[0045] S1, using a binocular camera to collect images of the concrete curved surface structure to be inspected from multiple different angles to obtain multi-angle images of the concrete curved surface structure to be inspected;
[0046] S2, obtaining the complete crack contour line based on the multi-angle image of the concrete curved surface structure to be detected;
[0047] Specifically, in this embodiment, the implementation process of the above S2 is as follows:
[0048] S21, training crack recognition model and semantic segmentation model;
[0049] S22, using the trained crack recognition model to perform crack recognition on the multi-angle images of the concrete curved surface structure to be detected acquired by the binocular camera, and using the crack recognition model to divide all the images of the concrete curved surface structure to be detected into crack images and background images, and store them separately to detect the images containing cracks;
[0050] S23, using the trained semantic segmentation model to perform semantic segmentation on the crack-containing image detected by the crack recognition model, to obtain a crack binary image, retain the crack contour shape, and extract the crack contour line;
[0051] S24, splicing the contour lines belonging to the same crack in different images to obtain a complete crack contour line;
[0052] It should be noted that for cracks that do not contain complete crack information in a single image, it is necessary to use the internal imaging principle of the binocular camera and the external relative posture information during shooting to perform crack splicing. The process is as follows:
[0053] S241, determining all images containing the cracks to be spliced based on the position information of the binocular camera when shooting;
[0054] S242, for the image containing the crack to be spliced, searching for feature points according to the crack features, matching feature points belonging to the same crack in different images to form paired feature points;
[0055] S243, matching the image overlapping areas according to the paired feature points, and performing crack stitching.
[0056] S3, using LiDAR to collect point cloud data of the concrete curved surface structure to be detected, and based on the point cloud data collected by the LiDAR, using a three-dimensional reconstruction method to obtain a three-dimensional point cloud model of the concrete curved surface structure to be detected;
[0057] S4, mapping the complete crack contour line to the three-dimensional point cloud model to achieve three-dimensional positioning of the crack;
[0058] Specifically, in this embodiment, the implementation process of the above S4 is as follows:
[0059] S41, calculating the accurate position coordinates of the complete crack contour line in the three-dimensional space by using a triangulation method based on the parallax information of the binocular camera;
[0060] Furthermore, based on the parallax information of the binocular camera, the triangulation method is used to calculate the position coordinates of the complete crack contour line in the three-dimensional space. Specifically, the internal parameters of the binocular camera and the triangulation method are first used to calculate the accurate coordinates of the contour line in the crack binary image in the three-dimensional space; then the position information of the binocular camera is used to check the coordinates of the crack contour line to obtain the final coordinates of the crack contour line.
[0061] S42, unifying the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of the three-dimensional point cloud model into the same coordinate system;
[0062] Furthermore, the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of the three-dimensional point cloud model are unified into the same coordinate system. Specifically, according to the positional relationship between the binocular camera and the LiDAR during shooting, the three-dimensional coordinate system of the crack contour line obtained by the binocular camera and the three-dimensional coordinate system of the point cloud model are calibrated so that they are located in the same coordinate system world.
[0063] S43, in the coordinate system, the attributes of the point cloud surrounded by the crack contour line in the three-dimensional point cloud model are defined as cracks, and the attributes of the remaining other point clouds are defined as background, and the point clouds with crack attributes and the point clouds with background attributes are distinguished by different colors to achieve three-dimensional positioning of the crack in the three-dimensional point cloud model.
[0064] S5, calculating the crack size based on the mapping result of the complete crack contour line in the three-dimensional point cloud model;
[0065] Specifically, in this embodiment, the implementation process of the above S5 is as follows:
[0066] S51, extracting a point cloud of crack attributes from the three-dimensional point cloud model, and fitting the point cloud of the same crack to form a crack skeleton line based on a Laplace-constrained shrinkage algorithm;
[0067] S52, calculating and analyzing the length and width of each crack based on the fitted crack skeleton line.
[0068] In summary, this embodiment provides a method for locating and analyzing cracks in a concrete curved surface structure that combines a binocular camera and LiDAR. This method takes into account the fact that the concrete structure may be a curved component, combines the multi-angle images of the concrete curved surface structure obtained by the binocular camera and the point cloud data of the concrete curved surface structure collected by LiDAR, and realizes the effective integration of the image and point cloud data through triangulation technology and the position information of the acquisition equipment to obtain the complete crack morphology. This method fully reflects the spatial characteristics of the acquisition target, and can not only accurately locate the cracks, but also use the point cloud data to conduct in-depth analysis and calculation of the cracks, thereby realizing the precise positioning and analysis of the cracks in the concrete structure. Compared with the traditional image analysis method, the method of this embodiment can provide more complete three-dimensional spatial information of the cracks, thereby overcoming the limitations of the traditional image analysis method in three-dimensional information processing. It effectively improves the accuracy and efficiency of the positioning and analysis of cracks in concrete structures.
[0069] Second embodiment
[0070] This embodiment provides an electronic device, such as Figure 2 As shown, the electronic device includes: a processor and a memory; wherein the processor and the memory can be connected via a communication bus; the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the method of the first embodiment. In addition, the electronic device may also include a transceiver, the processor and the transceiver can be connected via a communication bus, and the transceiver is used to communicate with other devices.
[0071] Next, combine Figure 2 The following is a detailed introduction to the various components of the electronic device:
[0072] Among them, the processor is the control center of the electronic device, and the electronic device may include multiple processors, each of which may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). The processor here may be a processor or a general term for multiple processing elements. For example, the processor is one or more central processing units (CPUs), or other general-purpose processors, application specific integrated circuits (ASICs), or one or more integrated circuits configured to implement an embodiment of the present invention, such as one or more microprocessors (digital signal processors, DSPs), or one or more field programmable gate arrays (field programmable gate arrays, FPGAs), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor may execute various functions of the electronic device by running or executing software programs stored in the memory and calling data stored in the memory.
[0073] In a specific implementation, as an embodiment, the processor may include one or more CPUs, such as Figure 2 The CPU0 and CPU1 shown in the figure are, of course, only exemplary.
[0074] The memory is used to store the software program for executing the solution of the present invention, and the execution is controlled by the processor. The specific implementation method can refer to the above method embodiment and will not be repeated here.
[0075] Optionally, the memory may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may be integrated with the processor or exist independently and accessed through the interface circuit ( Figure 2 The processor is coupled to the processor (not shown), which is not specifically limited in this embodiment of the present invention.
[0076] The transceiver may include a receiver and a transmitter ( Figure 2 The receiver is used to implement the receiving function, and the transmitter is used to implement the sending function. The transceiver can be integrated with the processor or exist independently and communicate with the electronic device through the interface circuit ( Figure 2 (not shown) is coupled to the processor, which is not specifically limited in this embodiment of the present invention.
[0077] In addition, it should be noted that Figure 2 The structure of the electronic device shown in the figure does not constitute a limitation on the device, and the actual device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. In addition, the technical effects achieved by the electronic device when executing the method of the first embodiment above can refer to the technical effects described in the first embodiment above, so they are not repeated here.
[0078] Third embodiment
[0079] This embodiment provides a computer-readable storage medium, which stores at least one instruction, and the instruction is loaded and executed by a processor to implement the method of the first embodiment. The computer-readable storage medium may be a ROM, a random access memory, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc. The instructions stored therein may be loaded by a processor in a terminal to execute the method.
[0080] In addition, it should be noted that the present invention can be provided as a method, an apparatus or a computer program product. Therefore, the embodiment of the present invention can be in the form of a full or partial hardware embodiment, a full or partial software embodiment or an embodiment combining software and hardware. Moreover, when implemented using software, the embodiment of the present invention can be in the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program codes. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center containing one or more available media sets. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium. The semiconductor medium may be a solid state drive.
[0081] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0082] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device, so that a series of operation steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0083] It should also be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. The terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of more restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements. In addition, the term "and / or" is only an association relationship describing the associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone, wherein A and B can be singular or plural. In addition, the character " / " in this article generally indicates that the objects before and after are in an "or" relationship, but it may also indicate an "and / or" relationship. Please refer to the context for specific understanding. "At least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or plural.
[0084] In addition, it can be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
[0085] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0086] In several embodiments provided by the present invention, it should be understood that the disclosed equipment, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of functional modules / units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.
[0087] If the method is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0088] Finally, it should be noted that the above is only a preferred embodiment of the present invention. It should be pointed out that although the preferred embodiment of the present invention has been described, for ordinary technicians in this technical field, once the basic creative concept of the present invention is known, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the protection scope of the present invention. Therefore, the attached claims are intended to be interpreted as including the preferred embodiment and all changes and modifications that fall within the scope of the embodiments of the present invention.
Claims
1. A method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR, characterized in that: The method for locating and analyzing cracks in a concrete curved surface structure comprises: The images of the concrete curved surface structure to be inspected are collected from multiple different angles using a binocular camera to obtain multi-angle images of the concrete curved surface structure to be inspected; Based on the multi-angle images of the concrete curved surface structure to be detected, the complete crack contour is obtained; Using LiDAR to collect point cloud data of the concrete curved surface structure to be detected, and based on the point cloud data collected by LiDAR, using a three-dimensional reconstruction method to obtain a three-dimensional point cloud model of the concrete curved surface structure to be detected; Mapping the complete crack contour line into the three-dimensional point cloud model to achieve three-dimensional positioning of the crack; The crack size is calculated based on the mapping result of the complete crack contour line in the three-dimensional point cloud model.
2. The method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR as claimed in claim 1, characterized in that: The method of obtaining a complete crack contour line based on the multi-angle image of the concrete curved surface structure to be detected includes: Train crack recognition model and semantic segmentation model; Use the trained crack recognition model to perform crack recognition on the multi-angle images of the concrete curved surface structure to be detected acquired by the binocular camera, and detect the images containing cracks; Use the trained semantic segmentation model to perform semantic segmentation on the crack-containing images detected by the crack recognition model, and extract the crack contour lines in each crack-containing image; The crack contours belonging to the same crack in different images are spliced to obtain a complete crack contour.
3. The method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR as claimed in claim 2, characterized in that: The step of splicing the crack contour lines belonging to the same crack in different images to obtain a complete crack contour line includes: Based on the position information of the binocular camera when shooting, all images containing the cracks to be stitched are determined; For images containing cracks to be spliced, feature point search is performed based on the crack features, and feature points belonging to the same crack in different images are matched to form paired feature points; The overlapping areas of the images are matched based on paired feature points to perform crack stitching.
4. The method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR as claimed in claim 1, characterized in that: Mapping the complete crack contour line to the three-dimensional point cloud model to achieve three-dimensional positioning of the crack, including: Based on the parallax information of the binocular camera, the position coordinates of the complete crack contour line in the three-dimensional space are calculated by using a triangulation method, and the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of the three-dimensional point cloud model are unified into the same coordinate system; In the coordinate system, the attributes of the point cloud surrounded by the complete crack contour line in the three-dimensional point cloud model are defined as cracks, and the attributes of the remaining other point clouds are defined as backgrounds, thereby achieving three-dimensional positioning of the cracks.
5. The method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR as claimed in claim 4, characterized in that: After defining the attributes of the point cloud surrounded by the complete crack contour line in the three-dimensional point cloud model as cracks and the attributes of the remaining other point clouds as background, the method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR further includes: The point cloud of crack attributes and the point cloud of background attributes are distinguished by different colors to achieve three-dimensional positioning of the crack in the three-dimensional point cloud model.
6. The method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR as claimed in claim 4, characterized in that: The method of calculating the position coordinates of the complete crack contour line in three-dimensional space by using a triangulation method based on the parallax information of the binocular camera includes: Firstly, the internal parameters of the binocular camera and the triangulation method are used to calculate the coordinates of the crack contour line in three-dimensional space. Then, the position information of the binocular camera is used to verify the coordinates of the crack contour line.
7. The method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR as claimed in claim 4, characterized in that: Unifying the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of the three-dimensional point cloud model into the same coordinate system, including: According to the positional relationship between the binocular camera and the LiDAR during shooting, the three-dimensional coordinate system of the crack contour line obtained by the binocular camera and the three-dimensional coordinate system of the point cloud model are calibrated, and the position coordinates of the complete crack contour line in the three-dimensional space and the coordinates of each point cloud in the three-dimensional point cloud model are unified into the same world coordinate system.
8. The method for locating and analyzing cracks in a concrete curved surface structure combining a binocular camera and LiDAR as claimed in claim 5, characterized in that: Calculating the crack size based on the mapping result of the complete crack contour line in the three-dimensional point cloud model includes: Extracting a point cloud of crack attributes from the three-dimensional point cloud model, and fitting the point cloud of the same crack to form a crack skeleton line based on a Laplace-constrained shrinkage algorithm; Based on the fitted crack skeleton line, the length and width of each crack are calculated and analyzed.
Citation Information
Patent Citations
Unmanned aerial vehicle multi-overlapped-remote-sensing-image method for extracting building contour line
CN104484668A
Three-dimensional model measurement method for concrete structure crack and related device
CN116152697A
Crack size measurement method, computer storage medium and system
CN116772730A
Splicing and expansion detection method for concrete structure crack
CN117314747A
Structure management device, structure management method, and structure management program
US20210018447A1
Cited By
Bridge mass concrete temperature monitoring method and system based on BIM
CN119830422A
