Road surface distress detection methods and systems

Abstract

This invention provides a method and system for detecting road surface defects. The method includes: acquiring road surface images; extracting information about road surface defects, including their location, from the images; obtaining multiple related location points of the defects; obtaining the optimal location point of the defects based on the multiple related location points; and marking the defects on a BIM model based on the optimal location point. The BIM model stores three-dimensional data of the road. In this invention, by acquiring road surface images and analyzing the images for defects, the location of road surface defects can be automatically and quickly obtained. Furthermore, by obtaining the optimal location point of the defects based on multiple related location points, the optimal location point can be determined, and the defects can be marked on the BIM model based on this optimal location point. This makes the marking of road surface defects more accurate, thus facilitating search and location.

Description

Technical Field

[0001] This invention relates to the field of road surface inspection technology, and in particular to a method and system for detecting road surface defects. Background Technology

[0002] In current technologies, the detection of road surface defects mainly relies on manual inspection, which is difficult to monitor in real time, time-consuming, labor-intensive, and has low accuracy. On the one hand, due to the lack of models and useful tools, inspectors can only describe the location of defects in words, making it difficult for remediation personnel to accurately pinpoint the exact location of the defects. On the other hand, tens of thousands of as-built documents and existing roads are difficult to accurately match, making it difficult to locate defects and find relevant data, resulting in low efficiency in defect treatment and even affecting public travel. Summary of the Invention

[0003] This invention provides a method and system for detecting pavement defects, which solves the problem that existing pavement defect detection technologies are difficult to locate and find, resulting in low efficiency in the treatment of pavement defects.

[0004] To solve the above-mentioned technical problems, the present invention is implemented as follows:

[0005] In a first aspect, embodiments of the present invention provide a method for detecting pavement defects, including:

[0006] Collect images of the road surface;

[0007] Information about road surface defects, including their location, is extracted from the road surface image.

[0008] Obtain multiple relevant location points of the road surface defects;

[0009] The optimal location point of the road surface defect is obtained based on the multiple related location points;

[0010] The pavement defects are marked on the BIM model based on their optimal location points, wherein the BIM model stores the three-dimensional data of the road.

[0011] Optionally, multiple relevant location points of the pavement defects are obtained, including:

[0012] Obtain a circle with the location of the road surface defect as the center and a preset length as the diameter, wherein the preset length is on the order of millimeters;

[0013] Multiple relevant location points were collected within the circle.

[0014] Optionally, multiple relevant location points are collected within the circle, including:

[0015] Multiple relevant location points are randomly collected within the circle;

[0016] or

[0017] If the road surface defect is a crack, multiple relevant location points are collected on both sides of the crack.

[0018] Optionally, multiple relevant location points of the pavement defects are obtained, including:

[0019] Obtain at least six location points on the road surface defects;

[0020] At least two circles are determined using the aforementioned at least six location points;

[0021] Select the plurality of relevant location points from the intersection region of the at least two circles.

[0022] Optionally, obtaining the optimal location point of the pavement defect based on the plurality of related location points includes:

[0023] The optimal location points of the pavement defects are obtained by inputting the multiple relevant location points into the least squares method, K-means clustering algorithm, or Ocerlap clustering algorithm model to find the optimal solution.

[0024] Optionally, based on the optimal location point of the pavement distress, the pavement distress is marked on the BIM model, further including:

[0025] Based on the collected road data, a 3D model of the road is created to obtain the BIM model.

[0026] Optionally, based on the optimal location point of the pavement distress, the pavement distress is marked on the BIM model, and then the process further includes:

[0027] The pavement defects are displayed according to the user's preset operations on the pavement defects marked on the BIM model. The preset operations include at least one of the following: rotation, translation, zoom in, and zoom out.

[0028] Secondly, embodiments of the present invention provide a road surface defect detection system, comprising:

[0029] The acquisition module is used to acquire images of the road surface.

[0030] An extraction module is used to extract information about road surface defects from the road surface image, the information including location;

[0031] The first acquisition module is used to acquire multiple relevant location points of the road surface defects;

[0032] The second acquisition module is used to acquire the optimal location point of the road surface defect based on the multiple related location points;

[0033] The marking module is used to mark the road surface defects on the BIM model according to the optimal location points of the road surface defects, wherein the BIM model stores the three-dimensional data of the road.

[0034] Optionally, the first acquisition module is used to obtain a circle with the location of the road surface defect as the center and a preset length as the diameter, the preset length being on the order of millimeters; and to collect multiple relevant location points within the circle.

[0035] Optionally, the first acquisition module is used to randomly collect multiple relevant location points within the circle; or, if the road surface defect is a crack, to collect multiple relevant location points on both sides of the crack respectively.

[0036] Optionally, the first acquisition module is used to acquire at least six location points on the road surface defect; determine at least two circles using the at least six location points; and select the plurality of related location points from the intersection area of ​​the at least two circles.

[0037] Optionally, the second acquisition module is used to input the multiple related location points into the least squares method, K-means clustering algorithm, or Ocerlap clustering algorithm model to find the optimal solution and obtain the optimal location point of the pavement distress.

[0038] Optionally, the pavement defect detection system further includes:

[0039] The modeling module is used to perform three-dimensional modeling of the road based on the collected road data to obtain the BIM model.

[0040] Optionally, the pavement defect detection system further includes:

[0041] The display module is used to display the pavement defects marked on the BIM model according to the user's preset operations, the preset operations including at least one of the following: rotation, translation, zoom in and zoom out.

[0042] Thirdly, embodiments of the present invention provide an electronic device, including: a processor, a memory, and a program stored in the memory and executable on the processor, wherein when the program is executed by the processor, it implements the steps of the road surface defect detection method as described in the first aspect above.

[0043] Fourthly, embodiments of the present invention provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the road surface defect detection method described in the first aspect above.

[0044] In this embodiment of the invention, by acquiring road surface images and performing road surface defect analysis on the images, the location of road surface defects can be obtained automatically and quickly. Furthermore, based on multiple related location points of the road surface defect points, the optimal location point of the road surface defect can be obtained, and the road surface defect is marked on the BIM model based on the optimal location point, making the marking of road surface defects more accurate, thereby facilitating search and location, and improving the efficiency of road surface defect treatment. Attached Figure Description

[0045] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0046] Figure 1 This is a schematic flowchart of the pavement distress detection method according to an embodiment of the present invention;

[0047] Figure 2 This is a schematic diagram of a method for obtaining multiple relevant location points of road surface defects according to an embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram of the pavement defect detection system according to an embodiment of the present invention;

[0049] Figure 4 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0050] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0051] Please refer to Figure 1 This invention provides a method for detecting pavement defects, comprising:

[0052] Step 11: Acquire images of the road surface;

[0053] In this embodiment of the invention, the road surface image can be collected by cameras installed on the road or other on-site inspection equipment.

[0054] Step 12: Extract information about road surface defects from the road surface image, including the location;

[0055] In addition to location, the information on pavement defects may include at least one of the following: the time when the pavement defects were acquired, the type of pavement defects, the shape and size of the pavement defects, etc.

[0056] Specifically, pavement distress analysis is performed on the collected pavement images, and information on pavement distress is extracted from the images containing pavement distress based on the analysis results.

[0057] Step 13: Obtain multiple relevant location points of the road surface defects;

[0058] Step 14: Obtain the optimal location point of the road surface defect based on the multiple relevant location points;

[0059] Step 15: Mark the pavement defects on the BIM (Building Information Modeling) model according to the optimal location of the pavement defects, wherein the BIM model stores the three-dimensional data of the road.

[0060] BIM technology is a data-driven tool applied to engineering design, construction, and management. By integrating digitized and information-based models of buildings, it facilitates sharing and transmission throughout the entire lifecycle of project planning, operation, and maintenance. This enables engineering technicians to correctly understand and efficiently respond to various building information, providing a foundation for collaborative work for design teams and all parties involved in the construction, including building and operation units. It plays a crucial role in improving productivity, saving costs, and shortening construction periods.

[0061] In this invention, by collecting road surface images and performing road surface defect analysis, the location of road surface defects can be automatically and quickly obtained. Furthermore, based on multiple related location points of the road surface defect points, the optimal location point of the road surface defect can be obtained, and the road surface defect is marked on the BIM model according to the optimal location point, making the marking of road surface defects more accurate, thereby facilitating search and location and improving the efficiency of road surface defect treatment.

[0062] Please refer to Figure 2 In one embodiment of the present invention, optionally, obtaining multiple relevant location points of the pavement defects includes:

[0063] Step 131a: Obtain a circle with the location of the road surface defect as the center and a preset length as the diameter, wherein the preset length is on the order of millimeters;

[0064] Optionally, the preset length is greater than 0 and less than or equal to 5 millimeters, thereby reducing the error.

[0065] Step 132a: Collect multiple relevant location points within the circle.

[0066] Optionally, multiple relevant location points can be randomly collected within the circle, or if the road surface defect is a crack, multiple relevant location points can be collected on both sides of the crack.

[0067] In another embodiment of the present invention, optionally, obtaining multiple relevant location points of the pavement defects includes:

[0068] Step 131b: Obtain at least six location points on the road surface defects;

[0069] Step 132b: Using the at least six location points, determine at least two circles, and select the plurality of related location points from the intersection region of the at least two circles.

[0070] For example, if the disease is a crack, six location points can be selected on the crack. Each set of three adjacent location points determines a circle, and the intersection area of ​​two circles is determined. Multiple relevant location points are then selected in the intersection area.

[0071] In this embodiment of the invention, optionally, obtaining the optimal location point of the pavement distress based on the plurality of related location points includes: inputting the plurality of related location points into a least squares method, a K-means clustering algorithm, or an Ocerlap clustering algorithm model to find the optimal solution, thereby obtaining the optimal location point of the pavement distress.

[0072] The least squares method is an optimization method that mainly minimizes the square of the error and the matching function of the most suitable data. Its functions are: (1) The least squares method can be used to obtain location data (the sum of the squares of the errors between these data and the actual data is minimized); (2) It can also be used for curve fitting.

[0073] When using the least squares method to find the optimal solution, the following formula can be used:

[0074]

[0075] Where E is the expected value With input value y i The difference (i.e., error, or residual) between the relevant location points makes the expected value... With input value y i The goal is to minimize the difference in the result, that is, to control the minimum error so that the result is close to the true value.

[0076] In this embodiment of the invention, since the error in locating the location of the disease is caused by factors such as the size and shape of the disease, the approximate range of the disease location can be determined intuitively without the need to collect large-scale sample data. This is also the advantage of the above-mentioned method of finding the optimal solution for road surface disease detection.

[0077] In this embodiment of the invention, optionally, the road surface defects are marked on the BIM model according to the optimal location point of the road surface defects. Before this, the method further includes: performing three-dimensional modeling of the road based on the collected road data to obtain the BIM model.

[0078] In this embodiment of the invention, a 3D model of a real road can be created using Revit at a 1:1 scale, complete with road information. The Revit suite of software is built for BIM and helps architects design, construct, and maintain higher-quality, more energy-efficient buildings.

[0079] In this embodiment of the invention, optionally, the pavement defects are marked on the BIM model according to the optimal location point of the pavement defects. Then, the method further includes: displaying the pavement defects marked on the BIM model according to the user's preset operation on the pavement defects marked on the BIM model. The preset operation includes at least one of the following: rotation, translation, zoom in and zoom out, so as to facilitate viewing.

[0080] The method of this invention solves the problem of inaccurate location of road surface defects. It can more accurately present the location of road surface defects on the BIM model system platform. Users can remotely monitor road conditions in real time through the BIM model system platform, reducing labor costs. Accurate location of defects enables inspection personnel to arrive in time for inspection, eliminate potential safety hazards, and provide solutions for road maintenance-related projects, which has certain commercial value.

[0081] Please refer to Figure 3 This invention provides a pavement defect detection system 30, comprising:

[0082] Acquisition module 31 is used to acquire images of the road surface;

[0083] Extraction module 32 is used to extract information about road surface defects from the road surface image, the information including location;

[0084] The first acquisition module 33 is used to acquire multiple relevant location points of the road surface defects;

[0085] The second acquisition module 34 is used to acquire the optimal location point of the road surface defect based on the plurality of related location points;

[0086] The marking module 35 is used to mark the road surface defects on the BIM model according to the optimal location points of the road surface defects, wherein the BIM model stores the three-dimensional data of the road.

[0087] In this embodiment of the invention, by acquiring road surface images and performing road surface defect analysis on the images, the location of road surface defects can be automatically and quickly obtained. Furthermore, based on multiple related location points of the road surface defect points, the optimal location point of the road surface defect can be obtained, and the road surface defect is marked on the BIM model based on the optimal location point, making the marking of road surface defects more accurate, thereby facilitating search and location, and improving the efficiency of road surface defect treatment.

[0088] Optionally, the first acquisition module 33 is used to acquire a circle with the location of the road surface defect as the center and a preset length as the diameter, the preset length being on the order of millimeters; and to collect multiple relevant location points within the circle.

[0089] Optionally, the preset length is greater than 0 and less than or equal to 5 millimeters.

[0090] Optionally, the first acquisition module is used to randomly collect multiple relevant location points within the circle; or, if the road surface defect is a crack, to collect multiple relevant location points on both sides of the crack respectively.

[0091] Optionally, the first acquisition module 33 is used to acquire at least six location points on the road surface defect; determine at least two circles using the at least six location points; and select the plurality of related location points from the intersection area of ​​the at least two circles.

[0092] Optionally, the second acquisition module 34 is used to input the multiple related location points into the least squares method, K-means clustering algorithm, or Ocerlap clustering algorithm model to find the optimal solution and obtain the optimal location point of the pavement distress.

[0093] Optionally, the pavement defect detection system further includes:

[0094] The modeling module is used to perform three-dimensional modeling of the road based on the collected road data to obtain the BIM model.

[0095] Optionally, the pavement defect detection system 30 further includes:

[0096] The display module (not shown in the figure) is used to display the pavement defects marked on the BIM model according to the user's preset operation. The preset operation includes at least one of the following: rotation, translation, zoom in and zoom out.

[0097] Please refer to Figure 4The present invention also provides an electronic device 40, including a processor 41, a memory 42, and a computer program stored in the memory 42 and executable on the processor 41. When the computer program is executed by the processor 41, it implements the various processes of the above-described road surface defect detection method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0098] This invention also provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the above-described road surface defect detection method embodiments and achieves the same technical effects. To avoid repetition, it will not be described again here. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0099] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0100] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0101] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of the present invention.

Claims

1. A method for detecting pavement defects, characterized in that, include: Collect images of the road surface; Information about road surface defects, including their location, is extracted from the road surface image. Obtain multiple relevant location points of the road surface defects; The optimal location point of the road surface defect is obtained based on the multiple related location points; Based on the optimal location of the road surface defects, the road surface defects are marked on the BIM model, wherein the BIM model stores the three-dimensional data of the road. The process of obtaining the optimal location point of the pavement distress based on the multiple related location points includes: inputting the multiple related location points into a least squares method, a K-means clustering algorithm, or an Ocerlap clustering algorithm model to find the optimal solution, thereby obtaining the optimal location point of the pavement distress.

2. The method according to claim 1, characterized in that, Obtain multiple relevant location points of the road surface defects, including: Obtain a circle with the location of the road surface defect as the center and a preset length as the diameter, wherein the preset length is on the order of millimeters; Multiple relevant location points were collected within the circle.

3. The method according to claim 2, characterized in that, Multiple relevant location points are collected within the circle, including: Multiple relevant location points are randomly collected within the circle; or If the road surface defect is a crack, multiple relevant location points are collected on both sides of the crack.

4. The method according to claim 1, characterized in that, Obtain multiple relevant location points of the road surface defects, including: Obtain at least six location points on the road surface defects; At least two circles are determined using the aforementioned at least six location points; Select the plurality of relevant location points from the intersection region of the at least two circles.

5. The method according to claim 1, characterized in that, Based on the optimal location of the pavement distress, mark the pavement distress on the BIM model, which also includes: Based on the collected road data, a 3D model of the road is created to obtain the BIM model.

6. The method according to claim 1, characterized in that, Based on the optimal location of the pavement distress, mark the pavement distress on the BIM model, and then include: The pavement defects are displayed according to the user's preset operations on the pavement defects marked on the BIM model. The preset operations include at least one of the following: rotation, translation, zoom in, and zoom out.

7. A road surface defect detection system, characterized in that, include: The acquisition module is used to acquire images of the road surface. An extraction module is used to extract information about road surface defects from the road surface image, the information including location; The first acquisition module is used to acquire multiple relevant location points of the road surface defects; The second acquisition module is used to acquire the optimal location point of the pavement distress based on the plurality of related location points; wherein, acquiring the optimal location point of the pavement distress based on the plurality of related location points includes: inputting the plurality of related location points into the least squares method or K-means clustering algorithm or Ocerlap clustering algorithm model to find the optimal solution, thereby obtaining the optimal location point of the pavement distress; The marking module is used to mark the road surface defects on the BIM model according to the optimal location points of the road surface defects, wherein the BIM model stores the three-dimensional data of the road.

8. An electronic device, characterized in that, include: A processor, a memory, and a program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the steps of the pavement distress detection method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the pavement distress detection method as described in any one of claims 1 to 6.

Images