Apparatus for identifying road surface defects

Abstract

The application relates to the technical field of road maintenance, in particular to a device for identifying road defects, which comprises a photographing device, a drone and a terminal device, the photographing device is connected with the terminal device through a wireless network or a mobile communication network, and the photographing device is mounted on the drone. The photographing device is used for collecting road images in the flight process of the drone, and the collected road images are sent to the terminal device through the wireless network or the mobile communication network; meanwhile, the geographical position of each road image collected by the drone through the Beidou satellite positioning is obtained; then the terminal device establishes a three-dimensional road model according to the obtained road images and the geographical position of each road image, and analyzes the three-dimensional road model to obtain road defects. It can be seen that the road defects are obtained by collecting road images through the drone, and the working efficiency is greatly improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of road maintenance, in particular to a device for identifying road defects. BACKGROUND

[0002] Currently, after long-term use of expressways, various surface diseases such as uneven road surface, cracks, potholes and rutting may exist. If these defects are not discovered and repaired in time, the efficiency and safety of passing vehicles will be affected, and even the road surface will be further damaged. The common method for detecting whether the expressway road surface is damaged is to have staff manually detect, that is, to arrange staff to detect whether the road surface is damaged at certain intervals, or to receive public reports of road damage. This method for discovering road damage is usually very lagging and requires a large amount of manpower. Therefore, it is necessary to provide a more timely and efficient road defect detection device. SUMMARY

[0003] The present application aims to provide a device for identifying road defects, so as to automatically collect road images and understand the road conditions in time through image analysis, thereby improving the work efficiency of road detection.

[0004] In order to achieve the above-mentioned purpose, the technical solutions adopted by the embodiments of the present application are as follows:

[0005] In a first aspect, the embodiments of the present application provide a device for identifying road defects, which comprises a photographic device, a drone and a terminal device. The photographic device and the terminal device are connected through a wireless network or a mobile communication network, and the photographic device is mounted on the drone. The photographic device collects road images during the flight of the drone and transmits the road images to the terminal device through the wireless network or the mobile communication network. The geographic position of each road image collected by the drone is located by a Beidou satellite. The terminal device establishes a three-dimensional road model according to the obtained road images and the geographic position of each road image, and analyzes the three-dimensional road model to obtain the road defects.

[0006] In a second aspect, the embodiment of the present application further provides a device for identifying road surface defects, which comprises a digital camera, a tilt photography camera, a UAV and a terminal device, the digital camera and the tilt photography camera are connected with the terminal device through a wireless network or a mobile communication network, and the digital camera and the tilt photography camera are mounted on the UAV; the digital camera and the tilt photography camera collect road surface images in different directions during the flight of the UAV, and transmit the collected road surface images to the terminal device through the wireless network or the mobile communication network; the geographic position of each road surface image collected by the UAV is located through the Beidou satellite; the terminal device establishes a three-dimensional road surface model according to the obtained road surface images and the geographic position of each road surface image, and analyzes the three-dimensional road surface model to obtain the road surface defects.

[0007] The device for identifying road surface defects provided by the embodiment of the present application comprises a photography device, a UAV and a terminal device, the photography device is connected with the terminal device, and the photography device is mounted on the UAV. The photography device is used for collecting road surface images during the flight of the UAV, and simultaneously locates the geographic position of each road surface image collected by the UAV through the Beidou satellite. Then, the terminal device establishes a three-dimensional road surface model according to the obtained road surface images and the geographic position of each road surface image, and analyzes the three-dimensional road surface model to obtain the road surface defects. It can be seen that, the road surface defects are analyzed by collecting road surface images through the UAV, so that the work efficiency is greatly improved.

[0008] In order to make the above objectives, characteristics and advantages of the present application more obvious and easy to understand, the following preferred embodiments are specifically described below, and the accompanying drawings are used for detailed description. BRIEF DESCRIPTION OF DRAWINGS

[0009] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and should not be regarded as a limitation to the scope. For those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0010] Figure 1 The structure schematic diagram of the device for identifying road surface defects provided by the embodiment of the present application is shown.

[0011] Figure 2 The structure schematic diagram of the photography device provided by the embodiment of the present application is shown.

[0012] The structure schematic diagram of the photography device provided by the embodiment of the present application is shown. DETAILED DESCRIPTION

[0013] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely to illustrate selected embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the scope of protection of the present invention.

[0014] It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. Furthermore, in the description of this invention, terms such as "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0015] To promote economic development, more and more highways are being built. However, highway maintenance is a key issue. Highways often suffer from various problems such as uneven road surfaces, cracks, potholes, and ruts due to various reasons. Current maintenance methods typically involve regular inspections by workers, which are inefficient and have a limited scope. Therefore, this invention provides a device for identifying road surface defects. This device uses a more efficient method to identify road surface defects over a large area of ​​highways, greatly improving work efficiency.

[0016] Please refer to Figure 1 This is a schematic diagram of a device for identifying road surface defects according to an embodiment of the present invention. The device includes a drone 110, a camera 120, a terminal device 130, and a base station 140. Both the camera 120 and the base station 140 are connected to the terminal device 130. The camera 120 is mounted on the drone 110 and is used to collect road surface images while the drone 110 is flying along a highway. Specifically, the camera 120 is connected to the terminal device 130 via a wireless network or a mobile communication network. The wireless network includes WiFi and other connection methods, and the mobile communication network includes 3G, 4G, or 5G networks and other connection methods.

[0017] Please refer to Figure 2This is a schematic diagram of the structure of a photographic device 120 provided in an embodiment of the present invention. The photographic device 120 can be multiple digital cameras 121. During installation, the multiple digital cameras 121 can be installed at different positions on the drone 110 to facilitate the acquisition of road images from different angles under the same scene.

[0018] As another implementation, the photography device 120 can be a single oblique photogrammetry camera 122, which is equipped with multiple cameras and can simultaneously capture road surface images from five different angles, such as one vertical angle and four oblique angles, so as to bring the user into a real and intuitive world that conforms to human vision.

[0019] As another implementation, the photographic device 120 can be a combination of a digital camera 121 and an oblique photogrammetry camera 122. During installation, the digital camera 121 and the oblique photogrammetry camera 122 can be installed in different positions so that the digital camera 121 and the oblique photogrammetry camera 122 can capture an all-around image of the current scene to obtain more material.

[0020] Then, the camera 120 will send multiple road surface images to the terminal device 130. This terminal device 130 can be a desktop computer or other electronic device with computing and processing capabilities. It should be noted that the camera 120 can simultaneously capture and send road surface images to the terminal device 130. Furthermore, the camera 120 can also send all road surface images captured during the drone 110's flight to the terminal device 130 after the drone 110 has stopped flying.

[0021] In addition, the BeiDou satellite will also locate the position of the UAV 110 when it collects road images, so that the corresponding location can be quickly found after the road defects are identified through image recognition analysis.

[0022] The specific implementation is as follows: A base station 140 is set up on the ground. This base station 140 can be used to receive BeiDou satellite signals to determine the first coordinate position. Since the base station 140 is fixed, the first coordinate position determined by the BeiDou satellite signals is more accurate. The base station 140 then sends the determined first coordinate position to the terminal device 130. In addition, the drone 110 is also equipped with a BeiDou satellite signal receiver. This receiver receives BeiDou satellite signals to determine the current second coordinate position of the drone 110 and sends this second coordinate position to the terminal device 130. The terminal device 130 then performs differential processing on the first and second coordinate positions to determine the geographical location of each road image captured by the drone. By using the first coordinate position to perform differential processing on the second coordinate position, the location of the drone 110 is more accurate, achieving higher precision than the coordinate position determined directly by the BeiDou satellite signal receiver on the drone 110.

[0023] It should also be noted that if the camera device 120 sends the collected road surface images to the terminal device 130 in real time, the drone 110 will also send the located geographical location to the terminal device 130 in real time to correspond with the road surface images; if the camera device 120 sends the collected road surface images to the terminal device 130 after the drone 110 has stopped flying, since the camera device 120 collects road surface images at predetermined intervals, it can also associate the different scenes in the road surface images with the real-time located geographical location.

[0024] Furthermore, the terminal device 130 will establish a three-dimensional road surface model based on the acquired road surface images and the geographical location of each road surface image, and analyze the three-dimensional road surface model to determine road surface defects. The specific implementation method is as follows:

[0025] First, the terminal device 130 will build a three-dimensional road surface model according to a predetermined algorithm based on the acquired multiple road surface images and the geographical location corresponding to each road surface image, and present it to the user in a more three-dimensional way.

[0026] Secondly, the terminal device 130 will analyze the three-dimensional road surface model to identify road defects. The analysis method is as follows: the terminal device 130 can calculate the distance between multiple coordinate points randomly selected by the user on the three-dimensional road surface model to obtain road surface undulation data. This data is then compared with preset road surface undulation data. If the difference between the current road surface undulation data and the preset data exceeds a threshold, it indicates that the current road section is too high or too low, and therefore, the road section may have already been damaged.

[0027] Alternatively, the terminal device 130 can also perform image recognition on any local image of the user-selected 3D road surface model to determine whether the local image contains road defects such as cracks, potholes, damage, ruts, and backflow. The recognition method can be that the terminal device 130 has previously collected a large number of ground defect samples and trained them in a classifier, such as collecting various types of crack samples, pothole samples, damage samples, rut samples, and backflow samples. Then, the terminal device 130 can directly input the user-selected local image into the classifier for recognition, thereby determining whether the local image contains road defects. This achieves autonomous recognition of road defects, greatly saving manual workload.

[0028] Therefore, the present invention provides a device for identifying road surface defects. It uses a drone equipped with a camera to collect road surface images and performs three-dimensional modeling on the road surface images to present the overall road surface condition to the user more intuitively. At the same time, it can respond to the user's selection to identify road surface defects on any road segment selected by the user, which greatly improves the accuracy of road surface detection and saves the workload of staff.

[0029] In summary, the present invention provides a device for identifying road surface defects. This device includes a photographic device, a drone, and a terminal device. The photographic device is connected to the terminal device and is mounted on the drone. The photographic device is used to acquire road surface images during the drone's flight. Simultaneously, it uses BeiDou satellite positioning to acquire the geographical location of each road surface image. The terminal device then builds a three-dimensional road surface model based on the acquired road surface images and their geographical locations, and analyzes the three-dimensional road surface model to deduce road surface defects. Therefore, this solution, by using a drone to acquire road surface images for analysis and defect identification, significantly improves work efficiency.

[0030] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can also be implemented in other ways. The apparatus embodiments described above are merely illustrative; for example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0031] In addition, the functional modules in the various embodiments of the present invention can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0032] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0033] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the invention should be included within the scope of protection of the invention. It should be noted that similar reference numerals and letters in the following figures denote similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0034] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A device for identifying road surface defects, characterized in that, The device includes a camera, a drone, and a terminal device. The camera is connected to the terminal device via a wireless network or a mobile communication network, and the camera is mounted on the drone. The photographic equipment captures road surface images during the flight of the drone and transmits the road surface images to the terminal device via a wireless network or mobile communication network; The geographical location of each road surface image collected by the drone is determined by the BeiDou satellite positioning system. The terminal device establishes a three-dimensional road surface model based on the acquired road surface images and the geographical location of each image, and analyzes the three-dimensional road surface model to derive the road surface defects; wherein, The terminal device analyzes the spacing between multiple randomly selected coordinate points on the three-dimensional road surface model to obtain road surface undulation data, and compares the road surface undulation data with preset road surface undulation data. If the difference between the road surface undulation data and the preset road surface undulation data is greater than a threshold, it indicates that the current road section is too high or too low.

2. The apparatus as claimed in claim 1, characterized in that, A reference station is set up on the ground. The reference station determines the first coordinate position by receiving Beidou satellite signals and sends the first coordinate position to the terminal device for accurate positioning of the detected road surface. The drone is also equipped with a Beidou satellite signal receiver, which is used to receive Beidou satellite signals to determine the current second coordinate position of the drone and send the second coordinate position to the terminal device. The terminal device performs differential processing on the first coordinate position and the second coordinate position to determine the geographical location of each road image collected by the UAV.

3. The apparatus as described in claim 1, characterized in that, The terminal device performs image recognition on any selected local image on the three-dimensional model to analyze whether there are road surface defects in the local image. The road surface defects include cracks, potholes, damage, ruts, and water seepage.

4. The apparatus as claimed in claim 1, characterized in that, The photographic equipment consists of multiple digital cameras. The digital cameras are multiple and installed at different locations on the drone to capture road images from multiple angles.

5. The apparatus as claimed in claim 1, characterized in that, The photographic equipment is an oblique photogrammetry camera. The oblique photogrammetry camera acquires road surface images from different angles through multiple cameras mounted on it.

6. The apparatus as claimed in claim 1, characterized in that, The photographic equipment includes a digital camera and an oblique photogrammetry camera. The digital camera and the oblique photogrammetry camera are respectively set at different positions of the UAV to collect road surface images from different directions.

7. A device for identifying road surface defects, characterized in that, The device includes a digital camera, an oblique photogrammetry camera, a drone, and a terminal device. The digital camera, the oblique photogrammetry camera, and the terminal device are connected via a wireless network or a mobile communication network. The digital camera and the oblique photogrammetry camera are mounted on the drone. The digital camera and oblique photogrammetry camera acquire road surface images from different directions during the flight of the UAV, and transmit the acquired road surface images to the terminal device through a wireless network or mobile communication network. The geographical location of each road surface image collected by the drone is determined by the BeiDou satellite positioning system. The terminal device establishes a three-dimensional road surface model based on the acquired road surface images and the geographical location of each image, and analyzes the three-dimensional road surface model to derive the road surface defects; wherein, The terminal device analyzes the spacing between multiple randomly selected coordinate points on the three-dimensional road surface model to obtain road surface undulation data, and compares the road surface undulation data with preset road surface undulation data. If the difference between the road surface undulation data and the preset road surface undulation data is greater than a threshold, it indicates that the current road section is too high or too low.

8. The apparatus as claimed in claim 7, characterized in that, A reference station is set up on the ground. The reference station determines the first coordinate position by receiving Beidou satellite signals and sends the first coordinate position to the terminal device for accurate positioning of the detected road surface. The drone is also equipped with a Beidou satellite signal receiver, which is used to receive Beidou satellite signals to determine the current second coordinate position of the drone and send the second coordinate position to the terminal device. The terminal device performs differential processing on the first coordinate position and the second coordinate position to determine the geographical location of each road image collected by the UAV.

Images