A road inspection system and an inspection method

Abstract

The application discloses a road inspection system and an inspection method. The scheme provided by the application collects road image information through access to various new inspection modes such as unmanned aerial vehicles and vehicle-mounted cameras. An AI computing model in the system performs pre-identification processing on the road image information through AI computing power to obtain road inspection identification information, helps inspectors make decisions and provides auxiliary prompts. Meanwhile, the system is connected with other linkage system platforms through a full-factor management module, linkage query, analysis and prediction of the system are realized, road risks are predicted, processed and solved early, and the automation of inspection, the efficiency of inspection and the cost of inspection are effectively improved.

Description

Technical Field

[0001] This application relates to the field of road traffic inspection technology, and in particular to a road inspection system and inspection method. Background Technology

[0002] Conventional road patrols cover a wide range, including urban main roads and rural roads. They rely mainly on manual judgment and post-event tracing, resulting in low automation. This leads to frequent traffic accidents, road damage, and other hidden dangers. Furthermore, the massive amounts of patrol data are difficult to analyze, and the traffic information systems are independent, making cross-system collaboration difficult. Consequently, there are technical problems such as high patrol costs and low efficiency. Summary of the Invention

[0003] This application provides a road inspection system and method to solve the technical problems of high inspection cost and low efficiency in existing road inspection methods.

[0004] To address the aforementioned technical issues, the first aspect of this application provides a road inspection system, comprising: a full-element management module, a road image acquisition module, a linkage platform access module, a 5G routing module, an AI computing module, and an input / output module;

[0005] The road image acquisition module and the linkage platform access module are both communicatively connected to the 5G routing module. The 5G routing module is communicatively connected to the all-element management module and the AI ​​computing module, respectively. The input / output module is communicatively connected to the all-element management module.

[0006] The road image acquisition module has a built-in camera device for acquiring road image information, and the linkage platform access module is used to connect with an external information platform to obtain platform data from the external information platform.

[0007] The 5G routing module is used to control 5G route allocation;

[0008] The AI ​​computing module is used to identify the road condition based on the road image information and the onboard AI recognition model to obtain road inspection and recognition information.

[0009] The full-element management module is used to generate information display data from the received road image information, platform data, and road inspection and identification information through a built-in visualization algorithm, and then process the display data through the input / output module.

[0010] Preferably, the road image acquisition module includes: an unmanned aerial vehicle (UAV) image acquisition module.

[0011] Preferably, the road image acquisition module further includes: a vehicle-mounted video acquisition module and / or a fixed road video acquisition module.

[0012] Preferably, the external information platform includes a geographic building data platform.

[0013] Preferably, the external information platform further includes: a meteorological data platform and / or a network communication platform.

[0014] Preferably, the input / output module includes an input submodule and an output submodule, wherein the input submodule includes a keyboard and mouse device and / or a remote control device, and the output submodule includes a display device and an audio device.

[0015] Meanwhile, the second aspect of this application provides a road inspection method, applied to a road inspection system as provided in the first aspect of this application, comprising:

[0016] Receive road image information and platform data obtained from the road image acquisition module and the linkage platform access module;

[0017] Based on the road image information, the road condition is identified using the AI ​​recognition model mounted in the AI ​​computing module to obtain road inspection and identification information;

[0018] The visualization algorithm built into the all-element management module generates information display data from the road image information, the platform data, and / or the road inspection and identification information, and then processes the display data through the input / output module.

[0019] Preferably, the construction method of the AI ​​recognition model specifically includes:

[0020] Obtain road image samples, which contain annotation information of road condition features;

[0021] Based on the road image samples, a preset AI learning model is trained to obtain an AI recognition model.

[0022] Preferably, the road image acquisition module includes: an unmanned aerial vehicle (UAV) image acquisition module, a vehicle-mounted video acquisition module, and / or a fixed road video acquisition module;

[0023] The external information platform includes: a geographic building data platform or a combination of the geographic building data platform and at least one of a meteorological data platform and a network communication platform.

[0024] Preferably, the step of generating information display data from the road image information, the platform data, and / or the road inspection and identification information using a visualization algorithm built into the full-element management module specifically includes:

[0025] The visualization algorithm built into the full-element management module generates information display screens for the road image information, the platform data, and the road inspection and identification information, respectively. The platform data includes BIM / GIS data obtained from the geographic building data platform, regional meteorological data obtained from the meteorological data platform, and audio and video streaming media data obtained from the network communication platform.

[0026] According to the preset screen combination configuration, the various information display screens are integrated to obtain the information display data.

[0027] As can be seen from the above technical solutions, this application has the following advantages:

[0028] The solution provided in this application collects road image information by integrating various new inspection methods such as drones and vehicle-mounted cameras. The AI ​​computing model in this system uses AI computing power to pre-identify and process the road image information to obtain road inspection identification information, which helps inspectors make decision-making assistance prompts. At the same time, it connects with various system platforms of the command center connected to the cloud platform to realize system linkage query, analysis and prediction, so that road risks can be predicted, handled and resolved early, effectively improving inspection automation, improving inspection efficiency and reducing inspection costs. Attached Figure Description

[0029] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1 This is a schematic diagram of a road inspection system embodiment provided in this application.

[0031] Figure 2 This is a schematic diagram illustrating the display effect of a road inspection system provided in this application.

[0032] Figure 3 This is a flowchart illustrating an embodiment of a road inspection method provided in this application. Detailed Implementation

[0033] This application provides a road inspection system and method to solve the technical problems of high inspection cost and low efficiency in existing road inspection methods.

[0034] To make the inventive objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described below are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0035] First, a detailed description of an embodiment of a road inspection system provided in this application is as follows:

[0036] Please see Figure 1 The road inspection system provided in this application includes: a full-element management module 1, a road image acquisition module 2, a linkage platform access module 3, a 5G routing module 4, an AI computing module 5, and an input / output module 6;

[0037] The road image acquisition module 2 and the linkage platform access module 3 are both connected to the 5G routing module 4. The 5G routing module 4 is connected to the all-element management module 1 and the AI ​​computing module 5 respectively. The input / output module 6 is connected to the all-element management module 1.

[0038] Among them, the road image acquisition module 2 has a built-in camera device for collecting road image information, and the linkage platform access module 3 is used to connect with the external information platform to obtain platform data from the external information platform;

[0039] 5G routing module 4 is used to control 5G route allocation;

[0040] The AI ​​computing module 5 is used to identify road conditions based on road image information and the onboard AI recognition model in order to obtain road inspection and recognition information.

[0041] The full-element management module 1 is used to generate information display data from the received road image information, platform data and road inspection and identification information through the built-in visualization algorithm, and then process the display data through the input / output module 6.

[0042] It should be noted that the various modules in the road inspection system provided in this embodiment, namely the road image acquisition module 2 and the linkage platform access module 3, are front-end information acquisition modules used to collect image information of the inspected roads and platform information stored in the linkage system platform. In this embodiment, the road image acquisition module 2 preferably uses a drone shooting device. In some embodiments, vehicle-mounted cameras and authorized wireless fixed cameras can also be added. The external information platforms connected through the linkage platform access module 3 mainly include: a geographic building data platform, which can obtain BIM / GIS data of the inspection area. In some embodiments, other external information platforms such as meteorological data platforms and network communication platforms can also be added to obtain regional meteorological information of the inspected roads and audio and video conferencing streaming media data with command center staff and / or road maintenance personnel. There is no need for data association or coupling between the various platform systems themselves. The full-element management module 1 will integrate them into the original information display data to obtain more detailed information display data.

[0043] The 5G routing module 4 is used to manage the 5G wireless network and 5G route allocation. The all-element management module 1 and the AI ​​computing module 5 belong to the backend data processing terminal.

[0044] The all-element management module 1 in this embodiment provides unified control and management of the entire system, and unified data fusion. It integrates heterogeneous data such as BIM / GIS data from the cloud platform, drone video, AI video, drone control interface, and system management interface into a process visualization, for example, the display effect is as follows: Figure 2 As shown, drone video feeds are overlaid on the GIS map, and manual flight control of the drones will be directly supported. If anomalies are detected on the road, heterogeneous AI video data can also be overlaid on the screen to help inspectors issue early warnings. Simultaneously, communication and handling can be facilitated with staff at the command center and road maintenance personnel via video conferencing and audio intercom.

[0045] In this embodiment, the road management system manages the network security access of external systems such as the road image acquisition module 2 and the geographic building data platform through the 5G routing module 4. The acquired video data flows to the AI ​​computing module 5, where the AI ​​recognition model identifies road conditions and outputs preliminary road inspection information, such as road cracks, foreign objects on the road surface, and road flooding. This information is then transmitted to the all-element management module 1. The AI ​​computing module also identifies key images from the external information platform connected to the linkage platform according to pre-set requirements and transmits the resulting key information to the all-element management module 1. Alternatively, the data flows directly to the all-element management module 1, which uses a visual interface to graphically and tabularly display the video data, road inspection information, and BIM / GIS information on the data processing terminal to assist inspectors in decision-making. The visual interface also includes a summary view of various traffic information systems, as well as combined views such as a drone control interface and a conference video control screen. Key information can also be uploaded to a cloud platform for remote command center viewing.

[0046] The road inspection system provided in this embodiment supports two forms: one is a portable case-type device with a built-in monitor, keyboard, mouse, etc., which can be used independently of a vehicle, similar to a portable device for individual soldiers. The other type can be connected to an external keyboard, mouse, gimbal remote control, etc., and is generally used inside a vehicle.

[0047] The above is a detailed description of an embodiment of a road inspection system provided in this application. The following is a detailed description of an embodiment of a road inspection method provided in this application.

[0048] Please see Figure 3 This embodiment provides a road inspection method, applied to a road inspection system as described in the above embodiment, including:

[0049] Step 101: Receive road image information and platform data obtained from the road image acquisition module and the linkage platform access module;

[0050] Step 102: Based on the road image information, the road condition is identified using the AI ​​recognition model in the AI ​​computing module to obtain road inspection and identification information;

[0051] Step 103: Using the visualization algorithm built into the all-element management module, the road image information, platform data, and / or road inspection and identification information are used to generate information display data, which is then processed for display through the input / output module.

[0052] Furthermore, the specific methods for constructing AI recognition models include:

[0053] Obtain road image samples, which contain annotation information of road condition features;

[0054] Based on road image samples, a pre-set AI learning model is trained to obtain an AI recognition model.

[0055] Furthermore, the road image acquisition module includes: a drone image acquisition module, a vehicle-mounted video acquisition module, and / or a fixed road video acquisition module;

[0056] External information platforms include: a geographic building data platform or a combination of a geographic building data platform and a meteorological data platform or a network communication platform.

[0057] Furthermore, through the built-in visualization algorithm of the full-element management module, information display data is generated from road image information, platform data, and / or road inspection and recognition information, specifically including:

[0058] The full-element management module uses built-in visualization algorithms to generate information display screens for road image information, platform data, and road inspection and identification information. The platform data includes BIM / GIS data obtained from the geographic building data platform, regional meteorological data obtained from the meteorological data platform, and audio and video streaming media data obtained from the network communication platform.

[0059] According to the preset screen combination configuration, the various information display screens are integrated to obtain the information display data.

[0060] In the description of this application, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0061] Unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to fixed connections, detachable connections, or integral connections; they can refer to mechanical connections or electrical connections; they can refer to direct connections or indirect connections through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0062] In the several embodiments provided in this application, it should be understood that the disclosed systems, modules, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0063] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0064] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0065] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0066] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0067] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A road inspection system, characterized in that, include: The system includes a full-element management module, a road image acquisition module, a linkage platform access module, a 5G routing module, an AI computing module, and an input / output module. The road image acquisition module and the linkage platform access module are both communicatively connected to the 5G routing module. The 5G routing module is communicatively connected to the all-element management module and the AI ​​computing module, respectively. The input / output module is communicatively connected to the all-element management module. The road image acquisition module has a built-in camera device for acquiring road image information. The linkage platform access module is used to connect with an external information platform to obtain platform data from the external information platform. The road image acquisition module includes: a UAV image acquisition module, a vehicle-mounted video acquisition module and / or a fixed road video acquisition module. The external information platform includes: a geographic building data platform or a combination of the geographic building data platform and at least one of a meteorological data platform and a network communication platform. The 5G routing module is used to control 5G route allocation; The AI ​​computing module is used to identify the road condition based on the road image information and the onboard AI recognition model to obtain road inspection and recognition information. The all-element management module is used to generate information display screens for the road image information, the platform data, and the road inspection and identification information through a built-in visualization algorithm. Then, according to a preset screen combination configuration, the various information display screens are integrated to obtain information display data, which is then displayed and processed through an input / output module. The platform data includes: BIM / GIS data obtained from the geographic building data platform, regional meteorological data obtained from the meteorological data platform, and audio and video streaming media data obtained from the network communication platform.

2. The road inspection system according to claim 1, characterized in that, The input / output module includes an input submodule and an output submodule. The input submodule includes a keyboard and mouse device and / or a remote control device. The output submodule includes a display device and an audio device.

3. A road inspection method, applied to a road inspection system as described in any one of claims 1 to 2, characterized in that, include: The system receives road image information and platform data obtained from the road image acquisition module and the linkage platform access module. The road image acquisition module includes: a UAV image acquisition module, a vehicle-mounted video acquisition module and / or a fixed road video acquisition module. The external information platform includes: a geographic building data platform or a combination of the geographic building data platform and at least one of a meteorological data platform and a network communication platform. Based on the road image information, the road condition is identified using the AI ​​recognition model mounted in the AI ​​computing module to obtain road inspection and identification information; The full-element management module uses a built-in visualization algorithm to generate information display screens for the road image information, platform data, and road inspection and identification information. Then, according to a preset screen combination configuration, the various information display screens are integrated to obtain information display data, which is then processed for display through an input / output module. The platform data includes BIM / GIS data obtained from the geographic building data platform, regional meteorological data obtained from the meteorological data platform, and audio and video streaming media data obtained from the network communication platform.

4. The road inspection method according to claim 3, characterized in that, The specific methods for constructing the AI ​​recognition model include: Obtain road image samples, which contain annotation information of road condition features; Based on the road image samples, a preset AI learning model is trained to obtain an AI recognition model.

Images