Road disease early warning method, device, product, medium and equipment

Abstract

The invention discloses a road disease early warning method and device, a product, a medium and equipment. The method comprises the following steps: S1, obtaining road picture information and geographic position information of a corresponding road; s2, performing disease identification on the road picture to obtain disease data, and associating the disease data with the geographic position information; and S3, distributing the disease data associated with the geographic position to a vehicle in a preset range around the corresponding geographic position to perform road disease early warning: when a roadside device is arranged in the preset range around the corresponding geographic position and a terminal device is arranged in the vehicle, obtaining vehicle information on a road through the roadside device, road danger prompt information is sent to terminal equipment of the corresponding vehicle according to the vehicle information; and when no terminal equipment exists in the vehicle, obtaining road danger prompt information through the cloud. The method has the advantages of being high in early warning accuracy, improving the intelligent level of road management, being safe to use and the like.

Description

Technical Field

[0001] The present invention mainly relates to the technical field of road hazard early warning, and specifically relates to a road hazard early warning method, device, product, medium and equipment. Background Art

[0002] At present, after a period of time, urban roads, whether asphalt or cement pavement, will have some early diseases, such as cracks, potholes, rutting, looseness, surface damage, etc. Some serious diseases on these roads threaten vehicles traveling at high speeds on the road. For example, some large potholes and large cracks will cause vehicles to slip or change lanes at high speeds, causing collisions with other vehicles. In severe cases, the vehicle bearings may break or the tires may explode, which will seriously endanger the driver and pedestrians on the road. At present, the only way to repair such road diseases on the market is to promptly notify the maintenance department through daily inspections and conduct periodic maintenance and repairs. However, maintenance and repair have a long cycle, and road diseases will exist on the road for a long time, which may cause continuous harm to vehicles. At present, there is a lack of good solutions to this problem on the market. Summary of the invention

[0003] In view of the technical problems existing in the prior art, the present invention provides a road hazard early warning method, device, product, medium and equipment for improving road safety.

[0004] In order to solve the above technical problems, the technical solution proposed by the present invention is:

[0005] A road disease early warning method comprises the following steps:

[0006] S1. Obtaining road image information and geographical location information of corresponding roads;

[0007] S2, identifying road damage in the road image, obtaining damage data, and associating the damage data with geographic location information;

[0008] S3. Distribute the disease data associated with the geographic location to the vehicles within a preset range around the corresponding geographic location for road disease warning. Specifically, when there is roadside equipment within the preset range around the corresponding geographic location and the vehicle is equipped with a terminal device matching the roadside equipment, obtain vehicle information on the road through the roadside equipment, and send road hazard warning information to the terminal device of the corresponding vehicle based on the vehicle information for road disease warning; when there is no terminal device inside the vehicle, obtain road hazard warning information through the cloud for road disease warning.

[0009] Preferably, in step S3, when roadside equipment is installed within a preset range around the corresponding geographical location and a terminal device is installed in the vehicle, if the vehicle is traveling in the lane where the disease is located, a road disease warning is issued to the corresponding vehicle; if the vehicle is not traveling in the lane where the disease is located, no road disease warning is issued.

[0010] Preferably, in step S3, when there is no terminal device inside the vehicle, a road disease warning is issued to vehicles on all roads behind the disease.

[0011] Preferably, the roadside device is a roadside unit RSU, the terminal device is an onboard unit OBU, and the roadside unit RSU communicates with the onboard unit OBU via a C-V2X protocol.

[0012] Preferably, in step S3, when issuing a road hazard warning, the location and severity of the hazard are indicated by voice and graphic lane-level road hazard reminders through the vehicle-mounted display screen.

[0013] Preferably, in step S3, the preset range is 1 km to 3 km.

[0014] The present invention also discloses a road disease early warning device, comprising:

[0015] A picture acquisition module is used to obtain road picture information and geographical location information of the corresponding road;

[0016] The disease recognition module is used to identify diseases in road images, obtain disease data, and associate the disease data with geographic location information;

[0017] The disease warning module is used to distribute disease data associated with geographic locations to vehicles within a preset range around the corresponding geographic locations for road disease warning; when roadside equipment is installed within the preset range around the corresponding geographic location and a terminal device matching the roadside equipment is installed in the vehicle, vehicle information on the road is obtained through the roadside equipment, and road hazard warning information is sent to the terminal device of the corresponding vehicle based on the vehicle information for road disease warning; when there is no terminal device inside the vehicle, road hazard warning information is obtained through the cloud for road disease warning.

[0018] The present invention further discloses a computer program product, comprising a computer program, wherein the computer program executes the steps of the method described above when executed by a processor.

[0019] The present invention also discloses a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the method described above are executed.

[0020] The present invention further discloses a computer device, comprising a memory and a processor connected to each other, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the method described above are executed.

[0021] Compared with the prior art, the advantages of the present invention are:

[0022] The present invention combines road image information with geographic location information and utilizes advanced image recognition technology to more accurately identify road defects, such as potholes and cracks, thereby improving the accuracy of early warning. Through a terminal device preset in the vehicle or a cloud server, intelligent information transmission and processing are realized, thereby improving the intelligent level of road management. The defect data is associated with the geographic location information, and early warning information is sent to vehicles within a preset range in a targeted manner, thereby improving the efficiency and coverage of early warning. Through early warning, drivers can take measures in advance to avoid potential road danger areas, thereby improving the safety of road use. For vehicles without preset terminal devices, early warning information is sent through the cloud, thereby ensuring that all vehicles can receive early warnings of road defects, thereby improving the convenience and accessibility of early warning information. By utilizing roadside equipment and cloud resources, dependence on internal vehicle equipment can be reduced, costs can be reduced, and resource allocation can be optimized. The above-mentioned road defect early warning method has significant effects in improving road safety, reducing traffic accidents, and improving the intelligent level of traffic management. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 The figure is a flow chart of an embodiment of the road hazard early warning method of the present invention.

[0024] Figure 2 Schematic diagram of the road disease warning method in the first embodiment of the present invention.

[0025] Figure 3 Schematic diagram of the road hazard warning method in the second embodiment of the present invention.

[0026] Figure 4 This is a specific flow chart of road hazard warning in Embodiment 1 of the present invention. DETAILED DESCRIPTION

[0027] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments.

[0028] like Figure 1 As shown, the road disease early warning method of the embodiment of the present invention comprises the steps of:

[0029] S1. Obtaining road image information and geographical location information of corresponding roads;

[0030] S2, identifying road damage in the road image, obtaining damage data, and associating the damage data with geographic location information;

[0031] S3. Distribute the disease data associated with the geographic location to the vehicles within a preset range around the corresponding geographic location for road disease warning. Specifically, when there is roadside equipment within the preset range around the corresponding geographic location and the vehicle is equipped with a terminal device matching the roadside equipment, obtain vehicle information on the road through the roadside equipment, and send road hazard warning information to the terminal device of the corresponding vehicle based on the vehicle information for road disease warning; when there is no terminal device inside the vehicle, obtain road hazard warning information through the cloud for road disease warning.

[0032] Specifically, in step S3, when there is a roadside device within a preset range around the corresponding geographical location and a terminal device is installed in the vehicle, if the vehicle is traveling in the lane where the disease is located, a road disease warning is issued to the corresponding vehicle; if the vehicle is not traveling in the lane where the disease is located, no road disease warning is issued. In another embodiment, when there is no terminal device inside the vehicle, a road disease warning is issued to vehicles on all roads behind the disease.

[0033] Specifically, the roadside equipment is the roadside unit RSU, the terminal equipment is the on-board unit OBU, and the roadside unit RSU communicates with the on-board unit OBU through the C-V2X protocol.

[0034] Specifically, in step S3, when issuing a road hazard warning, the location and severity of the hazard are given as a lane-level road hazard reminder in the form of voice and graphics through the vehicle-mounted display screen.

[0035] The present invention combines road image information with geographic location information and utilizes advanced image recognition technology to more accurately identify road defects, such as potholes and cracks, thereby improving the accuracy of early warning. Through a terminal device preset in the vehicle or a cloud server, intelligent information transmission and processing are realized, thereby improving the intelligent level of road management. The defect data is associated with the geographic location information, and early warning information is sent to vehicles within a preset range in a targeted manner, thereby improving the efficiency and coverage of early warning. Through early warning, drivers can take measures in advance to avoid potential road danger areas, thereby improving the safety of road use. For vehicles without preset terminal devices, early warning information is sent through the cloud, thereby ensuring that all vehicles can receive early warnings of road defects, thereby improving the convenience and accessibility of early warning information. By utilizing roadside equipment and cloud resources, dependence on internal vehicle equipment can be reduced, costs can be reduced, and resource allocation can be optimized. The above-mentioned road defect early warning method has significant effects in improving road safety, reducing traffic accidents, and improving the intelligent level of traffic management.

[0036] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0037] Embodiment 1:

[0038] like Figure 1-Figure 2 and Figure 4 As shown, the road disease early warning method of the embodiment of the present invention is applied to the situation where there are a roadside unit RSU and an on-board unit OBU, and includes the following steps:

[0039] Step 1: Inspection vehicles regularly collect road images and geographic locations through high-definition cameras and GNSS modules;

[0040] Step 2: Upload road pictures and related data to the intelligent network cloud control platform via 4G / 5G or other means;

[0041] Step 3: The cloud control platform sends the image to the GPU server for machine learning based on neural networks, identifies the road damage model, and updates and stores the identified damage data and geographic location data in the damage database. The intelligent connected cloud control platform deploys a fusion recognition algorithm based on CNN convolutional neural network and supplemented by traditional image processing algorithms, which can perform in-depth damage analysis on the inspection images transmitted back by the acquisition end 4G / 5G in real time, and obtain the GNSS geographic location and severity of the damage.

[0042] Step 4: The disease database distributes the disease to the MEC associated with the RSU in the corresponding location covering a 2-kilometer radius circle area through the vehicle-road cooperative intranet according to the geographical location of the roadside unit RSU;

[0043] Step 5: When a vehicle with an OBU is driving on a road with a defect, the camera in the roadside equipment identifies the lane where the vehicle is located and integrates the vehicle's GPS position and driving direction. If the distance between the defect and the vehicle is less than 50m (the specific distance can be determined according to the vehicle speed, etc.), a road hazard warning message is sent to the OBU vehicle through the C-V2X protocol; if the vehicle with an OBU is driving on an adjacent road with a defect, no warning is given;

[0044] Step 6: After receiving the road safety hazard warning information, the OBU vehicle uses voice and graphic animation reminders in conjunction with the vehicle display screen to remind the owner to pay attention to potholes or other dangerous road conditions ahead, so that the vehicle driver can slow down in advance to reduce the impact of road hazards on traffic safety.

[0045] Embodiment 2:

[0046] like Figure 1 and Figure 3As shown, the road disease early warning method of the embodiment of the present invention is applied to the case where the vehicle has no on-board unit OBU, and comprises the following steps:

[0047] Step 1: Inspection vehicles regularly collect road images and geographic locations through high-definition cameras and GNSS modules;

[0048] Step 2: Upload road pictures and related data to the intelligent network cloud control platform;

[0049] Step 3: The cloud control platform sends the image to the GPU server for machine learning based on neural networks, identifies the road damage model, and updates and stores the identified damage data and geographic location data in the damage database. The intelligent connected cloud control platform deploys a fusion recognition algorithm based on CNN convolutional neural network and supplemented by traditional image processing algorithms, which can perform in-depth damage analysis on the inspection images transmitted back by the acquisition end 4G / 5G in real time, and obtain the GNSS geographic location and severity of the damage.

[0050] Step 4: Vehicles without OBU do not have lane-level positioning information and C-V2X receiving modules. They can obtain road damage information from the cloud control center through Internet (UU) communication. However, the reminder method is at the road level. The vehicle will remind you of all dangerous damages ahead, but will not remind you based on the degree of match between the lane where the vehicle is located and the lane where the damage is located.

[0051] The embodiment of the present invention also discloses a road disease early warning device, including:

[0052] A picture acquisition module is used to obtain road picture information and geographical location information of the corresponding road;

[0053] The disease recognition module is used to identify diseases in road images, obtain disease data, and associate the disease data with geographic location information;

[0054] The disease warning module is used to distribute disease data associated with geographic locations to vehicles within a preset range around the corresponding geographic locations for road disease warning; when roadside equipment is installed within the preset range around the corresponding geographic location and a terminal device matching the roadside equipment is installed in the vehicle, vehicle information on the road is obtained through the roadside equipment, and road hazard warning information is sent to the terminal device of the corresponding vehicle based on the vehicle information for road disease warning; when there is no terminal device inside the vehicle, road hazard warning information is obtained through the cloud for road disease warning.

[0055] The embodiment of the present invention further discloses a computer program product, including a computer program, which executes the steps of the above method when executed by a processor. The embodiment of the present invention further discloses a computer readable storage medium, which stores a computer program, which executes the steps of the above method when executed by a processor. The embodiment of the present invention further discloses a computer device, including a memory and a processor connected to each other, the memory stores a computer program, and the computer program executes the steps of the above method when executed by the processor. The apparatus, product, medium and equipment of the present invention correspond to the above method and also have the advantages described in the above method.

[0056] The present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by hardware related to computer program instructions. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned method embodiment when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. Computer-readable storage media include: any entity or device that can carry computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. The memory is used to store computer programs and / or modules, and the processor implements various functions by running or executing computer programs and / or modules stored in the memory, and calling data stored in the memory. The memory may include high-speed random access memory and may also include non-volatile memory, such as a hard disk, an internal memory, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0057] The above are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should be regarded as the protection scope of the present invention.

Claims

1. A road disease early warning method, characterized in that: Includes steps: S1. Obtaining road image information and geographical location information of corresponding roads; S2. Identify road damage on the road image to obtain damage data, and associate the damage data with geographic location information; S3, distributing the disease data associated with the geographic location to vehicles within a preset range around the corresponding geographic location to perform road disease warning, specifically: when a roadside device is provided within a preset range around the corresponding geographic location, and a terminal device matching the roadside device is provided in the vehicle, vehicle information on the road is obtained through the roadside device, and road hazard prompt information is sent to the terminal device of the corresponding vehicle according to the vehicle information to perform road disease warning; When there is no terminal device inside the vehicle, road hazard warning information is obtained through the cloud to provide road hazard warnings.

2. The road hazard early warning method according to claim 1, characterized in that: In step S3, when roadside equipment is installed within a preset range around the corresponding geographical location and terminal equipment is installed in the vehicle, if the vehicle is traveling in the lane where the disease is located, a road disease warning is issued to the corresponding vehicle; if the vehicle is not traveling in the lane where the disease is located, no road disease warning is issued.

3. The road hazard early warning method according to claim 1, characterized in that: In step S3, when there is no terminal device inside the vehicle, a road disease warning is issued to all vehicles on the road behind the disease.

4. The road hazard early warning method according to claim 1, 2 or 3, characterized in that: The roadside device is a roadside unit RSU, the terminal device is an onboard unit OBU, and the roadside unit RSU communicates with the onboard unit OBU via a C-V2X protocol.

5. The road disease early warning method according to claim 1, 2 or 3, characterized in that: In step S3, when issuing a road hazard warning, the location and severity of the hazard are displayed through the vehicle display screen, and a lane-level road hazard reminder is given in the form of voice and graphics.

6. The road disease early warning method according to claim 1, 2 or 3, characterized in that: In step S3, the preset range is 1 km to 3 km.

7. A road disease early warning device, characterized in that: include: A picture acquisition module is used to obtain road picture information and geographical location information of the corresponding road; The disease recognition module is used to identify diseases in road images, obtain disease data, and associate the disease data with geographic location information; The disease warning module is used to distribute disease data associated with a geographic location to vehicles within a preset range around the corresponding geographic location to provide road disease warnings; when a roadside device is provided within a preset range around the corresponding geographic location and a terminal device matching the roadside device is provided in the vehicle, vehicle information on the road is obtained through the roadside device, and road hazard warning information is sent to the terminal device of the corresponding vehicle based on the vehicle information to provide road disease warnings; When there is no terminal device inside the vehicle, road hazard warning information is obtained through the cloud to provide road hazard warnings.

8. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are performed.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the computer program performs the steps of the method according to any one of claims 1 to 6.

10. A computer device comprising a memory and a processor connected to each other, wherein a computer program is stored in the memory, characterized in that: When the computer program is executed by a processor, the computer program performs the steps of the method according to any one of claims 1 to 6.

Images