A road surface condition detection apparatus, method, device and vehicle

Abstract

The application relates to a road surface condition detection device, method, apparatus and vehicle, wherein the device comprises a control module, an identification module, a camera module and an information acquisition module; the camera module is used for acquiring a target image including a road surface condition during vehicle driving; the control module is used for sending the received target image to the identification module for target object identification and receiving an identification result returned by the identification module, and in the case that the received identification result indicates that a target object exists in the target image, generating a wake-up signal and generating a detection result according to road surface condition information; the identification module is used for identifying the received target image by using a pre-trained detection model and generating an identification result; and the information acquisition module is used for acquiring road surface condition information of a road surface in response to the received wake-up signal. Through the application, the problem that abnormal conditions of a road surface cannot be identified in advance in the prior art is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image recognition, in particular to a road surface condition detection device, method, apparatus and vehicle. BACKGROUND

[0002] When encountering extreme weather, such as heavy rain, heavy snow, etc., the road around, especially the low-lying section of the road, may be submerged by water or thick layer of snow; when the vehicle is trapped in water, it is easy to cause the vehicle to be stranded; when the vehicle is trapped in snow, it is easy to slip and lack of climbing force to drive away. In addition, when there is a river, lake area nearby, waterlogged road is also easy to appear: when the water depth is large, the car wading may cause water to enter the engine exhaust pipe, causing the engine to stall; if water enters the cylinder, it will also cause mechanical damage to the engine valve train and cylinder head.

[0003] With the development and progress of hydrological detection technology, non-contact water level measurement method has been widely concerned for its advantages of quickness, safety, high precision and wide application range. The radar water level measurement device adopts non-contact water level measurement method, does not need to build a separate still water well, is not affected by impurities in the water, has high measurement precision, can be applied to special work such as plain water test, flood monitoring, high flood rescue, dangerous water measurement, etc. with much floating material, high sand content and poor water quality, and plays a great role in measurement for the main purpose of flood prevention, and ensures the safety of measurement personnel. However, the current water level depth detection and alarm vehicle terminal are not ideal, and even only detect and report or alarm when wading.

[0004] The vehicle terminal of the prior art can detect the water depth distance of the road surface where the vehicle is located in time when there is a risk of water immersion during parking of the vehicle, and trigger the control module to start the radar module and the camera module when the water depth distance reaches the preset height. The sensing module is installed at the center position of the vehicle tire, and only when the vehicle is involved in water, the system will start to work, which leads to that the abnormal condition of the road surface cannot be identified in advance.

[0005] There is no effective solution to the technical problem that the abnormal condition of the road surface cannot be identified in advance in the prior art. SUMMARY

[0006] A road surface condition detection device, method, apparatus and vehicle are provided in the embodiment to solve the technical problem that the abnormal condition of the road surface cannot be identified in advance in the prior art.

[0007] In a first aspect, a road surface condition detection device is provided in the embodiment, which comprises a control module, an identification module, a camera module and an information acquisition module.

[0008] The camera module is configured to acquire a target image including a road surface condition during vehicle driving and send the target image to the control module.

[0009] The control module is configured to send the received target image to the identification module for target object identification and receive an identification result returned by the identification module, and in a case where the received identification result indicates that the target object exists in the target image, generate a wake-up signal and send the wake-up signal to the information acquisition module, receive the road surface condition information sent by the information acquisition module, and generate a detection result according to the road surface condition information.

[0010] The identification module is configured to identify the received target image by using a pre-trained detection model and generate the identification result; and the identification result is used to identify whether the target object exists in the target image.

[0011] The information acquisition module is configured to acquire road surface condition information of the road surface in response to the received wake-up signal.

[0012] In some embodiments, the device further includes an alarm module.

[0013] The control module is further configured to generate an alarm signal according to the detection result, send the alarm signal to the alarm module, and control the alarm module to generate an alarm according to the alarm signal.

[0014] In some embodiments, the identification module is further configured to calculate a similarity between a pre-stored historical image and the target image when the target object exists in the target image, and send a target historical image with a similarity satisfying a preset condition to the control module.

[0015] In some embodiments, the device further includes a display module; and the control module is further configured to send the target historical image to the display module for display.

[0016] In a second aspect, a vehicle is provided in the present embodiment, and the vehicle is provided with the road surface condition detection device of the first aspect.

[0017] In a third aspect, a road surface condition detection method is provided in the present embodiment, and the method includes:

[0018] receiving a target image including a road surface condition during vehicle driving acquired by a camera module, and sending the target image to an identification module;

[0019] receive a recognition result generated by the recognition module according to the target image; the recognition result is used to identify whether the target object exists on the road surface;

[0020] generate a wake-up signal when the target object exists in the target image, and send the wake-up signal to an information acquisition module;

[0021] receive road surface condition information of the road surface acquired by the information acquisition module, and generate a detection result according to the road surface condition information.

[0022] In some embodiments, the method further comprises:

[0023] when the target object exists in the target image, receive a target historical image sent by the recognition module; the target historical image is a historical image selected by the recognition module according to a similarity between the historical image and the target image.

[0024] In some embodiments, the method further comprises: generating an alarm signal according to the detection result, and sending the alarm signal to an alarm module.

[0025] In some embodiments, the road surface condition information comprises depth information.

[0026] The detection result is generated according to the road surface condition information, comprising:

[0027] comparing the depth information with a preset value, and determining that the road surface is abnormal when the depth information is greater than the preset value.

[0028] In a fourth aspect, a road surface condition detection device is provided in the embodiment, and the device comprises:

[0029] a first receiving module configured to receive a target image including a road surface condition in a vehicle driving process acquired by a camera module, and send the target image to a recognition module;

[0030] a second receiving module configured to receive a recognition result generated by the recognition module according to the target image; the recognition result is used to identify whether the target object exists on the road surface;

[0031] a signal generating module configured to generate a wake-up signal when the target object exists in the target image, and send the wake-up signal to an information acquisition module;

[0032] a detection module configured to receive road surface condition information of the road surface acquired by the information acquisition module, and generate a detection result according to the road surface condition information.

[0033] Compared with the related art, the road surface condition detection device, method, apparatus and vehicle provided in the embodiment can recognize a target object by performing target object recognition on a target image of a road surface in front of the vehicle, and when the target object is recognized, an information acquisition module is started to detect information of the target object, and whether the road surface in front of the vehicle is abnormal is determined according to the detected information of the target object, so that the abnormal condition of the road surface is recognized in advance, and the safety of vehicle driving is improved. When water accumulation or snow accumulation is recognized, the information acquisition module is called again to detect the depth of water accumulation or snow accumulation, and the energy consumption of the system is reduced.

[0034] The details of one or more embodiments of the present application are presented in the following drawings and description to make other features, objects and advantages of the present application more clear. BRIEF DESCRIPTION OF DRAWINGS

[0035] The drawings described herein are intended to provide further understanding of the present application, form a part of the present application, and are used to explain the present application and do not constitute an improper limitation of the present application. In the drawings:

[0036] Figure 1 is a structural block diagram of a road surface condition detection device according to an embodiment of the present application;

[0037] Figure 2 is a structural block diagram of another road surface condition detection device according to an embodiment of the present application;

[0038] Figure 3 is a structural block diagram of another road surface condition detection device according to an embodiment of the present application;

[0039] Figure 4 is a flowchart of a road surface condition detection method according to an embodiment of the present application;

[0040] Figure 5 is a specific structural block diagram of a road surface condition detection device according to an embodiment of the present application;

[0041] Figure 6 is a specific flowchart of a road surface condition detection method according to an embodiment of the present application;

[0042] Figure 7 is a structural block diagram of a road surface condition detection apparatus according to an embodiment of the present application. DETAILED DESCRIPTION

[0043] In order to more clearly understand the purpose, technical scheme and advantages of the present application, the present application is described and explained in combination with the drawings and embodiments.

[0044] Unless otherwise defined, technical terms and scientific terms used in the present application shall have the same meaning as those commonly understood by a person skilled in the art to which the present application belongs. In the present application, the terms "one", "a", "an", "the", "these", and similar words do not indicate quantity, and they can be singular or plural. In the present application, the terms "include", "contain", "have", and any variants thereof are intended to cover non-exclusive inclusion; for example, a process, method, and system, product or device containing a series of steps or modules (units) are not limited to the listed steps or modules (units), but can include steps or modules (units) not listed, or can include other steps or modules (units) inherent to the process, method, product or device. In the present application, the terms "connected", "connected", "coupled" and the like do not limit to physical or mechanical connection, but can include electrical connection, whether direct or indirect. In the present application, "multiple" means two or more. "And / or" describes the relationship between the associated objects, which means that there can be three relationships, for example, "A and / or B" can mean that A exists alone, A and B exist together, and B exists alone. In general, the character " / " represents the relationship between the front and rear associated objects as "or". In the present application, the terms "first", "second", "third", and the like are only used to distinguish similar objects, and do not represent a specific order for the objects.

[0045] In the present embodiment, a road surface condition detection device is provided, Figure 1 is a structural block diagram of a road surface condition detection device according to an embodiment of the present application, as shown in the figure, the device comprises: a control module 110, an identification module 120, a camera module 130 and an information acquisition module 140. The identification module 120, the camera module 130 and the information acquisition module 140 are connected with the control module 110. Figure 1

[0046] ​Specifically, the camera module 130 is configured to acquire a target image including a road surface condition during driving of the vehicle, and send the target image to the control module 110. The control module 110 is configured to send the received target image to the identification module 120 for target object identification, receive an identification result returned by the identification module 120, and in a case where the received identification result indicates that the target image includes a target object, generate a wake-up signal, send the wake-up signal to the information acquisition module 140, receive road surface condition information sent by the information acquisition module 140, and generate a detection result according to the road surface condition information. The identification module 120 is configured to identify the received target image by using a pre-trained detection model, and generate an identification result; the identification result is used to identify whether the target image includes a target object. The information acquisition module 140 is configured to acquire road surface condition information of a road surface in response to the received wake-up signal.

[0047] Further specifically, the camera module 130 is configured to implement functions such as shooting, recording, video storage, etc. of the road surface during vehicle driving. Here, the road surface can be the road surface in front of the vehicle during vehicle driving. Exemplarily, the camera module 130 here can be implemented by using a camera unit in a vehicle's driving recorder. The control module 110 receives a target image including road surface conditions collected by the camera module 130, and sends the target image to the recognition module 120. The recognition module 120 performs target object recognition on the target image by using a pre-trained detection model, and sends a recognition result to the control module 110, where the recognition result is used to identify whether there is a target object in the target image. Here, the target object can be an obstacle existing on the road surface in the target image. Exemplarily, the obstacle here can be water accumulation, snow accumulation or other obstacles. The control module 110 receives the recognition result sent by the recognition module 120, and generates a wake-up signal of the information acquisition module 140 when the recognition result indicates that there is a target object in the target image, and sends the wake-up signal to the information acquisition module 140. The information acquisition module 140 starts detection of the information acquisition module 140 in response to the received wake-up signal, acquires road surface condition information of the road surface, the road surface condition information including information of the target object, and sends the road surface condition information to the control module 110. Exemplarily, the information acquisition module 140 here can include devices such as water depth detection radar, sonar, snow accumulation detection laser radar, etc.; the information of the target object acquired here can be depth or area information of water accumulation, or depth or area information of snow accumulation, or information such as height, area, volume, etc. of other obstacles. The control module 110 generates a corresponding detection result according to the received road surface condition information, i.e. the control module 110 generates a corresponding detection result according to the received information of the target object, and further, the control module 110 can generate a corresponding alarm signal according to the detection result to remind the user. Exemplarily, the detection result here can be that there is an anomaly on the road surface in front of the vehicle, or that there is no anomaly on the road surface in front of the vehicle.

[0048] In the embodiment, by performing target object recognition on the target image of the road surface in front of the vehicle, when the target object is recognized, the information acquisition module 140 is started to detect information of the target object, and according to the detected information of the target object, it is judged whether there is an anomaly on the road surface in front of the vehicle, so as to realize early recognition of abnormal conditions of the road surface, and improve the safety of vehicle driving. When water accumulation or snow accumulation is recognized, the information acquisition module 140 is woken up again to detect the depth of water accumulation or snow accumulation, so as to reduce the energy consumption of the system.

[0049] In the embodiment, a road surface condition detection device is also provided, Figure 2 is a structural block diagram of another road surface condition detection device of the embodiment of the application, like Figure 2As shown, the device further comprises an alarm module 150. The alarm module 150 is connected with the control module 110.

[0050] Specifically, the control module 110 generates a corresponding detection result according to the received information of the target object, generates an alarm signal according to the detection result, and sends the alarm signal to the alarm module 150, and controls the alarm module 150 to generate an alarm according to the alarm signal. Illustratively, the control module 110 compares the water depth or snow depth with a preset safety value according to the received water depth or snow depth information, and when the water depth or snow depth is greater than the preset safety value, the control module 110 generates a corresponding alarm signal, and sends the alarm signal to the alarm module 150, and the alarm module 150 generates a corresponding alarm according to the alarm signal. When the water depth or snow depth is greater than the preset safety value, it indicates that the current road condition cannot be safely passed by the vehicle, and the user needs to be reminded. In addition, the alarm module 150 here can be a voice alarm, which generates a corresponding voice alarm according to the alarm signal.

[0051] In this embodiment, by performing target object recognition on the target image of the road in front of the vehicle, when the target object is recognized, the information acquisition module 140 is started to detect the information of the target object, and according to the detected information of the target object, it is judged whether there is an abnormality in the road in front of the vehicle, and a corresponding alarm is generated to remind the user, so as to realize the early recognition of the abnormal condition of the road and improve the safety of the vehicle driving. When identifying water or snow conditions, the information acquisition module 140 is called again to detect the water or snow depth, reducing the energy consumption of the system.

[0052] In this embodiment, a road condition detection device is also provided, Figure 3 is a structural block diagram of another road condition detection device of the embodiment of the present application, as Figure 3 As shown, the device further comprises a display module 160. The display module 160 is connected with the control module 110.

[0053] Specifically, the recognition module 120 is further used to calculate the similarity between the pre-stored historical image and the target image when the target object exists in the target image, and send the target historical image with a similarity meeting a preset condition to the control module 110. The control module 110 sends the target historical image to the display module 160 for display. Here, the historical image with the highest similarity to the target image can be used as the target historical image. The display module 160 is further used to display the picture taken by the camera module 130 during driving and display the picture searched by the recognition module 120 without water or snow on the road in the past. The user can judge the road condition according to the image displayed by the display module 160.

[0054] In the embodiment, the target image of the road surface in front of the vehicle is subjected to target object recognition, when the target object is recognized, the information acquisition module 140 detects the information of the target object, judges whether there is an abnormality in the road surface in front of the vehicle according to the detected information of the target object, and generates a corresponding warning, and the display module 160 displays the target historical image, so that the user can judge the road condition according to the warning and the image displayed by the display module 160, thereby realizing the early identification of the abnormal condition of the road surface, improving the accuracy of the road condition judgment, and further improving the safety of the vehicle driving.

[0055] In some embodiments, the road surface condition detection device further comprises a communication module, and the information acquisition module 140 is connected with the control module 110 through the communication module. The communication module can be a wired communication module or a wireless communication module.

[0056] In the embodiment, a vehicle provided with the road surface condition detection device described in the foregoing embodiments is also provided. Illustratively, the road surface condition detection device can be arranged on the top or front of the vehicle. In addition, illustratively, the control module 110, the recognition module 120, the camera module 130, the display module 160 and the warning module 150 of the road surface condition detection device can be arranged in the vehicle event data recorder device of the vehicle, and the information acquisition module 140 can be arranged on the top or front of the vehicle.

[0057] In the embodiment, the target image of the road surface in front of the vehicle is subjected to target object recognition, when the target object is recognized, the information acquisition module 140 detects the information of the target object, judges whether there is an abnormality in the road surface in front of the vehicle according to the detected information of the target object, thereby realizing the early identification of the abnormal condition of the road surface, and improving the safety of the vehicle driving. When the water accumulation or snow accumulation is recognized, the information acquisition module 140 is reactivated to detect the depth of the water accumulation or snow accumulation, thereby reducing the energy consumption of the system.

[0058] In the embodiment, a road surface condition detection method is also provided, Figure 4 is a flowchart of a road surface condition detection method according to an embodiment of the present application, as shown in Figure 4 The flowchart comprises the following steps:

[0059] In step S410, the target image including the road surface condition during the driving of the vehicle is received by the camera module, and the target image is sent to the recognition module.

[0060] Specifically, the control module receives the target image including the road surface condition during the driving of the vehicle by the camera module, and sends the target image to the recognition module for target object recognition.

[0061] In step S420, the receiving identification module generates an identification result according to the target image; the identification result is used to identify whether the target object exists on the road surface.

[0062] Specifically, the control module receives an identification result generated by the identification module according to the target image. The identification result is used to identify whether the target object exists on the road surface. Illustratively, the identification result can be that the target image includes the target object, and the identification result can also be that the target image does not include the target object.

[0063] In step S430, when the target object exists in the target image, a wake-up signal is generated and sent to the information acquisition module.

[0064] Specifically, the control module receives an identification result generated by the identification module according to the target image, judges whether the target object exists in the target image according to the identification result, and when the target object exists in the target image, the control module generates a wake-up signal, the wake-up signal is used to wake up the information acquisition module, and the wake-up signal is sent to the information acquisition module. The information acquisition module responds to the received wake-up signal, starts the information acquisition module to detect, acquires the road surface condition information of the road surface, the road surface condition information includes the information of the target object, and sends the road surface condition information to the control module.

[0065] In step S440, the road surface condition information of the road surface acquired by the information acquisition module is received, and a detection result is generated according to the road surface condition information.

[0066] Specifically, the control module receives the road surface condition information of the road surface acquired by the information acquisition module, and generates a detection result according to the road surface condition information. That is, the control module generates a corresponding detection result according to the received information of the target object, and further, the control module can generate a corresponding alarm signal according to the detection result to remind the user. Illustratively, the detection result here can be that the road surface in front of the vehicle is abnormal, or that the road surface in front of the vehicle is not abnormal.

[0067] In this embodiment, by performing target object identification on the target image of the road surface in front of the vehicle, when the target object is identified, the information acquisition module is started to detect the information of the target object, and according to the detected information of the target object, it is judged whether the road surface in front of the vehicle is abnormal, so as to realize the early identification of the abnormal condition of the road surface, and improve the safety of the vehicle driving. When the water accumulation or snow accumulation condition is identified, the information acquisition module is woken up again to detect the water accumulation or snow accumulation depth, and the energy consumption of the system is reduced.

[0068] In some embodiments, the road surface condition detection method further comprises: when the target object exists in the target image, receiving a target historical image sent by the identification module; the target historical image is a historical image selected by the identification module according to a similarity between a pre-stored historical image and the target image.

[0069] Specifically, when the target object exists in the target image, the control module receives a target historical image sent by the identification module. The target historical image is a historical image selected by the identification module according to a similarity between a pre-stored historical image and the target image. For example, the historical image with the highest similarity to the target image can be selected as the target historical image.

[0070] In some embodiments, the road surface condition detection method further comprises: generating an alarm signal according to the detection result, and sending the alarm signal to the alarm module.

[0071] Specifically, the control module generates an alarm signal according to the detection result, and sends the alarm signal to the alarm module, so that the alarm module generates an alarm according to the alarm signal.

[0072] In some embodiments, the road surface condition information includes depth information. The detection result is generated according to the road surface condition information, which includes: comparing the depth information with a preset value, and determining that the road surface is abnormal when the depth information is greater than the preset value.

[0073] Specifically, the control module compares the depth information with a preset value, and determines that the road surface is abnormal when the depth information is greater than the preset value. That is, the vehicle cannot pass safely at this time.

[0074] The embodiments of the present application will be described and illustrated below through specific embodiments.

[0075] Figure 5 is a specific structural block diagram of the road surface condition detection device of the embodiments of the present application. As shown in Figure 5 The road surface condition detection device is a vehicle-mounted intelligent device for road water and snow depth detection and alarm. The road surface condition detection device comprises a main control module 510, a driving record module 520, a first display module 530, an intelligent identification module 540, a voice alarm module 550, a wired communication module 560 and a road surface information acquisition module 570.

[0076] Specifically, the main control module 510 is connected to the driving recorder module 520, the first display module 530, the intelligent recognition module 540, the voice alarm module 550, and the wired communication module 560, respectively, for interacting with each sub-module and controlling the operation of the entire system. The driving recorder module 520 is used for capturing, recording, and storing video of the road surface during driving. The intelligent recognition module 540 is used for intelligent analysis and retrieval of road surface water and snow accumulation. The wired communication module 560 is connected to the road surface information acquisition module 570, for transmitting road surface information to the main control module 510 or the vehicle system. The first display module 530 is used to display the images captured by the camera during driving and to display images of previously unwatered or snow-covered roads found by the intelligent module. The road surface information acquisition module 570 is used to detect road surface-related information, including water depth radar or sonar, snow accumulation detection lidar, etc. The voice alarm module 550 is used for voice warnings and reminders. This road surface condition detection device also includes a power module, which provides power to the entire vehicle-mounted intelligent device. The road surface information acquisition module 570 includes radar and sonar for detecting water or snow depth. The intelligent recognition module 540 includes a processing unit, a detection unit, and a comparison and retrieval unit. It retrieves road surface video data recorded during driving, and the processing unit inputs the video data into a pre-trained road surface detection model to obtain road surface detection boxes, each containing a road surface image. The detection unit inputs the road surface image included in the detection box into a trained neural network model to generate a detection result indicating the presence of water or snow. When water or snow is detected, the comparison and retrieval unit compares and retrieves stored images based on image features, obtaining previous images of the current road surface, and sending the image data of the previous image with the highest similarity to the main control module 510. The neural network model here includes a trained water accumulation detection model and a trained snow accumulation detection model. For example, this in-vehicle intelligent device can be implemented using a dashcam or an in-vehicle terminal with camera functionality, such as a built-in car visualization terminal or driving camera. Taking the implementation of this in-vehicle intelligent device through a dashcam as an example, the main control module 510, dashcam module 520, first display module 530, intelligent recognition module 540, voice alarm module 550 and wired communication module 560 can be set inside the dashcam, and the road information acquisition module 570 can be installed on the windshield or the top of the vehicle.

[0077] The road information acquisition module 570 is triggered to perform depth detection only when water or snow accumulation is detected on the road surface, avoiding continuous operation of radar, sonar, etc. The main control module 510 sends the image data with the highest similarity to the first display module 530, controlling the first display module 530 to display the image. The image is displayed to the user on the first display module 530, allowing the user to intuitively see the road condition when there is no water or snow accumulation, and to make a preliminary judgment on the road condition, such as whether the water or snow accumulation is severe. The system may sometimes make false judgments, so this double judgment further improves the accuracy of the judgment. The main control module 510 wakes up the road information acquisition module 570 through the wired communication module 560 to obtain depth data, and sends the data to the main control module 510 through the communication module. After receiving the water or snow accumulation depth data, the main control module 510 compares it with the preset safe wading depth and the measured data. When the measured data exceeds the preset value, it sends a command to the voice alarm module 550 to provide a voice alarm reminder.

[0078] In this specific embodiment, video analytics technology is used to identify road surface water or snow accumulation in advance, allowing vehicles to navigate through water or snow before they attempt to cross, thus avoiding the risks associated with such activities. Image comparison and retrieval technology retrieves past images of road conditions and displays them to the user, enabling them to make a preliminary assessment of the water and snow accumulation. Once water or snow accumulation is detected, the radar and sonar of the road information acquisition module 570 are activated to detect the depth of the water or snow accumulation, reducing the energy consumption of its continuous operation.

[0079] Figure 6 This is a detailed flowchart of the road surface condition detection method according to an embodiment of this application. Figure 5 and Figure 6 As shown, the road surface condition detection method includes the following steps:

[0080] In step S610, the driving recorder module 520 captures real-time video of the road conditions.

[0081] In step S620, the intelligent recognition module 540 performs real-time video analysis.

[0082] Step S630: Determine whether water or snow accumulation on the road surface is detected. If yes, proceed to step S640; otherwise, proceed to step S610.

[0083] In step S640, the intelligent recognition module 540 performs image retrieval.

[0084] Step S650: Determine whether past road surface images have been retrieved. If yes, proceed to step S660; otherwise, proceed to step S661.

[0085] In step S660, the intelligent recognition module 540 sends the retrieved road surface image to the main control module 510, which then sends it to the first display module 530 for display.

[0086] In step S661, the main control module 510 activates the road surface information acquisition module 570 through the wired communication module 560 to perform depth detection.

[0087] In step S670, the road surface information acquisition module 570 sends the water or snow depth data to the main control module 510.

[0088] In step S680, the main control module 510 compares the vehicle's preset safe value for water or snow depth with the actual measured data.

[0089] Step S690: Determine whether the actual measured value is greater than the safety value. If yes, proceed to step S691; otherwise, proceed to step S692.

[0090] In step S691, the main control module 510 sends a command to the voice alarm module 550 to provide a voice warning reminder.

[0091] Step S692, End.

[0092] In this specific embodiment, video analytics technology is used to identify road surface water or snow accumulation in advance, allowing vehicles to navigate through water or snow before they attempt to cross, thus avoiding the risks associated with such activities. Image comparison and retrieval technology retrieves past images of road conditions and displays them to the user, enabling them to make a preliminary assessment of the water and snow accumulation. Once water or snow accumulation is detected, the radar and sonar of the road information acquisition module 570 are activated to detect the depth of the water or snow accumulation, reducing the energy consumption of its continuous operation.

[0093] It should be noted that the steps shown in the above process or in the flowchart of the accompanying figures can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases the steps shown or described may be executed in a different order than that shown here.

[0094] This embodiment also provides a road surface condition detection device, which is used to implement the above embodiments and preferred embodiments; details already described will not be repeated. The terms "module," "unit," "subunit," etc., used below refer to combinations of software and / or hardware that achieve a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0095] Figure 7 This is a structural block diagram of a road condition detection device according to an embodiment of this application, such as...Figure 7 As shown, the device includes:

[0096] The first receiving module 710 is used to receive target images, including road conditions, acquired by the camera module during vehicle operation, and send the target images to the recognition module.

[0097] The second receiving module 720 is used to receive the recognition result generated by the recognition module based on the target image; the recognition result is used to identify whether a target object exists on the road surface.

[0098] The signal generation module 730 is used to generate a wake-up signal when a target object exists in the target image, and send the wake-up signal to the information acquisition module.

[0099] The detection module 740 is used to receive road surface condition information acquired by the information acquisition module and generate detection results based on the road surface condition information.

[0100] It should be noted that the above modules can be functional modules or program modules, and can be implemented through software or hardware. For modules implemented through hardware, the above modules can reside in the same processor; or the above modules can be located in different processors in any combination.

[0101] This embodiment also provides an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0102] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0103] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0104] S1, receive target images including road conditions during vehicle movement acquired by the camera module, and send the target images to the recognition module;

[0105] S2, Receive the recognition result generated by the recognition module based on the target image; the recognition result is used to identify whether a target object exists on the road surface;

[0106] S3, when a target object exists in the target image, a wake-up signal is generated and sent to the information acquisition module;

[0107] S4, receive road surface condition information obtained by the information acquisition module, and generate detection results based on the road surface condition information.

[0108] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, and will not be repeated in this embodiment.

[0109] Furthermore, in conjunction with the road surface condition detection method provided in the above embodiments, this embodiment can also provide a storage medium for implementation. The storage medium stores a computer program; when executed by a processor, the computer program implements the steps of any of the road surface condition detection methods described in the above embodiments.

[0110] It should be understood that the specific embodiments described herein are merely illustrative of the application and not intended to limit it. All other embodiments derived by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0111] Obviously, the accompanying drawings are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar situations based on these drawings without any creative effort. Furthermore, it is understood that although the work done in this development process may be complex and lengthy, for those skilled in the art, certain design, manufacturing, or production modifications made based on the technical content disclosed in this application are merely conventional technical means and should not be considered as insufficient disclosure of this application.

[0112] The term "embodiment" in this application refers to a specific feature, structure, or characteristic described in connection with an embodiment that may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily imply the same embodiment, nor does it imply that it is mutually exclusive with or independent of other embodiments. It will be clearly or implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0113] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of patent protection. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the appended claims.

Claims

1. A road surface condition detection device, characterized in that, The device includes: a control module, an identification module, a camera module, and an information acquisition module; The camera module is used to acquire target images, including road conditions, during vehicle operation and send the target images to the control module. The control module is configured to send the received target image to the recognition module for target object recognition and receive the recognition result returned by the recognition module; and, if the received recognition result indicates the presence of the target object in the target image, generate a wake-up signal and send the wake-up signal to the information acquisition module; and receive road condition information sent by the information acquisition module and generate a detection result based on the road condition information; the wake-up signal is used to wake up the information acquisition module; wherein, generating a detection result based on the road condition information includes: comparing the depth information of the target object with a preset value; if the depth information is greater than the preset value, then determining that there is an anomaly in the road surface; The recognition module is used to recognize the received target image using a pre-trained detection model and generate the recognition result; the recognition result is used to identify whether the target object exists in the target image; the recognition module is also used to calculate the similarity between the pre-stored historical image and the target image when the target object exists in the target image, and send the target historical image whose similarity meets the preset conditions to the control module; The information acquisition module is used to acquire road condition information, including depth information of the target object, in response to the received wake-up signal.

2. The road surface condition detection equipment according to claim 1, characterized in that, The device also includes an alarm module; The control module is further configured to generate an alarm signal based on the detection result, and send the alarm signal to the alarm module, thereby controlling the alarm module to generate an alarm based on the alarm signal.

3. The road surface condition detection equipment according to claim 1, characterized in that, The device also includes a display module; the control module is further configured to send the target historical image to the display module for display.

4. A vehicle, characterized in that, The vehicle is equipped with a road condition detection device and a driving recorder device as described in any one of claims 1 to 3; the control module, identification module, camera module, display module and alarm module of the road condition detection device are all located in the driving recorder device of the vehicle, and the information acquisition module is located on the top or front of the vehicle.

5. A method for detecting road surface condition, characterized in that, The method includes: Receive target images, including road conditions, acquired by the camera module during vehicle movement, and send the target images to the recognition module; The system receives the recognition result generated by the recognition module based on the target image; the recognition result is used to identify whether a target object exists on the road surface. When a target object exists in the target image and the recognition module retrieves a target historical image, the system receives the target historical image sent by the recognition module. The target historical image is a historical image selected by the recognition module based on the similarity between pre-stored historical images and the target image calculated by the recognition module. When a target object exists in the target image and the recognition module does not retrieve a target historical image, a wake-up signal is generated and sent to the information acquisition module. The wake-up signal is used to wake up the information acquisition module. The system receives road condition information, including depth information of the target object, obtained by the information acquisition module, and generates a detection result based on the road condition information. The step of generating the detection result based on the road condition information includes: comparing the depth information of the target object with a preset value, and determining that there is an anomaly in the road surface when the depth information is greater than the preset value.

6. The road surface condition detection method according to claim 5, characterized in that, The method further includes: generating an alarm signal based on the detection result, and sending the alarm signal to the alarm module.

7. A road surface condition detection device, characterized in that, The device includes: The first receiving module is used to receive target images, including road conditions, acquired by the camera module during vehicle operation, and send the target images to the recognition module; The second receiving module is used to receive the recognition result generated by the recognition module based on the target image; the recognition result is used to identify whether a target object exists on the road surface; the signal generating module is used to receive a target historical image sent by the recognition module when a target object exists in the target image and the recognition module retrieves a target historical image; the target historical image is a historical image selected by the recognition module based on the similarity between a pre-stored historical image and the target image calculated by the recognition module; it is also used to generate a wake-up signal when a target object exists in the target image and the recognition module does not retrieve a target historical image, and send the wake-up signal to the information acquisition module; the wake-up signal is used to wake up the information acquisition module; The detection module is used to receive road condition information, including depth information of the target object, obtained by the information acquisition module, and generate a detection result based on the road condition information; the step of generating a detection result based on the road condition information includes: comparing the depth information of the target object with a preset value, and determining that the road surface is abnormal when the depth information is greater than the preset value.

Images