Vehicle wading control method and device, electronic equipment and storage medium
Through the laser radar, it can sense the road information in real time and identify the water depth of low-lying road sections, and solve the safety problems of vehicles when wading water, realize the accurate monitoring and early warning of vehicles, reduce the risk of accidents, and improve the driver's emergency response capabilities.
Patent Information
- Application Number
- CN202411263909.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-11-12
AI Technical Summary
In the rainy season or extreme weather, it is difficult for vehicles to accurately judge the water depth of low-lying roads, resulting in vehicles that may accidentally enter deep water areas, causing accidents such as fire stalling or out of control. The existing vehicle control system cannot effectively control the vehicle's driving situation and road conditions.
By sending laser beams to the road section in front of the vehicle, using the lidar data to sense the road information in real time, identify low-lying road sections and calculate the water depth, and perform water wading warning operations if the preset threshold is reached to prevent the vehicle from entering the dangerous area.
It realizes accurate monitoring and early warning of vehicles when wading water, reduces the risk of accidents caused by wading water, improves drivers' emergency response capabilities, and ensures safe passage through the water-stacked sections.
Smart Images

Figure CN118928277A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent driving technology, and in particular to a vehicle wading control method, device, electronic device, and computer-readable storage medium. Background Art
[0002] During the rainy season or extreme weather, rainwater easily causes water to accumulate on the road, especially in some tunnels and low-lying sections. Most car owners are unable to clearly understand the safe wading depth of their vehicles and how to safely pass through the flooded sections. It is common for vehicles to stall in the water after driving to the low-lying sections and wait for rescue.
[0003] The current vehicle control system does not take into account the vehicle's driving conditions and the actual road conditions, and is unable to control the vehicle in a timely and accurate manner according to the road conditions. Summary of the invention
[0004] To solve the above technical problems, the embodiments of the present application provide a vehicle wading control method and device, an electronic device, a computer-readable storage medium, and a computer program product.
[0005] According to one aspect of an embodiment of the present application, a vehicle wading control method is provided, comprising: during vehicle driving, sending a laser beam to a road section in front of the vehicle to receive laser radar data returned by the road section in front of the vehicle; determining road information ahead of the vehicle based on the laser radar data; if the road information ahead indicates that the road ahead of the vehicle includes a low-lying section, sending a laser beam to the low-lying section to receive laser radar data of the low-lying section reflected from the low-lying section; determining a water depth corresponding to the low-lying section based on the laser radar data of the low-lying section, and if the water depth reaches a preset wading depth threshold, controlling the vehicle to perform a wading warning operation.
[0006] According to one aspect of an embodiment of the present application, determining the road ahead information of the vehicle based on the lidar data includes: obtaining the transmission and reception time difference between the emission time and the reception time of the laser beam in the lidar data; calculating the obstacle distribution information on the road ahead based on the transmission and reception time difference; and determining the road ahead information of the vehicle based on the obstacle distribution information.
[0007] According to one aspect of an embodiment of the present application, the method also includes: sending multiple laser beams to the road ahead of the vehicle at a preset frequency within a preset period; respectively calculating the receiving and sending time differences corresponding to each of the multiple laser beams; if multiple receiving and sending time differences show an increasing trend within the preset period, it is obtained that the road ahead of the vehicle is a low-lying section.
[0008] According to one aspect of an embodiment of the present application, determining the water depth corresponding to the low-lying road section based on the laser radar data of the low-lying road section includes: obtaining the reflection time of the laser beam on the water surface and the reflection time of the laser beam on the water bottom; calculating the refraction time difference between the water surface reflection time and the water bottom reflection time; obtaining the refraction angle of the water surface, and calculating the water depth corresponding to the low-lying road section based on the refraction angle and the refraction time difference.
[0009] According to one aspect of an embodiment of the present application, the method also includes: dividing the low-lying road section into multiple sub-sections, sending laser beams to the multiple sub-sections, and receiving multiple lidar data returned by the multiple sub-sections; performing three-dimensional modeling of the low-lying road section based on the multiple lidar data to obtain a three-dimensional model corresponding to the low-lying road section; and determining the water depth distribution corresponding to the low-lying road section based on the three-dimensional model.
[0010] According to one aspect of an embodiment of the present application, the method also includes: obtaining configuration information corresponding to the vehicle, the configuration information including the vehicle air intake height, the vehicle chassis height and the vehicle model; determining a preset wading depth threshold corresponding to the vehicle based on the vehicle air intake height, the vehicle chassis height and the vehicle model.
[0011] According to one aspect of an embodiment of the present application, the method also includes: determining obstacles in the low-lying road section based on the water depth distribution, the obstacles including mud and stones; and adjusting a preset wading depth threshold corresponding to the vehicle based on the mud and the stones.
[0012] According to one aspect of an embodiment of the present application, a vehicle wading control device is provided, including: a receiving module, used to send a laser beam to a road section in front of the vehicle during vehicle driving, so as to receive laser radar data returned from the road section in front of the vehicle; a determination module, used to determine the road information in front of the vehicle based on the laser radar data; a calculation module, used to send a laser beam to the low-lying section if the road information in front of the vehicle indicates that the road in front of the vehicle includes a low-lying section, so as to receive the low-lying section laser radar data reflected from the low-lying section; a control module, used to determine the water depth corresponding to the low-lying section based on the laser radar data of the low-lying section, and control the vehicle to perform a wading warning operation if the water depth reaches a preset wading depth threshold.
[0013] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the electronic device implements the vehicle wading control method as described above.
[0014] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor of a computer, the computer executes the vehicle wading control method as described above.
[0015] According to one aspect of an embodiment of the present application, a computer program product is also provided, including a computer program, which implements the steps in the vehicle wading control method as described above when executed by a processor.
[0016] In the technical solution provided in the embodiments of the present application, during the driving process of the vehicle, by sending a laser beam to the road section in front of the vehicle, the laser radar can perceive the road conditions in front of the vehicle in real time. When a low-lying section is detected and the water depth reaches the preset wading depth threshold, the vehicle can promptly perform wading warning operations to avoid dangerous situations caused by the vehicle mistakenly entering deep water areas. Through the precise monitoring and warning of the laser radar, the vehicle can avoid areas with excessive water accumulation, thereby reducing the risk of accidents such as vehicle stalling and loss of control due to wading. After receiving the wading warning, the driver has enough time to make judgments and take avoidance measures, thereby improving the driver's emergency response ability.
[0017] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the drawings:
[0019] Figure 1 is a schematic diagram of an implementation environment for vehicle wading control during vehicle driving, shown in an exemplary embodiment of the present application;
[0020] Figure 2 is a flow chart of a vehicle wading control method shown in an exemplary embodiment of the present application;
[0021] Figure 3 is a flow chart of a vehicle wading control method shown in another exemplary embodiment of the present application;
[0022] Figure 4 is a flow chart of a vehicle wading control method shown in another exemplary embodiment of the present application;
[0023] Figure 5is a flow chart of a vehicle wading control method shown in another exemplary embodiment of the present application;
[0024] Figure 6 is a schematic diagram showing the propagation of a laser beam in a low-lying road section according to an exemplary embodiment;
[0025] Figure 7 is a flow chart of a vehicle wading control method shown in another exemplary embodiment of the present application;
[0026] Figure 8 is a flow chart of a vehicle wading control method shown in another exemplary embodiment of the present application;
[0027] Fig. 9 is a flow chart of a vehicle wading control method shown in another exemplary embodiment of the present application;
[0028] Fig.10 is a simplified flow chart of vehicle wading control in an exemplary application scenario;
[0029] Fig.11 is a block diagram of a vehicle wading control device shown in an exemplary embodiment of the present application;
[0030] Fig.12 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION
[0031] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.
[0032] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.
[0033] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.
[0034] The term "multiple" as used in this application refers to two or more than two. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship.
[0035] First of all, it should be noted that LiDAR can build a 3D model of the vehicle's surroundings in real time by actively emitting lasers and receiving reflected signals. In wading scenarios, this helps the vehicle more accurately perceive key information such as water depth, water flow speed, and underwater topography. Based on these perception data, the vehicle can make more intelligent decisions, such as adjusting the driving speed, choosing a safer wading route, or promptly reminding the driver to take risk avoidance measures.
[0036] LiDAR has the characteristics of high precision and high resolution, and can accurately measure the distance and shape of target objects. In wading detection, this high precision enables the vehicle to more accurately judge the water depth and terrain changes. At the same time, LiDAR has a long detection distance and can sense potential dangers ahead before the vehicle approaches the wading area. Compared with other sensors (such as cameras), LiDAR performs more stably in adverse weather conditions. In low-visibility environments such as rainy or foggy days, LiDAR can still work normally and provide stable perception data for the vehicle. In addition, LiDAR is insensitive to changes in light, and can effectively avoid misjudgments caused by insufficient light or changes in reflectivity.
[0037] Figure 1 FIG. 1 is a schematic diagram of an implementation environment for vehicle wading control during vehicle driving, shown in an exemplary embodiment of the present application. Figure 1 As shown, during the driving process of the vehicle, the on-board lidar device 110 sends a laser beam to the road section in front of the vehicle and receives the lidar data returned by the road section in front of the vehicle. The control-end server 120 can determine the road information ahead of the vehicle based on the returned lidar data. If the server 120 detects that the road ahead of the vehicle includes a low-lying section, the lidar device 110 can send a laser beam to the low-lying section when the vehicle drives to the low-lying section, and receive the lidar data of the low-lying section. The server 120 determines the water depth corresponding to the low-lying section based on the lidar data of the low-lying section. If the water depth reaches the preset wading depth threshold, the vehicle is controlled to perform a wading warning operation. Figure 1The control server 120 shown is a navigation server, which can be, for example, an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms, etc., which are not limited here. The laser radar device 110 can communicate with the control server 120 through wireless networks such as 3G (third generation mobile information technology), 4G (fourth generation mobile information technology), and 5G (fifth generation mobile information technology), which are not limited here.
[0038] During the rainy season or extreme weather, rainwater easily causes water to accumulate on the road, especially in some tunnels and low-lying sections. Most car owners are unable to clearly understand the safe wading depth of their vehicles and how to safely pass through the flooded sections. It is common for vehicles to stall in the water after driving to low-lying sections and wait for rescue. The current vehicle control system does not consider the vehicle's own driving conditions and the actual road conditions, and cannot control the vehicle in a timely and accurate manner according to the road conditions.
[0039] The above-mentioned problems are generally applicable in general travel scenarios. To solve these problems, the embodiments of the present application respectively propose a vehicle wading control method, a vehicle wading control device, an electronic device, a computer-readable storage medium, and a computer program product, which will be described in detail below.
[0040] See also Figure 2 , Figure 2 is a flow chart of a vehicle wading control method shown in an exemplary embodiment of the present application. The method can be applied to Figure 1 The implementation environment shown is specifically executed by the server 120 in the implementation environment. It should be understood that the method can also be applied to other exemplary implementation environments and be specifically executed by devices in other implementation environments. This embodiment does not limit the implementation environment to which the method is applicable.
[0041] like Figure 2 As shown, in an exemplary embodiment, the vehicle wading control method includes at least steps S210 to S240, which are described in detail as follows:
[0042] Step S210, during the driving process of the vehicle, a laser beam is sent to the road section in front of the vehicle to receive the laser radar data returned by the road section in front of the vehicle.
[0043] First of all, it should be noted that the laser inside the LiDAR system periodically emits laser pulses. These laser pulses pass through a specific lens system or beam controller and are directed to the road section in front of the vehicle in a specific direction and angle. When the laser pulse encounters objects in the road section ahead (such as vehicles, pedestrians, trees, buildings, etc.), part of the laser energy will be reflected back by the surface of these objects. The photodetector in the LiDAR system is responsible for receiving these reflected laser signals. After being focused and filtered by the optical system, these signals are converted into electrical signals. After amplification, filtering, and analog-to-digital conversion, the received electrical signals are sent to the information processing module for calculation. Based on the time difference (Round Trip Time) between the emission time and the reception time of the laser pulse, combined with physical parameters such as the speed of light, the distance from the LiDAR to the target object can be calculated. In addition, the LiDAR can also obtain the intensity information of the reflected laser, which helps to identify objects of different materials. By continuously emitting and receiving laser pulses, the LiDAR can obtain three-dimensional point cloud data of the road section ahead of the vehicle in real time. After further processing and fusion, these data can generate accurate three-dimensional stereo images, providing the vehicle with comprehensive environmental perception capabilities.
[0044] Specifically, when the vehicle is driving, it sends a laser beam to the road ahead of the vehicle to receive the laser radar data returned by the road ahead of the vehicle. This process is a crucial part of autonomous driving and advanced driver assistance systems (ADAS). Lidar (Light Detection And Ranging) provides vehicles with accurate environmental perception capabilities through its unique working principle.
[0045] Step S220, determining the road information ahead of the vehicle based on the laser radar data.
[0046] Specifically, the lidar collects point cloud data of the road environment ahead by continuously emitting laser pulses in front of the vehicle and receiving the reflected signals. These data contain information such as the distance, position, shape, and reflection intensity of the object. The original point cloud data may contain noise and invalid points, and filtering is required to remove these interference factors. Feature information of the road environment, such as road boundaries, lane lines, obstacles, etc., is extracted from the processed point cloud data. This is usually achieved by identifying geometric features (such as straight lines, curves), reflection intensity differences, and height information in the point cloud. Using the extracted feature information, the road environment ahead is reconstructed in three dimensions to form an accurate three-dimensional stereo image.
[0047] Step S230: If the road ahead information indicates that the road ahead of the vehicle includes a low-lying section, a laser beam is sent to the low-lying section to receive the low-lying section laser radar data reflected back by the low-lying section.
[0048] Specifically, the LiDAR system first identifies low-lying areas in the road ahead by processing point cloud data. This is usually achieved by analyzing the height changes, shape characteristics, and possible reflection characteristics of water in the point cloud. Once a low-lying section is identified, the system adjusts the LiDAR's scanning strategy. Specifically, it increases the scanning density of the low-lying section, that is, it sends more laser beams to the area. This helps to obtain more detailed and accurate three-dimensional information of the low-lying section. The LiDAR emits dense laser beams to the low-lying section according to the adjusted scanning strategy. These beams will illuminate the ground, water, obstacles and other objects in the low-lying section and produce reflections. The LiDAR receives these reflected laser signals and converts them into electrical signals for processing. These signals contain the depth, width, shape of the low-lying section and possible obstacle information. The received LiDAR data for the low-lying section needs to be further processed and analyzed. The system uses algorithms to extract useful information, such as the depth, width, shape contour of the low-lying section, and the location and size of obstacles.
[0049] Specifically, if it is determined that the road ahead of the vehicle includes a low-lying section, then when the vehicle drives into the low-lying section, multiple laser beams are sent to the low-lying section. Laser beams can be sent to different areas of the low-lying section, and the depth, width, shape outline, and location and size of obstacles corresponding to the low-lying section can be determined based on the lidar data returned from different areas.
[0050] Step S240, determining the water depth corresponding to the low-lying road section based on the laser radar data of the low-lying road section, and if the water depth reaches a preset wading depth threshold, controlling the vehicle to perform a wading warning operation.
[0051] Specifically, usually, the dry ground at the edge of the low-lying road section is selected as the reference plane, and its height can be regarded as the zero water level or the reference height. Use the vehicle-mounted laser radar system to scan the low-lying road section area. The laser radar can generate high-precision three-dimensional point cloud data, which contains the shape and height information of the surrounding environment (including the ground and the water surface). By counting the average height of all points on the water surface, the relative height of the water surface can be obtained. The water depth value obtained by subtracting the height of the reference plane from the average height of the water surface is the water depth of the low-lying road section. Set a preset wading depth threshold. This threshold is determined according to the type, performance and safety standards of the vehicle. For example, a lower threshold may be set for ordinary cars, while a higher threshold may be set for off-road vehicles. If the water depth is greater than or equal to the preset wading depth threshold, a wading warning operation is performed. Wading warning operation. The warning operation may include but is not limited to: displaying a warning message on the vehicle dashboard. Issuing an audible or visual alarm to alert the driver. Automatically adjusting the vehicle's driving mode (such as reducing the speed, increasing the driving force, etc.) to adapt to the wading environment. In extreme cases, even emergency braking measures can be taken to ensure safety.
[0052] In this embodiment, during the driving process of the vehicle, by sending a laser beam to the road section in front of the vehicle, the laser radar can sense the road conditions in front of the vehicle in real time. When a low-lying section is detected and the water depth reaches the preset wading depth threshold, the vehicle can promptly perform wading warning operations to avoid dangerous situations caused by the vehicle accidentally entering deep water areas. Through the precise monitoring and warning of the laser radar, the vehicle can avoid areas with excessive water accumulation, thereby reducing the risk of accidents such as vehicle stalling and loss of control due to wading. After receiving the wading warning, the driver has enough time to make judgments and take avoidance measures, thereby improving the driver's emergency response ability.
[0053] Further, based on the above embodiments, please refer to Figure 3 In one of the exemplary embodiments provided in the present application, the specific implementation process of determining the road information ahead of the vehicle based on the laser radar data may also include steps S310 to S330, which are described in detail as follows:
[0054] Step S310, obtaining the time difference between the emission time and the reception time of the laser beam in the laser radar data;
[0055] Step S320, calculating obstacle distribution information on the road ahead based on the sending and receiving time difference;
[0056] Step S330: determining the road ahead information of the vehicle based on the obstacle distribution information.
[0057] Specifically, the LiDAR system emits a series of laser pulses into the surrounding environment. Each pulse has a unique identifier and a precise emission timestamp. When the laser pulse encounters an object (such as an obstacle, road sign, etc.), part of the light will be reflected back to the LiDAR. The LiDAR receiver captures these reflected lights and records their reception timestamps. By comparing the emission timestamp of each laser pulse with the corresponding reception timestamp, the time difference from the emission to the reception of the laser beam (i.e., the round-trip time) can be calculated. This time difference is a key parameter for calculating the distance of an object.
[0058] Using the speed of light in air (about 300 million meters per second) and the known time difference between sending and receiving, the distance from the obstacle encountered by the laser pulse to the laser radar can be calculated. The formula is usually: distance = (speed of light * time difference) / 2 (because the time is round trip).
[0059] LiDAR usually contains multiple transmitters and receivers (or rotatable transmitters / receivers). By measuring the return time of laser pulses emitted at different angles, the direction and position of obstacles can be determined. By integrating the obstacle distance and direction information measured by all laser pulses, a three-dimensional point cloud map can be constructed, which represents the shape and position of the vehicle's surroundings. By analyzing the terrain features in the point cloud map (such as road surface flatness, edge lines, etc.), road areas can be identified. Usually, the road surface is relatively flat and continuous, while obstacles (such as vehicles, pedestrians, trees, etc.) appear as bumps or irregular shapes in the point cloud.
[0060] In this embodiment, by measuring the time difference between the emission and reception of the laser beam and calculating using the speed of light, the distance from the laser radar to the obstacle can be accurately obtained. The laser radar can still work normally at night and in severe weather conditions and is not restricted by environmental factors, providing the vehicle with continuous and reliable environmental perception capabilities, further improving driving safety.
[0061] Further, based on the above embodiments, please refer to Figure 4 In one of the exemplary embodiments provided in the present application, the specific implementation process of the above-mentioned vehicle wading control may also include steps S410 to S430, which are described in detail as follows:
[0062] Step S410, sending a plurality of laser beams to the road ahead of the vehicle at a preset frequency within a preset period;
[0063] Step S420, respectively calculating the sending and receiving time differences corresponding to the multiple laser beams;
[0064] Step S430: If the plurality of receiving and sending time differences show an increasing trend within the preset period, it is determined that there is a low-lying road ahead of the vehicle.
[0065] Specifically, the preset period is a time window for collecting enough data for analysis. This period should be long enough to capture changes in road terrain, but not too long to delay response to emergencies. Preset frequency: This is the rate at which the lidar emits laser beams. A higher frequency can provide denser data points, thereby more accurately depicting the contours of the road terrain. However, this will also increase the complexity and computational workload of data processing. For each emission and reception of a laser beam, the emission timestamp and reception timestamp are recorded. The time difference between the transmission and reception of each laser beam is calculated, and this time difference is proportional to the distance of the obstacle (or ground) encountered by the laser beam. If multiple consecutive time differences are observed to be gradually increasing, this usually means that the laser beam is gradually approaching a lower terrain, that is, the vehicle is approaching a low-lying road section. When this increasing trend reaches a certain level of significance (which can be determined by setting a threshold or statistical test), it can be judged that there is a low-lying road section in front of the vehicle.
[0066] In this embodiment, by sending laser beams at a preset period and preset frequency, real-time dynamic monitoring of the road environment ahead can be achieved. This continuous, high-frequency monitoring method can capture subtle changes in road conditions, such as slight ups and downs in the road surface, changes in water depth, etc., providing the vehicle with more timely and accurate environmental information.
[0067] Further, based on the above embodiment, please refer to Figure 5 In one of the exemplary embodiments provided in the present application, the specific implementation process of determining the water depth corresponding to the low-lying road section based on the low-lying road section laser radar data may also include steps S510 to S530, which are described in detail as follows:
[0068] Step S510, obtaining the reflection time of the laser beam on the water surface and the reflection time of the laser beam on the water bottom;
[0069] Step S520, calculating the refraction time difference between the water surface reflection time and the water bottom reflection time;
[0070] Step S530, obtaining the refraction angle of the water surface, and calculating the water depth corresponding to the low-lying road section based on the refraction angle and the refraction time difference.
[0071] Specifically, when a vehicle drives into a low-lying flooded section of road, the data collected by the lidar installed on the vehicle will be transmitted to the vehicle's corresponding terminal. The lidar data returned by the lidar can then be used to determine the depth and distribution of water in the low-lying section. Combined with the water depth, it can be determined whether there are mud, stones, and other factors that affect traffic in the low-lying section, and then whether the vehicle can pass through the low-lying section.
[0072] For example, see Figure 6 , assuming that the propagation speed of light in air is V1, the propagation speed of light in water is V2, and the refractive index of light in air is n1 and the refractive index of light in water is n2, and the incident angle of light on the water surface is θ, the refraction angle is α, and the water depth is D. When the laser sent by the lidar sensor is used as the incident light, the laser will reflect a part of the echo when it reaches the water surface first, which takes T1, and will reflect the echo again after reaching underwater, and the second time takes T2, so the propagation distance of the laser underwater can be expressed as:
[0073]
[0074] Furthermore, the water depth corresponding to the low-lying road section can be expressed as:
[0075]
[0076] According to the relationship between refractive index and velocity and other parameters, it can be expressed as:
[0077]
[0078] Since the refractive index n1 of light in air is approximately 1, that is:
[0079]
[0080] Since the propagation speed of light in air V1 is approximately equal to the speed of light C, we can deduce from (1) and (2) above that:
[0081]
[0082] Furthermore, the water depth corresponding to the low-lying road section can be calculated.
[0083] For example, when the laser beam first hits the water surface, part of the light will be immediately reflected back to the LiDAR, and this timestamp can be recorded as the water surface reflection time. After the laser beam penetrates the water surface, it will also be reflected at the bottom of the water and received by the LiDAR again. This timestamp can be recorded as the bottom reflection time. Refraction time difference = bottom reflection time - surface reflection time
[0084] This difference represents the total time it takes for the laser beam to penetrate from the water surface to the bottom and back (not including the propagation time in the water). However, since the laser beam propagates slower in water than in air (about 3 / 4 of the speed of light in a vacuum), this difference needs to be further processed to calculate the water depth.
[0085] In this embodiment, the water depth of the low-lying area is calculated by the refraction time difference between the reflection time of the laser beam on the water surface and the water bottom, and the refraction angle of the water surface. The depth of the accumulated water will directly affect the propagation path and time of the laser beam. Therefore, the change in this time difference becomes an effective basis for identifying low-lying sections. By timely identifying low-lying sections, vehicles can adjust their driving strategies in advance to avoid risks caused by wading too deep.
[0086] Further, based on the above embodiments, please refer to Figure 7 In one of the exemplary embodiments provided in the present application, the specific implementation process of the above-mentioned vehicle wading control method may also include steps S710 to S730, which are described in detail as follows:
[0087] Step S710, dividing the low-lying road section into multiple sub-road sections, sending laser beams to the multiple sub-road sections, and receiving multiple laser radar data returned by the multiple sub-road sections;
[0088] Step S720, performing three-dimensional modeling on the low-lying road section based on the multiple laser radar data to obtain a three-dimensional model corresponding to the low-lying road section;
[0089] Step S730, determining the water depth distribution corresponding to the low-lying road section based on the three-dimensional model.
[0090] Specifically, the low-lying road section in front of the vehicle can be divided into multiple sub-sections, and then laser beams are sent to the multiple sub-sections, and multiple lidar data returned by the multiple sub-sections are received. Then, three-dimensional modeling of the low-lying road section is performed by analyzing the multiple lidar data to obtain high-precision three-dimensional data of the low-lying road section, wherein the three-dimensional data includes the water depth of the low-lying road section, road conditions, obstacle information therein, etc.
[0091] Specifically, in some feasible embodiments, the lidar sensor collects water depth within an area range M of 1.5m×1m, the system sends a laser once within a range of 5cm×5cm, and analyzes and models the water depth data collected by the lidar sensor within the area M multiple times to obtain high-precision three-dimensional data of the surrounding environment, including water depth, road conditions and obstacle information.
[0092] First, the low-lying road section is divided into multiple sub-sections. This step is to monitor the condition of the entire road section more finely, because the water depth at different locations in the low-lying road section may vary greatly due to complex terrain and uneven water accumulation. By dividing the sub-sections, data can be collected and analyzed more targetedly. Next, laser beams are sent to these sub-sections and the returned lidar data is received. Lidar calculates the distance by emitting laser beams and measuring the time it takes for them to reflect back, thereby obtaining the three-dimensional coordinate information of the target object. In the application of low-lying road sections, lidar can capture the surface morphology of objects such as road surfaces and water accumulation, providing basic data for subsequent three-dimensional modeling. Then, based on the collected multiple lidar data, three-dimensional modeling is performed on the low-lying road section. Three-dimensional modeling is the process of converting two-dimensional or three-dimensional lidar data into a visual three-dimensional model. Then, through three-dimensional modeling, the terrain, water depth and other information of the low-lying road section can be intuitively displayed, providing a basis for subsequent decision-making analysis. Finally, the water depth distribution corresponding to the low-lying road section is determined based on the three-dimensional model. In the three-dimensional model, the location, shape and depth of the accumulated water in each sub-section can be clearly seen.
[0093] In this embodiment, the low-lying road section is subdivided into multiple sub-sections, which can capture terrain changes more accurately and reduce errors caused by large-scale measurements. The three-dimensional model generated based on lidar data can intuitively display the terrain undulations and height changes of the low-lying road section. Through the three-dimensional model, the water depth of each sub-section can be accurately calculated, providing a reliable reference for vehicle driving.
[0094] Further, based on the above embodiments, please refer to Figure 8 In one of the exemplary embodiments provided in the present application, the specific implementation process of the above-mentioned vehicle wading control method may also include step S810 and step S820, which are described in detail as follows:
[0095] Step S810, obtaining configuration information corresponding to the vehicle, the configuration information including the height of the vehicle air intake, the height of the vehicle chassis and the vehicle model;
[0096] Step S820, determining a preset wading depth threshold corresponding to the vehicle based on the vehicle air intake height, the vehicle chassis height and the vehicle model.
[0097] Specifically, the laser radar data can be used to calculate the water depth of low-lying sections in real time, and then compare it with the maximum wading height of the vehicle. Considering that the vehicle will affect the accumulation of water during driving, and the water waves will cause the water surface to rise, the system believes that the water level exceeds 1 / 2 of the tire, that is, it is in a wading state; in summary, according to the specific model, the minimum value of the maximum wading depth of common models and the height of 1 / 2 of the tire is taken as the critical value. If it exceeds the critical value, the system will determine that it is in a wading state. If the water depth is lower than the safety threshold and the road condition is good, the system will judge it as "safe to pass"; if the water depth is close to the safety threshold or the road condition is general, the system will judge it as "careful to pass"; if the water depth exceeds the safety threshold or the road condition is poor, the system will judge it as "do not pass".
[0098] Exemplarily, it is necessary to obtain detailed configuration information of the vehicle from the vehicle manufacturer's database, vehicle manual, or through the vehicle system interface (such as the OBD-II interface). This information includes, but is not limited to, the height of the vehicle's air intake: This is the height of the vehicle's engine air intake relative to the ground, which is critical to preventing water from entering the engine. Vehicle chassis height: The chassis height determines the vehicle's ability to pass through uneven or flooded roads. Vehicle model: Vehicle model information may affect other factors of wading capability, such as tire size, vehicle weight distribution, etc. Although this information is not directly used to calculate the wading depth, it can be used as a reference to fine-tune the preset threshold.
[0099] Further, the air intake height is used as the upper limit: The most direct method is to use the air intake height as the absolute upper limit of the wading depth. In theory, the vehicle's wading depth should not exceed the air intake height to prevent water from entering the engine and causing stalling or damage. Chassis height as a reference: Although the chassis height is not a factor that directly determines the wading depth, it provides the minimum safe clearance when the vehicle passes through a flooded area. It can be used as a reference factor for adjusting the wading depth threshold, especially when the air intake height is high but the chassis is low. Vehicle-specific adjustments: For some special models (such as the difference between off-road vehicles, SUVs and sedans), fine-tuning may be required based on their design and performance characteristics. For example, off-road vehicles generally have a higher chassis and superior wading capabilities, and their wading depth threshold can be appropriately increased.
[0100] In this embodiment, by accurately calculating the wading depth threshold of the vehicle, the driver can clearly know at what depth of water it is safe to drive, thereby avoiding the engine from flooding, flameout, or even more serious damage due to wading too deep, greatly improving driving safety. In addition, vehicles of different models and configurations have different wading capabilities. By accurately calculating the wading depth threshold of each vehicle, more personalized driving suggestions can be provided to users to meet the needs and preferences of different drivers.
[0101] Further, based on the above embodiments, please refer to Fig. 9 In one of the exemplary embodiments provided in the present application, the specific implementation process of the above-mentioned vehicle wading control method may also include step S910 and step S920, which are described in detail as follows:
[0102] Step S910, determining obstacles in the low-lying road section based on the water depth distribution, the obstacles including mud and stones;
[0103] Step S920, adjusting a preset wading depth threshold corresponding to the vehicle based on mud and rocks.
[0104] It should be noted that muddy areas usually have lower load-bearing capacity and higher friction, which may cause vehicles to get stuck or slip. Muddy areas are detected through visual recognition (such as driver observation or using on-board cameras) or sensor data (such as soil moisture sensors). Rocks may be hidden in the water and cause damage to the vehicle's chassis and tires. The presence and size of rocks are detected through sensors such as radar, laser radar (LiDAR) or high-definition cameras.
[0105] Specifically, if the muddy area is extensive and deep, the wading depth threshold should be significantly lowered, and it is even recommended to avoid entering the area. If the mud is shallow and the vehicle has sufficient passability, the wading depth threshold can be slightly lowered, but it should be ensured that the vehicle has sufficient power and traction to overcome the resistance of the mud. If stones are detected and their size may cause damage to the vehicle, the wading depth threshold should be re-evaluated, taking into account the vehicle's chassis height and tire size. If the stones are small and sparsely distributed, it may not be necessary to significantly adjust the wading depth threshold; but if the stones are large or dense, the wading depth threshold should be significantly lowered or a detour should be chosen. Therefore, it is necessary to adjust the vehicle's preset wading depth threshold based on the mud and stones in the low-lying sections.
[0106] In this embodiment, in addition to considering the water depth itself, obstacles such as mud and stones that may exist in low-lying road sections are also considered, which enhances the comprehensiveness of the water wading risk assessment. Moreover, since obstacles such as mud and stones may reduce the vehicle's passing ability, the accuracy of the vehicle's wading depth facilities can be improved.
[0107] Fig.101 is a brief flow chart of vehicle wading control in an exemplary application scenario. In the application scenario shown in 10, during the driving process of the vehicle, a laser beam is sent to the road section in front of the vehicle to receive the laser radar data returned by the road section in front of the vehicle; multiple laser beams are sent to the road in front of the vehicle at a preset frequency within a preset period; the time difference between sending and receiving corresponding to the multiple laser beams is calculated respectively; if multiple time differences between sending and receiving show an increasing trend within the preset period, the result that the road section in front of the vehicle is a low-lying section is obtained. The low-lying section is divided into multiple sub-sections, laser beams are sent to the multiple sub-sections, and multiple laser radar data returned by the multiple sub-sections are received; three-dimensional modeling is performed on the low-lying section based on the multiple laser radar data to obtain a three-dimensional model corresponding to the low-lying section; the water depth distribution corresponding to the low-lying section is determined based on the three-dimensional model. The configuration information corresponding to the vehicle is obtained, and the configuration information includes the height of the vehicle air intake, the height of the vehicle chassis and the vehicle model; the preset wading depth threshold corresponding to the vehicle is determined based on the height of the vehicle air intake, the height of the vehicle chassis and the vehicle model. If the water depth reaches the preset wading depth threshold, the vehicle is controlled to perform a wading warning operation. For the detailed implementation process, please refer to the records in the aforementioned embodiments, which will not be described in detail here.
[0108] Fig.11 is a block diagram of a vehicle wading control device shown in an exemplary embodiment of the present application. The device can be applied to Figure 1 The implementation environment shown in the figure is specifically configured in the server 120. The device can also be applied to other exemplary implementation environments and specifically configured in other devices. This embodiment does not limit the implementation environment to which the device is applied.
[0109] like Fig.11 As shown, the exemplary vehicle wading control device includes: a receiving module 1110, which is used to send a laser beam to the road section ahead of the vehicle during the vehicle's driving process, so as to receive the laser radar data returned by the road section ahead of the vehicle; a determination module 1120, which is used to determine the road information ahead of the vehicle based on the laser radar data; a calculation module 1130, which is used to send a laser beam to the low-lying section if the road information ahead indicates that the road ahead of the vehicle includes a low-lying section, so as to receive the low-lying section laser radar data reflected from the low-lying section; a control module 1140, which is used to determine the water depth corresponding to the low-lying section based on the laser radar data of the low-lying section, and if the water depth reaches a preset wading depth threshold, control the vehicle to perform a wading warning operation.
[0110] According to one aspect of an embodiment of the present application, the above-mentioned determination module 1120 is also used to obtain the transmission and reception time difference between the emission time and the reception time of the laser beam in the lidar data; calculate the obstacle distribution information on the road ahead based on the transmission and reception time difference; and determine the road ahead information of the vehicle based on the obstacle distribution information.
[0111] According to one aspect of an embodiment of the present application, the above-mentioned determination module 1120 is also used to send multiple laser beams to the road ahead of the vehicle at a preset frequency within a preset period; calculate the sending and receiving time differences corresponding to each of the multiple laser beams; if multiple sending and receiving time differences show an increasing trend within the preset period, it is obtained that the road ahead of the vehicle is a low-lying section.
[0112] According to one aspect of an embodiment of the present application, the above-mentioned control module 1140 is also used to obtain the reflection time of the laser beam on the water surface and the reflection time of the laser beam on the bottom of the water; calculate the refraction time difference between the water surface reflection time and the water bottom reflection time; obtain the refraction angle of the water surface, and calculate the water depth corresponding to the low-lying road section based on the refraction angle and the refraction time difference.
[0113] According to one aspect of an embodiment of the present application, the above-mentioned control module 1140 is also used to divide the low-lying road section into multiple sub-sections, send laser beams to the multiple sub-sections, and receive multiple lidar data returned by the multiple sub-sections; perform three-dimensional modeling of the low-lying road section based on the multiple lidar data to obtain a three-dimensional model corresponding to the low-lying road section; and determine the water depth distribution corresponding to the low-lying road section based on the three-dimensional model.
[0114] According to one aspect of an embodiment of the present application, the above-mentioned vehicle wading control device also includes: an acquisition module, used to obtain configuration information corresponding to the vehicle, the configuration information includes the vehicle air intake height, the vehicle chassis height and the vehicle model; a threshold module, used to determine the preset wading depth threshold corresponding to the vehicle based on the vehicle air intake height, the vehicle chassis height and the vehicle model.
[0115] According to one aspect of an embodiment of the present application, the above-mentioned vehicle wading control device also includes: an obstacle determination module, which is used to determine obstacles in low-lying road sections based on water depth distribution, and the obstacles include mud and stones; an adjustment module is used to adjust a preset wading depth threshold corresponding to the vehicle based on mud and stones.
[0116] It should be noted that the vehicle wading control device provided in the above embodiment and the vehicle wading control method provided in the above embodiment belong to the same concept, wherein the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment, and will not be repeated here. In practical applications, the vehicle wading control device provided in the above embodiment can allocate the above functions to different functional modules as needed, that is, divide the internal structure of the device into different functional modules to complete all or part of the functions described above, and this is not limited here.
[0117] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by one or more processors, the electronic device implements the vehicle wading control method provided in the above-mentioned embodiments.
[0118] Fig.12 The structure diagram of the computer system suitable for implementing the electronic device of the embodiment of the present application is shown. It should be noted that: Fig.12 The computer system 1200 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0119] like Fig.12 As shown, the computer system 1200 includes a central processing unit (CPU) 1201, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1202 or the program loaded from the storage part 1208 to the random access memory (RAM) 1203, such as executing the method in the above embodiment. In the RAM 1203, various programs and data required for system operation are also stored. The CPU 1201, the ROM 1202 and the RAM 1203 are connected to each other through the bus 1204. The input / output (I / O) interface 1205 is also connected to the bus 1204.
[0120] The following components are connected to the I / O interface 1205: an input section 1206 including a keyboard, a mouse, etc.; an output section 1207 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1208 including a hard disk, etc.; and a communication section 1209 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1209 performs communication processing via a network such as the Internet. A drive 1210 is also connected to the I / O interface 1205 as needed. A removable medium 1211, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1210 as needed so that a computer program read therefrom is installed into the storage section 1208 as needed.
[0121] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 1209, and / or installed from a removable medium 1211. When the computer program is executed by a central processing unit (CPU) 1201, various functions defined in the system of the present application are executed.
[0122] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. A computer program contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.
[0123] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0124] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.
[0125] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the vehicle wading control method as described above is implemented. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.
[0126] Another aspect of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the vehicle wading control method provided in each of the above embodiments.
[0127] The above content is only a preferred exemplary embodiment of the present application and is not intended to limit the implementation scheme of the present application. A person skilled in the art can easily make corresponding changes or modifications based on the main concept and spirit of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection required by the claims.
Claims
1. A vehicle wading control method, characterized in that: include: During the driving process of the vehicle, a laser beam is sent to the road section in front of the vehicle to receive laser radar data returned by the road section in front of the vehicle; Determining road information ahead of the vehicle based on the laser radar data; If the front road information indicates that the road ahead of the vehicle includes a low-lying section, sending a laser beam to the low-lying section to receive low-lying section laser radar data reflected by the low-lying section; The water depth corresponding to the low-lying road section is determined based on the laser radar data of the low-lying road section. If the water depth reaches a preset wading depth threshold, the vehicle is controlled to perform a wading warning operation.
2. The method according to claim 1, characterized in that The determining the road information ahead of the vehicle based on the laser radar data comprises: Obtaining a time difference between the emission time and the reception time of the laser beam in the laser radar data; Calculating obstacle distribution information on the road ahead based on the sending and receiving time difference; The road ahead information of the vehicle is determined based on the obstacle distribution information.
3. The method according to claim 2, characterized in that The method further comprises: Sending a plurality of laser beams to a road ahead of the vehicle at a preset frequency within a preset period; respectively calculating the sending and receiving time differences corresponding to the multiple laser beams; If a plurality of receiving and sending time differences show an increasing trend within the preset period, it is obtained that there is a low-lying road section ahead of the vehicle.
4. The method according to claim 1, characterized in that The determining the water depth corresponding to the low-lying road section based on the laser radar data of the low-lying road section includes: Obtaining the reflection time of the laser beam on the water surface and the reflection time of the laser beam on the water bottom; Calculating the refraction time difference between the water surface reflection time and the water bottom reflection time; The refraction angle of the water surface is obtained, and the water depth corresponding to the low-lying road section is calculated based on the refraction angle and the refraction time difference.
5. The method according to claim 4, characterized in that The method further comprises: Divide the low-lying road section into a plurality of sub-road sections, send laser beams to the plurality of sub-road sections, and receive a plurality of laser radar data returned by the plurality of sub-road sections; Performing three-dimensional modeling on the low-lying road section based on the multiple laser radar data to obtain a three-dimensional model corresponding to the low-lying road section; The water depth distribution corresponding to the low-lying road section is determined based on the three-dimensional model.
6. The method according to claim 5, characterized in that The method further comprises: Acquire configuration information corresponding to the vehicle, the configuration information including vehicle air intake height, vehicle chassis height and vehicle model; The preset wading depth threshold corresponding to the vehicle is determined based on the vehicle air intake height, the vehicle chassis height and the vehicle model.
7. The method according to claim 6, characterized in that The method further comprises: Determining obstacles in the low-lying road section based on the water depth distribution, wherein the obstacles include mud and stones; The preset wading depth threshold corresponding to the vehicle is adjusted based on the mud and the rocks.
8. A vehicle wading control device, characterized in that: The device comprises: A receiving module, used to send a laser beam to a road section ahead of the vehicle during the vehicle's driving process, so as to receive laser radar data returned by the road section ahead of the vehicle; A determination module, configured to determine the road ahead information of the vehicle based on the laser radar data; a computing module, configured to send a laser beam to the low-lying section if the front road information indicates that the road ahead of the vehicle includes a low-lying section, so as to receive low-lying section laser radar data reflected from the low-lying section; The control module is used to determine the water depth corresponding to the low-lying road section based on the laser radar data of the low-lying road section, and if the water depth reaches a preset wading depth threshold, control the vehicle to perform a wading warning operation.
9. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the electronic device to implement the vehicle wading control method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: Computer-readable instructions are stored thereon, and when the computer-readable instructions are executed by a processor of a computer, the computer is caused to execute the vehicle wading control method according to any one of claims 1 to 7.
