Identifying a road condition on the basis of measured data from inertial sensors of a vehicle
Patent Information
- Application Number
- EP2023700262
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-01-10
- Filing Date
- 2023-01-03
- Publication Date
- 2024-11-20
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing methods for detecting road conditions, such as those using ultrasonic sensors, are prone to interference from ambient noise and require additional sensor installations, which are not always necessary or effective.
A method utilizing inertial sensors to detect road conditions based on acceleration and yaw rate measurements, which are inherently more robust to noise and can be integrated into standard vehicle control units, allowing for automatic detection and execution of driver assistance functions without the need for additional sensors.
This approach effectively identifies road conditions like wetness or slipperiness, enabling improved vehicle stability and control by using noise values from inertial sensors, reducing computational effort, and enhancing recognition accuracy through filtering and statistical analysis.
Smart Images

Figure 1.1
Abstract
Description
[0001] Detecting a road condition based on measurement data from a vehicle's inertial sensor system
[0002] Field of the invention
[0003] The invention relates to a method for detecting a road condition based on measurement data from an inertial sensor system of a vehicle. Furthermore, the invention relates to a control unit and a computer program for executing such a method, as well as to a computer-readable medium on which such a computer program is stored.
[0004] State of the art
[0005] For example, to detect road conditions, ultrasound data provided by an ultrasonic sensor installed in a vehicle can be evaluated. This ultrasound data can be used to determine, for example, whether the road surface on which the vehicle is currently traveling is wet or dry. However, ambient noise, such as the noise of other vehicles, can interfere with such acoustic detection.
[0006] Disclosure of the invention
[0007] Against this background, a method for detecting a road condition based on measurement data from a vehicle's inertial sensor system, a corresponding control unit, a corresponding computer program, and a corresponding computer-readable medium are presented below according to the independent claims. Advantageous further developments and improvements of the approach presented here emerge from the description and are described in the dependent claims.
[0008] Advantages of the invention
[0009] Embodiments of the present invention enable the detection of a road condition based on acceleration and / or yaw rate values, such as those measured by an inertial sensor installed as standard in the vehicle. This eliminates the need to retrofit an additional sensor for detecting the road condition, such as an ultrasonic sensor.
[0010] An inertial sensor, also called an inertial measurement unit (IMU), is, by its very nature, significantly more robust than an acoustic sensor against ambient noise or reflections of noise, for example from guardrails or tunnel walls, because it primarily measures structure-borne noise transmitted from the vehicle's tires to its supporting structure. Interference from vehicle movements, such as those that occur during braking, acceleration, or steering, can generally be accurately estimated and compensated for accordingly. A further advantage is that inertial sensors are standard in many vehicles, for example as a component of a control unit installed in the vehicle, particularly a control unit configured to stabilize driving dynamics.
[0011] A first aspect of the invention relates to a computer-implemented method for detecting a road condition based on measurement data from an inertial sensor system of a vehicle. The method comprises at least the following steps: receiving the measurement data, wherein the measurement data indicate an acceleration and / or yaw rate of the vehicle measured by the inertial sensor system; determining noise values that indicate a noise intensity in the measurement data; and detecting the road condition as a function of the noise values.
[0012] The method can, for example, be carried out automatically by a processor of a control unit of the vehicle. The control unit can additionally be configured to execute one or more driver assistance functions such as ABS or ESP based on the measured data, with which the vehicle can be steered, accelerated and / or braked depending on the detected road condition, for example to stabilize the vehicle. For this purpose, the vehicle can comprise appropriate actuators, for example in the form of a steering actuator, a brake actuator, an engine control unit, an electric drive motor, or a combination of at least two of these examples. For example, it is possible for the control unit to use the measured data to detect the road condition based on the noise values and additionally to stabilize the vehicle based on the measured acceleration(s) and / or yaw rate(s) of the vehicle.
[0013] The inertial sensor system can be installed in the vehicle, with the measurement data being generated and output by the inertial sensor system during vehicle operation and received by the control unit. For example, the inertial sensor system can be integrated into the control unit.
[0014] The vehicle can be a motor vehicle, such as a car, truck, bus, or motorcycle. In a broader sense, a vehicle can also be understood as an autonomous, mobile robot.
[0015] “Road condition” can be understood as the condition of a road surface on which the vehicle is currently moving. For example, the road condition can be detected by assigning the noise values to one of several predefined classes such as “wet,” “dry,” “slippery,” or “good grip,” a value that quantifies the wetness and / or dryness of the road surface, a value that quantifies the risk of aquaplaning for the vehicle, or a combination of at least two of these examples. This assignment can be made, for example, using one or more characteristic curves or one or more characteristic maps determined in previous driving tests. The characteristic curves or characteristic maps can be stored in the control unit, for example in the form of one or more mathematical functions or one or more lookup tables.
[0016] The method described above and below is based on the knowledge that tire noise propagates as structure-borne sound from the tires to the inertial sensors, which can then be recorded. Surprisingly, tests have shown that the noise in the measurement data generated by the inertial sensors changes significantly depending on the road surface condition. In particular, it was shown that the noise becomes significantly louder when the vehicle changes from a dry road surface to a wet road surface, and significantly weaker when the vehicle changes direction. Such a change in the intensity of the noise thus allows conclusions to be drawn about the current road condition or a change between two road conditions, for example between "dry," "wet," or "damp."The effect can be used, for example, to calculate or correct a friction coefficient that indicates an estimated friction between the wheels and the road surface or to estimate a probability of aquaplaning.
[0017] A second aspect of the invention relates to a control unit comprising a processor configured to execute the method described above and below. The control unit may comprise hardware and / or software modules. In addition to the processor, the control unit may comprise a memory and data communication interfaces for data communication with peripheral devices. Features of the method may also be considered features of the control unit, and vice versa.
[0018] Further aspects of the invention relate to a computer program and a computer-readable medium on which the computer program is stored.
[0019] The computer program comprises instructions which, when the computer program is executed by the processor, cause the processor to carry out the method described above and below.
[0020] The computer-readable medium may be a volatile or non-volatile data storage device. For example, the computer-readable medium may be a hard disk, a USB storage device, RAM, ROM, EPROM, or flash memory. The computer-readable medium may also be a data communications network that enables downloading of program code, such as the Internet or a data cloud.
[0021] Features of the method described above and below may also be understood as features of the computer program and / or the computer-readable medium and vice versa.
[0022] Possible features and advantages of embodiments of the invention may be considered, among other things, and without limiting the invention, as being based on the ideas and findings described below.
[0023] According to one embodiment, the measurement data can comprise measured values for at least two different measurement dimensions. Noise values can be determined from the measured values of each measurement dimension, indicating the intensity of noise associated with the measurement dimension. The road surface condition can then be identified depending on the noise values of different measurement dimensions. A "measurement dimension" can be understood, for example, as a longitudinal, lateral, or vertical acceleration, or a roll, pitch, or yaw rate of the vehicle. Tests have shown that the noise in the measurement data is influenced to varying degrees by changes in the vehicle's speed, depending on the measurement dimension.In other words, it was found that there are measurement dimensions that are less influenced by changes in vehicle speed than others and are therefore particularly suitable for detecting road conditions based on noise. Particularly suitable measurement dimensions include vertical acceleration, roll rate, and pitch rate. In principle, however, other common measurement dimensions are also suitable for the method.
[0024] According to one embodiment, the noise values can be determined in different predetermined frequency ranges, in particular in three to eight different predetermined frequency ranges. Preferably, the noise values can be determined in three to four different predetermined frequency ranges. The frequency ranges can differ from one another in their bandwidth and / or their limits. This can improve the detection accuracy of the method. For example, a first, low frequency range can be between 100 Hz and 200 Hz, a second, medium frequency range between 200 Hz and 500 Hz, and / or a third, high frequency range between 500 Hz and a maximum frequency of the inertial sensor, wherein the maximum frequency can be 1 kHz, for example. Wet hissing often affects rather high frequency ranges, while interference noise often affects rather low frequency ranges.If the noise in high frequency ranges is high compared to the noise in low frequency ranges, then the noise can be attributed to the wet hiss of the wheels.
[0025] According to one embodiment, the measurement data and / or data based on the measurement data can be input into a smoothing filter as input data to obtain output data that is smoothed compared to the input data, i.e., contains no noise or significantly less noise than the measurement data. A difference can be formed between the input data and the output data. The noise values can then be determined from the difference. A smoothing filter can be understood as a low-pass filter, for example, a rectangular or Gaussian filter. This allows the noise to be filtered out of the measurement data with little computational effort.
[0026] According to one embodiment, the difference can be squared to obtain the noise values. This can reduce inaccuracies in determining the noise values.
[0027] According to one embodiment, the measurement data can be received in several consecutive time steps. The noise values in a current time step can be determined from the measurement data of different time steps. For example, the noise values can be determined using one, two, or more than two previous time steps that each precede the current time step. For example, the noise values can be determined from the measurement data of several consecutive time steps. It is conceivable, for example, that average noise values are determined from the measurement data of different time steps. In this way, measurement inaccuracies can be compensated. The time steps can, for example, be 0.1 millisecond, 1 millisecond, or 5 milliseconds each.
[0028] According to one embodiment, the measurement data from different time steps can be input into an edge filter to obtain filter data in which the noise is amplified compared to the measurement data. The noise values can be determined from the filter data. An "edge filter" can generally be understood as a high-pass filter or edge operator configured to amplify changes in the intensity of the noise. For example, the edge filter can be a Laplace filter, a Sobel operator, or a Prewitt operator. However, the use of a nonlinear filter is also conceivable. In this way, the detection of the road condition can be further improved.
[0029] According to one embodiment, the noise values can be determined by squaring the filter data. This can reduce the computational effort when executing the method. According to one embodiment, the filter data can be input to the smoothing filter as the input data (see above). In other words, the noise values can be determined by calculating the difference between the filter data and the output data resulting from the suppression or attenuation of the noise in the filter data by means of the smoothing filter.
[0030] This allows the noise that was amplified by the edge filter to be filtered out of the filter data with little computational effort.
[0031] According to one embodiment, the road condition can also be detected depending on the current vehicle speed. Tests have shown that the noise varies not only depending on the wetness of the road surface, but also depending on the vehicle speed. Evaluating the noise values in combination with the current vehicle speed thus increases the reliability of the method.
[0032] According to one embodiment, at least one detection value indicating the wetness of a vehicle's roadway and / or a risk of aquaplaning for the vehicle can be determined to detect the road condition. A "detection value" can be understood, for example, as a Boolean value or a value from a continuous value range, such as a percentage. The detection value can be read, for example, from a lookup table that assigns different detection values to different noise values. Optionally, further values can be assigned to the detection values in the lookup table, for example, possible values for the current speed of the vehicle or statistical values (see below).
[0033] According to one embodiment, additional statistical values can be determined that indicate a variance in the measured data and / or the noise values. The road surface condition can also be detected based on the statistical values. The statistical values can, for example, be determined in tests and stored in the control unit in the form of one or more characteristic curves or one or more characteristic maps. In this way, the robustness of the method against random interference can be increased. Brief description of the drawings
[0034] Embodiments of the invention are described below with reference to the accompanying drawings, wherein neither the drawings nor the description are to be construed as limiting the invention.
[0035] Fig. 1 shows a vehicle with a control unit according to an embodiment of the invention.
[0036] Fig. 2 shows the control unit from Fig. 1 in detail.
[0037] Fig. 3 shows a diagram comparing a time course of a speed of the vehicle from Fig. 1 with a time course of a noise measured by an inertial sensor of the vehicle from Fig. 1.
[0038] The figures are merely schematic and not to scale. The same reference numerals throughout the figures indicate identical or equivalent features.
[0039] Embodiments of the invention
[0040] Fig. 1 shows a vehicle 1 traveling on a roadway 3. In this example, the vehicle 1 is equipped with an inertial sensor 5 in the form of a 6D sensor configured to measure accelerations and angular rates of the vehicle 1 with respect to an x-, y-, and z-direction, respectively.
[0041] Furthermore, the vehicle 1 has a control unit 7 which is configured to receive and evaluate measurement data 9 generated by the inertial sensor system 5.
[0042] The inertial sensor system 5 is arranged here, for example, outside the control unit 7 in the vehicle 1. However, it is also possible for the inertial sensor system 5 to be integrated into the control unit 7.
[0043] The control unit 7 can, for example, execute a driver assistance function configured to steer, accelerate, and / or decelerate the vehicle 1 based on the measurement data 9. Details of the control unit 7 are shown in Fig. 2. The driver assistance function can, for example, include the detection of a road condition of the roadway 3 in the method described below.
[0044] As can be seen in Fig. 2, the measurement data 9 are received in the control unit 7 in a first step of the method. The measurement data 9 can be received in several consecutive journals. For example, in each journal, three measured values for the accelerations a x , a y , a z and three measured values for the rotation rates U) X , ÜJy, (Ü Z be received.
[0045] In a second step, a noise value determination module 10 determines noise values 13 from the measurement data 9, which indicate an intensity of noise in the measurement data 9. For example, the noise values 13 can be determined for each of the six aforementioned measurement dimensions.
[0046] Additionally or alternatively, the noise values 13 can be determined from the intensities of the noise in different predetermined frequency ranges.
[0047] In a third step, the noise values 13 are evaluated in a detection module 14 to detect the road condition. The detection module 14 can, for example, use the noise values 13 to determine a detection value 15 that indicates whether the road surface 3 is wet or dry. In the example shown in Fig. 1, the vehicle 1 is driving into a wet section 17 of the road surface 3. This is associated with a sudden increase in the intensity of the noise in the measurement data 9, which is detected by the detection module 14 as a change in the road condition from "dry" to "wet" (see also Fig. 3). Accordingly, the detection value 15 here indicates the road condition as "wet."
[0048] The detection value 15 can therefore be a wetness value, which, as here, can indicate various discrete road conditions or different degrees of wetness of the road 3. Additionally or alternatively, the detection module 14 can output an aquaplaning risk value, which indicates a risk of aquaplaning for the vehicle 1, as the detection value 15.
[0049] Fig. 3 shows an example of a temporal course of a longitudinal speed v x of the vehicle 1. Below are the corresponding (filtered) noise values 13 from the measurements of the accelerations a x , a y , a z and the measurements of the rotation rates U) X , ÜJy, (Ü ZVehicle 1 decelerates from 19 m / s to 15 m / s. Shortly before second 34, vehicle 1 reaches the wet section 17, which here consists of watered tiles, and remains largely stable. Shortly before second 38, vehicle 1 accelerates, causing it to become unstable. The change in longitudinal speed and the instability have a major influence on the longitudinal acceleration a x , the lateral acceleration a y and the yaw rate a> z and thus also on their noise values 13. As can be clearly seen in Fig. 3, the noise values 13 of the other dimensions are significantly more robust against the vehicle movements.
[0050] As shown in Fig. 2, the control unit 7 can optionally include a smoothing filter 18, into which the measurement data 9 in each magazine are input as input data 19 and which converts the input data 19 into output data 21 in which the noise is suppressed or at least significantly attenuated. The noise values 13 can then be determined from the output data 21.
[0051] The noise values 13, w can be determined, for example, by calculating in a calculation module 22 the squared deviations between the (raw) measurement data 9, z raw than the input data 19 and the filtered measured values z fi | t as the output data 21 are calculated:
[0052] W = Oraw - Zfilt) 2
[0053] The smoothing filter 18 can optionally be preceded by an edge filter 23, into which the measurement data 9 in each journal are input and which generates filter data 25 from the measurement data 9 of several consecutive time steps, for example, from two, three, or more than three consecutive journals, in which the noise is significantly amplified by differentiation compared to the measurement data 9. The filter data 25 can then be input into the smoothing filter 18 as the input data 19 to obtain the output data 21.
[0054] For example, the measurement data 9, z raw be processed using a Laplace filter in such a way that a second derivative z A fe the measurement data 9 using the measurement data 9, z raw fe a current time step k, the measurement data 9, z^ ^ of a first time step immediately preceding the current journal k and the measurement data 9, z raWife-2of a second time step immediately preceding the first journal: z A,fc — z raw,fc-2 — ^ z ra.w,kl + z raw,fc
[0055] The resulting filter data 25, z A can then be filtered with the smoothing filter 18 to obtain the output data 21 , e.g. A fi | t to obtain.
[0056] Finally, the noise values 13, w can be calculated in the calculation module 22 with:
[0057] The more often the derivation is performed and thus the noise is amplified and the larger the filter time constant is chosen, the smaller the deviation from z A fi | t from zero relative to z A . To save computing time, the noise values 13, w can therefore also be calculated directly by squaring the derivative z A can be calculated in the calculation module 22: w = (z A ) 2
[0058] Detection value 15 can, for example, be used to better predict a coefficient of friction, which indicates the friction between the wheels of vehicle 1 and the road surface 3. For example, if the ambient temperature is greater than 4 °C and the road surface 3 is detected as dry, a coefficient of friction of at least 0.6 can be assumed. This results in, for example, an ABS function building up more brake pressure faster and with more force than if the road surface 3 is detected as wet or the ambient temperature is below 4 °C.
[0059] At very high speeds, the coefficient of friction on a very wet road surface 3 can be significantly below 0.6 and, particularly due to aquaplaning, can become so small that the vehicle 1 becomes difficult to control. The risk of aquaplaning is essentially proportional to the intensity of the noise, whereas the coefficient of friction is essentially inversely proportional to the intensity of the noise. The braking forces can therefore be adapted to the measured noise. It is possible for several detection values 15 to be calculated from several noise values 13 in each measurement step. For example, the detection values 15 can be determined by evaluating noise levels in different measurement dimensions and / or frequency ranges, in particular in two to eight, preferably in three to four different frequency ranges.
[0060] All detection values 15 of a measurement step can be merged together as follows, for example.
[0061] In the merger, an individual variance each individual measurement. The individual detection value 15, Ht for each noise value 13 and the corresponding variance can be calculated, for example, using Tests as a function of different vehicle speeds v or degrees of wetness H and stored in maps or characteristic curves in the control unit 7 and thus calculated from the respective map or characteristic curve during vehicle operation:
[0062] For the later calculation of the weighted mean S a sensor, ie a measurement dimension, the variance can first be of the sensor from the reciprocal sum of its reciprocal variances:
[0063] The smaller the individual standard deviation oj is, the stronger the detection value 15 becomes when calculating the sensor-individual Recognition value 15 weighted:
[0064] Interferences often affect the measurements of a sensor's measurement step to varying degrees, leading to particularly large differences in the detection values 15 of a sensor. All detection values 15 of sensors affected by interference should therefore have a lower weight when calculating a fused detection value across multiple sensors. Disturbances that have different effects on the measurements of a measurement step should lead to a correspondingly larger value for the variance of the fused detection value. Measurements for which experience shows a high variance due to measurement noise should be given less weight when calculating the variance of the fused detection value. For this reason, in a further step, the deviations of the detection values 15 from the weighted mean p can be used to determine the variance. s and the variance a weighted sensor-individual variance can be calculated:
[0065] This weighted variance is the greater the stronger the recognition values 15, fa from the weighted mean as long as these differences are not due to a high variance that is due to the known measurement noise is to be expected.
[0066] A total variance is then calculated from the two previously Variances calculated:
[0067] The total variance oj is large if all individual variances af are large due to the expected measurement noise. However, it is also large if the individual variances af are small due to the expected measurement noise, while the detection values 15, differ greatly. However, the total variance oj can be small if one of the measured values deviates significantly, while a high variance was determined for this measured value due to the expected measurement noise.
[0068] Disturbances caused by vehicle movements such as acceleration, braking, or steering have a greater impact on the noise values 13 of the measurement dimensions longitudinal acceleration, lateral acceleration, and yaw rate (hereinafter referred to as the first measurement dimensions) than on those of the measurement dimensions vertical acceleration, roll rate, and pitch rate (hereinafter referred to as the second measurement dimensions). To ensure maximum robustness against disturbances, the first measurement dimensions can be fused in a first fusion, and the second measurement dimensions can be fused in a second fusion. The results of both fusions can then be merged.
[0069] Alternatively, the measurement data 9 and / or the noise values 13 can be input into a machine learning algorithm that has been trained with historical measurement data and / or historical noise values in order to calculate the recognition values 15 and / or fused recognition values from the measurement data 9 and / or the noise values 13.
[0070] Finally, it should be noted that terms such as "comprising," "having," etc., do not exclude other elements or steps, and indefinite articles such as "a" or "an" do not exclude a plurality. Reference signs in the claims are not to be considered as limitations.
Claims
Claims 1. Method for detecting a road condition based on measurement data (9) from an inertial sensor system (5) of a vehicle (1), wherein the method comprises: Receiving the measurement data (9), wherein the measurement data (9) indicate an acceleration and / or rotation rate of the vehicle (1) measured by the inertial sensor (5); Determining noise values (13) that indicate the intensity of noise in the measurement data (9); and Detecting the road surface condition depending on the noise levels (13).
2. Method according to claim 1, wherein the measurement data (9) are measured values for at least two different measurement dimensions (a x , a y , a z , OJ X , a> y , OJ Z ) include; wherein the measured values of each measurement dimension (a x , a y , a z , a> x , a> y , a> z) Noise values (13) are determined which represent an intensity of one of the measurement dimensions (a x , a y , a z , a> x , a> y , a> z ) associated noise; wherein the road condition depends on the noise values (13) of different measurement dimensions (a x , a y , a z , a> x , a> y , a> z ) is recognized.
3. Method according to one of the preceding claims, wherein the noise values (13) are determined in various predetermined frequency ranges, in particular in three to eight different predetermined frequency ranges.
4. A method according to any of the preceding claims, wherein the measurement data (9) and / or data (25) based on the measurement data (9) are input as input data (19) into a smoothing filter (18) to obtain output data (21) which is smoothed compared to the input data (19); wherein a difference is formed between the input data (19) and the output data (21); wherein the noise values (13) are determined from the difference.
5. Method according to claim 4, where the noise values (13) are determined by squaring the difference.
6. Method according to one of the preceding claims, wherein the measurement data (9) are received in several successive magazines and the noise values (13) are determined in a current magazine from the measurement data (9) of different time steps.
7. Method according to claim 6, wherein the measurement data (9) of different time steps are fed into an edge filter (23) to obtain filter data (25) in which the noise is amplified relative to the measurement data (9); wherein the noise values (13) are determined from the filter data (25).
8. Method according to claim 7, wherein the noise values (13) are determined by squaring the filter data (25).
9. Method according to claim 7 referred back to claim 4, wherein the filter data (25) are entered as the input data (19) into the smoothing filter (18).
10. Method according to one of the preceding claims, wherein at least one detection value (15) is determined to detect the road surface condition, indicating a degree of wetness of a road surface (3) of the vehicle and / or a risk of aquaplaning for the vehicle (1).
11. Method according to one of the preceding claims, wherein the road surface condition is additionally dependent on a current speed (v x ) of the vehicle (1) is recognized.
12. Method according to one of the preceding claims, wherein additionally statistical values are determined which indicate a variance with respect to the measurement data (9) and / or the noise values (13); wherein the road condition is additionally recognized as a function of the statistical values. Control unit (7) comprising a processor configured to execute the method according to any one of the preceding claims. Computer program comprising instructions that, when the computer program is executed by the processor, cause the processor to execute the method according to any one of claims 1 to 12. Computer-readable medium on which the computer program according to claim 14 is stored.
