Method for outputting an information signal for a driver of a motor vehicle, electronic computing apparatus, and motor vehicle
Patent Information
- Application Number
- EP2024701391
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-03-01
- Filing Date
- 2024-01-19
- Publication Date
- 2026-01-07
AI Technical Summary
Existing vehicle systems fail to effectively alert drivers to necessary vehicle maintenance actions at optimal times, considering the driver's mental state and urgency, potentially leading to overlooked maintenance and increased risk of vehicle damage or breakdown.
An electronic computing device in the vehicle determines the required maintenance actions based on vehicle state and distance traveled, adjusting the timing of warning signals according to the driver's mental state and urgency, ensuring the signal is issued when necessary and least burdensome, using sensors and navigation data to assess the driver's condition and vehicle status.
This approach ensures drivers receive timely alerts for maintenance without overwhelming them, reducing the risk of missed actions and vehicle damage by synchronizing alerts with the driver's mental state and vehicle condition, thus improving maintenance adherence and safety.
Smart Images

Figure EP2024051254_06092024_PF_FP
Abstract
Description
[0001] Method for issuing an information signal for a driver of a motor vehicle, electronic computing device and motor vehicle
[0002] The present invention relates to a method for outputting an information signal for a driver of a motor vehicle, an electronic computing device and a motor vehicle.
[0003] US 10 981 575 B2 discloses a system in a vehicle comprising one or more physiological sensors configured to receive stress load data indicative of a stress load of a vehicle occupant. The system further comprises a control unit connected to the one or more physiological sensors and configured to determine a stress load of the occupant using at least the stress load data and to issue an instruction to execute driving dynamics features of the vehicle if the stress load exceeds a threshold. The driving dynamics features of the vehicle include adjusting an active suspension of the vehicle.
[0004] Furthermore, a vehicle safety assistance system is known from US 10 053 067 B2, which is designed to determine, based on measured values, whether a warning signal and / or an autonomous braking signal should be issued.
[0005] From US 9612 999 B2 a vehicle computer system is known which is configured to activate or adapt a do not disturb feature based on an attention requirement value.
[0006] Vehicle status information in the vehicle, such as inspection indicators, is displayed to the driver at a fixed interval or dynamically, depending on the driving style, for example for short distances or full load.
[0007] The object of the invention is to create a solution that enables a driver to pay particularly close attention to respective vehicle status information issued by a vehicle. This object is achieved by the subject matter of the independent claims. Further possible embodiments of the invention are disclosed in the subclaims, the description, and the figures. Features, advantages, and possible embodiments that are set out in the description for one of the subject matter of the independent claims are to be regarded at least analogously as features, advantages, and possible embodiments of the respective subject matter of the other independent claims, as well as any possible combination of the subject matter of the independent claims, optionally in conjunction with one or more of the subclaims.
[0008] The invention relates to a method for outputting an information signal to a driver of a motor vehicle, in particular a motor vehicle, in particular a passenger car. This information signal characterizes information for the driver. In the method, it is provided that an electronic computing device, which is in particular part of the motor vehicle, determines an information signal to be output as a function of a determined state of the motor vehicle, which characterizes an action required by the driver at the latest upon expiration of a predetermined time interval extending into the future or upon covering a predetermined distance. In other words, the electronic computing device determines, based on the state of the motor vehicle, that the driver must perform an action.Based on the determined condition of the motor vehicle, this action must be carried out at the latest when the specified time interval has elapsed or the distance has been covered, in order to particularly minimize the risk of damage to the motor vehicle or the risk of the motor vehicle breaking down. This warning signal can, for example, indicate that an inspection of the motor vehicle must be carried out at the latest when the time interval has elapsed or at the end of the specified distance traveled. The driver can thus be made aware of the inspection to be carried out by issuing the warning signal, so that the driver can arrange an inspection appointment at a workshop with sufficient advance notice. Alternatively, the warning signal can indicate that an exhaust gas aftertreatment fluid in the motor vehicle must be refilled at the latest when the time interval has elapsed or at the end of the specified distance traveled.As a further example, the warning signal can indicate that the brake pads of the motor vehicle must be changed at the latest by the end of the time interval or at the end of the specified distance travelled.
[0009] The method further provides for the driver's mental state to be determined in the form of a characteristic value using the electronic computing device. The method further provides for the predetermined output time for the warning signal to be adjusted depending on the characteristic value if the time interval or distance is greater than a predetermined threshold value. By comparing the determined time interval or distance with the predetermined threshold value, it can be determined how urgently the output of the warning signal is. If the time interval or distance is longer than the predetermined threshold value, then it is not absolutely necessary for the warning signal to be output immediately. If the time interval or distance is less than or equal to the predetermined threshold value, then the warning signal must be output urgently.
[0010] The output time can be predetermined for a neutral mood of the driver. As an alternative to the neutral mood, the driver can have a positive mood or a negative mood. If the characteristic value lies in a first range, then the driver's positive mood exists. If the characteristic value lies in a second range adjacent to the first range, then the driver's neutral mood exists. If the characteristic value lies in a third range adjacent to the second range, then the driver's neutral mood exists. If the characteristic value lies in the second range and it is thus determined that the driver's neutral mood exists, then the indication signal is output at the output time. If the characteristic value lies in the first range and it is thus determined that the driver's positive mood exists, then the indication signal is output before the output time.If the characteristic value lies in the third range and it is thus determined that the driver is in a negative mood, the warning signal is issued after the output time. In the case of a negative mood, the output of the warning signal is thus postponed, specifically until a point in time at which it is determined that the driver's mood is neutral or positive. At the latest when the time interval or distance reaches the specified threshold, the warning signal is issued, even if the driver's mood is still negative.
[0011] To implement this, the electronic computing device can prevent the output of the warning signal in the motor vehicle if the characteristic value characterizing the driver's mental state lies in the third range. If it is determined that the characteristic value characterizing the driver's mental state lies in the first or second range, the electronic computing device triggers the output of the warning signal in the motor vehicle, with the output time being selected depending on whether the characteristic value lies in the first range or the second range. The output of the warning signal thus occurs depending on the driver's mental state characterized by the characteristic value.
[0012] In a positive mood, the warning signal is given earlier, for example to counteract under-challenge or fatigue on the part of the driver. If the driver is in a good mental state and the characteristic value is therefore in the first or second range, then it is assumed that the driver is attentive enough to sufficiently perceive the warning signal and to carry out or initiate the corresponding required action at the latest by the end of the time interval or upon reaching the end of the route. If it is determined on the basis of the characteristic value lying in the third range that the driver is in a poor mental state, then it is determined that burdening the driver with the warning signal should be avoided, at least as long as the determined time interval or the determined distance is greater than the specified threshold.The method thus makes it possible to delay the warning signal if the driver is in a poor mental state, until a point in time when the warning signal is unavoidable, or until the driver is in a good mental state again. This makes it particularly effective to avoid stress for a driver under severe mental strain caused by the warning signal.
[0013] In a possible development of the invention, it is provided that the warning signal is triggered regardless of the driver's mental state when it is determined that the time interval or the distance is less than or equal to the predetermined threshold value. If the determined time interval or the distance is less than or equal to the predetermined threshold value, then it is determined that the warning signal must be issued urgently. In this case, for example, the driver's mental state cannot be analyzed at all. As a result, the warning signal is issued regardless of the driver's mental state. This can ensure that the driver is informed of the urgent action that must be taken and, in particular, that the driver still has sufficient time until the time interval expires or until the end of the distance to actually carry out the action.By specifying the threshold value, it is possible to set how long before the end of the time interval or before the end of the route the warning signal is issued reliably and independently of the driver's mental state. In a further possible embodiment of the invention, individual threshold values for the time interval or the route are specified for different actions to be carried out that are characterized by the warning signal. If, for example, the warning signal indicates that an inspection must be carried out, then the specified threshold value can be different than if the warning signal indicates that the brake pads must be changed. The point in time at which the warning signal is issued, regardless of the driver's mental state, thus depends individually on which action the driver must perform by the end of the time interval or by reaching the end of the route at the latest.For example, the threshold value for the warning signal characterizing the inspection to be performed can be significantly lower than the threshold value for the warning signal characterizing the brake pad replacement. This means that the warning signal characterizing the inspection to be performed is issued reliably and independently of the driver's mental state a significantly shorter time period before the end of the time interval or before the end of the route is reached than the warning signal characterizing the brake pads to be replaced. For example, it may be less critical for the inspection to be performed that it is actually carried out by the end of the time interval or before the end of the route is reached than for the brake pad replacement.By selecting different threshold values, the point in time at which the warning signal is issued, regardless of the driver's mental state, can be particularly well specified for each of the actions to be taken, particularly depending on their criticality.
[0014] In a further possible embodiment of the invention, the mental state of the driver is determined based on a determined state of mind of the driver and / or a determined level of stress on the driver. The state of mind can, for example, characterize whether the driver is in a good mood or in a bad mood, depressed or tired. The state of mind can influence how receptive the driver is to the respective information characterized by the warning signal. The better the driver's state of mind, the more receptive they are to the content of the warning signal. The determined level of stress on the driver characterizes how much attention the driver is already demanding from various devices and / or people and / or animals.In particular, the combination of the driver's state of mind and the driver's workload allows the driver's mental state to be determined with particular reliability. The more accurately the driver's state is determined, the better the warning signal can be used to prevent overexertion.
[0015] In this context, a further development of the invention can provide for the state of mind to be determined based on the driver's vital signs. Vital signs are, in particular, measured values that represent basic bodily functions such as blood pressure, heart rate, respiratory rate, and temperature. Based on the driver's measured vital signs, it is possible to determine whether the driver's state of mind is positive, neutral, or negative. In particular, it can be determined whether the driver is tired (negative state of mind), in a good mood (positive state of mind), or angry (negative state of mind). The vital signs enable a particularly simple determination of the state of mind.Alternatively or additionally, the state of mind can be determined based on the color of the driver's face and / or facial expressions and / or pupil size, whereby the color of the face, facial expressions and pupil size can each be determined from a video image depicting the driver. This video image can be recorded, for example, using an interior camera of the motor vehicle. A microphone in the interior of the motor vehicle can be used to record the driver's speech, and this recorded speech can in turn be used to determine the driver's state of mind. For example, the driver's state of mind can be inferred based on a speaking speed and / or speaking volume and / or the words chosen by the driver and / or the pitch of what is spoken.
[0016] In this context, a further possible embodiment of the invention can provide for the vital signs to be determined by means of a sensor device on the steering wheel of the motor vehicle, in particular by measuring the pulse, and / or by means of a wearable worn by the driver. To measure the driver's pulse, an electrocardiography sensor can be provided in the steering wheel or in the wearable, in particular. These wearables involve computer technology that is worn on the body or on the head. Wearable technology is thus technology that is intended to be used while worn on the body. Examples of wearables include smartwatches, smart glasses, and smart clothing. Using the wearables or the sensor device arranged on the steering wheel, the driver's vital signs can be measured particularly easily, with the driver being minimally impacted during the recording of the vital signs.In a further possible embodiment of the invention, it is provided that the driver's workload is determined based on images depicting the interior of the motor vehicle and captured by an interior camera of the motor vehicle and / or based on route guidance provided by a navigation device. The images depicting the interior of the motor vehicle, which have been captured by the interior camera of the motor vehicle, can be evaluated using an image processing device. In this case, the images can be evaluated with regard to the number and arrangement of respective vehicle occupants in the interior of the motor vehicle. Furthermore, the age of the respective vehicle occupants can be determined based on the images. Alternatively or additionally, the activity of the respective vehicle occupants can be determined based on the images.This means that the images can be used to determine how many vehicle occupants are in the interior of the motor vehicle and in which positions the respective vehicle occupants are sitting. Alternatively or additionally, it can be determined whether the respective vehicle occupants are sleeping, particularly active and, for example, moving or talking. It is assumed that the more vehicle occupants there are in the motor vehicle and the more active the respective vehicle occupants are, the higher the strain on the driver. Furthermore, it can be assumed that the younger the respective vehicle occupants are, in particular children, toddlers or babies, the greater the strain on the driver. Alternatively or additionally, the volume of noises in the interior of the motor vehicle can be determined and the strain determined as a function of the measured volume.This determines that the strain on the driver increases the higher the measured noise level in the interior of the vehicle. If, for example, there are screaming children in the interior of the vehicle and / or media is played at a high volume, then it is determined that the strain on the driver is high. The strain on the driver can also depend on the activated route guidance. If a particularly large number of navigation instructions are issued by the navigation system within a short period of time, this demands a lot of attention from the driver, so it is determined that the strain on the driver is high. For example, a large number of navigation instructions are issued within a short period of time if the vehicle is in a city and following a complicated route that requires frequent turns.The more precisely the strain and thus the attention required of the driver can be determined, the more precisely the driver's mental state can be determined, whereby the risk of the driver being overwhelmed by the output of the warning signal can be kept particularly low. In a further possible embodiment of the invention, the state of the motor vehicle is checked several times and the time interval or the distance is adjusted depending on the result of the check. As a result of the adjusted time interval or the adjusted distance, this new adjusted time interval or the new, adjusted distance can in turn be compared with the predetermined threshold value and, depending on the comparison and, if applicable, depending on the driver's mental state, the warning signal can be issued or the output of the warning signal can be suppressed.During a journey, the driver can influence whether certain actions indicated by the warning signal are to be carried out sooner or later through their driving style. Depending on the driver's driving style, an initially calculated time interval, at the end of which the action must be carried out at the latest, or an initially calculated distance, by the end of which the action must be carried out at the latest, may be extended or shortened. If the driver drives particularly carefully, for example, it may happen that the brake pads do not need to be changed until later than determined in an initial calculation. If the driver drives in a particularly sporty manner, for example, the exhaust gas aftertreatment fluid is used up more quickly than originally calculated and therefore needs to be topped up sooner.By checking the condition of the motor vehicle several times, it can be ensured that the calculated time interval or the calculated distance actually characterizes the time at which the respective action must be carried out at the latest.
[0017] The invention further relates to an electronic computing device which is configured to implement a method as already described in connection with the method according to the invention for outputting an information signal to a driver of a motor vehicle. The electronic computing device is in particular part of a motor vehicle in which the information signal is to be output. The electronic computing device is thus configured to determine a state of the motor vehicle or to receive a determined state of the motor vehicle. Furthermore, the electronic computing device is configured to determine, depending on the determined state of the motor vehicle, an information signal to be output, which characterizes the action required by the driver at the latest upon expiration of a predetermined time interval extending into the future or upon covering a predetermined distance.Furthermore, the electronic computing device is configured to determine a mental state of the driver in the form of a characteristic value if the time interval or distance is greater than a predetermined threshold value. For this purpose, the electronic computing device can be configured to determine or receive a state of mind of the driver and / or a level of stress on the driver. To determine the state of mind of the driver, the electronic computing device can be configured to receive vital signs determined by a sensor device. To determine the level of stress on the driver, the electronic computing device can be configured to receive images from an interior camera monitoring the interior of the motor vehicle and / or data relating to active route guidance from a navigation device.
[0018] The invention further relates to a motor vehicle, in particular a motor vehicle, in particular a passenger car, having an electronic computing device as already described in connection with the electronic computing device according to the invention. Furthermore, the motor vehicle comprises an output device configured to output the information signal. The output device can in particular comprise at least one loudspeaker and / or at least one screen device. The loudspeaker is configured to output the information signal in the form of an acoustic signal. The screen device is configured to output the information signal in the form of an optical signal in image form and / or in text form.
[0019] Further features of the invention can be derived from the following description of the figures and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features shown below in the description of the figures and / or in the figures alone, can be used not only in the respective combinations specified, but also in other combinations or on their own, without departing from the scope of the invention.
[0020] The drawing shows:
[0021] Fig. 1 is a schematic process diagram for a method for outputting an information signal for a driver of a motor vehicle.
[0022] Fig. 1 shows a process diagram for a method for outputting an advisory signal to a driver of a motor vehicle. The method can be carried out using an electronic computing device of a motor vehicle. In addition to the electronic computing device, the motor vehicle can comprise an output device configured to output the advisory signal. This advisory signal characterizes an action to be performed at the latest upon expiration of a predetermined time interval extending into the future or upon traveling a predetermined distance, which action is to be performed in particular by the driver of the motor vehicle or by a vehicle owner of the motor vehicle. The advisory signal can thus characterize, for example, "Inspection due in 3,000 kilometers" or "Refill exhaust aftertreatment fluid within 2,000 kilometers" or "Change brake pads in 1,000 kilometers".The warning signal is therefore dependent on a condition of the motor vehicle and characterizes an action necessary to improve the condition of the motor vehicle.
[0023] The method provides that in a first method step V1 the information signal to be output is determined depending on a determined state of the motor vehicle. For example, it can therefore be determined that the brakes of the motor vehicle are worn out as a condition of the motor vehicle. Alternatively or additionally, the fill level of a tank for the exhaust gas aftertreatment fluid can be determined as a condition of the motor vehicle. Furthermore, the state of the motor vehicle can be determined as to when an inspection is due. In particular, the method can be provided only for actions characterized by the information signal for which the risk of damage to the motor vehicle is rather low, should the action not have been carried out at the latest by the end of the time interval or by the time the end of the route is reached.In contrast, warning signals characterizing actions that must be performed by the end of the time interval or by reaching the end of the route to avoid damage to the vehicle can be issued directly in the vehicle. In particular, the warning signals for which the output time can be varied characterize the following information: "Refill AdBlue within x km"; "Oil sensor defective. Please visit a workshop"; "Inspection in x days"; "Oil service in x days"; "Oil service and inspection in x days".
[0024] The condition of the vehicle is checked several times, and the time interval or distance traveled is adjusted based on the result of the check. This ensures that the determined time interval or distance traveled corresponds to the urgency required to take the action based on the condition of the vehicle. Different types of warning signals can be issued in the vehicle. There may be warnings that can be postponed, at least until a certain point in time, such as "Inspection due in 3,000 kilometers," "Refill exhaust aftertreatment fluid within 2,000 kilometers," "Change brake pads in 1,000 kilometers," and others.Furthermore, there are non-movable vehicle status messages such as "oil level low - please top up" or the check engine light or an indicator that shows that the windshield washer fluid level is low or an outside temperature warning or an engine temperature warning or a coolant level message or information about the fuel level or information about the battery charge and others.
[0025] In a second method step V2 of the method, the time interval is compared with a threshold value specified for the time interval, or the distance is compared with a threshold value specified for the distance. This specified threshold value can be individually specified for the action to be performed, which is characterized by the indication signal. In other words, an individual threshold value is specified for the time interval or distance for different actions to be performed, which are characterized by the indication signal.
[0026] If it is determined during the second method step V2 that the time interval or the distance is less than or equal to the specified threshold value, then the information signal is output, which is represented in Fig. 1 by the box labeled "+". In other words, in the method diagram in Fig. 1, starting from the second method step V2, the arrow is followed to the box labeled "+" if the information signal is output immediately and independently of the driver's mental state. If, on the other hand, it is determined during the second method step V2 that the time interval or the distance is greater than the specified threshold value, then the driver's mental state, determined in the form of a characteristic value, is subsequently checked in a third method step V3.If, during the review of the characteristic value, it is determined that the characteristic value lies in a first or second range, with the first range characterizing a positive mood of the driver and the second range characterizing a negative mood of the driver, then the output of the information signal in the motor vehicle is triggered. Thus, starting from the third method step V3 in the process diagram, the arrow is followed to the box marked with the designation "+", which characterizes the output of the information signal. An output time for the information signal is selected depending on whether the driver is in a positive or neutral mood. If the driver is in a neutral mood, the information signal is output at a predetermined output time. If the driver is in a positive mood, the information signal is output before the predetermined output time.
[0027] If, during the third method step V3, it is determined that the characteristic value lies in a third range, which characterizes a negative mood of the driver, then the output of the warning signal in the motor vehicle is suppressed, which is represented in Fig. 1 by the box labeled " ." The output of the warning signal can be suppressed until it is determined that the characteristic value lies in the first or second range, thus indicating a positive or neutral mood of the driver, or until the time interval or distance has reached the threshold value.
[0028] The driver's mental state is determined by the electronic computing device based on the driver's emotional state and / or the driver's workload. The emotional state can be determined based on the driver's vital signs, which are determined in particular by a sensor device on the steering wheel of the motor vehicle, in particular by measuring the driver's pulse, and / or by a wearable device worn by the driver. The driver's workload can be determined based on images depicting the interior of the motor vehicle captured by an interior camera of the motor vehicle and / or based on route guidance provided by a navigation device.
[0029] For postponeable warnings, it is sufficient to postpone the display of these warnings using the vehicle's own output media to a later, more suitable time if the driver's mental state corresponds to a negative mood. However, the thresholds are defined at which the respective warning signal must be displayed at the latest and further postponement is no longer possible. An example of this is "Service due in 500 kilometers," where the assigned threshold ensures that the driver is given sufficient time to schedule or obtain an appointment for an inspection at the workshop.
[0030] An appropriate time for issuing the warning signal is defined by the driver's emotional state being determined using the vehicle's own sensors, such as pulse measurement via an electrocardiography sensor in the steering wheel, or external or coupled sensors, such as a fitness bracelet. An appropriate time for issuing the warning signal can be defined by the driver's emotional state being neutral or positive. An inappropriate time for issuing the warning signal can be defined by the vehicle's own or external sensors determining that the driver's emotional state is negative, for example, stressed or annoyed.If an already stressed driver is shown a warning about a service due in 3,000 kilometers, this can potentially lead to mental overload and thus increased stress or discomfort for the driver. Postponing a postponeable vehicle status warning to a later time is acceptable if the assigned threshold at which this corresponding warning signal must be displayed without further delay has not yet been reached. A system-internal workload manager can be used to assess the driver's mental state.
[0031] The method thus provides for the mental state or mental workload of the driver to be included in a dynamic calculation of the display time of a vehicle status message, in this case the warning signal.
[0032] Overall, the invention shows how an emphatic vehicle can be created through movable vehicle status indicators.
[0033] List of reference symbols
[0034] V1 to V3 respective process steps
[0035] + Warning signal is issued
[0036] Warning signal is not issued
Claims
Patent claims 1. A method for issuing an information signal for a driver of a motor vehicle, in which by means of an electronic computing device - depending on a determined state of the motor vehicle, an indication signal is determined to be output, which characterises an action required by the driver at the latest upon expiry of a predetermined time interval extending into the future or upon covering a predetermined distance (V1), - a mental state of the driver is determined in the form of a characteristic value, and - a planned output time for the warning signal is adjusted depending on the characteristic value (V3) if the time interval or the distance is greater than a predetermined threshold value (V2).
2. The method according to claim 1, wherein the warning signal is triggered regardless of the mental state of the driver when it is determined that the time interval or the distance is less than or equal to the predetermined threshold value.
3. Method according to claim 1 or 2, wherein individual threshold values for the time interval are specified for different actions to be carried out, characterized by the indication signal.
4. Method according to one of the preceding claims, wherein the mental state is determined based on a determined state of mind of the driver and / or a determined strain of the driver.
5. The method according to claim 4, wherein the state of mind is determined based on vital signs of the driver.
6. The method according to claim 5, wherein the vital signs are determined by means of a sensor device on the steering wheel of the motor vehicle, in particular by pulse measurement, and / or by means of a wearable worn by the driver.
7. Method according to one of claims 4 to 6, wherein the driver’s workload is determined based on data recorded by an interior camera of the motor vehicle, images depicting the interior of the motor vehicle and / or on the basis of route guidance provided by a navigation device.
8. Method according to one of the preceding claims, wherein the condition of the motor vehicle is checked several times and the time interval or the distance is adjusted depending on a result of the check.
9. Electronic computing device which is configured to carry out a method according to one of the preceding claims.
10. Motor vehicle, with an electronic computing device according to claim 9, and with an output device which is designed to output the warning signal.