Method for preparing a person for a traffic situation which requires greater alertness on the part of the person, by means of an assistance system of a motor vehicle, computer program product, computer-readable storage medium and assistance system

EP4646716A1Pending Publication Date: 2025-11-12VOLKSWAGEN AG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
EP2023837575
Authority / Receiving Office
EP · EP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-01-03
Filing Date
2023-12-20
Publication Date
2025-11-12

AI Technical Summary

Technical Problem

Existing vehicle support systems fail to comprehensively prepare drivers for dynamic traffic hazards by not adequately processing real-time data on road conditions and driver attention levels, leading to insufficient reactions in potentially dangerous situations.

Method used

A method and system that utilizes a receiving device, optical detection, and electronic computing to assess driver attention and generate control signals for functional vehicle devices to increase attention, providing predictive and acute measures through visual, acoustic, and haptic warnings, as well as assistance functions, to enhance road safety by preparing drivers for critical traffic situations.

Benefits of technology

The system effectively increases driver attention in real-time, enabling earlier and more urgent responses to potential dangers, improving road safety by providing timely and targeted support through a combination of warnings and assistance functions, such as lane recommendations and comfort measure adjustments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 1.1
    Figure 1.1
Patent Text Reader

Abstract

The invention relates to a method for preparing a person (3) for a traffic situation (4), which requires greater alertness on the part of the person (3), by means of an assistance system (2), said method comprising the steps of: - receiving traffic information (7) for the traffic situation (4) by means of a receiving device (5) of the assistance system (2); - detecting the person (3) using an optical detection device (6) of the assistance system (2); - determining a current state of alertness of the person (3) based on detection by means of an electronic computing device (12) of the assistance system (2); and - generating a control signal (10) for a function device (11) of the motor vehicle (1) based on the current state of alertness and based on the traffic situation (4) by means of the electronic computing device (12), wherein the function device (11) is designed to increase the state of alertness of the person (3) and thus prepare the person (3) for the traffic situation (4). The invention also relates to a computer program product and to an assistance system (2).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Description

[0002] Method for preparing a person for a traffic situation requiring increased attention by means of a support system of a motor vehicle, computer program product, computer-readable storage medium and support system

[0003] The invention relates to a method for preparing a person for a traffic situation requiring increased attention from the person, by means of an assistance system of a motor vehicle according to the applicable patent claim 1. Furthermore, the invention relates to a computer program product and an assistance system.

[0004] It is already known that hazards exist and can arise on the roads that simultaneously impair the attention of many drivers. These include, among others, construction sites, accidents, traffic jams, complicated road layouts, illegible signage, billboards, landmarks, events, and crossing road users. These hazards are dynamic in terms of their potential to affect driving ability. Their dynamics can depend on factors in the vehicle's environment, such as weather, region, traffic density, time of day, and year. If the hazards are detected in real time by multiple road users, this data can be made available to nearby vehicles using swarm data technology. Once transmitted, the data is not comprehensively processed. The ego vehicle can encounter potential hazards along the road.There are no appropriate reactions from the receiving vehicle.

[0005] US 2005 / 0 237 224 A1 relates to a vehicle navigation system for alerting a driver of the presence and status of traffic devices. The vehicle navigation system may alert a driver of the time remaining before the traffic device, such as a traffic light, changes the flow of traffic. The vehicle navigation system may also warn a driver of traffic devices such as stop signs and speed limit signs as the driver approaches the device. The vehicle navigation system may alert the driver through audible or visual warnings, or both. The vehicle navigation system may include a display screen that may or may not be mounted on the vehicle. The vehicle navigation system may also include an in-vehicle warning system that allows vehicle drivers to send warning messages to other vehicle drivers in the immediate vicinity.US 2020 / 0 201 334 A1 relates to a method for assisting a driver of a vehicle in driving the vehicle, in which the surroundings of the vehicle are detected, wherein the detection of the surroundings includes the course of driving paths and movement data of other road users.The method provides that historical data, which were obtained at least from past driving maneuvers of road users in the detected environment, are retrieved for the detected environment, the detected environment of the vehicle is analyzed and a traffic situation of the vehicle in relation to at least one second road user of the other detected road users is determined, a probable driving maneuver of the second road user is predicted on the basis of the retrieved historical data and the current traffic situation, and a control signal is generated to assist the driver in driving the vehicle depending on the predicted driving maneuver of the second road user.

[0006] The object of the present invention is to provide a method, a computer program product and a support system by means of which road safety can be increased.

[0007] This object is achieved by a method, a computer program product, and a support system according to the independent patent claims. Advantageous embodiments are specified in the subclaims.

[0008] One aspect of the invention relates to a method for preparing a person for a traffic situation requiring increased attention, using an assistance system of a motor vehicle. Traffic information for the traffic situation requiring increased attention is received by a receiving device of the assistance system. The person is detected by an optical detection device of the assistance system. The person's current attention level is determined based on the detection by an electronic computing device of the assistance system.A control signal for a functional device of the motor vehicle is generated by means of the electronic computing device as a function of the current state of attention and as a function of the traffic situation, wherein the functional device is designed to increase the person's state of attention and thus to prepare the person for the traffic situation. In particular, road safety can be increased because in situations requiring increased attention, the person, in particular the driver of the motor vehicle, is prepared for the traffic situation by increasing attention. In particular, this takes place as a function of the current state of attention, so that the state of attention can be increased depending on the situation. In particular, it can thus be provided that after the traffic situation has been transmitted, it is processed accordingly.The vehicle may encounter potential hazards along the road. Appropriate responses from the receiving vehicle, such as offering warning, preparation, and assistance to the driver, are thus ensured.

[0009] In particular, it is proposed that data recording and processing be expanded. This will include, in particular, an assessment of the criticality of the traffic situation and thus also an assessment of the situation for the driver's own driving task in the vehicle or the driver's vehicle. Optionally, it can be provided, for example, that the data is also anonymized. Furthermore, functionality can be limited if anonymity cannot be guaranteed due to an insufficient number of other vehicles in the vicinity.

[0010] Predictive measures can be derived to inform and support the driver. The driver is supported in safely handling the dangerous situation. The implementation allows a cascade of increasing urgency, which can be achieved earlier than with previous solutions thanks to prediction. Furthermore, warning times for existing assistance systems can be brought forward. If necessary, the danger can be indicated visually at an early stage with a hazard indicator based on recorded data, such as direction and distance. The output device can be a head-up display, a smart light, an interior light, combination lighting, or even an instrument cluster. If necessary, an acoustic warning can also be given with a hazard indicator based on recorded data, such as direction and distance.Haptic warnings can also be given, for example by displaying the danger in relation to the recorded traffic information, for example with direction and distance.

[0011] In particular, a distinction can be made between predictive and acute measures. Predictive measures are specifically provided, for example, continuous activation of the driver 15 minutes before the end of a traffic jam. In acute situations, it can also be provided that, for example, a pre-crash system can be activated as a functional device at least 15 seconds ahead when crossing road users.

[0012] Furthermore, it may be provided, for example, that a lane change recommendation and a speed reduction recommendation are also provided. Furthermore, a distance recommendation can also be issued. The driver can also be offered support through assistance functions and automated driving functions, such as a lane keeping assistant, a lane change assistant, and an intersection assistant. Furthermore, it is also possible for active intervention in such assistance functions, for example, when only the lane departure warning is used, activation of the lane centering system, and intervention in the Front Assist.

[0013] Safety systems can also be prepared, for example, by deactivating or hiding tertiary tasks in the vehicle, such as preventing distracting activities in the infotainment system. In particular, however, driver support is offered through activation or comfort measures, which can include activating or deactivating music, lights, fragrances, and air conditioning. Conversations with telephone contacts or voice assistance can also be prevented. Furthermore, a fitness program in the vehicle can be deactivated accordingly, or seat adjustment, massage, or games can also be prevented.

[0014] In particular, a user profile can be created that describes which functional units cause which changes in the driver's attention level. This can be done, for example, by observing the driver during operation. Based on this profile, the functional unit can then be controlled accordingly, or the intensity of the functional unit can be adjusted accordingly, depending on the desired attention level.

[0015] According to an advantageous embodiment, a target attention level is determined depending on the received traffic situation. The target attention level is compared with the current attention level, and the control signal is generated based on the comparison. For this purpose, it can be provided, for example, that if the target attention level matches the current attention level, the control signal is suppressed. If, for example, it is determined that the attention level corresponds at least to the determined target attention level, the increase in the attention level can be suppressed, since the driver is already sufficiently attentive to be able to handle the traffic situation. This prevents unnecessary preparation or activation of the functional device.

[0016] A further advantageous embodiment provides that if the current attention level falls below the target attention level, a decision is made as to which type of functional device is activated. In particular, for example, different functional devices can be activated. For example, a display device, an acoustic device, a haptic device, a lighting device in the motor vehicle, or the like can be activated accordingly. Depending on the current attention level and how this falls below the target attention level, a cascade can be activated accordingly. For example, functional devices that only achieve a slight increase in the attention level, such as a scent device, can be initiated if the current attention level falls only slightly below the target attention level.In particular, this can be done depending on the created driver profile. If the current level of attention deviates significantly from the target level of attention, a corresponding function that is more intensely perceptible to the person can be activated accordingly. For example, a music system can be activated accordingly, which can increase the road user's level of attention accordingly.

[0017] Furthermore, it has proven advantageous to determine the intensity of the output needed to increase attention when the current level of attention falls below the target level. For example, the volume of a music system can be adjusted accordingly. Furthermore, corresponding light intensities or massage function intensities can be adjusted accordingly. In particular, it can be assumed that the higher the intensity, the higher the level of attention can be increased. This can be done, in particular, depending on the created driver profile.

[0018] A further advantageous embodiment provides that if the current attention level falls below the target attention level, a decision is made as to the point in time before the occurrence of the traffic situation at which the control signal is to be generated. In particular, this allows a gradual increase in the attention level to be initiated, so that it is not unpleasant for the driver when the attention level is increased accordingly. Depending on the difference between the current attention level and the target attention level, the increase in the attention level can, for example, be carried out between 15 seconds and 15 minutes before the actual occurrence of the traffic situation. This can be done, in particular, depending on the created driver profile.

[0019] Furthermore, it has proven advantageous if, when the current level of attention falls below the target level, a decision is made as to whether a plurality of functional devices should be activated to increase attention. The plurality of functional devices are, in particular, different functional devices. Thus, the level of attention of the driver or person can be increased using multiple functional devices. This can be done, in particular, depending on the created driver profile. This makes it possible to increase the improved level of attention for the person.

[0020] In a further advantageous embodiment, the traffic situation is provided by an electronic computing device external to the vehicle, wherein the traffic situation is evaluated based on the attention levels of a large number of other road users who have mastered the traffic situation. In particular, swarm data can be used, for example, from those who are currently in the traffic situation or who have already mastered the traffic situation, and traffic information can be generated based on this swarm knowledge. In particular, the traffic information can also be taken into account depending on the attention levels of the large number of other road users. This allows traffic information to be generated extremely reliably.

[0021] The method presented is, in particular, a computer-implemented method. Therefore, a further aspect of the invention relates to a computer program product with program code means that, when the program code means are processed by the electronic computing device, cause an electronic computing device to perform a method according to the preceding aspect. The computer program product can also be referred to as a computer program. Furthermore, the invention also relates to a computer-readable storage medium containing the computer program product.

[0022] A further aspect of the invention also relates to a support system for a motor vehicle for preparing a person for a traffic situation requiring increased attention from the person, comprising at least one receiving device, an optical detection device, and an electronic computing device. The support system is designed to carry out a method according to the preceding aspect. In particular, the method is carried out by means of the support system.

[0023] The electronic computing device comprises, for example, processors, circuits, in particular integrated circuits, as well as other electronic components in order to be able to carry out corresponding process steps.

[0024] A further aspect of the invention also relates to a motor vehicle with a support system according to the preceding aspect. The motor vehicle is, in particular, operated at least partially with assistance.

[0025] Advantageous embodiments of the method are considered to be advantageous embodiments of the support system and the motor vehicle. The support system and the motor vehicle have specific features for this purpose in order to be able to carry out corresponding method steps.

[0026] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.

[0027] The invention also includes further developments of the support system according to the invention and of the motor vehicle that have features already described in connection with the further developments of the method according to the invention. For this reason, the corresponding further developments of the support system according to the invention and of the motor vehicle are not described again here.

[0028] The invention also includes combinations of the features of the described embodiments.

[0029] An exemplary embodiment of the invention is described below. The sole FIG. 1 shows a schematic view of an embodiment of a motor vehicle with an embodiment of a support system.

[0030] The exemplary embodiment explained below is a preferred exemplary embodiment of the invention. In this exemplary embodiment, the described components each represent individual, independently considered features of the invention, which also further develop the invention independently of one another and are thus also considered components of the invention, either individually or in a combination other than that shown. Furthermore, the described exemplary embodiment can also be supplemented by further features of the invention already described.

[0031] In the figure, functionally identical elements are provided with the same reference numerals.

[0032] Fig. 1 shows a schematic plan view of an embodiment of a motor vehicle 1 with an embodiment of an assistance system 2. The assistance system 2 is designed to prepare a person 3 for a traffic situation 4 that requires increased attention from the person 3. For this purpose, the assistance system 2 has at least one receiving device 5, an optical detection device 6, and an electronic computing device 12.

[0033] In the method for preparing the person 3 for the traffic situation 4, it is provided that traffic information 7 for the traffic situation 4, which requires increased attention from the person 3, is received by the receiving device 5. In the present exemplary embodiment, it is shown that the traffic situation 4 is detected, for example, by another road user 8 and transmitted to a central electronic computing device 9. The traffic situation 7 can in turn be transmitted from the central electronic computing device 9 to the receiving device 5. Alternatively or additionally, the traffic situation can also be transmitted directly from the motor vehicle 1, from the other road user 8, for example via V2V communication.

[0034] Person 3 is detected by means of the optical detection device 6, which is designed, for example, as a camera, in particular an interior camera. A current attention level of person 3 is determined as a function of the detection by means of the electronic computing device 12. A control signal 10 for a functional device 11 of the motor vehicle 1 is then generated by means of the electronic computing device 12 as a function of the current attention level and as a function of the traffic situation 4, wherein the functional device 11 is designed to increase the attention level of person 3 and thus to prepare person 3 for the traffic situation 4.

[0035] In particular, it can be provided that a target attention level is determined depending on the received traffic situation 4, the target attention level is compared with the current attention level, and the control signal 10 is generated depending on the comparison. It can be provided that if the target attention level matches the current attention level, the control signal 10 is subdivided.

[0036] Furthermore, it can be provided that if the current attention level falls below the target attention level, a decision is made as to which type of functional device 11 is activated. Furthermore, it can also be provided that a decision is made as to the intensity of an output required to increase attention. Furthermore, it can also be provided that a decision is made as to the point in time before the occurrence of the traffic situation 4 at which the control signal 10 is generated. It is also possible to decide whether a plurality of functional devices 11 are activated to increase attention.

[0037] Furthermore, Fig. 1 shows that the traffic information 7 is provided by an electronic computing device 9 external to the motor vehicle, wherein the traffic situation 4 is evaluated on the basis of the attention level of a plurality of road users 8 who have mastered the traffic situation 4.

[0038] In particular, road safety can be increased because, in situations requiring increased attention, the person 3, in particular the driver of the motor vehicle, is prepared for the traffic situation 4 by increasing their attention. This occurs, in particular, depending on the current state of attention, so that the state of attention can be increased depending on the situation. In particular, it can thus be provided that, after the traffic situation 4 has been transmitted, it is processed accordingly. The motor vehicle 1 may encounter potential hazards along the road. Appropriate reactions from the receiving motor vehicle 1, such as an offer to warn, prepare, and assist the driver, are thus provided.

[0039] In particular, it is proposed that data recording and processing be expanded. In particular, an assessment of the criticality of the traffic situation 4 is carried out, and thus also an assessment of the situation for the driver's own driving task in the vehicle 1 or the driver. Optionally, it can be provided, for example, that the data is also anonymized. Furthermore, a limitation of functionality can be implemented if anonymity cannot be guaranteed due to an insufficient number of other vehicles in the vicinity.

[0040] Predictive measures can be derived to inform and support the driver. The driver is supported in safely handling the dangerous situation. The implementation allows a cascade of increasing urgency, which can be achieved earlier than with previous solutions thanks to prediction. Furthermore, warning times for existing assistance systems can be brought forward. If necessary, the danger can be indicated visually at an early stage with a hazard indicator based on recorded data, such as direction and distance. The output device can be a head-up display, a smart light, an interior light, combination lighting, or even an instrument cluster. If necessary, an acoustic warning can also be given with a hazard indicator based on recorded data, such as direction and distance.Haptic warnings can also be given, for example by displaying the danger in relation to the recorded traffic information 7, for example with direction and distance.

[0041] In particular, a distinction can thus be made between predictive and acute measures. Predictive measures are provided in particular, for example, continuous activation of the driver 15 minutes before the end of a traffic jam. In acute situations, it can also be provided that, for example, a pre-crash system can be activated as a functional device 11 when crossing road users 8 are approaching at least 15 seconds ahead. Furthermore, it can be provided that, for example, a lane change recommendation and a speed reduction recommendation are also given. Furthermore, a distance recommendation can also be issued. The driver can also be offered assistance functions and automated driving functions, for example a lane keeping assistant, a lane change assistant and an intersection assistant.Furthermore, it is also possible for active intervention in such assistance functions, for example when only using the lane departure warning, switching on the lane centering system and intervening in the Front Assist.

[0042] Safety systems can also be prepared, for example, by deactivating or hiding tertiary tasks in motor vehicle 1, such as preventing distracting activities in the infotainment system. In particular, however, an offer to support the driver 1 is made through activation or comfort measures, which may include activating or deactivating music, lights, fragrances, and air conditioning. A conversation with telephone contacts or voice assistance can also be prevented. Furthermore, a fitness program in motor vehicle 1 can be deactivated accordingly, or seat adjustment, massage, or games can also be prevented.

[0043] In particular, a user profile can be created, for example, which describes which functional units 11 cause which changes in the driver's attention level. This can be done, for example, by observing the driver during operation. Based on this, depending on the desired attention level, the functional unit 11 can be controlled accordingly, or the intensity of the functional unit 11 can be adjusted accordingly. For this purpose, the electronic computing device 12 can, for example, have a machine learning algorithm to create or learn the driver profile accordingly. List of reference symbols

[0044] motor vehicle

[0045] support system

[0046] person

[0047] Traffic situation

[0048] Receiving device optical detection device

[0049] Traffic information

[0050] Road user external electronic computing device

[0051] control signal

[0052] Functional device electronic computing device

Claims

Patent claims 1. A method for preparing a person (3) for a traffic situation (4) requiring increased attention from the person (3) by means of a support system (2) of a motor vehicle (1), comprising the steps: Receiving traffic information (7) for the traffic situation (4) which requires increased attention of the person (3) by means of a receiving device (5) of the support system (2); Detecting the person (3) with an optical detection device (6) of the support system (2); Determining a current state of attention of the person (3) as a function of the detection by means of an electronic computing device (12) of the support system (2); and Generating a control signal (10) for a functional device (11) of the motor vehicle (1) as a function of the current state of attention and as a function of the traffic situation (4) by means of the electronic computing device (12), wherein the functional device (11) is designed to increase the state of attention of the person (3) and thus to prepare the person (3) for the traffic situation (4).

2. Method according to claim 1, characterized in that a target attention state is determined as a function of the received traffic information (7) and the target attention state is compared with the current attention state and the control signal (10) is generated as a function of the comparison.

3. Method according to claim 2, characterized in that if the desired attention state matches the current attention state, the control signal (10) is suppressed.

4. Method according to claim 2 or 3, characterized in that If the current level of attention falls below the target level of attention, a decision is made as to which type of functional device (11) is activated.

5. Method according to claim 2 to 4, characterized in that if the current attention level falls below the target attention level, a decision is made as to which intensity of an output is required to increase attention.

6. Method according to claims 2 to 5, characterized in that if the current attention level falls below the target attention level, a decision is made as to the point in time before the occurrence of the traffic situation (4) at which the control signal (10) is generated.

7. Method according to claims 2 to 6, characterized in that if the current attention level falls below the target attention level, a decision is made as to whether a plurality of functional devices (11) are to be activated to increase attention.

8. Method according to one of the preceding claims, characterized in that the traffic information (7) is provided by an electronic computing device (9) external to the motor vehicle, wherein the traffic situation (4) is evaluated on the basis of attention states of a plurality of other road users (8) who have mastered the traffic situation (4).

9. Computer program product with program code means which cause an electronic computing device (5) to carry out a method according to one of claims 1 to 8 when the program code means are processed by the electronic computing device (5).

10. Support system (2) for a motor vehicle (1) for preparing a person (3) for a traffic situation (4) which requires increased attention of the person (3), with at least one receiving device (5), an optical detection device (6) and an electronic computing device (12), wherein the support system (2) is designed to carry out a method according to one of claims 1 to 8.