Method for a motor vehicle to reduce driver distraction, computer program and / or computer-readable medium, data processing device, motor vehicle

DE102023120936A1Inactive Publication Date: 2025-02-13BAYERISCHE MOTOREN WERKE AG
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
DE102023120936
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-08-07
Publication Date
2025-02-13
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A method for a motor vehicle for reducing driver distraction, comprising: outputting a first output signal to visually display a first output information on a first output device of the vehicle; acquiring a second output information for output on a second output device of the vehicle; acquiring perceptual information relating to the driver's perception of the first output information; and outputting a second output signal to visually display the second output information at a time dependent on the perceptual information.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present disclosure relates to a method for a motor vehicle for reducing distraction of a driver of the motor vehicle. The disclosure also relates to a computer program and / or computer-readable medium, a data processing device for a motor vehicle, and a motor vehicle comprising a data processing device.

[0002] More and more state-of-the-art vehicles feature displays as output devices. Displays are known that can also be used by a passenger or an occupant of the vehicle other than the driver and / or, due to their arrangement and / or orientation, are designed to provide or present content primarily to the passenger. Such output devices, or so-called passenger displays, can, for example, display messages intended for the passenger.

[0003] Messages on the passenger display can distract the driver, causing them to focus their attention on the message or the passenger display instead of driving the vehicle. Driver distraction can pose a safety risk and should therefore be avoided. The display of these messages can be disabled in the settings to reduce driver distraction. However, this also prevents the passenger from perceiving the message.

[0004] Furthermore, it is known to reduce the viewing angle, i.e., the spatial area from which the contents of the output device can be visually perceived, in order to reduce distraction from the passenger display. However, such solutions are only suitable if the viewing angle for the output device can be defined, for example, if the outputs from an output device are intended to be accessible exclusively to the passenger.

[0005] Furthermore, it is possible that the output of a message, for example, only occurs under certain conditions, for example with regard to a vehicle context and / or a driving load.

[0006] For example, DE 20 2016 107 361 U1 discloses a system comprising: one or more computers and one or more memory devices storing instructions operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising: receiving vehicle data indicative of a condition of a vehicle; determining a current vehicle context based on the vehicle data; receiving message data indicative of one or more candidate messages, each message having a corresponding display context; determining whether a particular one of the candidate messages has a display context that matches the current vehicle context;and in response to determining that a particular one of the candidate messages has a display context that matches the current vehicle contexts, providing the particular message for output on a display of the vehicle;

[0007] DE 11 2015 001 332 T5 discloses a vehicle notification control device including an operation acceptance section, an output data acquisition section, a notification control section, and a driving load determination section. If the driving load is determined to be low, the notification control section performs notification based on output data acquired by the output data acquisition section. If the driving load is determined to be high, the notification is suspended based on the output data.

[0008] DE 10 2019 002 403 A1 discloses a method and a system for influencing an optical output of image data on an output device in a vehicle. The method comprises the following steps: determining a viewing direction of a driver of the vehicle in the vehicle, provided that the determined viewing direction is directed towards the output device; fading out the optical output of the image data at an average fading rate, wherein the fading rate defines a temporal decrease in the optical perceptibility of the output image data by a human; and provided that the determined viewing direction is directed towards the output device and is directed away from the output device, fading in the optical output of the image data at an average fading rate, wherein the fading rate describes a temporal increase in the optical perceptibility of the output image data by a human.

[0009] Against the background of this prior art, one object of the present disclosure is to provide a method suitable for enriching the prior art. In particular, the object of the disclosure is to enable driver distraction caused by information on an output device to be reduced without completely impairing certain functions, in particular the display of information for a passenger.

[0010] The problem is solved by the features of the independent claims. The subclaims contain further developments of the disclosure.

[0011] According to one aspect of the disclosure, the object is achieved by a method for a motor vehicle for reducing distraction of a driver of the motor vehicle, the method comprising: outputting a first output signal for visually perceivable presentation of first output information on a first output device of the vehicle; detecting second output information for output on a second output device of the vehicle; detecting perception information relating to a perception of the first output information by the driver; and outputting a second output signal for visually perceivable presentation of the second output information at a time dependent on the perception information.

[0012] It was recognized that the driver can typically only process one piece of output information at a given time and can therefore focus their attention on it. Furthermore, it was recognized that the driver focuses on the first piece of output information if the second piece of output information is output relatively shortly after the first piece of output information. The first piece of output information can be intended for the driver and thus for output on the first output device. The second piece of output information can be intended for output on the second output device and for the front passenger or for an occupant other than the driver and / or not be intended for the driver. Substantial distraction caused by the output of the second piece of output information can thus be avoided.

[0013] The first output signal controls the output or display of the first output information on the first output device. The driver can visually perceive the first output information and process its content. To determine whether the driver has perceived the first output information on the first output device, the perception information is recorded. The perception information can, in particular, include a time and / or a duration of the driver's perception of the first output information. The perception information can be used to temporally coordinate the second output information on the second output device, which is different from the first output device.For this purpose, the detection of the second output information and the output of the second output signal for outputting the second output information can be separated in time in such a way that the driver focuses on the output of the first output information despite the output of the second output information.

[0014] This reduces the distraction caused by the output of information on the second output device. The second output information can still be displayed. This eliminates the need to deactivate a specific function, especially the display of information for a passenger.

[0015] Optionally, the time for outputting the second output signal is determined based on a predetermined psychological refractory period and the first output signal. It was recognized that the first output signal defines a time for outputting the first piece of output information. A period, in particular a psychological refractory period, can thus define the time for outputting the second output signal and thus the time for outputting the second piece of output information. The psychological refractory period refers to a time interval in which only one stimulus can be processed, and with a subsequent, second stimulus, the reaction time to the stimulus increases (see AT Welford, The "psychological refractory period" and the timing of high-speed performance - A review and a theory. In: British Journal of Psychology. Volume 43, 1952, pp. 2-19).The psychological refractory period can be a constant and / or depend on a context in which the motor vehicle is located, and depending on this context the psychological refractory period is parameterized.

[0016] Optionally, the psychological refractory period is less than 1.5 seconds. This allows a sufficient reduction in driver distraction through the output of the second output information, while simultaneously allowing a message to be presented to an occupant other than the driver without a noticeable time delay. The psychological refractory period of less than 1.5 seconds represents a comparatively short time difference between the output of the first output information and the output of the second output information.

[0017] Optionally, the first output signal is output based on the detection of the second output information. It has been recognized that the detection of the second output information, for example, the receipt of a message, can trigger the output of the first output signal. The first output information can, for example, include information related to driving and / or have less distracting content than the second output information in order to reduce overall driver distraction.

[0018] Optionally, the output of the second output signal is delayed until that point in time. It has been recognized that delaying the second output signal may be useful for temporally coordinating the output of the first output information and the second output information. Alternatively or additionally, the second output signal may include information relating to the point in time, which can be used to temporally control the output of the second output information.

[0019] Optionally, the perception information is captured by an interior camera of the vehicle and / or the perception information includes the driver's gaze direction. It was recognized that an interior camera can provide an effective way to capture the driver's reaction to the output of the first output information. The gaze direction can be captured by the interior camera, and based on the gaze direction, it can be determined whether the driver is looking at the first output device to perceive the first output information. Optionally, the dynamics of the gaze direction can be captured.

[0020] Optionally, the second output signal is output depending on activity information relating to an occupant other than the driver. It was recognized that the output of the second output signal can be useful when, for example, the occupant is not distracted and is therefore accessible to perceiving the second output signal. This allows for a wider range of options for temporally coordinating the output of the first output signal and the second output signal.

[0021] In other words, and with reference to a specific embodiment which is described as not limiting the present disclosure, the above can be summarized as follows: The disclosure relates to a method for avoiding distractions caused by the timing of messages on the passenger display. More and more vehicles are offering displays which can also be used by passengers. Messages intended for the passenger can be shown on these displays. The display of these messages can be completely deactivated in the settings. To reduce distraction caused by the passenger display, a film can be used which ensures that the display is only visible from the passenger's perspective and not from the driver's position. The messages on the passenger display can distract the driver.Solutions such as the film are only useful for displays that are intended exclusively for the front passenger. The basic principle of the disclosure is that the information on the front passenger display is only shown at a specific time, thus reducing the distraction. The interior camera determines where the driver and front passenger are looking. If content intended for the front passenger is to be shown on their display, it is initially held back. Such content could be, for example, a notification about an incoming text message. When content intended for the driver is then displayed (e.g. a change in the current speed limit and display in the HUD), the interior camera determines whether the driver turns to look at the message. If necessary, the system also generates a message (e.g. a repetition of the current speed limit) to direct the driver's gaze.As soon as the driver's gaze is detected, the content intended for the front passenger and previously withheld is offered, provided the passenger is not currently involved in another activity (detected via the interior camera). This process minimizes the distracting effect of the message intended for the front passenger on the driver because it takes advantage of the so-called psychological refractory period. In attention research, the psychological refractory period is a time interval in which only one stimulus can be processed. If a second stimulus follows, the reaction time increases. If stimuli are presented in quick succession, the second stimulus cannot be processed or can only be processed to a very limited extent within the "refractory period". Driver distraction is reduced by information on the front passenger display without having to completely deactivate certain functions.

[0022] According to one aspect of the disclosure, a computer program and / or a computer-readable medium is provided. The computer program and / or the computer-readable medium comprise instructions which, when the program or instructions are executed by a data processing device, cause the device to perform the method according to the disclosure and / or steps thereof. Optionally, the computer program and / or the computer-readable medium comprises instructions which, when the program or instructions are executed by a data processing device, cause the device to perform the method steps described as advantageous or optional in order to achieve an associated technical effect.

[0023] According to one aspect of the disclosure, a data processing device for a motor vehicle is provided. The data processing device is configured to perform the method described above. Optionally, the data processing device is configured to perform a method step described as advantageous or optional and / or to implement a method feature in order to achieve an associated technical effect.

[0024] According to one aspect of the disclosure, a motor vehicle comprising the data processing device described above is provided. Optionally, the data processing device of the motor vehicle and / or the motor vehicle is configured to perform a method step described as advantageous or optional and / or to implement a method feature in order to achieve an associated technical effect.

[0025] In the following, one embodiment is described with reference to the figures. Fig. 1 schematically shows a motor vehicle according to one aspect of the disclosure; Fig. 2 schematically shows a flow diagram of a method according to one aspect of the disclosure; and Fig. 3 shows a schematic representation of a computer-readable medium according to one aspect of the disclosure.

[0026] Fig. 1 schematically shows a motor vehicle 50 according to one aspect of the disclosure. Fig. 1 also shows a driver 60 of the motor vehicle 50 and an occupant 61 different from the driver 60, i.e. a passenger.

[0027] The motor vehicle 50 is a land vehicle, in particular a passenger car. The motor vehicle 50 is optionally configured to perform an automated driving function. The motor vehicle 50 is thus optionally configured to be operated at least partially autonomously. The driver 60 operates the motor vehicle 50. The driver 60 can drive the motor vehicle 50 and / or control, monitor, and / or be responsible for the driving of the motor vehicle 50.

[0028] The motor vehicle 50 has a data processing device 51. The data processing device 51 or the motor vehicle 50 are designed to process the data relating to Fig. 2 described method 100. For this purpose, the motor vehicle 50 has Fig. 1 has a first output device 55, a second output device 56 and an interior camera 57.

[0029] The first output device 55 and the second output device 56 are each configured for visually perceptible output. The first output device 55 and the second output device 56 thus comprise a display. As a display, the first output device 55 and the second output device 56 are based, for example, on a selectively controllable pixel array or matrix and an illumination system for illuminating the pixel matrix with light in a visible spectrum.

[0030] The first output device 55 is configured to output visually perceptible first output information 71 to the driver 60. For this purpose, the first output device 55 can be supplied with a first output signal 52. For this purpose, the first output device 55 and the data processing device 51 are communicatively connected to one another. The first output signal 52 can trigger the output of the first output information 71 directly, i.e., without delay. The first output information 71 can include semantic content, which is translated by the data processing device 51 into the first output signal 52 for supplying the first output device 55 and transmitted to the first output device 55 for outputting the first output information 71.

[0031] The first output device 55 is arranged, for example, in a dashboard, a console, and / or an instrument panel and / or is designed as a projective display, for example, as a head-up display. The first output device 55 is designed and arranged such that the first output information 71 is presented to a driver 60, typically sitting in a driver's seat. The first output device 55 can therefore be referred to as a driver display.

[0032] The second output device 56 is configured to output a visually perceptible second item of output information 72 for the occupant 61. For this purpose, the second output device 56 can be supplied with a second output signal 53. For this purpose, the second output device 56 and the data processing device 51 are communicatively connected to one another. The second output signal 53 can trigger the output of the second item of output information 72 directly, i.e., without delay. The second item of output information 72 can include semantic content, which is translated by the data processing device 51 into the second output signal 53 for supplying the second output device 56 and transmitted to the second output device 56 for outputting the second item of output information 72.

[0033] The second output device 56 is arranged, for example, in the console and / or in a section of an interior of the motor vehicle 50 that can be spatially assigned to the occupant 61. The second output device 56 is designed and arranged such that the second output information 72 is presented to an occupant 61, typically sitting in a passenger seat. The second output device 56 can therefore be referred to as a passenger display.

[0034] The interior camera 57 is a camera arranged in the interior of the motor vehicle 50. The interior camera 57 has a detection area that encompasses the driver 60 or a region of the interior in which a driver 60 is typically located while driving. The interior camera 57 is configured to detect a viewing direction of the driver 60 or to capture image data from which the viewing direction of the driver 60 can be determined. In particular, the interior camera 57 is configured to capture perception information 70. The perception information 70 relates to the perception of the output of the first output information 71 from the first output device 55 by the driver 60.

[0035] The detection area of ​​the interior camera 57 also includes the occupant 61 or an area of ​​the interior in which an occupant 61 is typically located while driving. The interior camera 57 is configured to capture activity information 62 relating to the occupant 61 or to capture image data from which the activity information 62 of the occupant 61 can be determined. The activity information 62 relates to the actions or behavior of the occupant 61. Based on the activity information 62, the data processing device 51 can estimate whether and to what extent the occupant 61 can perceive the output of the second output information 72 on the second output device 56 and / or is distracted by it. Optionally, the motor vehicle 50 can each have one or more interior cameras 57 (not shown) for capturing the driver 60 and the occupant 61.

[0036] So that the first output device 55 can output the first output information 71 and the second output device 56 can output the second output information 72, the data processing device 51 is configured to capture the first output information 71 and the second output information 71. For this purpose, the data processing device 51 can, for example, have a communication interface that enables the reception of a signal relating to the first output information 71 and / or the second output information 72. For example, the first output information 71 or a corresponding signal can be transmitted from a vehicle bus to the data processing device 51 in order to enable an output concerning an automated driving function and / or a vehicle-related context.The second output information 72 or a corresponding signal can be received by the data processing device 51, for example, from a terminal device of the occupant 70 coupled to the motor vehicle 50, for example from a mobile phone of the front passenger, in order to enable the output of a message content. Optionally, the data processing device 51 is configured to generate a first output information 71 and / or to store it for later or repeated output in order to be able to generate and / or retrieve the first output information 71 conditionally by detecting the second output information 72. The output of the first output signal 52 can thus occur conditionally by detecting the second output information 72.

[0037] The data processing device 51 is thus configured to output the first output signal 52 for displaying the first output information 71 on the first output device 55 of the vehicle 50 in a manner that is visually perceptible to the driver 60.

[0038] Furthermore, the data processing device 51 is configured to detect the second output information 72 for outputting the second output information 72 on the second output device 56 of the vehicle 50. The data processing device 51 can condition or trigger the output of the first output signal 52 by detecting the second output information 72. If the data processing device 51 receives, for example, a message intended for the occupant 70 as the second output information 72, the first output information 71, for example, traffic information, can be output to reduce distraction of the driver 60 by the message or the second output information 72.

[0039] Furthermore, the data processing device 51 is configured to capture the perception information 70 relating to the perception of the first output information 71 by the driver 60. The perception information 70 is captured by the interior camera 57, and the perception information 70 includes the viewing direction of the driver 60. Based on the viewing direction, it can be determined whether the driver 60 actually perceives the output of the first output information 71 intended for the driver 60.

[0040] Furthermore, the data processing device 51 is configured to output the second output signal 53 for visually perceptible representation of the second output information 72 at a time t dependent on the perceptual information 70. For this purpose, the data processing device 51 can determine an output time for the output of the first output information 71, for example, based on the first output signal 52. The data processing device 51 is configured to determine the time t for outputting the second output signal 53 based on a predetermined psychological refractory period RP and the first output signal 52. The psychological refractory period RP is less than 1.5 s.For this purpose, the data processing device 51 can retrieve the psychological refractory period RP, for example, from a memory (not shown) and add it to the output time of the output of the first output information 71 and output the second output signal 53 for outputting the second output information 72 such that the output of the second output information 72 occurs at a time t later by the psychological refractory period RP than the output of the first output information 71. The data processing device 51 is configured to withhold the output of the second output signal 53 until the time t and / or to carry it out as a function of the activity information 62 relating to the occupant 61.The retention of the second output signal 53 can alternatively be effected by outputting the second output signal 53 with an output time for outputting the second output information 72, wherein the output time of the second output information 72 is equal to the output time of the first output information 71 added to the psychological refractory period RP.

[0041] Fig. 2 schematically shows a flow diagram of a method 100 according to one aspect of the disclosure. The method 100 according to Fig. 2 is a method 100 for a motor vehicle 50 for reducing a distraction of a driver 60 of the motor vehicle 50. Such a motor vehicle 50 is described with reference to Fig. 1 described. Fig. 2 is made with reference to Fig. 1 described.

[0042] The procedure 100 according to Fig. 2 comprises: outputting 110 a first output signal 52 for visually displaying a first output information item 71 on a first output device 55 of the vehicle 50 for the driver 60.

[0043] The method 100 comprises: capturing 120 a second output information 72 for output on a second output device 56 of the vehicle 50.

[0044] The method 100 comprises: capturing 130 a piece of perception information 70 relating to a perception of the first output information 71 by the driver 60. The capturing 130 of the perception information 70 is carried out by an interior camera 57 of the vehicle 50, and the perception information 70 comprises a viewing direction of the driver 60.

[0045] The method 100 comprises: outputting 140 a second output signal 53 for visually perceptibly representing the second output information 72 at a time t dependent on the perceptual information 70. The time t for outputting 140 the second output signal 53 is determined based on a predetermined psychological refractory period RP and the first output signal 52. The psychological refractory period RP is less than 1.5 s. The output 140 of the second output signal 53 is withheld until the time t.

[0046] The output 140 of the second output signal 53 takes place as a function of activity information 62 concerning an occupant 61 other than the driver 60.

[0047] The output 110 of the first output signal 52 can be effected by the detection 120 of the second output information 72.

[0048] The person skilled in the art will recognize that the method 100 according to Fig. 2 can also be performed in a different order than that shown. In particular, it is possible for steps of the method 100 to be interchanged, shifted, and / or performed simultaneously. In particular, the output 110 of the first output signal 52 and the acquisition 120 of the second output information 72 can be interchanged if the output 110 of the first output signal 52 is conditioned or triggered by the acquisition 120 of the second output information 72.

[0049] Fig. 3 shows a schematic representation of a computer-readable medium 200 according to one aspect of the disclosure. The computer-readable medium 200 includes instructions (not shown) which, when the program or instructions are executed by a data processing device 51, cause the data processing device 51 to execute the method 100 and / or the steps of the method 100 according to Fig. 2 to be carried out.

[0050] The instructions can be present as program code in any code or in any language, in particular in a code suitable for controlling and / or monitoring motor vehicles 50. The computer-readable medium 200 can be or comprise any digital data storage device, such as a USB stick, a hard drive, a CD-ROM, an SD card, or an SSD card. The computer program does not necessarily have to be stored on such a computer-readable storage medium, but can also be accessible via the Internet or otherwise. Reference symbol (part of the description) 50 motor vehicles 51 Data processing device 52 first output signal 53 second output signal 55 first output device 56 second output device 57 Interior camera 60 drivers 61 inmates 62 Activity information 70 Perceptual information 71 first issue information 72 second output information 100 procedures 110 Output of initial output information 120 Capturing a second output information 130 Capturing perceptual information 140 Outputting a second output signal 200 computer-readable medium RP psychological refractory period t Time QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] DE 20 2016 107 361 U1

[0006] DE 11 2015 001 332 T5

[0007] DE 10 2019 002 403 A1

[0008] Zitierte Nicht-Patentliteratur

[0000] A. T. Welford, The „psychological refractory period“ and the timing of high-speed performance - A review and a theory. In: British Journal of Psychology. Band 43, 1952, S. 2-19

[0015]

Claims

[1] A method (100) for a motor vehicle (50) for reducing a distraction of a driver (60) of the motor vehicle (50), the method (100) comprising: - outputting (110) a first output signal (52) for visually displaying a first output information item (71) on a first output device (55) of the vehicle (50) for the driver (60); - detecting (120) a second output information (72) for output on a second output device (56) of the vehicle (50); - detecting (130) a perception information (70) relating to a perception of the first output information (71) by the driver (60); and - Outputting (140) a second output signal (53) for visually perceptible representation of the second output information (72) at a time (t) dependent on the perceptual information (70). [2] Method (100) according to claim 1, wherein the time (t) for outputting (140) the second output signal (53) is determined based on a predetermined psychological refractory period (RP) and the first output signal (52). [3] The method (100) of claim 1 or 2, wherein the psychological refractory period (RP) is less than 1.5 s. [4] Method (100) according to one of the preceding claims, wherein the outputting (110) of the first output signal (52) occurs due to the detection (120) of the second output information (72). [5] Method (100) according to one of the preceding claims, wherein the output (140) of the second output signal (53) is withheld until the time (t). [6] Method (100) according to one of the preceding claims, wherein the detection (130) of the perception information (70) is carried out by an interior camera (57) of the vehicle (50) and / or the perception information (70) comprises a viewing direction of the driver (60). [7] Method (100) according to one of the preceding claims, wherein the outputting (140) of the second output signal (53) takes place as a function of activity information (62) relating to an occupant (61) other than the driver (60). [8] Computer program and / or computer-readable medium (200) comprising instructions which, when the program or instructions are executed by a data processing device (51), cause the device (51) to carry out the method (100) and / or the steps of the method (100) according to one of claims 1 to 7. [9] Data processing device (51) for a motor vehicle (50), wherein the data processing device (51) is configured to carry out the method (100) according to one of claims 1 to 7. [10] Motor vehicle (50) comprising the data processing device (51) according to claim 9.

Citation Information

Patent Citations

  • Method and device for influencing the optical output of image data on an output device in a vehicle

    DE102019002403A1

  • vehicle notification control device and vehicle notification control system

    DE112015001332T5

  • manage messages in vehicles

    DE202016107361U1

  • Method and device for controlling display content on a vehicle output device

    DE102018008045B4

  • Control of a display on a vehicle's infotainment system screen

    DE102021120998A1