Method and device for influencing the optical output of image data on an output device in a vehicle

Abstract

The invention relates to a method and a system for influencing the optical output of image data on an output device in a vehicle. The proposed method comprises the following steps: determining (101) the direction of sight of a vehicle driver in the vehicle, fading out (102) the optical output of image data with an average fade-out rate DOWN if the determined direction of sight points to the output device, wherein the fade-out rate DOWN defines a time-dependent decrease in visual perceptibility of the output image data to a person; and fading in (103) the optical output of image data with an average fade-in rate UP if the determined direction of sight points to the output device and away from the output device, wherein the fade-in rate UP describes a time-dependent increase in visual perceptibility of the output image data to a person.

Description

Technical Field

[0001] The invention relates to a method and a device for influencing the optical output of image data at an optical output device in a vehicle, in particular a motor vehicle, and to a vehicle having such a device. Background Art

[0002] In many countries, the reproduction of image data, in particular moving images such as videos, animations, clips, etc., on an optical output device visible to the vehicle driver is not permitted for safety reasons while the vehicle is in motion, since this is likely to distract the respective driver.

[0003] In order to allow image data to be reproduced by means of such an optical output device, for example for a passenger sitting next to the driver, a method and a device for influencing the attention of a driver of a motor vehicle is known, for example, from the publication DE 10 2011 084 887 A1, which comprises a system with an optical output device.

[0004] The method disclosed in the publication includes the following steps: determining whether the vehicle driver focuses his attention on the output device, and if a value characterizing the duration and / or frequency of the driver's attention being directed to the output device reaches or exceeds a certain threshold, the information on the output device is faded out. As a result, the driver and the co-driver cannot recognize the information output on the output device, thus prompting the driver to shift his attention away from the user interface and thus look back at the road.

[0005] According to the cited publication, in the case of a screen as output device, the information on the output device can be faded out by directly erasing the entire screen content. It is also possible to fade out, in particular to erase, only a few or more parts of the screen content, for example those related to the corresponding function. Summary of the invention

[0006] The object of the present invention is to improve the method and the device according to the publication DE 10 2011 084 887 A1 in such a way that the user convenience and thus the traffic safety are increased.

[0007] The invention is based on the features of the independent claim. Advantageous developments and embodiments are the subject matter of the dependent claims.

[0008] A first aspect of the invention relates to a method for influencing the optical output of image data on an output device in a vehicle, comprising the following steps:

[0009] - determining the direction of sight of the vehicle driver in the vehicle,

[0010] - if the determined viewing direction points to the output device, fading out the optical output of the image data with an average fading rate DOWN, wherein the fading rate DOWN defines a temporal reduction in the visual perceptibility of the output image data to a human being, and

[0011] If the determined viewing direction points towards the output device and away from the output device again, the optical output of the image data fades in with an average fade-in rate UP, wherein the fade-in rate UP describes the temporal increase in the visual perceptibility of the output image data to a person.

[0012] The term "image data" is to be understood in a broad sense here. It includes outputs of alphanumeric characters, graphics, images, video images, television images, Internet content, vehicle data, vehicle navigation data, etc. Preferably, the optically output image data includes data DAT1 related to the guidance of the vehicle and other image data DAT2. Thus, for example, the data DAT2 may include video content, Internet content and / or photo content, and the data DAT1 may include dynamic data and / or navigation data and / or other data for guiding the vehicle and / or for controlling the vehicle system.

[0013] The term "output device" for the optical output of image data is to be understood in a broad sense. Output devices include in principle all currently known devices for the optical output of image data, such as FED, LCD, TFT, LCD, CRT, plasma, OLED or SED displays, touch screens and LEDs, laser projection systems and in particular HUDs (head-up displays).

[0014] The term "vehicle" is to be understood in a broad sense here. It includes, in particular, land vehicles (motor vehicles, buses, trucks, etc.), aircraft, water vehicles, underwater vehicles, rail vehicles.

[0015] Here, the term driver "viewing direction" refers to the direction in which the driver's eyes are currently looking.

[0016] The term "fading out" describes a particularly gradual or stepwise reduction in the perceptibility of image data optically displayed on an output device. The fading out process preferably takes place over a defined period of time greater than 0 and, after the undisturbed elapse of this period, results in a person no longer being able to discern any image data on the output device.

[0017] The term "average fade-out rate DOWN" describes the average decrease in the perceptibility of optically displayed image data over time. It is assumed here that the image data optically displayed on the output device have a perceptibility of 100% in principle before the image data are faded out, because the image data to be displayed are displayed, for example, with an optimal pixel resolution, optimal resolution, optimal brightness, etc. for the output unit in order to obtain optimal perceptibility.

[0018] In this case, the term “fading in” describes that the perceptibility of image data optically displayed on an output device is increased or improved, in particular gradually or stepwise.

[0019] The term “average fade-in rate UP” describes the average increase / improvement in the perceptibility of optically displayed image data over time.

[0020] Therefore, "fading in" is the antonym of "fading out" in this context. Moreover, "fading in" presupposes that the perceptibility of the displayed image data has been at least partially reduced beforehand, i.e., faded out. The fading in process preferably takes place over a predetermined time period greater than 0 and, after the undisturbed elapse of this time period, results in a human being being able to recognize the image data displayed on the output device with 100% perceptibility.

[0021] In the proposed method, the driver's gaze direction is thus preferably determined continuously, in particular during the travel of the vehicle, and a check is made as to whether the gaze direction and thus the driver's attention is directed toward the output device. If it is detected that the driver is looking at the output device, the image data optically displayed on the output device are faded out at an average fade rate DOWN. The driver is thus prompted to turn his gaze away from the output device and back toward the traffic situation.

[0022] If the driver looks at the output device and then turns his gaze away from the output device (regardless of where he initially looked), according to the invention the optical output of the image data is faded in at an average fade-in rate UP.

[0023] This method is preferably always used when the vehicle is travelling faster than a specified speed (≥0).

[0024] Accomplished thereby on the one hand prompting the driver to focus his attention on the guidance of the vehicle rather than the output device during the operation of the vehicle or especially during driving.On the other hand, the co-pilot next to the driver can watch the optical output of the image data on the output device thus.

[0025] After all, as long as the co-driver is present, he or she will exert a certain psychological pressure on the driver if he or she is interested in viewing the optically output image data, which causes the driver not to look at the output device, so that the co-driver can view the output image data without being disturbed. In short, this achieves, on the one hand, influencing the optical output in a user-friendly manner, and on the other hand, further improving traffic safety.

[0026] In a development of the proposed method, the optical output of the image data is faded in only when the driver is focusing his attention on a defined area, such as the traffic situation ahead.

[0027] In a particularly advantageous development of the proposed method, the following condition applies: UP>DOWN, ie the rate at which the perceptibility of the displayed image data decreases is lower than the rate at which the perceptibility of the image data whose perceptibility is decreased increases.

[0028] The output device is preferably a display which is situated in the vehicle in such a way that the outputted image data can be seen, in particular, by a passenger sitting next to the driver.

[0029] The output device is preferably a head-up display, the image data of which are projected so that the passenger sitting next to the driver can see them.

[0030] Advantageously, the fading-out and fading-in of image data is performed only for the data DAT2 , ie only for image data which are not used for vehicle guidance / vehicle navigation.

[0031] Advantageously, the direction of sight is determined by a camera system which is designed and set up to detect the position of the pupils of the driver's eyes and to determine the direction of sight based on the pupil position. Advantageously, the camera system is arranged in the region of the dashboard in front of the driver and / or in the region of the vehicle roof in front of the driver. The camera system preferably comprises a stereo camera.

[0032] An advantageous development of the proposed method is characterized in that the perceptibility reduction or enhancement of the output image data is caused by a reduction or increase in the light intensity LI of the image data output. For this purpose, the light intensity LI of the image data output can preferably be between 0 and a predetermined maximum value LI. MAX Change between: LI∈[0,..,LI MAX ].

[0033] Additionally or alternatively, the reduction or enhancement of the perceptibility of the output image data is caused by increasing or reducing the blurriness of the image data output. Advantageously, the blurring is caused by defocusing the output image data and / or by overlapping the output image data with image data that generates an area with variable transparency. Thus, in the case of a complete fading of the image data, the transparency of this area is equal to zero, i.e., for example, only a uniformly colored area is still displayed, but no image data is output.

[0034] An advantageous development of the proposed method is characterized in that the optical output of the image data is faded out using a step function T 渐隐 (t) is implemented, at which time the light intensity LI is gradually reduced and / or the blurriness of the image data output is gradually increased.

[0035] An advantageous development of the proposed method is characterized in that the fading in of the optical output of the image data is performed using a step function T 渐显(t) is achieved in which the light intensity LI of the image data output is gradually increased and / or the blurriness of the image data output is gradually reduced in the step function.

[0036] Step function T 渐隐 (t) and / or T 渐显 (t) preferably through equidistant support points t = t n =t0+(n-1)*Δt, where n=0, 1, 2, ..., t0 is the start time, and Δt is the specified time step.

[0037] An advantageous development of the proposed method is characterized in that a frequency with which the driver's gaze is directed toward the output unit and / or a frequency with which the driver's gaze is directed away from the output unit is determined, wherein the fade-out rate DOWN is increased with increasing frequency.

[0038] An advantageous development of the proposed method is characterized in that the frequency with which the driver looks toward the output unit and / or away from the output unit is determined, wherein the fade-out rate DOWN increases with increasing frequency and / or the fade-in rate UP decreases accordingly.

[0039] In this case, the fade-out rate DOWN and / or the fade-in rate UP is preferably changed in such a way that UP>DOWN applies.

[0040] If the determined viewing direction points to the output device, then the output device is preferably viewed according to the time difference / time delay ZV DOWN The optical output of the image data begins to fade out at an average fade rate DOWN. In other words, if it is determined at time t* that the driver is looking at the output device, the optical output of the image data is only at time t=t*+ZV DOWN If the driver looks at the output device only for a moment and then looks away, the image data are not faded out, so that the co-driver can still perceive the image data without interference. DOWN The image data is then faded out.

[0041] An advantageous development of the proposed method is characterized in that the optical output of the image data is faded in only after a time difference ZV has elapsed if the determined viewing direction of the driver is directed toward the output device and away from the output device. UP In other words, if it is determined at time t** that the driver's gaze is away from the output device, the fading in of the optical output of the image data begins at time t=t**+ZV UPIf the driver only looks away from the output device for a moment and then looks back at it, no fading in of the image data will therefore take place. UP The image data is then gradually displayed.

[0042] Another aspect of the invention relates to a system, by means of which image data can be outputted optically on an output device in a vehicle. The system comprises a sensor system arranged in the vehicle, which is designed and set up for determining the direction of sight of a driver of the vehicle, and a control unit of the output device, which is designed and set up in such a way that if the determined direction of sight points to the output device, the optical output of the image data fades out with an average fade-out rate DOWN, wherein the fade-out rate DOWN defines a decrease in the visual perceptibility of the output image data to a person over time, and if the determined direction of sight points to the output device and then moves away from the output device, the optical output of the image data fades in with an average fade-in rate UP, wherein the fade-in rate UP describes an increase in the visual perceptibility of the output image data to a person over time.

[0043] The control unit is advantageously configured and designed in such a way that UP>DOWN applies.

[0044] The optically outputtable image data preferably only contain two types of image data: firstly, data DAT1 relevant to driving the vehicle, and secondly, other data DAT2. Advantageously, the control unit is designed so that the fading in and out of the image data is only performed for the data DAT2. The data DAT2 preferably represents video content, Internet content and / or photo content, i.e., image content, in particular, for entertainment.

[0045] Advantageously, the data DAT1 represent dynamic data and / or navigation data and / or other data specifically intended for guiding the vehicle and / or controlling vehicle systems.

[0046] The output unit is preferably a display that can be used to output image data, especially also for the co-driver located next to the driver to watch. Alternatively, the output unit is a head-up display, the image data it projects can be viewed by the co-driver located next to the driver.

[0047] Advantageously, the sensor system comprises a camera system which is designed and set up to detect the pupil position of the driver's eyes and to determine the sight direction based on the pupil position. For this purpose, the sensor system preferably knows the geometry of the front region of the driver's cab in the direction of travel, the position of the driver's seat and the arrangement and position of the output device. The camera system is preferably arranged in the region of the dashboard in front of the driver and / or in the region of the vehicle roof in front of the driver. The camera system preferably comprises a stereo camera.

[0048] Advantageously, the control unit is designed and arranged such that a reduction or an increase in the perceptibility of the outputted image data is brought about by a reduction or an increase in the light intensity LI of the outputted image data.

[0049] The control unit is preferably designed and configured to output the image data with a light intensity LI ranging from 0 to a predetermined maximum value LI. MAX Change between: LI∈[0,..,LI MAX ].

[0050] The control unit is preferably designed and configured such that the reduction or increase in the perceptibility of the output image data is brought about by an increase or decrease in the blurriness of the output image data.

[0051] The control unit is preferably designed and set up to cause the blur by defocusing the output image data and / or by overlapping the output image data with image data that generates the area with variable transparency.

[0052] Advantageously, the control unit is designed and configured such that the optical output of the image data is faded out using a step function T 渐隐 (t) is implemented in which the light intensity LI is gradually reduced and / or the blurriness of the image data output is gradually enhanced.

[0053] Advantageously, the control unit is designed and configured such that the fading in of the optical output of the image data uses a step function T 渐显 (t) is implemented, in which the light intensity LI of the image data output is gradually increased and / or the blurriness of the image data output is gradually reduced.

[0054] Step function T 渐隐 (t) and / or T 渐显 (t) preferably through equidistant support points t = t n =t0+(n-1)*Δt, where n=0, 1, 2, ..., t0 is the start time, and Δt is the specified time step.

[0055] Advantageously, the control unit is designed and configured to determine the frequency with which the driver's gaze is directed toward the output unit, wherein the fade-out rate DOWN increases as the frequency increases.

[0056] Advantageously, the control unit is designed and set up to determine the frequency with which the driver's gaze is directed towards the output unit, wherein the fade-out rate DOWN increases with increasing frequency and / or the fade-in rate UP decreases accordingly.

[0057] In this case, the fade-out rate DOWN and / or the fade-in rate UP are preferably varied in such a way that UP>DOWN applies.

[0058] Advantageously, the control unit is designed and configured such that, if the determined viewing direction of the driver is directed toward the output device, the optical output of the image data is faded out according to the time difference ZV DOWN start.

[0059] The control unit is preferably designed and configured such that if the determined viewing direction of the driver is directed toward the output device and then away from the output device, the optical output of the image data is faded in according to the time difference ZV UP start.

[0060] A final aspect of the invention relates to a vehicle having the above-described system. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Further advantages, features and details are obtained from the following description, which may be explained in detail with reference to the attached drawings, of at least one exemplary embodiment. Identical, similar and / or functionally identical components are provided with the same reference numerals, wherein:

[0062] Figure 1 A highly schematic process of the method according to the invention is shown,

[0063] Figure 2 An example of a perceptible change in the output image data is shown, wherein the driver looks at the display device at a certain moment and does not avert his gaze,

[0064] Figure 3 shows an example of a perceptible change in the output image data, in which the driver looks at the output device at a certain point in time and then turns his gaze away from the output device,

[0065] Figure 4 A highly schematic structure of a system according to the invention is shown. DETAILED DESCRIPTION

[0066] Figure 1 A highly schematic sequence of a method according to the invention for influencing the optical output of image data on an output device in a vehicle is shown, the method comprising the following steps. In step 101, the direction of sight of the vehicle driver is determined in the vehicle. In step 102, if the determined direction of sight points toward the output device, the optical output of the image data is faded out with an average fade-out rate DOWN, wherein the fade-out rate DOWN defines a decrease in the optical perceptibility of the output image data to a person over time. In step 103, if the determined direction of sight points toward the output device and away from the output device, the optical output of the image data is faded in with an average fade-in rate UP, wherein the fade-in rate UP describes an increase in the optical perceptibility of the output image data to a person over time. In particular, UP>DOWN applies.

[0067] Figure 2 An example of a perceptible change in the output image data is shown, in which the driver looks at the output device at time t0 and does not remove his gaze for a longer period of time (eg, 10 seconds).

[0068] In the graph shown, time t is shown along the x-axis, and the perceptibility of the image data displayed on the output device is shown along the y-axis in units of percentage [%]. Here, a perceptibility of 100% corresponds to an optimal image data output of the output device. When the perceptibility is 0%, a person cannot perceive the image data to be output.

[0069] As described above, the perceptibility can be changed, for example, by changing the image brightness of the image data to be output on the output device and / or by changing the blurriness of the image data to be output. Thus, a perceptibility of 0% corresponds, for example, to a "black" screen, where the image brightness of the image data to be output is zero, or it corresponds, for example, to a blurriness of the output image data, where the image data to be output cannot be recognized.

[0070] The graph shows the perceptibility profile of the image data to be output for a situation in which the image data to be output are first displayed on the output device with 100% perceptibility and it is determined at time t0 that the driver is looking at the output device.

[0071] However, the “optical output of the image data to be outputted by fading out 102 at the average fade-out rate DOWN” does not start at time t0, but starts at a time difference ZV DOWN To start with, for example, the time difference is 2, 3 or 4 seconds.

[0072] In this embodiment, the fading 102 of the optical output of the image data is performed using a step function T 渐隐 (t), in which the light intensity LI of the image data output is gradually reduced and / or the blurriness of the image data output is gradually increased, so that the perceptibility of the image data to be output is weakened according to the average fade-out rate DOWN (indicated by the dotted line). Step function T 渐隐 (t) Here we use equidistant support points t = t n =t0+(n-1)*Δt, where n=0, 1, 2, ..., t0 is the start time, and Δt is the specified time step.

[0073] Naturally, any other time function f(t) can also be used to perform the fading 102 of the optical output of the image data.

[0074] From t0 to t E The time period is preferably 5 to 15 seconds.

[0075] Figure 3An example of a change in the perceptibility of output image data is shown, wherein the driver initially looks at the output device at time t0 and again looks away from the output device at time t1. In the example shown, the time difference between t0 and t1 is so small that the perceptibility of the image data to be output cannot reach 0% due to fading. The perceptibility of the output image data is 37% at time t1.

[0076] The optical output of the image data is gradually displayed 103 according to the time difference ZV UP The fading-in 103 of the optical output of the image data also uses a step function T 渐显 (t) is implemented in which the light intensity LI of the image data output is increased stepwise and / or the blurriness of the image data output is decreased stepwise. It can be clearly seen that UP>DOWN applies, ie the decrease in perceptibility is slower than the increase in perceptibility.

[0077] Figure 4 The highly schematic structure of the system of the present invention is shown, with the help of which image data can be optically output on an output device 201 in a vehicle, the system comprising a sensor system 202 arranged in the vehicle, which is designed and set up for determining the direction of sight of a driver of the vehicle; the system also comprises a control unit 203 for controlling the output device 201, which is designed and set up as follows, that is, if the determined direction of sight points to the output device 201, the optical output of the image data fades out with an average fade-out rate DOWN, wherein the fade-out rate DOWN defines the time-dependent weakening of the optical perceptibility of the output image data to a person, and if the determined direction of sight points to the output device 201 and leaves the output device 201, the optical output of the image data fades in with an average fade-in rate UP, wherein the fade-in rate UP describes the time-dependent increase in the optical perceptibility of the output image data to a person.

[0078] Although the present invention has been described and explained in detail by preferred embodiments, the present invention is not limited to the disclosed examples, and those skilled in the art may deduce other variations therefrom without departing from the scope of protection of the present invention. It is therefore apparent that there are many possible variations. It is also apparent that the exemplified embodiments are in fact only examples, which should never be understood as limitations, for example, on the scope of protection, possible applications or configurations of the present invention. On the contrary, the foregoing description and illustrations enable those skilled in the art to implement the embodiments, wherein those skilled in the art, knowing the disclosed inventive concept, may make various changes, for example, with respect to the functions or arrangements of the various elements mentioned in the embodiments, without departing from the scope of protection defined by the claims and their legal equivalents as detailed in the specification.

Claims

1. A method for influencing the optical output of image data on an output device in a vehicle, comprising the following steps: - determining (101) a viewing direction of a driver of the vehicle in the vehicle, - if the determined viewing direction points to the output device, fading out the optical output of the image data with an average fading rate DOWN (102), wherein the fading rate DOWN defines a time-dependent decrease in the visual perceptibility of the output image data to a human being, and - if the determined gaze direction points to the output device and moves away from the output device, fading in (103) the optical output of the image data with an average fade-in rate UP, wherein the fade-in rate UP describes a temporal increase in the visual perceptibility of the output image data to a human being, - Applicable is UP>DOWN, The frequency of the driver's gaze direction toward the output unit and / or the frequency of the driver's gaze direction away from the output unit is determined, wherein the fade-out rate DOWN increases with increasing frequency and / or the fade-in rate UP decreases accordingly.

2. The method according to claim 1, wherein: The fading (102) of the optical output of the image data is performed using a step function T 渐隐 (t) is implemented in that in the step function, the light intensity LI of the image data output is gradually reduced and / or the blurriness of the image data output is gradually increased.

3. The method according to claim 1 or 2, wherein: The fading (103) of the optical output of the image data is performed using a step function T 渐显 (t) is implemented in that in the step function, the light intensity LI of the image data output is gradually increased and / or the blurriness of the image data output is gradually reduced.

4. The method according to claim 2, wherein: The step function T 渐隐 (t) and / or T 渐显 (t) According to the equidistant support points t = t n =t0+(n-1)*Δt, where n=0, 1, 2, ...., t0:=start time, and Δt:=specified time step.

5. The method according to claim 1 or 2, wherein: If the determined sight direction points to the output device, then according to the time difference ZV DOWN The optical output of the image data begins to fade out at an average fade rate DOWN (102).

6. The method according to claim 1 or 2, wherein: If the determined sight direction is directed toward the output device and away from the output device, then the time difference ZV UP A fade-in of the optical output of the image data is initiated (103).

7. A system, by means of which image data can be optically output on an output device (201) in a transport vehicle, the system comprising: a sensor system (202) arranged in the vehicle, the sensor system being designed and set up to determine the direction of sight of the driver of the vehicle, - a control unit (203) which controls the output device (201), the control unit being designed and configured as follows, i. if the determined viewing direction points to the output device (201), the optical output of the image data is faded out at an average fade rate DOWN, wherein the fade rate DOWN defines a time-dependent decrease in the visual perceptibility of the output image data to a human being, and ii. if the determined sight line direction points to the output device (201) and leaves the output device (201), the optical output of the image data is faded in with an average fade-in rate UP, wherein the fade-in rate UP describes the time-dependent increase in the visual perceptibility of the output image data to a human being, - Applicable is UP>DOWN, The frequency of the driver's gaze direction toward the output unit and / or the frequency of the driver's gaze direction away from the output unit is determined, wherein the fade-out rate DOWN increases with increasing frequency and / or the fade-in rate UP decreases accordingly.

Images