Display system and display method for a vehicle

Abstract

The invention relates to a display system (100) for a vehicle (10), comprising: - a driver monitoring module (110) which is configured to detect the viewing behaviour of a driver of the vehicle (10); - a display module (120) which is configured to display a moving visual content (BVI); and - a control module (130) which is configured to actuate the display module (120) in such a way that a playback speed of the moving visual content (BVI) is adjusted, in particular reduced, on the basis of the viewing behaviour.

Description

[0001] Display system and display procedure for a vehicle

[0002] The present disclosure relates to a display system for a vehicle, a vehicle with such a display system, a display method for a vehicle, and a storage medium for executing the display method. The present disclosure relates in particular to a reduction or avoidance of impaired driver attention through dynamic visual information.

[0003] State of the art

[0004] It is generally known that certain types of dynamic visual information can attract or hold human attention. In the context of vehicles, this could potentially have an undesirable effect on driver attention and thus possibly impair road safety. To reduce adverse effects on driver attention, switching off displays while driving could be considered. However, this contradicts the very purpose of displaying dynamic visual information, as it would then no longer be visible. Furthermore, such a measure could restrict the use of displays by other vehicle occupants, such as front-seat passengers.

[0005] Disclosure of the invention

[0006] The purpose of this disclosure is to specify a display system for a vehicle, a vehicle with such a display system, a display method for a vehicle, and a storage medium for executing the display method, all of which can reduce or even avoid a negative impact on driver attention through dynamic visual information. In particular, the purpose of this disclosure is not to reduce, but rather to maintain or increase road safety.

[0007] This problem is solved by the subject matter of the independent claims. Advantageous embodiments are specified in the dependent claims.

[0008] According to an independent aspect of the present disclosure, a display system for a vehicle, in particular a motor vehicle, is specified. The display system comprises a driver monitoring module configured to detect the gaze behavior of a driver of the vehicle; a display module configured to display moving visual content; and a control module configured to control the display module such that a playback speed of the moving visual content is set based on the gaze behavior.

[0009] According to the invention, moving visual content such as animations is not stopped, switched off, overlaid, obscured, or otherwise altered. Instead, the playback speed is specifically adjusted based on the driver's gaze, so that the moving visual content has no or less of an impact on the driver's attention when it can be viewed or perceived. For example, a film on a passenger display can be automatically slowed down to half the normal playback speed when the driver looks towards the passenger display. In this way, the potential for distraction for the driver is reduced, while the passenger can continue to watch the film relatively undisturbed. As a result, road safety can be improved without compromising user comfort.

[0010] The driver monitoring module, the display module, and the control module may include software components / algorithms designed to run on at least one processor and thereby perform the functionalities of the respective module.

[0011] The display module and the control module can be implemented in a single software and / or hardware module. Alternatively, the display module and the control module can each be implemented in separate software and / or hardware modules.

[0012] The term "moving visual content" refers to any form of graphics, animations, videos, or similar media that contain dynamic elements and typically move or change to provide a visual representation. This content can be presented on screens, displays, or other media platforms and serves to convey information or entertainment visually.

[0013] Preferably, the moving visual content is a film, a video or an (e.g. decorative) animation.

[0014] A "film" is an artistic representation that uses moving images to tell a story, express emotions, convey information, or provide entertainment.

[0015] A "video," such as a streaming video, is a digital recording that contains moving images and often sound. Videos are frequently a form of digital media content that can be uploaded and streamed on platforms like YouTube. They can cover a variety of content, including vlogs, tutorials, music videos, documentaries, and much more. These videos are accessible via the internet and can be viewed by users worldwide.

[0016] An "animation" refers to the creation of movement in images or graphics through the sequential display of images or frames. These frames, which often differ slightly from one another, create the impression of movement or change when played back quickly. Animations can be hand-drawn, computer-generated, or created using stop-motion techniques.

[0017] The term "playback speed" of moving visual content refers to the speed at which the image sequences or frames are played back. This speed determines how fast or slow the movements or changes within the content appear. A higher playback speed results in faster movements, while a lower speed slows movements down. In some implementations, the playback speed may be specified as a fraction or multiplier of the original recording speed, such as 1x (normal), 0.5x (half speed), or 2x (double speed).

[0018] Preferably, the driver monitoring module comprises at least one sensor configured to detect the driver and provide detection data. The at least one sensor can be an optical sensor, such as a camera, in particular an interior camera. Optionally, the driver monitoring module can include at least one light source. In some embodiments, the light source can be an infrared light source, and the at least one sensor can be an infrared sensor, such as an infrared camera.

[0019] Preferably, the driver monitoring module is configured to determine the driver's gaze behavior based on the data acquired by the at least one sensor. In particular, the driver monitoring module can be configured to evaluate the data acquired by the at least one sensor, such as image data, using suitable software. By evaluating the acquired data, the driver's gaze behavior can be detected and determined.

[0020] Preferably, the driver monitoring module is configured to determine the driver's gaze behavior based on the driver's (spatial) head orientation. For example, the head orientation can be detected by an interior camera. This allows insights to be gained into where a person is looking. The term "(spatial) orientation," as used in this disclosure, refers to the arrangement or pose of the driver's head in three-dimensional space. The orientation of the driver's head can be appropriately derived, for example, from image data from the interior camera.

[0021] Preferably, gaze behavior includes, or is, a gaze direction. The gaze direction refers to the orientation of the eyes toward a specific object, person, or point in space. It indicates where a person is looking or what area the person is visually perceiving. The gaze direction can be determined using various methods, such as observing eye movements, pupil position, and / or head orientation.

[0022] Preferably, the driver monitoring module is configured to record the direction of gaze using eye tracking. The term "eye tracking" refers specifically to the recording of eye movements, which are detected, for example, by an interior camera. This allows insights to be gained into where a person is looking.

[0023] Preferably, the control module is configured to control the display module such that the playback speed of the moving visual content is set to a nominal value when the viewing behavior corresponds to a first predetermined viewing behavior. The term "nominal value" refers to a fixed or named value used to describe the speed at which, for example, a video or animation is played. For example, the nominal playback speed value might be "Ix", which corresponds to the normal playback speed.

[0024] Preferably, the first predetermined gaze behavior is such that the driver does not perceive the moving visual content. For example, the driver cannot perceive the moving visual content if a display area of ​​the display module is outside the driver's field of vision. This can be estimated, for example, based on the direction of gaze. The "driver's field of vision" refers to the area that the driver can see from their current position without significantly changing their head or eye movements.

[0025] Preferably, the first predetermined gaze behavior is such that the driver looks away from the display module. This can be determined, for example, based on the direction of gaze, whereby it can be determined that the driver looks away from the display module if the direction of gaze does not fall on the display area of ​​the display module.

[0026] Preferably, the control module is configured to control the display module such that the playback speed of the moving visual content is reduced relative to the nominal value when the viewing behavior corresponds to a second predetermined viewing behavior. For example, the playback speed of the moving visual content can be reduced to 0.75 times, 0.5 times, or 0.25 times the normal playback speed.

[0027] Preferably, the second predetermined gaze behavior is such that the driver perceives the moving visual content. The driver can perceive the moving visual content, for example, if the display area of ​​the display module is within the driver's field of vision. This can be estimated, for example, based on the direction of gaze.

[0028] Preferably, the second predetermined gaze behavior is such that the driver looks in the direction of the display module, in particular at the display module itself. This can be determined, for example, based on the direction of gaze, whereby it can be determined that the driver is looking in the direction of the display module when the direction of gaze hits or falls upon the display surface of the display module.

[0029] Preferably, the second predetermined viewing behavior is such that the display module or the display area of ​​the display module is located in the driver's peripheral field of vision. This can be determined, for example, based on the direction of gaze. The "driver's peripheral field of vision" refers to the area outside the central field of vision that a driver can perceive without significantly altering eye movements or head position. It includes the lateral areas that are not directly in front of the eyes, but rather to the side or near the edges of the field of vision.

[0030] Preferably, the control module is configured to control the display module in such a way that the playback speed of the moving visual content is gradually reduced the more and / or the longer or more frequently the driver looks towards the display module. For example, the playback speed of the moving visual content can first be reduced to a first value (e.g., 0.75 times the normal playback speed or less) when the display module is in the driver's peripheral vision, and then further reduced to a second value (e.g., 0.5 times the normal playback speed or less) when the driver looks directly at the display module.

[0031] Preferably, the display module comprises a display, in particular an LCD display, a plasma display, or an OLED display. Additionally or alternatively, the display module may include a projection device configured to project the moving visual content directly into the driver's and / or passenger's field of vision, in particular onto a windshield. In some embodiments, the display module may be a central information output device of an infotainment system, such as a head unit or a pillar-to-pillar display. Preferably, the display module is permanently installed in the vehicle. Preferably, the display module is a driver display or a passenger display.

[0032] According to another independent aspect of the present disclosure, a vehicle, in particular a motor vehicle, is specified. The vehicle comprises the display system according to the embodiments of the present disclosure.

[0033] The term "vehicle" includes cars, trucks, vans, buses, motorhomes, motorcycles, etc., used for the transport of people, goods, etc. In particular, the term includes motor vehicles for passenger transport.

[0034] According to a further independent aspect of the present disclosure, a display method for a vehicle, in particular a motor vehicle, is specified. The display method comprises detecting, by a driver monitoring module, the gaze behavior of a driver of the vehicle; displaying, by a display module, moving visual content; and controlling the display module by a control module such that a playback speed of the moving visual content is set based on the gaze behavior.

[0035] The display procedure can implement the aspects of the display system described in this document.

[0036] According to another independent aspect of the present disclosure, a software (SW) program is specified. The SW program can be configured to run on one or more processors and thereby execute the display procedure for a vehicle described in this document.

[0037] According to another independent aspect of this disclosure, a storage medium is specified. The storage medium may include a software program configured to run on one or more processors and thereby execute the display procedure for a vehicle described in this document. According to another independent aspect of this disclosure, software with program code is specified. The software is configured to perform the display procedure for a vehicle when the software runs on one or more software-controlled devices.

[0038] According to another independent aspect of the present disclosure, a system is specified. The system comprises one or more processors; and at least one memory connected to the one or more processors and containing instructions that can be executed by the one or more processors to perform the display method for a vehicle described in this document.

[0039] A processor or processor module is a programmable computing unit, i.e., a machine or an electronic circuit that controls other elements according to given instructions and thereby advances an algorithm (process).

[0040] Brief description of the drawings

[0041] Examples of the manifestation of the revelation are shown in the figures and are described in more detail below. They show:

[0042] Figure 1 schematically shows a vehicle with a display system according to embodiments of the present disclosure,

[0043] Figure 2 schematically shows a display module with moving visual content according to embodiments of the present disclosure, and

[0044] Figure 3 shows a flowchart of a display method for a vehicle according to embodiments of the present disclosure. Embodiments of the disclosure

[0045] Unless otherwise noted, the same reference symbols are used for identical and equivalent elements in the following.

[0046] Figure 1 schematically shows a vehicle 10 with a display system 100 according to embodiments of the present disclosure. Figure 2 schematically shows a display module 120 with a moving visual content BVI according to embodiments of the present disclosure.

[0047] The display system 100 comprises a driver monitoring module 110, which is configured to record the gaze behavior of the driver of the vehicle 10. For this purpose, the driver monitoring module 110 can include at least one sensor, such as a camera, in particular an interior camera. The driver monitoring module 110 can evaluate the data provided by the at least one sensor, such as image data, using suitable software and thus determine the driver's gaze behavior.

[0048] In some embodiments, gaze behavior includes, or is, a gaze direction. The driver monitoring module can be configured to detect the gaze direction using eye tracking. The term "eye tracking" refers specifically to the detection of eye movements, for example, by an interior camera. This allows insights to be gained into where a person is looking.

[0049] The display system 100 further comprises a display module 120, which is configured to display moving visual content (BVI), such as a film, a video, or an animation (e.g., decorative). In some embodiments, the display module 120 can be a driver display or a passenger display.

[0050] The display system 100 further comprises a control module 130, which is configured to control the display module 120 in such a way that the playback speed of the moving visual content BVI is set, and in particular reduced, based on the gaze behavior. Specifically, the playback speed of the moving visual content BVI can be reduced if there is a risk of distraction from the moving visual content BVI, for example, if the driver is looking at the display module 120.

[0051] In some embodiments, the control module 120 is configured to control the display module 120 such that the playback speed of the moving visual content BVI is set to a nominal value when the viewing behavior corresponds to a first predetermined viewing behavior. For example, the nominal value of the playback speed may be "Ix", which corresponds to the normal playback speed.

[0052] In some embodiments, the first predetermined gaze behavior is such that the driver does not perceive the moving visual content BVI. For example, the driver cannot perceive the moving visual content BVI if a display area of ​​the display module 120 is outside the driver's field of vision.

[0053] Additionally or alternatively, the first predetermined gaze behavior can be such that the driver looks away from the display module 120. This can be determined, for example, based on the direction of gaze, whereby it can be determined that the driver looks away from the display module 120 if the direction of gaze does not fall on the display area of ​​the display module 120.

[0054] In some embodiments, the control module 130 is configured to control the display module 120 such that the playback speed of the moving visual content BVI is reduced relative to its nominal value when the gaze behavior corresponds to a second predetermined gaze behavior. For example, the playback speed of the moving visual content can be reduced to 0.75 times, 0.5 times, or 0.25 times the normal playback speed. In some embodiments, the second predetermined gaze behavior is such that the driver perceives the moving visual content BVI. The driver can perceive the moving visual content BVI, for example, when the display area of ​​the display module 120 is within the driver's field of vision.

[0055] Additionally or alternatively, the second predetermined gaze behavior can be such that the driver looks in the direction of the display module 120, in particular at the display module 120. This can be determined, for example, based on the direction of gaze, whereby it can be determined that the driver is looking in the direction of the display module 120 when the direction of gaze hits or falls on the display surface of the display module 120.

[0056] Additionally or alternatively, the second predetermined viewing behavior can be such that the display module 120 or the display area of ​​the display module 120 is located in a peripheral field of vision of the driver.

[0057] In some embodiments, the control module 130 is configured to control the display module 120 such that the playback speed of the moving visual content BVI is gradually reduced as the driver looks closer to the display module 120. For example, the playback speed of the moving visual content BVI can first be reduced to a first value (e.g., 0.75 times or 0.5 times the normal playback speed) when the display module 120 is in the driver's peripheral vision, and then further reduced to a second value (e.g., 0.25 times the normal playback speed or less) when the driver is looking directly at the display module 120.

[0058] Figure 3 schematically shows a flowchart of a display method 300 according to embodiments of the present disclosure. The display method 300 can be implemented by suitable software that can be executed by one or more processors (e.g., a CPU). The display method 300 comprises, in block 310, the detection of a driver's gaze behavior by a driver monitoring module; in block 320, the display of moving visual content by a display module; and in block 330, the control of the display module by a control module such that a playback speed of the moving visual content is set based on the gaze behavior.

[0059] According to the invention, moving visual content such as animations is not stopped, switched off, overlaid, obscured, or otherwise altered. Instead, the playback speed is specifically adjusted based on the driver's gaze, so that the moving visual content has no or less of an impact on the driver's attention when it can be viewed or perceived. For example, a film on a passenger display can be automatically slowed down to half the normal playback speed when the driver looks towards the passenger display. In this way, the potential for distraction for the driver is reduced, while the passenger can continue to watch the film relatively undisturbed. As a result, road safety can be improved without compromising user comfort.

[0060] Although the invention has been further illustrated and explained in detail by means of preferred embodiments, the invention is not limited by the disclosed examples, and other variations can be derived from them by a person skilled in the art without departing from the scope of protection of the invention. It is therefore clear that a multitude of possible variations exist. It is also clear that the embodiments mentioned as examples are truly only examples and are not to be understood in any way as limiting, for example, the scope of protection, the possible applications, or the configuration of the invention.Rather, the preceding description and the description of the figures enable the person skilled in the art to implement the exemplary embodiments in concrete terms, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without leaving the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description.

Claims

Patent claims 1. Display system (100) for a vehicle (10), comprising: a driver monitoring module (110) configured to detect the gaze behavior of a driver of the vehicle (10); a display module (120) configured to display moving visual content (BVI); and a control module (130) configured to control the display module (120) such that a playback speed of the moving visual content (BVI) is set, in particular reduced, based on the gaze behavior.

2. Display system (100) according to claim 1, wherein the moving visual content (BVI) is a film, a video or an animation.

3. Display system (100) according to claim 1 or 2, wherein the driver's gaze behavior includes or is a gaze direction.

4. Display system (100) according to any one of claims 1 to 3, wherein the control module (130) is configured to control the display module (120) such that: the playback speed of the moving visual content (BVI) is set to a nominal value when the viewing behavior corresponds to a first predetermined viewing behavior; and the playback speed of the moving visual content (BVI) is reduced with respect to the nominal value when the viewing behavior corresponds to a second predetermined viewing behavior.

5. Display system (100) according to claim 4, wherein: the first predetermined gaze behavior is such that the driver does not perceive the moving visual content (BVI) and / or looks away from the display module (120); and the second predetermined gaze behavior is such that the driver perceives the moving visual content (BVI) and / or looks towards the display module (120) looks and / or the display module (120) is located in a peripheral field of vision of the driver.

6. Display system (100) according to claim 4 or 5, wherein the control module (130) is configured to control the display module (120) such that the playback speed of the moving visual content (BVI) is gradually reduced as the driver looks towards the display module (120).

7. Display system (100) according to any one of claims 1 to 6, wherein the display module (120) is a driver display or a passenger display.

8. Vehicle (10), in particular motor vehicle, comprising the display system (100) according to any one of claims 1 to 7.

9. Display procedure (300) for a vehicle (10), comprising: Detection (310), by a driver monitoring module (110), of the gaze behavior of a driver of the vehicle (10); Displays (320), through a display module (120), of moving visual content (BVI); and Control (330) of the display module (120) by a control module (130) such that the speed of the moving visual content (BVI) is set, in particular reduced, based on the viewing behavior.

10. Storage medium comprising a software program configured to run on one or more processors and thereby to execute the display method (300) according to claim 9.

Images