Method and system for displaying information on a driver display

By using gaze detection to determine when a vehicle driver is actively viewing the driver display, the system ensures that overlays are displayed only after a predefined threshold, reducing distraction and improving information processing.

DE102023132227A1Pending Publication Date: 2025-05-22DR ING H C F PORSCHE AG
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
DE102023132227
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-11-20
Publication Date
2025-05-22

AI Technical Summary

Technical Problem

Existing driver display systems in vehicles do not effectively adapt to the driver's viewing behavior, potentially distracting the driver with overlays that are not timely or relevant.

Method used

A method and system that utilize gaze detection to determine the driver's viewing direction and measure the duration of uninterrupted viewing, displaying overlays only when the driver has focused on the display for a predefined threshold time.

Benefits of technology

This approach ensures that overlays, such as warnings or driver assistance aids, are displayed only when the driver is actively viewing the display, reducing distraction and improving the driver's ability to process information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The present invention relates to a method for displaying information on a driver display, in which the driver display (11) is arranged in the field of vision of the vehicle driver, in which an image transmission from at least one surrounding camera of the vehicle is shown on the driver display (11) for operation thereof, in which, in a further embodiment, a viewing direction of the vehicle driver is determined, in which a duration of uninterrupted viewing of the driver display (11) by the vehicle driver is measured, and in which, if a predetermined threshold value of the duration is exceeded, at least one display (12) is shown on the driver display (11). Furthermore, a system is presented with which the method can be carried out.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method for displaying information on a driver display, in which the information is displayed according to eye tracking. Furthermore, a system is presented with which the method can be implemented.

[0002] One or more surround-view cameras are a common feature of modern vehicles. Such surround-view cameras assist a driver, for example, when parking or reversing. A camera image is transmitted to a display located in the driver's field of vision and is usually overlaid with additional information, some of which is graphical or text-based. In addition to the pure surrounding image, information is shown on the display. This information not only partially covers the camera image but also draws the driver's attention, for example, to read an information text.

[0003] GB 2542408 A describes a car with a rearview camera, HUD, and eye-tracking camera. The rear view is selectively displayed on the windshield when the driver looks at a specific area.

[0004] From the publication CN 112277804 A 8, a vehicle with an eye tracking camera is known, which captures an image obscured by an A-pillar and calculates it from camera recordings based on the driver's line of sight.

[0005] Document CN 106183997 A discloses a vehicle with a rearview and eye-tracking camera. A controller detects whether the driver's gaze is directed at the screen and automatically switches it on or off accordingly.

[0006] EP 3915837 B1 discusses a digital mirror system. A camera installed in the vehicle detects when the driver's eyes move and thus changes their direction of view. The image displayed in the mirror is adjusted accordingly.

[0007] Against this background, it is an object of the present invention to present a method for displaying information on a driver display, wherein the information is adapted to the driver's gaze behavior. Disturbance to the driver is to be avoided or reduced. Furthermore, a system is to be presented with which the method can be implemented.

[0008] To achieve the aforementioned problem, a method for displaying information on a driver display is proposed, in which the driver display is positioned within the driver's field of vision. To operate the driver display, an image transmission from at least one surrounding camera of the vehicle is shown on the display. In a further embodiment, the driver's viewing direction is determined, and the duration of uninterrupted viewing of the driver display by the driver is measured. If a predetermined threshold value for the duration is exceeded, at least one information display is shown on the driver display.

[0009] This advantageously adapts the display of messages to the driver based on their actual viewing behavior. Devices for detecting the driver's line of sight, for example, using cameras positioned inside the vehicle and aimed at the driver, are well known and are now part of many vehicles.

[0010] With the method according to the invention, at least one overlay only occurs when the driver looks at the driver display for longer than the specified threshold, instead of, for example, looking out of a vehicle window or into a rearview or exterior mirror. This advantageously gives the driver the opportunity to capture the entire image until the threshold for the duration of uninterrupted viewing has elapsed. By briefly looking away from the driver display and, for example, looking at a rearview mirror, viewing the driver display is interrupted, thus resetting the measured time to zero.

[0011] In one embodiment of the method according to the invention, the at least one display is selected from the following list: warning, driver assistance, direction of travel vector, distance value to the nearest object.

[0012] In a further embodiment of the method according to the invention, the predetermined threshold value is selected to be two seconds.

[0013] In yet another embodiment of the method according to the invention, the at least one surroundings camera is directed to a field of view from the following list: rear near field of the vehicle, respective lateral near field, wide-angle vehicle in front.

[0014] In a further embodiment of the method according to the invention, the at least one display is shown at a location on the driver display that is not viewed by the driver at the moment the threshold value is exceeded.

[0015] Furthermore, a system is claimed which comprises a vehicle with at least one surroundings camera, a driver display, a gaze detector, and a control unit. The driver display is arranged in the field of vision of a vehicle driver, wherein the driver display is designed to display an image transmission from at least one surroundings camera of the vehicle. The gaze detector, also referred to as "eye tracking", is designed, in a continued embodiment, to determine a direction of gaze of the vehicle driver and to measure the duration of uninterrupted viewing of the driver display by the vehicle driver. The control unit is configured to display at least one overlay on the driver display if a predetermined threshold value for the duration is exceeded.

[0016] In one embodiment of the system according to the invention, the at least one display is selected from the following list: warning, driver assistance, direction of travel vector, distance value to the nearest object.

[0017] In a further embodiment of the system according to the invention, the predetermined threshold value is set to two seconds.

[0018] In yet another embodiment of the system according to the invention, the at least one surroundings camera is directed at a field of view from the following list: rear near field of the vehicle, respective lateral near field, wide-angle field in front of the vehicle.

[0019] In a further further embodiment of the system according to the invention, the control unit is configured to display the at least one overlay at a location on the driver display that is not viewed by the driver at the moment the threshold value is exceeded.

[0020] Further advantages and embodiments of the invention will become apparent from the description and the accompanying drawings.

[0021] It is understood that the features mentioned above and those to be explained below can be used not only in the combination specified in each case, but also in other combinations or on their own, without departing from the scope of the present invention.

[0022] Fig. 1 schematically shows a field of view of a vehicle driver in the direction of travel in an embodiment of the method according to the invention.

[0023] In Fig.1 schematically shows a field of vision 10 of a vehicle driver in the direction of travel in one embodiment of the method according to the invention. The field of vision 10 contains a part of the dashboard 13, on which a driver display 11 is arranged, as well as a section of the driver's view of a real traffic situation 15 through a windshield. An image is transmitted to the driver display 11 by a surrounding camera aligned in a direction of travel, which shows a camera image 14 of the real traffic situation 15. After the driver has viewed the driver display 11 for a period of time longer than a predetermined threshold, an overlay 12, for example, "Do not rely solely on the camera image," is displayed.At the time the threshold value was exceeded, the driver's line of sight was directed towards a traffic sign 16 shown on the driver display 11, so that according to the invention the display 12 is shown at a different location on the driver display 11. List of reference symbols 10 Field of view in direction of travel 11 Driver display 12 Fade-in 13 Dashboard 14 Camera image shown on driver display 15 Vehicle apron observed by the surrounding camera 16 traffic sign QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] GB 2542408 A

[0003] CN 112277804 A

[0004] CN 106183997 A

[0005] EP 3915837 B1

[0006]

Claims

[1] Method for displaying information on a driver display, in which the driver display (11) is arranged in the field of vision of the vehicle driver, in which an image transmission from at least one surroundings camera of the vehicle is shown on the driver display (11) for operation thereof, in which, in a continued embodiment, a viewing direction of the vehicle driver is determined, in which a duration of uninterrupted viewing of the driver display (11) by the vehicle driver is measured, and in which, if a predetermined threshold value of the duration is exceeded, at least one display (12) is shown on the driver display (11). [2] Method according to claim 1, wherein the at least one display (12) is selected from the following list: warning, driver assistance, direction of travel vector, distance value to the nearest object. [3] Method according to one of the preceding claims, in which the predetermined threshold value is selected to be two seconds. [4] Method according to one of the preceding claims, in which the at least one surroundings camera is directed to a field of view from the following list: rear near field of the vehicle, respective lateral near field, wide-angle vehicle in front field. [5] Method according to one of the preceding claims, in which the at least one display (12) is displayed at a location on the driver display (12) which is not viewed by the driver at the moment the threshold value is exceeded. [6] System comprising a vehicle with at least one surroundings camera, a driver display (11), a gaze detector, and a control unit, wherein the driver display (11) is arranged in the field of vision of a vehicle driver, wherein the driver display (11) is designed to display an image transmission from at least one surroundings camera of the vehicle, wherein the gaze detector is designed, in a continued embodiment, to determine a direction of gaze of the vehicle driver and to measure a duration of uninterrupted viewing of the driver display (11) by the vehicle driver, and wherein the control unit is configured to display at least one overlay (12) on the driver display (11) when a predetermined threshold value of the duration is exceeded. [7] System according to claim 6, wherein the at least one display (12) is selected from the following list: warning, driver assistance, direction of travel vector, distance value to the nearest object. [8] A system according to any one of claims 6 or 7, wherein the predetermined threshold is set to two seconds. [9] System according to one of claims 6 to 8, wherein the at least one environment camera is directed to a field of view from the following list: Rear near field of the vehicle, respective lateral near field, wide-angle vehicle in front. [10] System according to one of claims 6 to 9, wherein the control unit is configured to display the at least one overlay (12) at a location on the driver display (11) which is not viewed by the driver at the moment the threshold value is exceeded.

Citation Information

Patent Citations

  • Line of sight-controlled display system for motor vehicle i.e. car, has control unit controlling display of information based on line of sight duration of detected line of sight relative to display of information on display area

    DE102007025531A1

  • Vehicle i.e. passenger car, has control unit provided with monitoring unit for monitoring direction of view of driver of vehicle, where monitoring unit judges whether driver observes display on basis of gaze direction

    DE102012019508A1

  • Method and device for controlling at least one function of at least one display device for the interior of a vehicle

    DE102012206030A1

  • Method and appropriately designed device for visually triggering a process in a motor vehicle

    DE102014203982A1

  • Camera-based driver assistance system and methods for controlling such a system

    DE102017209908A1