Method for adapting a vehicle display device, computer-readable medium, system, and vehicle
The method enhances display readability for drivers wearing sunglasses by using an interior camera to detect sunglasses and adjust display settings based on gaze recognition, addressing the issue of reduced visibility caused by sunglasses and sunlight changes.
Patent Information
- Application Number
- DE102021114784
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-06-09
- Publication Date
- 2024-12-19
- Estimated Expiration
- 2041-06-09
AI Technical Summary
Vehicle users often struggle to see visual display elements clearly with sunglasses on due to brightness filtering, which existing technologies have not adequately addressed.
A method using an interior camera to detect sunglasses and adjust display device brightness based on gaze recognition rates, enhancing readability by increasing brightness when sunglasses are detected, and adjusting dynamically to changing sunlight conditions.
Ensures clear visibility of display content for drivers wearing sunglasses by adaptively adjusting display brightness and composition, accommodating varying sunlight conditions and user feedback.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method for adapting a display device of a vehicle. The invention further relates to a computer-readable medium for adapting a display device of a vehicle, a system for adapting a display device of a vehicle, and a vehicle comprising the system for adapting a display device of a vehicle.
[0002] Visual display elements are becoming increasingly common in vehicle interiors. Driving-related information or infotainment information is shown on large-screen displays. Vehicle users often have difficulty seeing the visual display elements while wearing sunglasses, as the sunglasses filter out some of the brightness of the displays.
[0003] DE 10 2015 007 485 A1 describes a method for adapting image content of a head-up display on a windshield of a vehicle, in which a perception condition of the image content is evaluated, depending on which an optimal visibility of the image content is set.
[0004] DE 10 2015 219 111 A1 describes a method for controlling the lighting of control elements in a motor vehicle with an interior camera for recording a driver.
[0005] DE 10 2019 001 559 A1 describes a device for adjusting the polarization direction of a head-up display on a windshield of a vehicle.
[0006] DE 10 2019 209 950 A1 describes a method for adjusting a display device in the interior of a vehicle, comprising the steps of detecting a vehicle occupant; detecting whether the detected vehicle occupant is wearing sunglasses; analyzing the detected sunglasses; and adjusting the display device based on the result of the analysis of the detected sunglasses.
[0007] It is therefore an object of the invention to efficiently adapt a display device of a vehicle. In particular, an object of the invention is to efficiently adapt a display device of a vehicle to a user who wears sunglasses while driving the vehicle.
[0008] This object is achieved by the features of the independent claims. Advantageous embodiments and further developments of the invention emerge from the dependent claims.
[0009] According to a first aspect, the invention is characterized by a method for adapting a display device of a vehicle. The method can be a computer-implemented method and / or a control unit-implemented method. The display device can be a heads-up display, a display, a touch-sensitive display, and / or a projector of the vehicle. The display device is preferably arranged in an interior of the vehicle. The vehicle can be a motor vehicle. The method comprises detecting sunglasses of a driver of the vehicle. The sunglasses can be self-tinting sunglasses or sunglasses with self-tinting lenses. The sunglasses can be detected by an interior camera of the vehicle. The interior camera can be part of a driver monitoring system. The interior camera is preferably a driver monitoring camera.
[0010] If sunglasses of the vehicle driver have been detected, the method comprises detecting the driver's gaze by a driver monitoring camera of the vehicle, determining a detection rate of the driver's gaze by the vehicle's driver monitoring camera at a predetermined time interval, and adjusting the vehicle's display device depending on the determined detection rate of the driver's gaze. Adjusting the display device preferably comprises increasing the brightness of the display device. Adjusting the display device can be performed in such a way that the readability of the display device is increased when sunglasses are detected.
[0011] Advantageously, the method can be used to efficiently adjust the display device when sunglasses are detected by the driver monitoring camera, so that the driver can read the display device even with the sunglasses on. By adjusting the display device depending on the recognition rate of the driver's gaze, the display device can efficiently adapt to self-tinting sunglasses. If the sunlight is strong, the driver monitoring camera can no longer recognize the driver's gaze. The recognition rate drops in strong sunlight. As the recognition rate decreases, the display device can be adjusted so that the driver can still read the display device. For example, the brightness of the display device can be increased as the recognition rate of the driver's gaze decreases. If the sunlight is weak, the driver monitoring camera can recognize the driver's gaze. The recognition rate increases in weak sunlight.As the recognition rate increases, the display can be adjusted to allow the driver to continue reading the display. For example, the brightness of the display can be reduced as the driver's gaze recognition rate increases. This allows the display to be adjusted to accommodate short-term changes in sunlight, for example, when the sun is obscured by a cloud or a building. The driver can always read the display despite changing ambient conditions and changing shades of the sun visor.
[0012] According to an advantageous embodiment of the invention, the driver's gaze can be continuously detected at predetermined times by the vehicle's driver monitoring camera, and / or the predetermined time interval can be a sliding time interval. This allows the driver's gaze to be monitored flexibly.
[0013] According to a further advantageous embodiment of the invention, when determining the recognition rate of the driver's gaze by the vehicle's driver monitoring camera within the specified time interval, only those detected gazes can be taken into account in which at least one eyelid is open and / or the driver's head position is oriented toward the driver monitoring camera. This allows the recognition rate to be determined more precisely, and the display device can be adjusted more precisely based on the recognition rate.
[0014] According to a further advantageous embodiment of the invention, adapting the vehicle's display device depending on the determined recognition rate of the driver's gaze can comprise adapting the vehicle's display device if the determined recognition rate falls below a predetermined threshold. Additionally or alternatively, adapting the display device can be adapted if the recognition rate falls below one or more further thresholds. Preferably, a profile for adapting the display device is linked to a threshold, and if the threshold is exceeded, the display device is adapted to the linked profile. A profile for adapting the display device comprises at least one brightness value of the display device. This allows the display device to be adapted efficiently and / or flexibly.
[0015] According to a further advantageous embodiment of the invention, adjusting the vehicle's display device depending on the determined recognition rate of the driver's gaze can include adjusting the brightness of the display device. This allows the brightness of the display device to be efficiently adjusted to ensure readability for the driver when sunglasses are detected.
[0016] According to a further advantageous embodiment of the invention, adapting the vehicle's display device depending on the determined recognition rate of the driver's gaze can include adapting a color composition of the vehicle's display device. This allows the color composition of the display device to be efficiently adapted to ensure readability for the driver when sunglasses are detected.
[0017] According to a further advantageous embodiment of the invention, if the recognition rate of the driver's gaze falls below a predetermined threshold in the predetermined time interval, the method may further comprise: generating a suggestion message for adjusting the display device by a digital assistant of the vehicle depending on the recognition rate of the driver's gaze; providing the suggestion message to the driver of the vehicle by the digital assistant; receiving a response message in response to the suggestion message from the driver of the vehicle by the digital assistant; and adjusting the display device of the vehicle depending on the response message from the driver of the vehicle. This allows the display device to be adjusted efficiently, taking into account feedback from the driver.
[0018] According to a further aspect, the invention is characterized by a computer-readable medium for adapting a display device of a vehicle, wherein the computer-readable medium comprises instructions which, when executed on a computer and / or a control device, carry out the method described above.
[0019] According to a further aspect, the invention is characterized by a system for adapting a display device of a vehicle, wherein the system is designed to carry out the method described above.
[0020] According to a further aspect, the invention is characterized by a vehicle comprising the above-described system for adapting a display device of a vehicle.
[0021] Further features of the invention emerge from the claims, the figures, and the description of the figures. All features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the respective specified combination, but also in other combinations or even on their own.
[0022] In the following, a preferred embodiment of the invention is described with reference to the accompanying drawings. Further details, preferred embodiments and developments of the invention will emerge from these. In detail, schematically Fig. 1 an exemplary method for adjusting a display device of a vehicle.
[0023] In detail, Fig.1 shows an exemplary method 100 for adjusting a display device of a vehicle. In good weather, it is common for a driver of a vehicle to wear sunglasses while driving the vehicle. The sunglasses filter out some of the brightness from the display devices in the vehicle's interior. Content displayed by the display devices to the driver cannot be recognized or can only be recognized to a limited extent by the driver when the sunglasses are on.
[0024] The method 100 can detect 102 sunglasses of a driver of the vehicle. The sunglasses can be detected, for example, by a driver monitoring camera of a driver monitoring system. Additionally, the driver monitoring camera can monitor a driver's gaze direction and / or blinking behavior. Furthermore, the driver monitoring camera can detect the degree of light filtering of the sunglasses.
[0025] If the vehicle driver's sunglasses are detected, the method can detect the driver's gaze through the vehicle's driver monitoring camera 104. If the driver's eyelid is open, their gaze is directed toward the driver monitoring camera, and the degree of light filtration of the sunglasses is low, the driver monitoring camera can detect the driver's gaze. If the driver's eyelid is closed, and / or their gaze is not directed toward the driver monitoring camera, and / or the degree of light filtration of the sunglasses is high, the driver monitoring camera cannot detect the driver's gaze.
[0026] The method 100 can determine 104 a detection rate of the driver's gaze by the vehicle's driver monitoring camera in a predetermined time interval. Only detected gazes are used to calculate the detection rate in which the driver's eyelid is open, the direction of gaze is directed toward the driver monitoring camera, and the degree of light filtering of the sunglasses is low. The detection rate indicates the proportion of detected gazes to the total number of gaze detections by the driver monitoring camera in the predetermined time interval.
[0027] Finally, method 100 can adjust 106 the vehicle's display device depending on the determined recognition rate of the driver's gaze. Adjustment 106 is preferably performed by increasing the brightness of the vehicle's display device. If multiple display devices are arranged in a field of vision or a direction of vision of the driver, the method can adjust all or only driving-relevant display devices in the field of vision or the direction of vision of the driver, in particular by increasing the brightness.
[0028] Advantageously, by increasing the brightness of the display device(s) when the driver's sunglasses are detected, the comfort when reading content displayed on the display devices can be efficiently increased. List of reference symbols 100 procedures 102 Detecting a driver's gaze 104 Determining a recognition rate 106 Adjusting a display device
Claims
[1] A method (100) for adapting a display device of a vehicle, the method (100) comprising: Detecting sunglasses belonging to a driver of the vehicle; and If sunglasses of the driver of the vehicle were detected: detecting (102) a driver's gaze by a driver monitoring camera of the vehicle; Determining (104) a recognition rate of the driver's gaze by the driver monitoring camera of the vehicle in a predetermined time interval; and Adapting (106) the vehicle's display device depending on the determined recognition rate of the driver's gaze. [2] The method (100) of claim 1, wherein the driver's gaze is continuously detected at predetermined times by the driver monitoring camera of the vehicle; and / or wherein the predetermined time interval is a sliding time interval. [3] Method (100) according to one of the preceding claims, wherein in determining (104) the recognition rate of the driver's gaze by the driver monitoring camera of the vehicle in the predetermined time interval, only recognized gazes are taken into account in which at least one eyelid is open and / or a head position of the driver is oriented towards the driver monitoring camera. [4] Method (100) according to one of the preceding claims, wherein the adjusting (106) of the display device of the vehicle in dependence on the determined recognition rate of the driver's gaze comprises: Adjusting (106) the vehicle's display device if the determined detection rate falls below a predetermined threshold. [5] Method (100) according to one of the preceding claims, wherein the adjusting (106) of the display device of the vehicle as a function of the determined recognition rate of the driver's gaze comprises adjusting a brightness of the display device. [6] Method (100) according to one of the preceding claims, wherein the adjusting (106) of the display device of the vehicle as a function of the determined recognition rate of the driver's gaze comprises adjusting a color composition of the display device of the vehicle. [7] Method (100) according to one of the preceding claims, the method further comprising: If the driver’s gaze recognition rate falls below a specified threshold in the specified time interval: Generating a suggestion message for adjusting the display device by a digital assistant of the vehicle depending on the recognition rate of the gaze of the driver of the vehicle; Providing the suggestion message to the driver of the vehicle through the digital assistant; Receiving a response message in response to the suggestion message from the driver of the vehicle by the digital assistant; and Adjusting the vehicle's display device depending on the vehicle driver's response message. [8] A computer-readable medium for adapting a display device of a vehicle, the computer-readable medium comprising instructions which, when executed on a computer and / or a control device, carry out a method (100) according to any one of claims 1 to 7. [9] System for adapting a display device of a vehicle, the system being designed to carry out a method (100) according to any one of claims 1 to 7. [10] A vehicle comprising a system for adjusting a display device of a vehicle according to claim 9.
Citation Information
Patent Citations
Method and device for adapting image content of a head-up display on a windshield of a vehicle
DE102015007485A1
Driver assistance system and method for adapting the illumination of operating elements in motor vehicles
DE102015219111A1
Device and method for adjusting the polarization direction of a head-up display
DE102019001559A1
Methods for sunglasses analysis and display device adjustment
DE102019209950A1
