Device and method for adjusting the brightness of a vehicle display unit

Abstract

In a device and method for determining a driver's focus area, an image depicting a section of the vehicle's interior is captured, and corresponding image data is generated and processed. Based on this image data, at least when sunlight enters the vehicle's interior, a first brightness level of the light incident on a first area of ​​the display unit's screen and a second brightness level of the light incident on a second area of ​​the display unit's screen are determined. Based on the determined first brightness level, the display unit's brightness is adjusted for the first area. Based on the determined second brightness level, the display unit's brightness is adjusted for the second area.

Description

[0001] The invention relates to a device and a method for adjusting the brightness of a vehicle's display unit. An image depicting an area of ​​the vehicle's interior is captured, and corresponding image data is generated and processed.

[0002] DE 10 2007 032 494 A1 discloses a device for dimming at least one mirror in a vehicle. Light sensors, designed as CCD image sensors, CMOS image sensors and / or video cameras, are used to detect the brightness.

[0003] DE 10 2011 088 760 A1 discloses a display device with a display surface and a light sensor integrated into the display device. The light sensor can, for example, comprise a photodiode or a photoresistor.

[0004] WO 2003 / 082 621 A1 discloses the detection of a glare effect of a display in a vehicle using a light sensor, wherein the light sensor detects a brightness value.

[0005] DE 10 2021 100 578 A1 discloses that, depending on where the sun is positioned opposite a vehicle and which windows are provided, a first area can be created in the interior of the vehicle which is illuminated by light coming in from outside, and a second area which is unilluminated by the incoming light.

[0006] Especially when sunlight only illuminates part of a display area of ​​a display unit, it is difficult for a driver to correctly perceive all the information displayed on the display unit.

[0007] The object of the invention is to provide a device and a method for adjusting the brightness of a vehicle display unit, by which the brightness of the display unit can be easily adjusted.

[0008] This problem is solved by a device having the features of claim 1 and by a method having the features of the independent method claim. Advantageous embodiments are specified in the dependent claims.

[0009] Using the device with the features of claim 1, a first brightness for a first area of ​​the display surface and a second brightness in the second area of ​​the display surface can be easily adjusted depending on the sunlight incident on the display surface, so that the driver can easily and correctly perceive the displayed information. In particular, the brightness is adjusted such that, to display the same information, the brightness of the pixels in the first area of ​​the display unit is greater than the brightness of the pixels in the second area of ​​the display unit when sunlight is detected on the first area and not on the second area.

[0010] Another advantage is the energy savings in the vehicle when a display unit is brightly illuminated in only one area and not in the other. Displaying different brightness levels can also be applied to illuminated buttons and illuminated design elements in the vehicle in the same energy-saving manner.

[0011] The interior camera is an interior camera integrated into the interior rearview mirror and / or its housing. The interior camera is positioned and oriented in such a way that the display unit is not shown in the illustration. The interior rearview mirror can be an optical mirror or a display mirror in which an image captured by a camera is displayed on a screen. This allows an interior camera already integrated into the vehicle's rearview mirror for other purposes to be used to adjust the brightness of the display unit.

[0012] Furthermore, it is advantageous if the processing unit is configured to detect a shadow cast by sunlight inside the vehicle and, based on this detected shadow, to determine the first and second areas of the display area of ​​the display unit. The processing unit can also determine the brightness caused by sunlight in the first and second areas of the display area. Alternatively or additionally, the processing unit can be configured to check whether the detected shadow actually falls on the display area of ​​the display unit. If so, the processing unit can further check whether the shadow falls only on a portion of the display area.The processing unit can then identify the area of ​​the display surface where the shadow falls as the first area and the remaining part of the display surface as the second area. The brightness in the first area is then lower than in the second area. This allows the differently illuminated areas of the display surface due to sunlight to be easily determined, and the brightness of the targeted pixels of the display unit to be controlled accordingly, so that a uniformly clear image is displayed for a viewer, such as the driver or passenger.

[0013] It is advantageous if the processing unit is designed to detect the cast shadow outside the display area of ​​the display unit and to extrapolate the path of the cast shadow inside the vehicle onto the display area of ​​the display unit. This allows for the simple identification of the area of ​​the display surface onto which the extrapolated cast shadow falls as the first area and the remaining part of the display surface as the second area. This makes it easy to determine the areas of the display surface illuminated differently due to sunlight and to control the brightness of the corresponding pixels of the display unit accordingly, so that a uniformly clear image is displayed for a viewer, such as the driver or passenger.

[0014] It is also advantageous if the processing unit is equipped to determine the cast shadow on the display area of ​​the display unit based on the image data using a machine learning model. This allows the areas of the display surface illuminated with varying brightness due to sunlight to be easily identified, and the brightness of the targeted pixels of the display unit to be controlled accordingly, ensuring a uniformly clear and easily perceptible image for the viewer, such as the driver or passenger.

[0015] Furthermore, it is advantageous if the processing unit is designed to determine a shadow boundary as a line or plane between direct sunlight and the areas in the vehicle's interior shaded by the cast shadow, based on the image data. This allows the first and second areas of the display surface to be easily determined from the shadow boundary.

[0016] It is particularly advantageous if the processing unit is designed to determine the shadow boundary outside the display area of ​​the display unit based on the image data and to extrapolate the shadow boundary within the display area of ​​the display unit. This allows the first and second areas of the display surface to be determined easily and reliably.

[0017] Furthermore, the processing unit can be configured to determine the shadow boundary on the display area of ​​the display unit based on the image data using a machine learning model. This also allows the first and second areas of the display surface to be determined easily and reliably.

[0018] It is advantageous if the processing unit is designed to determine the brightness in the interior within an area affected by a cast shadow and the brightness in an area not affected by a cast shadow. Based on these brightness levels, the unit can then determine the first brightness of the light incident on a first area of ​​the display surface and the second brightness of the light incident on a second area of ​​the display surface. This makes it easy to determine the brightness of the light falling on the display surface.

[0019] Furthermore, the vehicle's interior camera can be configured to capture at least one video sequence with several consecutively recorded images, particularly an image of an area of ​​the vehicle interior encompassing at least part of the driver's seat, and to generate image data corresponding to the images in the video sequence. This allows changes in the angle of incidence of sunlight into the vehicle's interior to be easily determined and the brightness of the pixels to display information to be continuously adjusted.

[0020] It is advantageous if the processing unit is configured to control the display unit in such a way that the pixels assigned to the first display area have a first brightness level, and the pixels assigned to the first display area have a second brightness level. This allows the brightness in the display area of ​​the display unit to be adjusted so that a uniformly perceptible image is displayed for the viewer.

[0021] It is also advantageous if the processing unit is designed to use a machine learning model to determine, based on the image data, the first brightness of the light incident on a first area of ​​the display unit's screen and the second brightness of the light incident on a second area of ​​the display unit's screen. This allows the brightness levels to be determined simply and reliably.

[0022] The interior camera can be, for example, an infrared camera, an RGB camera, an IR-RGB camera, and / or a time-of-flight (TOF) camera. This allows for high-quality capture of environmental data, making it easy to monitor a specific viewing area. Combining multiple camera types further enhances image quality. Using IR images is advantageous because these images are independent of ambient light. An RGB-IR camera combines the ability to be independent of ambient light with the ability to provide RGB information when visible light is available. Furthermore, an RGB-IR camera allows for the easy separation of display illumination (RGB spectrum) and the IR light from the sun. This makes it simple and reliable to detect shadows and the effects of lighting within the vehicle's interior, allowing for the clear differentiation of light sources.

[0023] The method with the features of the dependent method claim has the same advantages as the claimed device. In particular, the method can be further developed with the features of the dependent claims directed to the device and the aforementioned embodiments.

[0024] The embodiments are explained in more detail below with reference to the figures. These show: Fig. 1. A perspective schematic representation of a vehicle cockpit; Fig. 2 the representation of the cockpit according to Fig. 1 with a schematically drawn shadow boundary; and Fig. 3. A camera-captured image of a vehicle interior view.

[0025] Fig. Figure 1 shows a perspective schematic representation of a cockpit 100 of a vehicle 102. A driver 104 is seated in the driver's seat of the vehicle 102, which is hidden for the sake of simplicity. The cockpit 100 also includes a central information display 108 designed as a touchscreen and a head-up display 110 with a variety of display areas for showing a variety of information.

[0026] The Head-Up Display 110 is located above the dashboard 114 of the vehicle 102 and projects information across the entire width of the windshield 130 of the vehicle 102. Important driving data is displayed directly in the driver's field of vision 104. This includes, in particular, the current gear position (P) in display area 116, the current speed of the vehicle 102 (0 km / h) in display area 118, and the remaining range (600 km) in display area 120. Other information, such as the outside temperature and weather, is displayed in a display area 112 further away from the driver 104. Entertainment information for the front passenger can also be displayed in an area further away from the driver 104. This information and / or other information can also be displayed in the central information display 108. The driver 104 can also make inputs via this information display 108, such as...Enter destination information for a navigation system and / or configure and / or change vehicle settings.

[0027] The head-up display 110 and the central information display 108 are components of an operating system of the vehicle 102. Such an operating system is marketed by the applicant under the name Panoramic iDrive, whereby the head-up display 110 is also referred to as Panoramic Vision.

[0028] In addition to the Head Up Display 110, the cockpit 100 of the vehicle 102 may also be equipped with a 3D head-up display, which displays navigation instructions and information on driver assistance systems.

[0029] In general, the display elements 108 and 110 each form a functional unit of an output unit of the vehicle 102, which is designed to output information to the driver 104. At least one loudspeaker 120 and at least one microphone 124 of the vehicle 102 are also arranged in the cockpit 100. The loudspeaker 126 forms a functional unit of the output unit, and the microphone 124 forms a functional unit of the input unit. The functional units of the output unit and the input unit can also serve as playback units for audio and / or video playback.

[0030] In the upper area of ​​the windshield 128 of the vehicle 102, an interior rearview mirror 132 and an interior camera 134 integrated into this interior rearview mirror 132 are arranged. The camera 134 is designed and integrated into the rearview mirror 132 in such a way that it captures images depicting at least one area of ​​the interior of the vehicle 102.

[0031] A control unit 138 of the vehicle 102, serving as a processing unit, has data transmission connections via data inputs and outputs 140 to the aforementioned input and output units 108, 110, 122, 124, 126, 134 and to other units of the vehicle 102, for example, to additional cameras, sensors, input and output units, and to additional control units of assistance systems. Furthermore, the control unit 138 can be connected to at least one environmental sensing unit for sensing the environment of the vehicle 102, such as at least one rain sensor, at least one temperature sensor, at least one front camera 144, at least one radar sensor 146, and / or at least one lidar sensor 148. The connections can be wired or wireless and can be established, in particular, using a bus system and / or network.

[0032] The control unit 138 further comprises a communication module 142, which is configured to establish a connection with a telecommunications network, in particular a mobile communications network. This communication module 142 facilitates, in particular, car-to-car and infrastructure-to-car communication. Data can be transmitted to and from the vehicle 102 via this communication module 142, in particular to and / or from a central database and / or processing unit of the vehicle manufacturer and / or a service provider.

[0033] In other embodiments, additional cameras are arranged in the interior of the vehicle 102 in the B-pillars and above the driver 104 and the passenger.

[0034] With the help of the interior camera 134 and the possible additional interior cameras, several images can be recorded one after the other, preferably as an image sequence or video sequence, and corresponding image data can be generated for each image, which are transmitted to the control unit 138 and processed by it.

[0035] The at least one front camera 144 of the vehicle 102 is also preferably designed to capture several successive images, particularly in the form of a video stream, to generate image data corresponding to the images and to transmit this data to the control unit 138.

[0036] The vehicle 102 has at least one driver assistance system, which detects, in particular, the surroundings detection unit (front camera 144, lidar sensor 148 and / or radar sensor 146), other vehicles and / or the current traffic situation in front of or around the vehicle 102. Using the surroundings detection unit and / or other control units, sensors and / or assistance systems, driving data is collected and processed by the control unit 138 to analyze the driving behavior of the driver 104 and / or to determine their level of attention.

[0037] For personalization, the driver can in particular customize the displays in the Head Up Display 110 and / or create their own driving profiles and use their own images as a background for the display units 108, 110.

[0038] The cockpit includes a steering wheel 122, which can be a multifunction steering wheel, in particular with illuminated buttons. The vehicle can also be operated via so-called swipe gestures, which are recognized using images captured by the interior camera 134 and processed as operating inputs.

[0039] Voice commands for controlling the vehicle 102 can be entered via microphone 124 by the driver 104. Speech recognition for identifying these commands can be performed using artificial intelligence and a Large Language Model, enabling the recognition of even more complex voice commands.

[0040] Fig. Figure 2 shows the representation of the cockpit 100 degrees. Fig. 1 with a schematically drawn shadow boundary 160. Elements with the same structure or function have the same reference symbols.

[0041] The shadow boundary 160 is formed by sunlight entering through the left side window and / or rear window of the vehicle 102. The driver 104 casts a shadow, which defines the shadow boundary. In the illustrated embodiment, the area 164 to the right of the shadow boundary is darkened by the cast shadow, while the area 162 to the left of the shadow boundary 160 is brightly illuminated by direct sunlight.

[0042] Due to the cast shadow, the light incident on area 168 of the display surface of display unit 110 is less than the light incident on area 166 of the display surface of display unit 110. Furthermore, due to the cast shadow, the light incident on area 172 of the display surface of display unit 108 is less than the light incident on area 170 of the display surface of display unit 108.

[0043] The interior camera 134 captures at least one video sequence with several consecutively recorded images depicting at least part of the driver's seat 106 in the vehicle interior and generates image data corresponding to the images 200 of the video sequence. The control unit 138 processes the image data and, based on the brightness gradients in the vehicle interior, determines at least one section or part of the shadow boundary 160. An example image 200 of the video sequence is shown in Fig. 3 shown.

[0044] In other embodiments, at least one video sequence with several successively recorded images is captured using a further interior camera of the vehicle 102. This sequence depicts an area of ​​the vehicle interior encompassing at least a part of the cockpit 100 of the vehicle 102 and generates image data corresponding to the images of the video sequence. The control unit 138 processes the image data and, based on the brightness gradients in the vehicle interior, determines at least one section or part of the shadow boundary 160.

[0045] Based on the image data from the interior camera 134, the control unit 138 determines, at least when sunlight enters the vehicle interior, a first brightness of the light incident on a first area 166, 170 of the display surface of the respective display unit 108, 110 and a second brightness of the light incident on a second area 168, 172 of the display surface of the respective display unit 108, 110. When determining the brightness, the control unit 138 can take into account the light emitted by the display units, in particular the light emitted by the display units 108, 110 in areas 166, 168, 170, 172, or the brightness caused by this emitted light, from the total brightness determined from the image data in order to determine the brightness caused by the light incident on the display surface relatively accurately.The distinction between the light / brightness emitted by display units 108 and 110 in areas 166, 168, 170, and 172 can also be easily determined if the interior camera 134 is an RGB-IR camera that captures both IR and RGB images. This allows for a simple differentiation between the illumination of display units 108 and 110 (pixel brightness) in the RGB spectrum and the IR light from the sun by processing the image data. Shadows and the influence of lighting can thus be easily and reliably determined in the interior of vehicle 102, and the light sources can be reliably distinguished.

[0046] If the display units 108, 110 are not located in the area detected by the interior camera 134, the control unit 138 can determine the course of the shadow boundary 160 in the area of ​​the display units 108, 110 and, based on the brightness in the vehicle interior, also the brightness of the light incident on the areas 166, 168, 170, 172.

[0047] Based on the determined brightness levels of the light incident in areas 170 and 172, the control unit 138 controls the brightness of the display unit 108 in such a way that the brightness of the pixels in the first area 170 is increased and / or the brightness of the pixels in the second area 172 is decreased so that an image that is uniformly and easily perceptible to a viewer, such as the driver 104 or the passenger, is displayed on the display unit 108.

[0048] Based on the determined brightness levels of the light incident in areas 166 and 168, the control unit 138 controls the brightness of the display unit 110 in such a way that the brightness of the pixels in the first area 166 is increased and / or the brightness of the pixels in the second area 168 is decreased so that an image that is uniformly and easily perceptible to a viewer, such as the driver 104 or the passenger, is displayed on the display unit 110.

[0049] One advantage of the described embodiments is the energy saving in the vehicle 102 when a display unit 108, 110 is brightly illuminated only in one area 166, 170 and the other area 168, 172 is not. Displaying different brightness levels can also be applied to illuminated buttons and illuminated design elements in the vehicle 102 in the same energy-saving manner.

[0050] In other embodiments, the control unit 138 can determine both the shadow boundary 160 and the brightness in the areas 166, 168, 170, 172 from the image data using a machine learning model.

[0051] Alternatively or additionally, the control unit 138 can extrapolate the further course of the shadow boundary 160 from the course of a part of the shadow boundary 160 visible in the figure and determine the course of the shadow boundary 160 in the area of ​​the display units 108, 110. Based on this, the control unit 138 can then determine the areas 166, 170 that are brightly illuminated by sunlight and the darkened and therefore less brightly illuminated areas 168, 172 of the display surfaces of the display units 108, 110. For this purpose, the control unit 138 can also use a machine learning model.

[0052] Fig. Figure 3 shows a schematic representation of an image 200 of the interior of the vehicle 102, captured by the interior camera 134. The camera 134 has, by way of example, a field of view of 120 degrees. It is particularly advantageous if the camera 134 is an RGB-IR interior camera. In other embodiments, the camera 134 can also have a field of view in the range of 100 degrees to 150 degrees or more. The camera 134 is oriented towards the driver's seat 202, a passenger seat 204, and a rear bench seat of the vehicle 102. In the Fig. In the situation shown in Figure 3, the driver 104 is sitting in the driver's seat 202 and another occupant 206 is sitting in the passenger seat 204. Thus, in the present embodiment, the other occupant is the passenger 206. As already mentioned, the control unit 138 processes the image data of the images 200 taken by the camera 134 and, based on this, determines the shadow boundary 160 as in conjunction with Fig. 2 described.

[0053] Based on the Fig. 1, Fig. 2 to Fig. In the embodiments described in Section 3, at least the camera 134 and the control unit 138 constitute a device for adjusting the brightness of a display unit 108, 110 of a vehicle 102. The control unit 138 is also referred to as the processing unit. Further embodiments described in Section 3 include at least the camera 134, the control unit 138, and a device for adjusting the brightness of a display unit 108, 110 of a vehicle 102. Fig. 1, Fig. 2 to Fig. The three elements and features shown and mentioned in the preceding description can be part of the device. Likewise, process steps described with reference to the device can be part of the claimed process. 100 Cockpit 102 vehicles 104 drivers 108 Central Information Display 110 Head Up Display 112, 116, 118, 120 display areas 114 Dashboard 122 Steering wheel 124 microphones 126 speakers 130 Windscreen 132 Interior rearview mirror 134 Interior camera 138 Control unit 140 data inputs and outputs 142 Communication module 160 shadow line 162, 164 areas 166 to 172 areas 200 images 202 Driver's seat 204 Passenger seat 206 passengers

Claims

[1] Device for adjusting the brightness of a vehicle display unit, with an interior camera (134) arranged in the interior of a vehicle (102), which is configured to capture at least one image (200) depicting an area of ​​the interior of the vehicle (102) and to generate image data corresponding to the image (200), with a processing unit (138) that is trained to process the image data, wherein the processing unit (138) is configured to determine, starting from the image data of the camera (134), at least when sunlight enters the interior of the vehicle (102), a first brightness of the light incident on a first area (166, 170) of the display surface of the display unit (108, 110) and a second brightness of the light incident on a second area of ​​the display surface of the display unit (108, 110), wherein the processing unit (138) is configured to set a first brightness of the display unit (108, 110) in the first area (166, 170) based on the determined first brightness and to set a second brightness of the display unit (108, 110) in the second area (168, 172) based on the determined second brightness, characterized by , that the interior camera is an interior camera (134) integrated in the interior rearview mirror and / or integrated into a housing of the interior rearview mirror (132), wherein the interior camera (134) is arranged and aligned such that the display unit (108, 110) is not shown in the figure. [2] Device according to claim 1, wherein the processing unit (138) is configured to determine a shadow cast by sunlight in the interior of the vehicle (102) and to determine, based on the determined shadow, the first area of ​​the display surface and the second area of ​​the display surface of the display unit (108, 110). [3] Device according to claim 2, wherein the processing unit (138) is configured to determine the drop shadow outside the display area of ​​the display unit (108, 110) and to extrapolate the drop shadow on the display area of ​​the display unit (108, 110). [4] Device according to claim 2 or 3, wherein processing unit (138) is configured to determine the drop shadow on the display area of ​​the display unit (108, 110) from the image data using a machine learning model. [5] Device according to any of the preceding claims 2 to 4, wherein the processing unit is configured to determine, starting from the image data, a shadow boundary (160) as a line or plane between direct sunlight and areas shaded by the cast shadow in the interior of the vehicle (102). [6] Device according to claim 5, wherein the processing unit is configured to determine the shadow boundary (160) outside the display area of ​​the display unit (108, 110) starting from the image data and to extrapolate the shadow boundary (160) on the display area of ​​the display unit (108, 110). [7] Device according to claim 5 or 6, wherein processing unit (138) is configured to determine the shadow boundary (160) on the display area of ​​the display unit (108, 110) from the image data using a machine learning model. [8] Device according to any one of the preceding claims 2 to 7, wherein the processing unit (138) is configured to determine the brightness in the interior in an area affected by the cast shadow and to determine the brightness in the interior in an area not affected by the cast shadow, and from these brightnesses to determine the first brightness of the light incident on a first area (166, 170) of the display surface and the second brightness of the light incident on a second area (168, 172) of the display surface. [9] Device according to one of the preceding claims, wherein the interior camera (134) of the vehicle (102) is configured to capture at least one video sequence with several successively recorded images (200) with an image of an area of ​​the vehicle interior comprising at least a part of a driver's seat (202) and to generate image data corresponding to the images (200) of the video sequence. [10] Device according to one of the preceding claims, wherein the processing unit (138) is configured to control the display unit (108, 110) such that the pixels assigned to the first display area (166, 170) have a first brightness and the pixels assigned to the second display area (168, 172) have a second brightness. [11] Device according to one of the preceding claims, wherein the processing unit (138) is configured to determine, starting from the image data, the first brightness of the light incident on a first area (166, 170) of the display area of ​​the display unit (108, 110) and the second brightness of the light incident on a second area (168, 172) of the display area of ​​the display unit (108, 110) using a machine learning model. [12] Device according to one of the preceding claims, wherein the display unit (108, 110) is a touch display (108) and / or a head-up display (110) and / or wherein the interior camera (134) is an infrared camera and / or an RGB camera and / or a TOF camera. [13] Method for adjusting the brightness of a vehicle display unit, in which an image (200) depicting an area of ​​the vehicle's interior is captured and corresponding image data is generated and processed, and where, starting from the image data, at least when sunlight enters the interior of the vehicle (102), a first brightness of the light incident on a first area (166, 170) of the display surface of the display unit (108, 110) and a second brightness of the light incident on a second area (168, 172) of the display surface of the display unit (108, 110) is determined, and where, starting from the determined first brightness, a first brightness of the display unit (108, 110) is set in the first area (166, 170) and, starting from the determined second brightness, a second brightness of the display unit (108, 110) is set in the second area (168, 172), characterized by , that the image (200) is created using a sensor integrated into the interior rearview mirror and / or integrated into a housing of the interior rearview mirror (132) The interior camera (134) is captured, wherein the interior camera (134) is arranged and aligned such that the display unit (108, 110) is not shown in the figure.

Images