Vehicle display device equipped with a camera

Abstract

The invention describes a vehicle display device equipped with a camera, in which a display comprising MiniLEDs or MicroLEDs is used as display unit. Displays with this active light-emitting design usually have a light-transmitting property due to their structural properties. This light-transmitting property can be advantageously used to take an image of the area (34) in front of the camera by means of a camera (26) arranged behind the display. When taking the camera image with visible light, the light emitted by the display or the display unit (18) can be prevented from interfering with the camera recording by activating the camera (26) and the display unit (18) at different times. Alternatively, the maximum sensitivity spectrum of the camera (26) can be set different from the light output spectrum of the display unit (18). Furthermore, it is also possible to use invisible radiation, for example infrared radiation, for the camera imaging, so that reflections of the light emitted by the display unit (18) in the area (34) in front of the display device (10) are separated from the effective reflections of this area (34) that the camera (26) needs to capture.

Description

Incorporation of priority claims

[0001] This patent application claims priority to German patent application 102023131318.5, filed on November 10, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present invention relates to a vehicle display device equipped with a camera, wherein the display device has a display unit (hereinafter also referred to as a display) that actively emits visible light, and therefore the display device does not have a backlight unit. Background Technology

[0003] To improve vehicle safety, it has long been known that monitoring the vehicle interior is necessary to identify potential safety risks. Specifically, it is known that detecting driver facial features, such as eyelid movements, can help identify potential driver fatigue and trigger appropriate warning signals.

[0004] For a variety of reasons, cameras used for the aforementioned purposes should be integrated into a display device installed in the vehicle's dashboard. In principle, the bezel of the display device is typically designed to accommodate such a camera. However, for visual appeal, the industry trend is to make the bezel of the display device as narrow as possible, leaving insufficient space for a camera. The same applies to the edge areas of the display unit itself, which are typically coated black on the display surface.

[0005] Document US-A-2010 / 0073584 discloses a display device that includes an LCD display and a camera disposed behind the LCD display.

[0006] Document DE-A-102020000347 discloses another electro-optical display in which actively emitting MiniLEDs or MicroLEDs are used as pixels.

[0007] Documents DE-B-102019211967, DE-A-102019114005, DE-A-102019114004, and DE-A-19632381 also disclose other display devices that place the camera behind or within the display area. Summary of the Invention

[0008] The purpose of this invention is to provide a vehicle display device equipped with a camera, which has a simplified structure and higher display quality and camera shooting quality.

[0009] The present invention achieves the above-mentioned objective through a first technical solution, which proposes a vehicle display device equipped with a camera, the display device comprising: - An electro-optical display unit that actively emits visible light, the display unit having a display side and a back side opposite to the display side; - A camera sensitive to invisible light, the camera being arranged facing the back of the display unit; and - At least one invisible light source; - Wherein, the invisible light emitted by the at least one light source is incident on the area in front of the display side of the display unit, and after being reflected by any objects that may exist in that area, passes through the display unit and reaches the camera; and - The display unit comprises MiniLED or MicroLED and is at least partially transparent to visible light.

[0010] The terms "visible light" and "invisible light" mentioned below refer to radiation within the wavelength range visible to the human eye and radiation within the wavelength range invisible to the human eye, respectively.

[0011] In the first technical solution of the present invention, a camera sensitive to invisible light is used, for example, by equipping the camera with a suitable filter. Specifically, the invisible light is infrared radiation.

[0012] A light source emitting invisible light, such as infrared light, is used to illuminate the camera for imaging. The light emitted by this source reaches the area in front of the display unit, that is, the area in front of the display side of the display unit. The display unit itself is an electro-optic device capable of actively emitting visible light; therefore, the display device of the present invention does not require a backlight unit.

[0013] The display unit used in this invention comprises MiniLED or MicroLED and is at least partially transparent to visible light. Such display units are already in the prior art and are characterized by high image quality, offering numerous advantages over traditional LCD displays. MiniLEDs or MicroLEDs can be made of inorganic crystalline semiconductor materials or organic semiconductor materials, with the advantages of such display units being particularly pronounced when inorganic crystalline semiconductor materials are used.

[0014] For example, AU Optronics Corporation of Taiwan provides such a display unit used in this invention.

[0015] These displays present information on the display side by driving a single LED or a single group of RGB LEDs, typically arranged at the intersection of two sets of electrical control lines. Practice has shown that to achieve display quality far exceeding acceptable standards, it is not necessary to have an LED or group of RGB LEDs at every intersection. This means that such displays have so-called "gaps," in which the display is almost transparent to visible light.

[0016] This invention takes advantage of this property, as the aforementioned transparency can significantly improve the imaging quality of the camera, thereby obtaining high-quality captured images.

[0017] As an alternative to the first technical solution of the present invention described above, the present invention proposes a second technical solution: a vehicle display device equipped with a camera, the display device comprising: - An electro-optical display unit that actively emits visible light, the display unit having a display side and a back side opposite to the display side; and - A visible light-sensitive camera, which is arranged facing the back of the display unit; — Wherein, the sensitivity spectrum of the camera differs from the spectrum of visible light emitted by the display unit; and - Light whose spectrum is consistent with or within the sensitivity spectrum of the camera can pass through the display unit and reach the camera from objects that may be present in the area in front of the display side.

[0018] In the second technical solution of the present invention, visible light is used not only to present information on the display side of the monitor, but also for imaging and capturing images with a camera. However, in this case, it is necessary to prevent "crosstalk" between the light emitted by the display unit and the light used for camera capture. In the display device of the second technical solution of the present invention, crosstalk is avoided by making the sensitivity spectrum of the camera different from the emission spectrum of the display unit. Specifically, the wavelength corresponding to the peak sensitivity of the camera is different from the wavelength corresponding to the peak emission of the display unit. This is particularly applicable to RGB radiation, i.e., red, yellow, and blue light. Therefore, in the display device of the second technical solution of the present invention, it is preferably configured such that the sensitivity spectrum of the camera to red, yellow, and blue light, especially the peak values ​​of the sensitivity spectrum of the camera to red, yellow, and blue light, is different from the spectrum of red, yellow, and blue light emitted by the display unit, especially the peak values ​​of the spectrum of red, yellow, and blue light emitted by the display unit.

[0019] For example, the above effect can be achieved by using an optical filter with multiple transmission bands and absorption bands, or by using multiple optical filters, wherein the transmission bands and absorption bands of each filter are different from those of the other filters.

[0020] As described below, the present invention also proposes a third technical solution: a vehicle display device equipped with a camera, which uses "time-division multiplexing" instead of "optical multiplexing". The display device of the third technical solution includes: - An electro-optical display unit that actively emits visible light, the display unit having a display side and a back side opposite to the display side; and - A visible light-sensitive camera, which is arranged facing the back of the display unit; - Wherein, the camera and the display unit can be activated alternately; such that during the time interval when the display unit emits light, the light emitted by the display unit reflected by objects that may exist in the area in front of the display side will not be recorded by the camera, or although it will be recorded by the camera, it will not be processed as a camera image by the camera or downstream processing unit, or the camera image will not be used; while during the time interval when the display unit does not emit light, the ambient light reflected by objects that may exist in the area in front of the display side can reach the camera and be collected by the camera to form a camera image.

[0021] By separating the light-emitting process of the display unit from the imaging and capturing process of the camera in time, it is possible to achieve non-interference between the two, thereby avoiding the generation of "crosstalk".

[0022] As described above, the display unit used in this invention is a visible light display unit, which is basically semi-transparent, with a transmittance of at least about 30%, or about 40%, or about 50%, or about 55%, or about 60% for visible light.

[0023] As mentioned above, the display unit typically has a grid pattern consisting of a first electrical conductor extending parallel to each other and a second electrical conductor extending laterally and parallel to each other; wherein, in the intersection area of ​​the first electrical conductor and the second electrical conductor, a MiniLED or a MicroLED, or a group of three RGB MiniLEDs or three RGB MicroLEDs, or a group of three MiniLEDs equipped with corresponding RGB color filters or three MicroLEDs equipped with corresponding RGB color filters are arranged in about half or one-third of the intersection area; or, there is an intermediate region that is transparent to visible light between adjacent MiniLEDs or MicroLEDs, between adjacent groups of RGB MiniLEDs or RGB MicroLEDs, or between adjacent groups of three MiniLEDs equipped with corresponding RGB color filters or three MicroLEDs equipped with corresponding RGB color filters.

[0024] In the second arrangement of MiniLEDs or MicroLEDs described above, even if all the intersecting areas are occupied by MiniLEDs or MicroLEDs, the transparency of the display unit to visible light can still be guaranteed.

[0025] RGB MiniLED or RGB MicroLED also includes a typical LED structure, in which quantum dots or phosphors are placed on the blue light-emitting LED to "convert" the blue light into yellow or red light.

[0026] As described above, since MiniLEDs or MicroLEDs themselves lack light transmittance, the overall transparency of the display unit is affected to some extent. However, even so, it is still possible to generate camera images of completely satisfactory quality while achieving excellent display effects. By moving the display unit relative to the camera in at least one direction, it is advantageous to stitch together multiple sub-camera images with shadow effects at corresponding LED positions into a single complete camera image. Attached Figure Description

[0027] The invention will now be described in detail with reference to the accompanying drawings. In the drawings: Figure 1 This is an example of the application of a display device according to an exemplary embodiment of the present invention; Figure 2 This is a schematic diagram of key components essential to the present invention in a display device according to an exemplary embodiment of the present invention.

[0028] List of reference numerals 10 Display devices 12 cameras 14. Dashboard 16. Driver, upper body 18 display units 20 Display side of display unit 22 Touch panel 23 Cover glass 24. Back of the display unit 26 cameras 28 Infrared Filter 30 Infrared light source 32 Control Unit 34. Front area of ​​the display device Detailed Implementation

[0029] Figure 1Application examples of the display device for all three technical solutions of the present invention are shown, wherein a camera is arranged behind the display, and the camera may be an infrared-sensitive camera or a visible light-sensitive camera. In this exemplary embodiment, both the display unit and the camera are arranged inside the dashboard 14 of a vehicle, with the camera 12 facing the driver 16. The information extracted from the camera image depends on the specific application and is prior art, therefore it will not be described in detail in this invention.

[0030] Figure 2 The main components of the display device 10 according to three technical solutions of the present invention are shown. The display device 10 includes a MiniLED or MicroLED display unit 18, which has a display side 20 facing the viewer (driver 16 in this exemplary embodiment). A touch panel 22 and a cover glass 23 may be provided on the display side 20, or typically only the cover glass 23 may be provided without the touch panel 22.

[0031] A camera 26, such as a CMOS camera, is arranged near the back surface 24 of the display unit 18 opposite to the display side 20. This camera may be equipped with an infrared filter 28, making it sensitive only to infrared radiation or, more broadly, invisible radiation. In the case of invisible light imaging, at least one invisible radiation or invisible light source 30 is typically also provided behind or below the display unit 18. However, this light source can also be housed within the bezel (not shown) of the display device 10; it should be noted, however, that since the trend in display device development is towards extremely narrow bezels, this arrangement is not a preferred option.

[0032] The display unit 18, the camera 26, and, if present, at least one light source 30 are controlled by an electronic control unit 32, which is also used, for example, to receive and / or process images captured by the camera 26.

[0033] The display unit 18 has a transmittance of at least 45% for visible light, which is determined by the structural design of MiniLED or MicroLED displays. The structure of such displays is prior art and will not be described in detail herein.

[0034] The highly transparent display unit 18 facilitates the camera 26 in capturing images of the area 34 in front of the display device. Combined with... Figure 1In the example shown, camera 26 can capture images of the head and / or upper body of driver 16. For example, visible light from the environment can be used for imaging, which, after being reflected by a viewer (such as driver 16), passes through the transparent display unit and is recorded by camera 26. To avoid crosstalk, more precisely, to prevent light emitted by the MicroLED or MiniLED of display unit 18 from interfering with camera imaging, control unit 32 can alternately activate display unit 18 and camera 26 within continuous time intervals. Alternatively, suitable optical filters or structural design measures can be used to ensure that the wavelength corresponding to the peak sensitivity of camera 26 is different from the emission wavelength of MiniLED or MicroLED of display unit 18. Furthermore, invisible light can also be used for camera imaging to separate the camera imaging exposure from the emission process of display unit 18. All the above technical solutions fall within the protection scope of this invention.

Claims

1. A vehicle display device equipped with a camera, characterized in that, include: - An electro-optical display unit (18) that actively emits visible light, the display unit (18) having a display side (20) and a back side (24) opposite to the display side (20). - A camera (26) sensitive to invisible light, the camera (26) being arranged facing the back (24) of the display unit (18); as well as - At least one invisible light source (30); - In this process, invisible light emitted by at least one light source (30) is incident on an area (34) in front of the display side (20) of the display unit (18), and after being reflected by an object (16) that may exist in this area, passes through the display unit (18) and reaches the camera (26); and - in, The display unit (18) comprises MiniLED or MicroLED and is at least partially transparent to visible light.

2. A vehicle display device equipped with a camera, characterized in that, include: - An electro-optical display unit (18) that actively emits visible light, the display unit (18) having a display side (20) and a back side (24) opposite to the display side (20); and - A visible light sensitive camera (26) is arranged facing the back (24) of the display unit (18); - Wherein, the sensitivity spectrum of the camera (26) is different from the spectrum of visible light emitted by the display unit (18); and - Light whose spectrum is consistent with or within the sensitivity spectrum of the camera can pass through the display unit (18) and reach the camera (26) from objects that may exist in the area in front of the display side (20).

3. The display device according to claim 2, characterized in that, The sensitivity spectrum of the camera (26) to red, yellow and blue light, especially the peak values ​​of the sensitivity spectrum of the camera to red, yellow and blue light, is different from the spectrum of red, yellow and blue light emitted by the display unit (18), especially the peak values ​​of the spectrum of red, yellow and blue light emitted by the display unit (18).

4. The display device according to claim 2 or 3, characterized in that, It includes optical filters having multiple transmission bands and absorption bands, or multiple optical filters, wherein the transmission bands and absorption bands of each optical filter are different from those of the other optical filters.

5. A vehicle display device equipped with a camera, characterized in that, include: - An electro-optical display unit (18) that actively emits visible light, the display unit (18) having a display side (20) and a back side (24) opposite to the display side (20); and - A visible light sensitive camera (26) is arranged facing the back (24) of the display unit (18); - The camera (26) and the display unit (18) can be activated alternately, so that during the time interval when the display unit emits light, the light emitted by the display unit reflected by the object (16) that may exist in the area (34) in front of the display side (20) of the display unit (18) will not be recorded by the camera (26), or although it is recorded by the camera (26), it will not be processed by the camera or the downstream processing unit (32) as a camera image, or the camera image will not be used; while during the time interval when the display unit (18) does not emit light, the ambient light reflected by the object (16) that may exist in the area (34) in front of the display side (20) can reach the camera (26) and be collected by the camera (26) to form a camera image.

6. The display device according to any one of claims 1 to 5, characterized in that, The display unit (18) is substantially semi-transmissive to visible light, and its transmittance to visible light is at least about 30%, or about 40%, or about 50%, or about 55%, or about 60%.

7. The display device according to any one of claims 1 to 6, characterized in that, The display unit (18) has a grid pattern consisting of a first electrical conductor extending parallel to each other and a second electrical conductor extending laterally and parallel to each other; and in the intersection area of ​​the first electrical conductor and the second electrical conductor, a MiniLED or a MicroLED, or a group of three RGB MiniLEDs or three RGB MicroLEDs, or a group of three MiniLEDs equipped with corresponding RGB color filters or three MicroLEDs equipped with corresponding RGB color filters are arranged in about half or one-third of the intersection area.

8. The display device according to any one of claims 1 to 7, characterized in that, The display unit (18) has a grid pattern consisting of a first electrical conductor extending parallel to each other and a second electrical conductor extending laterally and parallel to each other; and there is an intermediate region that is transparent to visible light between adjacent MiniLEDs or MicroLEDs, between adjacent RGB MiniLED groups or RGB MicroLED groups, or between three adjacent MiniLED groups or three MicroLED groups equipped with corresponding RGB color filters.

9. The display device according to claim 7 or 8, characterized in that, The display unit (18) and the camera (26) can move relative to each other in at least one direction, and can stitch together multiple sub-camera images captured during the relative movement to form a complete camera image.

10. The display device according to any one of claims 1 to 9, characterized in that, The MiniLED or MicroLED is made of inorganic crystalline semiconductor material or organic semiconductor material.

Images