Display integration device

Abstract

The invention provides display integration equipment. The display integration equipment comprises a display device, a controller and at least one photographing device, the display device comprises a plurality of display modules and a light absorption module. The display modules include a liquid crystal layer. The light absorption module is arranged on one side of the display modules. The controller is in signal connection with the display device and is used for controlling the display device to display image data. The at least one photographing device is arranged on one side, far away from the display modules, of the light absorption module, is in signal connection with the controller and is used for penetrating through the display devices to capture an image. Therefore, the effectiveness and the accuracy of driver monitoring are ensured.

Description

Technical Field

[0001] This disclosure relates to an integrated device, and more particularly to a display integrated device with a photographic device. Background Technology

[0002] According to relevant data research, human error accounts for 94%-96% of all car accidents. Human error includes speeding, dangerous driving, distracted driving, fatigued driving, drunk driving, and the influence of drugs. Improving driver safety by incorporating driving monitoring systems and providing timely warnings to drivers is a measure that governments worldwide are planning to adopt.

[0003] In addition to providing warnings, suppliers / automakers will further integrate with Advanced Driver Assistance Systems (ADAS) in the future to assist with vehicle control or connect to emergency services when the driver is unresponsive or unable to react. On the other hand, based on Driver Monitoring Systems (DMS) technology, this can be extended to passenger monitoring systems. By analyzing passenger behavior, it can be further linked to various applications in the Intelligent Cockpit, which is also one of the future development directions for automakers and suppliers.

[0004] An In-Cabin Monitoring System (ICMS) is an intelligent system used to monitor the in-vehicle environment, driver status, and passenger behavior. ICMS combines various sensing technologies and artificial intelligence algorithms to improve driving safety, passenger comfort, and drive the development of autonomous driving technology; it is an important component of current ADAS (Advanced Driver Assistance Systems).

[0005] However, most current ICMS cameras are exposed, meaning drivers can see them filming while driving. This makes drivers feel monitored and uncomfortable about their privacy being violated. Therefore, many drivers deliberately cover the cameras to avoid computer system monitoring, leading to numerous traffic accidents caused by human error.

[0006] Some manufacturers in the industry are evaluating the use of Organic Light-Emitting Diodes (OLEDs) or Liquid Crystal Displays (LCDs) in Under-Display Cameras (UDCs). However, both have an opaque thin-film transistor (TFT) metal layer and a black matrix (BM) on the color filter (CF) side. Combined with the transmittance of the polarizer or CF color resist, this results in excessively low transmittance.

[0007] Therefore, it can be seen that there is currently a lack of displays on the market that have high transmittance in the infrared (IR) band, can mount a camera behind the display, and will not affect the normal display of the display in the visible light band. Therefore, relevant manufacturers are seeking solutions. Summary of the Invention

[0008] The purpose of this disclosure is to provide a display integration device that, by mounting a camera behind a display with high infrared transmittance, ensures driver visual comfort and the effectiveness and accuracy of driver monitoring.

[0009] An embodiment of the structural implementation of this disclosure provides a display integration device, including a display unit, a controller, and at least one photographic device. The display unit includes a plurality of display modules and a light-absorbing module. Each display module includes a liquid crystal layer. The light-absorbing module is disposed on one side of the display modules. The controller is signal-connected to the display unit and used to control the display unit to display image data. The at least one photographic device is disposed on the side of the light-absorbing module away from the display modules and is signal-connected to the controller, used to capture an image through the display unit.

[0010] Other embodiments of the foregoing implementation are as follows: each of these display modules has a transmittance of more than 15% in the infrared wavelength range.

[0011] Other embodiments of the aforementioned implementation are as follows: at least one photographic device is disposed in at least one through hole of the light absorption module.

[0012] Other embodiments of the aforementioned implementation are as follows: the photographic device is an infrared camera, and the display device is a cholesterol liquid crystal display.

[0013] Other embodiments of the foregoing implementation are as follows: Each of these display modules further includes two transparent conductive layers and two protective layers. The transparent conductive layers are respectively disposed on two sides of the liquid crystal layer. The two protective layers are respectively disposed on the two sides of the two transparent conductive layers away from the liquid crystal layer.

[0014] Other embodiments of the foregoing implementation are as follows: The light-absorbing module includes a light-absorbing layer. The light-absorbing layer is used to absorb visible light that penetrates these display modules. The light-absorbing layer is made of an infrared-permeable material.

[0015] Other embodiments of the aforementioned implementation are as follows: these display modules are stacked and each displays a different color.

[0016] Another embodiment of the structural implementation of this disclosure provides a display integration device, including a display device, a controller, and at least one photographic device. The display device includes a liquid crystal layer and a light-absorbing module. The liquid crystal layer includes a plurality of pixels. The light-absorbing module is disposed on one side of the liquid crystal layer. The controller is signal-connected to the display device and used to control the display device to display image data. The at least one photographic device is disposed on the side of the light-absorbing module away from the display device and is signal-connected to the controller, used to capture an image through the display device.

[0017] Other embodiments of the foregoing implementation are as follows: These pixels include a plurality of first pixels, a plurality of second pixels, and a plurality of third pixels. The first pixels are spaced apart from each other. The second pixels are spaced apart from each other. The third pixels are spaced apart from each other. The first pixels, second pixels, and third pixels are arranged in parallel sequence and each displays a different color.

[0018] Other embodiments of the aforementioned implementation are as follows: the transmittance of the liquid crystal layer in the infrared wavelength range is greater than 15%.

[0019] Other embodiments of the aforementioned implementation are as follows: at least one photographic device is disposed in at least one through hole of the light absorption module.

[0020] Other embodiments of the aforementioned implementation are as follows: the photographic device is an infrared camera, and the display device is a cholesterol liquid crystal display.

[0021] Other embodiments of the foregoing implementation are as follows: The display device further includes two transparent conductive layers and two protective layers. The two transparent conductive layers are respectively disposed on two sides of the liquid crystal layer. The two protective layers are respectively disposed on the two sides of the two transparent conductive layers away from the liquid crystal layer.

[0022] Other embodiments of the foregoing implementation are as follows: The light absorption module includes a light absorption layer. The light absorption layer is used to absorb visible light that penetrates the liquid crystal layer. The light absorption layer is made of an infrared-permeable material. Attached Figure Description

[0023] Figure 1 This is a schematic diagram illustrating a display integration device according to a first embodiment of the present disclosure;

[0024] Figure 2This is a block connection diagram illustrating a first embodiment of the display integration device of the present disclosure;

[0025] Figure 3 This is a schematic diagram illustrating the application of the display integration device according to the first embodiment of the present disclosure;

[0026] Figure 4A This is a schematic diagram illustrating a display device according to a first embodiment of the present disclosure;

[0027] Figure 4B This is a schematic diagram illustrating a display device according to a second embodiment of the present disclosure; and

[0028] Figure 5 This is a schematic diagram illustrating a display integration device according to a third embodiment of the present disclosure.

[0029] The reference numerals in the attached figures are explained as follows:

[0030] 100, 100a: Display integrated device

[0031] 110: Display device

[0032] 111: Display Module

[0033] 1111,1111b,1111g,1111r: Liquid crystal layer

[0034] 1112: Transparent conductive layer

[0035] 1113: Protective layer

[0036] 112: Light Absorption Module

[0037] 113: Optical adhesive layer

[0038] 120: Controller

[0039] 130: Photographic Device

[0040] 131: Lens

[0041] B: Third pixel

[0042] G: Second pixel

[0043] L: Visible light

[0044] R: First pixel Detailed Implementation

[0045] Several embodiments of this disclosure will be described below with reference to the accompanying drawings. For clarity, many practical details will be set forth in the following description. However, it should be understood that these practical details should not be used to limit the scope of this disclosure. That is, in some embodiments of this disclosure, these practical details are not essential. Furthermore, for the sake of simplicity, some conventional structures and elements will be illustrated in the drawings in a simple schematic manner; and repeated elements may be denoted by the same reference numerals.

[0046] Furthermore, in this document, when a component (or unit or module, etc.) is "connected" to another component, it can mean that the component is directly connected to the other component, or that the component is indirectly connected to the other component, meaning that there is another component between the component and the other component. Only when it is explicitly stated that a component is "directly connected" to another component does it indicate that there is no other component between the component and the other component. The terms "first," "second," and "third" are only used to describe different components and do not limit the components themselves; therefore, "first component" can also be referred to as "second component." Moreover, the combinations of components / units / circuits in this document are not combinations generally known, conventional, or existing in this art. Whether the component / unit / circuit itself is existing cannot be used to determine whether its combination relationship is easily accomplished by a person skilled in the art.

[0047] Please see Figure 1 and Figure 2 As shown, where Figure 1 This is a schematic diagram illustrating a display integration device according to a first embodiment of the present disclosure; Figure 2 This is a block connection diagram illustrating a display integration device according to a first embodiment of the present disclosure. The display integration device 100 includes a display device 110, a controller 120, and at least one camera device 130. The controller 120 is signal-connected to the display device 110, and the camera device 130 is disposed on one side of the display device 110.

[0048] In the first embodiment, the display device 110 may be a cholesteric liquid crystal display; the controller 120 may be a microprocessor, a central processing unit (CPU), a mobile device processor, a cloud processor, or other electronic computing processor; the imaging device 130 may be an infrared camera, an RGB camera, or a 3D time-of-flight (ToF) camera, but the present disclosure is not limited thereto.

[0049] Please see Figure 3 As shown, where Figure 3This is a schematic diagram illustrating the application of the display integration device according to the first embodiment of the present disclosure. The display integration device 100 can be applied to an ICMS (In-Vehicle Management System) to display and monitor the driver or passengers as an in-vehicle display. Furthermore, the display integration device 100 does not necessarily have to be displayed as an in-vehicle display; when fabricated using a flexible substrate such as polyethylene terephthalate (PET), it can also be used as a steering wheel cover or automotive interior cover. Moreover, as... Figure 3 As shown, the integrated display device 100 can be flexibly positioned and can be installed in locations such as the dashboard, steering wheel, left and right A-pillars, front passenger side, or interior rearview mirror (e.g., ...). Figure 3 (Framed area). Among them, the steering column and instrument panel positions, which are directly facing the driver's face, have the best effect, followed by the A-pillar and the rearview mirror.

[0050] Please see Figure 1 and Figure 4A As shown, where Figure 4A This is a schematic diagram illustrating a display device according to a first embodiment of the present disclosure. The display device 110 includes a plurality of display modules 111 and a light-absorbing module 112, the light-absorbing module 112 being disposed on one side of the display modules 111. Furthermore, the display device 110 may also include at least one optical adhesive layer 113 disposed between the display modules 111, the optical adhesive layer 113 being used to bond the display modules 111 together. The display device 110 has a transmittance greater than 15% in the infrared wavelength range.

[0051] Controller 120 controls display device 110 to display image data. Camera 130 is located on the side of light-absorbing module 112 away from display module 111 and is signal-connected to controller 120, capturing an image through display device 110. Camera 130 uses an infrared camera to capture facial and eye information of the driver and passengers in low-light or no-light environments. Infrared cameras are crucial for fatigue detection, attention monitoring, and identification. Camera 130 uses an RGB camera to capture color images of the in-vehicle environment, primarily for passenger behavior monitoring and in-vehicle status recognition. Camera 130 uses a ToF depth camera to detect passenger volume, posture, and position, helping to identify passenger numbers and prevent erroneous movements in seats.

[0052] The display modules 111 are stacked, and visible light L can pass through the stacked display modules 111 and light absorption modules 112 in sequence to reach the camera device 130.

[0053] exist Figure 4A In the middle, the number of display modules 111 is three, and each of the three display modules 111 contains a liquid crystal layer (e.g., Figure 4AThe display module 111 comprises a liquid crystal layer 1111b, 1111g, 1111r that can reflect blue, green, and red light respectively, two transparent conductive layers 1112, and two protective layers 1113. The two transparent conductive layers 1112 of each display module 111 are respectively disposed on two sides of the liquid crystal layers 1111b, 1111g, and 1111r. The two protective layers 1113 of each display module 111 are respectively disposed on the two sides of the two transparent conductive layers 1112 away from the liquid crystal layers 1111b, 1111g, and 1111r. In the first embodiment, the transparent conductive layer 1112 may be made of a transparent conductive material such as indium tin oxide (ITO) or indium zinc oxide (IZO); the protective layer 1113 may be made of a flexible transparent organic material such as glass, PET, or polyimide (PI), but this disclosure is not limited thereto.

[0054] The light absorption module 112 includes a light absorption layer. This layer absorbs visible light L that passes through the display module 111 and provides infrared light transmission. The light absorption layer can be made of an infrared-permeable material, either dye-based or coated, so that a lens 131 of the imaging device 130 can be directly positioned behind the light absorption module 112 to capture images. The infrared-permeable material can be an organic dye such as bromine-substituted dye or nitrososubstituted dye, a black organic dye based on aniline or phenothiazine, or a polymer dye such as polyvinyl chloride dye. The light absorption layer can increase its infrared transmission efficiency while maintaining the inherent properties of plastic by adjusting the proportions of different materials during processing.

[0055] It should be noted that, in other possible embodiments, the light-absorbing module may further include a substrate, which may be disposed on one side of the light-absorbing layer and bonded to the lens. In this case, the light-absorbing layer can be made of a dye-based infrared-transmitting material, and the light-absorbing layer can be formed by mixing the dye-based infrared-transmitting material with an optical adhesive and then applying it to the substrate. Furthermore, in other possible embodiments, the light-absorbing module may also include an adhesive layer, which may be disposed on one side of the light-absorbing layer and bonded to the protective layer. The light-absorbing layer can be formed by mixing a dye-based infrared-transmitting material with a substrate such as plastic or ABS (Acrylonitrile Butadiene Styrene) resin.

[0056] To further explain, when the display device 110 uses a cholesteric liquid crystal display, the driving substrate of the cholesteric liquid crystal display has only transparent materials such as ITO or PI in the active area (AA). Therefore, it is a nearly transparent material in both the visible light L and IR bands and does not contain opaque components such as CF, TFT, and polarizers found in LCDs or OLEDs. It is estimated that it can achieve a transmittance of 60% in the 700nm to 1000nm band.

[0057] In addition, the cholesterol liquid crystal display has a higher transmittance in the IR band compared to other displays, allowing the camera device 130 to capture images of the driver or passenger through the display device 110 without affecting the normal display function of the display device 110.

[0058] In this way, the display device 110 uses a cholesteric liquid crystal display that allows infrared light to penetrate, enabling the camera device 130 behind it to capture images. This not only ensures the driver's visual comfort but also ensures the effectiveness and accuracy of driver monitoring, realizing real-time monitoring of the vehicle driver and improving driving safety.

[0059] Please see Figure 4B As shown, Figure 4B This is a schematic diagram illustrating a display device according to a second embodiment of the present disclosure. The difference between the display device 110 of the second embodiment and the aforementioned second embodiment is that the display module 111 of the display device 110 has only one set (i.e., a single-layer horizontal structure). The liquid crystal layer 1111 of the display module 111 includes multiple pixels, including multiple first pixels R, multiple second pixels G, and multiple third pixels B. The first pixels R are spaced apart from each other, the second pixels G are spaced apart from each other, and the third pixels B are spaced apart from each other. The first pixels R, second pixels G, and third pixels B are arranged in parallel in sequence and each displays a different color. The first pixels R, second pixels G, and third pixels B can reflect blue, green, and red light respectively.

[0060] Please see Figure 5 As shown, Figure 5 This is a schematic diagram illustrating a display integration device according to a third embodiment of the present disclosure. In this third embodiment, the display integration device 100a differs from the display integration device 100 of the first embodiment in the location of the photographic device 130. Specifically, the photographic device 130 is disposed in at least one through-hole of the light-absorbing module 112.

[0061] Furthermore, the lens 131 of the camera device 130 of the integrated display device 100a can be equipped with an anti-reflection coating (AR coating) to avoid reflections and increase the contrast of the display.

[0062] In detail, due to Fresnel reflection, when light passes from air through an uncoated glass substrate, approximately 4% of the light is reflected at each interface, allowing only 92% of the incident light to pass through. Excessive reflected light reduces luminous flux. The anti-reflective coating applied to the lens surface increases the luminous flux of the photographic device 130, reduces surface reflection and scattering, and effectively improves the signal-to-noise ratio (SNR) of the photographic device 130, resulting in clearer images.

[0063] In this way, the display device 110 can be penetrated by infrared light, allowing the camera device 130 behind it to capture images outwards. This not only ensures the driver's visual comfort but also ensures the effectiveness and accuracy of driver monitoring, enabling real-time monitoring of the vehicle driver and improving driving safety.

[0064] It should be noted that the display integration device described in this disclosure is an example of an ICMS, but its application is not limited to this. In other embodiments, the display integration device can be applied to e-books, FACE ID system unlocking, or monitoring the reader's focus, abnormal posture, etc., and providing timely suggestions for rest.

[0065] Furthermore, integrated display devices can also be used in hospital electronic photo frames or display screens, or as an auxiliary system for long-term care to monitor abnormal patient conditions, such as falls or abnormal postures. Moreover, integrated display devices can also serve as electronic advertising windows, determining the displayed advertising content based on the viewer's position, posture, and gaze.

[0066] As can be seen from the above embodiments, the present disclosure has the following advantages: the display device uses a cholesterol liquid crystal display that allows infrared light to penetrate, enabling the camera device behind it to capture images outward. This not only ensures the driver's visual comfort but also does not affect the normal display of the display in the visible light band. It also ensures the effectiveness and accuracy of driver monitoring, realizes real-time monitoring of the vehicle driver, and improves driving safety.

[0067] Although the present disclosure has been described above with reference to embodiments, it is not intended to limit the present disclosure. Any person skilled in the art may make some changes and modifications without departing from the concept and scope of the present disclosure. Therefore, the scope of protection of the present disclosure shall be determined by the appended claims.

Claims

1. A display integration device, characterized in that, Include: A display device, comprising: Multiple display modules, including a liquid crystal layer; and A light absorption module is disposed on one side of the plurality of display modules; A controller, signal-connected to the display device, is used to control the display device to display image data; and At least one photographic device is disposed on the side of the light-absorbing module away from the plurality of display modules and is signal-connected to the controller, and is used to capture an image through the display device.

2. The display integration device as described in claim 1, characterized in that, Each of the plurality of display modules has a transmittance of more than 15% in the infrared wavelength range.

3. The display integration device as described in claim 1, characterized in that, The at least one photographic device is disposed in at least one through-hole of the light-absorbing module.

4. The display integration device as described in claim 1, characterized in that, The photographic device is an infrared camera, and the display device is a cholesterol liquid crystal display.

5. The display integration device as described in claim 1, characterized in that, Each of the plurality of display modules further includes: Two transparent conductive layers are respectively disposed on both sides of the liquid crystal layer; and Two protective layers are respectively disposed on the two sides of the two transparent conductive layers away from the liquid crystal layer.

6. The display integration device as described in claim 1, characterized in that, The light absorption module includes: A light-absorbing layer is used to absorb visible light that penetrates the multiple display modules; The light-absorbing layer is made of an infrared-permeable material.

7. The display integration device as described in claim 1, characterized in that, The multiple display modules are stacked and each displays a different color.

8. A display integration device, characterized in that, Include: A display device, comprising: A liquid crystal layer containing multiple pixels; and A light absorption module is disposed on one side of the liquid crystal layer; A controller, signal-connected to the display device, is used to control the display device to display image data; and At least one photographic device is disposed on the side of the light-absorbing module away from the display device and is signal-connected to the controller, and is used to capture an image through the display device.

9. The display integration device as described in claim 8, characterized in that, The plurality of pixels includes: Multiple first pixels are set at intervals between them; Multiple second pixels, spaced apart from each other; and Multiple third pixels, spaced apart from each other; The plurality of first pixels, the plurality of second pixels, and the plurality of third pixels are arranged in parallel in sequence and each displays a different color.

10. The display integration device as claimed in claim 8, characterized in that, The liquid crystal layer has a transmittance of more than 15% in the infrared wavelength range.

11. The display integration device as claimed in claim 8, characterized in that, The at least one photographic device is disposed in at least one through-hole of the light-absorbing module.

12. The display integration device as claimed in claim 8, characterized in that, The photographic device is an infrared camera, and the display device is a cholesterol liquid crystal display.

13. The display integration device as claimed in claim 8, characterized in that, The display device also includes: Two transparent conductive layers are respectively disposed on both sides of the liquid crystal layer; and Two protective layers are respectively disposed on the two sides of the two transparent conductive layers away from the liquid crystal layer.

14. The display integration device as claimed in claim 8, characterized in that, The light absorption module includes: A light-absorbing layer is used to absorb visible light that penetrates the liquid crystal layer; The light-absorbing layer is made of an infrared-permeable material.

Images