Display device with 3D camera module and electronic device

Abstract

The application provides a display device with a 3D camera module and an electronic equipment, comprising a display substrate and a 3D camera module; the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix area comprises at least two light transmission areas; the 3D camera module comprises a depth camera module located at the backlight side of the black matrix area; the depth camera module comprises a laser module and an imaging module; the laser module is used for emitting laser so that the laser is irradiated onto an object to be photographed through the first light transmission area; the imaging module is used for receiving the laser reflected by the object to be photographed through the second light transmission area and obtaining a depth image of the surface of the object to be photographed according to the laser. The depth camera module is arranged at the backlight side of the black matrix area of the display substrate, so that a non-display area, i.e. a notch area, is not needed to be arranged at the top of the display device to install the depth camera module, and thus the display device is not affected in appearance and full-screen experience.

Description

Technical Field

[0001] This invention relates to the field of display technology, and more specifically, to a display device and electronic device having a 3D camera module. Background Technology

[0002] As the market develops, consumers have increasingly stringent requirements for display effects, demanding not only diverse designs but also higher screen-to-body ratios. Full-screen technology, through ultra-narrow bezels or even borderless designs, achieves screen-to-body ratios exceeding 90%.

[0003] Full-screen phones maximize the display area without changing the body shape, resulting in a more stunning display effect. Existing full-screen structural designs have a non-display area, or notch, at the top of the display substrate to accommodate components such as the depth camera module in 3D camera modules. However, this still affects the aesthetics of the display device and the full-screen experience. Summary of the Invention

[0004] In view of this, the present invention provides a display device and electronic device with a 3D camera module to solve the problem that the non-display area of ​​the existing mounting depth camera module affects the aesthetics of the display device and the full-screen experience.

[0005] To achieve the above objectives, the present invention provides the following technical solution:

[0006] The display device with a 3D camera module provided by the present invention includes a display substrate and a 3D camera module;

[0007] The display substrate includes a display area and a black matrix area surrounding the display area; the black matrix area includes at least two light-transmitting areas.

[0008] The 3D camera module includes a depth camera module located on the backlight side of the black matrix area;

[0009] The depth camera module includes a laser module and an imaging module;

[0010] The laser module is used to emit laser light so that the laser light passes through the first light-transmitting area and illuminates the object to be photographed;

[0011] The imaging module is used to receive the laser reflected by the object to be photographed through the second light-transmitting area, and to obtain a depth image of the surface of the object to be photographed based on the laser.

[0012] Preferably, the light-transmitting area is provided with an infrared film layer;

[0013] The laser module is used to emit infrared laser light so that the infrared laser light passes through an infrared film layer and a light-transmitting area and illuminates the object to be photographed.

[0014] The imaging module employs an infrared camera to receive infrared laser light reflected from the object to be photographed through another infrared film layer and another light-transmitting area, and to obtain a depth image of the surface of the object to be photographed based on the infrared laser light.

[0015] Preferably, the depth camera module includes a beam splitter and a projection lens located between the laser module and the display substrate;

[0016] The beam splitter is used to split the laser emitted by the laser module into multiple randomly distributed laser beams;

[0017] The projection lens is used to focus the multiple laser beams onto the display substrate and then project the multiple laser beams onto the object to be photographed.

[0018] Preferably, the depth camera module includes a collimating lens, a reflective device, a beam splitter, and a projection lens located between the laser module and the display substrate;

[0019] The collimating lens is used to collimate the incident laser and output a collimated beam.

[0020] The reflecting device is used to refract the collimated beam and project it onto the beam splitter;

[0021] The beam splitter is used to split the collimated beam projected by the reflector into multiple randomly distributed laser beams.

[0022] The projection lens is used to focus the multiple laser beams onto the display substrate and then project the multiple laser beams onto the object to be photographed.

[0023] Preferably, the depth camera module includes a driving circuit connected to the laser module and the imaging module;

[0024] The driving circuit is used to control the laser module and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser module by controlling the driving current of the laser module.

[0025] Preferably, the imaging module is a first imaging module;

[0026] The first imaging module is used to obtain a depth image of the surface of the object to be photographed based on the received laser spot pattern reflected by the object.

[0027] Preferably, the imaging module is a second imaging module;

[0028] The second imaging module is used to obtain a depth image of the surface of the object to be photographed based on the delay or phase difference of the laser light reflected by the object.

[0029] Preferably, a diffuser is provided between the beam splitter and the projection lens;

[0030] The diffuser is used to diffuse the laser and cause the laser beam to be emitted in floodlight.

[0031] Preferably, the laser module uses any of the following lasers:

[0032] -Vertical cavity surface-emitting laser array;

[0033] -Emitting laser;

[0034] - Semiconductor laser.

[0035] The electronic device provided according to the present invention is characterized in that it includes the aforementioned display device.

[0036] Compared with the prior art, the present invention has the following beneficial effects:

[0037] The display device and electronic device with a 3D camera module provided by the present invention place the depth camera module on the backlight side of the black matrix area of ​​the display substrate, thereby eliminating the need to set a non-display area, i.e., a notch area, on the top of the display device to install the depth camera module, thus not affecting the aesthetics of the display device and the full-screen experience;

[0038] In this invention, an infrared film layer is set in the light-transmitting area of ​​the black matrix region. This infrared film layer can transmit infrared light so as not to affect the operation of the depth camera module, but visible light cannot pass through the infrared film layer, thus ensuring the integrity of the black matrix region and not affecting the aesthetics of the display screen.

[0039] In this invention, a beam splitter is split into multiple randomly distributed laser beams by a projection lens and then focused onto the display substrate. These multiple laser beams are then projected onto the object to be photographed, reducing the installation space of the laser module and enabling the application of this invention on narrow-bezel screens (screens with a narrower black matrix area). Attached Figure Description

[0040] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0041] Figure 1 This is a schematic diagram of the structure of a display device according to an embodiment of the present invention;

[0042] Figure 2 This is a schematic diagram of the structure of another display device in an embodiment of the present invention;

[0043] Figure 3 This is a schematic diagram of one installation of the laser module in an embodiment of the present invention;

[0044] Figure 4 This is another schematic diagram of the laser module installation in an embodiment of the present invention;

[0045] Figure 5 This is a schematic diagram of a display device based on a VCSEL laser in an embodiment of the present invention;

[0046] Figure 6 This is a schematic diagram of a display device based on an EEL laser in an embodiment of the present invention;

[0047] Figure 7 This is a schematic diagram of the structure of a display device provided in the first specific embodiment of the present invention;

[0048] Figure 8 This is a schematic diagram of the structure of a display device provided in a second specific embodiment of the present invention;

[0049] Figure 9 This is a laser spot diagram of a multi-beam laser according to an embodiment of the present invention;

[0050] Figure 10 This is a schematic diagram of a display device provided in the third specific embodiment of the present invention.

[0051] In the picture:

[0052] 10 is the display substrate; 11 is the laser module; 12 is the imaging module; 13 is the beam splitter; 14 is the driving circuit; 15 is the processing module; 16 is the projection lens; 17 is the reflector; 18 is the collimating lens; 19 is the diffuser; 20 is the black matrix area; 30 is the display area; 40 is the inner screen. Detailed Implementation

[0053] The present invention will now be described in detail with reference to specific embodiments. These embodiments will help those skilled in the art to further understand the present invention, but do not limit the invention in any way. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention. These all fall within the scope of protection of the present invention.

[0054] It should be noted that when a component is referred to as "fixed to" or "set on" another component, it can be directly on or indirectly on that other component. When a component is referred to as "connected to" another component, it can be directly connected to or indirectly connected to that other component. Furthermore, a connection can be for both fixing and circuit connection purposes.

[0055] It should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", and "outer" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing the embodiments of the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention.

[0056] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of embodiments of the present invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0057] As described in the background section, existing full-screen-based structural designs have a non-display area, or notch area, on the top of the display substrate in order to install devices such as depth cameras in 3D camera modules. However, this affects the aesthetics of the display device and the full-screen experience.

[0058] The inventors discovered that existing depth camera modules all use vertical cavity surface emitting lasers (VCSELs) as light sources. However, due to the low output power of VCSEL lasers, when the transmittance of the display substrate is low, the light power of the laser after passing through the first light-transmitting area is low, and an effective depth image cannot be obtained. Therefore, it is necessary to set a non-display area, i.e., a notch area, on the top of the display substrate, and to make holes in the non-display area to install the VCSEL laser.

[0059] Based on this, the present invention provides a display device with a 3D camera module to overcome the above-mentioned problems existing in the prior art, including a display substrate and a 3D camera module;

[0060] The display substrate includes a display area and a black matrix area surrounding the display area; the black matrix area includes at least two light-transmitting areas.

[0061] The 3D camera module includes a depth camera module located on the backlight side of the black matrix area;

[0062] The depth camera module includes a laser module and an imaging module;

[0063] The laser module is used to emit laser light so that the laser light passes through the first light-transmitting area and illuminates the object to be photographed;

[0064] The imaging module is used to receive laser light reflected from the object to be photographed through the second light-transmitting area, and to obtain a depth image of the surface of the object to be photographed based on the laser light.

[0065] The display device and electronic device with a 3D camera module provided by the present invention place the depth camera module on the backlight side of the black matrix area of ​​the display substrate, thereby eliminating the need to set a non-display area, such as a notch area, on the top of the display device to install the depth camera module, thus not affecting the aesthetics and full-screen experience of the display device.

[0066] The above is the core idea of ​​this invention. To make the above-mentioned objectives, features, and advantages of this invention more apparent and understandable, the technical solutions in the embodiments of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this invention, and not all embodiments. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0067] This invention provides a display device with a 3D camera module, such as... Figure 1 As shown, the system includes a display substrate 10 and a 3D camera module, which includes a depth camera module located on the backlight side of the display substrate 10. It should be noted that the depth camera module in this embodiment is an infrared camera module, and the laser module uses an infrared laser that emits infrared laser light. The laser module employs a vertical-cavity surface-emitting laser array, an edge-emitting laser, and a semiconductor laser.

[0068] In this embodiment, the light-emitting side of the display substrate is the side that can display images, while the backlight side is the side that cannot display images. That is, the depth camera module in this embodiment can be located below the display substrate 10, i.e., below the screen, without damaging the structure of the display substrate 10; for example, it does not require drilling a hole in the non-display area at the top of the display substrate 10 to house the depth camera module. The display substrate includes a display area and a black matrix area surrounding the display area; the black matrix area includes at least two light-transmitting areas. The light-transmitting areas are circular areas with a diameter of less than 1 mm.

[0069] In this embodiment of the invention, the depth camera module includes a laser module 11 and an imaging module 12. Both the laser module 11 and the imaging module 12 are located on the backlight side of the display substrate 10. The light outlet of the laser module 11 faces the display substrate 10, allowing the laser to pass through a first light-transmitting area 10 and illuminate the object to be photographed on the light-emitting side of the display substrate 10. The light inlet of the imaging module 12 faces the display substrate 10, allowing the laser reflected from the object to pass through a second light-transmitting area 10 and enter the imaging module 12.

[0070] The laser module 11 is used to emit a laser so that the laser passes through the first light-transmitting area and illuminates the object to be photographed; the imaging module 12 is used to receive the laser reflected by the object to be photographed through the first light-transmitting area 10, and obtain a depth image of the surface of the object to be photographed based on the laser, the depth image including depth information of different areas of the surface of the object to be photographed.

[0071] Since the laser module and imaging module are located on the backlight side of the black matrix area, there is no need to set up a non-display area on the top of the display device to install the depth camera module, thus not affecting the aesthetics of the display device and the full-screen experience.

[0072] Furthermore, since both the laser module 11 and the imaging module 12 are located on the backlight side of the display substrate 10, there are multiple possibilities for their arrangement and combination. Without affecting aesthetics, the distance between the laser module 11 and the imaging module 12 can be increased to improve the shooting accuracy of the depth camera module, such as... Figure 2 As shown, the laser module 11 and the imaging module 12 can also be set in the black matrix areas on both sides respectively.

[0073] Optionally, the light-transmitting area is provided with an infrared film layer;

[0074] The laser module 11 is used to emit infrared laser so that the infrared laser passes through an infrared film layer and a light-transmitting area and irradiates the object to be photographed.

[0075] The imaging module 12 employs an infrared camera to receive infrared laser light reflected from the object to be photographed through another infrared film layer and another light-transmitting area, and to obtain a depth image of the surface of the object to be photographed based on the infrared laser light.

[0076] Optionally, such as Figure 3 , Figure 7 As shown, the depth camera module also includes a beam splitter 13 and a projection lens 16 located between the display substrate 10 and the laser module 11;

[0077] The beam splitter 13 is used to split the laser emitted by the laser module 11 into multiple randomly distributed laser beams.

[0078] The projection lens 16 is used to focus the multiple laser beams onto the display substrate and then project the multiple laser beams onto the object to be photographed.

[0079] In this embodiment of the invention, the aperture of the multi-beam laser is located on the display substrate 10. The display substrate 10 can be a glass substrate, and the inner side of the display substrate 10 is the inner screen 40 of the display device.

[0080] In embodiments of the present invention, such as Figure 5 and Figure 6 As shown, the depth camera module includes a drive circuit 14 connected to the laser module 11 and the imaging module 12. The drive circuit 14 is used to control the laser module 11 and the imaging module 12 to be turned on or off simultaneously, and to control the output optical power of the laser module 11 by controlling the drive current of the laser module 11, so as to control the optical power of the laser passing through the first light-transmitting area 10 by controlling the output optical power of the laser module 11.

[0081] Furthermore, the depth camera module also includes a processing module 15, and the 3D camera module also includes a 2D imaging module. The 2D imaging module is used to capture 2D images of the object to be photographed. The processing module 15 is used to obtain a 3D image of the object to be photographed based on the depth image captured by the 3D camera module and the 2D image captured by the 2D imaging module.

[0082] It should be noted that in order to place the depth camera module on the backlight side of the display substrate 10, the driving current can be increased by the driving circuit 14, the pulse width of the laser module 11 can be reduced, the optical power of the laser module 11 can be greatly increased, and the total pulse energy of the laser module 11 can be kept basically unchanged, thus meeting the optical power limit for human eye safety.

[0083] In one embodiment of the present invention, such as Figure 4 , Figure 8 As shown, a collimating lens 18 and a reflecting device 17 are also provided between the beam splitter 13 and the laser module 11;

[0084] The collimating lens 18 is used to collimate the incident laser and output a collimated beam.

[0085] The reflective device 17 is used to refract the collimated beam and project it onto the beam splitter 13;

[0086] The beam splitter 13 is used to split the collimated beam projected by the reflector 17 into multiple randomly distributed laser beams.

[0087] The projection lens 16 is used to focus the multiple laser beams onto the display substrate 10 and then project the multiple laser beams onto the object to be photographed.

[0088] In this embodiment of the invention, the reflective device 17 can be a reflective mirror or a triangular prism. A reflective film can be coated on the reflective surface of the triangular prism.

[0089] The imaging module 12 is a first imaging module, optionally an infrared camera. The first imaging module 12 obtains a depth image of the surface of the object to be photographed based on the light spot pattern of the laser reflected from the object.

[0090] Specifically, the beam splitter 13 splits the laser emitted by the laser module 11 into multiple randomly distributed laser beams. When these laser beams irradiate a plane, they form a pattern similar to... Figure 9 As shown in the image, when multiple lasers illuminate the object to be photographed, the spot pattern will deform or shift. After the first imaging module captures the spot pattern on the surface of the object, it will obtain a depth image of the object's surface based on the deformation or shift of the spot pattern, thus obtaining the depth information of the unevenness of the object's surface. The processing module 15 can then obtain a 3D image of the object based on the depth image and the 2D image.

[0091] In another embodiment of the present invention, such as Figure 10 As shown, a diffuser 19 is provided between the beam splitter and the projection lens. The diffuser 19 is used to diffuse the laser and allow the laser floodlight to be emitted. The diffuser 19 is used to diffuse the laser emitted from the beam splitter 13, allowing the laser floodlight to be emitted onto the display substrate 10. The imaging module is a second imaging module, optionally a TOF (Time of Flight) camera. The second imaging module obtains a depth image of the surface of the object to be photographed based on the delay or phase difference of the laser reflected from the object. That is, the second imaging module obtains a depth image of the surface of the object to be photographed based on the time difference between the time of laser emission and the time of laser reception, or based on the phase difference between the emitted and received lasers. Then, the processing module 15 can obtain a 3D image of the object to be photographed based on the depth image and the 2D image.

[0092] In this embodiment of the invention, the beam splitter 13 can be a nanophotonic chip, a diffractive optical element (DOE), or a coded structured photomask, etc., and the invention is not limited to these.

[0093] The display device with a 3D camera module provided by the present invention has a high output light power of the laser module. Even when facing a display substrate with low transmittance, the light power of the laser passing through the first light-transmitting area is also high. Therefore, the depth camera module can be set on the backlight side of the display substrate, so there is no need to set a non-display area on the top of the display device to install the depth camera module, thus not affecting the aesthetics of the display device and the full-screen experience.

[0094] This invention also provides an electronic device, which includes the display device provided in any of the above embodiments. This electronic device can be a mobile phone, tablet computer, or digital camera, etc. The electronic device with a 3D camera module provided by this invention eliminates the need to set a non-display area on the top of the display device to install the depth camera module, resulting in a more aesthetically pleasing appearance and facilitating a full-screen experience.

[0095] The display device and electronic device with a 3D camera module in this embodiment of the invention place the depth camera module on the backlight side of the black matrix area of ​​the display substrate, thereby eliminating the need to set a non-display area (notch) on the top of the display device to install the depth camera module, thus not affecting the aesthetics and full-screen experience of the display device; an infrared film layer is set in the light-transmitting area of ​​the black matrix area. This infrared film layer can transmit infrared light and will not affect the operation of the depth camera module, but visible light cannot pass through the infrared film layer, ensuring the integrity of the black matrix area and not affecting the aesthetics of the display screen; after the beam splitter is divided into multiple randomly distributed laser beams by the projection lens and focused on the display substrate, the multiple laser beams are projected onto the object to be photographed, reducing the installation space of the laser module and realizing the application of the invention on narrow bezel screens (screens with a narrow black matrix area).

[0096] The various embodiments described in this specification are presented in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0097] The various embodiments described in this specification are presented in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0098] The specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art can make various modifications or variations within the scope of the claims, which do not affect the essence of the present invention.

Claims

1. A display device with a 3D camera module, characterized in that, Including display substrates and 3D camera modules; The display substrate includes a display area and a black matrix area surrounding the display area; the black matrix area includes at least two light-transmitting areas. The 3D camera module includes a depth camera module located on the backlight side of the black matrix area; The depth camera module includes a laser module and an imaging module; The laser module is used to emit laser light so that the laser light passes through a light-transmitting area and illuminates the object to be photographed. The imaging module is used to receive the laser reflected by the object to be photographed through another light-transmitting area, and to obtain a depth image of the surface of the object to be photographed based on the laser. The depth camera module includes a beam splitter and a projection lens located between the laser module and the display substrate; The beam splitter is used to split the laser emitted by the laser module into multiple randomly distributed laser beams; the apertures of the multiple laser beams are located on the display substrate; The projection lens is used to focus the multiple laser beams onto the display substrate and then project the multiple laser beams onto the object to be photographed.

2. The display device according to claim 1, characterized in that, The light-transmitting area is provided with an infrared film layer; The laser module is used to emit infrared laser light so that the infrared laser light passes through an infrared film layer and a light-transmitting area and illuminates the object to be photographed. The imaging module is used to receive infrared laser light reflected from the object to be photographed through another infrared film layer and another light-transmitting area, and to obtain a depth image of the surface of the object to be photographed based on the infrared laser light.

3. The display device according to claim 1, characterized in that, The depth camera module includes a collimating lens, a reflective device, a beam splitter, and a projection lens located between the laser module and the display substrate; The collimating lens is used to collimate the incident laser and output a collimated beam. The reflecting device is used to refract the collimated beam and project it onto the beam splitter; The beam splitter is used to split the collimated beam projected by the reflector into multiple randomly distributed laser beams. The projection lens is used to focus the multiple laser beams onto the display substrate and then project the multiple laser beams onto the object to be photographed.

4. The display device according to claim 1, characterized in that, The depth camera module includes a driving circuit connected to the laser module and the imaging module; The driving circuit is used to control the laser module and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser module by controlling the driving current of the laser module.

5. The display device according to claim 1, characterized in that, The imaging module is the first imaging module; The first imaging module is used to obtain a depth image of the surface of the object to be photographed based on the received laser spot pattern reflected by the object.

6. The display device according to claim 1, characterized in that, The imaging module is a second imaging module; The second imaging module is used to obtain a depth image of the surface of the object to be photographed based on the delay or phase difference of the laser light reflected by the object.

7. The display device according to claim 6, characterized in that, A diffuser is provided between the beam splitter and the projection lens; The diffuser is used to diffuse the laser and cause the laser beam to be emitted in floodlight.

8. The display device according to claim 1, characterized in that, The laser module uses any of the following lasers: - Vertical cavity surface-emitting laser array; - Simultaneous laser emission; - Semiconductor lasers.

9. An electronic device, characterized in that, Includes the display device according to any one of claims 1 to 8.

Images