Display device and electronic device with 3D camera module

Abstract

The present invention provides a display device and electronic device with a 3D camera module, including a display panel and a 3D camera module; the display panel has a light exit area and a light entrance area penetrating in the thickness direction; the 3D camera module includes a depth camera module located on the backlight side of the display panel; the depth camera module includes a laser and an imaging module; the laser is used to emit laser light so that the laser light passes through the light exit area and irradiates the object to be photographed; the imaging module is used to receive the incident laser light from the light entrance area after being reflected by the object to be photographed, and obtain a depth image of the surface of the object to be photographed according to the incident laser light. The present invention can set the depth camera module on the backlight side of the display panel, so that there is no need to set a non-display area in the top area of ​​the display device to install the depth camera module, and thus will not affect the beauty and full-screen experience of the display device.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a display device and an electronic device with a 3D camera module. Background Art

[0002] With the development of the market, consumers have increasingly stringent requirements for the display effects of display screens, requiring not only diversified appearance designs, but also the higher the screen-to-body ratio, the better. Full-screen technology achieves a screen-to-body ratio of more than 90% through ultra-narrow bezels or even bezel-free designs. It maximizes the display area without changing the body, making the display effect even more amazing. In the existing full-screen-based structural design, in order to install devices such as the depth camera module in the 3D camera module, a non-display area, i.e., a bangs area, is set at the top of the display panel. However, this still affects the aesthetics of the display device and the full-screen experience. Summary of the invention

[0003] In view of the defects in the prior art, an object of the present invention is to provide a display device with a 3D camera module.

[0004] A display device with a 3D camera module provided by the present invention comprises a display panel and a 3D camera module;

[0005] The display panel has a light exiting area and a light entering area penetrating along a thickness direction;

[0006] The 3D camera module includes a depth camera module located on the backlight side of the display panel;

[0007] The depth camera module includes a laser and an imaging module;

[0008] The laser is used to emit laser light, so that the laser light passes through the light emitting area and then irradiates the object to be photographed;

[0009] The imaging module is used to receive incident laser light from the light incident area after being reflected by the object to be photographed, and obtain a depth image of the surface of the object to be photographed according to the incident laser light.

[0010] Preferably, the depth camera module includes a light splitting device located between the laser and the display panel;

[0011] The beam splitter is used to split the laser light emitted by the laser into a plurality of randomly distributed laser beams.

[0012] Preferably, the depth camera module includes a driving circuit connected to the laser and the imaging module;

[0013] The driving circuit is used to control the laser and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser by controlling the driving current of the laser.

[0014] Preferably, the imaging module is a first imaging module;

[0015] The first imaging module obtains a depth image of the surface of the object to be photographed according to the received spot pattern of the laser reflected by the object to be photographed.

[0016] Preferably, an optical lens is provided between the light splitting device and the display panel;

[0017] The optical lens is used to collimate the laser.

[0018] Preferably, the imaging module is a second imaging module;

[0019] The second imaging module obtains a depth image of the surface of the object to be photographed according to the time delay or phase difference of the laser light reflected by the object to be photographed.

[0020] Preferably, a diffuser is provided between the light splitting device and the display panel;

[0021] The diffuser is used to diffuse the laser and make the laser emit in a flood light.

[0022] Preferably, the depth camera module includes a processing module; the 3D camera module also includes a 2D imaging module;

[0023] The 2D imaging module is used to capture a 2D image of the object to be captured;

[0024] The processing module is used to obtain a 3D image of the object to be photographed according to the depth image and the 2D image.

[0025] Preferably, the light exit area and the light entrance area adopt a light-transmitting structure of any of the following shapes:

[0026] - Single through hole;

[0027] - a through hole matrix formed by a plurality of through holes;

[0028] - A light-transmitting structure formed by multiple interconnected through holes

[0029] - Single light transmission channel;

[0030] - A light-transmitting structure formed by multiple interconnected light-transmitting channels;

[0031] - A light-transmitting structure formed by connecting through holes and through channels.

[0032] Preferably, the spectroscopic device is a nanophotonic chip, a diffraction grating or a coded structure photomask.

[0033] The electronic equipment provided by the present invention comprises the above-mentioned display device.

[0034] Compared with the prior art, the present invention has the following beneficial effects:

[0035] The display device with a 3D camera module provided by the present invention has a laser that emits laser light so that the laser light passes through the light exiting area and irradiates the object to be photographed, and the imaging module is used to receive the incident laser light from the light entrance area after being reflected by the object to be photographed. Therefore, the depth camera module can be set on the backlight side of the display panel, so that there is no need to set a non-display area in the top area of ​​the display device to install the depth camera module, which will not affect the aesthetics and full-screen experience of the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0037] Figure 1 A schematic diagram of the structure of a display device provided by an embodiment of the present invention;

[0038] Figure 2 A schematic diagram of the structure of a display device provided in a variation of the present invention;

[0039] Figure 3 A schematic diagram of the structure of another display device provided by an embodiment of the present invention;

[0040] Figure 4 A schematic structural diagram of a display device provided in a specific embodiment of the present invention;

[0041] Figure 5 is a spot diagram of multiple laser beams in an embodiment of the present invention;

[0042] Figure 6 A schematic structural diagram of a display device provided in another specific embodiment of the present invention;

[0043] Figure 7 (a), (b), and (c) are schematic diagrams of a through hole matrix formed by a plurality of through holes in an embodiment of the present invention;

[0044] Figure 8 (a) and (b) are schematic diagrams of a light-transmitting structure formed by a plurality of through holes in an embodiment of the present invention. DETAILED DESCRIPTION

[0045] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several variations and improvements may be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0046] As described in the background technology, in the existing full-screen based structural design, in order to install devices such as the depth camera module in the 3D camera module, a non-display area, namely the bangs area, is set at the top area of ​​the display panel. However, this will affect the aesthetics of the display device and the full-screen experience.

[0047] Based on this, the present invention provides a display device with a 3D camera module to overcome the above problems existing in the prior art, including a display panel and a 3D camera module;

[0048] The 3D camera module includes a depth camera module located on the backlight side of the display panel;

[0049] The depth camera module includes a laser and an imaging module;

[0050] The laser is used to emit laser light, so that the laser light passes through the light emitting area on the display panel and then irradiates the object to be photographed;

[0051] The imaging module is used to receive the laser light that is reflected by the object to be photographed and passes through the light incident area of ​​the display panel, and obtain a depth image of the surface of the object to be photographed according to the laser light.

[0052] The display device with a 3D camera module provided by the present invention has a laser that emits laser light so that the laser light passes through the light exiting area and irradiates the object to be photographed, and the imaging module is used to receive the incident laser light from the light entrance area after being reflected by the object to be photographed. Therefore, the depth camera module can be set on the backlight side of the display panel, so that there is no need to set a non-display area in the top area of ​​the display device to install the depth camera module, which will not affect the aesthetics and full-screen experience of the display device.

[0053] The above is the core idea of ​​the present invention. In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical scheme in one embodiment of the present invention will be clearly and completely described below in conjunction with the drawings in one embodiment of the present invention. Obviously, the described embodiment is only a part of the embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0054] An embodiment of the present invention provides a display device with a 3D camera module, such as Figure 1 As shown, it includes a display panel 10 and a 3D camera module, wherein the display panel 30 has a light exit area and a light entrance area penetrating along the thickness direction; the 3D camera module includes a depth camera module located on the backlight side of the display panel 10. It should be noted that the depth camera module in one embodiment of the present invention is an infrared camera module, and the laser is an infrared laser that emits infrared laser.

[0055] The light-emitting side of the display panel is the side that can display images, and the backlight side is the side that cannot display images. That is, the depth camera module in one embodiment of the present invention can be located below the display panel 10, that is, can be set below the screen, and there is no need to dig a hole in the non-display area at the top of the display panel 10 to set the depth camera module.

[0056] In one embodiment of the present invention, the depth camera module includes a laser 11 and an imaging module 12. The laser 11 and the imaging module 12 are both located on the backlight side of the display panel 10, and the light outlet of the laser 11 is arranged toward the display panel 10 so that the laser can pass through the light outlet area on the display panel 10 to illuminate the object to be photographed located on the light outlet side of the display panel 10, and the light inlet of the imaging module 12 is arranged toward the display panel 10 so that the laser reflected by the object to be photographed passes through the light outlet area on the display panel 10 and enters the imaging module 12.

[0057] In one embodiment of the present invention, the light exiting area and the light incident area adopt a light-transmitting structure of any of the following shapes:

[0058] - Single through hole;

[0059] - A through-hole matrix formed by multiple through-holes, such as Figure 7 (a) Figure 7 (b) Figure 7 (c) as shown;

[0060] - A light-transmitting structure formed by multiple interconnected through holes

[0061] - Single light transmission channel;

[0062] - A light-transmitting structure formed by multiple interconnected light-transmitting channels, such as Figure 8 (a) as shown;

[0063] - A light-transmitting structure formed by connecting through holes and through channels, such as Figure 8 (b) shown.

[0064] In one embodiment of the present invention, the cross-sectional diameter of the single through hole is less than 2 mm. In a preferred embodiment of the present invention, the cross-sectional diameter of the single through hole is 1 mm.

[0065] Figure 2 A structural schematic diagram of a display device provided in a variation of the present invention is shown in FIG. Figure 2 As shown, the extending directions of the light exiting area and the light incident area are perpendicular to a side surface of the display panel 10 .

[0066] In a preferred embodiment of the present invention, the extension direction of the single through hole forms a certain angle with a side surface of the display panel 10 , and the angle may be 30°, 45° or 60°.

[0067] In one embodiment of the present invention, a reflective layer is coated on the inner wall surfaces of the light exit area and the light entrance area to achieve total reflection of the laser light on the inner wall surfaces of the light exit area and the light entrance area. For example, a metal layer or a high-reflective coating. The metal may be aluminum, silver, gold, copper or another highly reflective metal.

[0068] Among them, the laser 11 is used to emit laser so that the laser passes through the display panel and then irradiates the object to be photographed; the imaging module 12 is used to receive the laser reflected by the object to be photographed and passed through the display panel 10, and obtain a depth image of the surface of the object to be photographed based on the laser, and the depth image includes depth information of different areas of the surface of the object to be photographed.

[0069] Furthermore, since the laser 11 and the imaging module 12 are both arranged on the backlight side of the display panel 10, there are many possibilities for the arrangement and combination of the laser 11 and the imaging module 12. Without affecting the aesthetics, the distance between the laser 11 and the imaging module 12 can be increased to improve the shooting accuracy of the depth camera module.

[0070] Alternatively, if Figure 3 As shown, the depth camera module also includes a spectrometer 13 located between the display panel 10 and the laser 11, and the spectrometer 13 is used to split the laser light emitted by the laser 11 into a plurality of randomly distributed laser beams.

[0071] In one embodiment of the present invention, Figure 1 , Figure 2 as well as Figure 3 As shown, the depth camera module includes a driving circuit 14 connected to the laser 11 and the imaging module 12. The driving circuit 14 is used to control the laser 11 and the imaging module 12 to be turned on or off at the same time, and to control the output optical power of the laser 11 by controlling the driving current of the laser 11, so as to control the optical power of the laser passing through the display panel 10 by controlling the output optical power of the laser 11.

[0072] Furthermore, the depth camera module also includes a processing module 15, and the 3D camera module also includes a 2D imaging module. The 2D imaging module is used to capture a 2D image of the object to be captured. The processing module 15 is used to obtain a 3D image of the object to be captured based on the depth image captured by the 3D camera module and the 2D image captured by the 2D imaging module.

[0073] It should be noted that if the depth camera module is placed below the screen, i.e., on the backlight side of the display panel 10, in order to obtain an image of the object to be photographed (taking a human face as an example) above the screen, i.e., on the light emitting side of the display panel 10, the laser emitted by the depth camera module must pass through the display panel 10, be reflected by the object to be photographed, pass through the display panel 10 twice, and then be received by the imaging module 12.

[0074] Since the transmittance of the display panel 10 to the laser is very low, the transmittance of the general OLED display panel 10 to the infrared laser is less than 5%, and even the specially designed and processed OLED display panel 10 to the infrared laser transmittance is only 30%, and the comprehensive transmittance after passing through the screen twice is only 30%*30%=9%. Therefore, the output optical power of the existing VCSEL laser must be increased by more than 10 times to make the depth camera module work normally. Therefore, it is necessary to open a light-emitting area and a light-incoming area on the display panel 10 for the laser to be emitted and incident.

[0075] It should be noted that in order to set the depth camera module on the backlight side of the display panel 10, the driving current can be increased through the driving circuit 14, the pulse width of the laser 11 can be reduced, and the optical power of the laser 11 can be greatly improved while the total pulse energy of the laser 11 remains basically unchanged, thereby meeting the optical power limit for human eye safety.

[0076] In one embodiment of the present invention, Figure 4 As shown, an optical lens 16 is further provided between the light splitting device 13 and the display panel 10; the optical lens 16 is used to collimate the laser and irradiate the collimated laser onto the display panel 10. The imaging module 12 is a first imaging module, and optionally, the first imaging module is an infrared camera. The first imaging module obtains a depth image of the surface of the object to be photographed according to the received spot pattern of the laser reflected by the object to be photographed.

[0077] Specifically, the light splitting device 13 will split the laser light emitted by the laser 11 into a plurality of randomly distributed laser lights. When these laser lights are irradiated on a plane, a Figure 5As shown in the light spot image, when multiple lasers are irradiated onto the object to be photographed, the light spot pattern will be deformed or displaced. After the first imaging module captures the light spot pattern on the surface of the object to be photographed, it will obtain a depth image of the surface of the object to be photographed based on the deformation or displacement of the light spot pattern, that is, obtain the depth information of the uneven surface of the object to be photographed. The processing module 15 can obtain a 3D image of the object to be photographed based on the depth image and the 2D image.

[0078] In another embodiment of the present invention, Figure 6 As shown, a diffuser 17 is further provided between the spectroscopic device 13 and the display panel 10; the diffuser 17 is used to diffuse the laser emitted by the spectroscopic device 13 so that the laser is emitted onto the display panel 10. The imaging module is a second imaging module, and optionally, the second imaging module is a TOF (Time of Flight) camera. The second imaging module obtains a depth image of the surface of the object to be photographed according to the delay or phase difference of the laser reflected by the object to be photographed. In other words, the second imaging module obtains a depth image of the surface of the object to be photographed according to the time difference between the time of emitting the laser and the time of receiving the laser, or according to the phase difference between the emitted laser and the received laser. Afterwards, the processing module 15 can obtain a 3D image of the object to be photographed according to the depth image and the 2D image.

[0079] In an embodiment of the present invention, the spectroscopic device 13 may be a nanophotonic chip, or a diffractive grating (Diffractive Optics Element, DOE) or a coded structured optical mask, etc., but the present invention is not limited thereto.

[0080] The display device with a 3D camera module provided by the present invention has a high output light power of the laser. Even when facing a display panel with a low transmittance, the light power of the laser passing through the display panel is also high. Therefore, the depth camera module can be set on the backlight side of the display panel, thereby eliminating the need to set a non-display area in the top area of ​​the display device to install the depth camera module, thereby not affecting the aesthetics of the display device and the full-screen experience.

[0081] Moreover, in one embodiment of the present invention, the laser 11 adopts an edge emitting laser (EEL), so that only one laser 11 is used to capture a depth image, which is relatively low in cost; in addition, since the laser 11 can be mass-produced, the 3D camera module provided by the embodiment of the present invention can also be mass-produced; thirdly, since the substrate thermal impedance of the (Edge Emitting Laser, EEL) is much smaller than that of the VCSEL laser, the laser 11 and the 3D camera module have better heat dissipation performance.

[0082] In one embodiment of the present invention, the laser 11 may also use a vertical cavity surface emitting laser array (Vertical Cavity Surface Emitting Laser, VCSEL) as a light source.

[0083] An embodiment of the present invention further provides an electronic device, the electronic device comprising the display device provided by any of the above embodiments, the electronic device may be a mobile phone, a tablet computer, a digital camera, etc. The electronic device with a 3D camera module provided by the present invention does not need to set a non-display area in the top area of ​​the display device to install the depth camera module, and has a more beautiful appearance and is more conducive to achieving a full-screen experience.

[0084] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the embodiments can be referred to each other. The above description of the disclosed embodiments enables professionals and technicians in this field to implement or use the present invention. Various modifications to these embodiments will be obvious to professionals and technicians in this field, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown in this article, but will comply with the widest range consistent with the principles and novel features disclosed herein.

[0085] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art may make various modifications or variations within the scope of the claims, which do not affect the essence of the present invention.

Claims

1. A display device having a 3D camera module, It is characterized in that Including display panel and 3D camera module; The display panel has a light exiting area and a light entering area penetrating along a thickness direction; The 3D camera module includes a depth camera module located on the backlight side of the display panel; The depth camera module includes a laser and an imaging module; The laser is used to emit laser light, so that the laser light passes through the light emitting area and then irradiates the object to be photographed; The imaging module is used to receive the incident laser light from the light incident area after being reflected by the object to be photographed, and obtain a depth image of the surface of the object to be photographed according to the incident laser light; The depth camera module includes a driving circuit connected to the laser and the imaging module; The driving circuit is used to control the laser and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser by controlling the driving current of the laser; The driving circuit is used to increase the optical power of the edge emitting laser and reduce the pulse width of the edge emitting laser by increasing the driving current, thereby controlling the total pulse energy of the edge emitting laser to remain unchanged to meet the optical power limit of human eye safety.

2. The display device according to claim 1, It is characterized in that The depth camera module includes a light splitting device located between the laser and the display panel; The beam splitter is used to split the laser light emitted by the laser into a plurality of randomly distributed laser beams.

3. The display device according to claim 2, It is characterized in that The imaging module is a first imaging module; The first imaging module obtains a depth image of the surface of the object to be photographed according to the received spot pattern of the laser reflected by the object to be photographed.

4. The display device according to claim 3, It is characterized in that An optical lens is provided between the light splitting device and the display panel; The optical lens is used to collimate the laser.

5. The display device according to claim 2, It is characterized in that The imaging module is a second imaging module; The second imaging module obtains a depth image of the surface of the object to be photographed according to the time delay or phase difference of the laser light reflected by the object to be photographed.

6. The display device according to claim 5, It is characterized in that A diffuser is provided between the light splitting device and the display panel; The diffuser is used to diffuse the laser and make the laser emit in a flood light.

7. The display device according to claim 1, It is characterized in that The depth camera module includes a processing module; the 3D camera module also includes a 2D imaging module; The 2D imaging module is used to capture a 2D image of the object to be captured; The processing module is used to obtain a 3D image of the object to be photographed according to the depth image and the 2D image.

8. The display device according to claim 1, It is characterized in that The light exiting area and the light entering area adopt a light-transmitting structure of any of the following shapes: - Single through hole; - a through hole matrix formed by a plurality of through holes; - A light-transmitting structure formed by multiple interconnected through holes - Single light transmission channel; - A light-transmitting structure formed by multiple interconnected light-transmitting channels; - A light-transmitting structure formed by connecting through holes and through channels.

9. An electronic device, It is characterized in that A display device comprising any one of claims 1 to 8.

Images