Display device and electronic device with 3D camera module

Abstract

The present invention provides a display device and electronic device with a 3D camera module, including a display panel and a 3D camera module; the 3D camera module includes a depth camera module located on the backlight side of the display panel; the depth camera module includes a floodlight source and an imaging module; the floodlight source is used to emit floodlight so that the floodlight penetrates the display panel and irradiates the object to be photographed; the imaging module is used to receive the floodlight reflected by the object to be photographed and penetrates the display panel, and obtain a depth image of the surface of the object to be photographed according to the delay or phase difference of the floodlight. In the present invention, since the output light power of the edge-emitting laser and the LED light source in the floodlight light source is relatively high, the depth camera module can be set on the backlight side of the display panel, which will not affect the aesthetics and full-screen experience of the display device.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a display device and an electronic device with a 3D camera module. Background Art

[0002] With the development of the market, consumers have increasingly stringent requirements for the display effects of display screens, requiring not only diversified appearance designs, but also the higher the screen-to-body ratio, the better. Full-screen technology achieves a screen-to-body ratio of more than 90% through ultra-narrow bezels or even bezel-free designs. It maximizes the display area without changing the body, making the display effect even more amazing. In the existing full-screen-based structural design, in order to install devices such as the depth camera module in the 3D camera module, a non-display area, i.e., a bangs area, is set at the top of the display panel. However, this still affects the aesthetics of the display device and the full-screen experience. Summary of the invention

[0003] In view of the defects in the prior art, an object of the present invention is to provide a display device with a 3D camera module.

[0004] A display device with a 3D camera module provided by the present invention includes a display panel and a 3D camera module;

[0005] The 3D camera module includes a depth camera module located on the backlight side of the display panel;

[0006] The depth camera module includes a floodlight source and an imaging module;

[0007] The floodlight source is used to emit floodlight, so that the floodlight penetrates the display panel and irradiates the object to be photographed;

[0008] The imaging module is used to receive the floodlight reflected by the object to be photographed and penetrating the display panel, and obtain a depth image of the surface of the object to be photographed according to the time delay or phase difference of the floodlight.

[0009] Preferably, the floodlight source comprises a beam splitter, a diffuser and an edge-emitting laser;

[0010] The edge emitting laser is used to emit laser light;

[0011] The light splitting device is located at the light emitting side of the edge emitting laser, and is used to split the laser light emitted by the edge emitting laser into a plurality of randomly distributed laser beams;

[0012] The diffuser is arranged on the light-emitting side of the light-splitting device, and is used to diffuse the multiple laser beams, and make the multiple laser beams flood-emitted to the display panel and then irradiated onto the object to be photographed;

[0013] The imaging module is used to receive the floodlight reflected by the object to be photographed and penetrating the display panel, and obtain a depth image of the surface of the object to be photographed according to the delay or phase difference of the received floodlight reflected by the object to be photographed.

[0014] Preferably, the floodlight source is an LED light source.

[0015] Preferably, the depth camera module comprises a driving circuit connected to the edge emitting laser and the imaging module;

[0016] The driving circuit is used to control the edge emitting laser and the imaging module to be turned on or off simultaneously, and to control the output optical power of the edge emitting laser by controlling the driving current of the edge emitting laser.

[0017] Preferably, the light entrance of the imaging module is arranged toward the display panel, so that the laser reflected by the object to be photographed penetrates the display panel and then enters the imaging module.

[0018] Preferably, the light outlet of the floodlight source is arranged toward the display panel, so that the laser light can penetrate the display panel and illuminate the object to be photographed located on the light outlet side of the display panel.

[0019] Preferably, the depth camera module includes a processing module; the 3D camera module also includes a 2D imaging module;

[0020] The 2D imaging module is used to capture a 2D image of the object to be captured;

[0021] The processing module is used to obtain a 3D image of the object to be photographed according to the depth image and the 2D image.

[0022] Preferably, the areas of the display panel corresponding to the floodlight source and the imaging module are all display areas;

[0023] Alternatively, the areas of the display panel corresponding to the floodlight source and the imaging module are all non-display areas.

[0024] Preferably, the area of ​​the display panel corresponding to the floodlight source is a display area, and the area corresponding to the imaging module is a non-display area;

[0025] Alternatively, the area of ​​the display panel corresponding to the floodlight source is a non-display area, and the area of ​​the display panel corresponding to the imaging module is a display area.

[0026] The electronic device provided by the present invention comprises the display device with the 3D camera module.

[0027] Compared with the prior art, the present invention has the following beneficial effects:

[0028] The display device and electronic device with a 3D camera module provided by the present invention have a high output light power of the edge-emitting laser or LED light source in the floodlight light source. Even when facing a display panel with low transmittance, the light power of the laser penetrating the display panel is also high. Therefore, the depth camera module can be set on the backlight side of the display panel, thereby eliminating the need to set a non-display area on the top of the display device to install the depth camera module, thereby not affecting the aesthetics of the display device and the full-screen experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0030] Figure 1 A schematic diagram of the structure of a display device provided by an embodiment of the present invention;

[0031] Figure 2 A schematic diagram of the structure of another display device provided by an embodiment of the present invention;

[0032] Figure 3 (a) is a graph showing the optical power and current of a VCSEL laser provided in an embodiment of the present invention;

[0033] Figure 3 (b) is a graph showing the optical power and current of an EEL laser provided by an embodiment of the present invention;

[0034] Figure 4 1 is a spot diagram of multiple laser beams in an embodiment of the present invention.

[0035] In the figure:

[0036] 10 is a display panel; 11 is an edge-emitting laser; 12 is an imaging module; 13 is a spectrometer; 14 is a driving circuit; 15 is a processing module; and 16 is a diffuser. DETAILED DESCRIPTION

[0037] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several variations and improvements may be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0038] As described in the background technology, in the existing full-screen based structural design, in order to install devices such as the depth camera module in the 3D camera module, a non-display area, i.e., a bangs area, is set on the top of the display panel. However, this will affect the aesthetics of the display device and the full-screen experience.

[0039] The inventors have found that existing depth camera modules all use vertical cavity surface emitting lasers (VCSEL) as light sources. However, since the output light power of the VCSEL laser is low, when the transmittance of the display panel is low, the light power of the laser after penetrating the display panel is low, and an effective depth image cannot be obtained. Therefore, it is necessary to set a non-display area, i.e., a bangs area, on the top of the display panel, and to dig a hole in the non-display area to install the VCSEL laser.

[0040] Based on this, the present invention provides a display device with a 3D camera module to overcome the above problems in the prior art, including a display panel and a 3D camera module;

[0041] The 3D camera module includes a depth camera module located on the backlight side of the display panel;

[0042] The depth camera module includes a floodlight source and an imaging module;

[0043] The floodlight source is used to emit floodlight, so that the floodlight penetrates the display panel and irradiates the object to be photographed;

[0044] The imaging module is used to receive the floodlight reflected by the object to be photographed and penetrating the display panel, and obtain a depth image of the surface of the object to be photographed according to the time delay or phase difference of the floodlight.

[0045] The display device with a 3D camera module provided by the present invention, the floodlight source includes an edge-emitting laser or an LED light source. Since the output light power of the edge-emitting laser and the LED light source is relatively high, even when facing a display panel with a low transmittance, the light power of the laser penetrating the display panel is also relatively high. Therefore, the depth camera module can be arranged on the backlight side of the display panel, thereby eliminating the need to set a non-display area on the top of the display device to install the depth camera module, thereby not affecting the aesthetics of the display device and the full-screen experience.

[0046] The above is the core idea of ​​the present invention. In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in combination with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0047] An embodiment of the present invention provides a display device having a 3D camera module, such as Figure 2 As shown, it includes a display panel 10 and a 3D camera module, and the 3D camera module includes a depth camera module located on the backlight side of the display panel 10. It should be noted that the depth camera module in the embodiment of the present invention is an infrared camera module, and the laser is an infrared laser that emits infrared laser.

[0048] The light-emitting side of the display panel is the side that can display images, and the backlight side is the side that cannot display images. That is, the depth camera module in the embodiment of the present invention can be located below the display panel 10, that is, can be set below the screen without destroying the structure of the display panel 10, such as without digging a hole in the non-display area at the top of the display panel 10 to set the depth camera module.

[0049] In the embodiment of the present invention, the floodlight source includes an edge emitting laser (EEL) 11. The edge emitting laser 11 and the imaging module 12 are both located on the backlight side of the display panel 10, and the light outlet of the edge emitting laser 11 is arranged toward the display panel 10 so that the laser can penetrate the display panel 10 and illuminate the object to be photographed located on the light outlet side of the display panel 10, and the light inlet of the imaging module 12 is arranged toward the display panel 10 so that the laser reflected by the object to be photographed can penetrate the display panel 10 and enter the imaging module 12.

[0050] Among them, the edge emitting laser 11 is used to emit laser so that the laser penetrates the display panel and then irradiates the object to be photographed; the imaging module 12 is used to receive the laser reflected by the object to be photographed and penetrates the display panel 10, and obtain a depth image of the surface of the object to be photographed based on the laser, and the depth image includes depth information of different areas of the surface of the object to be photographed.

[0051] Since the output optical power of the edge-emitting laser is relatively high, even when facing a display panel with low transmittance, the optical power of the laser penetrating the display panel is also relatively high. Therefore, the depth camera module can be set on the backlight side of the display panel, thereby eliminating the need to set a non-display area on the top of the display device to install the depth camera module, thereby not affecting the aesthetics of the display device and the full-screen experience.

[0052] Furthermore, since the edge emitting laser 11 and the imaging module 12 are both arranged on the backlight side of the display panel 10, there are many possibilities for the arrangement and combination of the edge emitting laser 11 and the imaging module 12. Without affecting the aesthetics, the distance between the edge emitting laser 11 and the imaging module 12 can be increased to improve the shooting accuracy of the depth camera module.

[0053] The floodlight source further includes a beam splitter 13 located between the display panel 10 and the edge emitting laser 11 , and the beam splitter 13 is used to split the laser light emitted by the edge emitting laser 11 into a plurality of randomly distributed laser beams.

[0054] In a variation of the present invention, the floodlight source adopts an LED light source. Since the light emitted by the LED light source is floodlight, the beam splitter and the diffuser can be omitted. In addition, since the LED light source has a high luminous efficiency, the emitted floodlight can also penetrate the display panel 10.

[0055] In the embodiment of the present invention, Figure 2 As shown, the depth camera module includes a driving circuit 14 connected to the edge emitting laser 11 and the imaging module 12. The driving circuit 14 is used to control the edge emitting laser 11 and the imaging module 12 to be turned on or off at the same time, and to control the output optical power of the edge emitting laser 11 by controlling the driving current of the edge emitting laser 11, so as to control the optical power of the laser penetrating the display panel 10 by controlling the output optical power of the edge emitting laser 11.

[0056] Furthermore, the depth camera module also includes a processing module 15, and the 3D camera module also includes a 2D imaging module. The 2D imaging module is used to capture a 2D image of the object to be captured. The processing module 15 is used to obtain a 3D image of the object to be captured based on the depth image captured by the 3D camera module and the 2D image captured by the 2D imaging module.

[0057] It should be noted that if the depth camera module is placed below the screen, i.e., on the backlight side of the display panel 10, in order to obtain an image of the object to be photographed (taking a human face as an example) above the screen, i.e., on the light emitting side of the display panel 10, the laser emitted by the depth camera module must pass through the display panel 10, be reflected by the object to be photographed, pass through the display panel 10 twice, and then be received by the imaging module 12.

[0058] Since the transmittance of the display panel 10 to the laser is very low, the transmittance of a general OLED display panel 10 to an infrared laser is less than 5%. Even a specially designed and processed OLED display panel 10 has a transmittance of only 30% to the infrared laser, and the comprehensive transmittance after passing through the screen twice is only 30%*30%=9%. Therefore, the output light power of the existing VCSEL laser must be increased by more than 10 times to enable the depth camera module to work normally.

[0059] However, the output optical power of VCSEL lasers cannot be increased by more than 10 times. Figure 3 As shown, Figure 3The optical power-current curves of the edge-emitting laser 11, namely the EEL laser and the VCSEL laser, are shown in FIG. 1 . Since the VCSEL laser is prone to heat up when the driving current is large, its output optical power decreases with the increase of the driving current, so that its maximum optical power is only 10 mW, and the optical power of the laser emitted by it after penetrating the display panel 10 is low. In other words, the existing VCSEL laser cannot ensure the normal operation of the depth camera module arranged on the backlight side of the display panel 10 by increasing the output optical power. Figure 3 As shown, the output optical power of the edge-emitting laser 11 will increase with the increase of the driving current, and its maximum peak output optical power can reach tens of W. Therefore, a depth camera module can be set on the backlight side of the display panel 10, that is, the non-display area on the top, i.e., the bangs area, can be omitted to improve the aesthetics of the display device and the full-screen experience.

[0060] It should be noted that, in the embodiment of the present invention, the area of ​​the display panel 10 corresponding to the floodlight source is a display area or a non-display area, that is, the floodlight source can emit laser from the area of ​​the display panel 10 having structures such as pixels, i.e., the display area, or can emit laser from the area of ​​the display panel 10 having a black matrix, i.e., the non-display area, and the present invention is not limited to this.

[0061] It should also be noted that, in the embodiment of the present invention, the areas of the display panel 10 corresponding to the floodlight source and the imaging module 12 are all display areas, or the areas corresponding to the floodlight source and the imaging module 12 are all non-display areas, or the area corresponding to the floodlight source is the display area and the area corresponding to the imaging module 12 is the non-display area, or the area corresponding to the floodlight source is the non-display area and the area corresponding to the imaging module 12 is the display area.

[0062] Of course, it should also be noted that, regardless of whether the area corresponding to the floodlight source and the imaging module 12 is a display area or a non-display area, in order to increase the transmittance of the laser and improve the imaging effect of the depth image, special design and processing can be performed in the area of ​​the display panel 10 corresponding to the floodlight source, and special design and processing can be performed in the area of ​​the display panel 10 corresponding to the imaging module 12. The special design and processing here include making the array substrate of the display panel 10 transparent, or reducing the density of the metal wiring on the display panel 10 to improve the transparency of the area, etc. Of course, the present invention is not limited to this.

[0063] It should be noted that in order to set the depth camera module on the backlight side of the display panel 10, the driving current can be increased through the driving circuit 14, the pulse width of the edge emitting laser 11 can be reduced, and the optical power of the edge emitting laser 11 can be greatly improved while the total pulse energy of the edge emitting laser 11 is basically kept unchanged to meet the optical power limit for human eye safety.

[0064] In the embodiment of the present invention, the light splitting device 13 will split the laser light emitted by the edge emitting laser 11 into a plurality of randomly distributed laser lights. When these laser lights are irradiated on a plane, a Figure 4 The spot image shown.

[0065] In an embodiment of the present invention, a diffuser 16 is further provided between the spectroscopic device 13 and the display panel 10; the diffuser 16 is used to diffuse the laser emitted by the spectroscopic device 13 so that the laser floodlight is emitted onto the display panel 10. Optionally, the imaging module is a TOF (Time of Flight) camera. The imaging module obtains a depth image of the surface of the object to be photographed based on the delay or phase difference of the laser reflected by the object to be photographed. In other words, the imaging module obtains a depth image of the surface of the object to be photographed based on the time difference between the time of emitting the laser and the time of receiving the laser, or based on the phase difference between the emitted laser and the received laser. Afterwards, the processing module 15 can obtain a 3D image of the object to be photographed based on the depth image and the 2D image.

[0066] In the embodiment of the present invention, the spectroscopic device 13 may be a nanophotonic chip, or a diffractive grating (Diffractive Optics Element, DOE) or a coded structured optical mask, etc., but the present invention is not limited thereto.

[0067] The display device with a 3D camera module provided by the present invention has a high output light power of the edge-emitting laser. Even when facing a display panel with a low transmittance, the light power of the laser penetrating the display panel is also high. Therefore, the depth camera module can be set on the backlight side of the display panel, thereby eliminating the need to set a non-display area on the top of the display device to install the depth camera module, thereby not affecting the aesthetics of the display device and the full-screen experience.

[0068] Moreover, compared with a 3D camera module using a VCSEL laser array, the 3D camera module in the embodiment of the present invention only uses one edge emitting laser 11 to capture depth images, and the cost is relatively low; in addition, since the edge emitting laser 11 can be mass-produced, the 3D camera module provided by the embodiment of the present invention can also be mass-produced; thirdly, since the substrate thermal impedance of the edge emitting laser 11 is much smaller than that of the VCSEL laser, the edge emitting laser 11 and the 3D camera module have better heat dissipation performance.

[0069] An embodiment of the present invention further provides an electronic device, which includes the display device provided by any of the above embodiments, and the electronic device can be a mobile phone, a tablet computer, a digital camera, etc. The electronic device with a 3D camera module provided by the present invention does not need to set a non-display area on the top of the display device to install the depth camera module, and the appearance is more beautiful and more conducive to achieving a full-screen experience.

[0070] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the embodiments can be referred to each other. The above description of the disclosed embodiments enables professionals and technicians in this field to implement or use the present invention. Various modifications to these embodiments will be obvious to professionals and technicians in this field, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown in this article, but will comply with the widest range consistent with the principles and novel features disclosed herein.

[0071] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art may make various modifications or variations within the scope of the claims, which do not affect the essence of the present invention.

Claims

1. A display device having a 3D camera module, characterized in that: Including display panel and 3D camera module; The 3D camera module includes a depth camera module located on the backlight side of the display panel; The depth camera module includes a floodlight source and an imaging module; The floodlight source is used to emit floodlight, so that the floodlight penetrates the display panel and irradiates the object to be photographed; the transmittance of the display panel to the infrared laser is no more than 5% or 30%; The imaging module is used to receive the floodlight reflected by the object to be photographed and penetrating the display panel, and obtain a depth image of the surface of the object to be photographed according to the delay or phase difference of the floodlight; The floodlight source includes a beam splitter, a diffuser, and an edge-emitting laser; The edge emitting laser is used to emit laser light; The light splitting device is located at the light emitting side of the edge emitting laser, and is used to split the laser light emitted by the edge emitting laser into a plurality of randomly distributed laser beams; The diffuser is arranged on the light-emitting side of the light-splitting device, and is used to diffuse the multiple laser beams, and make the multiple laser beams flood-emitted to the display panel and then irradiated onto the object to be photographed; The imaging module is used to receive the floodlight reflected by the object to be photographed and penetrating the display panel, and obtain a depth image of the surface of the object to be photographed according to the delay or phase difference of the received floodlight reflected by the object to be photographed; The depth camera module includes a driving circuit connected to the edge emitting laser and the imaging module; The driving circuit is used to control the edge emitting laser and the imaging module to be turned on or off at the same time, and to control the output optical power of the edge emitting laser by controlling the driving current of the edge emitting laser; The driving circuit is used to increase the optical power of the edge emitting laser and reduce the pulse width of the edge emitting laser by increasing the driving current, thereby controlling the total pulse energy of the edge emitting laser to remain unchanged to meet the optical power limit of human eye safety.

2. The display device with a 3D camera module according to claim 1, characterized in that: The floodlight source is an LED light source.

3. The display device with a 3D camera module according to claim 1, characterized in that: The light entrance of the imaging module is arranged toward the display panel, so that the laser reflected by the object to be photographed can enter the imaging module after penetrating the display panel.

4. The display device with a 3D camera module according to claim 1, characterized in that: The light outlet of the floodlight source is arranged toward the display panel, so that the laser light can penetrate the display panel and illuminate the object to be photographed located on the light outlet side of the display panel.

5. The display device with a 3D camera module according to claim 1, characterized in that: The depth camera module includes a processing module; the 3D camera module also includes a 2D imaging module; The 2D imaging module is used to capture a 2D image of the object to be captured; The processing module is used to obtain a 3D image of the object to be photographed according to the depth image and the 2D image.

6. The display device with a 3D camera module according to claim 1, characterized in that: The areas of the display panel, the floodlight source and the imaging module corresponding to each other are all display areas; Alternatively, the areas of the display panel corresponding to the floodlight source and the imaging module are all non-display areas.

7. The display device with a 3D camera module according to claim 1, characterized in that: The area of ​​the display panel corresponding to the floodlight source is a display area, and the area corresponding to the imaging module is a non-display area; Alternatively, the area of ​​the display panel corresponding to the floodlight source is a non-display area, and the area of ​​the display panel corresponding to the imaging module is a display area.

8. An electronic device, characterized in that: A display device with a 3D camera module comprising any one of claims 1 to 7.

Images