Display panel, display terminal and display device

By integrating the image acquisition module in the display panel, converting ambient light into an electrical signal using the lens layer and the second photoelectric conversion unit, combined with the image display function of the first photoelectric conversion unit, the problem of space occupation of the display interface is solved, and the Efficient image display and acquisition improves screen-to-body ratio and user experience.

CN115428063BActive Publication Date: 2024-11-15HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202080099986.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-04-30
Publication Date
2024-11-15
Estimated Expiration
2040-04-30

AI Technical Summary

Technical Problem

In the self-luminous display panel, in order to achieve image acquisition, a front camera needs to be set separately to occupy part of the space of the display interface, resulting in a small screen-to-body ratio of the display interface and the display area cannot be fully utilized.

Method used

The image acquisition module is integrated in the display panel, and the lens layer and the second photoelectric conversion unit convert ambient light into an electrical signal. Combined with the image display function of the first photoelectric conversion unit, the image display and image acquisition are realized in a time-sharing manner, avoiding the The need to set up a camera separately increases the screen-to-body ratio.

Benefits of technology

It realizes a display panel with a large screen-to-body ratio, and can perform image display and image acquisition at the same time, improves the utilization rate and user experience of the display interface, and ensures the quality of the image and the clarity of the acquisition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115428063B_ABST
    Figure CN115428063B_ABST
Patent Text Reader

Abstract

A display panel (11) for improving the screen-to-body ratio and capable of performing image display and image acquisition in a time-sharing manner, the display panel (11) comprising a plurality of pixel units (P) arranged in a matrix, each pixel unit (P) comprising at least one first photoelectric conversion unit (101) for emitting light to display an image. An image acquisition module (13) is arranged between the pixel units (P) in at least a portion of the display area. The image acquisition module (13) comprises a lens layer (131) for acquiring ambient light and a second photoelectric conversion unit (102) for converting the ambient light into an electrical signal, the electrical signal being used to reconstruct an image corresponding to the ambient light. The light emitted by the first photoelectric conversion unit (101) and the electrical signal output by the second photoelectric conversion unit (102) are performed in a time-sharing manner, and the display panel (11) multiplexes the image display and image acquisition functions in a portion of the display area. It also relates to a display terminal and a display device comprising the display panel (11).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image display and image acquisition, and in particular to a display panel, a display terminal and a display device. Background Art

[0002] In the process of displaying images on the self-luminous display panel, in order to realize that the image display interface facing the user can capture images, a separate image capture device is required at the position of the display interface, for example, a front camera needs to be set on the display interface. Obviously, the setting of the front camera will inevitably occupy part of the position of the image display interface, thereby limiting the display area of ​​the display interface and resulting in a small screen-to-body ratio of the display interface. Summary of the invention

[0003] The embodiments of the present application provide a display panel with a large screen-to-body ratio and better image acquisition performance.

[0004] In one implementation of the present application, a display panel is provided, comprising a display area, wherein the display area comprises a plurality of pixel units arranged in a matrix, and each pixel unit comprises at least one first photoelectric conversion unit for emitting light to display an image. An image acquisition module is arranged between the pixel units in the first area within the display area. The image acquisition module comprises a lens layer and a second photoelectric conversion unit, wherein the lens layer is used to transmit ambient light outside the display panel to the second photoelectric conversion unit, and the second photoelectric conversion unit is used to convert the ambient light into an electrical signal in an image acquisition state, and the electrical signal is used to reconstruct an image corresponding to the ambient light, wherein the light emitted by the first photoelectric conversion unit and the electrical signal output by the second photoelectric conversion unit are performed in a time-sharing manner. Thus, the display panel can perform image display and image acquisition in a time-sharing manner, and then the display panel can directly reuse the functions of image display and image acquisition without separately setting up an image acquisition device such as a camera, thereby realizing full-screen display and being able to effectively improve the screen-to-body ratio of the display interface.

[0005] In one implementation of the present application, the first area includes an image display state and an image acquisition state. When the first area is in the image display state, the first photoelectric conversion unit emits light to perform image display, and the second photoelectric conversion unit stops outputting the electrical signal. When the first area is in the image acquisition state, the first photoelectric conversion unit stops emitting light, and the second photoelectric conversion unit converts the ambient light into the electrical signal. The lens layer is a focusing lens, which is used to converge the ambient light and transmit it to the second photoelectric conversion unit. When the first area is in the image acquisition state, the second photoelectric conversion unit receives and collects the converged ambient light provided by the lens layer, and converts the ambient light into an electrical signal.

[0006] In one implementation of the present application, the first photoelectric conversion unit is arranged in parallel with the lens layer in the same layer, and the lens layer is directly opposite to and covers the second photoelectric conversion unit. Since the first photoelectric conversion unit is arranged in parallel with the lens layer in the same layer, the second photoelectric conversion unit is separated from the first photoelectric conversion unit by at least one layer of structure, which can effectively prevent the light emitted by the first photoelectric conversion unit from leaking to the second photoelectric conversion unit.

[0007] In one implementation of the present application, the second conversion unit is a photodetector, and the first conversion unit is a light emitting diode, an organic light emitting diode, or a micro light emitting diode.

[0008] In one implementation of the present application, the lens layer includes a focusing lens state and a plane lens state. When the first area is in an image display state, the first photoelectric conversion unit emits light to display an image, the lens layer is in a plane lens state, and the second photoelectric conversion unit stops converting the ambient light into the electrical signal. When the first area is in an image acquisition state, the first photoelectric conversion unit stops emitting light, the lens layer is in a focusing lens state, and converges and transmits the ambient light to the second photoelectric conversion unit, the second photoelectric conversion unit receives and collects the converged ambient light provided by the lens layer, and converts the ambient light into an electrical signal.

[0009] Since the lens layer can present two states, a focusing lens state and a flat lens state, to adapt to the display panel being in an image display state or an image acquisition state, better image display quality and better acquired image quality are ensured.

[0010] In one implementation of the present application, the display panel further includes a control module, the control module is connected to the lens layer, and the control module is used to output different voltages to the lens layer and control the lens layer to be in a focusing lens state or a plane lens state. When the control module receives a first instruction, the control module outputs a first voltage to the lens layer and controls the lens layer to be in a plane lens state, and the first instruction is used to instruct the first area to display an image. Alternatively, when the control module receives a second instruction, the control module outputs a second voltage to the lens layer and controls the lens layer to be in a focusing lens state, and the second instruction is used to instruct the first area to capture an image. Different voltages are provided to the lens layer according to the instructions corresponding to the image display state and the image capture state, so as to accurately control the refractive index of the lens layer to control the phase of the incident light, and ensure accurate matching with the image display state or image capture state of the display panel.

[0011] In one implementation of the present application, the lens layer is a hyperplane lens. The first voltage controls the phase shift angle of the ambient light entering the hyperplane lens to be 0°, the hyperplane lens is a plane mirror, and the second voltage controls the phase shift angle of the ambient light entering the hyperplane lens to be The hyperplane lens is a condenser lens for converging the ambient light and transmitting it to the second photoelectric conversion unit. The phase shift angle Used to adjust the focal length required for the current captured image. Since the lens layer is a hyperplane lens, the refractive index of the lens layer can be accurately controlled by providing different voltages, thereby achieving control of the incident light phase delay angle. In particular, when the hyperplane lens is a focusing lens, the focal length of the hyperplane lens can be adjusted by controlling the incident light phase delay angle, ensuring that the captured image has a high definition.

[0012] In one implementation of the present application, when the first area has the same shape and area as the display area, the control module receives a first instruction, and the control module provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and controls the second photoelectric conversion unit to stop performing photoelectric conversion. The control module receives a second instruction, and the control module alternately outputs the first voltage and the second voltage according to a preset frequency. The second voltage controls the first photoelectric conversion unit to stop emitting light, controls the lens layer to be in a focusing lens state, and controls the second photoelectric conversion unit to perform photoelectric conversion on the ambient light received from the lens layer after being converged. Among them, since the first area extends to the entire display interface, in order to ensure that the display panel does not affect the user's viewing of the image while performing image acquisition, the preset frequency can be 60HZ, at which the user's visual display interface remains in the image display state, ensuring the user's visual experience.

[0013] In one implementation of the present application, when the first area is smaller than the area of ​​the display area, the control module receives a first instruction, the control module provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and controls the second photoelectric conversion unit to stop performing photoelectric conversion. The control module receives a second instruction, the control module outputs a second voltage, the second voltage controls the first photoelectric conversion unit to stop emitting light, controls the lens layer to be in a focusing lens state, and controls the second photoelectric conversion unit to perform photoelectric conversion on the ambient light received from the lens layer after being converged. The area that multiplexes the image display and image acquisition functions will not affect the image display of the area that only performs image display when performing image display, so that image display and image acquisition can be performed simultaneously on the display panel.

[0014] In one implementation of the present application, when the control module receives the first instruction again, it exits the image acquisition state and enters the image display state. After the display panel completes image acquisition, it exits the image acquisition state by receiving an instruction indicating restoration to the image display state again, and all pixel units in the display area perform image display.

[0015] In one implementation of the present application, the first photoelectric conversion unit and the second photoelectric conversion unit are arranged in parallel on the same layer, and the lens layer is opposite to and covers the second photoelectric conversion unit. Thus, the lens layer and the first photoelectric conversion unit are arranged at a certain distance. When the first photoelectric conversion unit emits light and the lens layer is in a plane lens, the lens layer can assist in transmitting the light emitted by the first photoelectric conversion unit to the outside of the display panel to effectively improve the image display brightness.

[0016] In one implementation of the present application, the first conversion unit is a light emitting diode, an organic light emitting diode or a micro light emitting diode, and the second photoelectric conversion unit is a photodetector.

[0017] In one implementation of the present application, the first photoelectric conversion unit is also used to receive the ambient light in the image acquisition state and convert the ambient light into an electrical signal to perform image acquisition. The second photoelectric conversion unit is also used to convert the image data into an optical signal for emission to display the image in the image display state. The first photoelectric conversion unit and the second photoelectric conversion unit are micro-light emitting diodes. Both the first photoelectric conversion unit and the second photoelectric conversion unit can perform image display and image acquisition in a time-sharing manner, further improving the resolution and clarity of image display and acquisition.

[0018] In one implementation of the present application, the first photoelectric conversion unit and the second photoelectric conversion unit are arranged in parallel on the same layer, and the lens layer covers the first conversion unit and the second photoelectric conversion unit. Thus, the lens layer can cover the first photoelectric conversion unit and the second photoelectric conversion unit at the same time, effectively improving the brightness of the image during display and the fineness of the focus adjustment during image acquisition, thereby ensuring the quality of image acquisition.

[0019] In one implementation of the present application, when the area of ​​the first area is the same as that of the display area, the control module receives a first instruction, and the control module provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and controls the first photoelectric conversion unit and the second photoelectric conversion unit to emit light to display an image at the same time. The control module receives a second instruction, and the control module alternately outputs the first voltage and the second voltage according to a preset frequency, and the second voltage controls the lens layer to be in a focusing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion unit to stop emitting light, and simultaneously performs photoelectric conversion on the ambient light received from the lens layer after convergence. Among them, since the first area extends to the entire display interface, in order to ensure that the display panel does not affect the user's viewing of the image while performing image acquisition, the preset frequency can be 60HZ, at which the user's visual display interface remains in the state of image display, ensuring the user's visual experience.

[0020] In one implementation of the present application, when the first area is smaller than the area of ​​the display area, the control module receives a first instruction, the control module provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and controls the first photoelectric conversion unit and the second photoelectric conversion unit to simultaneously emit light to display an image; in the image acquisition state, the control module receives a second instruction, the control module outputs a second voltage, the second voltage controls the lens layer to be in a focusing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion unit to stop emitting light, and simultaneously performs photoelectric conversion on the ambient light received from the lens layer after convergence. The area that multiplexes the image display and image acquisition functions will not affect the image display of the area that only performs image display when performing image display, so that image display and image acquisition can be performed simultaneously on the display panel.

[0021] In one implementation of the present application, a display terminal is provided, comprising an input module and a display panel as described in any one of the above, wherein the input module is used to receive a control instruction input by a user's operation, and to generate the first control instruction and the second control instruction correspondingly according to the control instruction. The display panel in the display terminal can reuse the two functions of image display and image acquisition, so that the screen-to-body ratio of the display panel is effectively improved, providing more space for realizing full-screen display.

[0022] In one implementation of the present application, a display device is provided, comprising any one of the display panels described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A schematic diagram showing a planar structure of a terminal in an embodiment of the present application;

[0024] Figure 2 for Figure 1 The side structure diagram of the display terminal is shown;

[0025] Figure 3 For Figure 2 A schematic diagram of the structure of a plane showing a panel;

[0026] Figure 4 For Figure 3 The image acquisition module is shown as a schematic diagram of the distribution on the display interface;

[0027] Figure 5 For Figure 3 The image acquisition module is shown as a schematic diagram of the distribution on the display interface;

[0028] Figure 6 For Figure 1 and Figure 3 An enlarged structural schematic diagram of the first area shown;

[0029] Figure 7 In the first embodiment of this application, Figure 6 The schematic diagram of the cross-sectional structure along the VI-VI line is shown;

[0030] Figure 8 For Figure 7 The connection diagram of the image display module and the image acquisition module shown;

[0031] Fig. 9 For Figure 6-Figure 7 The flowchart shown is to drive the display panel to perform image display acquisition;

[0032] Fig.10 A schematic diagram of timing control for image display acquisition;

[0033] Fig.11 In the second embodiment of the present application, Figure 6 The schematic diagram of the cross-sectional structure along the VI-VI line is shown;

[0034] Fig.12 For Fig.11 A schematic diagram of the specific structure of the lens layer shown;

[0035] Fig.13 For Fig.11 Schematic diagram of the light path structure when the lens layer is in the condenser state;

[0036] Fig.14 For Fig.13 The optical path diagram of the lens layer shown is in plane mirror mode;

[0037] Fig.15 For Fig.13Schematic diagram of the optical path of the lens layer shown in the condenser mode;

[0038] Fig.16 For Fig.11 The diagram of the connection of the driving display panel function module is shown;

[0039] Fig.17 For Fig.11 , Fig.16 The flowchart shown is to drive the display panel to perform image display acquisition;

[0040] Fig.18 For Fig.11 , Fig.16 The timing control schematic diagram of driving the display panel to perform image display acquisition is shown;

[0041] Fig.19 For Fig.11 , Fig.16 The flowchart shown is to drive the display panel to perform image display acquisition;

[0042] Fig. 20 For Fig.11 , Fig.16 The timing control schematic diagram of driving the display panel to perform image display acquisition is shown;

[0043] Fig.21 In the third embodiment of this application, Figure 6 The schematic diagram of the cross-sectional structure along the VI-VI line is shown;

[0044] Fig. 22 For Fig.21 The diagram of the connection of the driving display panel function module is shown;

[0045] Fig.23 For Fig.11 , Fig.16 The timing control schematic diagram of driving the display panel to perform image display acquisition is shown;

[0046] Fig.24 For Fig.11 , Fig.16 The timing control schematic diagram of driving the display panel to perform image display acquisition is shown. DETAILED DESCRIPTION

[0047] The embodiments of the present invention are described below in conjunction with the accompanying drawings.

[0048] Figure 1 This is a schematic diagram showing the planar structure of a terminal in one embodiment of the present application. Figure 1As shown, the display terminal 10 includes a display interface (Active Area) AA for performing image display and graphic acquisition and an instruction acquisition module for receiving user operations. The user's operation on the display terminal 10 represents the corresponding control instructions of the same user input. In this embodiment, the instruction acquisition module can be: a mechanical button, a language pickup module, a motion sensor, a brain wave sensor, and an image acquisition module.

[0049] In this embodiment, the display interface AA is substantially the same in shape and size as the light emitting area on the front of the display terminal 10, and the display interface AA performs image display or obtains light in the external environment for image acquisition based on image data in a time-sharing manner. Among them, the display interface AA can perform image display and image acquisition in a partial area in a time-sharing manner, or the display interface AA can perform image display and image acquisition in a time-sharing manner in the entire area. That is, the display terminal 10 can be in an image display state or an image acquisition state in at least a partial area of ​​the display interface AA in a time-sharing manner, thereby, the display interface AA can perform image display and image acquisition in a time-sharing manner, then the display interface AA can reuse the functions of image display and image acquisition, without the need to separately set up an image acquisition device such as a camera, thereby realizing full-screen display and being able to effectively increase the screen-to-body ratio of the display interface.

[0050] The display interface AA includes a plurality of pixel units P arranged evenly in an array, each pixel includes a plurality of sub-pixels (Pixel) arranged at a preset distance, and each sub-pixel is composed of a first photoelectric conversion unit ( Figure 7 ) is composed of a plurality of sub-pixels Pixel as an image display module 12 ( Figure 3 ).

[0051] The display interface AA includes a first area A1, in which a plurality of second photoelectric conversion units ( Figure 7 ), multiple second photoelectric conversion units as an image acquisition module 13 ( Figure 3 ).

[0052] The first photoelectric conversion unit and the second photoelectric conversion unit are elements for converting photoelectric signals. The first photoelectric conversion unit converts image signals into light signals to emit and display images, and the second photoelectric conversion unit collects ambient light and converts it into electrical signals to reconstruct images.

[0053] See also Figure 2 , which is Figure 1 The side structure diagram of the display terminal is shown.

[0054] like Figure 2As shown, the display terminal 10 includes a stacked touch layer TL and a display panel 11. The display panel 11 includes a light emitting surface 11a for emitting light, and the touch layer TL is disposed on the surface of the light emitting surface 11a of the display panel 11. The touch layer TL is used to sense a user's touch operation.

[0055] The display panel 11 at least includes an array substrate 111 and a photoelectric conversion layer 112 disposed on the surface of the array substrate 111. In this embodiment, the photoelectric conversion layer 112 includes a plurality of photoelectric conversion elements (not shown), and the photoelectric conversion elements may be light emitting diodes (LEDs), organic electroluminescence semiconductor materials (OLEDs), and micro-sized light emitting diodes (μ-LEDs).

[0056] Of course, in other embodiments of the present application, the touch layer TL may not be required.

[0057] See also Figure 3 , which is as follows Figure 2 The schematic diagram of the structure of the plane of the display panel is shown.

[0058] like Figure 3 As shown, the display panel 11 includes an image display module 12 for displaying an image by emitting light and an image acquisition module 13 for acquiring an image by collecting ambient light.

[0059] The image display module 12 is distributed in the entire display interface AA, and the image acquisition module 13 is distributed in at least a partial area of ​​the display interface.

[0060] The image display module 12 includes a plurality of pixel units evenly distributed throughout the display interface AA, each pixel includes a plurality of sub-pixels (Pixel) spaced at a preset distance, and each sub-pixel serves as a first photoelectric conversion unit, which is used to convert the image signal of the analog electrical signal into a light signal and emit it. Each pixel unit includes at least a red sub-pixel (R), a green sub-pixel (G), and a blue sub-pixel (B), which emit red light, green light, and blue light, respectively. By mixing the red light, green light, and blue light emitted by the three-color sub-pixels with different brightness grayscales, each pixel unit can emit colored light, thereby realizing the display interface AA to perform color image display.

[0061] The image acquisition module 13 is distributed in at least a partial area of ​​the display interface AA, wherein the image acquisition module 13 is distributed between sub-pixels Pixel, and is used to collect ambient light outside the display terminal 10 and convert the ambient light into electrical signals, and reconstruct the image outside the display terminal by processing the electrical signals.

[0062] In this embodiment, the size of the image acquisition module 13 is smaller than the size of the sub-pixel Pixel in the image display module.

[0063] The display terminal 10 further includes an image display driving control circuit 12A for driving the image display module 12 to perform image display, and an image acquisition driving control circuit 13A for driving the image acquisition module 13 to perform image acquisition and reconstruction. The image display driving control circuit 12A and the image acquisition driving control circuit 13A are disposed in a non-image display area of ​​the display terminal 10.

[0064] Specifically, see Figure 4 , which is as follows Figure 3 The image acquisition module is shown as a schematic diagram of AA distribution on the display interface.

[0065] The display interface AA includes a first area A1 . The first area A1 is smaller than the area of ​​the display interface AA. The first area A1 can be set at any position of the display interface.

[0066] The first area A1 includes both an image display module and an image acquisition module, wherein the image acquisition module is distributed between sub-pixels Pixel.

[0067] Specifically, see Figure 5 , which is as follows Figure 3 The image acquisition module is shown as a schematic diagram of AA distribution on the display interface.

[0068] The display interface AA includes a first area A1 , and the area and shape of the first area A1 are the same as the area and shape of the display interface AA, that is, the first area A1 overlaps with the display interface AA.

[0069] The first area A1 and the display interface AA include both an image display module and an image acquisition module, wherein the image acquisition module is distributed between the sub-pixels Pixel.

[0070] See also Figure 6 , which is as follows Figure 1 and Figure 3 An enlarged structural schematic diagram of the first area A1 is shown.

[0071] like Figure 6As shown, in the first area A1 of the display interface AA, a plurality of pixel units P are included in the first area A1, each pixel includes a plurality of sub-pixels Pixel arranged at a preset distance, and each sub-pixel Pixel is composed of a first photoelectric conversion unit 101, which is used to convert the image signal of the analog electrical signal into a light signal and emit it.

[0072] Meanwhile, in the first area A1, a plurality of second photoelectric conversion units 102 are arranged between adjacent sub-pixels Pixel. The second photoelectric conversion unit 102 is used to collect ambient light and convert the light signal into an electrical signal, which can be used to reconstruct an image of the ambient light.

[0073] The arrangement of the second photoelectric conversion unit 102 and the sub-pixel Pixel can be set according to actual needs, for example, Figure 6 As shown, a second photoelectric conversion unit 102 is disposed between two adjacent sub-pixels Pixel, and each sub-pixel Pixel is surrounded by six second photoelectric conversion units 102 arranged in a rectangular shape. In other implementations of the present application, two or more second photoelectric conversion units 102 are disposed between two adjacent sub-pixels Pixel, and the number of second photoelectric conversion units 102 disposed around each sub-pixel Pixel may also be four, and the shape may also be a rhombus, a circle, or other shapes, but is not limited thereto.

[0074] In this embodiment, the first photoelectric conversion unit 101 converts the image signal into a light signal and emits it to display the image, and the second photoelectric conversion unit 102 collects ambient light and converts it into an electrical signal to reconstruct the image in a time-sharing manner, that is, when the first photoelectric conversion unit 101 converts the image signal into a light signal and emits it to display the image, the second photoelectric conversion unit 102 stops collecting ambient light and converts it into an electrical signal. When the second photoelectric conversion unit 102 collects ambient light and converts it into an electrical signal, the first photoelectric conversion unit 101 stops converting the image signal into a light signal and emits it.

[0075] See also Figure 7 , which is as in the first embodiment of the present application Figure 6 Shown is a schematic diagram of the cross-sectional structure along line VI-VI.

[0076] The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121. The first photoelectric conversion unit 101 is used to emit light to display an image. The first reading circuit 121 is used to read the image data to be displayed from the image display drive control circuit 12A, and output a corresponding driving signal to the first photoelectric conversion unit 101 according to the image data, driving the first photoelectric conversion unit 101 to emit light according to the driving signal to display the image data accordingly.

[0077] The image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used to transmit the ambient light outside the display panel to the second photoelectric conversion unit 102. The second photoelectric conversion unit 102 is used to convert the ambient light into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light.

[0078] In this embodiment, the lens layer 131 is spaced apart from the second photoelectric conversion unit 102 by a preset distance, so that the lens layer can converge a sufficient amount of collected ambient light to the second photoelectric conversion unit 102 .

[0079] In this embodiment, the first photoelectric conversion unit 101 and the first reading circuit 121 are arranged vertically opposite to each other, and at the same time, the first photoelectric conversion unit 101 and the lens layer 131 are arranged on the same layer, and the second photoelectric conversion unit 102 is located directly below the lens layer 131. The same layer arrangement in this embodiment means that the first photoelectric conversion unit 101 and the lens layer 131 are basically arranged side by side in the same plane.

[0080] In this embodiment, the first photoelectric conversion unit 101 is an LED, an OLED or a μ-LED, the second photoelectric conversion unit 102 is a photodetector (PD), and the lens layer is a metamaterial lens (Meta-Lens).

[0081] See also Figure 8 , which is as follows Figure 7 The diagram shows the connection between the image display module and the image acquisition module.

[0082] like Figure 8 As shown, the control module 100 is electrically connected to the image display driving control circuit 12A, the image acquisition driving control circuit 13A and the second photoelectric conversion unit 102 .

[0083] The control module 100 is used to receive a control instruction provided by the input module, and the control instruction includes instructing the display device to perform image display or image acquisition in the first area A1 of the display interface AA.

[0084] The control instruction can be input by the user touching the touch layer TL in the operation input module. For example, the display interface AA is currently performing image display. When the user needs to take a photo, the camera application on the touch screen is operated and triggered, thereby outputting the image acquisition control instruction to the control module 100.

[0085] Further, when the image acquisition is completed and the corresponding position in the operation display interface AA is touched again, a control instruction indicating that the image acquisition is completed and image display is required is output to the control module 100 .

[0086] In other embodiments of the present application, the control instructions may also be instructions generated by the user operating the mechanical buttons, voice module, motion sensing module or brain wave sensing module in the input module.

[0087] When the control module 100 receives the control instruction of image acquisition, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 121, and at the same time, controls the second photoelectric conversion unit 102 to convert the received ambient light into an electrical signal, and the image acquisition drive control circuit 13A processes the electrical signal to reconstruct the image corresponding to the ambient light.

[0088] When the control module 100 receives a control instruction that image acquisition is completed and image display is required, the control module 100 controls the image display drive control circuit 12A to transmit the image data to be displayed to the image display module 121 for image display. At the same time, the control module 100 controls the second photoelectric conversion unit 102 to stop converting ambient light into electrical signals, that is, stops image acquisition.

[0089] See also Figure 9-10 , Fig. 9 For Figure 6-Figure 7 The flowchart shown is a flowchart of driving the display panel to perform image display acquisition. Fig.10 Schematic diagram of the timing control for image display acquisition.

[0090] like Fig. 9 As shown, the steps of driving the display panel 11 to display and capture images include:

[0091] Step 901: The control module 100 receives a second control instruction for image acquisition. Fig.10 As shown, at time t2, the display interface AA in the display terminal 10 enters the image acquisition state of the image acquisition time period Tc, and the control module 100 receives the second control instruction for image acquisition. It should be noted that between time t1-t1 before t2, the display interface AA is in the image display state of the image display time period Td.

[0092] In step 903, the control module 100 outputs a first control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit 13A according to a second control instruction for instructing the first area to perform image acquisition, controls the second photoelectric conversion unit 102 to be in an on state, and converts the received ambient light into an electrical signal.

[0093] At the same time, the control module 100 outputs a first control signal to the image display driving control circuit 110 to control the image display driving control circuit 110 to stop outputting image data to the image display module.

[0094] Step 905: the image acquisition drive control circuit 13A processes the electrical signal to reconstruct an image corresponding to the ambient light.

[0095] Step 907: The control module 100 receives a first control instruction for instructing the first area to display an image. Fig.10 As shown, at time t3, the control module 100 receives the first control instruction, and the display interface AA in the display terminal 10 enters the image display state of the image display time period Td.

[0096] In step 909, the control module 100 outputs a second control signal to the image display drive control circuit 110 according to the first control instruction, and controls the image display drive control circuit 110 to output image data to the image display module for image display. In this embodiment, the image data output to the image display module for image display may be an image captured by the image capture module.

[0097] At the same time, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit to control the second photoelectric conversion unit 102 to be in a closed state and stop converting ambient light into electrical signals, that is, stop image acquisition.

[0098] See also Fig.11 , which is as in the second embodiment of the present application Figure 6 Shown is a schematic diagram of the cross-sectional structure along line VI-VI.

[0099] The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121. The first photoelectric conversion unit 101 is used to emit light to display an image. The first reading circuit 121 is used to read the image data to be displayed from the image display driving control circuit 12A, and output a corresponding driving signal to the first photoelectric conversion unit 101 according to the image data. The first photoelectric conversion unit 101 emits light according to the driving signal to display the image data.

[0100] The image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used to transmit ambient light outside the display panel 11 to the second photoelectric conversion unit 102. The second photoelectric conversion unit 102 is used to convert the ambient light into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light. In this embodiment, the lens layer 131 and the second photoelectric conversion unit 102 are separated by a preset distance so that the lens layer 131 can converge a sufficient amount of collected ambient light to the second photoelectric conversion unit 102.

[0101] In this embodiment, the lens layer 131 includes two states: a focusing lens state and a flat lens state.

[0102] When the lens layer 131 is in a plane mirror state, the lens layer 131 causes the incident ambient light to generate a phase shift angle of 0°. At this time, the lens layer 131 is a plane mirror.

[0103] When the lens layer 131 is in the condenser state, the lens layer 131 causes the incident ambient light to generate a certain phase shift angle, thereby converging the incident ambient light and transmitting the converged light to the second photoelectric conversion unit 102 .

[0104] The lens layer 102 can be switched in the state of a focusing lens or a flat lens by receiving different voltages or different mechanical pressures.

[0105] Specifically, by loading different voltages to control the lens layer 131 to be in a focusing lens state or a flat lens, the lens layer 131 can be: when a first voltage is loaded to the lens layer 131, the refractive index of the lens layer 131 under the control of the first voltage makes the incident light not produce a phase shift, and is in a flat lens state, that is, the phase shift angle generated by the hyperplane lens for the incident ambient light is 0°; when a second voltage is loaded to the lens layer 131, the refractive index of the lens layer 131 under the control of the first voltage makes the incident light produce a certain phase shift, that is, the phase shift angle generated by the hyperplane lens for the incident ambient light is in, is greater than 0, in which case the hyperplane lens is a focusing lens.

[0106] Further, when the control module 100 receives a second instruction to control the first area A1 to be in an image display state, the first photoelectric conversion unit 101 emits light to display an image, the lens layer 131 is in a planar lens state, and the second photoelectric conversion unit 102 stops converting the ambient light into the electrical signal.

[0107] When the control module 100 receives the first instruction to control the first area A1 to be in an image acquisition state, the first photoelectric conversion unit 101 stops emitting light, the lens layer 131 is in a condenser state, and converges the ambient light and transmits it to the second photoelectric conversion unit 102. The second photoelectric conversion unit 102 receives and collects the converged ambient light provided by the lens layer, and converts the ambient light into an electrical signal.

[0108] In this embodiment, the first photoelectric conversion unit 101 and the first reading circuit 121 are arranged vertically opposite each other. At the same time, the first photoelectric conversion unit 101 and the first reading circuit 121 on the lower side of the second photoelectric conversion unit 102 are arranged on the same layer, and the lens layer 131 is located directly above the layer structure where the second photoelectric conversion unit 102 is located.

[0109] In this embodiment, the first conversion unit 101 is an LED, an OLED or a μ-LED, and the second conversion unit 102 is a PD.

[0110] See also Figure 12-13 , Fig.12 For Fig.11 The specific structural diagram of the lens layer 131 is shown in FIG. Fig.13 It is a schematic diagram of the light path structure when the lens layer 131 is in the focusing lens state.

[0111] like Fig.12 As shown, the lens layer 131 is a metamaterial lens. The metamaterial lens in the lens layer 131 includes a plurality of unit structures U. By adjusting the size and arrangement of each unit structure U, any desired phase distribution can be accurately obtained.

[0112] Specifically, Fig.13 As shown, according to the optical path difference required to reach the lens focus f, the phase distribution required by the hyperplane lens satisfies formula (1):

[0113]

[0114] In formula (1), the center point of the lens is the origin of the coordinate system, (x, y) is the coordinate of a certain position on the lens, f is the focal length, is the phase, and λ is the wavelength of the incident light.

[0115] The wavelength λ of the hyperplane lens can be controlled by externally applying different voltages or by mechanical means. According to the above formula, the hyperplane lens can achieve dynamic adjustment of the focal length of the lens layer 131 by adjusting the phase of the hyperplane lens.

[0116] The hyperplane lens adjusts the phase by loading different voltages, that is, by adjusting the refractive index in the microstructure by using different voltages, controlling the phase shift of the incident light, and thus changing the focal length.

[0117] Specifically, when light waves are transmitted in a medium, the transmission speed will be less than the free space speed, becoming c / n, where c is the free space speed and n is the refractive index of the medium. Under the same transmission distance, different materials have different refractive indices, which will delay the light waves differently and produce different phase differences.

[0118] For example, Fig.12 As shown, the equivalent refractive index of the structural unit of the hyperplane lens can be controlled by a micro-variable diode or other active devices. When a light wave is in a medium with an inhomogeneous refractive index, the change in the adjacent refractive index is Δn, and the phase difference caused by the transmission length d is formula (2):

[0119]

[0120] In formula (2), λ is the free space wavelength.

[0121] In other embodiments of the present application, the phase of the hyperplane lens is adjusted through a mechanical structure, including using a transparent elastic material as a substrate, adjusting the different stretching degrees of the elastic film by loading different voltages, changing the shape of the lens and the period size of the hypersurface array during the stretching process, so that the phase of the hypersurface is redistributed, thereby changing the focal length f.

[0122] It can be seen that the focal length f of the lens layer 131 can be adjusted in real time according to the pixel requirements of the captured image, thereby ensuring the clarity and quality of the image captured by the image capture module 13.

[0123] See also Figure 14-15 , Fig.14 For Fig.13 The optical path diagram of the lens layer shown is in plane mirror mode. Fig.15 For Fig.13 Schematic diagram of the light path of the lens layer shown in condenser mode.

[0124] like Fig.14 As shown, the hyperplane lens in the lens layer 131 makes the phase shift angle of the incident ambient light 0°, and the lens layer 131 is a plane mirror. At this time, the light emitted from the first photoelectric conversion unit 101 is emitted from the lens layer to the outside of the display panel 11, that is, it is emitted from the light-emitting surface to the external environment. Since the hyperplane mirror is a plane mirror at this time, it can ensure that the light inside the display panel 10 can be accurately emitted from the lens layer 131 and the light-emitting surface, and will not cause the light emitted by the first photoelectric conversion unit 101 as a sub-pixel Pixel for performing image display to be distorted or other abnormal phenomena.

[0125] like Fig.15 As shown, the super plane lens in the lens layer 131 makes the phase shift angle of the incident ambient light be The lens layer 131 is in a focusing lens state. At this time, ambient light enters the lens layer from the light-emitting surface and enters the display panel 11. The lens layer also converges the ambient light and transmits the converged light to the second photoelectric conversion unit 102 to ensure that the captured image has better quality.

[0126] See also Fig.16 , which is as follows Fig.11 The diagram shows the connection diagram of the driving display panel functional module.

[0127] like Fig.16As shown, the control module 100 is electrically connected to the image display drive control circuit 12A, the lens layer 131, the second photoelectric conversion unit 102 and the image acquisition drive control circuit 13A. The control module 100 is used to receive control instructions provided by the input module, and the control instructions include instructing the display device to perform image display or image acquisition in the first area A1 of the display interface AA.

[0128] When the control module 100 receives the first control instruction for image acquisition, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 12, and at the same time, controls the second photoelectric conversion unit 102 to convert the received ambient light into an electrical signal, and the image acquisition drive control circuit 13A processes the electrical signal to reconstruct the image corresponding to the ambient light.

[0129] When the control module 100 receives the second control instruction indicating that image acquisition is completed and image display is required, the control module 100 controls the image display drive control circuit 12A to transmit the image data to be displayed to the image display module for image 12 display. At the same time, the control module 100 controls the second photoelectric conversion unit 102 to stop converting ambient light into electrical signals, i.e., stops image acquisition.

[0130] Specifically, the control module 100 is electrically connected to the lens layer 131 , and is used to provide different voltages to the lens layer 131 according to different control instructions, and control the lens layer 131 to be in a focusing lens state or a planar lens state.

[0131] When the control module 100 receives a first instruction corresponding to image display, the control module 100 provides a first voltage to the lens layer 131 to control the lens layer 131 to be in a plane lens state, and the first instruction indicates that the first area needs to be in an image display state. When the control module 100 receives a second instruction corresponding to image acquisition, the control module 100 provides a second voltage to the lens layer 131 to control the lens layer 131 to be in a focusing lens state, and the second instruction indicates that the first area needs to be in an image acquisition state.

[0132] See also Figure 17-Figure 18 , Fig.17 For Fig.11 , Fig.16 The flowchart shown is a flowchart of driving the display panel to perform image display acquisition. Fig.18 For Fig.11 , Fig.16 The timing control schematic diagram of driving the display panel to perform image display acquisition is shown.

[0133] like Fig.17 and Figure 4As shown, when the first area A1 is smaller than the area of ​​the display area AA, the step of driving the display panel to perform image display acquisition includes:

[0134] Step 1701: receiving a second control instruction instructing the first area to perform image acquisition. Fig.18 As shown, the image acquisition time period Tc begins at time t2, and the control module 100 receives the image acquisition control instruction. It should be noted that between time t1 and t2 before t2, the display interface AA is in the image display state corresponding to the image display time period Td.

[0135] Step 1703, the control module 100 outputs a second voltage to the lens layer 131 according to the second control instruction of image acquisition, so that the lens layer 131 is in a condenser state and focuses the ambient light; at the same time, the control module 100 outputs a first control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit, controls the second photoelectric conversion unit 102 to turn on, and converts the received ambient light into an electrical signal.

[0136] At the same time, the control module 100 outputs a first control signal to the first photoelectric conversion unit 101 and the image display driving control circuit 110 to control the image display driving control circuit 110 to stop outputting image data to the image display module and control the first photoelectric conversion unit 101 not to emit light.

[0137] Step 1705: the image acquisition driving control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light. The image acquisition driving control circuit 13A performs amplification, noise reduction and other processing on the electrical signal to obtain the image corresponding to the ambient light.

[0138] Step 1707: receiving a first control instruction instructing the first area to display an image. Fig.18 As shown, at time t3, the image display time period Td begins, and the control module 100 receives the first control instruction for image display.

[0139] Step 1709, according to the first control instruction of image display, the control module 100 outputs the second control signal to the image display driving control circuit 12A, controls the image display driving control circuit 110 to output the image data to the image display module 12 and the first photoelectric conversion unit 101, so that the first photoelectric unit 101 emits light according to the image data and displays the image, and at the same time, the control module 100 outputs the first voltage to the lens layer 131, so that the lens layer 131 is in a plane mirror state to assist in the display of the image. In this embodiment, the image data output to the image display module 12 for image display can be an image captured by the image capture module 13.

[0140] At the same time, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit 13A to control the second photoelectric conversion unit 102 to turn off and stop converting the ambient light into electrical signals, that is, stop image acquisition.

[0141] See also Figure 19-20 , Fig.19 For Fig.11 , Fig.16 The flowchart shown is a flowchart of driving the display panel to perform image display acquisition. Fig. 20 For Fig.11 , Fig.16 The timing control schematic diagram of driving the display panel to perform image display acquisition is shown.

[0142] like Fig.19 and Figure 5 As shown, when the area of ​​the first area AA is the same as that of the display area AA, the step of driving the display panel 11 to perform image display acquisition includes:

[0143] Step 1901: receiving a second control instruction for image acquisition. Fig. 20 As shown, the image acquisition time period Tc begins at time t2, and the control module 100 receives the image acquisition control instruction. It should be noted that between time t1 and t2 before t2, the display interface AA is in the image display state corresponding to the image display time period Td.

[0144] In the image display period Td, the control module 100 receives a first instruction corresponding to image display, provides a first voltage to the lens layer 131, controls the lens layer 131 to be in a planar lens state, and controls the second photoelectric conversion unit 102 to stop performing photoelectric conversion.

[0145] In the image acquisition time period Tc, the control module 100 receives the second instruction, and the control module 100 alternately outputs the first voltage and the second voltage to the lens layer 131 at a preset frequency, and at the same time, alternately outputs the first control signal and the second control signal to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 at a preset frequency. That is, the image display module 12 and the image acquisition module 13 are controlled to alternately perform image display and image acquisition at a preset frequency.

[0146] Specifically, the second voltage controls the lens layer 131 to be in a focusing lens state to focus ambient light, and the first voltage controls the lens layer 131 to be in a flat lens state to assist in image display. At the same time, through the first control signal and the second control signal, the first photoelectric conversion unit 101 is controlled to be in a state of not emitting light or emitting light, and the second photoelectric conversion unit 102 is controlled to be turned on to perform photoelectric conversion or turned off to stop converting ambient light into electrical signals, thereby realizing image display and image acquisition, respectively.

[0147] In this embodiment, the preset frequency is 60 Hz, at which the user can visually maintain the display interface AA in the image display state.

[0148] Step 1907: receiving a first control instruction instructing the first area to display an image. Fig. 20 As shown, at time t3, the image display time period Td begins, and the control module 100 receives the first control instruction for image display.

[0149] Step 1909, according to the first control instruction of image display, the control module 100 outputs the second control signal to the image display driving control circuit 12A, controls the image display driving control circuit 110 to output the image data to the image display module 12 and the first photoelectric conversion unit 101, so that the first photoelectric unit 101 emits light according to the image data and displays the image, and at the same time, the control module 100 outputs the first voltage to the lens layer 131, so that the lens layer 131 is in a plane mirror state to assist in the display of the image. In this embodiment, the image data output to the image display module 12 for image display can be an image captured by the image capture module 13.

[0150] At the same time, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit 13A to control the second photoelectric conversion unit 102 to turn off and stop converting the ambient light into electrical signals, that is, stop image acquisition.

[0151] See also Fig.21 , which is the third embodiment of the present application for Figure 6 Shown is a schematic diagram of the cross-sectional structure along line VI-VI.

[0152] The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 131 . The first photoelectric conversion unit 101 is used to convert image data into light signals and emit a display image, or convert ambient light into electrical signals to perform image acquisition.

[0153] The first reading circuit 131 is used to read the image data to be displayed from the image display driving control circuit 12A, and output a corresponding driving signal to the first photoelectric conversion unit according to the image data, driving the first photoelectric conversion unit 101 to emit light according to the driving signal to display the image data accordingly.

[0154] Or receive the electrical signal converted by the first photoelectric conversion unit 101 from the optical signal, and transmit the electrical signal to the image acquisition drive control circuit.

[0155] The image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102 . The lens layer 131 is used to transmit ambient light outside the display panel 11 to the second photoelectric conversion unit 102 .

[0156] The second photoelectric conversion unit 102 is used to convert the ambient light into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light, or to convert the electrical signal into an optical signal according to image data and emit the displayed image.

[0157] The first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light and receive light at different times.

[0158] In the present embodiment, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are arranged in parallel and in the same layer, and the lens layer 131 covers the surfaces of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102. At the same time, the reading circuit 121 is correspondingly arranged on the surfaces of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 away from the lens layer 131, and communicates with the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to transmit the read image data to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 for photoelectric conversion.

[0159] In this embodiment, the lens layer 131 includes two states: a focusing lens state and a plane lens state. When the lens layer 131 is in the plane mirror state, the phase shift angle of the hyperplane lens in the lens layer 131 is 0°, and the lens layer 131 is a plane mirror.

[0160] When the lens layer 131 is in the condenser state, the lens layer 131 converges the ambient light and transmits it to the second photoelectric conversion unit 102 .

[0161] The lens layer 131 is in a state of a focusing lens or a flat lens and can be switched by receiving different voltages.

[0162] Specifically, a first voltage is provided to the lens layer 131 to control the lens layer 131 to be in a plane lens state. The hyperplane lens makes the incident ambient light phase shift angle 0°, and is in a plane lens state. A second voltage controls the hyperplane lens to make the incident ambient light phase shift angle The plane lens is a focusing lens.

[0163] When the first area A1 is in an image display state, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light to display an image, and the lens layer 131 is in a planar lens state.

[0164] When the first area A1 is in an image acquisition state, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 stop emitting light, the lens layer 131 is in a condenser state, and converges the ambient light and transmits it to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102. The first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 receive and collect the converged ambient light provided by the lens layer 131, and convert the ambient light into an electrical signal and provide it to the reading circuit 121.

[0165] In this embodiment, the first conversion unit 101 and the second conversion unit 102 are both μ-LEDs, which can convert electrical signals into optical signals for image display or convert ambient light into electrical signals for image acquisition in a time-sharing manner.

[0166] See also Fig. 22 , which is as follows Fig.21 The diagram shows the connection diagram of the driving display panel functional module.

[0167] like Fig. 22 As shown, the control module 100 is electrically connected to the image display driving control circuit 110 , the lens layer, the image display driving control circuit 120 , and the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 .

[0168] The control module 100 is used to receive a control instruction provided by the input module, and the control instruction includes instructing the display device to perform image display or image acquisition in the first area A1 of the display interface AA.

[0169] The control instruction can be the touch screen in the user operation input module. For example, the display interface AA currently performs image display. When the user needs to take a photo, the camera application on the touch screen is operated and triggered, thereby outputting the image acquisition control instruction to the control module 100.

[0170] Further, when the image acquisition is completed and the user performs a corresponding touch operation again, such as clicking the location where the “photograph” icon is located, a control instruction indicating that the image acquisition is completed and image display is required is output to the control module 100 .

[0171] In other embodiments of the present application, the control instructions may also be instructions generated by the user operating the mechanical buttons, voice module, motion sensing module or brain wave sensing module in the input module.

[0172] The reading circuit 121 is electrically connected to the image display driving control circuit 110 and the image display driving control circuit 120 .

[0173] When the control module 100 receives the first control instruction for image acquisition, the control module 100 controls the image display drive control circuit 110 to stop outputting image data to the image display module, and at the same time, controls the lens layer 131 to be in a condenser state, and controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to convert the received ambient light into electrical signals, and the image acquisition drive control circuit processes the electrical signals and reconstructs the image corresponding to the ambient light.

[0174] When the control module 100 receives the second control instruction that image acquisition is completed and image display is required, the control module 100 controls the image display drive control circuit 110 to transmit the image data to be displayed to the image display module 12 for image display. At the same time, the control lens layer 131 is controlled to be in a plane mirror state, and the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are controlled to stop converting ambient light into electrical signals, that is, stop image acquisition.

[0175] Specifically, the control module 100 is electrically connected to the lens layer 131 , and is used to provide different voltages to the lens layer 131 according to different control instructions and control the lens layer 131 to be in a focusing lens state or a planar lens state.

[0176] When the control module 100 receives the first instruction, it provides a first voltage to the lens layer 131 to control the lens layer 131 to be in a planar lens state. The first instruction indicates that the first area needs to be in an image display state.

[0177] When the control module 100 receives the second instruction, it provides a second voltage to the lens layer 131 to control the lens layer 131 to be in a focusing lens state. The second instruction indicates that the first area needs to be in an image acquisition state.

[0178] See also Fig.23 , Fig.23 For Fig.11 , Fig.16 The timing control schematic diagram of driving the display panel to perform image display acquisition is shown.

[0179] like Fig.23 As shown, when the first area is smaller than the area of ​​the display area.

[0180] The control module 100 receives the second control instruction for image acquisition. Fig.23 As shown, at time t2, the control module 100 receives the second control instruction instructing the first area to enter image acquisition, and the first area enters the image acquisition period Tc. It should be noted that during the image display period Td before t2, including the time t1-t1, the display interface AA is in the image display state.

[0181] The control module 100 outputs a second voltage to the lens layer 131 according to the first control instruction, so that the lens layer 131 is in a condenser state to condense the ambient light; and outputs a first control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit to control the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to be in a photosensitive state to convert the received ambient light into an electrical signal.

[0182] At the same time, the control module 100 outputs a first control signal to the image display driving control circuit 110 to control the image display driving control circuit 110 to stop outputting image data to the image display module.

[0183] The image acquisition drive control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light.

[0184] The control module 100 receives the control instruction of image display. Fig.23 As shown, at time t3, the control module 100 receives a first control instruction instructing the first area to display an image.

[0185] According to the first control instruction, the control module 100 outputs a second control signal to the image display drive control circuit 110, and controls the image display drive control circuit 110 to output image data to the image display module for image display. In this embodiment, the image data output to the image display module for image display may be an image captured by the image capture module.

[0186] At the same time, the control module 100 outputs a first voltage to the lens layer 131, so that the lens layer 131 is in a plane mirror state to assist in image display; and outputs a second control signal to the second photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to control both to emit light to perform image display. In this embodiment, the first control signal and the second control signal can reuse the first voltage and the second voltage to perform control on the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.

[0187] See also Fig.24 , Fig.24 For Fig.11 , Fig.16 The timing control diagram of driving the display panel to collect image display is shown in FIG. Fig.24 As shown, when the area of ​​the first region is the same as that of the display region:

[0188] During the image display period Tc, the control module 100 receives a first instruction, and the control module 100 provides a first voltage to the lens layer 131, controls the lens layer 131 to be in a flat lens state to assist in display, and controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to emit light simultaneously to display the image data.

[0189] During the image acquisition time period Td, the control module 100 receives the second instruction, and the control module 100 alternately outputs the first voltage and the second voltage according to the preset frequency. The second voltage controls the lens layer 131 to be in the condenser state to condense the ambient light, and at the same time controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to be in the photosensitive state to convert the concentrated ambient light into an electrical signal; the first voltage controls the lens layer 131 to be in the plane mirror state to assist in image display, and at the same time controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to emit light to perform image display. In this embodiment, the preset frequency is 60HZ, at which the user visually maintains the display interface AA in the image display state.

[0190] A pixel circuit provided in an embodiment of the present application is introduced in detail above. Specific examples are used herein to illustrate the principles and embodiments of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present application, there may be changes in the specific embodiments and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A display panel, comprising an array substrate, wherein a display area corresponding to the array substrate comprises a plurality of pixel units arranged in a matrix, each pixel unit comprises at least one first photoelectric conversion unit for emitting light to display an image, characterized in that: An image acquisition module is arranged between adjacent pixel units in the array substrate corresponding to the first area in the display area. The image acquisition module includes a lens layer and a second photoelectric conversion unit, the lens layer is used to collect ambient light outside the display panel and transmit it to the second photoelectric conversion unit, the second photoelectric conversion unit is used to convert the ambient light into an electrical signal in the image acquisition state, and the electrical signal is used to reconstruct the image corresponding to the ambient light, wherein the first photoelectric conversion unit emits light and the second photoelectric conversion unit outputs the electrical signal in a time-sharing manner.

2. The display panel according to claim 1, characterized in that: The first area includes an image display state and an image acquisition state. When the first area is in the image display state, the first photoelectric conversion unit emits light to perform image display, and the second photoelectric conversion unit stops outputting the electrical signal. When the first area is in the image acquisition state, the first photoelectric conversion unit stops emitting light, and the second photoelectric conversion unit converts the ambient light into the electrical signal. The lens layer is a focusing lens, which is used to converge the ambient light and transmit it to the second photoelectric conversion unit. When the first area is in an image acquisition state, the second photoelectric conversion unit receives and collects the converged ambient light provided by the lens layer, and converts the ambient light into an electrical signal.

3. The display panel according to claim 1, characterized in that: The first photoelectric conversion unit is arranged in parallel with the lens layer in the same layer, and the lens layer faces and covers the second photoelectric conversion unit.

4. The display panel according to claim 1, characterized in that: The lens layer includes a focusing lens state and a flat lens state. When the first area is in an image display state, the first photoelectric conversion unit emits light to display an image, the lens layer is in a planar lens state, and the second photoelectric conversion unit stops converting the ambient light into the electrical signal; When the first area is in an image acquisition state, the first photoelectric conversion unit stops emitting light, the lens layer is in a condenser state, and converges the ambient light and transmits it to the second photoelectric conversion unit. The second photoelectric conversion unit receives and collects the converged ambient light provided by the lens layer, and converts the ambient light into an electrical signal.

5. The display panel according to claim 4, characterized in that: The display panel further comprises a control module, the control module is connected to the lens layer, the control module is used to output different voltages to the lens layer and control the lens layer to be in a focusing lens state or a flat lens state; When the control module receives a first instruction, the control module outputs a first voltage to the lens layer and controls the lens layer to be in a planar lens state, wherein the first instruction is used to instruct the first area to display an image; or When the control module receives a second instruction, the control module outputs a second voltage to the lens layer and controls the lens layer to be in a focusing lens state, wherein the second instruction is used to instruct the first area to perform image acquisition.

6. The display panel according to claim 5, characterized in that: The lens layer is a super flat lens, The first voltage controls the phase shift angle of the ambient light entering the hyperplane lens to be 0°, and the hyperplane lens is a plane mirror; The second voltage controls the phase shift angle of the ambient light entering the hyperplane lens to be △φ. The hyperplane lens is a focusing lens used to converge the ambient light and transmit it to the second photoelectric conversion unit. The phase shift angle △φ is used to adjust the focal length required for the current image acquisition.

7. The display panel according to claim 6, characterized in that: When the first region has the same shape and area as the display region, The control module receives a first instruction, and provides a first voltage to the lens layer to control the lens layer to be in a planar lens state, and controls the second photoelectric conversion unit to stop performing photoelectric conversion; The control module receives the second instruction, and the control module outputs the first voltage and the second voltage alternately according to a preset frequency. The second voltage controls the first photoelectric conversion unit to stop emitting light, controls the lens layer to be in a focusing lens state, and controls the second photoelectric conversion unit to perform photoelectric conversion on the focused ambient light received from the lens layer.

8. The display panel according to claim 6, characterized in that: When the first area is smaller than the area of ​​the display area, The control module receives a first instruction, and provides a first voltage to the lens layer to control the lens layer to be in a planar lens state, and controls the second photoelectric conversion unit to stop performing photoelectric conversion; The control module receives a second instruction and outputs a second voltage. The second voltage controls the first photoelectric conversion unit to stop emitting light, controls the lens layer to be in a focusing lens state, and controls the second photoelectric conversion unit to perform photoelectric conversion on the focused ambient light received from the lens layer.

9. The display panel according to claim 8, characterized in that: When the control module receives the first instruction again, the display panel exits the image acquisition state and enters the image display state.

10. The display panel according to any one of claims 5 to 9, characterized in that: The first photoelectric conversion unit and the second photoelectric conversion unit are arranged in parallel in the same layer, and the lens layer faces and covers the second photoelectric conversion unit.

11. The display panel according to claim 6, characterized in that: The first photoelectric conversion unit is also used to receive the ambient light in the image acquisition state and convert the ambient light into an electrical signal to perform image acquisition; The second photoelectric conversion unit is also used to convert the image data into a light signal for output to display the image in the image display state; The first photoelectric conversion unit and the second photoelectric conversion unit are micro light emitting diodes.

12. The display panel according to claim 11, characterized in that: The first photoelectric conversion unit and the second photoelectric conversion unit are arranged in parallel on the same layer, and the lens layer covers the first photoelectric conversion unit and the second photoelectric conversion unit.

13. The display panel according to claim 11 or 12, characterized in that: When the first region has the same area as the display region, The control module receives a first instruction, provides a first voltage to the lens layer, controls the lens layer to be in a planar lens state, and controls the first photoelectric conversion unit and the second photoelectric conversion unit to simultaneously emit light to display an image; The control module receives a second instruction, and the control module alternately outputs a first voltage and a second voltage at a preset frequency. The second voltage controls the lens layer to be in a focusing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion unit to stop emitting light, and simultaneously performs photoelectric conversion on the ambient light received from the lens layer after being converged.

14. The display panel according to claim 11 or 12, characterized in that: When the first area is smaller than the area of ​​the display area, The control module receives a first instruction, provides a first voltage to the lens layer, controls the lens layer to be in a planar lens state, and controls the first photoelectric conversion unit and the second photoelectric conversion unit to simultaneously emit light to display an image; The control module receives a second instruction, and the control module outputs a second voltage. The second voltage controls the lens layer to be in a focusing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion unit to stop emitting light, and simultaneously performs photoelectric conversion on the focused ambient light received from the lens layer.

15. A display terminal, characterized in that: It includes an input module and a display panel as described in any one of claims 5-14, the input module is used to accept control instructions input by user operations, and generate a first instruction and a second instruction according to the control instructions, wherein the first instruction is used to instruct the first area to display an image, and the second instruction is used to instruct the first area to capture an image.

16. A display device, characterized in that: A display panel comprising any one of the above items.