Display panel, display device and gaze position recognition method thereof
By integrating optical collimation and convergence structures onto the display panel, rapid pupil positioning and tracking are achieved, solving the problem of slow response speed in eye-tracking systems, improving system response speed, and reducing data processing time.
Patent Information
- Application Number
- CN202310927389.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-26
- Publication Date
- 2026-02-13
- Estimated Expiration
- 2043-07-26
AI Technical Summary
Existing eye-tracking systems have slow response times, large data volumes, and long information processing times.
The display panel design includes a substrate, an optical collimation structure, an optical converging structure, and a photosensitive unit. It achieves rapid pupil positioning and tracking through a non-imaging method. The optical collimation structure collects infrared light reflected from the eye into the photosensitive unit, and the gaze position is determined by the signal difference.
This reduces the amount of data processed and improves the response speed of the eye-tracking system.
Smart Images

Figure CN119376083B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of display, in particular, to a display panel, a display device and a method for identifying a gazed position. BACKGROUND
[0002] With the development of pupil-iris technology and the progress of human eye recognition algorithm, the eye tracking system, the latest visual field positioning system, comes into being.
[0003] The eye tracking system currently adopted is to capture images by camera, and then transmit the images to a chip for processing, denoising and demodulation, so as to realize tracking and positioning of the eyes. These methods all need the camera to take pictures, and the data volume is large, the information processing time is long, and the response speed of the eye tracking system is slow.
[0004] It should be noted that the information disclosed in the above background section is only used to strengthen the understanding of the background of the present disclosure, and therefore can include information that does not constitute prior art known to those of ordinary skill in the art. SUMMARY
[0005] The purpose of the present disclosure is to improve the response speed of the eye tracking system, and to provide a display panel, a display device and a method for identifying a gazed position.
[0006] According to one aspect of the present disclosure, a display panel is provided, which has a display area and a non-display area located at the periphery of the display area, and further includes a substrate, a plurality of optical collimation structures, a plurality of optical convergence structures and a plurality of light sensing units. The plurality of optical collimation structures are arranged on one side of the substrate and located in the non-display area; the plurality of optical convergence structures are arranged on one side of the substrate and located in the display area; the plurality of light sensing units are arranged between the substrate and the optical collimation structures and located in the non-display area, and the plurality of light sensing units correspond one-to-one to the plurality of optical collimation structures; the optical collimation structure is used to collect infrared light reflected by the eye to the surface of the light sensing unit; the plurality of optical collimation structures and the plurality of optical convergence structures are of the same layer and the same material.
[0007] In one embodiment of the present disclosure, the angle range of the light sensing unit receiving the infrared light is a collimation angle, which is calculated by the following formula:
[0008]
[0009]
[0010]
[0011] Wherein, D is the distance between the eye and the light sensing unit, m is the eye movement distance, w is the width of the eye movement range, q is the number of light sensing units arranged on one side of the display area, γ is the field of view angle of the eye watching the display panel, and η is the view angle change value.
[0012] In one embodiment of the present disclosure, the signal difference between the two adjacent light sensing units is obtained by the following formula:
[0013] ΔS = S1 - S0 4);
[0014] S0 = A1 x a1 + (A21 + A22) x a2 5);
[0015] S1 = B3 x a1 + (B21 + B22) x a2 6);
[0016] Wherein, ΔS is the signal difference, S0 is the signal value of the first light sensing unit, S1 is the signal value of the second light sensing unit, A1 is the coverage area of the collimation angle corresponding to the first light sensing unit on the pupil, A21 is the coverage area of the collimation angle corresponding to the first light sensing unit on the iris on one side of the pupil, A22 is the coverage area of the collimation angle corresponding to the first light sensing unit on the iris on the other side of the pupil, B1 is the coverage area of the collimation angle corresponding to the second light sensing unit on the pupil, B21 is the coverage area of the collimation angle corresponding to the second light sensing unit on the iris on one side of the pupil, B22 is the coverage area of the collimation angle corresponding to the second light sensing unit on the iris on the other side of the pupil, a1 is the reflectivity of the pupil to infrared light, and a2 is the reflectivity of the iris to infrared light.
[0017] In one embodiment of the present disclosure, the coverage area of the collimation angle corresponding to the first light sensing unit on the pupil is equal to the size of the pupil.
[0018] In one embodiment of the present disclosure, the size of the collimation angle is between 1.13 degrees and 3.9 degrees.
[0019] In one embodiment of the present disclosure, the optical collimation structure is a first microlens, and the focal point of the first microlens is located on the surface of the light sensing unit.
[0020] In one embodiment of the present disclosure, the first microlens is a circular first microlens and / or a columnar first microlens, and the height of the columnar first microlens is greater than the aperture of the circular first microlens.
[0021] In one embodiment of the present disclosure, the first microlens is a circular first microlens, and the radius of curvature of the circular first microlens satisfies:
[0022] R = (n1 x L1 +... nt x Lt) x (nlens - 1) 7);
[0023] In a direction away from the substrate base, n1 is the refractive index of the first layer between the first microlens and the photosensitive unit, nt is the refractive index of the tth layer, L1 is the thickness of the first layer, Lt is the thickness of the tth layer, and R is the radius of curvature of the circular first microlens.
[0024] In an embodiment of the present disclosure, the display panel further comprises a light filtering structure, which is arranged between the optical collimation structure and the photosensitive unit, and comprises a red light filtering layer, a green light filtering layer and a blue light filtering layer arranged in layers.
[0025] In an embodiment of the present disclosure, the display panel further comprises a second light absorbing portion, which is arranged at the periphery of the light filtering structure, and the orthographic projection of the second light absorbing portion on the substrate base forms an enclosed area, and the orthographic projection of the photosensitive unit on the substrate base covers the enclosed area.
[0026] In an embodiment of the present disclosure, the first microlens is a columnar first microlens, and the display panel comprises columnar first microlenses arranged in a first direction and columnar first microlenses arranged in a second direction, wherein the second direction is perpendicular to the first direction.
[0027] In an embodiment of the present disclosure, the non-display area is in the shape of a rectangular frame, and comprises four sub-non-display areas located around the display area, one of which is arranged with the bonding circuit, and the other three are respectively arranged with a group of photosensitive units.
[0028] In an embodiment of the present disclosure, the display panel further comprises a driving circuit layer, and the photosensitive unit is arranged in the same layer as the driving circuit layer.
[0029] According to another aspect of the present disclosure, a display device is provided, comprising an optical path adjusting lens, an infrared light source and a display panel provided by any one of the aspects of the present disclosure, the infrared light source being arranged at the periphery of the lens; and the display panel being arranged on the side of the infrared light source and the optical path adjusting lens away from the eye.
[0030] According to still another aspect of the present disclosure, a method for identifying the gazed position of the display device provided by the other aspect of the present disclosure is provided, the method comprising:
[0031] emitting infrared light to the eye by the infrared light source;
[0032] When the infrared light reflected by the eye is reflected to the optical path collimation structure, if the amount of infrared light signal sensed by a certain photosensitive unit is less than that of the photosensitive units in the surrounding area, it is determined that the pupil gazes at the position of the photosensitive unit.
[0033] The display panel of the present disclosure has a display area and a non-display area, the display area is provided with a plurality of optical convergence structures, the optical convergence structures are extended to the non-display area, a plurality of optical collimation structures are arranged in the non-display area, and a plurality of light sensing units corresponding to the plurality of optical collimation structures, the optical collimation structures are used to collect the infrared light reflected by the eyes to the surface of the light sensing units. If the amount of infrared light signal sensed by a certain light sensing unit is less than that of the light sensing units in the surrounding area, it is determined that the pupil is staring at the position of the light sensing unit. Through the regional collimation of the eye reflected light by the optical path collimation structure, the rapid positioning and tracking of the pupil can be realized in a non-imaging manner, the data amount is small, the time length of information processing is reduced, and the response speed of the eye movement tracking system is improved.
[0034] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS
[0035] The drawings incorporated into the specification and forming part of the specification, show embodiments consistent with the present disclosure, and together with the specification, serve to explain the principles of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative labor.
[0036] Figure 1 A cross-sectional view of a display panel according to an embodiment of the present disclosure.
[0037] Figure 2 A plan view of a display panel according to an embodiment of the present disclosure.
[0038] Figure 3 A structure view of a first microlens according to an embodiment of the present disclosure.
[0039] Figure 4 A view of the collimation angle of the optical collimation structure corresponding to the light sensing unit according to an embodiment of the present disclosure.
[0040] Figure 5 A view of the relationship between the angle range of the infrared light received by the light sensing unit and the optical collimation structure of the optical collimation structure according to an embodiment of the present disclosure.
[0041] Figure 6 A view of the collimation angle of the optical collimation structure corresponding to the light sensing unit according to an embodiment of the present disclosure.
[0042] Figure 7 A view of the collimation angle of the optical collimation structure corresponding to the light sensing unit according to an embodiment of the present disclosure.
[0043] Figure 8 For the first kind of collimation angle, a schematic diagram of the first light sensing unit and the second light sensing unit on the eye when the coverage areas of the first light sensing unit and the second light sensing unit are adjacent.
[0044] Figure 9 For the second kind of collimation angle, a schematic diagram of the first light sensing unit and the second light sensing unit on the eye.
[0045] Figure 10 For the third kind of collimation angle, a schematic diagram of the first light sensing unit and the second light sensing unit on the eye.
[0046] Figure 11 For the fourth kind of collimation angle, a schematic diagram of the first light sensing unit and the second light sensing unit on the eye.
[0047] Figure 12 For the first kind of collimation angle, a schematic diagram of the distribution of the coverage area of the first light sensing unit on the pupil and the iris, and the distribution of the coverage area of the second light sensing unit on the pupil and the iris.
[0048] Figure 13 A schematic diagram of a cross section of another display panel according to an embodiment of the present disclosure.
[0049] Figure 14 A schematic diagram of a plan view of another display panel according to an embodiment of the present disclosure.
[0050] Figure 15 A schematic diagram of the structure of another first microlens according to an embodiment of the present disclosure.
[0051] Figure 16 A schematic diagram of the relationship between the height of the first microlens and the signal quantity of the light sensing unit according to an embodiment of the present disclosure.
[0052] Figure 17 A schematic diagram of the structure of a display device according to an embodiment of the present disclosure.
[0053] Figure 18 A flowchart of a method for identifying a gazed position of a display device according to an embodiment of the present disclosure.
[0054] In the figure: 1, silicon substrate, 10, substrate, 12, driving circuit layer, 11, transistor, 111, gate, 112, first active layer, 113, first electrode, 114, second electrode, 115, gate insulating layer, 116, first data line, 117, second data line, 118, first scan line, 12, first transistor, 13, second transistor, 14, contact hole, 15, insulating layer, 16, third conductive layer, 17, light sensing unit, 171, second active layer, 172, third electrode, 173, fourth electrode, 174, third data line, 175, fourth data line, 1701, first light sensing unit, 1702, second light sensing unit, 18, fourth conductive layer, 19, binding circuit, 2, light emitting layer, 21, first conductive layer, 22, organic light emitting functional layer, 23, second conductive layer, 201, first light emitting device, 202, second light emitting device, 2001, first electrode, 2002, second electrode, 2003, light emitting unit, 3, first encapsulation layer, 4, color filter layer, 41, first light absorbing part, 42, red filter pattern, 43, green filter pattern, 44, blue filter pattern, 5, second encapsulation layer, 61, filter structure, 611, red filter layer, 612, green filter layer, 613, blue filter layer, 62, second light absorbing part, 7, filling layer, 71, first filling part, 72, second filling part, 8, microlens layer, 81, first microlens, 82, second microlens, 83, first adhesive layer, 84, second adhesive layer, 9, cover plate, 100, display area, 200, non-display area, 2001, sub-non-display area, 300, infrared light source, 400, light path adjusting lens, 500, eye, 5001- eye movement range, 5002- pupil, 5003- iris. DETAILED DESCRIPTION
[0055] Example embodiments now will be described more fully hereinafter with reference to the accompanying drawings; however, the example embodiments can be implemented in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. Like reference numerals refer to like elements throughout the figures, and thus description of the same will be omitted. In addition, the drawings are to be considered in the illustrative mode, and not to be considered to be limiting.
[0056] Although relative terms such as "up" and "down" are used in this specification to describe the relative relationship of one component of an icon to another, these terms are used only for convenience, such as according to the orientation of the examples shown in the accompanying drawings. It is understood that if the device of the icon is flipped upside down, the component described as "up" will become the component described as "down." When a structure is "up" of another structure, it may mean that the structure is integrally formed on the other structure, or that the structure is "directly" mounted on the other structure, or that the structure is "indirectly" mounted on the other structure through another structure.
[0057] The terms “a,” “one,” “the,” “the,” and “at least one” are used to indicate the presence of one or more elements / components / etc.; the terms “including” and “having” are used to indicate an open-ended inclusion and to mean that there may be other elements / components / etc. in addition to the listed elements / components / etc.; the terms “first,” “second,” and “third,” etc., are used only as markers and are not a limitation on the number of objects.
[0058] This disclosure provides a display panel. For example... Figures 1 to 17 As shown, the display panel has a display area 100 and a non-display area 200 located around the display area 100. The display panel also includes a substrate 10, multiple optical collimating structures, multiple optical converging structures, and multiple photosensitive units 17. The multiple optical collimating structures are disposed on one side of the substrate 10 and located in the non-display area 200; the multiple optical converging structures are disposed on one side of the substrate 10 and located in the display area 100; the multiple photosensitive units 17 are disposed between the substrate 10 and the optical collimating structures and located in the non-display area 200, and the multiple photosensitive units 17 correspond one-to-one with the multiple optical collimating structures; the optical collimating structures are used to collect the infrared light reflected by the eye 500 onto the surface of the photosensitive unit 17; the multiple optical collimating structures and the multiple optical converging structures are in the same layer and made of the same material.
[0059] The display area 100 of the display panel is provided with multiple optical converging structures, which extend to the non-display area 200. Multiple optical collimating structures and multiple photosensitive units 17 corresponding to each optical collimating structure are provided in the non-display area 200. The optical collimating structures are used to collect the infrared light reflected from the eye 500 onto the surface of the photosensitive unit 17. If the amount of infrared light signal sensed by a certain photosensitive unit 17 is less than the amount of infrared light signal sensed by the photosensitive units 17 in its surrounding area, it is determined that the pupil 5002 is focused on the location of that photosensitive unit 17. By achieving regional collimation of the light reflected from the eye 500 through the optical path collimating structures, rapid positioning and tracking of the pupil 5002 can be achieved without imaging. This reduces the amount of data, shortens the information processing time, and improves the response speed of the eye-tracking system.
[0060] The display panel involved in the embodiments of the present disclosure will be described in detail below in combination with specific embodiments.
[0061] As shown in Figure 1 The display panel includes a driving back plate 1 and a pixel layer, the driving back plate 1 includes a substrate 10 and a driving circuit layer 100, for the sake of clarity, Figure 1 Only the first sub-pixel region and the second sub-pixel region adjacent to the pixel layer are shown, and for each sub-pixel region, only the light emitting element and the transistor 11 in the driving circuit layer 100 directly connected to the light emitting element are shown. For example, the transistor 11 can be a driving transistor configured to control the size of the current driving the light emitting element to emit light. For example, the transistor 11 can also be a light emitting control transistor for controlling whether the current driving the light emitting element to emit light flows. The embodiments of the present disclosure do not limit this.
[0062] The display panel includes a substrate 10, a first conductive layer 21 disposed on the substrate 10, an organic light emitting functional layer 22, and a second conductive layer 23. The first conductive layer 21 is disposed on the side of the driving circuit layer 100 away from the substrate 10, the organic light emitting functional layer 22 is disposed on the side of the first conductive layer 21 away from the substrate 10, and the second conductive layer 23 is disposed on the side of the organic light emitting functional layer 22 away from the substrate 10.
[0063] The first conductive layer 21 includes the first electrodes 2001 of the first light emitting device 201 and the first electrodes 2001 of the second light emitting device 202 in the first sub-pixel region and the second sub-pixel region, respectively, which are insulated from each other, and the first electrodes 2001 of the first light emitting device 201 and the first electrodes 2001 of the second light emitting device 202 are disconnected from each other. The second conductive layer 23 includes the second electrodes 2002 of the first light emitting device 201 and the second electrodes 2002 of the second light emitting device 202 in the first sub-pixel region and the second sub-pixel region, respectively, which are connected to each other.
[0064] In order to improve the light emitting efficiency and the color gamut of the light emitting device, a plurality of light emitting layers 2 can also be used to emit white light by stacking each other, that is, the organic light emitting functional layer 22 can include a plurality of sub-light emitting functional layers, and the plurality of sub-light emitting functional layers are stacked in a direction perpendicular to the substrate 10. For example, the organic functional layer 22 includes two yellow sub-light emitting functional layers and a blue sub-light emitting functional layer stacked with each other, or the organic functional layer 22 includes two red sub-light emitting functional layers, a green sub-light emitting functional layer, and a blue sub-light emitting functional layer stacked with each other.
[0065] As shown in Figure 1As shown, the display panel provided in this embodiment uses a silicon substrate as the substrate 10, and the driving circuit layer 100 can be integrated on the silicon substrate to form a driving backplane 1. In this case, silicon-based circuits can achieve higher precision. The first light-emitting element and the second light-emitting element are formed on the driving backplane 1, which includes the substrate 10 and the driving circuit layer 100 formed on the substrate 10. The silicon substrate is, for example, monocrystalline silicon or high-purity silicon.
[0066] The driving circuit layer 100 is located in the display area 100. The driving circuit layer 100 is formed on the substrate 10 using semiconductor processes. For example, a first active layer 112 (i.e., a semiconductor layer), a first electrode 113, and a second electrode 114 of the transistor 11 are formed in the substrate 10 using a doping process. An insulating layer 15 is formed using a silicon oxidation process, and multiple third conductive layers 16 are formed using a sputtering process. The semiconductor layer of the transistor 11 (e.g., the semiconductor layer) Figure 1 The first active layer is located inside the substrate 10 or is a part of the substrate 10.
[0067] like Figure 1 As shown, the first light-emitting element is electrically connected to the first transistor 12, and the second light-emitting element is electrically connected to the second transistor 13. The embodiments of this disclosure do not limit the specific types of the first transistor 12 and the second transistor 13. The first transistor 12 is described exemplarily below, and this description also applies to the second transistor 13, and therefore will not be repeated.
[0068] For example, transistor 11 includes a gate 111, a gate insulating layer 115, a first active layer 112, a first electrode 113, and a second electrode 114. The embodiments of this disclosure do not limit the type, material, or structure of the first transistor 12. For example, it can be a top-gate type, a bottom-gate type, etc. The first active layer 112 of the first transistor 12 can be an inorganic semiconductor material such as microcrystalline silicon, amorphous silicon, polycrystalline silicon (low-temperature polycrystalline silicon or high-temperature polycrystalline silicon), or oxide semiconductor (e.g., IGZO), or it can also be an organic material, such as PBTTT, PDBT-co-TT, PDQT, PDVT-10, dianaphthalo-dithiophene (DNTT), or pentanebenzene. For example, the first transistor 12 can be N-type or P-type.
[0069] Some embodiments of the present disclosure are described taking a field effect transistor (such as a MOS field effect transistor) formed in a silicon substrate as an example, in which the silicon substrate is doped (p-type doping or n-type doping) to form a first active layer 112 of the transistor, i.e., the first active layer 112 of the transistor is located in the silicon substrate or is part of the silicon substrate. The source and drain of the transistor used herein can be symmetrical in structure, so that the source and drain thereof can be indistinguishable in structure. In the embodiments of the present disclosure, in order to distinguish the two poles of the transistor other than the gate, for example, one of the poles is directly described as a first pole 113 and the other pole is a second pole 114.
[0070] The display panel can further include a third conductive layer 16 including a plurality of sub-third conductive layers 161 arranged at intervals, and the plurality of sub-third conductive layers 161 are arranged one-to-one corresponding to the plurality of first electrodes 2001 included in the first conductive layer 21. In a top emission structure, the third conductive layer 16 can be arranged as a reflective layer for reflecting light emitted by the light emitting element to improve light extraction efficiency. For example, the orthographic projection of each first electrode 2001 in the first conductive layer 21 on the substrate 10 falls within the orthographic projection of the sub-third conductive layer corresponding to the first electrode 2001 on the substrate 10. In this case, the first conductive layer 21 can use a transparent conductive oxide material with a high work function, such as ITO, IZO, IGZO, AZO, etc.
[0071] The light emitting layer 2 of the pixel layer includes a first light emitting device 201 and a second light emitting device 202 located in the first sub-pixel region and the second sub-pixel region, respectively. The first transistor 12 drives the first light emitting device 201 to emit light, and the second transistor 13 drives the second light emitting device 202 to emit light. The first light emitting device 201 and the second light emitting device 202 each include a light emitting unit 2003, and the light emitting unit 2003 is opposite to the first electrode 2001 and the second electrode 2002.
[0072] Generally, a fourth conductive layer 18 can be arranged between the third conductive layer 16 and the transistor, and the fourth conductive layer 18 can include a first data line 116, a second data line 117, and a first scan line 118 connected to the gate 111, the first data line 116 connected to the first pole 113, and the second data line 117 connected to the second pole 114.
[0073] The first light emitting device 201 and the second light emitting device 202 can be organic light emitting diodes (OLEDs) or quantum dot light emitting diodes (QLEDs), and the embodiments of the present disclosure do not limit the type of light emitting element. For example, the light emitting unit 2003 can be a small molecule organic material or a high polymer organic material.
[0074] The first light emitting device 201 and the second light emitting device 202 are top emission structures, and the first electrode 2001 and the second electrode 2002 have reflectivity. For example, the first electrode 2001 includes a material with high work function and high reflectivity to serve as an anode, such as a stack structure of Ti / Al / Ti / Mo, in which titanium metal can serve as a buffer layer to improve adhesion between layers, Al serves as a high-reflectivity material, and Mo serves as a high-work-function material in direct contact with the organic functional layer to improve carrier injection capability. Correspondingly, the second conductive layer 23 serves as a cathode, for example, the second conductive layer 23 can be a transparent conductive material or a stack structure of a transparent conductive material and a metal material. For example, the second conductive layer 23 can be a transparent metal oxide conductive material such as indium zinc oxide (IZO), indium tin oxide (ITO), indium gallium zinc oxide (IGZO), etc., and can also be a transparent nanometer conductive material such as carbon nanotubes, graphene, nanometer silver wires, etc.
[0075] It can be understood that the first electrode 2001 of the first light emitting element is formed on the surface of the driving back plate 1 and is electrically connected to the first electrode 113 of the first transistor 12 through the contact hole 14 filled with a conductive material (for example, tungsten) and the plurality of third conductive layers. Figure 1 The insulating layer 15 and the third conductive layer 16 are exemplarily shown as one layer, but the number of layers of the insulating layer 15 and the third conductive layer 16 is not limited in the embodiments of the present disclosure.
[0076] The display panel further includes a first encapsulation layer 3, the first encapsulation layer 3 is arranged on the side of the second electrode away from the substrate substrate, and a color filter layer 4 is arranged on the side of the first encapsulation layer 3 away from the substrate substrate. The color filter layer 4 includes a first light-absorbing portion 41, and the first light-absorbing portion 41 has a first opening, a second opening and a third opening. A red filter pattern 42 is arranged in the first opening, a green filter pattern 43 is arranged in the second opening, and a blue filter pattern 44 is arranged in the third opening. The first light-absorbing portion 41 can further have a fourth opening, and a white filter pattern is arranged in the fourth opening. The light emitted by the first light emitting device 201 and the second light emitting device 202 passes through the color filter layer 4 to form visible light of different colors.
[0077] The display panel further includes a second encapsulation layer 5, and the second encapsulation layer 5 is arranged on the side of the light filter structure 61 away from the substrate substrate. The display panel further includes a microlens layer 8, and the microlens layer 8 is arranged on the side of the second encapsulation layer 5 away from the substrate substrate and located in the display area 100. The microlens layer 8 includes a plurality of second microlenses 82, and the second microlenses 82 are bonded to the second encapsulation layer 5 through a first bonding layer 83. The plurality of second microlenses 82 converge visible light of different colors.
[0078] The driving back plate 1 further comprises a light sensing unit 17 disposed on one side of the substrate and located in the non-display area 200 of the display panel, and the light sensing unit 17 is disposed in the same layer as the driving circuit layer. The light sensing unit 17 can adopt a photodiode 17. In this example, the silicon substrate is doped (p-type doping or n-type doping) to form a second active layer 171, a third electrode 172 and a fourth electrode 173 of the photodiode 17, i.e., the second active layer 171, the third electrode 172 and the fourth electrode 173 of the photodiode are located in the silicon substrate, or the second active layer 171, the third electrode 172 and the fourth electrode 173 of the photodiode 17 are part of the silicon substrate.
[0079] The insulating layer 15 extends to the non-display area 200 and covers the second active layer 171, the third electrode 172 and the fourth electrode 173 of the photodiode. The fourth conductive layer 18 is further provided with a third data line 174 and a fourth data line 175, and the third data line 174 and the fourth data line 175 are connected to the third electrode 172 and the fourth electrode 173 of the photodiode 17 through vias, respectively. In the direction away from the display area 100, the first encapsulation layer 3 extends from the surface of the second electrode 2002 to the surface of the insulating layer 15. It can be understood that the first encapsulation layer 3 covers the second electrode 2002 and the insulating layer 15.
[0080] The light sensing unit 17 senses infrared light, so it is necessary to filter out visible light. In this embodiment, the display panel further comprises a light filtering structure 61 disposed on the side of the encapsulation layer away from the substrate and located in the non-display area 200. The light filtering structure 61 comprises a red light filtering layer 611, a green light filtering layer 612 and a blue light filtering layer 613 stacked together, the red light filtering layer 611 is disposed in the same layer as the color filter layer 4, the blue light filtering layer 613 is disposed on the side of the red light filtering layer 611 away from the substrate, and the green light filtering layer 612 is disposed on the side of the blue light filtering layer 613 away from the substrate. The red light filtering layer 611, the green light filtering layer 612 and the blue light filtering layer 613 all cover the light sensing unit 17 in the substrate. Visible light (380-760nm) can be filtered through three color filters. Of course, other light filtering layers can also be used to filter out visible light, for example: only through the infrared light absorption part.
[0081] The red filter layer 611 has the same thickness as the color filter layer 4. Because of the addition of the green filter layer 612 and the blue filter layer 613, there is a step difference between the second encapsulation layer 5 and the color filter layer 4. To eliminate the step difference between the second encapsulation layer 5 and the color filter layer 4, and between the second encapsulation layer 5 and the first encapsulation layer 3 on the side of the filter structure 61 away from the display area 100, the display panel further includes a filling layer 7. The filling layer 7 includes a first filling portion 71 and a second filling portion 72. The first filling portion 71 is disposed between the second encapsulation layer 5 and the color filter layer 4. The thickness of the first filling portion 71 is equal to the sum of the thicknesses of the blue filter layer 613 and the green filter layer 612. The thickness of the first filling portion 71 is also equal to the sum of the thicknesses of the red filter layer 611, the blue filter layer 613, and the green filter layer 612.
[0082] The display panel also includes a second light-absorbing part 62, which is disposed around the filter structure 61. The thickness of the second light-absorbing part 62 is equal to the sum of the thicknesses of the red filter layer, the blue filter layer 613, and the green filter layer 612. The orthographic projection of the second light-absorbing part 62 on the substrate forms an enclosing area, and the orthographic projection of the photosensitive unit 17 on the substrate covers the enclosing area.
[0083] The microlens layer 8 also includes multiple optical collimating structures, which are located on the side of the second encapsulation layer 5 away from the substrate and in the non-display area 200. The orthogonal projection of the optical collimating structure onto the substrate covers the orthogonal projection of the photosensitive unit 17 onto the substrate. The optical collimating structure is used to collect the infrared light reflected by the eye 500 onto the surface of the photosensitive unit 17. The optical collimating structure can be a first microlens 81, which is disposed in the same layer as the second microlens 82. The first microlens 81 is bonded to the second encapsulation layer 5 through a first adhesive layer 83.
[0084] The display panel also includes a second adhesive layer 84 and a cover plate 9. The second adhesive layer 84 is disposed on the side of the microlens layer 8 away from the substrate 10, and the cover plate 9 is bonded to the side of the second adhesive layer 84 away from the substrate.
[0085] like Figures 2 to 5 As shown, the non-display area 200 is a rectangular frame surrounding the display area 100. The non-display area 200 includes four sub-non-display areas 2001 located around the display area 100. One sub-non-display area 2001 is equipped with a bonding circuit 19, and the other three sub-non-display areas 2001 are each equipped with a set of photosensitive units 17. The number of photosensitive units 17 in one sub-non-display area 2001 is:
[0086]
[0087] Where γ is the field of view of the eye when viewing the display panel at 500 degrees, and η is the change in viewing angle.
[0088] For example, if the viewing angle γ of eye 500 is 90° when viewing the display panel, and the viewing angle variation value η is 2°, then the number of light-sensing units 17 set in a sub-non-display area 2001 is 45. It should be noted that this is merely an illustrative example and does not limit the number of light-sensing units 17. The corresponding number of light-sensing units 17 can be made according to different viewing angle variation values.
[0089] The photosensitive unit 17 receives infrared light at a collimated angle. The eye movement distance is connected to the center of the optical collimation structure, forming the collimation angle of the optical collimation structure. The collimation angle is calculated using the following formula:
[0090]
[0091]
[0092] Where D is the distance between the eye 500 and the light-sensing unit 17, m is the eye movement distance, w is the width of the eye movement range 5001, and q is the number of light-sensing units 17 set in a sub-non-display area 2001.
[0093] The eye-box 5001 has a virtual border of 8mm × 8mm (industry experience value). The distance m of the eye 500 can be calculated to be 178um, and the distance D between the eye 500 and the photosensitive unit 17 is 50.009mm. The optical path adjustment lens will have a scaling effect on the size of the eye-box 5001 and the distance D between the eye 500 and the photosensitive unit 17. After the optical path adjustment lens, the distance m of the eye 500 is 591um, the distance D between the eye 500 and the photosensitive unit 17 is 60.1mm, and the collimation angle θ is 1.13°.
[0094] like Figure 6 As shown, each photosensitive unit 17 receives infrared light reflected from different eye movement distances, and their corresponding collimation angles do not overlap. Therefore, the ratio of the size of the photosensitive unit 17 to the size of the optical collimation structure needs to be small, and the photosensitive unit 17 needs to have sensitivity to receive a small amount of light. For example... Figure 7 As shown, the collimation angles corresponding to adjacent photosensitive units 17 intersect each other, reducing the requirements for the ratio of the size of the photosensitive unit 17 to the size of the optical collimation structure, as well as the sensitivity to light flux.
[0095] like Figures 8 to 12 As shown, the theoretically calculated optimal collimation angle θ is 1.13°. However, during the design phase, the maximum luminous flux is pursued to improve the light signal received by the photosensitive unit 17. When the eye 500 observes the display panel, the size of the pupil 5002 will change between 2.5mm and 4mm depending on the brightness. The signal difference between two adjacent photosensitive units 17 is calculated using the following formula:
[0096] ΔS = S1 - S0 4);
[0097] S0 = A1 x a1 + (A21 + A22) x a2 5);
[0098] S1 = B3 x a1 + (B21 + B22) x a2 6);
[0099] wherein, ΔS is the signal difference, S0 is the signal value of the first light sensing unit 1701, S1 is the signal value of the second light sensing unit 1702, A1 is the coverage area of the collimation angle corresponding to the first light sensing unit 1701 on the pupil, A21 is the coverage area of the collimation angle corresponding to the first light sensing unit 1701 on the iris on one side of the pupil, A22 is the coverage area of the collimation angle corresponding to the first light sensing unit 1701 on the iris on the other side of the pupil; B1 is the coverage area of the collimation angle corresponding to the second light sensing unit 1702 on the pupil, B21 is the coverage area of the collimation angle corresponding to the second light sensing unit 1702 on the iris on one side of the pupil, B22 is the coverage area of the collimation angle corresponding to the second light sensing unit 1702 on the iris on the other side of the pupil, a1 is the reflectivity of the pupil to infrared light, a2 is the reflectivity of the iris to infrared light. As can be seen from the figure, the first light sensing unit 1701 is arranged adjacent to the second light sensing unit 1702.
[0100] The collimation angle corresponding to the light sensing unit 17 increases, so the eye movement distance becomes larger, and to achieve the same angle of view change value, the signal difference ΔS needs to be maximized, so that more light flux can be reflected to the light sensing unit 17 under the same angle of view change value. Pursuing the maximization of the signal difference ΔS, the signal difference ΔS reaches the maximum when A1 is the size of the pupil 5002. For the same angle of view change value, the increase of the collimation angle can be realized, and the theoretically optimal collimation angle is between 1.13° and 3.9°. According to the calculation, the light sensing unit 17 can receive 0 to ±3.9° of infrared light reflected by the eye 500.
[0101] The optical collimation structure can be the first microlens 81, or a slit or a hole, etc. In the present embodiment, the optical collimation structure is a circular first microlens 81. After determining the size of the collimation angle, the size of the first microlens 81 and the thickness of each layer between the light sensing unit 17 and the first microlens 81 can be determined.
[0102] As shown in FIG. 8, the first microlens 81 is a circular first microlens, and the light signal received by the light sensing unit 17 is the strongest when the focal point of the first microlens 81 is located on the surface of the light sensing unit 17. While ensuring the focal length, the radius of curvature of the circular first microlens satisfies: Figures 1 to 3
[0103] R = (n1 x L1 +... nt x Lt) x (nlens - 1) 7);
[0104] n1 is the refractive index of the first layer between the circular first microlens and the light sensing unit 17, nt is the refractive index of the tth layer, L1 is the thickness of the first layer, Lt is the thickness of the tth layer, and R is the radius of curvature of the circular first microlens.
[0105] In the present embodiment, for the silicon-based display panel, the insulating layer, the pixel definition layer and the substrate are all arranged on the silicon substrate, and thus the materials of the insulating layer, the pixel definition layer and the substrate are the same, and these layers can be considered as the first layer in formula 7. The materials of the first encapsulating layer 3 and the second encapsulating layer 5 are the same, and can be considered as the second layer in formula 7, and the first adhesive layer 83 can be considered as the third layer in formula 7.
[0106] The arch height and the aperture of the circular first microlens are calculated by the following formula:
[0107] R 2 = (R - d) + (h / 2) 2 +(h / 2) 2 8);
[0108] wherein R is the radius of curvature of the circular first microlens, d is the aperture of the circular first microlens, and h is the arch height of the circular first microlens.
[0109] According to the material and thickness of each layer between the circular first microlens and the light sensing unit 17, the radius of curvature of the circular first microlens can be calculated. By setting the arch height of the circular first microlens, the aperture of the circular first microlens can be calculated by the above formula. The setting of the arch height of the circular first microlens can be derived from the relationship between the arch height of the first microlens and the signal amount of the light sensing unit 17.
[0110] As shown in FIG. 8, the first microlens 81 can also be a columnar first microlens. The height of the columnar first microlens is greater than the aperture of the circular first microlens, and thus the light flux of the columnar first microlens is greater than that of the circular first microlens. In order to realize the sensing of the infrared light converging in different directions, the plurality of first microlenses are divided into two setting modes. Specifically, the plurality of columnar first microlenses can include columnar first microlenses arranged along a first direction and columnar first microlenses arranged along a second direction, and the second direction is perpendicular to the first direction. Figures 13 to 15 The four sub-non-display areas 2001 include two first sub-non-display areas 200 extending along a first direction and second sub-non-display areas 200 extending along a second direction. One of the first sub-non-display areas 200 is arranged with the binding circuit 19, and the other first sub-non-display area 200 is arranged with the columnar first microlenses arranged along the second direction. The two second sub-non-display areas 200 are arranged with the columnar first microlenses arranged along the first direction. It should be noted that the first direction is the direction in which the columnar first microlenses are arranged, and the second direction is the direction in which the light sensing unit 17 is arranged.
[0111] Figure 14 The second direction is a direction perpendicular to the x direction shown in the figure. Figure 14 The second direction is a direction perpendicular to the x direction shown in the figure.
[0112] In other implementable embodiments, the columnar first microlenses arranged in the first direction and the columnar first microlenses arranged in the second direction can also be alternately arranged in one columnar first microlens in one sub-non-display area 2001. That is, the columnar first microlenses arranged in the second direction are arranged between two adjacent columnar first microlenses arranged in the first direction, and the columnar first microlenses arranged in the first direction are arranged between two adjacent columnar first microlenses arranged in the second direction.
[0113] Figure 16 A schematic diagram of the relationship between the height of the first microlens and the signal amount of the light sensing unit 17 is shown in the figure. As can be seen from the figure, when the height of the first microlens is about 2 microns, the signal amount of the light sensing unit 17 is the largest. In the case where the signal strength is unchanged, that is, the angle range of receiving infrared light is the largest, that is, the collimation angle of the first microlens is the largest.
[0114] The display device according to any one of the above embodiments of the present disclosure can further include an optical path adjusting lens 400 and an infrared light source 300. Figure 17 As shown in the figure, the display device can include the optical path adjusting lens 400, the infrared light source 300, and the display panel according to any one of the above embodiments of the present disclosure. The infrared light source 300 is arranged at the periphery of the lens, and the display panel is arranged on the side of the infrared light source 300 and the optical path adjusting lens 400 away from the eye 500. The specific structure and beneficial effects of the display panel have been described in detail above, and therefore, will not be described here.
[0115] It should be noted that, in addition to the display panel, the display device also includes other necessary components and compositions, for example, a circuit board, a power line, etc. Those skilled in the art can supplement accordingly according to the specific use requirements of the display device, and will not be described here.
[0116] The display device can be a conventional electronic device, for example, a mobile phone, a computer, a television, a projector, and a camcorder, or a new wearable device, for example, a VR wearable device, which will not be listed here. When the display device is a VR wearable device, the optical path adjusting lens 400 is a VR lens.
[0117] The display device according to any one of the above embodiments of the present disclosure can further include a method for identifying the gazed position.
[0118] As shown in the figure, the method includes: Figure 18 As shown in the figure, the method includes:
[0119] In step S10, infrared light is emitted to the eye by the infrared light source.
[0120] Step S20, when the infrared light reflected by the eye is reflected to the light path collimation structure, if the infrared light signal amount sensed by a certain light sensing unit is less than the infrared light signal amount of the light sensing units in the surrounding area, it is determined that the pupil is staring at the position of the light sensing unit.
[0121] When the display device is a VR wearable device, because the reflectivity difference between the pupil and the iris in the near-infrared wave band is large, the pupil center can be located through subsequent data processing, and the real-time gaze point can be calculated through the pre-established mapping relationship between the pupil center and the gaze point position. It is not necessary to shoot the image of the eye by the camera, the gaze position of the eye can be quickly determined through the light sensing units at different positions of the non-display area, the data amount is small, the information processing time is reduced, and the response speed is improved.
[0122] Through eye movement tracking, the eye movement trajectory obtained can be used as a command in the VR wearable device, and the eye and the VR wearable device are more interactive. In this way, the command can be issued through more convenient eye movement, and stronger interactivity is provided.
[0123] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses or adaptive changes of this disclosure that follow the general principles of this disclosure and include common knowledge or conventional technical means in the art not disclosed in this disclosure. The specification and examples are only regarded as exemplary, and the true scope and spirit of the disclosure are indicated by the appended claims.
Claims
1. A display panel having a display area and a non-display area located at a periphery of the display area, characterized by, The display panel further comprises: a substrate substrate; a plurality of optical collimation structures arranged on one side of the substrate substrate and located in the non-display area; a plurality of optical focusing structures arranged on one side of the substrate substrate and located in the display area; a plurality of light sensing units arranged between the substrate substrate and the optical collimation structures and located in the non-display area, the plurality of light sensing units corresponding one-to-one to the plurality of optical collimation structures; The optical collimation structure is used to collect the infrared light reflected by the eye to the surface of the light sensing unit; The plurality of optical collimation structures and the plurality of optical focusing structures are of the same layer and the same material; The angle range of the light sensing unit receiving infrared light is a collimation angle, and the collimation angle is obtained by the following formula: 1); 2); 3); Wherein, D is the distance between the eye and the light sensing unit, m is the eye movement distance, w is the width of the eye movement range, q is the number of light sensing units arranged in the non-display area on one side of the display area, γ is the field of view angle of the eye watching the display panel, and η is the view angle change value; The signal difference between the two adjacent light sensing units is obtained by the following formula: 4); 5); 6); Wherein, △S is the signal difference, S0 is the signal value of the first light sensing unit, S1 is the signal value of the second light sensing unit, A1 is the coverage area of the collimation angle corresponding to the first light sensing unit on the pupil, A21 is the coverage area of the collimation angle corresponding to the first light sensing unit on the iris on one side of the pupil, A22 is the coverage area of the collimation angle corresponding to the first light sensing unit on the iris on the other side of the pupil; B1 is the coverage area of the collimation angle corresponding to the second light sensing unit on the pupil, B21 is the coverage area of the collimation angle corresponding to the second light sensing unit on the iris on one side of the pupil, B22 is the coverage area of the collimation angle corresponding to the second light sensing unit on the iris on the other side of the pupil, α1 is the reflectivity of the pupil to infrared light, and α2 is the reflectivity of the iris to infrared light; The coverage area of the first light sensing unit on the collimation angle on the pupil is equal to the size of the pupil.
2. The display panel of claim 1, wherein, The size of the collimation angle is between 1.13 degrees and 3.9 degrees.
3. The display panel of claim 1, wherein, The optical collimation structure is a first microlens, and the focal point of the first microlens is located on the surface of the light sensing unit.
4. The display panel of claim 3, wherein, The first microlens is a circular first microlens and / or a columnar first microlens, and the height of the columnar first microlens is greater than the aperture of the circular first microlens.
5. The display panel of claim 4, wherein, The first microlens is a circular first microlens, and the radius of curvature of the circular first microlens satisfies: 7); In the direction away from the substrate substrate, n1 is the refractive index of the first layer between the first microlens and the light sensing unit, nt is the refractive index of the tth layer, L1 is the thickness of the first layer, Lt is the thickness of the tth layer, and R is the radius of curvature of the circular first microlens.
6. The display panel of claim 1, wherein, The display panel further comprises a light filtering structure arranged between the optical collimation structure and the light sensing unit, and the light filtering structure comprises a red light filtering layer, a green light filtering layer and a blue light filtering layer arranged in layers.
7. The display panel of claim 6, wherein, The display panel further comprises a second light absorbing portion, the second light absorbing portion is arranged at the periphery of the light filtering structure, the orthographic projection of the second light absorbing portion on the substrate substrate forms an enclosed area, and the orthographic projection of the light sensing unit on the substrate substrate covers the enclosed area.
8. The display panel of claim 3, wherein, The first microlens is a columnar first microlens, and the first microlens includes columnar first microlenses arranged along a first direction and columnar first microlenses arranged along a second direction perpendicular to the first direction.
9. The display panel of claim 1, wherein, The non-display area includes four sub-non-display areas located around the display area, one of the sub-non-display areas is provided with a binding circuit, and the other three sub-non-display areas are respectively provided with a group of the light sensing units.
10. The display panel of claim 1, wherein, The display panel further includes a driving circuit layer, and the light sensing units are arranged in the same layer as the driving circuit layer.
11. A display device comprising: Comprising: a light path adjusting lens; an infrared light source arranged at the periphery of the light path adjusting lens; The display panel according to any one of claims 1 to 10 is arranged on a side of the infrared light source and the light path adjusting lens away from the eye.
12. A method of identifying a gazed position of a display device according to claim 11, characterized by, The method comprises: emitting infrared light to the eye by an infrared light source; when the infrared light reflected by the eye is reflected to the optical collimation structure, if the infrared light signal amount sensed by a certain light sensing unit is less than that of the light sensing units in the surrounding area, it is determined that the pupil is staring at the position of the light sensing unit.
Citation Information
Patent Citations
Silicon-based OLED micro-display with eye tracking function and preparation method thereof
CN111562669A
Near-eye display device and virtual / augmented reality equipment
CN112987295A
Display panel and preparation method thereof, display equipment, display system and display method
CN113655649A