Methods for determining the position of display devices, wearable display devices, and the point of gaze.

Abstract

This application discloses a display device, a wearable display device, and a method for determining the position of the gaze point, relating to the field of virtual reality technology. Because the processing circuit in the display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the processing circuit can quickly determine the position of the user's gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a higher refresh rate.

Description

Technical Field

[0001] This application relates to the field of virtual reality technology, and in particular to a display device, a wearable display device, and a method for determining the position of the gaze point. Background Technology

[0002] Virtual reality (VR) devices are devices that can create virtual environments through displayed images, allowing users to immerse themselves in those virtual environments.

[0003] In related technologies, VR devices include a display panel, a camera, a processor, and a driving circuit. The camera captures images of the user's eyes. The processor determines the position of the user's gaze point on the display panel based on the eye images and performs local rendering of the desired display image based on the gaze point position. The driving circuit drives the display panel to display the image based on the locally rendered image sent by the processor. Because the processor can perform local rendering only on the area where the gaze point is located in the display image, without needing to perform global rendering of the display image, it not only reduces the processor's load but also ensures the display effect of the display panel.

[0004] However, in related technologies, the processor is inefficient at determining the position of the gaze point based on the eye image captured by the camera, which in turn leads to low display efficiency of the display panel. Summary of the Invention

[0005] This application provides a display device, a wearable display device, and a method for determining the position of the gaze point, which can solve the problem of low efficiency in determining the position of the gaze point in related technologies. The technical solution is as follows:

[0006] On one hand, a display device is provided, the display device comprising:

[0007] A display panel having a display area and a peripheral area surrounding the display area;

[0008] Multiple photoelectric sensing components are located in the surrounding area. Each photoelectric sensing component is used to receive light signals reflected from the user's eye and convert the light signals into electrical signals.

[0009] The system also includes a processing circuit connected to each of the photoelectric sensing components. The processing circuit is used to determine the position of the user's gaze point on the display panel based on the magnitude of the signal value of the electrical signal sent by each of the photoelectric sensing components and the position of at least one of the photoelectric sensing components.

[0010] Optionally, the surrounding area includes: a first area extending along a first direction and a second area extending along a second direction, wherein the first direction intersects the second direction; the plurality of photoelectric sensing components include a plurality of first photoelectric sensing components and a plurality of second photoelectric sensing components;

[0011] The plurality of first photoelectric sensing components are located in the first region and arranged along the first direction, and the plurality of second photoelectric sensing components are located in the second region and arranged along the second direction.

[0012] Optionally, the first direction is perpendicular to the second direction; the surrounding area includes: two first areas and two second areas;

[0013] The two first regions are arranged along the second direction and are respectively located on both sides of the display area, and the two second regions are arranged along the first direction and are respectively located on both sides of the display area.

[0014] Optionally, the processing circuit is used for:

[0015] Determine the first coordinate value of the target first photoelectric sensor component with the smallest signal value of the electrical signal transmitted among the plurality of first photoelectric sensor components;

[0016] Determine the second coordinate value of the target second photoelectric sensor component with the smallest signal value of the electrical signal transmitted among the plurality of second photoelectric sensor components;

[0017] The position of the user's gaze point on the display panel is determined based on the first coordinate value and the second coordinate value.

[0018] Optionally, the display device further includes: a control circuit; each of the photoelectric sensing components includes: a switching transistor and a photodiode;

[0019] The photodiode includes: a substrate, and a pixel electrode, a P-type material layer, a photosensitive material layer, an N-type material layer, and a common electrode, which are sequentially stacked on one side of the substrate and in a direction away from the substrate.

[0020] The first electrode of the switching transistor is electrically connected to the pixel electrode, the second electrode of the switching transistor is electrically connected to the processing circuit, and the control electrode of the switching transistor is electrically connected to the control circuit. The control circuit is used to control the switching transistor to turn on and off.

[0021] Optionally, the display panel includes a plurality of sub-pixels located in the display area, each sub-pixel including at least one pixel transistor;

[0022] The switching transistor and the pixel transistor are fabricated using the same process.

[0023] Optionally, each of the photoelectric sensing components includes a first bonding pattern and a second bonding pattern for electrical connection;

[0024] The first bonding pattern is electrically connected to the first electrode of the switching transistor, and the second bonding pattern is electrically connected to the pixel electrode of the photodiode.

[0025] Optionally, the processing circuit is a driving circuit; the driving circuit is further configured to drive the display panel to display an image based on the position of the user's eye's gaze point on the display panel.

[0026] Optionally, the pixel electrode is located away from the display panel relative to the common electrode, and the pixel electrode is made of a transparent material.

[0027] Optionally, the display device further includes: a flexible circuit board attached to the peripheral area;

[0028] The switching transistor is located on the flexible circuit board.

[0029] Optionally, the processing circuit is a processor; the display device further includes a driving circuit connected to the processor;

[0030] The processor is also configured to send the position of the user's eye gaze point on the display panel to the driving circuit, the driving circuit being configured to drive the display panel to display an image based on the position of the gaze point.

[0031] Optionally, the common electrode is located away from the display panel relative to the pixel electrode, and the material of the common electrode is a transparent material.

[0032] Optionally, the display device further includes: a plurality of filters corresponding one-to-one with the plurality of photoelectric sensing components, each of the filters being located on the side of the corresponding photoelectric sensing component away from the display panel;

[0033] The filter is used to transmit infrared light and absorb visible light.

[0034] On the other hand, a wearable display device is provided, the wearable display device comprising: a display device as described above, a lens located on the display side of the display device, and a plurality of light-emitting elements located on the edge of the lens;

[0035] The emission direction of the plurality of light-emitting elements is opposite to that of the display device.

[0036] Optionally, all of the plurality of light-emitting elements are infrared light-emitting diodes.

[0037] In another aspect, a method for determining the position of the gaze point is provided, applied to the display device described above, the method comprising:

[0038] Receives light signals reflected from the user's eyes;

[0039] The optical signal is converted into an electrical signal;

[0040] Based on the magnitude of the electrical signal value and the position of at least one photoelectric sensing component, the position of the user's gaze point on the display panel is determined.

[0041] Optionally, determining the position of the user's eye's gaze point on the display panel based on the electrical signal includes:

[0042] The driving circuit in the display device determines the position of the user's eye gaze point on the display panel based on the electrical signal;

[0043] The method further includes: the driving circuit sending the position of the gaze point to the processor of the display device;

[0044] The processor renders the image to be displayed in the display device based on the position of the gaze point, and sends the rendered image to the driving circuit;

[0045] The driving circuit drives the display panel to display based on the rendered image to be displayed.

[0046] Optionally, determining the position of the user's eye's gaze point on the display panel based on the electrical signal includes:

[0047] The processor in the display device determines the position of the user's eye gaze point on the display panel based on the electrical signal;

[0048] The method further includes:

[0049] The processor renders the image to be displayed in the display device based on the position of the gaze point, and sends the rendered image to the driving circuit;

[0050] The driving circuit drives the display panel to display based on the rendered image to be displayed.

[0051] Optionally, determining the position of the user's eye's gaze point on the display panel based on the electrical signal includes:

[0052] At least one target first photoelectric sensing component is identified from a plurality of first photoelectric sensing components arranged along a first direction;

[0053] At least one target second photoelectric sensor component is identified from a plurality of second photoelectric sensor components arranged along the second direction;

[0054] The position of the user's gaze point on the display panel is determined based on the position of the first photoelectric sensing component of each target and the position of the second photoelectric sensing component of each target;

[0055] Wherein, the signal value of the electrical signal transmitted by the first photoelectric sensing component of the target is less than or equal to a first threshold, and the signal value of the electrical signal transmitted by the second photoelectric sensing component of the target is less than or equal to a second threshold.

[0056] Optionally, determining the position of the user's eye's gaze point on the display panel based on the electrical signal includes:

[0057] Determine the first coordinate value of the target first photoelectric sensor component that transmits the electrical signal with the smallest value among a plurality of first photoelectric sensor components arranged along the first direction;

[0058] Determine the second coordinate value of the target second photoelectric sensor component that transmits the electrical signal with the smallest value among the plurality of second photoelectric sensor components arranged along the second direction;

[0059] The position of the user's gaze point on the display panel is determined based on the first coordinate value and the second coordinate value;

[0060] Wherein, the first direction intersects with the second direction.

[0061] In another aspect, a computer-readable storage medium is provided, wherein instructions are stored therein, which are executed by a display device to implement the method for determining the position of the gaze point as described above.

[0062] In another aspect, a computer program product containing instructions is provided, which, when run on the computer, causes the computer to perform the method for determining the position of the gaze point described above.

[0063] The beneficial effects of the technical solution provided in this application include at least the following:

[0064] This application provides a display device, a wearable display device, and a method for determining the position of the gaze point. Since the processing circuit in the display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the processing circuit can quickly determine the position of the user's gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a high refresh rate for the display panel. Attached Figure Description

[0065] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0066] Figure 1 This is a schematic diagram of the structure of a display device provided in an embodiment of this application;

[0067] Figure 2 This is a top view of a display panel provided in an embodiment of this application;

[0068] Figure 3 This is a schematic diagram of another display device provided in an embodiment of this application;

[0069] Figure 4 This is a schematic diagram of a photoelectric sensing component provided in an embodiment of this application;

[0070] Figure 5 This is a schematic diagram of an optoelectronic sensing component, processing circuit, and control circuit provided in an embodiment of this application;

[0071] Figure 6 This is a partial schematic diagram of a display device provided in an embodiment of this application;

[0072] Figure 7 This is a partial schematic diagram of another display device provided in an embodiment of this application;

[0073] Figure 8 This is a schematic diagram of a photodiode provided in an embodiment of this application;

[0074] Figure 9 This is a schematic diagram of the structure of another display device provided in the embodiments of this application;

[0075] Figure 10 This is a schematic diagram of another display device provided in the embodiments of this application;

[0076] Figure 11 This is a partial schematic diagram of another display device provided in the embodiments of this application;

[0077] Figure 12 This is a partial schematic diagram of another display device provided in an embodiment of this application;

[0078] Figure 13 This is a partial schematic diagram of another display device provided in an embodiment of this application;

[0079] Figure 14This is a schematic diagram of another display device provided in the embodiments of this application;

[0080] Figure 15 This is a schematic diagram of a wearable display device provided in an embodiment of this application;

[0081] Figure 16 This is a flowchart of a method for determining a gaze point provided in an embodiment of this application;

[0082] Figure 17 This is a flowchart of another method for determining gaze points provided in an embodiment of this application;

[0083] Figure 18 This is a flowchart of another method for determining the gaze point provided in the embodiments of this application. Detailed Implementation

[0084] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0085] The terminology used in the embodiments section of this application is for illustrative purposes only and is not intended to limit the application. Unless otherwise defined, the technical or scientific terms used in the embodiments of this application should have the ordinary meaning understood by one of ordinary skill in the art to which this application pertains. The terms "first," "second," "third," and similar terms used in the patent application specification and claims of this application do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms "a" or "one," and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms "comprising" or "including," and similar terms mean that the elements or objects preceding "comprising" or "including" encompass the elements or objects listed following "comprising" or "including" and their equivalents, and do not exclude other elements or objects. The terms "connected," "linked," and similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up," "down," "left," "right," etc., are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0086] Figure 1 This is a schematic diagram of the structure of a display device provided in an embodiment of this application. (Reference) Figure 1 As can be seen, the display device 01 may include: a display panel 011, multiple photoelectric sensing components 012, and a processing circuit 013.

[0087] The display panel 011 has a display area 011a and a peripheral area 011b surrounding the display area 011a. A plurality of photoelectric sensing components 012 may be located in the peripheral area 011b, each photoelectric sensing component 012 being used to receive light signals reflected from the user's eye and convert the light signals into electrical signals.

[0088] The processing circuit 013 can be connected to each photoelectric sensing component 012, and can receive electrical signals sent by each photoelectric sensing component 012. The processing circuit 013 is used to determine the position of the user's gaze point on the display panel 011 based on the magnitude of the signal values ​​of the electrical signals sent by each photoelectric sensing component 012 and the position of at least one photoelectric sensing component. Figure 1 The diagram only shows the processing circuit 013 connected to one photoelectric sensing component 012. In reality, the processing circuit 013 is connected to each photoelectric sensing component 012 to ensure that the processing circuit 013 can receive the electrical signals sent by each photoelectric sensing component 012.

[0089] In this embodiment, the processing circuit 013 may pre-store the positions of each photoelectric sensing component 012. Since different areas of the human eye have different reflectivities for light (e.g., infrared light), the photoelectric sensing component 012 receives different light signals reflected from different areas of the human eye. The electrical signals converted from these different light signals by the photoelectric sensing component 012 have different signal values. Therefore, the processing circuit can determine the position of the user's gaze point on the display panel 011 based on the magnitude of the electrical signal value and the position of the photoelectric sensing component 012.

[0090] Typically, electrical signals involve less data than images, so the processing circuit 013 is more efficient at processing electrical signals than at processing images. In this embodiment, the processing circuit 013 is highly efficient at processing the electrical signals sent by each photoelectric sensing component 012, enabling it to quickly determine the position of the user's gaze point on the display panel 011. This, in turn, improves the efficiency of the display panel 011 in displaying images, resulting in a higher refresh rate for the display panel 011.

[0091] Furthermore, since the multiple photoelectric sensing components 012 are located in the peripheral area 011b of the display panel 011, the multiple photoelectric sensing components 012 will not affect the normal display of the display panel 011, and the display effect of the display panel 011 is good.

[0092] In summary, the embodiments of this application provide a display device. Since the processing circuit in the display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the processing circuit can quickly determine the position of the user's eye gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a high refresh rate for the display panel.

[0093] Figure 2 This is a top view of a display panel provided in an embodiment of this application. (Reference) Figure 2 As can be seen, the peripheral area 011b of the display panel 011 includes: a first area 011b1 extending along the first direction X and a second area 011b2 extending along the second direction Y. The first direction X intersects the second direction Y.

[0094] Combination Figure 1 and Figure 2 It can be seen that the plurality of photoelectric sensing components 012 may include: a plurality of first photoelectric sensing components 012a and a plurality of second photoelectric sensing components 012b. The plurality of first photoelectric sensing components 012a are located in the first region 011b1 and are arranged along the first direction X. The plurality of second photoelectric sensing components 012b are located in the second region 011b2 and are arranged along the second direction Y.

[0095] Optionally, a plurality of first photoelectric sensing components 012a are evenly arranged along the first direction X, and a plurality of second photoelectric sensing components 012b are evenly arranged along the second direction Y.

[0096] In this embodiment, the processing circuit 013 can receive electrical signals sent by each of the plurality of first photoelectric sensing components 012a, and can determine at least one target first photoelectric sensing component from the plurality of first photoelectric sensing components 012a. The processing circuit 013 can also receive electrical signals sent by each of the plurality of second photoelectric sensing components 012b, and can determine at least one target second photoelectric sensing component from the plurality of second photoelectric sensing components 012b. Finally, the processing circuit 013 can determine the position of the user's eye gaze point on the display panel 011 based on the position of at least one target first photoelectric sensing component and the position of at least one target second photoelectric sensing component.

[0097] The signal value of the electrical signal transmitted by the first photoelectric sensing component can be less than or equal to a first threshold, and the signal value of the electrical signal transmitted by the second photoelectric sensing component can be less than or equal to a second threshold. The first threshold and the second threshold can be equal or unequal; this embodiment does not limit this.

[0098] The user's eye includes the pupil, sclera, and iris. The position of the user's gaze point on the display panel 011 is the same as the position of the pupil's gaze point on the display panel 011. Since the pupil is the darkest color, it reflects the least amount of light. Furthermore, the electrical signal converted from the reflected light signal is also minimal. Therefore, based on the signal values ​​of the electrical signals transmitted by the first photoelectric sensing component (less than or equal to a first threshold) and the second photoelectric sensing component (less than or equal to a second threshold), the position of the user's pupil's gaze point on the display panel 011 can be determined.

[0099] Optionally, the first threshold and the second threshold can be fixed values ​​pre-stored in the processing circuit 013. Alternatively, the first threshold can be determined by the processing circuit 013 based on the signal values ​​of the electrical signals received from the plurality of first photoelectric sensing components 012a. The second threshold can be determined by the processing circuit 013 based on the signal values ​​of the electrical signals received from the plurality of second photoelectric sensing components 012b.

[0100] For example, the processing circuit 013 can arrange the signal values ​​of N electrical signals sent by N first photoelectric sensing components 012a in ascending order, and can determine the signal value located at the nth position as a first threshold. Here, N is an integer greater than 1, and n is an integer greater than 1 and less than N / 2. The processing circuit 013 can also arrange the signal values ​​of M electrical signals sent by M second photoelectric sensing components 012b in ascending order, and can determine the signal value located at the mth position as a second threshold. Here, M is an integer greater than 1, and m is an integer greater than 1 and less than M / 2.

[0101] Alternatively, the processing circuit 013 determines the signal value with the smallest signal value among the multiple first photoelectric sensing components 012a as the first threshold, and determines the signal value with the smallest signal value among the multiple second photoelectric sensing components 012b as the second threshold.

[0102] In this embodiment, the processing circuit 013 can determine the first coordinate value of the target first photoelectric sensor component with the smallest signal value of the electrical signal transmitted among the plurality of first photoelectric sensor components 012a, and can determine the second coordinate value of the target second photoelectric sensor component with the smallest signal value of the electrical signal transmitted among the plurality of second photoelectric sensor components 012b. The processing circuit 013 can determine the position of the user's eye's gaze point on the display panel 011 based on the first and second coordinate values.

[0103] In the embodiments of this application, reference is made to Figure 2 The first direction X is perpendicular to the second direction Y. The first direction X can be the pixel row direction of the display panel 011, and the second direction Y can be the pixel column direction of the display panel 011.

[0104] refer to Figure 2 The surrounding area 011b may include two first areas 011b1 and two second areas 011b2. The two first areas 011b1 may be arranged along the second direction Y and are located on either side of the display area 011a. The two second areas 011b2 may be arranged along the first direction X and are located on either side of the display area 011a. Accordingly, refer to... Figure 3 Among the plurality of first photoelectric sensing components 012a included in the plurality of photoelectric sensing components 0122, a portion of the first photoelectric sensing components 012a are located in a first region 011b1, and another portion of the first photoelectric sensing components 012a are located in another first region 011b1. Among the plurality of second photoelectric sensing components 012b included in the plurality of photoelectric sensing components 0122, a portion of the second photoelectric sensing components 012b are located in a second region 011b2, and another portion of the second photoelectric sensing components 012b are located in another second region 011b2.

[0105] Therefore, the processing circuit 013 can determine the position of the user's gaze point on the display panel 011 based on the first photoelectric sensing component 012a of the two first regions 011b1 and the second photoelectric sensing component 012b of the two second regions 011b2, thereby improving the accuracy of the determined gaze point position.

[0106] In this embodiment of the application, the display device 01 may further include a control circuit. Figure 4 This is a schematic diagram of the structure of a photoelectric sensing component provided in an embodiment of this application. (Reference) Figure 4 It can be seen that the photoelectric sensing component 012 may include: a switching transistor 0121 and a photodiode 0122.

[0107] Optionally, the photodiode 0122 can be a hydrogenated amorphous silicon diode or an organic photodiode (OPD). Among them, the organic photodiode has a better response to infrared light than the hydrogenated amorphous silicon diode.

[0108] This application uses photodiode 0122 as an example of an organic photodiode. (See reference...) Figure 4 The photodiode 0122 includes: a substrate 01221, and a pixel electrode 01222, a P-type material layer 01223, a photosensitive material layer 01224, an N-type material layer 01225 and a common electrode 01226, which are sequentially stacked on one side of the substrate 01221 and in a direction away from the substrate 01221.

[0109] refer to Figure 5The first electrode of the switching transistor 0121 is electrically connected to the pixel electrode 01222, the second electrode of the switching transistor 0121 is electrically connected to the processing circuit 013, and the control electrode of the switching transistor 0121 is electrically connected to the control circuit 014. The control circuit 014 is used to control the switching transistor 0121 to turn on and off. The substrate 01221 can be made of glass. Figure 4 The diagram only shows the first electrode of the switching transistor 0121 being electrically connected to the pixel electrode 01222, and does not show the electrical connection between the switching transistor 0121 and the processing circuit 013 and the control circuit 014.

[0110] Optionally, the photodiode 0122 may further include a driver chip located on one side of the substrate 01221 and a connection trace located on the same layer as the pixel electrode 01222. One end of the connection trace is connected to the driver chip, and the other end of the connection trace is connected to the common electrode 01226. The driver chip is used to provide a signal to the common electrode 01226 through the connection trace.

[0111] When the driver chip provides a signal to the common electrode 01226, the photodiode 0122 receives the light signal reflected from the user's eye and converts the light signal into an electrical signal. The control circuit 014 controls the switching transistor 0121 to turn on, and the electrical signal is transmitted to the processing circuit 013 through the switching transistor 0121.

[0112] In this embodiment of the application, the display panel 011 includes a plurality of sub-pixels located in the display area 011a, and each sub-pixel includes at least one pixel transistor.

[0113] As an optional implementation, the switching transistor 0121 in the photoelectric sensing component 012 can be fabricated using the same process as the pixel transistor. That is, referring to... Figure 6 The switching transistor 0121 in the photoelectric sensing component 012 can be integrated into the display panel 011.

[0114] Figure 7 This is a cross-sectional view of a display panel and a photoelectric sensing component provided in an embodiment of this application. (Reference) Figure 7 As can be seen, the photoelectric sensing component 012 may include a first bonding pattern 0123 and a second bonding pattern 0124 for electrical connection. The first bonding pattern 0123 can be electrically connected to the first electrode of the switching transistor 0121, and the second bonding pattern 0124 can be electrically connected to the pixel electrode 01222 of the photodiode 0122. Thus, by setting the first bonding pattern 0123 and the second bonding pattern 0124, the first electrode of the switching transistor 0121 of the photoelectric sensing component 012 is electrically connected to the pixel electrode 01222 of the photodiode 0122.

[0115] Optionally, an anisotropic conductive film (ACF) 0125 may be present between the first bonding pattern 0123 and the second bonding pattern 0124. The bonding connection between the first bonding pattern 0123 and the second bonding pattern 0124 is achieved through the ACF.

[0116] Optionally, the pixel electrode 01222, the common electrode 01226, the first bonding pattern 0123, and the second bonding pattern 0124 are all made of conductive materials to ensure effective signal transmission.

[0117] Figure 8 This is a schematic diagram of a photodiode and a second bonding pattern provided in an embodiment of this application. (Reference) Figure 8 It can be seen that the second bonding pattern 0124 can be located on the same layer as the pixel electrode 01222 of the photodiode 0122, and there is a gap between the second bonding pattern 0124 and the pixel electrode 01222.

[0118] refer to Figure 4 and Figure 8 It can be seen that the photoelectric sensing component 012 may also include an encapsulation layer 0126. The encapsulation layer 0126 may be located on the side of the common electrode 01226 away from the substrate 01221, and is used to encapsulate the photodiode 0122 to prevent damage to the photodiode 0122.

[0119] In this implementation, refer to Figure 9 The processing circuit 013 can be a driver IC. After determining the position of the user's eye gaze point on the display panel 011 based on the electrical signals sent by each photoelectric sensing component 012, the driver circuit 013 can also drive the display panel 011 to display an image based on the position of the user's eye gaze point on the display panel 011.

[0120] Optional, see reference Figure 9 The display device 01 may further include a processor 015 connected to the driving circuit 013. After determining the user's gaze point position on the display panel 011 based on the electrical signals sent by each photoelectric sensing component 012, the driving circuit 013 can send the user's gaze point position on the display panel 011 to the processor 015. The processor 015 can perform partial rendering of the image to be displayed on the display panel 011 based on the gaze point position, and send the partially rendered image to be displayed to the driving circuit 013. The driving circuit can drive the display panel 011 to display based on the partially rendered image to be displayed sent by the processor 015.

[0121] Specifically, when the processor 015 performs local rendering of the image to be displayed on the display panel 011, it can render only the area where the gaze point is located in the image. This not only reduces the load on the processor 015 but also ensures the display effect of the display panel 011.

[0122] It should be noted that the orthographic projection of the first binding pattern 0123 on the display panel 011 can overlap with the orthographic projection of the second binding pattern 0124 on the display panel 011. Therefore Figure 9 A square is used to represent the first binding pattern 0123 and the second binding pattern 0124, and is illustrated using 0123 / 0124. Furthermore, Figure 9 Switching transistor 0121 is not shown in the diagram. Additionally... Figure 9 The image only shows a portion of the photodiodes 0122 of the photoelectric sensing component 012, and only two photodiodes 0122 are shown connected to the driving circuit 013 via the first bonding pattern 0123 and the second bonding pattern 0124. In reality, photodiodes 0122, the first bonding pattern 0123, and the second bonding pattern 0124 can be arranged on all four sides of the peripheral area 011b, and each photodiode 0122 can be connected to the driving circuit 013.

[0123] In this implementation, the pixel electrode 01222 of the photodiode 0122 is located away from the display panel 011 relative to the common electrode 01226. That is, light reflected from the user's eye enters from one side of the pixel electrode 01222. Therefore, to ensure that the photodiode 0122 can receive the light signal reflected from the user's eye, the material of the pixel electrode 01222 needs to be transparent. For example, the material of the pixel electrode 01222 is indium tin oxide (ITO).

[0124] Optionally, the material of the common electrode 01226 can be a transparent material or a non-transparent material. This application does not limit this.

[0125] In this embodiment, the display panel 011 can be a liquid crystal display (LCD) panel. The LCD panel includes an array substrate, a color filter substrate, and a liquid crystal layer located between the array substrate and the material substrate. Since the pixel transistors of the sub-pixels of the display panel 011 are typically integrated in the array substrate, in order to ensure that the switching transistor 0121 of the photoelectric sensing component 012 is fabricated using the same process as the pixel transistors, the switching transistor 0121 can also be integrated in the array substrate. That is, during the fabrication of the array substrate, both the pixel transistors of the sub-pixels and the switching transistor 0121 of the photoelectric sensing component 012 are fabricated.

[0126] Of course, in this implementation, the display panel 011 can also be an organic light-emitting diode (OLED) display panel or a light-emitting diode (LED) display panel. This application embodiment does not limit the type of display panel. When the display panel 011 is an OLED display panel 011 or an LED display panel 011, it is only necessary to ensure that the switching transistor 0121 of the photoelectric sensing component 012 is located in the peripheral area 011b of the display panel 011.

[0127] As another alternative implementation, refer to Figure 11 The display panel 011 may further include a flexible circuit board 016 attached to the peripheral area 011b. The switching transistor 0121 of the photoelectric sensing component 012 is located on the flexible circuit board 016. That is, referring to... Figure 11 The switching transistor 0121 in the photoelectric sensing component 012 is fabricated independently of the display panel 011 and is not integrated into the display panel 011. The switching transistor 0121 in the photoelectric sensing component 012 is not fabricated using the same process as the pixel transistor.

[0128] In this implementation, refer to Figure 10 The processing circuit 013 can be a processor. For example, the processor 013 can be a central processing unit (CPU), a graphics processing unit (GPU), or an application processor (AP).

[0129] Optional, see reference Figure 9 The display device 01 may further include a driving circuit 015 connected to the processor 013. After determining the position of the user's gaze point on the display panel 011 based on the electrical signals sent by each photoelectric sensing component 012, the processor 013 can perform local rendering of the image to be displayed on the display panel 011 based on the position of the gaze point, and send the locally rendered image to be displayed to the driving circuit 015. The driving circuit 015 can drive the display panel 011 to display based on the locally rendered image to be displayed sent by the processor 013.

[0130] Specifically, when the processor 013 performs local rendering of the image to be displayed on the display panel 011, it can render only the area where the gaze point is located in the image. This not only reduces the load on the processor 013 but also ensures the display effect of the display panel 011.

[0131] It should be noted that, Figure 10 The image only shows a portion of the photodiodes 0122 and switching transistors 0121 of the photoelectric sensing component 012, and only two photodiodes 0122 are shown connected to the driving circuit 013 via the switching transistors 0121. In reality, photodiodes 0122 can be placed on all four sides of the peripheral area 011b, and each photodiode 0122 can be connected to the processor 013 via the flexible circuit board 016.

[0132] In this implementation, the common electrode 01226 of the photodiode 0122 is located away from the display panel 011 relative to the pixel electrode 01222. That is, light reflected from the user's eye enters from one side of the common electrode 01226. Therefore, to ensure that the photodiode 0122 can receive the light signal reflected from the user's eye, the material of the common electrode 01226 needs to be transparent. For example, the material of the common electrode 01226 is ITO.

[0133] Optionally, the pixel electrode 01222 can be made of a transparent material or a non-transparent material. This application does not limit this.

[0134] In this embodiment, the display panel 011 can be an LCD display panel. The LCD display panel includes an array substrate, a color filter substrate, and a liquid crystal layer located between the array substrate and the color filter substrate. Typically, the orthographic projection of the color filter substrate onto the array substrate and the orthographic projection of the liquid crystal layer onto the array substrate are both located within the array substrate, and the array substrate also includes regions that do not overlap with the color filter substrate and the liquid crystal layer.

[0135] refer to Figure 12 The switching transistor 0121 of the photoelectric sensing component 012 can be located on the side of the array substrate 01221 near the liquid crystal layer, and in a region of the array substrate that does not overlap with the color filter substrate or the liquid crystal layer. Alternatively, refer to... Figure 13 The switching transistor 0121 of the photoelectric sensing component 012 can be located on the side of the color filter substrate away from the liquid crystal layer. In this case, the switching transistor 0121 of the photoelectric sensing component 012 needs to be located on one side of the portion of the color filter substrate located in the peripheral region 011b.

[0136] Of course, in this implementation, the display panel 011 can also be an OLED display panel or an LED display panel. This application embodiment does not limit the type of the display panel 011. When the display panel 011 is an OLED display panel or an LED display panel, it is only necessary to ensure that the switching transistor 0121 of the photoelectric sensing component 012 is located in the peripheral area 011b of the display panel 011.

[0137] Optionally, in the embodiments of this application, the switching transistor 0121 of the photoelectric sensing component 012 can be an amorphous silicon (a-si) thin film transistor, a low temperature poly-silicon (LTPS) thin film transistor, or an oxide thin film transistor.

[0138] In this embodiment, the photoelectric sensing component 012 includes a switching transistor 0121 and a photodiode 0122. The switching transistor 0121 can be integrated in the display panel 011 or located on a flexible circuit board attached to the display panel 011. The arrangement of the switching transistor 0121 is not fixed. Therefore, the arrangement of multiple photoelectric sensing components 012 usually refers to the arrangement of the photodiodes 0122 in the multiple photoelectric sensing components 012.

[0139] For example, the arrangement of multiple first photoelectric sensing components 012a along the first direction X means that the photodiodes 0122 in the multiple first photoelectric sensing components 012a are arranged along the first direction X. The arrangement of multiple second photoelectric sensing components 012b along the second direction Y means that the photodiodes 0122 in the multiple second photoelectric sensing components 012b are arranged along the second direction Y.

[0140] Figure 14 This is a schematic diagram of another display device provided in an embodiment of this application. (Reference) Figure 14 The display device may further include a plurality of filters 017 corresponding one-to-one with a plurality of photoelectric sensing components 012. Each filter 017 may be located on the side of the corresponding photoelectric sensing component 012 away from the display panel 011. The filters may be used to absorb infrared light and visible light.

[0141] By setting a filter 017 on the side of the photoelectric sensing component 012 away from the display panel 011 to filter out visible light, the light emitted by the display panel 011 is prevented from affecting the light signal received by the photoelectric sensing component, thus ensuring the accuracy of the determined gaze point position.

[0142] In summary, the embodiments of this application provide a display device. Since the processing circuit in the display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the processing circuit can quickly determine the position of the user's eye gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a high refresh rate for the display panel.

[0143] Figure 15 This is a schematic diagram of the structure of a wearable display device provided in an embodiment of this application. (Reference) Figure 15As can be seen, the wearable display device 00 may include: a display device 01 as provided in the above embodiments, a lens 02 located on the display side of the display device 01, and a plurality of light-emitting elements 03 located at the edge of the lens. The emission direction of the plurality of light-emitting elements 03 is away from the display device. Figure 15 Only the display panel 011 and multiple photoelectric sensing components 012 of the display device are shown in the image.

[0144] In this embodiment, the light emitted by each light-emitting element 03 can illuminate the user's eye, and the light emitted by the light-emitting element 03 is reflected by the user's eye and then illuminates the photoelectric sensing component 012. This allows the photoelectric sensing component 012 to receive the light signal reflected by the user's eye.

[0145] refer to Figure 15 The wearable display device 00 also includes a lens frame 04, which is located at the edge of the lens 02 and serves to fix the lens 02. Multiple light-emitting elements 03 can be fixed on the side of the lens frame 03 away from the display panel 011.

[0146] Optionally, multiple light-emitting elements 03 can be evenly arranged on the side of the lens frame 04 away from the display panel 011 to ensure the uniformity of light illuminating the user's eyes and to ensure the accuracy of the processing circuit 013 of the display device 01 in determining the position of the user's gaze point on the display panel 011 based on the electrical signals sent by each of the photoelectric sensing components 012.

[0147] Optionally, all light-emitting elements 03 are infrared light-emitting diodes. Because the reflectivity of infrared light varies considerably among the user's pupil, sclera, and iris, designing the light-emitting elements 03 as infrared light-emitting diodes allows the photoelectric sensing component 012 to receive infrared light signals reflected from the pupil, sclera, and iris, facilitating the processing circuit 013 in determining the position of the user's eye (pupil) gaze point on the display panel 011.

[0148] In summary, the embodiments of this application provide a wearable display device. Since the processing circuit in the display device of the wearable display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the processing circuit can quickly determine the position of the user's eye gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a high refresh rate for the display panel.

[0149] Figure 16 This is a flowchart illustrating a method for determining a gaze point according to an embodiment of this application. This method can be applied to the display device provided in the above embodiments. (Reference) Figure 16The method may include:

[0150] Step 101: The photoelectric sensing component receives the light signal reflected from the user's eye.

[0151] In this embodiment, the display device includes a display panel 011 and a plurality of photoelectric sensing components 012. The display panel 011 has a display area 011a and a peripheral area 011b surrounding the display area 011a. The plurality of photoelectric sensing components 012 may be located in the peripheral area 011b, and each photoelectric sensing component 012 is capable of receiving light signals reflected by the user's eye.

[0152] Step 102: The photoelectric sensing component converts the optical signal into an electrical signal.

[0153] In this embodiment of the application, after each photoelectric sensing component 012 receives the light signal reflected by the user's eye, it can convert the received light signal into an electrical signal.

[0154] Step 103: The processing circuit determines the position of the user's gaze point on the display panel based on the magnitude of the electrical signal value and the position of at least one photoelectric sensing component.

[0155] In this embodiment, the display device further includes a processing circuit 013 connected to each photoelectric sensing component 012 and capable of receiving electrical signals sent by each photoelectric sensing component 012. After receiving the electrical signals sent by each photoelectric sensing component 012, the processing circuit 013 can determine the position of the user's eye gaze point on the display panel 011 based on the electrical signals sent by each photoelectric sensing component 012.

[0156] In this embodiment, the processing circuit 013 may pre-store the positions of each photoelectric sensing component 012. Since different areas of the human eye have different reflectivities for light (e.g., infrared light), the photoelectric sensing component 012 receives different light signals reflected from different areas of the human eye. The electrical signals converted from these different light signals by the photoelectric sensing component 012 have different signal values. Therefore, the processing circuit can determine the position of the user's gaze point on the display panel 011 based on the magnitude of the electrical signal value and the position of the photoelectric sensing component 012.

[0157] Typically, electrical signals involve less data than images, so the processing circuit 013 is more efficient at processing electrical signals than at processing images. In this embodiment, the processing circuit 013 is highly efficient at processing the electrical signals sent by each photoelectric sensing component 012, enabling it to quickly determine the position of the user's gaze point on the display panel 011 based on the electrical signals. This improves the efficiency of the display panel 011 in displaying images, resulting in a higher refresh rate for the display panel 011.

[0158] In summary, the embodiments of this application provide a method for determining the position of the gaze point. Since the processing circuit in the display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the processing circuit can quickly determine the position of the user's gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a higher refresh rate for the display panel.

[0159] Figure 17 This is a flowchart of another method for determining the gaze point provided in an embodiment of this application. This method can be applied to the display device provided in the above embodiments. (Reference) Figure 17 The method may include:

[0160] Step 201: Multiple first photoelectric sensing components and multiple second photoelectric sensing components receive the light signal reflected from the user's eye.

[0161] In this embodiment, the display device 01 includes a display panel 011 and a plurality of photoelectric sensing components 012. The display panel 011 has a display area 011a and a peripheral area 011b surrounding the display area 011a. The user is typically positioned on the display side of the display panel 011 to view the image displayed on the display panel 011. Furthermore, the plurality of photoelectric sensing components 012 may be located on the display side of the display panel 011 and within the peripheral area 011b.

[0162] The display panel 011 also has a light-emitting element 03 on its display side, and the light emitted by the light-emitting element 03 can shine into the user's eyes. The user's eyes can reflect the light emitted by the light-emitting element 03. Furthermore, the light emitted by the light-emitting element 03, after being reflected by the user's eyes, can shine into multiple photoelectric sensing components 012, thereby enabling the multiple photoelectric sensing components 012 to receive the light signal reflected by the user's eyes.

[0163] Optionally, the plurality of photoelectric sensing components 012 include a plurality of first photoelectric sensing components 012a arranged along a first direction X and a plurality of second photoelectric sensing components 012b arranged along a second direction Y. Each of the plurality of first photoelectric sensing components 012a and the plurality of second photoelectric sensing components 012b is capable of receiving light signals reflected from the user's eye.

[0164] Step 202: Each of the multiple first photoelectric sensing components and multiple second photoelectric sensing components converts the received optical signal into an electrical signal.

[0165] In this embodiment, after the plurality of first photoelectric sensing components 012a and the plurality of second photoelectric sensing components 012b receive an optical signal, each photoelectric sensing component 012 can convert the received optical signal into an electrical signal. Furthermore, the signal value of the electrical signal converted by the photoelectric sensing component 012 is positively correlated with the optical signal received by that photoelectric sensing component 012. That is, the larger the optical signal received by the photoelectric sensing component 012, the larger the signal value of the electrical signal converted by the photoelectric sensing component 012; the smaller the optical signal received by the photoelectric sensing component 012, the smaller the signal value of the electrical signal converted by the photoelectric sensing component 012.

[0166] Step 203: Each photoelectric sensing component sends an electrical signal to the drive circuit.

[0167] In this embodiment, the processing circuit 013 of the display device 01 can be a driving circuit, which can be connected to each photoelectric sensing component 012. Each photoelectric sensing component 012 can send an electrical signal to the driving circuit.

[0168] Step 204: The driving circuit determines at least one target first photoelectric sensing component from among a plurality of first photoelectric sensing components.

[0169] In this embodiment, after receiving electrical signals from a plurality of first photoelectric sensing components 012a, the driving circuit can determine at least one target first photoelectric sensing component from the plurality of first photoelectric sensing components 012a. Furthermore, the driving circuit can also determine the position of each target first photoelectric sensing component, for example, determining the coordinate values ​​of each target first photoelectric sensing component.

[0170] Wherein, the signal value of the electrical signal sent by the target first photoelectric sensing component to the driving circuit is less than or equal to a first threshold. This first threshold may be a fixed value pre-stored in the driving circuit. Alternatively, the first threshold may be determined by the driving circuit based on the signal values ​​of the electrical signals received from the plurality of first photoelectric sensing components 012a.

[0171] For example, the driving circuit can arrange the signal values ​​of the N electrical signals sent by the N first photoelectric sensing components 012a in ascending order, and determine the signal value at the nth position as the first threshold. Here, N is an integer greater than 1, and n is an integer greater than 1 and less than N / 2. Alternatively, the driving circuit can determine the signal value with the smallest signal value among the received electrical signals from the multiple first photoelectric sensing components 012a as the first threshold.

[0172] If the first threshold is the smallest signal value among the electrical signals transmitted by the plurality of first photoelectric sensing components 012a, then the driving circuit can determine a target first photoelectric sensing component from the plurality of first photoelectric sensing components 012a. Therefore, the driving circuit can determine the first coordinate value of the target first photoelectric sensing component with the smallest signal value among the plurality of first photoelectric sensing components 012a.

[0173] Optionally, the first coordinate value can be represented as (first abscissa value, first ordinate value). The first abscissa value can be the coordinate value of the target first photoelectric sensing component in the first direction X, and the first ordinate value can be the coordinate value of the target first photoelectric sensing component in the second direction Y. Since multiple first photoelectric sensing components 012a are arranged along the first direction X, the coordinate value of each first photoelectric sensing component 012a in the second direction Y can be 0. That is, the first ordinate value of the target first photoelectric sensing component can be 0.

[0174] Step 205: The driving circuit determines at least one target second photoelectric sensing component from among a plurality of second photoelectric sensing components.

[0175] In this embodiment, after receiving electrical signals from multiple second photoelectric sensing components 012b, the driving circuit can determine at least one target second photoelectric sensing component from among the multiple second photoelectric sensing components 012b. Furthermore, the driving circuit can also determine the position of each target second photoelectric sensing component, for example, determining the coordinate values ​​of each target second photoelectric sensing component.

[0176] Wherein, the signal value of the electrical signal sent by the target second photoelectric sensing component to the driving circuit is less than or equal to a second threshold. This second threshold may be a fixed value pre-stored in the driving circuit. Alternatively, the second threshold may be determined by the driving circuit based on the signal values ​​of the electrical signals received from the plurality of second photoelectric sensing components 012b.

[0177] For example, the driving circuit can arrange the signal values ​​of the M electrical signals sent by the M second photoelectric sensing components 012b in ascending order, and determine the signal value at the m-th position as the second threshold. Here, M is an integer greater than 1, and m is an integer greater than 1 and less than M / 2. Alternatively, the driving circuit can determine the signal value with the smallest signal value among the received electrical signals from the multiple second photoelectric sensing components 012b as the second threshold.

[0178] If the second threshold is the smallest signal value among the electrical signals transmitted by the plurality of second photoelectric sensing components 012b, then the driving circuit can determine a target second photoelectric sensing component from the plurality of second photoelectric sensing components 012b. Therefore, the driving circuit can determine the second coordinate value of the target second photoelectric sensing component with the smallest signal value among the plurality of second photoelectric sensing components 012b.

[0179] Optionally, the second coordinate value can be represented as (second abscissa value, second ordinate value). The second abscissa value can be the coordinate value of the target second photoelectric sensing component in the first direction X, and the second ordinate value can be the coordinate value of the target second photoelectric sensing component in the second direction Y. Since multiple second photoelectric sensing components 012b are arranged along the second direction Y, the coordinate value of each second photoelectric sensing component 012b in the first direction X can be 0. That is, the second abscissa value of the target second photoelectric sensing component can be 0.

[0180] Step 206: The driving circuit determines the position of the user's gaze point on the display panel based on the position of the first photoelectric sensing component of each target and the position of the second photoelectric sensing component of each target.

[0181] In this embodiment of the application, after the driving circuit determines the position of each target first photoelectric sensing component and the position of each target second photoelectric sensing component, it can determine the position of the user's eye gaze point on the display panel 011 based on the position of each target first photoelectric sensing component and the position of each target second photoelectric sensing component.

[0182] As one possible scenario, assuming the driving circuit identifies multiple target first photoelectric sensing components, it can determine the first coordinate value of each of these components. The first coordinate value of each target first photoelectric sensing component can be represented as (first abscissa value, first ordinate value). Subsequently, the driving circuit can determine the first abscissa average of the multiple target first photoelectric sensing components and the first ordinate average of the multiple target first photoelectric sensing components.

[0183] Since the first ordinate value of each target's first photoelectric sensing component is 0, the average first ordinate value of the first ordinates of multiple targets' first photoelectric sensing components is also 0.

[0184] Accordingly, assuming the driving circuit identifies multiple target second photoelectric sensing components, it can determine the second coordinate value of each of these components. The second coordinate value of each component can be represented as (second abscissa value, second ordinate value). Subsequently, the driving circuit can determine the second abscissa average value and the second ordinate average value of the multiple target second photoelectric sensing components.

[0185] Since the second abscissa value of each target's second photoelectric sensing component is 0, the average value of the second abscissa of the second abscissa of multiple target second photoelectric sensing components is also 0.

[0186] The driving circuit can then determine the position of the user's gaze point on the display panel 011 based on the first horizontal average value and the second vertical average value. For example, the position of the gaze point can be represented by the coordinates of the gaze point (first horizontal average value, second vertical average value).

[0187] As another possible scenario, assuming the driving circuit identifies a target first photoelectric sensing component, the driving circuit can determine the first coordinate value of the target first photoelectric sensing component. The first coordinate value of the target first photoelectric sensing component can be represented as (first horizontal coordinate value, first vertical coordinate value).

[0188] Accordingly, assuming the driving circuit identifies a target second photoelectric sensing component, the driving circuit can determine the second coordinate value of the target second photoelectric sensing component. The second coordinate value of the target second photoelectric sensing component can be represented as (second abscissa value, second ordinate value).

[0189] Then, the driving circuit can determine the position of the user's eye gaze point on the display panel 011 based on the first horizontal coordinate value and the second vertical coordinate value. For example, the position of the gaze point can be represented by the coordinates of the gaze point (first coordinate value, second coordinate value).

[0190] Step 207: The driving circuit sends the position of the gaze point to the processor of the display device.

[0191] In this embodiment, the display device further includes a processor that can be connected to the driving circuit. After determining the position of the user's eye's gaze point on the display panel 011, the driving circuit can send the position of the gaze point to the processor of the display device. For example, the driving circuit can send the coordinates of the gaze point to the processor.

[0192] Step 208: The processor renders the image to be displayed on the display device based on the position of the gaze point.

[0193] In this embodiment of the application, after receiving the position of the gaze point sent by the driving circuit, the processor can render the image to be displayed in the display device based on the position of the gaze point.

[0194] Optionally, the processor can perform local rendering of the region where the gaze point is located in the image to be displayed. The region where the gaze point is located can refer to a target region centered on the gaze point. The shape of this target region can be circular or rectangular, and its size can be a size pre-stored in the processor.

[0195] Step 209: The processor sends the rendered image to be displayed to the driver circuit.

[0196] Step 210: The driving circuit drives the display panel to display based on the rendered image to be displayed.

[0197] In this embodiment of the application, after receiving the rendered image to be displayed sent by the processor, the driving circuit can drive the display panel 011 to display based on the rendered image to be displayed.

[0198] It should be noted that the order of steps in the method for determining the position of the gaze point provided in the embodiments of this application can be appropriately adjusted, and steps can be added or removed as appropriate. For example, step 205 can be executed simultaneously with step 204, and steps 207 to 210 can be deleted according to actual circumstances. Any variations that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application, and therefore will not be elaborated further.

[0199] In summary, the embodiments of this application provide a method for determining the position of the gaze point. Since the driving circuit in the display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the driving circuit can quickly determine the position of the user's gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a higher refresh rate for the display panel.

[0200] Figure 18This is a flowchart of another method for determining the gaze point provided in an embodiment of this application. This method can be applied to the display device provided in the above embodiments. (Reference) Figure 18 The method may include:

[0201] Step 301: Multiple first photoelectric sensing components and multiple second photoelectric sensing components receive the light signal reflected by the user's eye.

[0202] In the embodiments of this application, the detailed description of step 301 can be found in the description of step 201 above, and will not be repeated here.

[0203] Step 302: Each of the plurality of first photoelectric sensing components 012a and the plurality of second photoelectric sensing components 012b converts the received optical signal into an electrical signal.

[0204] In the embodiments of this application, a detailed description of step 302 can be found in the description of step 202 above, and will not be repeated here.

[0205] Step 303: Each photoelectric sensing component sends an electrical signal to the processor.

[0206] In this embodiment, the processing circuit 013 of the display device can be a processor, which can be connected to each photoelectric sensing component 012. Each photoelectric sensing component 012 can send an electrical signal to the processor.

[0207] Step 304: The processor identifies at least one target first photoelectric sensing component from a plurality of first photoelectric sensing components.

[0208] In this embodiment, a detailed description of step 304 can be found in the description of step 204 above. However, the difference between step 304 and step 204 is that the execution subject of step 304 is the processor, while the execution subject of step 204 is the drive circuit. That is, by changing the execution subject in step 304 to the processor, the content of step 204 can be obtained. This embodiment will not be repeated here.

[0209] Step 305: The processor identifies at least one target second photoelectric sensor component from a plurality of second photoelectric sensor components.

[0210] In this embodiment, a detailed description of step 305 can be found in the description of step 205 above. However, the difference between step 305 and step 205 is that the execution subject of step 305 is the processor, while the execution subject of step 205 is the drive circuit. That is, by changing the execution subject in step 205 to the processor, the content of step 305 can be obtained.

[0211] Step 306: The processor determines the position of the user's gaze point on the display panel based on the position of the first photoelectric sensing component of each target and the position of the second photoelectric sensing component of each target.

[0212] In this embodiment of the application, a detailed description of step 306 can be found in the description of step 206 above. However, the difference between step 306 and step 206 is that the execution subject of step 306 is the processor, while the execution subject of step 206 is the drive circuit. That is, by changing the execution subject in step 206 to the processor, the content of step 306 can be obtained.

[0213] Step 307: The processor renders the image to be displayed on the display device based on the position of the gaze point.

[0214] In this embodiment, the processor determines the position of the gaze point, so the processor can directly render the image to be displayed in the display device based on the determined position of the gaze point.

[0215] Optionally, the processor can perform local rendering of the region where the gaze point is located in the image to be displayed. The region where the gaze point is located can refer to a target region centered on the gaze point. The shape of this target region can be circular or rectangular, and its size can be a size pre-stored in the processor.

[0216] Step 308: The processor sends the rendered image to be displayed to the driver circuit.

[0217] Step 309: The driving circuit drives the display panel to display based on the rendered image to be displayed.

[0218] In this embodiment of the application, after receiving the rendered image to be displayed sent by the processor, the driving circuit can drive the display panel to display based on the rendered image to be displayed.

[0219] It should be noted that the order of steps in the method for determining the position of the gaze point provided in the embodiments of this application can be appropriately adjusted, and steps can be added or removed as appropriate. For example, step 305 can be performed before step 304, and steps 307 to 309 can be deleted as needed. Any variations that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application, and therefore will not be elaborated further.

[0220] In summary, the embodiments of this application provide a method for determining the position of the gaze point. Since the driving circuit in the display device has high processing efficiency for the electrical signals sent by each photoelectric sensing component, the driving circuit can quickly determine the position of the user's gaze point on the display panel based on the electrical signals sent by each photoelectric sensing component, thereby improving the efficiency of the display panel in displaying images and achieving a higher refresh rate for the display panel.

[0221] This application provides a computer-readable storage medium storing instructions that are executed by a display device to implement the method for determining the position of the gaze point provided in the above-described method embodiments.

[0222] This application provides a computer program product containing instructions that, when run on a computer, cause the computer to execute the method for determining the position of the gaze point as provided in the above method embodiments.

[0223] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A display device, characterized in that, The display device includes: A display panel having a display area and a peripheral area surrounding the display area, the display area having at least one pixel transistor; Multiple photoelectric sensing components are located in the surrounding area. Each photoelectric sensing component is used to receive light signals reflected from the user's eye and convert the light signals into electrical signals. And a processing circuit connected to each of the photoelectric sensing components, the processing circuit being used to determine the position of the user's eye gaze point on the display panel based on the magnitude of the signal value of the electrical signal sent by each of the photoelectric sensing components and the position of at least one of the photoelectric sensing components. Each of the aforementioned photoelectric sensing components includes: a switching transistor, a photodiode, and a first bonding pattern and a second bonding pattern for electrical connection. The photodiode includes: a substrate, and a pixel electrode, a P-type material layer, a photosensitive material layer, an N-type material layer, and a common electrode, which are sequentially stacked on one side of the substrate and in a direction away from the substrate. The second bonding pattern is fabricated on the substrate of the photodiode, and the second bonding pattern and the pixel electrode of the photodiode are located on the same layer. The pixel electrode is made of a transparent material. The first bonding pattern and the switching transistor are integrated into the display panel. The orthographic projection of the first bonding pattern on the display panel overlaps with the orthographic projection of the second bonding pattern on the display panel. The first bonding pattern and the second bonding pattern are bonded together by anisotropic conductive adhesive film. The switching transistor and the pixel transistor of the display panel are fabricated using the same fabrication process. The first bonding pattern is electrically connected to the first electrode of the switching transistor, the second bonding pattern is electrically connected to the pixel electrode of the photodiode, and the second electrode of the switching transistor is electrically connected to the processing circuit.

2. The display device according to claim 1, characterized in that, The surrounding area includes: a first area extending along a first direction and a second area extending along a second direction, wherein the first direction and the second direction intersect; the plurality of photoelectric sensing components include a plurality of first photoelectric sensing components and a plurality of second photoelectric sensing components; The plurality of first photoelectric sensing components are located in the first region and arranged along the first direction, and the plurality of second photoelectric sensing components are located in the second region and arranged along the second direction.

3. The display device according to claim 2, characterized in that, The first direction is perpendicular to the second direction; the surrounding area includes: two first areas and two second areas; The two first regions are arranged along the second direction and are located on both sides of the display area, and the two second regions are arranged along the first direction and are located on both sides of the display area.

4. The display device according to claim 2, characterized in that, The processing circuit is used for: Determine the first coordinate value of the target first photoelectric sensor component with the smallest signal value of the electrical signal transmitted among the plurality of first photoelectric sensor components; Determine the second coordinate value of the target second photoelectric sensor component with the smallest signal value of the electrical signal transmitted among the plurality of second photoelectric sensor components; The position of the user's gaze point on the display panel is determined based on the first coordinate value and the second coordinate value.

5. The display device according to any one of claims 1 to 4, characterized in that, The display device further includes a control circuit; the control electrode of the switching transistor is electrically connected to the control circuit, and the control circuit is used to control the switching transistor to turn on and off.

6. The display device according to claim 5, characterized in that, The display panel includes a plurality of sub-pixels located in the display area, and each sub-pixel includes at least one pixel transistor.

7. The display device according to claim 1, characterized in that, The processing circuit is a driving circuit; the driving circuit is also used to drive the display panel to display an image based on the position of the user's eye gaze point on the display panel.

8. The display device according to claim 1, characterized in that, The pixel electrode is located away from the display panel relative to the common electrode.

9. The display device according to claim 5, characterized in that, The processing circuit is a processor; the display device further includes a driving circuit connected to the processor. The processor is also configured to send the position of the user's eye gaze point on the display panel to the driving circuit, the driving circuit being configured to drive the display panel to display an image based on the position of the gaze point.

10. The display device according to any one of claims 1 to 4, characterized in that, The display device further includes: a plurality of filters corresponding one-to-one with the plurality of photoelectric sensing components, each of the filters being located on the side of the corresponding photoelectric sensing component away from the display panel; The filter is used to transmit infrared light and absorb visible light.

11. A wearable display device, characterized in that, The wearable display device includes: a display device as described in any one of claims 1 to 10, a lens located on the display side of the display device, and a plurality of light-emitting elements located on the edge of the lens; The emission direction of the plurality of light-emitting elements is opposite to that of the display device.

12. The wearable display device according to claim 11, characterized in that, All of the light-emitting elements are infrared light-emitting diodes.

13. A method for determining the position of a fixation point, characterized in that, Applied to the display device according to any one of claims 1 to 10, the method comprises: Receives light signals reflected from the user's eyes; The optical signal is converted into an electrical signal; Based on the magnitude of the electrical signal value and the position of at least one photoelectric sensing component, the position of the user's gaze point on the display panel is determined.

14. The determination method according to claim 13, characterized in that, Determining the position of the user's gaze point on the display panel based on the electrical signal includes: The driving circuit in the display device determines the position of the user's eye gaze point on the display panel based on the electrical signal; The method further includes: the driving circuit sending the position of the gaze point to the processor of the display device; The processor renders the image to be displayed in the display device based on the position of the gaze point, and sends the rendered image to the driving circuit; The driving circuit drives the display panel to display based on the rendered image to be displayed.

15. The determination method according to claim 13, characterized in that, Determining the position of the user's gaze point on the display panel based on the electrical signal includes: The processor in the display device determines the position of the user's eye gaze point on the display panel based on the electrical signal; The method further includes: The processor renders the image to be displayed in the display device based on the position of the gaze point, and sends the rendered image to the driving circuit; The driving circuit drives the display panel to display based on the rendered image to be displayed.

16. The determining method according to any one of claims 13 to 15, characterized in that, Determining the position of the user's gaze point on the display panel based on the electrical signal includes: At least one target first photoelectric sensing component is identified from a plurality of first photoelectric sensing components arranged along a first direction; At least one target second photoelectric sensor component is identified from a plurality of second photoelectric sensor components arranged along the second direction; The position of the user's gaze point on the display panel is determined based on the position of the first photoelectric sensing component of each target and the position of the second photoelectric sensing component of each target; Wherein, the signal value of the electrical signal transmitted by the first photoelectric sensing component of the target is less than or equal to a first threshold, and the signal value of the electrical signal transmitted by the second photoelectric sensing component of the target is less than or equal to a second threshold.

17. The determining method according to any one of claims 13 to 15, characterized in that, Determining the position of the user's gaze point on the display panel based on the electrical signal includes: Determine the first coordinate value of the target first photoelectric sensor component that transmits the electrical signal with the smallest value among a plurality of first photoelectric sensor components arranged along the first direction; Determine the second coordinate value of the target second photoelectric sensor component that transmits the electrical signal with the smallest value among the multiple second photoelectric sensor components arranged along the second direction; The position of the user's gaze point on the display panel is determined based on the first coordinate value and the second coordinate value; Wherein, the first direction intersects with the second direction.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that are executed by a display device to implement the determination method as described in any one of claims 13 to 17.

Images