Screen gaze point acquisition method and display device

Abstract

This application provides a method for acquiring a screen gaze point and a display device, which are applied to the field of computer technology and are applied to a screen equipped with at least two light sensors. The method comprises: acquiring ambient light collected by each light sensor, wherein the ambient light is located on the light-emitting side of the screen; using a light sensor whose collected ambient light includes light reflected from the user's pupil as a target light sensor; and determining the position of the user's gaze point based on the position of the target light sensor. This solution improves the accuracy of acquiring the user's gaze point on the screen by providing a light sensor on the side of the screen to collect ambient light on the light-emitting side of the screen, thereby determining the position of the user's gaze point on the screen based on the position of the light sensor that collects light reflected from the user's pupil. This solution improves the accuracy of acquiring the user's gaze point on the screen while reducing the hardware cost of the light sensor.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method for acquiring a screen gaze point and a display device. Background Art

[0002] With the development of display technology, the application of eye tracking technology in interaction, gaze point rendering, and other aspects has continued to gain attention. By using eye tracking technology to determine the user's gaze point, the display effect of the user's gaze point on the screen can be adjusted to improve the user's visual experience when viewing the screen.

[0003] Current eye tracking technology generally uses a camera to obtain an image of the human eye, and then uses image pupil positioning methods such as ellipse fitting to determine the movement of the human pupil, and establish a relationship between pupil movement and the screen gaze point, thereby determining the change of the user's gaze point based on the change of the human eye image.

[0004] However, this method of determining the user's gaze point based on eye tracking technology requires the use of a camera and a screen in conjunction. Not only does it require setting the display position of the camera on the screen, but the determined position of the user's gaze point also depends on the camera's shooting effect, and the accuracy of the determined user's gaze point position cannot be guaranteed. Summary of the Invention

[0005] In view of this, an embodiment of the present application proposes a method for obtaining a screen gaze point and a display device, which are used to solve the problem in the prior art that not only does it require setting the display position of the screen occupied by the camera, but the determined position of the user's gaze point depends on the shooting effect of the camera, and the accuracy of the determined position of the user's gaze point cannot be guaranteed.

[0006] In a first aspect, the present application provides a method for acquiring a screen gaze point, which is applied to a screen provided with at least two light sensors. The method comprises:

[0007] Acquire ambient light collected by each of the light sensors, where the ambient light is located on a light-emitting side of the screen;

[0008] The light sensor that collects ambient light including the light reflected by the user's pupil is used as the target light sensor;

[0009] The position of the user's gaze point is determined according to the position of the target light sensor.

[0010] Optionally, before using the light sensor whose collected ambient light includes the user's pupil reflected light as the target light sensor, the method further includes:

[0011] Acquiring electrical signals corresponding to the ambient light collected by each of the light sensors;

[0012] When the electrical signal meets the electrical signal requirement, it is confirmed that the ambient light corresponding to the electrical signal includes the pupil reflected light of the user.

[0013] Optionally, when the electrical signal is a voltage, the electrical signal is required to have a voltage less than or equal to a voltage threshold;

[0014] When the electrical signal meets the electrical signal requirement, confirming that the ambient light corresponding to the electrical signal includes pupil reflected light of the user includes:

[0015] When the voltage is less than or equal to the voltage threshold, it is confirmed that the ambient light corresponding to the electrical signal includes light reflected from the pupil of the user.

[0016] Optionally, before acquiring the ambient light collected by each of the light sensors, the method further includes:

[0017] Obtaining a user's pupil size and a straight-line distance between the user's pupil and the light sensor;

[0018] Obtaining the user's field of view angle according to the user's pupil size and the straight-line distance;

[0019] When the user's viewing angle is greater than or equal to the sensor's viewing angle, the light sensor is turned on to collect ambient light on the light-emitting side of the screen.

[0020] Optionally, determining the position of the user's gaze point according to the position of the target light sensor includes:

[0021] acquiring, according to the position of the target light sensor, an associated position of the target light sensor on the screen, wherein the associated position is obtained by dividing the position of the screen according to the number and positions of the light sensors;

[0022] The average of the associated positions is calculated based on the number of the target light sensors to obtain the position of the user's gaze point on the screen.

[0023] Optionally, at least two horizontal light sensors are provided on the horizontal side of the screen, and at least two vertical light sensors are provided on the vertical side of the screen, the target light sensors include: at least one target horizontal light sensor and at least one target vertical light sensor, and the position of the user's gaze point includes a target horizontal coordinate value and a target vertical coordinate value;

[0024] The averaging of the associated positions based on the number of the target light sensors to obtain the position of the user's gaze point on the screen includes:

[0025] The average of the horizontal coordinate values of the target horizontal light sensors is used as the target horizontal coordinate value of the user's gaze point, and the average of the vertical coordinate values of the target vertical light sensors is used as the target vertical coordinate value of the user's gaze point.

[0026] According to a second aspect of the present application, a device for acquiring a screen gaze point is provided, which is applied to a screen provided with at least two light sensors, and comprises:

[0027] an acquisition module configured to acquire ambient light collected by each of the light sensors, where the ambient light is located on a light-emitting side of the screen;

[0028] A screening module is configured to use a light sensor whose collected ambient light includes light reflected from the user's pupil as a target light sensor;

[0029] The determination module is configured to determine the position of the user's gaze point according to the position of the target light sensor.

[0030] Optionally, the filter module is also configured to:

[0031] To obtain an electrical signal corresponding to the ambient light collected by each of the light sensors;

[0032] When the electrical signal meets the electrical signal requirement, it is confirmed that the ambient light corresponding to the electrical signal includes the pupil reflected light of the user.

[0033] Optionally, when the electrical signal is a voltage, the electrical signal is required to have a voltage less than or equal to a voltage threshold;

[0034] The screening module is further configured to:

[0035] When the voltage is less than or equal to the voltage threshold, it is confirmed that the ambient light corresponding to the electrical signal includes light reflected from the pupil of the user.

[0036] Optionally, the acquisition module is further configured to:

[0037] Obtaining a user's pupil size and a straight-line distance between the user's pupil and the light sensor;

[0038] Obtaining the user's field of view angle according to the user's pupil size and the straight-line distance;

[0039] When the user's viewing angle is greater than or equal to the sensor's viewing angle, the light sensor is turned on to collect ambient light on the light-emitting side of the screen.

[0040] Optionally, the determining module is further configured to:

[0041] acquiring, according to the position of the target light sensor, an associated position of the target light sensor on the screen, wherein the associated position is obtained by dividing the position of the screen according to the number and positions of the light sensors;

[0042] The average of the associated positions is calculated based on the number of the target light sensors to obtain the position of the user's gaze point on the screen.

[0043] Optionally, at least two horizontal light sensors are provided on the horizontal side of the screen, and at least two vertical light sensors are provided on the vertical side of the screen, the target light sensors include: at least one target horizontal light sensor and at least one target vertical light sensor, and the position of the user's gaze point includes a target horizontal coordinate value and a target vertical coordinate value;

[0044] The determining module is further configured to:

[0045] The average of the horizontal coordinate values of the target horizontal light sensors is used as the target horizontal coordinate value of the user's gaze point, and the average of the vertical coordinate values of the target vertical light sensors is used as the target vertical coordinate value of the user's gaze point.

[0046] According to a third aspect of the present application, a display device is provided, comprising a screen with at least two light sensors arranged on its sides, and a processor, wherein the processor is configured to implement the method for acquiring the screen gaze point described in the first aspect above.

[0047] According to the fourth aspect of the present application, a device is provided including a processor, a memory, and a program or instruction stored in the memory and executable on the processor. When the program or instruction is executed by the processor, the method for acquiring the screen gaze point described in the first aspect is implemented.

[0048] According to a fifth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method for obtaining the screen gaze point described in the first aspect is implemented.

[0049] With respect to the existing technology, this application has the following advantages:

[0050] The present application provides a method for acquiring a screen gaze point and a display device. This solution collects ambient light on the light-emitting side of the screen by setting a light sensor on the side of the screen, so as to determine the position of the user's gaze point on the screen according to the position of the light sensor that collects the light reflected by the user's pupil. This improves the accuracy of acquiring the position of the user's gaze point on the screen with a lower hardware cost based on the light sensor.

[0051] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present application. The same reference symbols are used throughout the drawings to represent the same components. In the drawings:

[0053] Figure 1 This is a flowchart of the steps of a method for obtaining a screen gaze point provided by an embodiment of the present application;

[0054] Figure 2 This is a schematic diagram of the layout of a light sensor in a screen provided in an embodiment of the present application;

[0055] Figure 3 This is a flowchart of another method for obtaining a screen gaze point provided by an embodiment of the present application;

[0056] Figure 4 This is one of the principle schematic diagrams of a method for obtaining a screen gaze point provided in an embodiment of the present application;

[0057] Figure 5 This is the second principle diagram of a method for obtaining a screen gaze point provided in an embodiment of the present application;

[0058] Figure 6 This is a schematic diagram of the structure of a voltage comparator provided in an embodiment of the present application;

[0059] Figure 7 This is a schematic diagram showing the effect of a method for obtaining a screen gaze point provided by an embodiment of the present application;

[0060] Figure 8 This is a structural block diagram of a device for acquiring a screen gaze point provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The following describes exemplary embodiments of the present application in more detail with reference to the accompanying drawings. Although exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.

[0062] Figure 1This is a flowchart of a method for acquiring a screen gaze point provided by an embodiment of the present application, which is applied to a screen provided with at least two light sensors. The method includes:

[0063] Step 101 : Acquire ambient light collected by each of the light sensors, where the ambient light is located on the light-emitting side of the screen.

[0064] In the embodiment of the present application, the screen is an electrical appliance for displaying images and colors. Usually, the user can watch the content displayed on the screen on the light-emitting side of the screen. The solution of the present application is to obtain the user's gaze point on the screen when the user is watching the content on the screen. Therefore, at least two light sensors are provided on the side of the screen, that is, in the non-display area around the screen. The light sensors can collect ambient light on the light-emitting side of the screen. It should be noted that the reason for setting up at least two light sensors is that it is necessary to detect changes in the user's gaze point based on different light sensors in the future. If only one light sensor is provided, it can only determine whether the user is watching the screen based on this solution, and cannot identify changes in the user's gaze point. Ambient light is light reflected by reflective objects in the scene where the screen is located to the light-emitting side of the screen.

[0065] Specifically, the number of light sensors set on the screen can be determined based on the accuracy of the position of the user's gaze point required for subsequent determination. Figure 2 , α is the horizontal field of view angle of the screen, and β is the vertical field of view angle of the screen. Therefore, the number of light sensors required to be set on the horizontal and vertical sides of the rectangular screen can be calculated by the following formulas (1) and (2), respectively:

[0066]

[0067] Wherein, θ is the horizontal position accuracy of the user's gaze point, γ is the vertical position accuracy of the user's gaze point, n1 is the number of light sensors on the horizontal side, and n2 is the number of light sensors on the vertical side.

[0068] For example, if the horizontal and vertical field angles of the screen are both 60°, and the horizontal and vertical position accuracy are both 0.5°, then the number of light sensors required to be set on the horizontal and vertical sides of the screen is 120.

[0069] When the user is watching the screen, the light sensor on the screen can be controlled to collect ambient light on the light-emitting side of the screen, which the user can then use to determine the position of the user's gaze point.

[0070] Step 102: Use a light sensor whose collected ambient light includes light reflected from the user's pupil as a target light sensor.

[0071] In the embodiments of the present application, the user's pupil reflected light refers to the light reflected by the user's pupil to the light sensor. It is understood that because the user's pupil has a strong absorption effect on light, the intensity of the user's pupil reflected light reflected by the user's pupil to the light sensor will be significantly lower than the intensity of the light reflected by other environmental reflective objects such as the user's face. Therefore, the weak intensity of the user's pupil reflected light can be used to determine whether the ambient light collected by the light sensor contains the user's pupil reflected light. Therefore, when it is detected that the ambient light collected by the light sensor has a weak intensity, it can be determined that the user's pupil reflected light is included in the ambient light, and the light sensor can be used as a target light sensor for subsequent determination of the location of the user's gaze point.

[0072] Step 103: Determine the position of the user's gaze point according to the position of the target light sensor.

[0073] In the embodiment of the present application, since each light sensor is arranged at a different position on the side of the screen, the screen can be divided into screen areas corresponding to each light sensor according to the position of each light sensor on the side of the screen. When the ambient light collected by the target light sensor includes the user's pupil light, it can be regarded as that the user is viewing the screen area corresponding to the position of the target light sensor, and then the position of the user's gaze point is the associated position of the screen area.

[0074] An embodiment of the present application provides a method for acquiring a screen gaze point, which collects ambient light on the light-emitting side of the screen by setting a light sensor on the side of the screen, and determines the position of the user's gaze point on the screen based on the position of the light sensor that collects the light reflected by the user's pupil. This improves the accuracy of acquiring the position of the user's gaze point on the screen with lower hardware cost based on the light sensor.

[0075] Figure 3 This is a flowchart of another method for acquiring a screen gaze point provided by an embodiment of the present application, which is applied to a screen provided with at least two light sensors. The method includes:

[0076] Step 201 : Obtain the user's pupil size and the straight-line distance between the user's pupil and the light sensor.

[0077] Step 202: Obtain the user's field of view angle according to the user's pupil size and the straight-line distance.

[0078] Step 203 : When the user's field of view angle is greater than or equal to the field of view angle of the sensor, the light sensor is turned on to collect ambient light from the light-emitting side of the screen.

[0079] In the embodiment of the present application, the user's field of view angle refers to the field of view angle of the user's pupil, and the field of view angle of the sensor can be obtained according to the factory configuration of the light sensor.

[0080] Reference Figure 4 , the range of the field of view angles 1 to 3 of the light sensor mapped to the user's pupil can represent the size relationship between the field of view angle of the user's pupil and the field of view angle of the light sensor, as shown by Figure 4 As can be seen from the left figure, when the field of view of the light sensor is significantly larger than the field of view of the user's pupil, when the user's pupil moves within the mapping range of the light sensor, the light sensor can collect all the light reflected from the user's pupil. Then the light sensor can only determine whether the user's pupil exists within the mapping range of the light sensor's field of view, and cannot perceive the changes in the light reflected from the user's pupil when the user's pupil moves within the mapping range. Figure 4 As can be seen from the middle figure, when the field of view of the light sensor is equal to the field of view of the user's pupil, as long as the user's pupil moves, the intensity of the light reflected by the user's pupil collected by the light sensor will change. Figure 4 The right side of the figure also shows that when the field of view of the light sensor is smaller than the field of view of the user's pupil, the intensity of the light reflected from the user's pupil collected by the light sensor will change when the user's pupil moves. Therefore, it can be concluded that as long as the field of view of the light sensor is smaller than or equal to the field of view of the user's pupil, the light sensor will detect the change in the light reflected from the user's pupil when the user's pupil moves, thereby determining the change in the position of the user's gaze point on the screen.

[0081] Specifically, the field of view of the light sensor can be obtained based on the factory configuration of the light sensor, and the field of view of the user's pupil is referenced. Figure 5 , needs to be determined based on the user's pupil size and the straight-line distance from the user's pupil to the light sensor. Specifically, the user's pupil field of view angle can be calculated using the following formula (3):

[0082]

[0083] Among them, FOV pupil is the field of view of the user's pupil, d is the radius of the user's pupil, and D is the straight-line distance from the user's pupil to the light sensor.

[0084] Therefore, if the user's pupil field of view angle is determined to be greater than or equal to the light sensor's field of view angle, this solution can effectively detect the user's gaze point on the screen through the light sensor, thereby starting the light sensor to collect ambient light. Of course, if the user's pupil field of view angle is smaller than the light sensor's field of view angle, although the user's gaze point on the screen cannot be detected, the light sensor can still detect whether the user is looking at the screen.

[0085] Step 204 : Acquire the ambient light collected by each of the light sensors, where the ambient light is located on the light-emitting side of the screen.

[0086] This step can be described with reference to the detailed description of step 101 and will not be repeated here.

[0087] Step 205: Acquire an electrical signal corresponding to the ambient light collected by each of the light sensors.

[0088] In an embodiment of the present application, the ambient light collected by the light sensor can be converted into an electrical signal through a photoelectric converter. The electrical signal can be a voltage or a current. During the specific photoelectric conversion, the intensity of the ambient light and the index of the electrical signal can be positively correlated or negatively correlated. The specific setting can be based on actual needs and is not limited here.

[0089] Optionally, the electrical signal includes: voltage.

[0090] Step 206 : When the voltage is less than or equal to the voltage threshold, confirm that the ambient light corresponding to the electrical signal includes light reflected from the pupil of the user.

[0091] In an embodiment of the present application, the voltage threshold may be the maximum voltage value obtained by converting the user's pupil reflection light through statistical analysis after collecting the user's pupil reflection.

[0092] When obtaining ambient light, the voltage can be set to be positively correlated with the ambient light, so that the lower the voltage, the lower the intensity of the ambient light. When the voltage obtained by converting the ambient light is less than or equal to the voltage threshold, based on the strong absorption characteristics of the user's pupil to light, it is determined that the ambient light contains light reflected by the user's pupil.

[0093] For example, refer to Figure 6 The schematic diagram of the structure of a voltage comparator is shown, wherein the u Sensor The voltage corresponding to the ambient light collected by the light sensor is input to the positive terminal of the comparator u Reference is the voltage corresponding to the voltage threshold, so when the voltage is less than or equal to the voltage threshold, the output indicates that the ambient light includes the light reflected by the user's pupil. Out , that is, if u Sensor ≤u Reference , then u Out =1, indicating that the human eye is looking at this sensor area, the corresponding sensor receives less light, and the sensor voltage value is low; if u Sensor >u Reference , then u Out =0, indicating that the human eye is not looking at this area, the corresponding sensor receives more light, and the sensor voltage value is higher.

[0094] Step 207 : The light sensor whose collected ambient light includes the light reflected from the user's pupil is used as a target light sensor.

[0095] This step can be described with reference to the detailed description of step 102 and will not be repeated here.

[0096] Step 208 : Acquire the associated position of the target light sensor in the screen according to the position of the target light sensor. The associated position is obtained by dividing the position of the screen according to the number and position of the light sensors.

[0097] In an embodiment of the present application, a plane rectangular coordinate system is established based on the plane where the screen is located, so that the position coordinates of each light sensor in the plane rectangular coordinate system and the position coordinates of each display area in the screen can be obtained. Then, when the field of view of each light sensor is the same, the position coordinate range of the display area where the user's pupil reflected light can be perceived by the field of view of each light sensor can be assigned to the light sensor as the associated position of each light sensor in the screen.

[0098] Step 209 : Calculate the average of the associated positions based on the number of the target light sensors to obtain the position of the user's gaze point on the screen.

[0099] In the embodiment of the present application, considering that there may not be only one target light sensor, when there are at least two target light sensors, the associated positions of the at least two target light sensors can be averaged. Of course, if there is only one target light sensor, the average value is the associated position of the target light sensor itself, and the average value is used as the position of the user's gaze point on the screen.

[0100] Optionally, at least two horizontal light sensors are provided on the horizontal side of the screen, and at least two vertical light sensors are provided on the vertical side, the target light sensors include: at least one target horizontal light sensor and at least one target vertical light sensor, the position of the user's gaze point includes a target horizontal coordinate value and a target vertical coordinate value, and step 209 includes: using the average of the horizontal coordinate values of the target horizontal light sensors as the target horizontal coordinate value of the user's gaze point, and using the average of the vertical coordinate values of the target vertical light sensors as the target vertical coordinate value of the user's gaze point.

[0101] In the examples of this application, refer to Figure 7Each horizontal light sensor set on the side of the screen can represent a horizontal coordinate x of the screen, and each vertical light sensor can represent a vertical coordinate y of the screen. Therefore, when the user is viewing the screen, the horizontal light sensor x2 that collects ambient light containing the user's pupil reflected light is used as the target horizontal light sensor, and the vertical light sensor y2 is used as the target vertical light sensor. The horizontal coordinate value corresponding to the target horizontal light sensor and the vertical coordinate value corresponding to the target vertical light sensor are used as the target horizontal coordinate value and target vertical coordinate value of the user's gaze point, respectively, to determine the position of the user's gaze point on the screen.

[0102] Furthermore, if there are multiple target horizontal light sensors and target vertical light sensors, the target horizontal coordinate value of the user's gaze point can be calculated using the following formula (4):

[0103]

[0104] where x f Indicates the target horizontal coordinate value, x i to x j represents the horizontal coordinate value corresponding to each target lateral light sensor, and n represents the number of target lateral light sensors.

[0105] The target vertical coordinate value of the user's gaze point is calculated using the following formula (5):

[0106]

[0107] where y f Indicates the target horizontal coordinate value, y i to y j represents the horizontal coordinate value corresponding to each target vertical light sensor, and m represents the number of target vertical light sensors.

[0108] The embodiment of the present application uses the average of the horizontal and vertical coordinate values of the light sensor that senses the light reflected by the user's pupil as the position of the user's gaze point, thereby improving the accuracy of the determined position of the user's gaze point.

[0109] Another method for acquiring a user's gaze point on a screen, provided in an embodiment of the present application, collects ambient light from the screen's light-emitting side by setting a light sensor on the side of the screen to determine the position of the user's gaze point on the screen based on the position of the light sensor that collects light reflected from the user's pupil. This improves the accuracy of acquiring the user's gaze point on the screen while minimizing hardware costs associated with the light sensor. Furthermore, the method determines whether the ambient light contains light reflected from the user's pupil based on the magnitude of a voltage value converted from the ambient light, thereby improving the accuracy of the determined position of the user's gaze point on the screen. Furthermore, the method further improves the accuracy of the determined position of the user's gaze point on the screen by determining the position of the user's gaze point on the screen based on the coordinate values of the position of the light sensor that collects light reflected from the user's pupil.

[0110] Reference Figure 8 The embodiment of the present application provides a structural block diagram of a device 30 for acquiring a screen gaze point, which is applied to a screen provided with at least two light sensors. The method includes:

[0111] An acquisition module 301 is configured to acquire ambient light collected by each of the light sensors, where the ambient light is located on the light-emitting side of the screen;

[0112] The screening module 302 is configured to use the light sensor whose collected ambient light includes the light reflected by the user's pupil as the target light sensor;

[0113] The determination module 303 is configured to determine the position of the user's gaze point according to the position of the target light sensor.

[0114] Optionally, the screening module 302 is further configured to:

[0115] To obtain an electrical signal corresponding to the ambient light collected by each of the light sensors;

[0116] When the electrical signal meets the electrical signal requirement, it is confirmed that the ambient light corresponding to the electrical signal includes the pupil reflected light of the user.

[0117] Optionally, when the electrical signal is a voltage, the electrical signal is required to have a voltage less than or equal to a voltage threshold;

[0118] The screening module 302 is further configured to:

[0119] When the voltage is less than or equal to the voltage threshold, it is confirmed that the ambient light corresponding to the electrical signal includes light reflected from the pupil of the user.

[0120] Optionally, the acquisition module 301 is further configured to:

[0121] Obtaining a user's pupil size and a straight-line distance between the user's pupil and the light sensor;

[0122] Obtaining the user's field of view angle according to the user's pupil size and the straight-line distance;

[0123] When the user's viewing angle is greater than or equal to the sensor's viewing angle, the light sensor is turned on to collect ambient light on the light-emitting side of the screen.

[0124] Optionally, the determining module 303 is further configured to:

[0125] acquiring, according to the position of the target light sensor, an associated position of the target light sensor on the screen, wherein the associated position is obtained by dividing the position of the screen according to the number and positions of the light sensors;

[0126] The average of the associated positions is calculated based on the number of the target light sensors to obtain the position of the user's gaze point on the screen.

[0127] Optionally, at least two horizontal light sensors are provided on the horizontal side of the screen, and at least two vertical light sensors are provided on the vertical side of the screen, the target light sensors include: at least one target horizontal light sensor and at least one target vertical light sensor, and the position of the user's gaze point includes a target horizontal coordinate value and a target vertical coordinate value;

[0128] The determining module 303 is further configured to:

[0129] The average of the horizontal coordinate values of the target horizontal light sensors is used as the target horizontal coordinate value of the user's gaze point, and the average of the vertical coordinate values of the target vertical light sensors is used as the target vertical coordinate value of the user's gaze point.

[0130] An embodiment of the present application provides a device for acquiring a screen gaze point, which collects ambient light on the light-emitting side of the screen by setting a light sensor on the side of the screen, and determines the position of the user's gaze point on the screen based on the position of the light sensor that collects the light reflected by the user's pupil. This improves the accuracy of acquiring the position of the user's gaze point on the screen with lower hardware cost based on the light sensor.

[0131] An embodiment of the present application provides an electronic device, a memory, and a program or instruction stored in the memory and executable on the processor. When the program or instruction is executed by the processor, any of the above-mentioned methods for acquiring a screen gaze point is implemented.

[0132] An embodiment of the present application provides a device for acquiring a screen gaze point, which collects ambient light on the light-emitting side of the screen by setting a light sensor on the side of the screen, so as to determine the position of the user's gaze point on the screen according to the position of the light sensor that collects the light reflected by the user's pupil. This improves the accuracy of acquiring the position of the user's gaze point on the screen with a lower hardware cost based on the light sensor.

[0133] An embodiment of the present application embodies a display device, which includes a screen with at least two light sensors arranged on the side, and a processor, wherein the processor is configured to implement the above-mentioned method for acquiring the screen gaze point.

[0134] An embodiment of the present application provides a computer storage medium having a computer program stored thereon. When the computer program is executed by a processor, the above-mentioned method for acquiring a screen gaze point can be implemented.

[0135] An embodiment of the present application provides a computer storage medium, which collects ambient light on the light-emitting side of the screen by setting a light sensor on the side of the screen, so as to determine the position of the user's gaze point on the screen according to the position of the light sensor that collects the light reflected by the user's pupil, thereby improving the accuracy of obtaining the position of the user's gaze point on the screen with lower hardware cost based on the light sensor.

[0136] Those skilled in the art will appreciate that the present application includes devices for performing one or more of the operations described herein. These devices may be specially designed and manufactured for the desired purpose, or they may include known devices found in general-purpose computers. These devices have computer programs stored therein, which are selectively activated or reconfigured. Such computer programs may be stored in a storage medium of a device (e.g., a computer) or in any type of medium suitable for storing electronic instructions and coupled to a bus, including but not limited to any type of disk (including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic cards, or optical cards. In other words, a storage medium includes any medium that can be used by a device (e.g., a computer) to store or transmit information in a readable form.

[0137] Those skilled in the art will appreciate that each block in these structural diagrams and / or block diagrams and / or flow charts, as well as combinations of blocks in these structural diagrams and / or block diagrams and / or flow charts, can be implemented using computer program instructions. Those skilled in the art will appreciate that these computer program instructions can be provided to a processor of a general-purpose computer, a specialized computer, or other programmable data processing method for implementation, thereby executing the schemes specified in the blocks or multiple blocks of the structural diagrams and / or block diagrams and / or flow charts disclosed in this application through the processor of the computer or other programmable data processing method.

[0138] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for obtaining a screen gaze point, characterized in that: Applied to a screen, at least two light sensors are provided in a non-display area around the screen, and the method includes: Acquire ambient light collected by each of the light sensors, where the ambient light is located on a light-emitting side of the screen; The light sensor that collects ambient light including the light reflected from the user's pupil is used as the target light sensor; Determining the position of the user's gaze point based on the position of the target light sensor; The number of the light sensors is determined by the viewing angle of the screen and the position accuracy of the user's gaze point.

2. The method according to claim 1, characterized in that Before using the light sensor that collects ambient light including light reflected from the user's pupil as the target light sensor, the method further includes: Acquiring an electrical signal corresponding to the ambient light collected by each of the light sensors; When the electrical signal meets the electrical signal requirement, it is confirmed that the ambient light corresponding to the electrical signal includes the pupil reflected light of the user.

3. The method according to claim 2, characterized in that When the electrical signal is a voltage, the electrical signal is required to have a voltage less than or equal to a voltage threshold; When the electrical signal meets the electrical signal requirement, confirming that the ambient light corresponding to the electrical signal includes pupil reflected light of the user includes: When the voltage is less than or equal to the voltage threshold, it is confirmed that the ambient light corresponding to the electrical signal includes light reflected from the pupil of the user.

4. The method according to claim 1, wherein Before acquiring the ambient light collected by each of the light sensors, the method further includes: Obtaining a user's pupil size and a straight-line distance between the user's pupil and the light sensor; Obtaining the user's field of view angle according to the user's pupil size and the straight-line distance; When the user's viewing angle is greater than or equal to the sensor's viewing angle, the light sensor is turned on to collect ambient light on the light-emitting side of the screen.

5. The method according to claim 1, wherein The determining the position of the user's gaze point according to the position of the target light sensor includes: acquiring, according to the position of the target light sensor, an associated position of the target light sensor on the screen, wherein the associated position is obtained by dividing the position of the screen according to the number and positions of the light sensors; The average of the associated positions is calculated based on the number of the target light sensors to obtain the position of the user's gaze point on the screen.

6. The method according to claim 5, characterized in that At least two horizontal light sensors are provided on the horizontal side of the screen, and at least two vertical light sensors are provided on the vertical side of the screen, the target light sensors include: at least one target horizontal light sensor and at least one target vertical light sensor, and the position of the user's gaze point includes a target horizontal coordinate value and a target vertical coordinate value; The averaging of the associated positions based on the number of the target light sensors to obtain the position of the user's gaze point on the screen includes: The average of the horizontal coordinate values of the target horizontal light sensors is used as the target horizontal coordinate value of the user's gaze point, and the average of the vertical coordinate values of the target vertical light sensors is used as the target vertical coordinate value of the user's gaze point.

7. A device for acquiring a screen gaze point, characterized in that: Applied to a screen, at least two light sensors are provided in a non-display area around the screen, and the device includes: an acquisition module configured to acquire ambient light collected by each of the light sensors, where the ambient light is located on a light-emitting side of the screen; A screening module is configured to use a light sensor whose collected ambient light includes light reflected from the user's pupil as a target light sensor; A determination module is configured to determine the position of the user's gaze point according to the position of the target light sensor; The number of the light sensors is determined by the viewing angle of the screen and the position accuracy of the user's gaze point.

8. A display device, characterized in that: The display device includes a screen with at least two light sensors arranged on its sides, and a processor, wherein the processor is configured to implement the method for acquiring a screen gaze point as described in any one of claims 1 to 6.

9. An electronic device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for acquiring the screen gaze point according to any one of claims 1 to 6 is implemented.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for acquiring the screen gaze point according to any one of claims 1 to 6 is implemented.

Images