Eye tracking device and eye tracking method

By placing sensors and signal transmitting components on the eyeball to calculate the eyeball position, the problem of camera dependence is solved, realizing camera-free eye tracking, which improves user experience and application convenience.

CN116935481BActive Publication Date: 2025-11-25HTC CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211252541.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2022-04-08
Filing Date
2022-10-13
Publication Date
2025-11-25
Estimated Expiration
2042-10-13

AI Technical Summary

Technical Problem

Existing eye-tracking technologies rely on cameras to capture images of the human eye, which limits the configuration of electronic products and the user experience.

Method used

Using a sensor and a surrounding sensor signal transmission component, the eye position is calculated by receiving and transmitting signals on the eyeball, enabling camera-free eye tracking.

Benefits of technology

It achieves camera-free eye tracking, enhances the user experience, is suitable for immersive applications such as augmented reality and virtual reality, and can be used anytime, anywhere.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116935481B_ABST
    Figure CN116935481B_ABST
Patent Text Reader

Abstract

An eye tracking device and an eye tracking method are disclosed. The eye tracking device includes a sensor and a plurality of signal emitting components. The sensor is disposed on an eye of a user. The sensor has a plurality of signal receiving components. The signal emitting components are disposed around the sensor and surround the sensor. The signal emitting components respectively emit a plurality of emitting signals. The signal receiving components receive the emitting signals to respectively generate a plurality of sensing signals. The eye tracking device calculates a position of the eye according to the sensing signals.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to an eye-tracking device and an eye-tracking method, and more particularly to an eye-tracking device and an eye-tracking method that can be configured on the eyeball and perform eye-tracking actions. Background Technology

[0002] Generally, electronic products using eye-tracking technology capture images of the human eye using a camera, and then use a computing device to obtain the eye-tracking results based on the captured images. However, cameras limit the configuration of current electronic products, thus affecting the user experience. Summary of the Invention

[0003] This invention provides an eye-tracking device and an eye-tracking method that can perform eye-tracking actions without a camera.

[0004] The eye-tracking device of this invention includes a sensor and multiple signal transmitting components. The sensor is disposed on the user's eyeball. The sensor has multiple signal receiving components. These signal transmitting components are disposed around and surround the sensor. These signal transmitting components respectively transmit multiple transmission signals. These signal receiving components receive these transmission signals to generate multiple sensing signals respectively. The eye-tracking device calculates the position of the eyeball based on these sensing signals.

[0005] This invention also provides an eye-tracking method. The eye-tracking method includes the following steps: A sensor having multiple signal receiving components is disposed on the user's eyeball. Multiple signal transmitting components are disposed around the sensor. These signal transmitting components surround the sensor. Each of the signal transmitting components transmits multiple transmitted signals. The signal receiving components receive these transmitted signals to generate multiple sensing signals. The location of the eyeball is calculated based on these sensing signals.

[0006] Based on the above, the eye-tracking device and eye-tracking method of the present invention can receive multiple transmitted signals to generate multiple inductive signals through sensors set on the user's eyeballs, so that the eye-tracking device can perform eye-tracking actions according to the inductive signals. Therefore, eye-tracking can be achieved without a camera configuration, and eye-tracking applications can be experienced anytime and anywhere.

[0007] To make the above features and advantages of the present invention more apparent and understandable, specific embodiments are described below in conjunction with the accompanying drawings. Attached Figure Description

[0008] Figure 1 This is a schematic diagram of an eye-tracking device according to an embodiment of the present invention;

[0009] Figure 2 This is a flowchart illustrating an eye-tracking method according to an embodiment of the present invention;

[0010] Figure 3 This is a schematic diagram illustrating the operation of an eye-tracking device according to an embodiment of the present invention;

[0011] Figure 4 Based on the present invention Figure 3 The flowchart of the eye-tracking method illustrated in the embodiments;

[0012] Figure 5A Based on the present invention Figure 3 The embodiment illustrates the operation of the signal transmitting component;

[0013] Figure 5B Based on the present invention Figure 3 The embodiment illustrates the operation of the signal receiving component;

[0014] Figure 6 Based on the present invention Figure 3 The flowchart of the eye-tracking method illustrated in the embodiments;

[0015] Figure 7 Based on the present invention Figure 6 A schematic diagram illustrating the operation of the signal receiving component in the embodiment.

[0016] Explanation of reference numerals in the attached figures

[0017] 100, 300: Eye-tracking devices

[0018] 110, 310: Sensors

[0019] 111~112, 311~312: Signal receiving components

[0020] 211, 221~223, 231~232, 241~246, 411, 421~423, 431~432, 441~446: Signal transmitting components

[0021] 330: Controller

[0022] AW: Arrow

[0023] EYE: Eyeball

[0024] F1~F4: Brackets

[0025] FE: Frame

[0026] GL: Glass

[0027] PA1, PB1~PB3, PC1~PC2, PD1~PD6: Charging signals

[0028] PT1, PT2: Period

[0029] S210~S240, S410~S450, S610~S640: Steps

[0030] SS_311, SS_312: Induction signals

[0031] X, Y, Z: Direction Detailed Implementation

[0032] Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same element references are used in the drawings and description to denote the same or similar parts.

[0033] Figure 1 This is a schematic diagram of an eye-tracking device according to an embodiment of the present invention. Please refer to... Figure 1 The eye-tracking device 100 can be coupled to an electronic device (not shown) to operate in conjunction with the electronic device. For example, the eye-tracking device 100 can be controlled by an electronic device to perform operations. The electronic device can be, for example, a mobile phone, tablet computer, laptop computer, and desktop computer.

[0034] exist Figure 1 In this embodiment, the eye-tracking device 100 includes a sensor 110 and a plurality of signal transmitting components 211-246. The sensor 110 is disposed on the user's eyeball (EYE). The signal transmitting components 211-246 are sequentially disposed around and surrounding the sensor 110. In this embodiment, the signal transmitting components 211-246 may be disposed dispersedly and asymmetrically on the frame FE (e.g., the frame of a head-mounted display). Figure 1 The number and configuration of the signal transmitting components 211 to 246 in the embodiments are merely examples and are not intended to limit the scope of the embodiments.

[0035] Since the sensor 110 is placed on the user's eye, the sensor 110 can change position as the eye moves.

[0036] In this embodiment, sensor 110 has multiple signal receiving components 111-112. Each signal receiving component 111 may include multiple segmented induction coils (not shown). These induction coils are sequentially arranged adjacent to the outer edge of sensor 110 and surround the pupil of the eye (i.e., Figure 1 (Solid black graphic). Figure 1 The number and configuration of the signal receiving components 111 to 112 in the embodiment are merely examples and are not intended to be limiting.

[0037] In this embodiment, sensor 110 may be, for example, a smart contact lens. Signal receiving components 111 or 112 may be, for example, a planar printed antenna or other types of antennas for receiving wireless signals. In this embodiment, signal transmitting components 211-246 may be, for example, a planar printed antenna or other types of antennas for outputting wireless signals.

[0038] Figure 2 This is a flowchart illustrating an eye-tracking method according to an embodiment of the present invention. Please refer to... Figure 1 as well as Figure 2 The eye-tracking device 100 can perform the eye-tracking method by executing the following steps S210 to S240.

[0039] In step S210, by having the user wear sensor 110 on their eye, a sensor 110 having multiple signal receiving components 111-112 is positioned on the user's eye. In this embodiment, sensor 110 can be worn in one eye. In some embodiments, there can be two sensors 110, each worn in one eye.

[0040] In step S220, a plurality of signal transmitting components 211 to 246 are arranged around the sensor 110 by the user wearing glasses with a frame FE.

[0041] In step S230, the eye-tracking device 100 causes the signal transmitting components 211 to 246 to send multiple transmission signals respectively, and causes the signal receiving components 111 to 112 to receive these transmission signals to generate multiple sensing signals respectively.

[0042] It should be noted that since the signal receiving component 111 has multiple different distances relative to the signal transmitting components 211-246, the induced signal generated by the signal receiving component 111 contains information related to these distances. The description of the signal receiving component 112 can be drawn by analogy with that of the signal receiving component 111, and therefore will not be repeated here.

[0043] In step S240, the eye-tracking device 100 calculates the position of the eye (EYE) based on these sensing signals. That is, the eye-tracking device 100 can track the eye based on distance information from multiple sensing signals. In this embodiment, the position of the eye (EYE) can be represented using Cartesian coordinates (e.g., (x, y, z)). In some embodiments, the position of the eye (EYE) can be represented using polar coordinates or other coordinate systems.

[0044] It is worth mentioning that by receiving multiple transmitted signals and generating corresponding multiple sensing signals through a sensor 110 mounted on the eyeball, eye-tracking actions can be performed based on the sensing signals, achieving eye tracking without the need for a camera, thus further miniaturizing the eye-tracking device 100. On the other hand, users can experience eye-tracking applications anytime, anywhere through the eye-tracking device 100, such as immersive experiences combined with augmented reality (AR) or virtual reality (VR).

[0045] Please refer to this again. Figure 1 In this embodiment, the eye-tracking device 100 further includes a controller (not shown) and a power supply (not shown). The controller is coupled to signal receiving components 111-112, multiple signal transmitting components 211-246, and the power supply. The controller may be disposed in an electronic device (not shown). The power supply may be disposed on the frame FE or in the glass GL sandwiched between the frame FE.

[0046] In this embodiment, the controller can turn on or off the signal receiving components 111-112 and / or the signal transmitting components 211-246. In this embodiment, the controller can control the power supply to charge the signal receiving components 111-112 and / or the signal transmitting components 211-246.

[0047] In this embodiment, the controller may be, for example, a field-programmable gate array (FPGA), a central processing unit (CPU), or other programmable general-purpose or special-purpose microprocessor, digital signal processor (DSP), programmable controller, application-specific integrated circuit (ASIC), programmable logic device (PLD), or other similar device or combination of these devices, which can load and execute relevant firmware or software to realize computing functions.

[0048] exist Figure 1In this embodiment, signal receiving components 111-112 may be distributed at different locations on the sensor 110. For example, signal receiving component 111 may be located at the outer edge of a first side of the sensor 110, and signal receiving component 112 may be located at the outer edge of a second side of the sensor 110, wherein the first side and the second side are opposite to each other. Signal receiving components 111 and 112 may be adjacent to each other to form a closed loop. In some embodiments, the number of signal receiving components 111-112 may be three or more, and is not limited thereto.

[0049] In this embodiment, signal transmitting components 211-246 are disposed on the frame FE (e.g., the frame of eyeglasses). The frame FE may be a closed or notched surround structure surrounding the sensor 110. For example, the frame FE includes a first support F1, a second support F2, a third support F3, and a fourth support F4. The first support F1 to the fourth support F4 are sequentially adjacent in a clockwise direction to form a surround structure. Figure 1 The shape of the frame FE and the number and configuration of the supports F1 to F4 in the embodiment are merely examples and are not intended to limit the scope of the embodiment.

[0050] In this embodiment, the signal transmitting components 211-246 include at least one first signal transmitting component 211, at least one second signal transmitting component 221-223, at least one third signal transmitting component 231-234, and at least one fourth signal transmitting component 241-246. The signal transmitting components 211-246 are sequentially and clockwise distributed on the supports F1-F4 of the frame FE.

[0051] In detail, in this embodiment, the first signal transmitting component 211 may have a first quantity (e.g., one). The first signal transmitting component 211 may extend in the Y direction and has a first dimension. The first signal transmitting component 211 is disposed on the first support F1 of the frame FE.

[0052] In this embodiment, the second signal transmitting components 221-223 may have a second quantity (e.g., three). The second signal transmitting component 221 may extend in the X direction and has a second dimension. The second signal transmitting components 222 and 223 can be described by analogy with the relevant description of the second signal transmitting component 221, and therefore will not be repeated here. The second signal transmitting components 221-223 may be distributed on the second bracket F2.

[0053] In this embodiment, the third signal transmitting components 231-232 may have a third quantity (e.g., two). The third signal transmitting component 231 may extend in the Y direction and has a third dimension. The third signal transmitting component 231 is disposed on the third support F3 of the frame FE. The description of the third signal transmitting component 232 can be deduced by analogy with the description of the third signal transmitting component 231, and therefore will not be repeated here. The third signal transmitting components 231-232 may be distributed on the third support F3.

[0054] In this embodiment, the fourth signal transmitting components 241-246 may have a fourth quantity (e.g., 6). The fourth signal transmitting component 241 may extend in the X direction and have a fourth dimension. The fourth signal transmitting components 242-246 can be deduced by referring to the relevant description of the fourth signal transmitting component 241, and therefore will not be repeated here. The fourth signal transmitting components 241-246 may be distributed on the fourth bracket F4.

[0055] It should be noted that the first, second, third, and fourth dimensions are all different. That is, the structural sizes of the signal transmitting components mounted on the different brackets F1 to F4 are all different. The aforementioned signal transmitting components are, for example, the first signal transmitting component 211, the second signal transmitting component 221, the third signal transmitting component 231, and the fourth signal transmitting component 241. On the other hand, the first, second, third, and fourth quantities are also different. That is, the number of signal transmitting components mounted on the different brackets F1 to F4 is all different. The aforementioned quantities are, for example, 1, 3, 2, and 6.

[0056] Figure 3 This is a schematic diagram illustrating the operation of an eye-tracking device according to an embodiment of the present invention. Please refer to... Figure 3 The sensor 310, multiple signal transmitting components 411-446, controller 330 and power supply (not shown) included in the eye-tracking device 300 can be deduced by referring to the relevant description of the eye-tracking device 100, and therefore will not be repeated here.

[0057] In this embodiment, when the eyeball moves (e.g., in the direction of arrow AW), the sensor 310 follows the eyeball to generate movement. That is, the positions of the signal receiving components 311 and 312 relative to the plurality of signal transmitting components 411 to 446 change. At this time, the eye-tracking device 300 can operate in tracking mode to calculate the position of the eyeball, or it can operate in correction mode to establish an eye movement model.

[0058] Regardless of whether in tracking mode or calibration mode, the power supply can output multiple charging signals PA1 to PD6 to signal transmitting components 411 to 446. Specifically, the first signal transmitting component 411 can receive charging signal PA1. The second signal transmitting components 421 to 423 can receive charging signals PB1 to PB3 respectively. The third signal transmitting components 431 to 432 can receive charging signals PC1 to PC2 respectively. The fourth signal transmitting components 441 to 446 can receive charging signals PD1 to PD6 respectively.

[0059] In this embodiment, signal transmitting components 411-446 can respectively receive charging signals PA1-PD6 for charging. In some embodiments, signal transmitting components 411-446 can respectively receive and transmit charging signals PA1-PD6 as transmission signals to perform eye tracking. In some embodiments, signal transmitting components 411-446 can respectively receive and transmit charging signals PA1-PD6 to charge sensor 310.

[0060] Figure 4 Based on the present invention Figure 3 A flowchart illustrating the eye-tracking method in the embodiments. Please refer to... Figure 3 as well as Figure 4 The eye-tracking device 300 can perform the eye-tracking method by executing the following steps S410 to S450.

[0061] In step S410, the controller 330 controls the signal transmitting components 411 to 446 to transmit multiple signals according to a set sequence, a set time interval, and a set radiation intensity.

[0062] For example, with clockwise as the enabling sequence, signal transmitting components 411-446 sequentially transmit signals with the same energy at equal time intervals. Please refer to this as well. Figure 5A , Figure 5A Based on the present invention Figure 3 A schematic diagram illustrating the operation of the signal transmitting component in the embodiment. Figure 5A In the diagram, the horizontal axis represents the operating time of signal transmitting components 411-446, and the vertical axis represents the voltage value. In this embodiment, charging signals PA1-PD6 are used to charge signal transmitting components 411-446 to send corresponding transmission signals. Each charging signal PA1-PD6 has the same enable period PT1 and the same enable voltage value. Furthermore, the time interval between each pair of charging signals PA1-PD6 is the same (i.e., period PT2).

[0063] In step S420, these transmitted signals are received by signal receiving components 311-312 to generate multiple induction signals respectively.

[0064] For example, please refer to the following: Figure 5B , Figure 5B Based on the present invention Figure 3 A schematic diagram illustrating the operation of the signal receiving component in the embodiment. Figure 5B In the diagram, the horizontal axis represents the operating time of signal receiving components 311-312, and the vertical axis represents the voltage value. In this embodiment, signal receiving components 311 and 312 can receive (and accumulate) multiple transmitted signals during step S410 to generate a first sensing signal SS_311 and a second sensing signal SS_312, respectively.

[0065] In step S430, the controller 330 determines whether the eye-tracking device 300 has an eye-tracking model. If the result of step S430 is no, it means that the eye-tracking device 300 has not yet established an eye-tracking model, and the eye-tracking device 300 executes step S440. If the result of step S430 is yes, it means that the eye-tracking device 300 has established an eye-tracking model, and the eye-tracking device 300 executes step S450.

[0066] In step S440, the eye-tracking device 300 operates in correction mode and establishes an eye movement model via the controller 330. In this embodiment, the eye-tracking device 300 may subsequently execute step S450. Step S440 may include the following details.

[0067] In the correction mode, the controller 330 sequentially sets the eye's eye position in multiple different gaze directions. These gaze directions may include gazing directly ahead (i.e., with the eye centered), a first direction (i.e., the positive X direction), a second direction (i.e., the negative X direction), a third direction (i.e., the positive Y direction), and a fourth direction (i.e., the negative Y direction). The number and order of gaze directions in this embodiment are merely examples and are not intended to limit the scope.

[0068] In the correction mode, corresponding to each gaze direction, the controller 330 causes each signal transmitting component 411 to 446 to transmit a transmission signal in a time-division manner. In this embodiment, the aforementioned transmission signal may, for example, be based on... Figure 5A The transmission signals generated by the charging signals PA1 to PD6.

[0069] In the correction mode, the controller 330 establishes multiple classification boundary equations based on the waveforms of multiple induction signals received by the signal receiving components 311-312. In this embodiment, the aforementioned induction signals may be, for example, based on... Figure 5B The induction signals SS_311~SS_312.

[0070] Specifically, for each gaze direction, the controller 330 calculates the average energy of each sensed signal. That is, when the eye is gazing directly forward (i.e., the eye is centered), the controller 330 calculates the average energy of the sensed signal generated at that time. When the eye is gazing in the positive X direction, the controller 330 calculates the average energy of the sensed signal generated at that time, and so on. In this embodiment, the controller 330 classifies the calculated average energy based on classification decision analysis or other classification methods to obtain multiple classification boundary equations relating to different gaze directions (e.g., centered, positive X direction, negative X direction, positive Y direction, negative Y direction) and the average energy of the sensed signal.

[0071] In the correction mode, the controller 330 performs classification calculations based on the aforementioned multiple gaze directions and their corresponding multiple energy average values ​​to establish an eye-tracking model. That is, the eye-tracking model may include multiple classification boundary equations to classify the energy average values ​​of the sensed signals to the corresponding gaze direction (e.g., center, positive X direction, negative X direction, positive Y direction, negative Y direction).

[0072] On the other hand, in the correction mode, in this embodiment, the controller 330 calculates the eigenvalues ​​and eigenvectors according to a characteristic equation (e.g., equation A×B=C×B). In the aforementioned equation, A is a vector formed by multiple energy averages corresponding to each gaze direction in the correction mode. B is an eigenvector representing the relationship between the gaze direction and the energy average of the sensed signal. C is the eigenvalue in the aforementioned relationship. The dimension of A can be 5×5, the dimension of B can be 5×1, and C can be a constant.

[0073] In the correction mode, the controller 330 establishes an eye-tracking model by storing feature values ​​(i.e., feature value C) and feature vectors (i.e., feature vector B). That is, in each classification boundary equation (corresponding to a single gaze direction), the eye-tracking model may include feature value C and feature vector B to calculate the location of the eyeball EYE by calculating the average energy of the sensed signal with feature vector B and / or feature value C.

[0074] In some embodiments, in step S440, the eye-tracking device 300 operates in correction mode, and a gaze vector lookup table is established by the controller 330. In correction mode, the controller 330 generates a lookup distance by cross-productting the average energy of each sense signal with the feature vector according to the classification boundary equation. The controller 330 plots the distance vector corresponding to each gaze direction using an interpolation method (e.g., interpolation) and stores multiple distance vectors as a gaze vector lookup table.

[0075] In step S450, the eye-tracking device 300 operates in tracking mode, and the controller 330 calculates the location of the eye (EYE) using various sensing signals. In other words, the eye-tracking device 300 can input the sensing signals into the eye-movement model for calculation to obtain the location of the eye (EYE).

[0076] In other embodiments of the present invention, the above-described correction mode can also be implemented by the controller 330 using machine learning. For example, the controller 330 can set up a neural network model and input the average energy of the obtained sensing signals associated with different gaze directions into the neural network model for training. In addition, in tracking mode, the controller 330 can input each sensing signal into the trained neural network model and calculate the location of the eyeball (EYE) accordingly.

[0077] Figure 6 Based on the present invention Figure 3 A flowchart illustrating the eye-tracking method in the embodiments. Please refer to... Figure 3 as well as Figure 6 The eye-tracking device 300 can perform the eye-tracking method by executing the following steps S610 to S640.

[0078] In step S610, the eye-tracking device 300 operates in tracking mode. The controller 330 calculates the average value (e.g., energy average value) of each sensing signal to obtain a measurement result, and generates lookup information by cross-productting the measurement result with a feature vector (i.e., feature vector B in the eye-tracking model). In other words, the controller 330 can calculate the energy average value of multiple sensing signals (i.e., the measurement result represented by a vector). The controller 330 can then substitute the measurement result into a characteristic equation to obtain lookup information represented by a vector.

[0079] In step S620, the eye-tracking device 300 operates in tracking mode, and the controller 330 inputs the search information into multiple classification boundary equations (i.e., classification boundary equations in the eye-tracking model) to obtain the gaze vector, and calculates the location of the eye EYE based on the gaze vector.

[0080] In step S630, the eye-tracking device 300 operates in the charging mode within the tracking mode, and the controller 330 determines the location of the eye (e.g., as shown in the image) based on the position of the eye. Figure 3 (as shown) to activate at least one of the selected signal transmitting components (e.g., signal transmitting components 422, 423) of the corresponding plurality of signal transmitting components 411 to 446.

[0081] In step S640, the eye-tracking device 300 operates in charging mode and controls the power supply through the controller 330 to cause the selected signal transmitting component (e.g., signal transmitting components 422, 423) to send charging signals (e.g., charging signals PB2, PB3) to the sensor 310, and cause the sensor 310 to charge according to the charging signals.

[0082] For example, please refer to the following: Figure 7 , Figure 7 Based on the present invention Figure 6 A schematic diagram illustrating the operation of the signal receiving component in the embodiment. Figure 7 In the diagram, the horizontal axis represents the operating time of signal receiving components 311-312, and the vertical axis represents the voltage value. In this embodiment, when the controller 330 has calculated the location of the eyeball (e.g., as shown in the diagram),... Figure 3 As shown, the controller 330 can select signal transmitting components 422 and 423 of the drive section. The selected signal transmitting components 422 and 423 respectively receive charging signals PB2 and PB3 with an enable voltage to perform charging. The other unselected signal transmitting components 411, 421, 431 to 446 do not receive charging signals (i.e., charging signals PA1, PB1, PC1 to PD6 without an enable voltage). The selected signal transmitting components 422 and 423 respectively send charging signals PB2 and PB3 so that the sensor 310 receives charging signals PB2 and PB3 to perform charging.

[0083] It should be noted that the eye-tracking device 300 can select a portion of the signal transmitting components 422 and 423 adjacent to the location of the eyeball (EYE) based on the location of the eyeball and / or the configuration (size, number, etc.) of the signal transmitting components 411-426. In this way, by enabling only a portion of the signal transmitting components 422 and 423, the eye-tracking device 300 can achieve a minimum output power, thereby improving the operational stability of the eye-tracking device 300 and further reducing the radiation energy that the human body may absorb.

[0084] In summary, the eye-tracking device and method of the present invention can perform eye-tracking actions through sensors mounted on the eyeball, thereby improving the user experience. In some embodiments, based on the calculated position of the eyeball, the eye-tracking device can enable a signal transmitting component to charge the sensor, thereby reducing the power consumption of the eye-tracking device and achieving minimum output power.

[0085] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An eye-tracking device, characterized in that... include: The sensor, placed on the user's eyeball, has multiple signal receiving components; as well as Multiple signal transmitting components are arranged around and surround the sensor. The plurality of signal transmitting components respectively transmits a plurality of transmitted signals, and the plurality of signal receiving components receive the plurality of transmitted signals to generate a plurality of sensing signals respectively. The eye-tracking device calculates the position of the eyeball based on the plurality of sensing signals. At least one of the plurality of signal transmitting components is selected according to the location of the eyeball to send a charging signal to the sensor to charge the sensor.

2. The eye-tracking device according to claim 1, characterized in that... The sensor described therein follows the eyeball to produce movement.

3. The eye-tracking device according to claim 1, characterized in that... Also includes: The controller is coupled to the plurality of signal receiving components.

4. The eye-tracking device according to claim 3, characterized in that... In the correction mode, the eye is sequentially positioned in multiple different gaze directions, and corresponding to each gaze direction, each signal transmitting component sends its respective transmission signal in a time-division manner. The controller is used to: Multiple classification boundary equations are established based on the waveforms of the multiple sensed signals; For each of the stated gaze directions, calculate the average energy of each of the stated sensing signals; as well as An eye-tracking model is established by classifying and calculating based on the multiple gaze directions and their corresponding average energy values.

5. The eye-tracking device according to claim 4, characterized in that... The controller further includes: The eigenvalues ​​and eigenvectors are calculated using the equation A × B = C × B, where A is the average energy value corresponding to the multiple gaze directions, B is the eigenvector, and C is the eigenvalue; and The feature values ​​and feature vectors are stored to establish the eye-tracking model.

6. The eye-tracking device according to claim 5, characterized in that... In tracking mode, the controller is used to: The average value of each of the sensed signals is calculated to obtain the measurement result, and the cross product of the measurement result and the feature vector is used to generate search information; as well as The search information is substituted into the multiple classification boundary equations to obtain a gaze vector, and the location of the eyeball is calculated based on the gaze vector.

7. The eye-tracking device according to claim 1, characterized in that, In charging mode, the controller in the eye-tracking device is used to: Based on the location of the eyeball, at least one of the corresponding plurality of signal transmitting components is activated to select the signal transmitting component; and The selected signal transmitting component sends the charging signal to the sensor, and the sensor charges according to the charging signal.

8. The eye-tracking device according to claim 1, characterized in that... The plurality of signal transmitting components are mounted on a frame that surrounds the sensor, and the plurality of signal receiving components are distributed at different locations on the sensor.

9. The eye-tracking device according to claim 8, characterized in that... The plurality of signal transmitting components includes at least one first signal transmitting component, at least one second signal transmitting component, at least one third signal transmitting component, and at least one fourth signal transmitting component. The at least one first signal transmitting component is disposed on the first support of the frame; the at least one second signal transmitting component is disposed on the second support of the frame; the at least one third signal transmitting component is disposed on the third support of the frame; and the at least one fourth signal transmitting component is disposed on the fourth support of the frame.

10. The eye-tracking device according to claim 9, characterized in that... The at least one first signal transmitting component, the at least one second signal transmitting component, the at least one third signal transmitting component, and the at least one fourth signal transmitting component each have a first size, a second size, a third size, and a fourth size, and the first size, the second size, the third size, and the fourth size are all different from each other.

11. The eye-tracking device according to claim 9, characterized in that... The at least one first signal transmitting component, the at least one second signal transmitting component, the at least one third signal transmitting component, and the at least one fourth signal transmitting component have a first quantity, a second quantity, a third quantity, and a fourth quantity, respectively, and the first quantity, the second quantity, the third quantity, and the fourth quantity are all different from each other.

12. An eye-tracking method, characterized in that... include: A sensor with multiple signal receiving components is placed on the user's eyeball; Multiple signal transmitting components are arranged around the sensor, and the multiple signal transmitting components surround the sensor; The plurality of signal transmitting components respectively transmit a plurality of transmitted signals, and the plurality of signal receiving components receive the plurality of transmitted signals to generate a plurality of induction signals respectively; The location of the eyeball is calculated based on the plurality of sensor signals; as well as At least one of the plurality of signal transmitting components is selected based on the location of the eyeball to send a charging signal to the sensor to charge the sensor.

13. The eye-tracking method according to claim 12, characterized in that... The sensor described therein follows the eyeball to produce movement.

14. The eye-tracking method according to claim 12, characterized in that... The correction mode also includes: The eyeballs are sequentially positioned in multiple different gaze directions; Corresponding to each of the gaze directions, each of the signal transmitting components transmits each of the transmitting signals in a time-division manner; Multiple classification boundary equations are established based on the waveforms of the multiple sensed signals; For each of the stated gaze directions, calculate the average energy of each of the stated sensing signals; and An eye-tracking model is established by classifying and calculating based on the multiple gaze directions and their corresponding average energy values.

15. The eye-tracking method according to claim 14, characterized in that... Also includes: The eigenvalues ​​and eigenvectors are calculated based on the equation A × B = C × B, where A is the average energy value corresponding to the multiple gaze directions, B is the eigenvector, and C is the eigenvalue. as well as The feature values ​​and feature vectors are stored to establish the eye-tracking model.

16. The eye-tracking method according to claim 15, characterized in that... The tracking mode also includes: The average value of each of the sensed signals is calculated to obtain the measurement result, and the cross product of the measurement result and the feature vector is used to generate search information; The search information is substituted into the multiple classification boundary equations to obtain a gaze vector, and the location of the eyeball is calculated based on the gaze vector.

17. The eye-tracking method according to claim 12, characterized in that... In charging mode, it also includes: Based on the location of the eyeball, at least one of the corresponding plurality of signal transmitting components is activated to select the signal transmitting component; and The selected signal transmitting component sends the charging signal to the sensor, and the sensor charges according to the charging signal.

Citation Information

Patent Citations

  • Optical system for detecting and tracking eye movements, associated external frame and associated connected contact lens

    US20210157133A1

  • Input detection

    US9207760B1