Eyeball tracking device of smart head-mounted device, tracking method and smart head-mounted device

Abstract

The embodiment of the application provides an eye tracking device, a tracking method and a smart head-mounted device of the smart head-mounted device; the eye tracking device comprises a flexible frame body, a contact point and a data processing unit; the flexible frame can be attached around the eye; the contact point is arranged on the flexible frame body and extends towards the eyeball, and a coil is arranged on the contact point; the contact point can be in contact with the skin around the eye and can be deformed by the driving of the skin and the muscle with the movement of the eyeball, so that the deformation of the coil is caused, and then the resistance value array [R1, R2,..., R N ] composed of each coil changes, wherein N is the number of the coils, and N>=3; the data processing unit is used for receiving the resistance value array [R1, R2,..., R N ] corresponding to the deformation of each coil, and converting the received resistance value array [R1, R2,..., R N ] into the eye gaze position [X, Y, Z] according to a preset function mapping relationship.

Description

Technical Field

[0001] This application relates to the field of eye-tracking technology, and more specifically, to an eye-tracking device, tracking method, and smart head-mounted device for a smart head-mounted device. Background Technology

[0002] With the rapid development of smart wearable devices, eye-tracking technology has gradually become a research hotspot in this field. Eye-tracking technology can capture and analyze users' eye movements in real time, providing users with a more natural and convenient interactive experience. Traditional eye-tracking technologies mostly rely on infrared light sources and infrared camera modules built into optical modules, and achieve eye tracking through image recognition algorithms. While this approach meets the needs of eye tracking to a certain extent, it also brings many problems.

[0003] First, the built-in infrared light source and infrared camera module are prone to stray light and ghosting in the optical module, which not only affects the accuracy and stability of eye tracking but also increases the difficulty and complexity of subsequent image processing. Second, existing eye tracking solutions impose stringent requirements on production assembly and sealing, increasing manufacturing costs and process difficulty. Furthermore, the built-in infrared light source and infrared imaging module occupy valuable space inside the smart wearable device, limiting the layout and expansion of other functional modules. Summary of the Invention

[0004] The purpose of this application is to provide an eye-tracking device, tracking method, and new technical solution for a smart head-mounted device.

[0005] In a first aspect, this application provides an eye-tracking device for a smart head-mounted device. The eye-tracking device for the smart head-mounted device includes:

[0006] The flexible frame can be fitted around the eyes;

[0007] At least one contact point is disposed on the flexible frame and extends toward the eyeball, and at least one coil is disposed on the contact point. The contact point is configured to contact the skin around the eye and deform with the movement of the eyeball through the action of the skin and muscles, thereby causing the coil to deform, and thus causing the resistance array [R1, R2, ..., R...] composed of the coils to... N The number of coils is N, and N≥3;

[0008] The data processing unit is used to receive the resistance value array [R1, R2, ..., R] corresponding to the deformation of each of the coils. N ], and according to the preset function mapping relationship f(R1, R2, ..., R N= [X, Y, Z], and the received resistance value array [R1, R2, ..., R... N Convert [X, Y, Z] to eye gaze position.

[0009] Optionally, each of the contacts is provided with at least two sets of coils, and at least one set of coils forms a non-zero angle with the other set of coils.

[0010] Optionally, each of the contacts is provided with two sets of mutually perpendicular coils.

[0011] Optionally, the coil is an S-shaped folded coil. When the coil deforms under the action of the skin and muscles along with the contact point, its length changes, which in turn causes a change in the resistance value of the coil.

[0012] Optionally, the contacts are set to at least four.

[0013] Optionally, the flexible frame is a flexible hollow airbag that can be adjusted by changing the internal air pressure to fit around the eyes.

[0014] Optionally, the flexible frame is made of silicone.

[0015] Optionally, the coil is disposed inside the contact.

[0016] Optionally, the smart head-mounted device is smart glasses, and the smart glasses include a frame;

[0017] The flexible frame is mounted on the eyeglass frame and located on the side closest to the eyes.

[0018] Secondly, this application provides an eye-tracking method, which is applied to a smart head-mounted device, and the eye-tracking method includes:

[0019] When wearing the smart head-mounted device, the flexible frame is attached to the area around the eyes, and each contact point on the flexible frame is in contact with the skin around the eyes; wherein, the contact points can deform with the movement of the eyeballs through the action of the skin and muscles;

[0020] When the contact point deforms, the shape change of each coil on it causes a change in its resistance value, thereby forming a resistance value array [R1, R2, R3..., R...] corresponding to eye movements. N ], where N is the total number of coils, N≥3;

[0021] The data processing unit receives the resistance value array [R1, R2, ..., R] corresponding to the deformation of each coil. N ], and according to the preset function mapping relationship f(R1, R2, ..., R N= [X, Y, Z], and the received resistance value array [R1, R2, ..., R... N Convert [X, Y, Z] to eye gaze position.

[0022] Optionally, the eye-tracking method further includes:

[0023] The preset motion point trajectory is dynamically displayed on the screen of the smart head-mounted device. The motion point trajectory is composed of different [X, Y, Z] coordinates and can cover the user's gaze range.

[0024] During eye tracking of motion points, the smart head-mounted device detects the deformation of the contact points caused by eye movements and acquires the resistance changes of all coils at each contact point, forming a corresponding resistance value array [R1, R2, ..., R...]. N ], where N is the total number of coils, and N≥3;

[0025] Connect each eye fixation point position [X, Y, Z] with the corresponding resistance value array [R1, R2, ..., R...]. N Pair them up to construct an array of resistance values ​​[R1, R2, ..., R]. N The functional mapping relationship f(R1, R2, ..., R) between the eye fixation position [X, Y, Z] and the eye fixation position [X, Y, Z]. N = [X, Y, Z].

[0026] Thirdly, this application provides a smart head-mounted device, the smart head-mounted device comprising:

[0027] The eye-tracking device as described in the first aspect.

[0028] The beneficial effects of this application are as follows:

[0029] This application provides a novel eye-tracking device that does not rely on infrared light sources and infrared camera modules found in traditional eye-tracking technologies. Instead, it utilizes the movement of peripheral eye muscles generated during eye movements, converting this muscle movement into changes in coil resistance to achieve eye tracking. This design not only avoids stray light and ghosting problems common in optical modules, ensuring the accuracy and stability of eye tracking, but also reduces reliance on image recognition algorithms and simplifies the system structure.

[0030] Because the eye-tracking device of this application is located outside the optical module, maintaining a certain distance from the eyeball, it is more conducive to the assembly and maintenance of the device. At the same time, it eliminates the need for complex dustproofing, reducing manufacturing costs and maintenance difficulty. Finally, from a space utilization perspective, the solution of this application avoids the occupation of internal space for the smart head-mounted device by the built-in infrared light source and red camera module, providing more layout and expansion space for other functional modules.

[0031] Other features and advantages of this specification will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0032] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of this specification and, together with their description, serve to explain the principles of this specification.

[0033] Figure 1 This is a usage diagram of the eye-tracking device according to an embodiment of this application;

[0034] Figure 2 This is a schematic diagram of the structure of the eye-tracking device according to an embodiment of this application;

[0035] Figure 3 This is an enlarged schematic diagram of the contact points of the eye-tracking device according to an embodiment of this application.

[0036] Explanation of reference numerals in the attached figures:

[0037] 1. Flexible frame; 2. Contact points; 3. Coil; 4. Screen; 5. Lens. Detailed Implementation

[0038] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present application.

[0039] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.

[0040] Technologies and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such technologies and equipment should be considered part of the specification.

[0041] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0042] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0043] The eye-tracking device, tracking method, and smart head-mounted device provided in this application will be described in detail below with reference to the accompanying drawings.

[0044] According to one embodiment of this application, an eye-tracking device for a smart head-mounted device is provided, see [link]. Figures 1 to 3 The eye-tracking device includes a flexible frame 1, at least one contact point 2, and a data processing unit (not shown in the figure). The flexible frame 1 can be attached to the area around the eye. The at least one contact point 2 is disposed on the flexible frame 1 and extends towards the eyeball. At least one coil 3 is disposed on the contact point 2. The contact point 2 is configured to contact the skin around the eye and deform with the movement of the eyeball through the action of the skin and muscles, thereby causing the coil 3 to deform. This, in turn, causes the resistance array [R1, R2, ..., R...] formed by the coils 3 to... N The data processing unit is used to receive the resistance value array [R1, R2, ..., R] corresponding to the deformation of each of the coils 3, where N is the number of coils 3 and N≥3; N ], and according to the preset function mapping relationship f(R1, R2, ..., R N = [X, Y, Z], and the received resistance value array [R1, R2, ..., R... N Convert [X, Y, Z] to eye gaze position.

[0045] The eye-tracking device for the smart head-mounted device provided in this application embodiment is described in [reference]. Figures 1 to 3 The eye-tracking device consists of the following components:

[0046] The eye-tracking device includes a flexible frame 1, which serves as the foundation of the entire eye-tracking device and can be closely attached to the area around the user's eyes, ensuring that each of the contact points 2 provided thereon can make contact with the skin around the eyes.

[0047] The contact points 2 are disposed on the flexible frame 1 and extend towards the eyeball. These contact points 2 are in contact with the skin around the eye and can deform with the movement of the eyeball through the action of the skin and muscles.

[0048] Furthermore, one or more coils 3 are provided on each of the contact points 2. When the eyeball moves within the eye socket, it causes corresponding movement in the skin and muscles around the eye, which in turn causes deformation of the contact point 2. As the contact point deforms, the coil 3 on it is stretched or compressed, resulting in a change in its resistance value. Based on this, for example, a resistance measurement module can monitor and record the change in resistance value of each coil 3 in real time. Since the movement of the eyeball in different directions causes different contact points 2 to deform in different directions, the change in resistance value of each coil 3 reflects the movement information of the eyeball in that direction. By collecting, processing, and analyzing this data on resistance value changes, a resistance value array [R1, R2, ..., R...] corresponding to the eyeball movement state can be constructed. N Through a pre-calibrated data process, a mapping relationship can be established between changes in resistance value and the position of eye fixation. In practical use, it is only necessary to input the real-time monitored resistance value array [R1, R2, ..., R...]. N By matching the image with this mapping relationship, the current gaze position of the eye can be accurately determined, thereby realizing the function of eye tracking.

[0049] For example, the total number of coils 3 is N, and N≥3, to ensure that multi-directional changes in eye movement can be fully captured.

[0050] Data processing unit (not shown in the figure): responsible for receiving the resistance value array [R1, R2, ..., R] from each of the coils 3. N The system converts the image into the eye's gaze position based on a preset function mapping relationship.

[0051] The working principle of the eye-tracking device provided in this application embodiment is as follows:

[0052] When a user wears a smart head-mounted device, eye movements cause changes in the skin and muscles around the eyes. These changes are transmitted to the contact points 2 on the flexible frame 1, causing the coils 3 on the contact points to deform and thus changing the resistance value of the coils 3. The resistance change of each coil 3 is recorded, forming a resistance value array [R1, R2, ..., RN]. This resistance value array reflects the current eye movement state. When the data processing unit receives this resistance value array, it processes it according to a preset function mapping relationship f(R1, R2, ..., R... N The coordinates () = [X, Y, Z) are transformed to obtain the eye's fixation position [X, Y, Z].

[0053] The eye-tracking device provided in this application does not rely on the infrared light source and infrared camera module in traditional optical modules, thus avoiding stray light and ghosting problems that may be generated by optical modules.

[0054] This application utilizes a combination of multiple contacts 2 and multiple coils 3 to comprehensively capture multi-directional changes in eye movement, achieving high-precision eye tracking.

[0055] The eye-tracking device provided in this application embodiment simplifies the assembly process and avoids the complexity and cost of dustproofing because the entire device is located outside the optical module.

[0056] It should be noted that the number of contact points 2 and the number of coils 3 can be adjusted as needed to ensure the accuracy of the eye-tracking effect.

[0057] Regarding the adjustment of the number of contact points 2:

[0058] The number of contact points 2 directly affects the detail and accuracy of eye movement capture. Increasing the number of contact points 2 can provide more data points, thus reflecting the eye movement state more comprehensively, especially in complex or rapid eye movements.

[0059] However, too many contact points 2 can also increase the complexity and cost of the entire eye-tracking device, while requiring more precise calibration and data processing. Therefore, in practical applications, the number of contact points 2 can be optimized based on specific needs (such as tracking accuracy, user comfort, cost, etc.).

[0060] In a preferred embodiment of this application, four contact points 2 are provided on the flexible frame 1, see [link to application]. Figure 2 .

[0061] Regarding the adjustment of the number of coils 3:

[0062] The number of coils 3 also significantly affects the accuracy of eye tracking. The number of coils 3 on each contact point 2 is a key factor. During the deformation of the contact point 2 as the eye moves, each coil 3 generates a change in resistance. This change in resistance is continuous and accurately reflects the amplitude and speed of eye movement in that direction. By monitoring and recording these resistance changes, a multi-dimensional array of resistance values ​​[R1, R2, ..., R...] can be constructed. N Each dimension of the image corresponds to the movement of the eyeball in a certain direction.

[0063] Therefore, increasing the number of coils 3 (either by increasing the number of coils 3 on the same contact 2 or by adding contact 2 to accommodate more coils 3) can provide more dimensional information, which helps to more accurately locate the gaze position of the eyeball, thereby improving the accuracy of eye tracking.

[0064] By adjusting the number of contact points 2 and coils 3, the tracking effect of the eye-tracking device in the smart head-mounted device can be optimized, ensuring accurate and stable tracking performance in different usage scenarios.

[0065] In a preferred embodiment of this application, the flexible frame 1 is provided with four contacts 2, and each contact 2 is provided with two sets of coils 3.

[0066] In the eye-tracking device provided in this application embodiment, the data processing unit is not only responsible for receiving and converting the resistance value array, but also for using deep learning algorithms such as neural networks to optimize the data and further improve the tracking accuracy.

[0067] In summary, the novel eye-tracking device provided in this application does not rely on infrared light sources and infrared camera modules found in traditional eye-tracking technologies. Instead, it utilizes the movement of peripheral eye muscles generated during eye movements, converting this muscle movement into changes in coil resistance to achieve eye tracking. This design not only avoids stray light and ghosting problems common in optical modules, ensuring the accuracy and stability of eye tracking, but also reduces reliance on image recognition algorithms and simplifies the system structure.

[0068] Because the eye-tracking device of this application is located outside the optical module, maintaining a certain distance from the eyeball, it is more conducive to the assembly and maintenance of the device. At the same time, it eliminates the need for complex dustproofing, reducing manufacturing costs and maintenance difficulty. Finally, from a space utilization perspective, the solution of this application avoids the occupation of internal space for the smart head-mounted device by the built-in infrared light source and red camera module, providing more layout and expansion space for other functional modules.

[0069] See some examples in this application. Figure 2 and Figure 3 Each contact 2 is provided with at least two sets of coils 3, and at least one set of coils 3 forms a non-zero angle with the other set of coils 3.

[0070] In this example of the application, see Figure 2 and Figure 3At least two sets of coils 3 are designed on each contact point 2 of the flexible frame 1, and the coils 3 on the same contact point 2 form a non-zero angle. Because the different coils 3 form a non-zero angle, they can respectively capture the deformation of their respective contact points 2 in different directions. It should be noted that eye movement is a complex three-dimensional movement, including multiple directions such as horizontal, vertical, and oblique. By setting at least two sets of coils 3 on each contact point 2, and ensuring that these coils 3 are not parallel to each other, sensitivity to eye movement in all directions can be ensured, thereby more comprehensively reflecting the state of eye movement.

[0071] When the eye moves, muscle activity in different directions causes each contact point 2 to deform in different directions, and these deformations are sensed by the coils 3 in the corresponding directions. Since each set of coils 3 is particularly sensitive to deformation in a specific direction, by combining data from multiple sets of coils 3, the current position and direction of eye movement can be determined more accurately, thereby improving the accuracy of eye tracking.

[0072] See some examples in this application. Figure 3 Each of the contact points 2 is provided with two sets of mutually perpendicular coils 3.

[0073] refer to Figure 3 Each contact point 2 is equipped with at least two sets of mutually perpendicular coils 3. Eye movement is three-dimensional, including multiple directions such as horizontal and vertical. By setting up mutually perpendicular coils 3, the deformation of the contact point in the horizontal and vertical directions can be captured independently, thereby achieving precise tracking of the eye.

[0074] See some examples in this application. Figure 3 The coil 3 is an S-shaped folded coil. When the coil 3 deforms under the action of the skin and muscles along with the contact 2, its length changes, which in turn causes the resistance value of the coil to change.

[0075] See Figure 3 When contact 2 deforms with the movement of skin and muscles, the length of the S-shaped folded coil changes, resulting in a change in its resistance value. This change is highly sensitive and can accurately capture minute signals during eye movements, improving the sensitivity and accuracy of eye tracking.

[0076] The S-shaped folded coil design adapts well to the contours and curves of human skin. When contact point 2 comes into contact with the skin, the S-shaped coil deforms accordingly to the skin's uneven shape. This excellent adaptability improves the wearing comfort and user experience of the eye-tracking device.

[0077] See some examples in this application. Figure 2The contact point 2 is configured to have at least four.

[0078] In the example of this application, at least four contact points 2 are provided on the flexible frame 1. This design brings significant technical benefits, which are analyzed in detail below:

[0079] (1) Improve the comprehensiveness of tracking: Eye movements are complex three-dimensional movements, including multiple directions such as horizontal, vertical, and tilt. By setting at least four contact points, the muscle movement areas around the eye can be more comprehensively covered, thereby capturing eye movement information from more directions. This comprehensive coverage helps to more accurately track the trajectory of eye movements and gaze position.

[0080] (2) Enhanced tracking accuracy: Multiple contacts 2 can simultaneously capture muscle changes in different parts of the eye during eye movement. These changes can complement each other during data processing, thereby improving tracking accuracy. For example, when the eye makes complex movements, the coils 3 on different contacts 2 will capture different resistance changes. These changes can be combined for more accurate analysis and judgment.

[0081] In some examples of this application, the flexible frame 1 is a flexible hollow airbag that can be attached to the area around the eyes by adjusting the internal air pressure.

[0082] When the flexible frame 1 is a flexible hollow airbag, the air pressure inside the flexible hollow airbag can be adjusted to make it fit snugly and comfortably around the eyes. This adaptive capability ensures close contact between the contact point 2 and the eye muscles, improving the accuracy and stability of eye movement capture.

[0083] In addition, the softness and adjustable air pressure of the airbags make the device more comfortable to wear, reducing pressure and discomfort on the skin around the eyes and improving the user's wearing experience.

[0084] In some examples of this application, the flexible frame 1 is made of silicone.

[0085] Silicone material has good biocompatibility, is harmless to human skin, and is suitable for prolonged contact with the skin around the eyes, reducing the risk of allergies and irritation.

[0086] Silicone material has high wear resistance, aging resistance and tear resistance, and can maintain good shape and performance during long-term use, thus extending the service life of eye-tracking devices.

[0087] Silicone material has a certain degree of elasticity and softness, which can fit the contour of the eye well, ensure close contact between the contact points and the eye muscles, and improve the comfort of wearing it.

[0088] In addition, the silicone material has good stability and is not easily affected by the external environment (such as temperature and humidity), ensuring the stability and reliability of the eye-tracking device during use.

[0089] In some examples of this application, the coil 3 is disposed inside the contact 2.

[0090] When the coil 3 is located inside the contact point 2, the coil 3 can directly sense the movement of the skin and muscles when the contact point 2 contacts the skin around the eye and moves with the eyeball. This direct contact design reduces signal transmission delay and attenuation, thereby improving the sensitivity and accuracy of eye movement tracking.

[0091] Of course, if the coil 3 is positioned outside the contact point 2, during eye tracking, since the coil 3 does not directly contact the skin around the user's eyes, the thickness of the contact point 2 needs to be designed to be thinner to ensure that the coil 3 can be as close to the skin as possible. However, because the coil 3 does not directly contact the skin, it avoids damage such as corrosion caused by sweat.

[0092] In summary, placing the coil 3 inside the contact 2 is an optimized design that can improve the sensitivity and accuracy of eye tracking and optimize signal quality.

[0093] In some examples of this application, the smart head-mounted device is smart glasses, which include a frame; the flexible frame 1 is disposed on the frame and located on the side close to the eyes.

[0094] Integrating the eye-tracking device provided in this application with smart glasses allows users to achieve eye-tracking functionality without wearing additional devices. Since the eye-tracking device is placed directly in front of the user's eyes, it can capture eye movement information in real time. Simultaneously, the close fit with the smart glasses ensures stable contact between the contact points and the skin around the eyes, further improving the accuracy and stability of eye tracking.

[0095] According to another embodiment of this application, an eye-tracking method is provided, which is applied to a smart head-mounted device, and the eye-tracking method includes the following steps S1 to S3:

[0096] Step S1: While wearing the smart head-mounted device, see... Figure 1 The flexible frame 1 is attached to the area around the eyes, and each contact point 2 on the flexible frame 1 is in contact with the skin around the eyes; wherein, the contact point 2 can deform with the movement of the eyeball through the action of the skin and muscles;

[0097] Step S2: When the contact 2 deforms, the shape change of each coil 3 on it causes a change in its resistance value, thereby forming a resistance value array [R1, R2, ..., R] corresponding to eye movement. N ], where N is the total number of coils, N≥3;

[0098] Step S3: Receive the array of resistance values ​​[R1, R2, ..., R] corresponding to the deformation of each coil through the data processing unit. N ], and according to the preset function mapping relationship f(R1, R2, ..., R N = [X, Y, Z], and the received resistance value array [R1, R2, ..., R... N Convert [X, Y, Z] to eye gaze position.

[0099] The above-described step S1 involves attaching the flexible frame 1 around the eyes when wearing a smart head-mounted device (such as smart glasses). This flexible frame 1 is designed to be soft enough to ensure it comfortably conforms to the eye contours of different users.

[0100] Furthermore, each contact point 2 on the flexible frame 1 is in contact with the skin around the eyes. These contact points 2 not only fit closely to the skin, but also deform with the movement of the eyeballs through the action of the skin and muscles.

[0101] As described in step S2 above, when the contact 2 deforms, the shape of each coil 3 on it also changes (e.g., the length changes), which causes a change in its resistance value.

[0102] By measuring the resistance values ​​of all coils 3, an array of resistance values ​​[R1, R2, ..., R] corresponding to eye movements can be formed. N In this array of resistance values, N represents the total resistance of coil 3, and N is at least 4 to ensure that sufficient eye movement information can be captured.

[0103] The above step S3 is described as follows: The data processing unit is responsible for receiving the resistance value array [R1, R2, ..., R] corresponding to the deformation of each coil 3. N This data processing unit can be a component inside a smart head-mounted device, or it can be connected to an external device (such as a smartphone or computer).

[0104] The data processing unit follows a preset function mapping relationship f(R1, R2, ..., R...). NThe function maps the received resistance values ​​to [X, Y, Z]. This mapping is crucial for converting the array of resistance values ​​into the eye's gaze position. Through this mapping, the data processing unit can convert the received resistance value array into the eye's gaze position [X, Y, Z] in three-dimensional space.

[0105] In summary, the eye-tracking method provided in this application captures eye movement information through a combination of a flexible frame 1, contact points 2, and coils 3, and converts this information into the eye's gaze position through a data processing unit. This method features high sensitivity and high accuracy, and is suitable for various application scenarios requiring eye tracking, such as virtual reality, augmented reality, and human-computer interaction.

[0106] In some examples of this application, the eye-tracking method further includes the following steps S100 to S300:

[0107] Step S100: Dynamically display a preset motion point trajectory on the screen of the smart head-mounted device. The motion point trajectory is composed of different [X, Y, Z] coordinates and can cover the user's gaze range.

[0108] Step S200: During the eye-tracking motion point trajectory process, the smart head-mounted device detects the deformation of the contact point caused by the eye movement, and obtains the resistance value changes of all coils on each contact point, forming a corresponding resistance value array [R1, R2, ..., R...]. N ], where N is the total number of coils, and N≥3;

[0109] Step S300: Connect the position of each eye fixation point [X, Y, Z] with the corresponding resistance value array [R1, R2, ..., R...]. N Pair them up to construct an array of resistance values ​​[R1, R2, ..., R]. N The functional mapping relationship f(R1, R2, ..., R) between the eye fixation position [X, Y, Z] and the eye fixation position [X, Y, Z]. N = [X, Y, Z].

[0110] The eye-tracking method provided in this application embodiment further includes the steps S100 to S300 described above. These steps mainly focus on the data calibration process, that is, how to establish a functional mapping relationship between the resistance value array and the eye gaze position. The details are described below.

[0111] Regarding step S100 above: A preset motion point trajectory is dynamically displayed on the screen 4 of the smart head-mounted device. This trajectory consists of different [X, Y, Z] coordinates and is designed to cover the user's gaze range. The purpose of this step is to provide a known and controllable eye movement environment to facilitate subsequent data calibration.

[0112] Regarding step S200 above: During the eye tracking of this motion point trajectory, the smart head-mounted device detects the deformation of contact point 2 caused by eye movement. By acquiring the resistance value changes of all coils 3 on each contact point 2, a corresponding resistance value array [R1, R2, ..., R...] can be formed. N This step is the data collection process, which provides the necessary input for constructing the function mapping relationship.

[0113] Regarding step S300 above: Each eye fixation point position [X, Y, Z] is associated with the corresponding resistance value array [R1, R2, ..., R...]. N Pairing is performed. Through this process, a functional mapping relationship f(R1, R2, ..., R) between the array of resistance values ​​and the eye fixation position can be constructed. N The function mapping is [X, Y, Z]. This mapping is the core of eye-tracking methods, allowing the system to accurately infer the eye's gaze position based on an array of resistance values.

[0114] Through data calibration, a more accurate function mapping relationship can be established. This means that in practical applications, the system can more accurately infer the eye's gaze position based on the resistance value array, thereby improving the accuracy of eye tracking.

[0115] According to yet another embodiment of this application, a smart head-mounted device is provided, the smart head-mounted device including the eye-tracking device as described above.

[0116] The specific implementation methods of the eye-tracking method and smart head-mounted device in this application can refer to the various embodiments of the eye-tracking device of the smart head-mounted device described above. Therefore, they have at least all the beneficial effects brought about by the technical solutions of the above embodiments, and will not be described in detail here.

[0117] The above embodiments mainly describe the differences between the various embodiments. As long as the different optimization features between the various embodiments are not contradictory, they can be combined to form a better embodiment. For the sake of brevity, they will not be elaborated here.

[0118] While specific embodiments of this application have been described in detail by way of examples, those skilled in the art should understand that the above examples are for illustrative purposes only and are not intended to limit the scope of this application. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this application. The scope of this application is defined by the appended claims.

Claims

1. An eye-tracking device for a smart head-mounted device, characterized in that, include: A flexible frame (1) can be attached to the area around the eyes; At least one contact point (2) is disposed on the flexible frame (1) and extends toward the eyeball, and at least one coil (3) is disposed on the contact point (2). The contact point (2) is configured to be able to contact the skin around the eye and to deform with the movement of the eyeball by the action of the skin and muscles, thereby causing the coil (3) to deform, and thus causing the resistance array [R1, R2, ..., R] composed of the coils (3) to be formed. N The number of coils (3) varies, where N is the number of coils (3) and N≥3; The data processing unit is used to receive the resistance value array [R1, R2, ..., R] corresponding to the deformation of each of the coils (3). N ], and based on the preset function mapping relationship f (R1, R2, ..., R) N The received resistance value array [R1, R2, ..., R] is set to [X, Y, Z]. N Convert [X, Y, Z] to eye gaze position; Each of the contact points (2) is provided with at least two sets of coils (3), and at least one set of coils (3) forms a non-zero angle with the other set of coils (3); The coil (3) is an S-shaped folded coil. When the coil (3) deforms under the action of the skin and muscles along with the contact (2), its length changes, which in turn causes the resistance value of the coil to change. The coil (3) is disposed inside the contact (2).

2. The eye-tracking device according to claim 1, characterized in that, Each of the contact points (2) is provided with two sets of mutually perpendicular coils (3).

3. The eye-tracking device according to claim 1, characterized in that, The contact (2) is set to at least four.

4. The eye-tracking device according to claim 1, characterized in that, The flexible frame (1) is a flexible hollow airbag that can be attached to the area around the eyes by adjusting the internal air pressure.

5. The eye-tracking device according to claim 1, characterized in that, The flexible frame (1) is made of silicone.

6. The eye-tracking device according to claim 1, characterized in that, The smart head-mounted device is smart glasses, and the smart glasses include a frame; The flexible frame (1) is mounted on the eyeglass frame and located on the side close to the eyes.

7. An eye-tracking method, characterized in that, The eye-tracking method uses the eye-tracking device as described in claim 1, and the eye-tracking method includes: When wearing the smart head-mounted device, the flexible frame is attached to the area around the eyes, and each contact point on the flexible frame is in contact with the skin around the eyes; wherein, the contact points can deform with the movement of the eyeballs through the action of the skin and muscles; When the contact point deforms, the shape change of each coil on it causes a change in its resistance value, thereby forming an array of resistance values ​​[R1, R2, ..., R] corresponding to eye movements. N ], where N is the total number of coils, N≥3; The data processing unit receives the resistance value array [R1, R2, ..., R] corresponding to the deformation of each coil. N ], and based on the preset function mapping relationship f (R1, R2, ..., R) N The received resistance value array [R1, R2, ..., R] is set to [X, Y, Z]. N Convert [X, Y, Z] to eye gaze position.

8. The eye-tracking method according to claim 7, characterized in that, Also includes: The preset motion point trajectory is dynamically displayed on the screen of the smart head-mounted device. The motion point trajectory is composed of different [X, Y, Z] coordinates and can cover the user's gaze range. During eye tracking of motion points, the smart head-mounted device detects the deformation of the contact points caused by eye movements and acquires the resistance changes of all coils at each contact point, forming a corresponding resistance value array [R1, R2, ..., R...]. N ], where N is the total number of coils, and N≥3; Connect each eye fixation point position [X, Y, Z] with the corresponding resistance value array [R1, R2, ..., R...]. N Pair them up to construct an array of resistance values ​​[R1, R2, ..., R]. N Functional mapping relationship between [X, Y, Z] and eye fixation position [X, Y, Z] f (R1, R2, ..., R) N = [X, Y, Z].

9. A smart head-mounted device, characterized in that, include: The eye-tracking device as described in any one of claims 1-6.

Images