Eyeball tracking device and tracking method of intelligent head-mounted equipment and intelligent head-mounted equipment

Abstract

The embodiment of the invention provides an eyeball tracking device and tracking method of intelligent head-mounted equipment and the intelligent head-mounted equipment. The eyeball tracking device comprises a flexible frame body, a contact and a data processing unit; the flexible frame can be attached to the periphery of the eye; the contacts are arranged on the flexible frame body and extend towards the eyeballs, coils are arranged on the contacts, the contacts can make contact with the skin around the eyes and can be driven by the skin and muscles to deform along with movement of the eyeballs, so that deformation of the coils is triggered, and then a resistance value array [R1, R2,..., RN] formed by the coils is changed, n is the number of the coils and is greater than or equal to 3; and the data processing unit is used for receiving the resistance value arrays [R1, R2,..., RN] corresponding to the deformation of each coil, and converting the received resistance value arrays [R1, R2,..., RN] into eyeball watching positions [X, Y, Z] according to a preset function mapping relation.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of eye tracking technology. More specifically, the embodiments of the present application relate to an eye tracking device and tracking method for a smart head-mounted device and a smart head-mounted device. Background Art

[0002] With the rapid development of smart wearable devices, eye tracking technology has gradually become a research hotspot in this field. Eye tracking technology can capture and analyze the user's eye movements in real time, providing users with a more natural and convenient interactive experience. Traditional eye tracking technology mostly relies on the infrared light source and infrared camera module built into the optical module, and realizes eye tracking through image recognition algorithms. Although this solution meets the needs of eye tracking to a certain extent, it also brings many problems.

[0003] First, the built-in infrared light source and infrared camera module are prone to cause stray light and ghosting in the optical module, which not only affects the accuracy and stability of eye tracking, but also increases the difficulty and complexity of subsequent image processing. Secondly, the existing eye tracking solutions have strict requirements on production assembly and sealing, which increases manufacturing costs and process difficulty. In addition, the built-in infrared light source and infrared camera module will also occupy valuable space inside the smart wearable device, limiting the layout and expansion of other functional modules. Summary of the invention

[0004] The purpose of this application is to provide an eye tracking device and tracking method for an intelligent head-mounted device and a new technical solution for the intelligent head-mounted device.

[0005] In a first aspect, the present application provides an eye tracking device for a smart head mounted device. The eye tracking device for a smart head mounted device comprises:

[0006] Flexible frame that can be attached around the eyes;

[0007] At least one contact is arranged on the flexible frame and extends in the direction of the eyeball, and at least one coil is arranged on the contact, and the contact is configured to be able to contact the skin around the eye and deform through the skin and muscles as the eyeball moves, thereby causing the coil to deform, and then making the resistance value array [R1, R2, ..., R N ] changes, wherein N is the number of the coils, and N ≥ 3;

[0008] A data processing unit is used to receive the resistance value array [R1, R2, ..., R N ], and according to the preset function mapping relationship f(R1, R2, ..., R N)=[X,Y,Z],the received resistance value array [R1、R2、……、R N ] is converted to the eye gaze position [X, Y, Z].

[0009] Optionally, at least two groups of coils are arranged on each of the contacts, and at least one group of coils forms a non-zero angle with another group of coils.

[0010] Optionally, two groups of coils perpendicular to each other are arranged on each of the contacts.

[0011] Optionally, the coil is an S-shaped folded coil, and when the contact is deformed under the influence of skin and muscle, the length of the coil changes, thereby causing the resistance value of the coil to change.

[0012] Optionally, the number of contacts is at least four.

[0013] Optionally, the flexible frame is a flexible hollow air bag that can be attached around the eyes by adjusting the internal air pressure.

[0014] Optionally, the flexible frame is made of silicone.

[0015] Optionally, the coil is arranged on the inner side of the contact.

[0016] Optionally, the smart head-mounted device is smart glasses, and the smart glasses include a frame;

[0017] The flexible frame is arranged on the frame and is located on a side close to the eyes.

[0018] In a second aspect, the present application provides an eye tracking method, which is applied to a smart head mounted device, and the eye tracking method comprises:

[0019] When the smart head-mounted device is worn, the flexible frame is attached to the periphery of the eyes, and each contact point on the flexible frame is in contact with the skin around the eyes; wherein the contact point can be deformed through the skin and muscles as the eyeball moves;

[0020] When the contact is deformed, the shape of each coil on it changes, causing its resistance value to change, thereby forming a resistance value array [R1, R2, R3..., R N ], wherein N is the total number of the coils, N≥3;

[0021] The data processing unit receives the resistance value array [R1, R2, ..., R N ], and according to the preset function mapping relationship f(R1, R2, ..., R N)=[X,Y,Z],the received resistance value array [R1、R2、……、R N ] is converted to the eye gaze position [X, Y, Z].

[0022] Optionally, the eye tracking method further includes:

[0023] Dynamically displaying a preset motion point trajectory on the screen of the smart head mounted device, where the motion point trajectory consists of different [X, Y, Z] coordinates and can cover the user's gaze range;

[0024] In the process of eyeball tracking the trajectory of the moving point, the smart head-mounted device detects the deformation of the touch point caused by the eyeball movement, and obtains the resistance value change of all coils on each of the touch points to form a corresponding resistance value array [R1, R2, ..., R N ], where N is the total number of coils, and N ≥ 3;

[0025] The position of each eyeball gaze point [X, Y, Z] is associated with the corresponding resistor value array [R1, R2, ..., R N ] to pair them and construct a resistor value array [R1, R2, ..., R N ] and the eye gaze position [X, Y, Z], the function mapping relationship f(R1, R2, ..., R N )=[X,Y,Z].

[0026] In a third aspect, the present application provides a smart head-mounted device, the smart head-mounted device comprising:

[0027] An eye tracking device as described in the first aspect.

[0028] The beneficial effects of this application are:

[0029] The embodiment of the present application provides a novel eye tracking device, which does not rely on the infrared light source and infrared camera module in the traditional eye tracking technology, but utilizes the movement of the eye peripheral muscles generated when the eye moves, and realizes the tracking of the eye movement by converting the movement of the muscle into the change of the coil resistance value. This design of the present application not only avoids the common stray light and ghosting problems in the optical module, ensures the accuracy and stability of eye tracking, but also reduces the dependence on the image recognition algorithm and simplifies the system structure.

[0030] Since the eye tracking device of the present application is located outside the optical module and maintains a certain distance from the eyeball, it is more conducive to the assembly and maintenance of the equipment. At the same time, there is no need for complex dust prevention treatment, which reduces the manufacturing cost and maintenance difficulty. Finally, from the perspective of space utilization, the solution of the present application avoids the occupation of the internal space of the smart head-mounted device by the built-in infrared light source and the red camera module, providing more layout and expansion space for other functional modules.

[0031] Other features and advantages of the present specification will become apparent from the following detailed description of exemplary embodiments of the present specification with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the specification and, together with the description, serve to explain the principles of the specification.

[0033] Figure 1 A diagram showing the use status of the eye tracking device according to an embodiment of the present application;

[0034] Figure 2 A schematic diagram of the structure of an eye tracking device according to an embodiment of the present application;

[0035] Figure 3 An enlarged schematic diagram of the contact points of the eye tracking device according to an embodiment of the present application.

[0036] Description of reference numerals:

[0037] 1. Flexible frame; 2. Contacts; 3. Coil; 4. Screen; 5. Lens. DETAILED DESCRIPTION

[0038] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that unless otherwise specifically stated, the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present application.

[0039] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present application, its application, or uses.

[0040] Techniques and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the techniques and equipment should be considered part of the specification.

[0041] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0042] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0043] The eye tracking device, tracking method and smart head-mounted device of the smart head-mounted device provided in the embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0044] According to an embodiment of the present application, an eye tracking device for a smart head mounted device is provided. Figures 1 to 3 The eye tracking device comprises a flexible frame 1, at least one contact 2 and a data processing unit (not shown in the figure); wherein the flexible frame 1 can be attached to the periphery of the eye; the at least one contact 2 is arranged on the flexible frame 1 and extends in the direction of the eye, and at least one coil 3 is arranged on the contact 2, and the contact 2 is configured to be able to contact the skin around the eye and to deform with the movement of the eye through the skin and muscles, thereby causing the deformation of the coil 3, and then making the resistance value array [R1, R2, ..., R N ] changes, wherein N is the number of the coils 3, and N≥3; the data processing unit is used to receive the resistance value array [R1, R2, ..., R N ], and according to the preset function mapping relationship f(R1, R2, ..., R N )=[X,Y,Z],the received resistance value array [R1、R2、……、R N ] is converted to the eye gaze position [X, Y, Z].

[0045] The eye tracking device of the smart head mounted device provided in the embodiment of the present application is shown in FIG. Figures 1 to 3 , the composition of the eye tracking device is as follows:

[0046] The eye tracking device includes a flexible frame 1, which serves as the basis of the entire eye tracking device and can be tightly attached to the periphery of the user's eyes to ensure that each of the contact points 2 arranged thereon can contact the eye skin.

[0047] The contact points 2 are arranged on the flexible frame 1 and extend toward the eyeball. The contact points 2 are in contact with the eye skin and can be deformed by the skin and muscles as the eyeball moves.

[0048] Furthermore, one or more coils 3 are provided on each of the contacts 2. When the eyeball moves in the eye socket, the skin and muscles around the eye will cause corresponding movements, thereby causing the contact 2 to deform. As the contact deforms, the coil 3 provided thereon will be stretched or compressed, causing its resistance value to change. On this basis, for example, a resistance measurement module can be used to monitor and record the change in the resistance value of each coil 3 in real time. Since the movement of the eyeball in different directions will cause different deformations of the contacts 2 in different directions, the change in the resistance value of each coil 3 will reflect the movement information of the eyeball in that direction. By collecting, processing and analyzing the data on these resistance value changes, a resistance value array [R1, R2, ..., R N ]. Through the pre-calibration process, a mapping relationship from resistance value change to eye gaze position can be established. In actual use, it is only necessary to convert the real-time monitored resistance value array [R1, R2, ..., R N ] is matched with this mapping relationship to accurately determine the current gaze position of the eye, thereby realizing the eye tracking function.

[0049] For example, the total number of the coils 3 is N, and N≥3, so as to ensure that the multi-directional changes of the eye movement can be fully captured.

[0050] Data processing unit (not shown): responsible for receiving the resistance value array [R1, R2, ..., R N ] and convert it into the eye gaze position according to the preset function mapping relationship.

[0051] The working principle of the eye tracking device provided in the embodiment of the present application is as follows:

[0052] When the user wears the smart head-mounted device, when the user's eyeballs move, the skin and muscles around the eyes will change, and these changes will be transmitted to the contact 2 on the flexible frame 1, causing the coil 3 on the contact to deform, resulting in a change in the resistance value of the coil 3. The resistance value change of each coil 3 will be recorded to form a resistance value array [R1, R2, ..., RN], which reflects the current movement state of the eyeball. When the data processing unit receives this resistance value array and maps it according to the preset function mapping relationship f(R1, R2, ..., R N )=[X,Y,Z] to convert and finally get the eye gaze position [X,Y,Z].

[0053] The eye tracking device provided in the embodiment of the present application does not rely on the infrared light source and infrared camera module in the traditional optical module, thus avoiding the stray light and ghosting problems that may be generated by the optical module.

[0054] In the present application, through the combination of multiple contacts 2 and multiple coils 3, it is possible to fully capture the multi-directional changes of eye movements and achieve high-precision eye tracking.

[0055] The eye tracking device provided in the embodiment of the present application is located as a whole outside the optical module, which simplifies the assembly process and avoids the complexity and cost of dust-proof treatment.

[0056] It should be noted that the number of the contacts 2 and the number of the coils 3 can be adjusted as needed to ensure the accuracy of the eye tracking effect.

[0057] Regarding the adjustment of the number of contacts 2:

[0058] The number of the contact points 2 directly affects the level of detail and accuracy of eye movement capture. Increasing the number of the contact points 2 can provide more data points, thereby more comprehensively reflecting the movement state of the eye, especially in complex or rapid eye movements.

[0059] However, too many contacts 2 may also increase the complexity and cost of the entire eye tracking device, and require more sophisticated calibration and data processing. Therefore, in practical applications, the number of contacts 2 can be optimized according to specific requirements (such as tracking accuracy, user comfort, cost, etc.).

[0060] In a preferred solution of the present application, four contacts 2 are arranged on the flexible frame 1, see Figure 2 .

[0061] Regarding the adjustment of the number of coils 3:

[0062] The number of coils 3 also has a significant impact on the accuracy of eye tracking. The number of coils 3 set on each contact 2 is a key factor. The resistance value of each coil 3 will change during the deformation of the contact 2 with the movement of the eye. This change in resistance value is continuous and can accurately reflect the movement amplitude and speed of the eye in that direction. By monitoring and recording these changes in resistance value, a multi-dimensional resistance value array [R1, R2, ..., R N ], where the change in each dimension corresponds to the movement state of the eyeball in a certain direction.

[0063] Therefore, increasing the number of coils 3 (the number of coils 3 can be increased on the same contact 2 or the contact 2 can be increased to accommodate more coils 3) can provide more dimensional information, which helps to more accurately locate the eye's gaze position, thereby improving the accuracy of eye tracking.

[0064] By adjusting the number of the contacts 2 and the coils 3, the tracking effect of the eye tracking device of the smart head-mounted device can be optimized to ensure accurate and stable tracking performance in different usage scenarios.

[0065] In a more preferred solution of the present application, four contacts 2 are arranged on the flexible frame 1 , and two groups of coils 3 are arranged on each of the contacts 2 .

[0066] In the eye tracking device provided in the embodiment of the present application, the data processing unit is not only responsible for receiving and converting the resistance value array, but can also optimize the data using deep learning algorithms such as neural networks to further improve the tracking accuracy.

[0067] In summary, the novel eye tracking device provided by the embodiment of the present application does not rely on the infrared light source and infrared camera module in the traditional eye tracking technology, but utilizes the movement of the eye peripheral muscles generated when the eye moves, and realizes the tracking of the eye movement by converting the movement of the muscle into the change of the coil resistance value. This design of the present application not only avoids the common stray light and ghosting problems in the optical module, ensures the accuracy and stability of eye tracking, but also reduces the dependence on the image recognition algorithm and simplifies the system structure.

[0068] Since the eye tracking device of the present application is located outside the optical module and maintains a certain distance from the eyeball, it is more conducive to the assembly and maintenance of the equipment. At the same time, there is no need for complex dust prevention treatment, which reduces the manufacturing cost and maintenance difficulty. Finally, from the perspective of space utilization, the solution of the present application avoids the occupation of the internal space of the smart head-mounted device by the built-in infrared light source and the red camera module, providing more layout and expansion space for other functional modules.

[0069] In some examples of this application, see Figure 2 and Figure 3 At least two groups of coils 3 are arranged on each of the contacts 2 , and at least one group of coils 3 forms a non-zero angle with another group of coils 3 .

[0070] In this example of the present application, see Figure 2 and Figure 3At least two groups of coils 3 are designed on each contact 2 of the flexible frame 1, and a non-zero angle is formed between the coils 3 on the same contact 2. Since non-zero angles are formed between different coils 3, they can respectively capture the deformation of the contact 2 in different directions. It should be noted that eye movement is a complex three-dimensional movement, including multiple directions such as horizontal, vertical and oblique. By setting at least two groups of coils 3 on each contact 2, and these coils 3 are not parallel to each other, the sensitivity to eye movement in all directions can be ensured, thereby more comprehensively reflecting the movement state of the eye.

[0071] When the eyeball moves, muscle activity in different directions will cause each contact 2 to deform in different directions, and these deformations will be sensed by the coils 3 in the corresponding directions. Since each group of coils 3 is more sensitive to deformation in a specific direction, by integrating the data of multiple groups of coils 3, the current position and movement direction of the eyeball can be more accurately determined, thereby improving the accuracy of eye tracking.

[0072] In some examples of this application, see Figure 3 Each of the contacts 2 is provided with two groups of coils 3 perpendicular to each other.

[0073] refer to Figure 3 At least two sets of mutually perpendicular coils 3 are arranged on each contact 2. The movement of the eyeball is three-dimensional, including multiple directions such as horizontal and vertical. By setting the coils 3 perpendicular to each other, the deformation of the contact in the horizontal and vertical directions can be captured independently, thereby achieving accurate tracking of the eyeball.

[0074] In some examples of this application, see Figure 3 The coil 3 is an S-shaped folded coil. When the contact 2 is deformed under the influence of the skin and muscles, the length of the coil 3 changes, thereby causing the resistance value of the coil to change.

[0075] See also Figure 3 When the contact 2 is deformed with the movement of the skin and muscles, the length of the S-shaped folded coil will change, which will cause its resistance value to change. This change is more sensitive and can accurately capture the tiny signals during eye movement, thus improving the sensitivity and accuracy of eye tracking.

[0076] The design of the S-shaped folded coil can well adapt to the contours and curves of the human skin surface. When the contact 2 contacts the skin, the S-shaped coil can deform accordingly with the concave and convex shape of the skin. This good adaptability improves the wearing comfort and user experience of the eye tracking device.

[0077] In some examples of this application, see Figure 2, the number of contacts 2 is at least four.

[0078] In the example of the present application, the number of the contacts 2 on the flexible frame 1 is at least four. This design brings about significant technical effects, which are specifically analyzed as follows:

[0079] (1) Improve the comprehensiveness of tracking: Eye movement is a complex three-dimensional movement, including horizontal, vertical, and tilted directions. By setting at least four contacts, the muscle movement area around the eye can be more comprehensively covered, thereby capturing eye movement information in more directions. This comprehensive coverage helps to track the eye movement trajectory and gaze position more accurately.

[0080] (2) Enhanced tracking accuracy: Multiple contacts 2 can simultaneously capture muscle changes in different parts of the eye during movement. These change information can complement each other during data processing, thereby improving tracking accuracy. For example, when the eye performs complex movements, the coils 3 on different contacts 2 will capture different changes in resistance values. These change data can be combined for more accurate analysis and judgment.

[0081] In some examples of the present application, the flexible frame 1 is a flexible hollow air bag that can be attached around the eyes by adjusting the internal air pressure.

[0082] When the flexible frame 1 is a flexible hollow airbag, the air pressure inside the flexible hollow airbag can be adjusted to make it tightly and comfortably adhere to the eye. This adaptive ability ensures close contact between the contact point 2 and the eye muscles, improving the accuracy and stability of eye movement capture.

[0083] In addition, the softness and adjustable air pressure characteristics of the airbag make the device more comfortable to wear, reducing the pressure and discomfort on the eye skin and improving the user's wearing experience.

[0084] In some examples of the present application, the flexible frame 1 is made of silicone.

[0085] Silicone material has good biocompatibility and is harmless to human skin. It is suitable for long-term contact with the skin around the eyes, reducing the risk of allergies and irritation.

[0086] Silicone material has high wear resistance, aging resistance and tear resistance, and can maintain good shape and performance during long-term use, extending the service life of the eye tracking device.

[0087] The silicone material has a certain degree of elasticity and softness, and can fit the eye contour well, ensuring close contact between the contact points and the eye muscles, while improving wearing comfort.

[0088] In addition, the silicone material has good stability and is not easily affected by the external environment (such as temperature, humidity, etc.), ensuring the stability and reliability of the eye tracking device during use.

[0089] In some examples of the present application, the coil 3 is disposed inside the contact 2 .

[0090] When the coil 3 is located inside the contact 2, when the contact 2 contacts the skin around the eye and moves with the eyeball, the coil 3 can directly sense the movement of the skin and muscles. This direct contact design reduces the delay and attenuation of signal transmission, thereby improving the sensitivity and accuracy of eye movement tracking.

[0091] Of course, if the coil 3 is arranged outside the contact 2, during eye tracking, since the coil 3 does not directly contact the skin around the user's eyes, the thickness of the contact 2 needs to be designed to be thinner to ensure that the coil 3 can be as close to the skin as possible. However, since the coil 3 does not directly contact the skin, it can avoid corrosion and other damage caused by sweat.

[0092] In summary, arranging the coil 3 on the inner side of the contact 2 is an optimized design solution, which can improve the sensitivity and accuracy of eye tracking and optimize the signal quality.

[0093] In some examples of the present application, the smart head-mounted device is a pair of smart glasses, which include a frame; the flexible frame 1 is disposed on the frame and is located on a side close to the eye.

[0094] The eye tracking device provided by the present application is integrated with smart glasses, so that the user can realize the eye tracking function without wearing other additional devices. Since the eye tracking device is directly set in front of the user's eyes, the movement information of the eyeball can be captured in real time. At the same time, the close fit with the smart glasses ensures the stable contact between the contact point and the eye skin, further improving the accuracy and stability of eye tracking.

[0095] According to another embodiment of the present application, an eye tracking method is provided. The eye tracking method is applied to a smart head mounted device. The eye tracking method includes the following steps S1 to S3:

[0096] Step S1: When wearing the smart head mounted device, refer to Figure 1 , so that the flexible frame 1 is attached to the periphery of the eye, and each contact point 2 on the flexible frame 1 is in contact with the skin around the eye; wherein the contact point 2 can be deformed by the skin and muscles as the eyeball moves;

[0097] Step S2: When the contact 2 is deformed, the shape of each coil 3 thereon changes, causing its resistance value to change, thereby forming a resistance value array [R1, R2, ..., R N ], wherein N is the total number of the coils, N≥3;

[0098] Step S3: receiving the resistance value array [R1, R2, ..., R N ], and according to the preset function mapping relationship f(R1, R2, ..., R N )=[X,Y,Z],the received resistance value array [R1、R2、……、R N ] is converted to the eye gaze position [X, Y, Z].

[0099] The above step S1 describes that when wearing a smart head mounted device (such as smart glasses), the flexible frame 1 is attached around the eyes. The flexible frame 1 is designed to be soft enough to ensure that it can comfortably fit the eye contours of different users.

[0100] Furthermore, each contact point 2 on the flexible frame 1 is in contact with the skin around the eye. These contact points 2 can not only fit the skin closely, but also deform with the movement of the eyeball through the skin and muscles.

[0101] The above step S2 describes that when the contact 2 is deformed, the shape of each coil 3 thereon will also change (for example, the length changes), and this change will cause the resistance value thereof to change.

[0102] By measuring the resistance values ​​of all coils 3, a resistance value array [R1, R2, ..., R N ]. In this resistor value array, N represents the total number of coils 3, and N is at least 4 to ensure that sufficient eye movement information can be captured.

[0103] The above step S3 describes that: the data processing unit is responsible for receiving the resistance value array [R1, R2, ..., R N ]. This data processing unit can be a component inside the smart head-mounted device or connected to an external device (such as a smartphone or computer).

[0104] The data processing unit is based on a preset function mapping relationship f(R1, R2, ..., R N)=[X,Y,Z]. This function mapping relationship is the key to converting the resistance value array into the eye gaze position. Through this function mapping relationship, the data processing unit can convert the received resistance value array into the eye gaze position [X,Y,Z] in three-dimensional space.

[0105] In summary, the eye tracking method provided in the embodiment of the present application captures the movement information of the eyeball through the combination of the flexible frame 1, the contact 2 and the coil 3, and converts it into the gaze position of the eyeball through the data processing unit. This method has the characteristics of high sensitivity and high accuracy, and is suitable for various application scenarios that require eye tracking, such as virtual reality, augmented reality, human-computer interaction, etc.

[0106] In some examples of the present application, the eye tracking method further includes the following steps S100 to S300:

[0107] Step S100: dynamically displaying a preset motion point trajectory on the screen of the smart head mounted device, where the motion point trajectory consists of different [X, Y, Z] coordinates and can cover the user's gaze range;

[0108] Step S200: During the eye tracking of the moving point trajectory, the smart head mounted device detects the deformation of the touch point caused by the eye movement, and obtains the resistance value change of all coils on each of the touch points to form a corresponding resistance value array [R1, R2, ..., R N ], where N is the total number of coils, and N ≥ 3;

[0109] Step S300: associate each eyeball gaze point position [X, Y, Z] with a corresponding resistor value array [R1, R2, ..., R N ] to pair them and construct a resistor value array [R1, R2, ..., R N ] and the eye gaze position [X, Y, Z], the function mapping relationship f(R1, R2, ..., R N ) = [X, Y, Z].

[0110] The eye tracking method provided in the embodiment of the present application also includes the above-mentioned steps S100 to S300, which mainly focus on the data calibration process, that is, how to establish a functional mapping relationship between the resistance value array and the eye gaze position.

[0111] Regarding the above step S100: dynamically displaying a preset motion point trajectory on the screen 4 of the smart head mounted device. This trajectory consists of different [X, Y, Z] coordinates and is designed to cover the user's gaze range. The purpose of this step is to provide a known and controllable eye movement environment for subsequent data calibration.

[0112] Regarding the above step S200: during the eye tracking of the moving point trajectory, the smart head mounted device detects the deformation of the contact 2 caused by the eye movement. By obtaining the resistance value changes of all coils 3 on each contact 2, a corresponding resistance value array [R1, R2, ..., R N ]. This step is the process of data collection, which provides the necessary input for building the function mapping relationship.

[0113] Regarding the above step S300: each eyeball gaze point position [X, Y, Z] is associated with a corresponding resistor value array [R1, R2, ..., R N ] to pair. Through this process, a functional mapping relationship f(R1, R2, ..., R N ) = [X, Y, Z]. This functional mapping relationship is the core of the eye tracking method, which allows the system to accurately infer the eye's gaze position based on the resistor value array.

[0114] Through the data calibration process, a more accurate function mapping relationship can be established. This means that in practical applications, the system can more accurately infer the eye's gaze position based on the resistor value array, thereby improving the accuracy of eye tracking.

[0115] According to another embodiment of the present application, a smart head-mounted device is provided, wherein the smart head-mounted device includes the eye tracking device as described above.

[0116] The specific implementation methods of the eye tracking method and the smart head-mounted device of the embodiments of the present application can refer to the various embodiments of the eye tracking device of the above-mentioned smart head-mounted device, and therefore at least have all the beneficial effects brought by the technical solutions of the above-mentioned embodiments, which will not be repeated here one by one.

[0117] The above embodiments focus on the differences between the various embodiments. As long as the different optimization features between the various embodiments are not contradictory, they can be combined to form a better embodiment. Considering the simplicity of the text, they will not be repeated here.

[0118] Although some specific embodiments of the present application have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are only for illustration, not for limiting the scope of the present application. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present application. The scope of the present application is defined by the appended claims.

Claims

1. An eye tracking device for a smart head mounted device, characterized in that: include: A flexible frame (1) capable of being attached around the eyes; At least one contact (2) is arranged on the flexible frame (1) and extends in the direction of the eyeball, and at least one coil (3) is arranged on the contact (2), and the contact (2) is configured to be able to contact the skin around the eye and to deform through the skin and muscles as the eyeball moves, thereby causing the coil (3) to deform, thereby making the resistance value array [R1, R2, ..., R N ] changes, wherein N is the number of the coils (3), and N≥3; A data processing unit is used to receive an array of resistance values ​​[R1, R2, ..., R N ], and according to the preset function mapping relationship f(R1, R2, ..., R N )=[X,Y,Z],the received resistance value array [R1、R2、……、R N ] is converted to the eye gaze position [X, Y, Z].

2. The eye tracking device according to claim 1, characterized in that: At least two groups of coils (3) are arranged on each contact point (2), and at least one group of coils (3) forms a non-zero angle with another group of coils (3).

3. The eye tracking device according to claim 2, characterized in that: Two groups of coils (3) perpendicular to each other are arranged on each contact point (2).

4. The eye tracking device according to claim 2 or 3, characterized in that: The coil (3) is an S-shaped folded coil. When the contact (2) is deformed under the influence of skin and muscle, the length of the coil (3) changes, thereby causing the resistance value of the coil to change.

5. The eye tracking device according to claim 4, characterized in that: The number of the contacts (2) is at least four.

6. The eye tracking device according to claim 1, characterized in that: The flexible frame (1) is a flexible hollow air bag that can be attached to the periphery of the eye by adjusting the internal air pressure.

7. The eye tracking device according to claim 1, characterized in that: The flexible frame (1) is made of silicone material.

8. The eye tracking device according to claim 1, characterized in that: The coil (3) is arranged on the inner side of the contact (2).

9. The eye tracking device according to claim 1, characterized in that: The smart head-mounted device is a pair of smart glasses, and the smart glasses include a frame; The flexible frame (1) is arranged on the frame and is located on a side close to the eyes.

10. An eye tracking method, characterized in that: The eye tracking method is applied to a smart head mounted device, and the eye tracking method comprises: When the smart head-mounted device is worn, the flexible frame is attached to the periphery of the eyes, and each contact point on the flexible frame is in contact with the skin around the eyes; wherein the contact point can be deformed through the skin and muscles as the eyeball moves; When the contact is deformed, the shape of each coil on it changes, causing its resistance value to change, thereby forming a resistance value array [R1, R2, ..., R N ], wherein N is the total number of the coils, N≥3; The data processing unit receives the resistance value array [R1, R2, ..., R N ], and according to the preset function mapping relationship f(R1, R2, ..., R N )=[X,Y,Z],the received resistance value array [R1、R2、……、R N ] is converted to the eye gaze position [X, Y, Z].

11. The eye tracking method according to claim 10, characterized in that: Also includes: Dynamically displaying a preset motion point trajectory on the screen of the smart head mounted device, where the motion point trajectory consists of different [X, Y, Z] coordinates and can cover the user's gaze range; In the process of eyeball tracking the trajectory of the moving point, the smart head-mounted device detects the deformation of the touch point caused by the eyeball movement, and obtains the resistance value change of all coils on each of the touch points to form a corresponding resistance value array [R1, R2, ..., R N ], where N is the total number of coils, and N ≥ 3; The position of each eyeball gaze point [X, Y, Z] is associated with the corresponding resistor value array [R1, R2, ..., R N ] to pair them and construct a resistor value array [R1, R2, ..., R N ] and the eye gaze position [X, Y, Z], the function mapping relationship f(R1, R2, ..., R N ) = [X, Y, Z].

12. A smart head mounted device, characterized in that: include: An eye tracking device as claimed in any one of claims 1 to 9.

Images