Wearable device and eye movement tracking method thereof

Abstract

The invention provides a wearable device and an eye movement tracking method thereof, the wearable device comprises a mirror frame, a waveguide sheet, an optical projector and an eye movement tracking assembly, and the waveguide sheet is installed on the mirror frame; when the wearable device is worn on a user, the waveguide sheet is arranged opposite to eyeballs of the user; the optical projector is mounted on the mirror frame; the eye movement tracking assembly comprises a light source and a camera, the light source and the camera are arranged in the middle of the optical projector or the mirror frame, at the moment, the light source and the camera are arranged in the middle of the optical projector or the mirror frame and serve as the eye movement tracking assembly, and the internal space of the optical projector or the internal space of the middle of the mirror frame is fully utilized. A camera with a large size is avoided, and meanwhile, the light source and the camera are integrated on the optical projector or the mirror frame, so that the overall size of the wearable device is small.

Description

Technical Field

[0001] The present application relates to the technical field of wearable devices, and in particular to an eye tracking method applied to a wearable device and the same. Background Art

[0002] With the development of science and technology, wearable devices are applied to people's lives. At this time, smart glasses can be a type of wearable device. Smart glasses can be AR (Augmented Reality) glasses, VR (Virtual Reality) glasses or audio glasses. In the existing technology, the wearable device is provided with a frame, an optical projector, a waveguide and a camera. The camera is external to the optical projector and is used for eye tracking. As an external component, the camera occupies a certain volume, resulting in a larger overall volume of the existing wearable device. Summary of the Invention

[0003] The purpose of the present invention is to provide a wearable device and an eye tracking method thereof to solve the problems raised in the above background technology.

[0004] To achieve the above object, the present invention provides the following technical solutions:

[0005] A wearable device, comprising:

[0006] Frames;

[0007] a waveguide plate mounted on the frame; when the wearable device is worn by a user, the waveguide plate is arranged opposite to the user's eyeball;

[0008] an optical projector mounted on the mirror frame;

[0009] The eye tracking component includes a light source and a camera, wherein the light source and the camera are arranged in the middle of the optical projector or the frame.

[0010] Optionally, the optical projector is provided with a first accommodation space, and the light source and the camera are both accommodated in the first accommodation space and integrated into the optical projector.

[0011] Optionally, the light source is disposed on one side of the camera, and the light source and the camera are arranged in a U-shape or a S-shape.

[0012] Optionally, the waveguide plate is provided with a plurality of waveguide layers, and the plurality of waveguide layers are stacked along the thickness direction of the waveguide plate; each of the waveguide layers is used to reflect light of a corresponding wavelength.

[0013] Optionally, a semi-reflective and semi-transparent structure is provided in the area of ​​the waveguide sheet opposite to the user's eyeball, and the semi-reflective and semi-transparent structure allows reflection of the light output by the light source.

[0014] Optionally, the optical projector is provided with a second accommodating space, and the light source and the camera are respectively arranged in the second accommodating space and the middle of the frame.

[0015] Optionally, the light source is located in the middle of the lens frame; the camera is located in the second accommodation space; the light source is disposed between two adjacent waveguide plates, and the light source is provided with two output ends, each output end of the light source is directed toward the two waveguide plates, and outputs light to the two waveguide plates synchronously;

[0016] Alternatively, the camera is located in the middle of the frame, and the light source is located in the second accommodation space.

[0017] Optionally, when the light source is located in the middle of the frame, there are multiple cameras, and the multiple cameras are distributed on both sides of the light source;

[0018] Alternatively, when the camera is located in the middle of the frame, there are multiple light sources, and the multiple light sources are distributed on both sides of the camera.

[0019] An eye tracking method for a wearable device, wherein the eye tracking method for a wearable device is applied to the above-mentioned wearable device; the eye tracking method for a wearable device comprises:

[0020] If the light source is in operation, the light source outputs a first light beam to the waveguide plate. The first light beam is transmitted through the waveguide plate, sequentially passes through the coupling-in region and the coupling-out region of the waveguide plate, and enters the user's eyeball. The first light beam is reflected by the user's eyeball to form a second light beam.

[0021] The second light passes through the coupling-in area and the coupling-out area of ​​the waveguide plate in sequence and is sensed by the camera to track the user's eyeball. At this time, the position of the eyeball is determined based on the image obtained by the camera, and the feature points in the image interface are adjusted according to the position of the eyeball, wherein the feature points are adjusted in real time with the real-time adjustment of the eyeball position.

[0022] Optionally, determining the position of the eyeball based on the image acquired by the camera, and adjusting feature points in the image interface according to the position of the eyeball, wherein the feature points are adjusted in real time as the position of the eyeball is adjusted, includes:

[0023] performing image processing on the image acquired by the camera and extracting the eyeball area;

[0024] Traversing the center of the eyeball area, determining the center of the eyeball area as the position of the eyeball, and introducing a coordinate system into the image interface;

[0025] The position of the eyeball is loaded into the coordinate system of the image interface, and feature points in the image interface are determined, wherein the feature points are adjusted in real time with the position of the eyeball.

[0026] Compared with the prior art, the present invention has the following beneficial effects:

[0027] The present invention provides a wearable device and an eye tracking method thereof, wherein a waveguide is mounted on a frame; when the wearable device is worn on a user, the waveguide is arranged opposite to the user's eyeballs; an optical projector is mounted on the frame; an eye tracking component comprises a light source and a camera, which are arranged in the middle of the optical projector or the frame. In this case, the light source and the camera are arranged in the middle of the optical projector or the frame. The light source and the camera serve as eye tracking components, making full use of the internal space of the optical projector or the internal space in the middle of the frame, avoiding the use of a large camera, and at the same time, the light source and the camera are integrated in the optical projector or the frame, so that the overall volume of the wearable device is small. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] To more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present application. Those skilled in the art can also derive other drawings based on these drawings without inventive effort.

[0029] In order to more completely understand the present application and its beneficial effects, the following description will be given in conjunction with the accompanying drawings. In the following description, the same reference numerals represent the same parts.

[0030] Figure 1 A schematic diagram of a wearable device is provided for an embodiment of the present application.

[0031] Figure 2 A schematic structural diagram of a wearable device is provided for an embodiment of the present application.

[0032] Figure 3 for Figure 2 Partial schematic diagram of the center A direction.

[0033] Figure 4 A schematic diagram showing a wearable device with a light source and a camera arranged in a U-shape is provided for an embodiment of the present application.

[0034] Figure 5 A schematic diagram of a single-layer waveguide layer of a wearable device is provided in an embodiment of the present application.

[0035] Figure 6 A schematic diagram is provided for an embodiment of the present application in which the light source of a wearable device is located in the middle of the frame.

[0036] Figure 7A schematic diagram is provided for an embodiment of the present application in which the camera of a wearable device is located in the middle of the frame.

[0037] Figure 8 A schematic diagram of two eye tracking components of a wearable device is provided for an embodiment of the present application.

[0038] Figure 9 A schematic diagram of a semi-reflective and semi-transparent structure of a wearable device is provided for an embodiment of the present application.

[0039] Figure 10 A schematic diagram of a grating of a wearable device is provided for an embodiment of the present application.

[0040] Figure 11 A schematic diagram illustrating a flow chart of an eye tracking method for a wearable device according to an embodiment of the present application is shown;

[0041] Figure 12 A block diagram of an eye tracking apparatus for a wearable device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0042] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0043] refer to Figures 1 to 10 The embodiment of the present application provides a wearable device 100, which is used in people's lives. In this case, the wearable device 100 can be ordinary glasses or smart glasses. Ordinary glasses are myopia glasses, sunglasses or cycling glasses; smart glasses can be AR (Augmented Reality) wearable devices 100, VR (Virtual Reality) glasses or audio glasses, wherein the wearable device 100 includes a frame 10, a waveguide 20, an optical projector 30 and an eye tracking component 40. The eye tracking component 40 is connected to the frame 10 and / or the optical projector 30, and the frame 10 accommodates the waveguide 20 and the optical projector 30.

[0044] The frame 10 serves as the main body of the wearable device 100 and is used to connect the waveguide plate 20, the optical projector 30 and the eye tracking component 40; wherein, when the wearable device 100 is a pair of smart glasses, the frame 10 includes a frame 11 and temples 12, and the temples 12 are hinged to the frame 11 and swing relative to the frame 11.

[0045] The waveguide plate 20 is installed on the frame 10. At this time, the waveguide plate 20 is installed on the frame 11 and is in the accommodation space of the frame 11. When the wearable device 100 is worn on the user, the waveguide plate 20 is arranged corresponding to the user's eyeballs, and the waveguide plate 20 faces the user's eyeballs so as to present an image when receiving the first light from the optical projector 30, and the second light reflected by the user's eyeballs is also conducted in the waveguide plate 20 to facilitate subsequent eye tracking.

[0046] The optical projector 30 is mounted on the frame 10 and outputs a first light beam toward the waveguide 20. The first light beam is guided through the waveguide 20. The optical projector 30 includes optical components that are plugged into and positioned by the frame 11. The optical components are mounted on the frame 11 and output light beams toward the waveguide 20. Optionally, the optical components are plugged into and positioned by the temples 12. The optical components are mounted on the temples 12 and output light beams toward the waveguide 20.

[0047] The eye tracking assembly 40 includes a light source 41 and a camera 42. The light source 41 and the camera 42 are disposed in the middle of the optical projector 30 or the frame 10. The light source 41 outputs a first light beam to the waveguide 20. The first light beam is then transmitted through the waveguide 20, sequentially passing through the incoupling region and outcoupling region of the waveguide 20, and enters the user's eyeball. The first light beam is then reflected by the user's eyeball to form a second light beam. The second light beam then passes through the incoupling region and outcoupling region of the waveguide 20, and is sensed by the camera 42 to track the user's eyeball. Optionally, the middle portion of the frame 10 is the middle portion of the frame 11.

[0048] Multiple first light rays pass through the waveguide 20 and illuminate different electrical points of the eyeball, and the characteristics of the eyeball are recorded so that the eyeball reflects the multiple first light rays and forms multiple second light rays. The multiple second light rays pass through the coupling-in area and the coupling-out area of ​​the waveguide 20 in sequence and are sensed by the camera 42 to track the user's eyeball. At this time, the light source 41 and the camera 42 are set in the middle of the optical projector 30 or the frame 10. The light source 41 and the camera 42 serve as the eye tracking component 40, making full use of the internal space of the optical projector 30 or the internal space in the middle of the frame 10, avoiding the use of a large camera. At the same time, the light source 41 and the camera 42 are integrated into the optical projector 30 or the frame 10, so that the overall volume of the wearable device 100 is small and eye tracking is achieved without increasing the volume of the product.

[0049] Among them, the light source 41 and the camera 42 can be selectively set in the middle of the optical projector 30 or the frame 11. When the light source 41 and the camera 42 are both set in the optical projector 30, the light source 41 and the camera 42 are built into the optical projector 30, and the space of the optical projector 30 is fully utilized, so that they are integrated into the optical projector 30, avoiding the eye tracking component 40 as an external component, so that the eye tracking component 40 can realize eye tracking without increasing the volume of the product.

[0050] refer to Figures 1 to 4 In an embodiment of the present application, the optical projector 30 is provided with a first accommodating space 30a, the light source 41 and the camera 42 are both accommodated in the first accommodating space 30a and integrated into the optical projector 30. At this time, the light source 41 and the camera 42 are both arranged in the optical projector 30 and make full use of the first accommodating space 30a of the optical projector 30.

[0051] At this time, the light source 41 is arranged on one side of the camera 42, and the light source 41 and the camera 42 are in the same space and arranged adjacent to each other, so that the light source 41 and the camera 42 are arranged in the same space, wherein the light source 41 and the camera 42 are arranged in a U-shape or a S-shape, and the internal space of the optical projector 30 is fully utilized based on the U-shape arrangement or the S-shape arrangement.

[0052] Light source 41 is an infrared laser emitter and emits a second light beam, which may be infrared light with a wavelength of 940 nm. The infrared light emitted by light source 41 is conducted through waveguide 20 and reflected by the user's eyeball. The second light beam reflected by the user's eyeball is sensed by camera 42 to track the user's eyeball. Optionally, camera 42 is an infrared light sensor.

[0053] The optical projector 30 has a second storage space 30b, with a light source 41 and a camera 42 positioned in the second storage space 30b and the middle of the frame 11, respectively. The camera 42 is located in the second storage space 30b, while the light source 41 is positioned in the middle of the frame 11. When positioned in the middle of the frame 11, the light source 41 outputs a second light beam toward the waveguide 20. This second light beam is reflected by the grating 50 toward the user's eye, forming a second light beam. This second light beam is then conducted through the waveguide 20 and sensed by the camera 42. The placement of the light source 41 in the middle of the frame 11 prevents both the light source 41 and the camera 42 from being integrated into the optical projector 30. Furthermore, the light source 41 fully utilizes the middle portion of the frame 11, reducing the size of the optical projector 30 and enabling the eye tracking component 40 to achieve eye tracking without increasing the product's bulk.

[0054] In addition, a light source 41 is disposed between two adjacent waveguide plates 20. The light source 41 has two output ends, each of which is directed toward the two waveguide plates 20 and simultaneously outputs light to the two waveguide plates 20. In this case, the light source 41 acts as a beam splitter, so that the second light beam is simultaneously transmitted to the left and right waveguide plates 20 after being split by the light source 41.

[0055] refer to Figure 6 In an embodiment of the present application, there is one light source 41 and two waveguide plates 20, and the light source 41 is located in the middle of the frame 10; the camera 42 is located in the second accommodating space 30b; the light source 41 is arranged between two adjacent waveguide plates 20, and the light source 41 is provided with two output ends, and the output ends of each light source 41 are respectively directed toward the two waveguide plates 20, and output light to the two waveguide plates 20 synchronously, so that light can be output to the two waveguide plates 20 through the same light source 41, thereby improving the utilization rate of the light source 41.

[0056] When the light source 41 is in the middle of the frame 10, there are multiple cameras 42, and the multiple cameras 42 are distributed on both sides of the light source 41. The multiple cameras 42 cooperate with the same light source 41, and the light source 41 outputs light in different directions. The light in different directions acts on the corresponding cameras 42 respectively, so as to form multiple eye tracking points, thereby integrating multiple eye tracking points.

[0057] refer to Figure 7 , the camera 42 has one, the light source 41 has one, the camera 42 is located in the middle of the frame 10, the light source 41 is located in the second accommodating space 30b, the light source 41 in the second accommodating space 30b outputs light to the waveguide sheet 20, and the light is conducted in the corresponding waveguide layer 21 in the waveguide sheet 20 so as to illuminate the user's eyeball, thereby being reflected by the eyeball. At this time, the light reflected by the eyeball is conducted to the camera 42 located in the middle of the frame 10.

[0058] In addition, when the camera 42 is in the middle of the frame 10, there are multiple light sources 41, and the multiple light sources 41 are distributed on both sides of the camera 42. The multiple light sources 41 cooperate with the same camera 42, and the multiple light sources 41 output light in different directions. The light in different directions acts on the camera 42 respectively, so as to form multiple eye tracking points, thereby integrating multiple eye tracking points.

[0059] refer to Figures 3 to 8 In addition, the waveguide plate 20 is provided with a plurality of waveguide layers 21, and the plurality of waveguide layers 21 are stacked along the thickness direction of the waveguide plate 20; each waveguide layer 21 is used to reflect light of a corresponding wavelength, so that light of different wavelengths can be filtered through different waveguide layers 21, so that the corresponding light can be conducted in the corresponding waveguide layer 21, thereby improving the light conduction efficiency of the waveguide plate 20.

[0060] refer to Figure 9 In an embodiment of the present application, the waveguide sheet 20 may also have a single waveguide layer 21. The light emitted by the light source 41 passes through the single waveguide layer 21 and is conducted in the waveguide sheet 20. At this time, the single waveguide layer 21 allows light of a single wavelength to be conducted.

[0061] A semi-reflective and semi-transparent structure 60 is provided in the area of ​​the waveguide sheet 20 relative to the user's eyeball. The semi-reflective and semi-transparent structure 60 allows the reflection of the light output by the light source 41 and allows other light to be transmitted to other waveguide layers 21. At this time, the light output by the light source 41 passes through the semi-reflective and semi-transparent structure 60 and is transmitted to the user's eyeball under the reflection of the semi-reflective and semi-transparent structure 60. As for other light, the other light is transmitted to the user's eyeball after passing through the semi-reflective and semi-transparent structure 60.

[0062] refer to Figure 10 A grating 50 is connected to the side of the waveguide sheet 20 facing the user's eyeball. The grating 50 is arranged relative to the optical projector 30 and allows the second light reflected by the user's eyeball to pass through. At this time, the second light emitted by the light source 41 passes through the grating 50, the second light is diffracted out of the waveguide and released into the user's eyeball, so that the second light is reflected by the user's eyeball and forms a second light. Optionally, the grating 50 is a blazed grating or a tilted grating. Optionally, the grating 50 is applied to the surface of the waveguide sheet 20 facing the user's eyeball by a coating.

[0063] Workflow: When the optical components are turned on, the infrared laser emitter with a wavelength of 940nm emits light that is coupled into the waveguide and enters the human eye through the outcoupling area. The reflected light from the human eye passes through the waveguide and the blazed grating 50 on the coating near the human eye and enters the infrared light sensor. The image obtained by the infrared light sensor is analyzed to obtain the eye state and realize eye tracking. Figure 5 In another embodiment of the present application, the light source 41 and the camera 42 are respectively arranged in the middle of the optical projector 30 and the frame 11, making full use of the space of the optical projector 30 and the space in the middle of the frame 11, thereby being integrated into the optical projector 30 and the frame 11, avoiding the eye tracking component 40 as an external component, so that the eye tracking component 40 can achieve eye tracking without increasing the volume of the product.

[0064] refer to Figure 11 , an eye tracking method for a wearable device 100, the eye tracking method for the wearable device 100 is applied to the wearable device 100; the eye tracking method for the wearable device 100 includes:

[0065] Step S10: When the optical projector 30 is in operation, a first light beam outputted by the optical projector 30 is obtained, the first light beam is transmitted through the waveguide 20 , and an image interface is displayed on the waveguide 20 ;

[0066] Step S20: If the light source 41 is in operation, the light source 41 outputs a second light to the waveguide 20 . The second light is transmitted through the waveguide 20 and enters the user's eyeball. The second light reflected by the user's eyeball is sensed by the camera 42 .

[0067] Step S30: determining the position of the eyeball based on the image acquired by the camera 42, and adjusting the feature points in the image interface according to the position of the eyeball, wherein the feature points are adjusted in real time with the real-time adjustment of the position of the eyeball.

[0068] At this time, the position of the eyeball is determined based on the image obtained by the camera 42, and the feature points in the image interface are adjusted according to the position of the eyeball, wherein the feature points are adjusted in real time with the position of the eyeball, so that the position adjustment of the feature points is triggered as the eyeball is adjusted, thereby realizing the position of the feature points in the image interface, and then realizing the eye tracking function.

[0069] Specifically, an eye tracking method for a wearable device 100 determines the position of an eyeball based on an image captured by a camera 42 and adjusts feature points in an image interface according to the position of the eyeball, wherein the feature points are adjusted in real time as the position of the eyeball is adjusted, including:

[0070] Performing image processing on the image acquired by the camera 42 and extracting the eyeball area;

[0071] Traversing the center of the eyeball area, determining the center of the eyeball area as the position of the eyeball, and introducing a coordinate system into the image interface;

[0072] The position of the eyeball is loaded into the coordinate system of the image interface, and feature points in the image interface are determined, wherein the feature points are adjusted in real time with the position of the eyeball.

[0073] At this time, the center of the eyeball area is traversed, and the center of the eyeball area is determined as the position of the eyeball, and a coordinate system is introduced to the image interface to facilitate the introduction of a coordinate system probability to the image interface, and feature points are selected for the eyeball area in the image interface to facilitate the formation of tracking points to be tracked based on multiple feature points, the position of the tracking point to be tracked is obtained in real time, and the eyeball is followed based on the coordinates of the tracking point to be tracked.

[0074] In addition, a coordinate system is established in the image interface, and a dynamic image of the eyeball is captured in real time, so as to introduce the concept of coordinate operation into the existing dynamic image, so as to determine the real-time position of the eyeball and ensure the accuracy of the position; the eyeball is processed and feature points are extracted, and fixed-point tracking is performed based on the position of the feature points to obtain the position adjustment of the feature points, thereby realizing the eye tracking project. In addition, the dynamic trajectory of the eyeball is captured in real time, and image analysis is performed based on the eyeball picture to determine the position of the eyeball.

[0075] Figure 12 FIG2 shows a block diagram of an eye tracking apparatus of a wearable device 100 according to an embodiment of the present application.

[0076] Reference Figure 12 As shown, an eye tracking device of a wearable device 100 according to an embodiment of the present application includes:

[0077] The image interface module 210 is used to obtain the first light output by the optical projector 30 when the optical projector 30 is in an operating state, transmit the first light through the waveguide plate 20, and display the image interface on the waveguide plate 20;

[0078] The sensing module 220 is configured to: when the light source 41 is in operation, the light source 41 outputs a second light to the waveguide 20; the second light is conducted through the waveguide 20 and enters the user's eyeball; and the second light reflected by the user's eyeball is sensed by the camera 42;

[0079] The feature point module 230 is used to determine the position of the eyeball based on the image acquired by the camera 42, and adjust the feature points in the image interface according to the position of the eyeball, wherein the feature points are adjusted in real time with the real-time adjustment of the eyeball position.

[0080] Compared with the prior art, the present invention has the following beneficial effects:

[0081] The present invention provides a wearable device 100 and an eye tracking method thereof, wherein a waveguide 20 is mounted on a frame 10; when the wearable device 100 is worn by a user, the waveguide 20 is arranged corresponding to the user's eyeball; an optical projector 30 is mounted on the frame 10 and outputs a first light toward the waveguide 20, and the first light is conducted through the waveguide 20; an eye tracking component 40 includes a light source 41 and a camera 42, the light source 41 and the camera 42 being arranged in the middle of the optical projector 30 or the frame 10, the light source 41 outputs a second light to the waveguide 20, the second light is conducted through the waveguide 20, and enters the user's eye. The light source 41 and the camera 42 are arranged in the middle of the optical projector 30 or the frame 10. The light source 41 and the camera 42 serve as the eye tracking component 40, making full use of the internal space of the optical projector 30 or the internal space of the middle of the frame 10, avoiding the use of a large camera. At the same time, the light source 41 and the camera 42 are integrated in the optical projector 30 or the frame 10, so that the overall volume of the wearable device 100 is small, and eye tracking is achieved without increasing the volume of the product.

[0082] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0083] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Therefore, features specified as "first" or "second" may explicitly or implicitly include one or more features.

[0084] This document uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for technical personnel in this field, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on this application.

Claims

1. A wearable device, characterized in that: include: Frames; A waveguide sheet is mounted on the frame; when the wearable device is worn by a user, the waveguide sheet is arranged opposite to the eyeball of the user; An optical projector, mounted on the mirror frame; The eye tracking component comprises a light source and a camera, wherein the light source and the camera are arranged in the middle of the optical projector or the frame.

2. A wearable device according to claim 1, characterized in that: The optical projector is provided with a first accommodation space, and the light source and the camera are both accommodated in the first accommodation space and integrated into the optical projector.

3. A wearable device according to claim 2, characterized in that: The light source is arranged on one side of the camera, and the light source and the camera are arranged in a U-shape or a S-shape.

4. A wearable device according to any one of claims 1 to 3, characterized in that: The waveguide sheet is provided with a plurality of waveguide layers, and the plurality of waveguide layers are stacked along the thickness direction of the waveguide sheet; each of the waveguide layers is used for reflecting light of a corresponding wavelength.

5. A wearable device according to claim 1, characterized in that: A semi-reflective and semi-transmissive structure is provided in the waveguide sheet in an area opposite to the user's eyeball, and the semi-reflective and semi-transmissive structure allows reflection of the light output by the light source.

6. A wearable device according to claim 1, characterized in that: The optical projector is provided with a second accommodating space, and the light source and the camera are respectively arranged in the second accommodating space and the middle of the lens frame.

7. A wearable device according to claim 6, characterized in that: The light source is located in the middle of the lens frame; the camera is located in the second accommodation space; the light source is disposed between two adjacent waveguide plates, and the light source is provided with two output ends, and the output ends of each light source are respectively directed toward the two waveguide plates, and output light to the two waveguide plates synchronously; Alternatively, the camera is located in the middle of the lens frame, and the light source is located in the second accommodation space.

8. A wearable device according to claim 1, characterized in that: When the light source is in the middle of the lens frame, there are multiple cameras, and the multiple cameras are distributed on both sides of the light source; Alternatively, when the camera is located in the middle of the lens frame, there are multiple light sources, and the multiple light sources are distributed on both sides of the camera.

9. An eye tracking method for a wearable device, characterized in that: The eye tracking method of the wearable device is applied to the wearable device as described in any one of claims 1 to 8; the eye tracking method of the wearable device comprises: If the light source is in working state, the light source outputs a first light to the waveguide plate, the first light is conducted through the waveguide plate, passes through the coupling-in area and the coupling-out area of ​​the waveguide plate in sequence, and enters the eyeball of the user, and the first light is reflected by the eyeball of the user to form a second light; The second light passes through the coupling-in area and the coupling-out area of ​​the waveguide plate in sequence and is sensed by the camera to track the user's eyeball. At this time, the position of the eyeball is determined based on the image acquired by the camera, and the feature points in the image interface are adjusted according to the position of the eyeball, wherein the feature points are adjusted as the position of the eyeball is adjusted in real time.

10. The eye tracking method for a wearable device according to claim 9, characterized in that: The method of determining the position of the eyeball based on the image acquired by the camera and adjusting the feature points in the image interface according to the position of the eyeball, wherein the feature points are adjusted in real time with the position of the eyeball, comprises: Performing image processing on the image acquired by the camera and extracting the eyeball area; Traverse the center of the eyeball area, determine the center of the eyeball area as the position of the eyeball, and introduce a coordinate system into the image interface; The position of the eyeball is loaded into the coordinate system of the image interface, and the feature points in the image interface are determined, wherein the feature points are adjusted as the position of the eyeball is adjusted in real time.

Images