Control method and device, eye movement system and smart glasses

Abstract

The embodiment of the present application discloses a control method, device, eye movement system and smart glasses. The embodiment of the present application will shoot an infrared light beam to the eye through the lens by the optical sensing assembly, and receive the infrared light beam reflected by the eye through the lens. At the same time, when determining the eye movement data, the embodiment of the present application will first acquire the lens parameters of the smart glasses, and determine the compensation adjustment value according to the lens parameters of the smart glasses, at least adjust the grating parameters according to the compensation adjustment value to compensate the lens diopter, and then control the optical sensing assembly to collect the infrared light data carrying the eye information, and determine the eye movement data according to the infrared light data. Therefore, the embodiment of the present application can ensure that the eye movement system is not interfered by the lens of the smart glasses, thereby improving the stability and application range of the eye movement system.

Description

Technical Field

[0001] This invention relates to the field of smart glasses technology, specifically to a control method, device, eye-tracking system, and smart glasses. Background Technology

[0002] Currently, smart glasses are widely considered the next-generation general-purpose computing platform after personal computers and smartphones, and are beginning to attract increasing attention. Smart glasses typically incorporate eye-tracking systems. These systems can capture, record, and analyze the user's eye movements and gaze points in real time. Smart glasses can then provide services based on the eye-tracking data output by these systems, such as contactless control, attention detection, and regional dynamic rendering. However, existing eye-tracking systems are often limited by the lenses of the smart glasses, making them only suitable for those with thinner lenses. For smart glasses with thicker lenses, existing eye-tracking systems suffer from lens obstruction of the light path, which can cause the system to malfunction or experience significant interference. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a control method, device, eye-tracking system, and smart glasses to ensure that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system.

[0004] In a first aspect, embodiments of the present invention aim to provide an eye-tracking system suitable for smart glasses, the eye-tracking system comprising: At least one optical sensing component includes an optical waveguide, at least one optical emitting module, and an optical receiving module. The optical waveguide is stacked on the outer surface of the lens of the smart glasses. The optical waveguide is used to transmit an infrared beam. The optical emitting module includes an infrared light source, an emission coupling grating, and an emission coupling grating. The infrared light source emits an infrared beam. The emission coupling grating couples the infrared beam emitted by the infrared light source into the optical waveguide. The emission coupling grating couples the infrared beam out of the optical waveguide and through the lens to the eye. The optical receiving module includes an infrared receiver, a receiving coupling grating, and a receiving coupling grating. The receiving coupling grating couples the infrared beam reflected from the eye and through the lens into the optical waveguide. The receiving coupling grating couples the infrared beam out of the optical waveguide and towards the infrared receiver. The infrared receiver receives the infrared beam. The control device is configured to perform the following steps: Obtain the lens parameters of the smart glasses; The compensation adjustment value corresponding to the emission coupling grating and the reception coupling grating is determined according to the lens parameters, wherein the compensation adjustment value is used to indicate the adjustment of the grating parameters of the emission coupling grating and the reception coupling grating to perform lens diopter compensation; The grating parameters should be adjusted at least according to the compensation adjustment value; Control the optical sensing component to collect infrared light data carrying eye information; Eye movement data is determined based on the infrared light data.

[0005] Secondly, embodiments of the present invention aim to provide a control method, the method comprising: Obtain the lens parameters of the smart glasses; Based on the lens parameters, compensation adjustment values ​​corresponding to the emission coupling grating and the reception coupling grating in the optical sensing component are determined. These compensation adjustment values ​​are used for lens refractive power compensation. The optical sensing component includes an optical waveguide, at least one light emitting module, and a light receiving module. The optical waveguide is stacked on the outer surface of the lens of the smart glasses and is used to transmit an infrared beam. The light emitting module includes an infrared light source, an emission coupling grating, and an emission coupling grating. The infrared light source emits an infrared beam, and the emission coupling grating... A grating is used to couple the infrared beam emitted by the infrared light source into the optical waveguide sheet. The emission coupling grating is used to couple the infrared beam out of the optical waveguide sheet and through the lens to the eye. The light receiving module includes an infrared receiver, a receiving coupling grating, and a receiving coupling grating. The receiving coupling grating is used to couple the infrared beam reflected by the eye and through the lens into the optical waveguide sheet. The receiving coupling grating is used to couple the infrared beam out of the optical waveguide sheet and to the infrared receiver. The infrared receiver is used to receive the infrared beam. The grating parameters should be adjusted at least according to the compensation adjustment value; Control the optical sensing component to collect infrared light data carrying eye information; Eye movement data is determined based on the infrared light data.

[0006] Thirdly, embodiments of the present invention aim to provide a control device, the device comprising: The acquisition unit is used to acquire the lens parameters of the smart glasses; A compensation unit is used to determine compensation adjustment values ​​corresponding to the emission coupling grating and the reception coupling grating in the optical sensing component based on the lens parameters. The compensation adjustment values ​​are used for lens refractive power compensation. The optical sensing component includes an optical waveguide, at least one light emitting module, and a light receiving module. The optical waveguide is stacked on the outer surface of the lens of the smart glasses and is used to transmit an infrared beam. The light emitting module includes an infrared light source, an emission coupling grating, and an emission coupling grating. The infrared light source is used to emit an infrared beam. An input grating is used to couple the infrared beam emitted by the infrared light source into the optical waveguide sheet, and an output grating is used to couple the infrared beam out from the optical waveguide sheet and through the lens to the eye. The light receiving module includes an infrared receiver, an input receiving grating, and an output receiving grating. The input receiving grating is used to couple the infrared beam reflected by the eye and through the lens into the optical waveguide sheet, and the output receiving grating is used to couple the infrared beam out from the optical waveguide sheet and to the infrared receiver. The infrared receiver is used to receive the infrared beam. An adjustment unit is used to adjust the grating parameters at least according to the compensation adjustment value; The acquisition unit is used to control the optical sensing component to acquire infrared light data carrying eye information; A determining unit is used to determine eye-tracking data based on the infrared light data.

[0007] Fourthly, embodiments of the present invention aim to provide a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implement the method described in the second aspect.

[0008] Fifthly, embodiments of the present invention aim to provide a computer program product that, when run on a computer, causes the computer to perform the method described in the second aspect.

[0009] Sixthly, embodiments of the present invention aim to provide smart glasses, the smart glasses comprising: The main body of the eyeglasses, including the lenses; The eye-tracking system as described in the first aspect.

[0010] This invention utilizes an optical sensing component to project an infrared beam through a lens onto the eye and to receive the infrared beam reflected from the eye through the lens. Simultaneously, when determining eye-tracking data, this invention first acquires the lens parameters of the smart glasses and determines a compensation adjustment value based on these parameters. At least based on the compensation adjustment value, the grating parameters are adjusted to compensate for lens refractive power. Then, the optical sensing component is controlled to collect infrared light data carrying eye information, and eye-tracking data is determined based on this infrared light data. Therefore, this invention ensures that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system. Attached Figure Description

[0011] The above and other objects, features and advantages of the present invention will become clearer from the following description of embodiments of the invention with reference to the accompanying drawings, in which: Figure 1 This is a schematic diagram of an existing eye-tracking system; Figure 2 This is a schematic diagram of an existing eye-tracking system; Figure 3 This is a schematic diagram of the eye-tracking system according to an embodiment of the present invention; Figure 4 This is a schematic diagram illustrating the arrangement of the optical sensing component according to an embodiment of the present invention; Figure 5 This is a flowchart of the control method according to an embodiment of the present invention; Figure 6 This is a flowchart of the grating parameter adjustment method according to an embodiment of the present invention; Figure 7 This is a schematic diagram of the operation of the optical emitting module according to an embodiment of the present invention; Figure 8 This is a schematic diagram of the operation of the optical receiving module according to an embodiment of the present invention; Figure 9 This is a schematic diagram of the control device according to an embodiment of the present invention; Figure 10 This is a schematic diagram of the control device according to an embodiment of the present invention; Figure 11 This is a schematic diagram of smart glasses according to an embodiment of the present invention. Detailed Implementation

[0012] The present application is described below based on embodiments, but it is not limited to these embodiments. In the detailed description of the present application below, certain specific details are described in detail. Those skilled in the art can fully understand the present application without these details. To avoid obscuring the substance of the present application, well-known methods, processes, flows, elements, and circuits are not described in detail.

[0013] Furthermore, those skilled in the art should understand that the accompanying drawings provided herein are for illustrative purposes only and are not necessarily drawn to scale.

[0014] Unless the context explicitly requires it, words such as "including" or "contains" throughout the application should be interpreted as including rather than exclusive or exhaustive; that is, meaning "including but not limited to".

[0015] In the description of this application, it should be understood that the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Furthermore, in the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0016] The solutions described in this specification and embodiments, if involving the processing of personal information, will be processed only on the premise of having a legal basis (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be processed within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0017] Figure 1 This is a schematic diagram of an existing eye-tracking system. (Example) Figure 1 As shown, a prior art eye-tracking system includes an infrared light source 11 and an infrared receiver 12. The infrared light source 11 and infrared receiver 12 can be respectively disposed on the frame 14 on both sides of the lens 13. The infrared light source 11 can be used to direct an infrared beam towards the eye 15. After being illuminated by the infrared beam, the eye 15 reflects the infrared beam. The infrared receiver 12 can be used to receive the infrared beam reflected by the eye 15. Furthermore, the prior art can perform data analysis on the infrared beam to determine the eye movement data of the eye 15.

[0018] However, existing eye-tracking systems are typically limited by the lenses of smart glasses, making them only suitable for smart glasses with thinner lenses. For smart glasses with thicker lenses, existing eye-tracking systems suffer from lens obstruction of the light path, which can cause the eye-tracking system to malfunction or experience significant interference.

[0019] Figure 2 This is a schematic diagram of an existing eye-tracking system. (Example) Figure 2As shown, for smart glasses with thicker lenses 24, the optical paths between the infrared light source 21 and the eye 23, and between the eye 23 and the infrared receiver 22, are both blocked by the lenses 24. This prevents the infrared light source 21 from projecting an infrared beam onto the eye 36, and the infrared receiver 22 from receiving the infrared beam reflected from the eye 36. Consequently, the eye-tracking system cannot effectively measure eye-tracking data, or can only measure eye-tracking data with significant errors. It should be understood that... Figure 1 and Figure 2 The arrows shown are used to represent the infrared transmission optical paths between different objects.

[0020] To address this, embodiments of the present invention provide a control method, device, eye-tracking system, and smart glasses to ensure that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system.

[0021] Figure 3 This is a schematic diagram of an eye-tracking system according to an embodiment of the present invention. Figure 3 As shown, the eye-tracking system includes at least one optical sensing component and a control device (not shown in the figure). It should be understood that when the eye-tracking system includes multiple optical sensing components (e.g., two optical sensing components), the multiple optical sensing components are respectively disposed on different lenses of the smart glasses to achieve infrared light data acquisition for different eyes of the user.

[0022] Specifically, the optical sensing component is used to direct an infrared beam toward the eye 36 through the lens 34, and to receive the infrared beam reflected by the eye 36 through the lens 34. The optical sensing component includes an optical waveguide 31, at least one light emitting module, and a light receiving module.

[0023] The optical waveguide 31 is a planar optical wave transmission structure. The optical waveguide 31 is stacked on the outer surface of the lens 34 of the smart glasses (i.e., the side away from the eye 36). The optical waveguide 31 is used to transmit infrared beams, specifically between each emitter coupling grating 322 and its corresponding emitter coupling grating 323, and between the receiver coupling grating 332 and the receiver coupling grating 333. It should be understood that... Figure 3 The arrows shown are used to represent the infrared transmission optical paths between different objects.

[0024] A light-emitting module is disposed on the optical waveguide 31. The light-emitting module is used to direct an infrared beam of light toward the eye 36 through the lens 34. The light-emitting module includes an infrared light source 321, an emission coupling grating 322, and an emission coupling grating 323. The infrared light source 321 emits an infrared beam. The emission coupling grating 322 couples the infrared beam emitted by the infrared light source 321 into the optical waveguide 31. The emission coupling grating 323 couples the infrared beam out of the optical waveguide 31 and through the lens 34 toward the eye 36.

[0025] An optical receiving module is disposed on the optical waveguide 31. The optical receiving module is used to receive the infrared beam reflected from the eye 36 through the lens 34. The optical receiving module includes an infrared receiver 331, a receiving coupling grating 332, and a receiving coupling grating 333. The receiving coupling grating 332 couples the infrared beam reflected from the eye 36 and transmitted through the lens 34 into the optical waveguide 31. The receiving coupling grating 333 couples the infrared beam out of the optical waveguide 31 and directs it towards the infrared receiver 331. The infrared receiver 331 receives the infrared beam.

[0026] The control device is a hardware device used to store and execute corresponding programs. It controls the optical sensing components to acquire infrared light data carrying eye information and determines eye movement data based on the infrared light data acquired by the optical sensing components.

[0027] Optionally, the control device can be located at a corresponding position on the smart glasses, and this application does not impose any limitations on this. The control device may include at least a processor and a memory. The processor and memory are connected via a bus. The memory is suitable for storing instructions or programs executable by the processor. The processor may be a standalone microprocessor, or a collection of one or more microprocessors. Thus, the processor can execute the instructions stored in the memory to perform corresponding method flows to process data and control other devices.

[0028] exist Figure 3 In the illustrated eye-tracking system, the control device acquires the lens parameters of the smart glasses. After acquiring these parameters, the control device determines compensation adjustment values ​​corresponding to the emitter-coupled-out (FCA) and receiver-coupled-in (RCI) gratings, and adjusts the grating parameters based on these values. Furthermore, the control device controls the optical sensing components to collect infrared light data carrying eye information and determines eye-tracking data based on this data. The compensation adjustment values ​​are used to instruct adjustments to the grating parameters of the FCA and RCI gratings to compensate for lens refractive power.

[0029] Therefore, by having the eye-tracking system project an infrared beam onto the eye through the lens and receive the infrared beam reflected from the eye through the lens, and by having the eye-tracking system determine a compensation adjustment value based on the lens parameters of the smart glasses when determining eye-tracking data, and adjust the grating parameters based on the compensation adjustment value to perform lens refractive power compensation, the embodiments of the present invention can ensure that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system.

[0030] Figure 4 This is a schematic diagram illustrating the arrangement of the optical sensing component according to an embodiment of the present invention. Figure 4 As shown, the optical sensing component includes an optical waveguide 41, multiple optical emitting modules, and an optical receiving module.

[0031] Specifically, the optical waveguide 41 is a planar optical wave transmission structure. The optical waveguide 41 is stacked on the outer surface of the lens 42 of the smart glasses (i.e., the side away from the eyes). The optical waveguide 41 is used to transmit infrared beams, specifically between each emitter coupling grating 431 and its corresponding emitter coupling grating 432, and between the receiver coupling grating 441 and the receiver coupling grating 442. It should be understood that... Figure 4 The arrows shown are used to represent the infrared transmission optical paths between different objects.

[0032] Optionally, as one implementation, the optical waveguide 41 may include a core layer and upper and lower cladding layers covering the core layer. The core layer may be formed of a high-refractive-index material, while the upper and lower cladding layers may be formed of a low-refractive-index material. Thus, the optical waveguide 41 can utilize the refractive index characteristics of the core layer and the upper and lower cladding layers to achieve total internal reflection for light wave propagation. It should be noted that in this implementation, the core layer may be disposed over the entire area of ​​the optical waveguide 41, or it may be disposed in a specific area of ​​the optical waveguide 41, i.e., the area where light waves need to be propagated. For example, the connection area between each emitter coupling grating 431 and its corresponding emitter coupling grating 432, and the connection area between the receiver coupling grating 441 and the receiver coupling grating 442, etc., are not limited in this application.

[0033] Optionally, as one arrangement, the waveguide 41 can be attached to the outer surface of the lens 42. Alternatively, as another arrangement, the waveguide 41 can be inserted into the outer surface of the lens 42 as a insert. It should be understood that, in order to enable the waveguide 41 to be inserted into the outer surface of the lens 42 as a insert, the frame of the smart glasses can be configured to include a double-layer lens ring. Furthermore, in some embodiments, the waveguide 41 can also be stacked on the outer surface of the lens 42 of the smart glasses in other ways, and this application does not limit this.

[0034] It should be understood that Figure 4 The shapes of the waveguides and lenses shown are for illustrative purposes only. In actual applications, the shapes of the waveguides and lenses are not limited to these shapes. Figure 4 The shapes shown are not limited to those described above. For example, the shapes of optical waveguide sheets and lenses can also be circular, square, or other types of irregular shapes, and this application does not impose any restrictions on them.

[0035] A light emitting module is disposed on the optical waveguide 41. The light emitting module is used to direct an infrared beam towards the eye through the lens 42. The light emitting module includes an infrared light source (stacked on the side of the emission coupling grating 431 not attached to the optical waveguide 41, not shown in the figure), an emission coupling grating 431, and an emission output grating 432. The infrared light source emits an infrared beam. The emission coupling grating 431 couples the infrared beam emitted by the infrared light source into the optical waveguide 41. The emission output grating 432 couples the infrared beam out of the optical waveguide 41 and through the lens 42 towards the eye.

[0036] An optical receiving module is disposed on the optical waveguide 41. The optical receiving module is used to receive the infrared beam reflected from the eye through the lens 42. The optical receiving module includes an infrared receiver (stacked on the side of the receiving coupling grating 442 not attached to the optical waveguide 41, not shown in the figure), a receiving coupling grating 441, and a receiving coupling grating 442. The receiving coupling grating 441 couples the infrared beam reflected from the eye and transmitted through the lens 42 into the optical waveguide 41. The receiving coupling grating 442 couples the infrared beam out of the optical waveguide 41 and directs it to the infrared receiver. The infrared receiver receives the infrared beam.

[0037] Optionally, as an implementation method, to allow the grating parameters of each grating to be adjusted to exhibit different optical characteristics, the emission-coupled grating, emission-coupled grating, receiver-coupled grating, and receiver-coupled grating can be set as controllable gratings of corresponding types. Schematic, the emission-coupled grating, emission-coupled grating, receiver-coupled grating, and receiver-coupled grating can be set as liquid crystal gratings. Liquid crystal gratings are optical elements that utilize the optical anisotropy (birefringence) properties of liquid crystal materials to form a periodic spatial structure through specific molecular arrangements, thereby enabling diffraction, deflection, or beam splitting of incident light.

[0038] Optionally, as a forming method, the gratings in the light emitting module and the light receiving module can be formed on the corresponding surfaces of the optical waveguide sheet by exposure. It should be understood that the light emitting module (i.e., the infrared light source, the emission coupling grating 431, and the emission coupling grating 432) and the light receiving module (i.e., the infrared receiver, the reception coupling grating 441, and the reception coupling grating 442) can be disposed on the inner surface of the optical waveguide sheet 41 facing the eye, or on the outer surface of the optical waveguide sheet 41 away from the eye; this application does not impose any limitation on this.

[0039] Furthermore, the optical waveguide is divided into a central region 411 and an edge region 412. Figure 4 (The two areas are distinguished by dashed lines). The central area 411 is the region where the waveguide 41 matches the eye box. The edge area 412 refers to all areas other than the central area 411. As a configuration, to ensure the optical sensing components can acquire accurate infrared light data and to avoid the optical sensing components interfering with the user's normal use of the smart glasses, the infrared light source, the emission coupling grating 431, the infrared receiver, and the reception coupling grating 442 are located in the edge area 412 of the waveguide 41. The reception coupling grating 441 and the emission coupling grating 432 are located in the central area 411 of the waveguide 41. It should be noted that in this embodiment of the invention, the eye box refers to the area where the eye can see a clear and complete image. The region where the waveguide 41 matches the eye box can specifically be understood as the area on the waveguide 41 where the user's eye can see a clear and complete image.

[0040] Furthermore, compared to the light emitting module, the light receiving module is more prone to distortion problems, leading to inaccurate infrared light data. Meanwhile, compared to the light receiving module, the light emitting module can adjust the incident direction of the infrared beam by adjusting the off-axis angle of the emission coupling grating. This makes the illumination effect of the light emitting module less restricted by its layout, allowing for greater layout freedom. Therefore, to avoid distortion in the light receiving module that could cause inaccurate infrared light data acquired by the optical sensing components, the receiving coupling grating 441 can be positioned at the center of the central area, and each emission coupling grating 432 can be arranged around the receiving coupling grating 441.

[0041] Furthermore, to avoid the optical path between the infrared light source and the emitter coupling grating and the optical path between the infrared receiver and the receiver coupling grating being affected by the lens, the infrared light source, emitter coupling grating, infrared receiver and receiver coupling grating can be set in the area where the optical waveguide does not overlap with the lens.

[0042] Furthermore, to avoid the infrared light source, emitter-coupled grating 431, infrared receiver, and receiver-coupled grating affecting the user's normal use of the smart glasses, the infrared light source, emitter-coupled grating 431, infrared receiver, and receiver-coupled grating 442 can be configured to be hidden within the frame of the smart glasses. It should be understood that this application does not limit the specific implementation method of hiding the infrared light source, emitter-coupled grating 431, infrared receiver, and receiver-coupled grating 442 within the frame of the smart glasses. Illustratively, as one implementation, the frame can have reserved space so that when the optical sensing components are placed in the smart glasses, the infrared light source, emitter-coupled grating 431, infrared receiver, and receiver-coupled grating 442 can be located within this space, thereby achieving the hiding of the aforementioned components. It should also be noted that, in this embodiment of the invention, although the emitter grating 432 and the receiver grating 441 are disposed in the visible area, the visibility of the liquid crystal grating is relatively low due to its optical characteristics such as high transmittance and wavelength selectivity, and it will not have much impact on the appearance of the smart glasses.

[0043] Figure 5 This is a flowchart of a control method according to an embodiment of the present invention. It is intended to be noted that... Figure 5 The execution entity of the control method shown is specifically the control device in the above embodiments. By executing... Figure 5 The control method shown allows the control device to control the optical sensing component to collect infrared light data carrying eye information, and to determine eye-tracking data based on the infrared light data collected by the optical sensing component. This ensures that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system. Figure 5 As shown, the control method may specifically include the following steps: Step S100: Obtain the lens parameters of the smart glasses.

[0044] Specifically, the control device acquires the lens parameters of the smart glasses.

[0045] It should be noted that, in step S100, the lens parameters acquired by the control device may include parameters related to the lens's refractive power. Schematic, the lens parameters acquired by the control device include spherical power, cylindrical power, and astigmatic axis. The spherical power characterizes the lens's ability to focus light. The cylindrical power characterizes the degree of astigmatism correction by the lens. The astigmatic axis characterizes the direction of astigmatism correction by the lens.

[0046] Alternatively, as one implementation, the lens parameters of the smart glasses are obtained by the control device through communication with a remote server. Or, as another implementation, the lens parameters of the smart glasses are obtained by the control device through communication with the user terminal (e.g., a mobile phone, tablet, or smartwatch) held by the person currently wearing the glasses.

[0047] Step S200: Determine the compensation adjustment values ​​corresponding to the emission coupling grating and the reception coupling grating in the optical sensing component based on the lens parameters.

[0048] Specifically, after acquiring the lens parameters of the smart glasses, the control device determines the compensation adjustment values ​​corresponding to the emission coupling grating and the receiver coupling grating in the optical sensing component based on the lens parameters. These compensation adjustment values ​​are used to instruct adjustments to the grating parameters of the emission coupling grating and the receiver coupling grating to compensate for the lens refractive power.

[0049] It is important to note that diopter is typically used to describe the macroscopic refractive power of a grating. In this embodiment of the invention, each adjustment value involved (including the compensation adjustment value here and the subsequent first, second, and third adjustment values) can be represented as an adjustment value for the diopter of the grating. Illustratively, in step S200, when the lens parameters are spherical power +3D, cylindrical power +1.25D, and astigmatic axis 175 degrees, to compensate for the diopter of the lens, the compensation adjustment values ​​corresponding to the emission-coupled grating and the receiving-coupled grating can be set to spherical power -3D, cylindrical power -1.25D, and astigmatic axis 175 degrees.

[0050] Step S300: Adjust the grating parameters at least according to the compensation adjustment value.

[0051] Specifically, after determining the compensation adjustment values ​​corresponding to the emitter-coupled grating and receiver-coupled grating in the optical sensing component, the control device will adjust the grating parameters of the emitter-coupled grating and receiver-coupled grating at least according to the compensation adjustment values.

[0052] Optionally, in addition to adjusting the grating parameters of the emitter grating and receiver grating according to the compensation adjustment value to compensate for the lens diopter, the control device can also determine an independent adjustment value for each grating and adjust the grating parameters of each grating according to each independent adjustment value, thereby improving the accuracy of the optical sensing component in acquiring infrared light data.

[0053] Figure 6 This is a flowchart illustrating a grating parameter adjustment method according to an embodiment of the present invention. It is intended to illustrate that by executing... Figure 6The grating parameter adjustment shown in the diagram allows the control device to determine an independent adjustment value for each grating, and then adjust the grating parameters of each grating according to these independent adjustment values, thereby improving the accuracy of the optical sensing component in acquiring infrared light data. For example... Figure 6 As shown, the adjustment of the grating parameters may specifically include the following steps: Step S310: Determine the first adjustment value corresponding to the emission coupling grating.

[0054] Specifically, the emitter coupling grating is used to couple the infrared beam emitted by the infrared light source into the optical waveguide. For the emitter coupling grating, it needs to ensure, as far as possible, that the infrared beam emitted by the infrared light source (including the astigmatic portion) is completely coupled into the optical waveguide. Simultaneously, the emitter coupling grating also needs to ensure that the infrared beam coupled into the optical waveguide can be controllably transmitted within the optical waveguide before being transmitted to the emitter output grating. In this step, the control device determines a first adjustment value corresponding to the emitter coupling grating. This first adjustment value is used to instruct the adjustment of the grating parameters of the emitter coupling grating so that the emitter coupling grating collimates and couples the infrared beam emitted by the infrared light source into the optical waveguide.

[0055] Step S320: Determine the second adjustment value corresponding to the emission coupling grating.

[0056] Specifically, the emission coupling grating is used to couple an infrared beam from the optical waveguide and direct it through the lens towards the eye. For the emission coupling grating, it needs to ensure that the infrared beam coupled from the optical waveguide can illuminate as much of the eye area as possible. In this step, the control device determines a second adjustment value corresponding to the emission coupling grating. This second adjustment value instructs the adjustment of the grating parameters of the emission coupling grating so that it can diverge and couple the infrared beam from the optical waveguide and direct it through the lens towards the eye. It should be understood that the specific value of the divergence angle included in the second adjustment value can be determined based on the actual conditions of the emission coupling grating (e.g., the location of the emission coupling grating, the area of ​​the emission coupling grating, the wavelength distribution of the infrared beam provided by the infrared light source, and the total internal reflection angle of the waveguide, etc.), and this application does not impose any limitations on this.

[0057] Optionally, to improve the illumination effect of the emission-coupled grating, the second adjustment value also includes the off-axis angle of the emission-coupled grating. This allows the emission-coupled grating to diffract the infrared beam from the waveguide in an inclined manner after adjustment according to the second adjustment value, and then project it through the lens towards the eye, thereby further increasing the area of ​​the eye region illuminated by the infrared beam from the coupled waveguide. It should be understood that the specific value of this off-axis angle is determined based on the actual conditions of the emission-coupled grating (e.g., the position of the emission-coupled grating, the area of ​​the emission-coupled grating, the wavelength distribution of the infrared beam provided by the infrared light source, and the total internal reflection angle of the waveguide, etc.), and this application does not impose any limitations on this.

[0058] Therefore, by using an emission coupling grating to collimate and couple the infrared beam emitted by the infrared light source into the optical waveguide, and by using an emission output grating to diverge and couple the infrared beam out of the optical waveguide in an inclined state, the embodiments of the present invention can improve the illumination effect of the light emission module for the eyes.

[0059] Figure 7 This is a schematic diagram of the operation of the light emitting module according to an embodiment of the present invention. It is intended to illustrate that the lens refractive power can be compensated by adjusting the grating parameters of the emission coupling grating and the reception coupling grating using compensation adjustment values. For ease of understanding, Figure 7 The diagram shown is a schematic of the operation of the light emission module after ignoring the effect of lens refractive power. Figure 7 The content shown is for illustrative purposes only and does not represent the actual transmission process of the light beam in a real-world application. Figure 7 As shown, for the infrared beam emitted by the infrared light source 71, the emission coupling grating 72 collimates and couples the infrared beam into the optical waveguide 73. After being coupled into the optical waveguide 73, the infrared beam undergoes multiple total internal reflections within the optical waveguide 73, thereby being transmitted by the optical waveguide 73 to the emission coupling grating 74. The emission coupling grating 74 diverges the infrared beam transmitted in the optical waveguide 73 out of the optical waveguide 73 in an oblique state. Furthermore, the infrared beam coupled out by the emission coupling grating 74 passes through the lens and illuminates the eye 75.

[0060] Step S330: Determine the third adjustment value corresponding to the receiving input grating and the receiving output grating.

[0061] Specifically, a receiving-coupled grating is used to couple the infrared beam reflected from the eye and transmitted through the lens into the optical waveguide, and a receiving-exit grating is used to couple the infrared beam out of the optical waveguide and direct it to the infrared receiver. Both the receiving-coupled grating and the receiving-exit grating must ensure that the infrared beam reflected from the eye and transmitted through the lens is correctly transmitted to the infrared receiver. In this step, the control device determines a third adjustment value corresponding to the receiving-coupled grating and the receiving-exit grating. This third adjustment value instructs the adjustment of the receiving-coupled grating and the receiving-exit grating so that the receiving-coupled grating collimates and couples the infrared beam reflected from the eye and transmitted through the lens into the optical waveguide, and that the receiving-exit grating collimates and couples the infrared beam out of the optical waveguide and directs it to the infrared receiver.

[0062] It is important to note that, without any special configuration, a grating typically couples light rays from different angles originating from the same point into and out of the light source in different directions. This leads to distortion in the final acquired infrared light data, making it impossible to accurately represent eye information. By using a receiving coupling grating to collimate and couple the infrared beam reflected from the eye and transmitted through the lens into the optical waveguide, and using a receiving coupling grating to collimate and couple the infrared beam out of the optical waveguide and direct it towards the infrared receiver, this embodiment of the invention ensures that light rays from different angles originating from the same point are coupled into and out of the light source in the same direction. This improves the accuracy of the final acquired infrared light data, enabling it to accurately represent eye information.

[0063] Figure 8 This is a schematic diagram of the operation of the optical receiving module according to an embodiment of the present invention. It is intended to illustrate that the lens diopter can be compensated by adjusting the grating parameters of the emission coupling grating and the reception coupling grating using compensation adjustment values. For ease of understanding, Figure 8 The diagram shown illustrates the operation of the light receiving module after ignoring the effects of lens refractive power. Figure 8 The content shown is for illustrative purposes only and does not represent the actual transmission process of the light beam in a real-world application. Figure 8 As shown, when the eye 81 is irradiated by an infrared beam, it reflects the beam. The receiving coupling grating 82 collimates and couples the infrared beam reflected from the eye and transmitted through the lens into the optical waveguide 83. After being coupled into the optical waveguide 83, the infrared beam undergoes multiple total internal reflections within the waveguide 83, thus being transmitted by the waveguide 83 to the receiving coupling grating 84. The receiving coupling grating 84 collimates and couples the infrared beam out of the optical waveguide 83 and directs it towards the infrared receiver 85. Furthermore, the infrared beam coupled out by the receiving coupling grating 84 is focused inside the infrared receiver 85, thereby obtaining infrared light data carrying eye information.

[0064] Optionally, as a method of determination, the aforementioned adjustment values ​​can be preset by relevant personnel. Alternatively, as another method of determination, embodiments of the present invention can be determined by relevant personnel based on a mapping table between actual test records of user wearing parameters and the required specific adjustment values. Furthermore, the aforementioned adjustment values ​​can also be determined by the control device based on the current user wearing parameters (e.g., pupillary distance, pupillary height, lens-to-eye distance (distance from the rear surface of the lens to the apex of the cornea), lens angle (angle between the lens plane and the line of sight), tilt angle (angle between the temple and the lens plane), and the actual relative position of each grating to the user's eyes, etc.) by looking up the values ​​in the mapping table. This application does not limit the specific method of determining each adjustment value.

[0065] Step S340: Adjust the grating parameters according to the compensation adjustment value, the first adjustment value, the second adjustment value and / or the third adjustment value.

[0066] Specifically, after determining the compensation adjustment value, the first adjustment value, the second adjustment value, and the third adjustment value, the control device will adjust the grating parameters according to the compensation adjustment value, the first adjustment value, the second adjustment value, and / or the third adjustment value so that each grating presents the required diopter.

[0067] Optionally, as one implementation, the adjustable grating parameters of each grating can be set to include the diffraction angle of each grating. In this adjustment method, the control device can adjust the diffraction angle of each grating according to a compensation adjustment value, a first adjustment value, a second adjustment value, and / or a third adjustment value, so that each grating exhibits the desired refractive power. Further optionally, the emission-coupled grating, emission-emission grating, receiver-coupled grating, and receiver-emission grating can be configured as liquid crystal gratings. Correspondingly, as one implementation of diffraction angle adjustment, the control device can control the liquid crystal molecules inside each grating to rotate in the corresponding direction by adjusting the voltage value applied to each grating, thereby changing the diffraction angle of each grating and thus making each grating exhibit the corresponding refractive power.

[0068] It should be noted that the adjustment of astigmatism in the refractive power can be achieved by the control device through individually rotating the liquid crystal molecules on the corresponding axis of the grating, and this application does not limit this. It should be understood that when the emission-coupled grating, emission-emission grating, receiver-coupled grating, and receiver-emission grating are set as other types of controllable gratings, the control device can also use a matching adjustment method to adjust the corresponding grating parameters of each controllable grating, thereby changing the refractive power of each controllable grating, and this application does not limit this. For example, in some embodiments, the adjustable grating parameters of each grating can be set to include the grating period of each grating.

[0069] Optionally, in step S340, when it is necessary to adjust the grating parameters simultaneously based on the compensation adjustment value, the first adjustment value, the second adjustment value, and the third adjustment value, the control device determines the target adjustment value corresponding to each grating based on the compensation adjustment value, the first adjustment value, the second adjustment value, and the third adjustment value. Then, the control device adjusts the grating parameters based on the target adjustment value. For any grating, the target adjustment value can be the final adjustment value obtained by integrating multiple adjustment values ​​of the grating. It should be understood that since diopter is additive, the target adjustment value can be determined by calculating the sum of the adjustment values ​​corresponding to each grating. For example, if the compensation adjustment value of the emission coupling grating is spherical power -3D, cylindrical power -1.25D, and astigmatic axis 175 degrees, and the second adjustment value is spherical power +1D, cylindrical power -1D, and astigmatic axis 175 degrees, then the target adjustment value of the emission coupling grating can be spherical power -2D, cylindrical power -2.25D, and astigmatic axis 50 degrees.

[0070] Step S400: Control the optical sensing component to collect infrared light data carrying eye information.

[0071] Specifically, after adjusting the parameters of each relevant grating, the control device will control the optical sensing components to collect infrared light data carrying eye information.

[0072] Optionally, since the grating parameters have been adjusted in advance, in step S400, the control device first controls the infrared light source to emit an infrared beam, and then receives the infrared beam through the infrared receiver to obtain infrared light data.

[0073] Step S500: Determine eye movement data based on the infrared light data.

[0074] Specifically, the pupil and cornea have different reflective properties to infrared light beams. Therefore, the infrared light data obtained by the infrared receiver from receiving the infrared light beam reflected by the eye can carry eye information. In this step, after acquiring the infrared light data, the control device determines the eye movement data based on the infrared light data.

[0075] Furthermore, after determining the eye-tracking data, the control device can provide relevant services to the user based on the eye-tracking data. Alternatively, the control device can also communicate with external devices (e.g., user terminals or servers) to provide eye-tracking data support to the external devices, thereby enabling the external devices to provide relevant services to the user based on the eye-tracking data. This application does not impose any limitations on this.

[0076] Figure 9 This is a schematic diagram of the control device according to an embodiment of the present invention. Figure 9As shown, the control device in this embodiment of the invention includes an acquisition unit 91, a compensation unit 92, an adjustment unit 93, a data acquisition unit 94, and a determination unit 95.

[0077] Specifically, the acquisition unit 91 is used to acquire the lens parameters of the smart glasses.

[0078] The compensation unit 92 is used to determine a compensation adjustment value corresponding to the emission coupling grating and the reception coupling grating in the optical sensing component based on the lens parameters. The compensation adjustment value is used for lens refractive power compensation. The optical sensing component includes a waveguide, at least one light emitting module, and a light receiving module. The waveguide is stacked on the outer surface of the lens of the smart glasses and is used to transmit an infrared beam. The light emitting module includes an infrared light source, an emission coupling grating, and an emission coupling grating. The infrared light source is used to emit an infrared beam. The emission coupling grating is used to couple the infrared beam emitted by the infrared light source into the optical waveguide sheet, and the emission output grating is used to couple the infrared beam out of the optical waveguide sheet and through the lens to the eye. The light receiving module includes an infrared receiver, a receiving coupling grating, and a receiving output grating. The receiving coupling grating is used to couple the infrared beam reflected by the eye and through the lens into the optical waveguide sheet, and the receiving output grating is used to couple the infrared beam out of the optical waveguide sheet and to the infrared receiver. The infrared receiver is used to receive the infrared beam.

[0079] The adjustment unit 93 is used to adjust the grating parameters at least according to the compensation adjustment value.

[0080] The acquisition unit 94 is used to control the optical sensing component to acquire infrared light data carrying eye information.

[0081] The determining unit 95 is used to determine eye movement data based on the infrared light data.

[0082] This invention utilizes an optical sensing component to project an infrared beam through a lens onto the eye and to receive the infrared beam reflected from the eye through the lens. Simultaneously, when determining eye-tracking data, this invention first acquires the lens parameters of the smart glasses and determines a compensation adjustment value based on these parameters. At least based on the compensation adjustment value, the grating parameters are adjusted to compensate for lens refractive power. Then, the optical sensing component is controlled to collect infrared light data carrying eye information, and eye-tracking data is determined based on this infrared light data. Therefore, this invention ensures that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system.

[0083] Figure 10 This is a schematic diagram of the control device according to an embodiment of the present invention. Figure 10As shown, the control device includes at least one processor 101; a memory 102 communicatively connected to at least one processor 101; and a communication component 103 communicatively connected to a scanning device, the communication component 103 receiving and transmitting data under the control of the processor 101; wherein the memory 102 stores instructions executable by at least one processor 101, the instructions being executed by at least one processor 101 to implement the above control method.

[0084] Specifically, the control device includes one or more processors 101 and a memory 102. Figure 10 Taking a processor 101 as an example, the processor 101 and the memory 102 can be connected via a bus or other means. Figure 10 Taking a bus connection as an example, memory 102, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Processor 101 executes various functional applications and data processing of the device by running the non-volatile software programs, instructions, and modules stored in memory 102, thereby realizing the above-mentioned control method.

[0085] Memory 102 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; the data storage area may store an option list, etc. Furthermore, memory 102 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 102 may optionally include memory remotely located relative to processor 101, and these remote memories may be connected to external devices via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0086] One or more modules are stored in memory 102 and, when executed by one or more processors 101, execute the control method in any of the above method embodiments.

[0087] The above-mentioned products can perform the methods provided in the embodiments of this application, and have the corresponding functional modules and beneficial effects of performing the methods. For technical details not described in detail in this embodiment, please refer to the methods provided in the embodiments of this application.

[0088] This invention utilizes an optical sensing component to project an infrared beam through a lens onto the eye and to receive the infrared beam reflected from the eye through the lens. Simultaneously, when determining eye-tracking data, this invention first acquires the lens parameters of the smart glasses and determines a compensation adjustment value based on these parameters. At least based on the compensation adjustment value, the grating parameters are adjusted to compensate for lens refractive power. Then, the optical sensing component is controlled to collect infrared light data carrying eye information, and eye-tracking data is determined based on this infrared light data. Therefore, this invention ensures that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system.

[0089] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program for use by a computer to execute some or all of the above-described method embodiments.

[0090] That is, those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing related hardware. This program is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0091] Figure 11 This is a schematic diagram of smart glasses according to an embodiment of the present invention. Figure 11As shown, the smart glasses include a main body and an eye-tracking system. The main body includes a frame 111 and two temples 112. The frame 111 includes two lens rings and a bridge. The two lens rings are frame structures used to accommodate and fix the corresponding lenses. Optionally, the lens rings can be of any shape, and this application does not limit this. It should be understood that, depending on the mounting method of the optical waveguide in the eye-tracking system, the lens rings can be a single-layer lens ring structure or a double-layer lens ring structure, and this application does not limit this. The bridge is an intermediate structure used to connect the two lens rings. The two temples 112 are rod-like structures connecting the two sides of the frame 111. Optionally, to ensure that the main body of the glasses does not fall off when the user wears the smart glasses, the shape of the tail portion of the two temples 112 can be adapted to the contour of the human external ear. Furthermore, the connection method between the temples 112 and the frame 111 can be set by relevant personnel according to actual needs, and this application does not limit this. For example, to support the folding and opening of the temples 112 for easy storage of the smart glasses, the two temples 112 are connected to the frame 111 via hinges. The eye-tracking system includes at least one optical sensing component and a control device. It should be understood that when the eye-tracking system includes multiple optical sensing components (e.g., two optical sensing components), the multiple optical sensing components are respectively disposed on different lenses of the smart glasses. The optical sensing components are used to project infrared light beams through the lenses toward the eyes and to receive infrared light beams reflected from the eyes through the lenses. The control device is used to acquire the lens parameters of the smart glasses, determine compensation adjustment values ​​based on the lens parameters, adjust the grating parameters at least according to the compensation adjustment values ​​to compensate for lens refractive power, and then control the optical sensing components to collect infrared light data carrying eye information and determine eye-tracking data based on the infrared light data. Thus, embodiments of the present invention can ensure that the eye-tracking system is not interfered with by the lenses of the smart glasses, thereby improving the stability and applicability of the eye-tracking system.

[0092] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. An eye-tracking system, characterized in that, The eye-tracking system is suitable for smart glasses, and the eye-tracking system includes: At least one optical sensing component includes an optical waveguide, at least one optical emitting module, and an optical receiving module. The optical waveguide is stacked on the outer surface of the lens of the smart glasses. The optical waveguide is used to transmit an infrared beam. The optical emitting module includes an infrared light source, an emission coupling grating, and an emission coupling grating. The infrared light source emits an infrared beam. The emission coupling grating couples the infrared beam emitted by the infrared light source into the optical waveguide. The emission coupling grating couples the infrared beam out of the optical waveguide and through the lens to the eye. The optical receiving module includes an infrared receiver, a receiving coupling grating, and a receiving coupling grating. The receiving coupling grating couples the infrared beam reflected from the eye and through the lens into the optical waveguide. The receiving coupling grating couples the infrared beam out of the optical waveguide and towards the infrared receiver. The infrared receiver receives the infrared beam. The control device is configured to perform the following steps: Obtain the lens parameters of the smart glasses; The compensation adjustment value corresponding to the emission coupling grating and the reception coupling grating is determined according to the lens parameters, wherein the compensation adjustment value is used to indicate the adjustment of the grating parameters of the emission coupling grating and the reception coupling grating to perform lens diopter compensation; The grating parameters should be adjusted at least according to the compensation adjustment value; Control the optical sensing component to collect infrared light data carrying eye information; Eye movement data is determined based on the infrared light data.

2. The eye-tracking system according to claim 1, characterized in that, The control device is specifically configured as follows: A first adjustment value corresponding to the emission coupling grating is determined. The first adjustment value is used to indicate the adjustment of the grating parameters of the emission coupling grating so that the emission coupling grating collimates and couples the infrared beam emitted by the infrared light source into the optical waveguide sheet. A second adjustment value corresponding to the emission coupling grating is determined. The second adjustment value is used to indicate the adjustment of the grating parameters of the emission coupling grating so that the emission coupling grating diverges and couples the infrared beam from the optical waveguide and directs it through the lens toward the eye. A third adjustment value is determined corresponding to the receiver coupling grating and the receiver coupling output grating. The third adjustment value is used to indicate the adjustment of the receiver coupling grating and the receiver coupling output grating so that the receiver coupling grating collimates and couples the infrared beam reflected from the eye and transmitted through the lens into the optical waveguide sheet, and so that the receiver coupling output grating collimates and couples the infrared beam out of the optical waveguide sheet and directs it toward the infrared receiver. The grating parameters are adjusted based on the compensation adjustment value, the first adjustment value, the second adjustment value, and / or the third adjustment value.

3. The eye-tracking system according to claim 2, characterized in that, The control device is specifically configured as follows: The target adjustment value corresponding to each of the gratings is determined based on the compensation adjustment value, the first adjustment value, the second adjustment value, and the third adjustment value; Adjust the grating parameters according to the target adjustment value.

4. The eye-tracking system according to claim 1, characterized in that, The infrared light source, the emission coupling grating, the infrared receiver, and the reception coupling grating are disposed in the edge region of the optical waveguide sheet, and the reception coupling grating and the emission coupling grating are disposed in the central region of the optical waveguide sheet. The central region of the optical waveguide sheet is a region that matches the eye box, and the edge region includes other regions besides the central region.

5. The eye-tracking system according to claim 4, characterized in that, The receiver coupling grating is positioned at the center of the central region, and the emitter coupling grating is arranged around the receiver coupling grating.

6. The eye-tracking system according to claim 4, characterized in that, The infrared light source, the emission coupling grating, the infrared receiver, and the reception coupling grating are hidden inside the frame of the smart glasses.

7. The eye-tracking system according to claim 4, characterized in that, The infrared light source, the emission coupling grating, the infrared receiver, and the reception coupling grating are disposed in the area of ​​the optical waveguide that does not overlap with the lens.

8. The eye-tracking system according to claim 1, characterized in that, The emitter-coupled grating, the emitter-output grating, the receiver-coupled grating, and the receiver-output grating are liquid crystal gratings.

9. A control method, characterized in that, The method includes: Obtain the lens parameters of the smart glasses; Based on the lens parameters, compensation adjustment values ​​corresponding to the emission coupling grating and the reception coupling grating in the optical sensing component are determined. These compensation adjustment values ​​are used for lens refractive power compensation. The optical sensing component includes an optical waveguide, at least one light emitting module, and a light receiving module. The optical waveguide is stacked on the outer surface of the lens of the smart glasses and is used to transmit an infrared beam. The light emitting module includes an infrared light source, an emission coupling grating, and an emission coupling grating. The infrared light source emits an infrared beam, and the emission coupling grating... A grating is used to couple the infrared beam emitted by the infrared light source into the optical waveguide sheet. The emission coupling grating is used to couple the infrared beam out of the optical waveguide sheet and through the lens to the eye. The light receiving module includes an infrared receiver, a receiving coupling grating, and a receiving coupling grating. The receiving coupling grating is used to couple the infrared beam reflected by the eye and through the lens into the optical waveguide sheet. The receiving coupling grating is used to couple the infrared beam out of the optical waveguide sheet and to the infrared receiver. The infrared receiver is used to receive the infrared beam. The grating parameters should be adjusted at least according to the compensation adjustment value; Control the optical sensing component to collect infrared light data carrying eye information; Eye movement data is determined based on the infrared light data.

10. A control device, characterized in that, The device includes: The acquisition unit is used to acquire the lens parameters of the smart glasses; A compensation unit is used to determine compensation adjustment values ​​corresponding to the emission coupling grating and the reception coupling grating in the optical sensing component based on the lens parameters. The compensation adjustment values ​​are used for lens refractive power compensation. The optical sensing component includes an optical waveguide, at least one light emitting module, and a light receiving module. The optical waveguide is stacked on the outer surface of the lens of the smart glasses and is used to transmit an infrared beam. The light emitting module includes an infrared light source, an emission coupling grating, and an emission coupling grating. The infrared light source is used to emit an infrared beam. An input grating is used to couple the infrared beam emitted by the infrared light source into the optical waveguide sheet, and an output grating is used to couple the infrared beam out from the optical waveguide sheet and through the lens to the eye. The light receiving module includes an infrared receiver, an input receiving grating, and an output receiving grating. The input receiving grating is used to couple the infrared beam reflected by the eye and through the lens into the optical waveguide sheet, and the output receiving grating is used to couple the infrared beam out from the optical waveguide sheet and to the infrared receiver. The infrared receiver is used to receive the infrared beam. An adjustment unit is used to adjust the grating parameters at least according to the compensation adjustment value; The acquisition unit is used to control the optical sensing component to acquire infrared light data carrying eye information; A determining unit is used to determine eye-tracking data based on the infrared light data.

11. A computer-readable storage medium storing computer program instructions thereon, characterized in that, The computer program instructions, when executed by a processor, implement the method as described in claim 9.

12. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in claim 9.

13. A type of smart glasses, characterized in that, The smart glasses include: The main body of the eyeglasses, including the lenses; The eye-tracking system as described in any one of claims 1-8.

Images