Ar glasses eye movement tracking design method and ar glasses

Abstract

The application relates to an AR glasses eye movement tracking design method and AR glasses. The AR glasses eye movement tracking design method realizes the function of an illumination turning area by utilizing part of an imaging coupling-out area, realizes turning of an illumination light beam, enables imaging coupling-out gratings of the imaging coupling-out area to match the illumination turning gratings, realizes grating multiplexing, reduces the number of scattered grating areas, makes the appearance of a waveguide more beautiful, simultaneously reduces the types of gratings on the waveguide surface, and reduces the waveguide processing difficulty.

Description

Technical Field

[0001] This invention relates to the field of eye-tracking technology, and in particular to an eye-tracking design method for AR glasses and AR glasses. Background Technology

[0002] With the development of near-eye display technology, eye-tracking technology has become an indispensable part of AR or VR devices. Eye-tracking technology integrates multiple fields such as optics, electronic control, and algorithms. It can perform image or other signal processing by recognizing feedback of eye features, calculate the direction of human eye gaze, and then infer the information that the user needs to recognize and the matching auxiliary prompts.

[0003] Existing eye-tracking solutions include tracking based on changes in eyeball and surrounding features, tracking based on changes in the Pulcim spot reflected by the iris and the pupil position, and tracking based on feature extraction by projecting a red beam onto the iris. These eye-tracking solutions usually require infrared illumination. In existing solutions, multiple infrared light sources are installed on the eyeglass frame, which requires circuitry to be set up inside the frame, making the frame design more complex and the assembly more cumbersome. Summary of the Invention

[0004] Therefore, it is necessary to address the problem that existing eye-tracking solutions require multiple infrared light sources, which leads to more complex frame designs, and to provide an eye-tracking design method for AR glasses and AR glasses.

[0005] An eye-tracking design method for AR glasses includes:

[0006] An illumination coupling region is set on the waveguide of the AR glasses, wherein the position coordinates of the illumination coupling region are ( , ,0);

[0007] Based on the eye box parameters and exit pupil distance parameters of the AR glasses, as well as the setting parameters of the field of view angle projected by the optomechanical components of the AR glasses, an imaging coupling area is set on the waveguide;

[0008] Based on the wave vector of the illumination beam emitted by the eye-tracking light source of the AR glasses and the grating vector of the illumination coupling area, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after coupling into the waveguide is determined.

[0009] Based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, the position of the illumination transition region is determined in the imaging exit region, starting from the position coordinates of the illumination coupling region. The nearest intersection point between the illumination beam and the imaging exit region is the position coordinate of the illumination transition region.

[0010] Based on the grating vector and position coordinates of the lighting transition zone, the settable range of the lighting coupling zone is determined, and at least one lighting coupling zone is set within the settable range of the lighting coupling zone;

[0011] Based on the center coordinates of the illumination coupling region and the perpendicular distance between the eyeball and the XY plane of the waveguide, determine the target azimuth angle after the illumination beam is coupled out by the illumination coupling region; and

[0012] The grating parameters of the illumination coupling grating are determined based on the target azimuth angle after the illumination beam is coupled out of the waveguide by the illumination coupling region.

[0013] In one embodiment, in the step of setting an imaging coupling region on the waveguide based on the eye box parameters and exit pupil distance parameters of the AR glasses and the setting parameters of the field of view angle projected by the optomechanical components of the AR glasses, the size and position of the imaging coupling region are determined according to the following relationship:

[0014] ;

[0015] ;

[0016] ;as well as

[0017] ;

[0018] Wherein, FOV is the field of view angle projected by the optical-mechanical component, and α is the aspect ratio of the field of view angle projected by the optical-mechanical component. This is the half-field angle in the horizontal direction of the imaging coupling region. Let L be the half-field angle in the vertical direction of the imaging coupling region, L be the length of the imaging coupling region, and W be the width of the imaging coupling region. The vertical distance from the eyeball to the waveguide. For the length of the eye box, The width of the eye box.

[0019] In one embodiment, the step of determining the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, based on the wave vector of the illumination beam emitted by the eye-tracking light source of the AR glasses and the grating vector of the illumination coupling area, includes:

[0020] Based on the wave vector of the illumination beam emitted by the eye-tracking light source and the grating vector of the illumination coupling region, determine the wave vector of the illumination beam as it propagates within the waveguide after coupling; and

[0021] Based on the wave vector of the illumination beam as it propagates in the waveguide after being coupled into it, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide is determined.

[0022] In one embodiment, in the step of determining the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide, based on the wave vector of the illumination beam emitted by the eye-tracking light source and the grating vector of the illumination coupling region, the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide is calculated according to the following relationship:

[0023] ;

[0024] in, The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being coupled into it.

[0025] In one embodiment, in the step of determining the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, based on the wave vector as the illumination beam propagates in the waveguide, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide is calculated according to the following relationship:

[0026] ;

[0027] in, The azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide. The X-axis component of the wave vector as the illumination beam propagates within the waveguide after being coupled into it. The Y-axis component of the wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being coupled into it.

[0028] In one embodiment, the step of determining the position of the illumination transition region in the imaging exit region based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, taking the position coordinates of the illumination coupling region as the starting point, wherein the step of determining the position coordinates of the illumination transition region at the nearest intersection point between the illumination beam and the imaging exit region includes the following steps:

[0029] The four endpoints of the imaging coupling region are defined as (L / 2, W / 2, 0), (-L / 2, W / 2, 0), (-L / 2, -W / 2, 0), and (L / 2, -W / 2, 0), where L is the length of the imaging coupling region and W is the width of the imaging coupling region; and

[0030] Based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide. The position coordinates of the illumination coupling area ( , Starting from (0), determine the nearest intersection point between the illumination beam and the imaging coupling region as ( , ,0).

[0031] In one embodiment, the step of determining the settable range of the illumination coupling area based on the grating vector and position coordinates of the illumination transition area, and setting at least one illumination coupling area within the settable range of the illumination coupling area, includes the following steps:

[0032] Set the grating vector of the illumination transition zone, and determine the wave vector of the illumination beam when it propagates in the waveguide after being coupled into the waveguide and the grating vector of the illumination transition zone.

[0033] Based on the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region, determine the angle between the illumination beam after being deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide.

[0034] Based on the position coordinates of the illumination transition region and the angle between the illumination beam after being turned by the illumination transition region and the X-axis of the waveguide's XY plane, the propagation range of the illumination beam after being turned by the illumination transition region is determined, thereby determining the settable range of the illumination coupling region; and

[0035] Within the settable range of the lighting coupling zone, the coordinates of the center position of the lighting coupling zone are selected as ( , ,0).

[0036] In one embodiment, in the step of setting the grating vector of the illumination transition region and determining the wave vector of the illumination beam propagating in the waveguide after being deflected by the illumination transition region, based on the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide and the grating vector of the illumination transition region, the wave vector of the illumination beam propagating in the waveguide after being deflected by the illumination transition region is calculated according to the following relationship:

[0037] ;

[0038] in, This is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled into the waveguide by the illumination coupling region.

[0039] In one embodiment, in the step of determining the angle between the illumination beam after it has been deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide, based on the wave vector as the illumination beam propagates within the waveguide after being deflected by the illumination deflection region, the angle between the illumination beam after it has been deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide is calculated according to the following formula:

[0040] ;

[0041] in, The angle between the illumination beam and the X-axis of the waveguide's XY plane after the illumination beam is deflected by the illumination deflection region. Let X be the X-axis component of the wave vector as the illumination beam propagates within the waveguide after being deflected by the illumination deflection region. The Y-axis component of the wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region.

[0042] In one embodiment, in the step of determining the target azimuth angle after the illumination beam is coupled out by the illumination coupling area based on the center position coordinates of the illumination coupling area and the vertical distance between the eyeball and the XY plane of the waveguide, the target azimuth angle after the illumination beam is coupled out by the illumination coupling area is calculated according to the following relationship:

[0043] ;

[0044] ;

[0045] in, The angle between the illumination beam after it is coupled out by the illumination coupling region and the XY plane of the waveguide. The angle between the projection of the illumination beam, after being coupled out by the illumination coupling region, into the XY plane of the waveguide and the X-axis. The X-axis coordinate of the center position of the lighting coupling area. The Y-axis coordinate of the center position of the lighting coupling area. This represents the vertical distance between the eyeball and the waveguide.

[0046] In one embodiment, the step of determining the grating parameters of the illumination coupling grating based on the target azimuth angle after the illumination beam is coupled out of the waveguide by the illumination coupling region includes the following steps:

[0047] By converting the target azimuth angle after the illumination beam is coupled out of the illumination coupling region to the K-domain diagram, the wave vector after the illumination beam is coupled out of the waveguide by the illumination coupling region is determined.

[0048] The grating vector of the illumination coupling region is determined based on the wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region; and

[0049] Based on the grating vector of the illumination coupling area, determine the grating clock angle and grating period of the illumination coupling area.

[0050] In one embodiment, in the step of determining the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region by converting the target azimuth angle after the illumination beam is coupled out of the illumination coupling region to the K-domain diagram, the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region is calculated according to the following relationship:

[0051] ;

[0052] in, The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. The angle between the illumination beam after it is coupled out by the illumination coupling region and the XY plane of the waveguide. The angle between the projection of the illumination beam, after being coupled out by the illumination coupling region, onto the XY plane of the waveguide and the X-axis.

[0053] In one embodiment, in the step of determining the grating vector of the illumination coupling region based on the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region, the grating vector of the illumination coupling region is calculated according to the following relationship:

[0054] ;

[0055] in, The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. This is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. This is the grating vector of the illumination coupling zone.

[0056] In one embodiment, the grating vector of the illumination coupling region satisfies the following relationship:

[0057] ;

[0058] in, The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled into the waveguide by the illumination coupling region. This is the grating vector of the illumination coupling region.

[0059] In one embodiment, in the step of determining the grating clock angle and grating period of the illumination coupling region based on the grating vector of the illumination coupling region, the grating clock angle and grating period of the illumination coupling region are calculated according to the following relationship:

[0060] ;

[0061] ;

[0062] in, The grating clock angle for the illumination coupling area. The grating period of the illumination coupling region, Let X be the grating vector along the X direction in the XY plane of the waveguide for the illumination coupling region. The grating vector of the illumination coupling region along the Y direction in the XY plane of the waveguide.

[0063] In one embodiment, the AR glasses eye-tracking design method further includes the steps of:

[0064] An imaging coupling region and an imaging transition region are formed on the waveguide, wherein the imaging coupling region, the imaging transition region, and the imaging coupling out region satisfy the following relationship:

[0065] ;

[0066] in, This is the wave vector of the imaging coupling region. This is the wave vector of the imaging transition region. This is the wave vector of the imaging coupling region.

[0067] An AR glasses design based on any of the above-described AR glasses eye-tracking design methods includes:

[0068] The main body of the eyeglasses includes a frame and a pair of temples connected to the frame;

[0069] A pair of optical-mechanical components, the two optical-mechanical components being respectively fixed to the two temples, for emitting imaging beams;

[0070] A pair of eye-tracking light sources, each fixed to one of the two optomechanical components, for emitting an illumination beam;

[0071] A pair of waveguides, fixed to the lens frame, for transmitting the imaging beam emitted by the optomechanical assembly and the image beam emitted by the eye-tracking light source in the form of total internal reflection; and

[0072] A transmission component includes an illumination coupling grating, an illumination coupling grating, an imaging coupling grating, an imaging deflection grating, and an imaging coupling grating, respectively disposed on the waveguide, to form an illumination coupling region, an illumination coupling region, an imaging coupling region, an imaging deflection region, and an imaging coupling region on the waveguide, respectively; the illumination coupling region is used to couple the illumination beam emitted by the eye-tracking light source into the waveguide and cause the illumination beam to propagate toward the imaging coupling region by total internal reflection; the imaging coupling region is used to deflect the illumination beam and cause the illumination beam to propagate toward the illumination coupling region by total internal reflection; the illumination coupling region is used to allow the illumination beam to exit to the eyeball.

[0073] The AR glasses of this application are equipped with only one eye-tracking light source. The illumination beam emitted by the eye-tracking light source can propagate in the waveguide. After propagating through the waveguide, the illumination beam can be split into one or more illumination beams. The multiple illumination beams can illuminate the eyeball at different angles, forming multiple reflected light spots to achieve the purpose of locating the pupil.

[0074] The AR glasses eye-tracking design method of this application enables the AR glasses to propagate an illumination beam through a waveguide and integrate the illumination beam into the waveguide, thereby improving the integration of the eye-tracking system. This AR glasses eye-tracking design method utilizes a portion of the imaging coupling region to function as an illumination transition region, achieving the transition of the illumination beam. This allows the imaging coupling grating in the imaging coupling region to match the illumination transition grating, enabling grating reuse, reducing the number of scattered grating regions, making the waveguide more aesthetically pleasing, and simultaneously reducing the types of gratings on the waveguide surface, thus lowering the waveguide fabrication difficulty. Attached Figure Description

[0075] Figure 1 A stereoscopic diagram of AR glasses provided for one embodiment of this application;

[0076] Figure 2 An exploded view of the AR glasses according to the above embodiments of this application is shown;

[0077] Figure 3 A partially enlarged schematic diagram of the temple of the AR glasses according to the above embodiments of this application is shown;

[0078] Figure 4 A schematic diagram of the waveguide structure of a first embodiment of AR glasses according to the above embodiments of this application is shown;

[0079] Figure 5An imaging K-domain diagram of the waveguide of a first embodiment of AR glasses according to the above embodiments of this application is shown;

[0080] Figure 6 An illumination K-domain diagram of the waveguide of a first embodiment of AR glasses according to the above embodiments of this application is shown;

[0081] Figure 7 A diagram showing the relative coordinates of the illumination area of ​​the waveguide and the eyeball of a first embodiment of the AR glasses according to the above embodiments of this application is provided.

[0082] Figure 8 A schematic diagram showing the settable range of the illumination coupling region of the waveguide of a first embodiment of AR glasses according to the above embodiments of this application is shown;

[0083] Figure 9 A schematic diagram of the waveguide structure of a second embodiment of AR glasses according to the above embodiments of this application is shown;

[0084] Figure 10 A schematic diagram of the waveguide side structure of a second embodiment of AR glasses according to the above embodiments of this application is shown;

[0085] Figure 11 The waveguide edge of the second embodiment of the AR glasses according to the above embodiments of this application is shown as follows: Figure 9 A schematic diagram of a cross-section cut by the shown section line;

[0086] Figure 12 A schematic diagram of the waveguide structure of a third embodiment of AR glasses according to the above embodiments of this application is shown;

[0087] Figure 13 An imaging K-domain diagram of the waveguide of a third embodiment of AR glasses according to the above embodiments of this application is shown;

[0088] Figure 14 An illumination K-domain diagram of the waveguide optical path 1 of a third embodiment of AR glasses according to the above embodiments of this application is shown;

[0089] Figure 15 The illumination K-domain diagram of the waveguide optical path 2 of the third embodiment of the AR glasses according to the above embodiments of this application is shown;

[0090] Figure 16 A schematic diagram illustrating the steps of the AR glasses eye-tracking design method provided in this application;

[0091] Figure 17 A schematic diagram of step S300 of the AR glasses eye-tracking design method according to this application is shown;

[0092] Figure 18A schematic diagram of step S400 of the AR glasses eye-tracking design method according to this application is shown;

[0093] Figure 19 A schematic diagram of step S500 of the AR glasses eye-tracking design method according to this application is shown;

[0094] Figure 20 A schematic diagram of step S700 of the AR glasses eye-tracking design method according to this application is shown.

[0095] Reference numerals: 10, eye-tracking light source; 20, waveguide; 21, illumination coupling region; 211, first coupling region; 212, second coupling region; 22, illumination coupling region; 221, first coupling region; 222, second coupling region; 23, imaging coupling region; 24, imaging transition region; 241, first imaging transition region; 242, second imaging transition region; 25, imaging coupling region; 30, main body of glasses; 31, frame; 32, temple; 40, optomechanical assembly. Detailed Implementation

[0096] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Many specific details are set forth in the following description to provide a thorough understanding of the present invention. However, the present invention can be practiced in many other ways different from those described herein, and those skilled in the art can make similar modifications without departing from the spirit of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0097] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0098] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0099] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise explicitly limited. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0100] In this invention, unless otherwise explicitly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "over," and "on top" of the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.

[0101] It should be noted that when an element is referred to as being "fixed to" or "set on" another element, it can be directly on the other element or there may be an intervening element. When an element is considered to be "connected to" another element, it can be directly connected to the other element or there may be an intervening element. The terms "vertical," "horizontal," "upper," "lower," "left," "right," and similar expressions used herein are for illustrative purposes only and do not represent the only possible implementation.

[0102] To address the issue that existing eye-tracking solutions require multiple infrared light sources, leading to more complex frame designs, this application provides an AR glasses solution with only one eye-tracking light source. The illumination beam emitted by the eye-tracking light source can propagate within a waveguide. After propagation through the waveguide, the illumination beam can be split into one or more illumination beams. These multiple illumination beams can illuminate the eyeball at different angles, forming multiple reflected light spots to achieve the purpose of locating the pupil.

[0103] Specifically, please refer to Figure 1 , Figure 2 , Figure 3 and Figure 4The AR glasses of this application may include a glasses body 30, a pair of optical-mechanical components 40, a pair of eye-tracking light sources 10, a pair of waveguides 20, and a transmission component. The glasses body 30 includes a frame 31 and a pair of temples 32 connected to the frame 31. The two optical-mechanical components 40 are respectively fixed to the two temples 32 for emitting imaging beams. The eye-tracking light sources 10 are respectively fixed to the two optical-mechanical components 40 for emitting illumination beams. The two eye-tracking light sources 10 are respectively fixed to the two optical-mechanical components 40 for emitting illumination beams. The waveguides 20 are fixed to the frame 31 for transmitting the imaging beams emitted by the optical-mechanical components 40 and the image beams emitted by the eye-tracking light sources 10 in the form of total internal reflection. The transmission component includes an illumination coupling grating, an illumination output grating, an imaging coupling grating, an imaging deflection grating, and an imaging output grating, respectively disposed on the waveguide 20, to form an illumination coupling region 21, an illumination output region 22, an imaging coupling region 23, an imaging deflection region 24, and an imaging output region 25 on the waveguide 20, respectively. The illumination coupling region 21 is used to couple the illumination beam emitted by the eye-tracking light source 10 into the waveguide 20 and cause the illumination beam to propagate towards the imaging output region 25 by total internal reflection. The imaging output region 25 is used to deflect the illumination beam and cause the illumination beam to propagate towards the illumination output region 22 by total internal reflection. The illumination output region 22 is used to allow the illumination beam to exit to the eyeball. By placing the eye-tracking light source 10 on the optical engine or temple 32, the AR glasses eliminate the need for wiring in the frame 31, making the frame 31 more lightweight and aesthetically pleasing, while also improving the integration of the temple 32.

[0104] Optionally, in one embodiment, the eye-tracking light source of the AR glasses of this application is an infrared light source, such as a near-infrared LED or VCSEL. The dominant wavelength of the infrared light is preferably 940nm, with a wavelength range between 880nm and 970nm. With this configuration, since the infrared light source is outside the visible range of the human eye, the user will not perceive any extra light spots. Simultaneously, the infrared light can pass through the pupil and reflect off the iris. Through the capture of the eye-tracking lens, an image of the eyeball can be formed. The iris in the image will be imaged as a reflected bright spot, while the pupil will not have a reflected bright spot. This facilitates the algorithm's differentiation of the pupil and the positioning reference based on the bright spot reflected by the iris.

[0105] Because the illumination beam emitted by the eye-tracking light source must first propagate through the illumination coupling area into the waveguide for total internal reflection, and then exit the waveguide through the illumination output area after propagating to the appropriate position, it illuminates the eyeball. To make the optical system of the AR glasses of this application more compact, the eye-tracking light source and the optomechanical components are positioned relatively close. When the target output position of the illumination beam is very close to the imaging transition zone, the illumination beam needs to be close to the direction of the beam after coupling with the imaging beam, which can easily cause the illumination beam to also propagate into the imaging transition zone. Furthermore, when the area of ​​the imaging transition zone is large, the aforementioned problem is also likely to occur. In addition, since the illumination beam is usually infrared light, with a wavelength longer than the visible light used for imaging, the wave vector of the illumination beam is also larger. After passing through the grating vector effect in the imaging transition zone, the illumination beam may be unable to continue propagating in the waveguide and ultimately fail to reach the target output position.

[0106] To address the aforementioned issues, this application provides an AR glasses eye-tracking design method. This method redesigns the illumination path of the eye-tracking light source, allowing the illumination beam to pass through the imaging coupling area and then be redirected by the imaging coupling area before illuminating the target coupling position. This provides greater freedom in setting the illumination path and the illumination coupling area.

[0107] Specifically, please refer to Figure 16 The AR glasses eye-tracking design method of this application may include the following steps:

[0108] S100. An illumination coupling region is set on the waveguide of the AR glasses, wherein the position coordinates of the illumination coupling region are ( , ,0);

[0109] S200. Based on the eye box parameters and exit pupil distance parameters of the AR glasses, as well as the setting parameters of the field of view angle projected by the optomechanical components of the AR glasses, an imaging coupling area is set on the waveguide.

[0110] S300. Based on the wave vector of the illumination beam emitted by the eye-tracking light source of the AR glasses and the grating vector of the illumination coupling area, determine the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide.

[0111] S400. Based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, the position of the illumination transition region is determined in the imaging exit region, starting from the position coordinates of the illumination coupling region. The nearest intersection point between the illumination beam and the imaging exit region is the position coordinate of the illumination transition region.

[0112] S500. Determine the settable range of the lighting coupling area based on the grating vector and position coordinates of the lighting transition area, and set at least one lighting coupling area within the settable range of the lighting coupling area;

[0113] S600. Based on the center position coordinates of the illumination coupling area and the perpendicular distance between the eyeball and the XY plane of the waveguide, determine the target azimuth angle after the illumination beam is coupled out by the illumination coupling area; and

[0114] S700. Determine the grating parameters of the illumination coupling grating based on the target azimuth angle after the illumination beam is coupled out of the waveguide by the illumination coupling area.

[0115] It is understandable that, such as Figure 4 and Figure 8 As shown, according to the above AR glasses eye-tracking design method, steps S100 and S200 determine the size and position of the imaging coupling area, so that subsequent steps can set the coupling direction of the illumination beam, ensuring that the illumination beam coupled into the waveguide can illuminate the imaging coupling area. Step S300 determines the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after coupling into it, thus determining the propagation direction of the illumination beam after coupling into the waveguide. Step S400 determines the intersection point of the illumination beam and the imaging coupling area when the illumination beam propagates in the waveguide, thereby determining the position coordinates of the illumination turning area in the imaging coupling area, so that the position of the illumination coupling area can be determined from the position coordinates of the illumination turning area as the starting point. Step S500 determines the settable range of the illumination coupling area on the waveguide. Setting the illumination coupling area within this settable range ensures that the illumination beam couples out normally in the predetermined direction, allowing the illumination beam to reach the target coupling position. Step S600 determines the target azimuth angle of the illumination beam after coupling out by the illumination coupling area, which facilitates the calculation of the grating vector of the illumination coupling area. By determining the grating parameters of the illumination coupling area in step S700, and designing the illumination coupling grating of the illumination coupling area based on these parameters, it can be ensured that the illumination beam coupled out of the illumination coupling area illuminates the eyeball along a predetermined path.

[0116] In this way, AR glasses designed using the eye-tracking design method of this application can propagate the illumination beam through the waveguide and integrate the illumination beam into the waveguide, thereby improving the integration of the eye-tracking system. By utilizing a portion of the imaging coupling region to realize the function of the illumination transition region, the illumination beam is turned, allowing the imaging coupling grating in the imaging coupling region to match the illumination transition grating, achieving grating multiplexing, reducing the number of scattered grating regions, making the waveguide more aesthetically pleasing, and reducing the types of gratings on the waveguide surface, thus lowering the waveguide fabrication difficulty.

[0117] Optionally, in one embodiment, in step S200, where an imaging coupling region is set on the waveguide based on the eye box parameters and exit pupil distance parameters of the AR glasses, as well as the setting parameters of the field of view angle projected by the optomechanical components of the AR glasses, the size and position of the imaging coupling region are determined according to the following relationship:

[0118] ;

[0119] ;

[0120] ;as well as

[0121] ;

[0122] Wherein, FOV is the field of view angle projected by the optical-mechanical component, and α is the aspect ratio of the field of view angle projected by the optical-mechanical component. This is the half-field angle in the horizontal direction of the imaging coupling region. Let L be the half-field angle in the vertical direction of the imaging coupling region, L be the length of the imaging coupling region, and W be the width of the imaging coupling region. This is the vertical distance between the eyeball and the waveguide (i.e., the exit pupil distance parameter). For the length of the eye box, This refers to the width of the eye box (i.e., the size parameter of the eye box).

[0123] In this way, the size and position of the imaging coupling area can be calculated and determined based on the field of view of the pre-designed optomechanical component, the aspect ratio of the field of view of the optomechanical component, the size of the eye box, and the vertical distance between the eyeball and the waveguide, so as to subsequently set the direction of the illumination coupling beam so that the illumination beam of the coupling waveguide of the illumination coupling area can illuminate the imaging coupling area.

[0124] Optionally, such as Figure 17 As shown, in one embodiment, step S300, which involves determining the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it has been coupled into the waveguide, based on the wave vector of the illumination beam emitted by the eye-tracking light source of the AR glasses and the grating vector of the illumination coupling area, includes:

[0125] S310. Based on the wave vector of the illumination beam emitted by the eye-tracking light source and the grating vector of the illumination coupling region, determine the wave vector of the illumination beam as it propagates in the waveguide after coupling into it; and

[0126] S320. Based on the wave vector of the illumination beam as it propagates in the waveguide after being coupled into it, determine the propagation azimuth angle of the illumination beam in the XY plane of the waveguide.

[0127] With this configuration, step S310 can determine the wave vector of the illumination beam as it propagates within the waveguide after being coupled into it, based on the wave vector emitted by the eye-tracking light source and the grating vector of the illumination coupling region, thereby determining the propagation direction of the illumination beam within the waveguide. Step S320 can determine the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into it, based on the wave vector of the illumination beam as it propagates within the waveguide, so as to subsequently determine the intersection point of the illumination beam with the imaging coupling region and the position of the illumination transition region.

[0128] Optionally, in one embodiment, in step S310, determining the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide, based on the wave vector of the illumination beam emitted by the eye-tracking light source and the grating vector of the illumination coupling region, the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide is calculated according to the following relationship:

[0129] ;

[0130] in, The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being coupled into it.

[0131] In this way, the wave vector of the illumination beam after it is coupled into the waveguide and propagates in the waveguide can be calculated according to the above relationship, so as to calculate the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide.

[0132] Optionally, in one embodiment, in step S320, determining the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, based on the wave vector of the illumination beam propagating in the waveguide, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide is calculated according to the following relationship:

[0133] ;

[0134] in, The azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide. The X-axis component of the wave vector as the illumination beam propagates within the waveguide after being coupled into it. The Y-axis component of the wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being coupled into it.

[0135] In this way, by decomposing the wave vector of the illumination beam as it propagates in the waveguide after being coupled into the waveguide into X-axis and Y-axis components, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after being coupled into the waveguide can be calculated using inverse trigonometric function formulas.

[0136] Optionally, such as Figure 7 , Figure 8 and Figure 18 As shown, in one embodiment, step S400, determining the position of the illumination transition region in the imaging exit region based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, with the position coordinates of the illumination coupling region as the starting point, wherein the step of determining the position coordinates of the illumination transition region by the nearest intersection point between the illumination beam and the imaging exit region includes the following steps:

[0137] S410. The four endpoints of the imaging coupling region are defined as (L / 2, W / 2, 0), (-L / 2, W / 2, 0), (-L / 2, -W / 2, 0), and (L / 2, -W / 2, 0), where L is the length of the imaging coupling region and W is the width of the imaging coupling region; and

[0138] S420. Based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide. The position coordinates of the illumination coupling area ( , Starting from (0), determine the nearest intersection point between the illumination beam and the imaging coupling region as ( , ,0).

[0139] Understandably, in step S410, the imaging coupling region is defined by setting its four endpoints and forming a rectangle around them. In step S420, the coordinates of the illumination coupling region are used as the starting point of the illumination beam, and a ray representing the illumination beam is drawn. The nearest intersection point between this ray and the defined imaging coupling region is the nearest intersection point between the illumination beam and the imaging coupling region. The coordinates of this intersection point are the location of the illumination turning zone. The illumination beam redirected by the imaging coupling region starts from this intersection point, and the location of the illumination coupling region needs to be determined in conjunction with this starting point.

[0140] Optionally, such as Figure 7 , Figure 8 and Figure 19 As shown, in one embodiment, step S500, which involves determining the settable range of the illumination coupling area based on the grating vector and position coordinates of the illumination transition area, and setting at least one illumination coupling area within the settable range of the illumination coupling area, includes the following steps:

[0141] S510. Set the grating vector of the illumination turning zone, and determine the wave vector of the illumination beam when it propagates in the waveguide after being coupled into the waveguide and the grating vector of the illumination turning zone.

[0142] S520. Based on the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region, determine the angle between the illumination beam after being deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide.

[0143] S530. Based on the position coordinates of the illumination transition region and the angle between the illumination beam after it is turned by the illumination transition region and the X-axis of the XY plane of the waveguide, determine the propagation range of the illumination beam after it is turned by the illumination transition region, so as to determine the settable range of the illumination coupling region; and

[0144] S540. Within the settable range of the lighting coupling area, the center position coordinates of the lighting coupling area are selected as ( , ,0).

[0145] In this way, firstly, through steps S510 and S520, the angle between the illumination beam after being redirected by the illumination turning region and the X-axis of the waveguide's XY plane is determined to confirm the propagation direction of the illumination beam after being redirected by the illumination turning region (i.e., after being redirected by the imaging coupling region); then, through step S530, taking the intersection point as the starting point, the propagation range of the illumination beam after being redirected by the illumination turning region (i.e., after being redirected by the imaging coupling region) can be determined based on the propagation direction of the illumination beam after being redirected by the illumination turning region, thereby determining the range within which the illumination coupling region can be set, such as... Figure 8 As shown in the figure, the shaded area represents the possible location range of the illumination coupling area. Finally, through step S540, a suitable location for the illumination coupling area is selected, taking into account factors such as waveguide structure and aesthetics, to ensure that the illumination beam can be coupled out normally in the predetermined direction.

[0146] Optionally, in one embodiment, in step S510, setting the grating vector of the illumination transition region, and determining the wave vector of the illumination beam propagating in the waveguide after being deflected by the illumination transition region based on the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide and the grating vector of the illumination transition region, the wave vector of the illumination beam propagating in the waveguide after being deflected by the illumination transition region is calculated according to the following relationship:

[0147] ;

[0148] in, This is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled into the waveguide by the illumination coupling region.

[0149] In this way, the wave vector of the illumination beam after being deflected by the illumination deflection region and propagating in the waveguide can be calculated according to the above relationship, so as to calculate the angle between the illumination beam after being deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide.

[0150] Optionally, in one embodiment, in step S520, determining the angle between the illumination beam after it has been deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide based on the wave vector as the illumination beam propagates within the waveguide, the angle between the illumination beam after it has been deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide is calculated according to the following formula:

[0151] ;

[0152] in, The angle between the illumination beam and the X-axis of the waveguide's XY plane after the illumination beam is deflected by the illumination deflection region. Let X be the X-axis component of the wave vector as the illumination beam propagates within the waveguide after being deflected by the illumination deflection region. The Y-axis component of the wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region.

[0153] In this way, by decomposing the wave vector of the illumination beam as it propagates in the waveguide after being deflected by the illumination deflection region into X-axis and Y-axis components, the angle between the illumination beam after being deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide can be calculated using inverse trigonometric function formulas, thereby determining the propagation direction of the illumination beam after being deflected by the illumination deflection region.

[0154] Preferably, in one embodiment, in step S500, multiple illumination coupling areas can be set within the settable range of the illumination coupling area to meet the requirement of multiple reflective bright spots in some eye-tracking algorithms. The positions of different illumination coupling areas and the directions of the emitted illumination beams are different, but they can all ensure that the illumination beam is directed toward the eyeball and forms multiple reflective bright spots after being reflected by the eyeball.

[0155] Optionally, in one embodiment, in step S600, determining the target azimuth angle after the illumination beam is coupled out by the illumination coupling area based on the center position coordinates of the illumination coupling area and the vertical distance between the eyeball and the XY plane of the waveguide, the target azimuth angle after the illumination beam is coupled out by the illumination coupling area is calculated according to the following formula:

[0156] ;

[0157] ;

[0158] in, The angle between the illumination beam after it is coupled out by the illumination coupling region and the XY plane of the waveguide. The angle between the projection of the illumination beam, after being coupled out by the illumination coupling region, into the XY plane of the waveguide and the X-axis. The X-axis coordinate of the center position of the lighting coupling area. The Y-axis coordinate of the center position of the lighting coupling area. This represents the vertical distance between the eyeball and the waveguide.

[0159] In this way, according to step S600, the angle between the illumination beam after being coupled out of the illumination coupling area and the XY plane of the waveguide, and the angle between the projection of the illumination beam after being coupled out of the illumination coupling area in the XY plane of the waveguide and the X-axis can be calculated respectively, thereby determining the target azimuth angle of the illumination beam after being coupled out of the illumination coupling area, so as to calculate the grating vector of the illumination coupling area in the subsequent calculation.

[0160] Optionally, such as Figure 20 As shown, in one embodiment, the step of determining the grating parameters of the illumination coupling grating in S700, based on the target azimuth angle after the illumination beam is coupled out of the waveguide by the illumination coupling region, includes the following steps:

[0161] S710. By converting the target azimuth angle after the illumination beam is coupled out of the illumination coupling area to the K-domain diagram, the wave vector after the illumination beam is coupled out of the waveguide by the illumination coupling area is determined.

[0162] S720. Determine the grating vector of the illumination coupling region based on the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region; and

[0163] S730. Determine the grating clock angle and grating period of the illumination coupling area based on the grating vector of the illumination coupling area.

[0164] Understandably, step S710 first converts the target azimuth angle of the illumination beam into the wave vector of the illumination beam after it is coupled out of the waveguide by the illumination coupling area; then step S720 converts the wave vector of the illumination beam after it is coupled out of the waveguide by the illumination coupling area into the grating vector of the illumination coupling area; finally, step S730 determines the grating clock angle and grating period of the illumination coupling area based on the grating vector of the illumination coupling area. The obtained grating clock angle and grating period are used to design the illumination coupling grating in the illumination coupling area, which can ensure that the illumination beam, after being coupled out of the illumination coupling grating, can illuminate the eyeball according to a predetermined path.

[0165] Optionally, in one embodiment, in step S710, by converting the target azimuth angle of the illumination beam after being coupled out of the illumination coupling region to the K-domain diagram, and determining the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region, the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region is calculated according to the following relationship:

[0166] ;

[0167] in, The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. The angle between the illumination beam after it is coupled out by the illumination coupling region and the XY plane of the waveguide. The angle between the projection of the illumination beam, after being coupled out by the illumination coupling region, onto the XY plane of the waveguide and the X-axis.

[0168] Optionally, in one embodiment, in step S720, determining the grating vector of the illumination coupling region based on the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region, the grating vector of the illumination coupling region is calculated according to the following formula:

[0169] ;

[0170] in, The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. This is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. This is the grating vector of the illumination coupling zone.

[0171] Furthermore, in one embodiment, the grating vector of the illumination coupling region satisfies the following relationship:

[0172] ;

[0173] in, The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled into the waveguide by the illumination coupling region. This is the grating vector of the illumination coupling region.

[0174] It is understandable that the optical path of the illumination beam is as follows: after the illumination beam is emitted from the eye-tracking light source, it enters the waveguide through the illumination coupling area, and propagates within the waveguide towards the imaging coupling area through total internal reflection. After diffraction and deflection in the imaging coupling area, it propagates again through total internal reflection in the illumination coupling area, and is then coupled out to the human eye by the illumination coupling area. Since the wavelength of the imaging beam is within the visible range of the human eye, while the wavelength of the illumination beam is within the invisible range of the human eye, and the diffraction angle of the same grating is different for beams of different wavelengths and angles, the setting of the illumination coupling area can be adjusted so that the grating vector of the illumination coupling area satisfies the above relationship. This allows the illumination beam to not exit in the imaging coupling area, but to continue propagating in the waveguide after diffraction until it reaches the illumination coupling area and is coupled out to the human eye. In this way, the imaging coupling area can simultaneously achieve the functions of illumination and deflection, reducing the setting of the grating area in the waveguide and reducing the complexity of waveguide manufacturing.

[0175] Optionally, in one embodiment, in step 730, determining the grating clock angle and grating period of the illumination coupling region based on the grating vector of the illumination coupling region, the grating clock angle and grating period of the illumination coupling region are calculated according to the following formula:

[0176] ;

[0177] ;

[0178] in, The grating clock angle for the illumination coupling area. The grating period of the illumination coupling region, Let X be the grating vector along the X direction in the XY plane of the waveguide for the illumination coupling region. The grating vector of the illumination coupling region along the Y direction in the XY plane of the waveguide.

[0179] In this way, by calculating the grating clock angle and grating period of the illumination coupling region separately, the grating parameters of the illumination coupling grating in the illumination coupling region can be determined so as to fabricate the illumination coupling region on the waveguide.

[0180] Optionally, in one embodiment, the AR glasses eye-tracking design method further includes the steps of:

[0181] An imaging coupling region and an imaging transition region are formed on the waveguide, wherein the imaging coupling region, the imaging transition region, and the imaging coupling out region satisfy the following relationship:

[0182] ;

[0183] in, This is the wave vector of the imaging coupling region. This is the wave vector of the imaging transition region. This is the wave vector of the imaging coupling region.

[0184] like Figure 5 As shown, this configuration enables the imaging coupling region, imaging transition region, and imaging coupling out region to form a closed loop on the K-domain diagram.

[0185] Optionally, in one embodiment, the waveguide of the AR glasses of this application is a surface-embossed waveguide, a volume holographic waveguide, or a hybrid waveguide, wherein the imaging coupling grating of the imaging coupling region is a surface-embossed grating or a volume holographic grating. Furthermore, the period of all gratings in the waveguide is preferably between 230 nm and 900 nm.

[0186] The AR glasses eye-tracking design method of this application will be further described below with reference to specific embodiments.

[0187] like Figure 4 As shown, in the first embodiment of this application, the waveguide 20 is provided with an illumination coupling region 21, an illumination coupling region 22, an imaging coupling region 23, an imaging transition region 24, and an imaging coupling region 25, and the size of the AR glasses' eye box is set. , The vertical distance between the eyeball and the waveguide 20 =18mm, the main wavelengths of the image projected by the optical engine components are respectively... , , The corresponding refractive indices are respectively , , The field of view (FOV) projected by the optomechanical assembly is 28°, and the aspect ratio of the FOV is 16:9. The grating parameters through which the illumination beam passes are shown in the table below.

[0188]

[0189] The locations of the lighting input zone and the lighting output zone are shown in the table below.

[0190]

[0191] like Figure 5 The image shown is an imaging K-domain diagram of the waveguide 20 in the first embodiment of the AR glasses of this application. It can be seen from the diagram that the imaging beam emitted from the optomechanical component enters from the imaging coupling region 23, is deflected by the imaging transition region 24 to the imaging coupling out region 25, and finally deflected by the imaging coupling out region 25 back to the imaging coupling region 23, forming a closed loop. Figure 6 The diagram shows the illumination K-domain of the waveguide 20 in the first embodiment of the AR glasses of this application. The diagram shows the wave vector changes of the illumination beam emitted by the eye-tracking light source from the illumination coupling region 21 into the waveguide 20, through the imaging coupling region 25 deflection to the illumination coupling region 22, and finally through the illumination coupling region 22 to the human eye.

[0192] like Figure 9 , Figure 10 and Figure 11 As shown, in the second embodiment of this application, the waveguide 20 is provided with an illumination coupling region 21, an illumination coupling region 22, an imaging coupling region 23, an imaging transition region 24, and an imaging coupling region 25. The imaging transition region 24 includes a primary imaging transition region 241 and a secondary imaging transition region 242. The size of the AR glasses' eye box is set. , The vertical distance between the eyeball and the waveguide 20 =18mm. Waveguide 20 is a hybrid waveguide with folding and diffraction. A coated reflective surface is provided in the coupling region to improve coupling efficiency. The reflection wedge angle of the coupling region is... 29°. The dominant wavelengths of the image projected by the optomechanical components are respectively... , , The corresponding refractive indices are respectively , , The field of view (FOV) projected by the optomechanical assembly is 28°, and the aspect ratio of the FOV is 16:9. The grating parameters through which the illumination beam passes are shown in the table below.

[0193]

[0194] The locations of the lighting input zone and the lighting output zone are shown in the table below.

[0195]

[0196] like Figure 12As shown, in the third embodiment of this application, the waveguide 20 is provided with an illumination coupling region 21, an illumination coupling region 22, an imaging coupling region 23, an imaging transition region 24, and an imaging coupling region 25. The illumination coupling region 21 includes a first coupling region 211 and a second coupling region 212, and the illumination coupling region 22 includes a first coupling region 221 and a second coupling region 222. The size of the AR glasses' eye box is set. , The vertical distance between the eyeball and the waveguide 20 =18mm, the main wavelengths of the image projected by the optical engine components are respectively... , , The corresponding refractive indices are respectively , , The field of view (FOV) projected by the optomechanical components is 28°, and the aspect ratio of the FOV is 16:9. The grating parameters of the waveguide 20 of the AR glasses are shown in the table below. The AR glasses of this third embodiment have two sets of illumination coupling areas 21 and illumination coupling areas 22, used to couple two illumination beams to the human eye, forming two reflective bright spots on the eyeball, which is beneficial for matching some algorithms that require two reflective bright spots. The two illumination coupling areas 21 are coupled to different parts of the FOV of the light source, meaning the coupled beams have different vectors in the air, such as... Figure 12 As shown, the grating parameters through which the two illumination beams pass are as follows.

[0197]

[0198] The locations of the lighting input zone and the lighting output zone are shown in the table below.

[0199]

[0200] like Figure 13 The image shown is an imaging K-domain diagram of the waveguide 20 in the third embodiment of the AR glasses of this application. It can be seen from the diagram that the imaging beam emitted from the optomechanical component enters from the imaging coupling region 23, is deflected by the imaging transition region 24 to the imaging coupling out region 25, and finally deflected by the imaging coupling out region 25 back to the imaging coupling region 23, forming a closed loop. Figure 14 The diagram shows the illumination K-domain of the waveguide 20 optical path 1 in the third embodiment of the AR glasses of this application. It can be seen from the diagram the wave vector changes throughout the entire process: the illumination beam emitted from the eye-tracking light source enters the waveguide 20 from the first coupling region 211, is deflected by the imaging coupling region 25 to the first coupling region 221, and finally couples out to the human eye through the first coupling region 221. Figure 15The diagram shows the illumination K-domain of the waveguide 20 optical path 2 of the third embodiment of the AR glasses of this application. It can be seen from the diagram that the illumination beam emitted by the eye-tracking light source is coupled into the waveguide 20 from the second coupling region 212, deflected by the imaging coupling region 25 to the second coupling region 222, and finally coupled out to the human eye through the second coupling region 222.

[0201] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0202] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these all fall within the protection scope of the present invention. Therefore, the protection scope of this invention patent should be determined by the appended claims.

Claims

1. A design method for eye-tracking AR glasses, characterized in that, include: An illumination coupling region is set on the waveguide of the AR glasses, wherein the position coordinates of the illumination coupling region are ( , ,0); Based on the eye box parameters and exit pupil distance parameters of the AR glasses, as well as the setting parameters of the field of view angle projected by the optomechanical components of the AR glasses, an imaging coupling area is set on the waveguide; Based on the wave vector of the illumination beam emitted by the eye-tracking light source of the AR glasses and the grating vector of the illumination coupling area, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after coupling into the waveguide is determined. Based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, the position of the illumination transition region is determined in the imaging exit region, starting from the position coordinates of the illumination coupling region. The nearest intersection point between the illumination beam and the imaging exit region is the position coordinate of the illumination transition region. Based on the grating vector and position coordinates of the lighting transition zone, the settable range of the lighting coupling zone is determined, and at least one lighting coupling zone is set within the settable range of the lighting coupling zone; Based on the center coordinates of the illumination coupling region and the perpendicular distance between the eyeball and the XY plane of the waveguide, determine the target azimuth angle after the illumination beam is coupled out by the illumination coupling region; and The grating parameters of the illumination coupling grating are determined based on the target azimuth angle after the illumination beam is coupled out of the waveguide by the illumination coupling region. In the step of setting an imaging coupling region on the waveguide based on the eye box parameters, exit pupil distance parameters, and the field of view angle projected by the optomechanical components of the AR glasses, the size and position of the imaging coupling region are determined according to the following relationship: ； ； ;as well as ； Wherein, FOV is the field of view angle projected by the optical-mechanical component, and α is the aspect ratio of the field of view angle projected by the optical-mechanical component. This is the half-field angle in the horizontal direction of the imaging coupling region. Let L be the half-field angle in the vertical direction of the imaging coupling region, L be the length of the imaging coupling region, and W be the width of the imaging coupling region. The vertical distance from the eyeball to the waveguide. For the length of the eye box, The width of the eye box.

2. The AR glasses eye-tracking design method according to claim 1, characterized in that, The step of determining the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, based on the wave vector of the illumination beam emitted by the eye-tracking light source of the AR glasses and the grating vector of the illumination coupling area, includes: Based on the wave vector of the illumination beam emitted by the eye-tracking light source and the grating vector of the illumination coupling region, determine the wave vector of the illumination beam as it propagates within the waveguide after coupling; and Based on the wave vector of the illumination beam as it propagates in the waveguide after being coupled into it, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide is determined.

3. The AR glasses eye-tracking design method according to claim 2, characterized in that, In the step of determining the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide, based on the wave vector of the illumination beam emitted by the eye-tracking light source and the grating vector of the illumination coupling region, the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide is calculated according to the following relationship: ； in, The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being coupled into it.

4. The AR glasses eye-tracking design method according to claim 3, characterized in that, In the step of determining the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it has been coupled into the waveguide, based on the wave vector as the illumination beam propagates in the waveguide, the propagation azimuth angle of the illumination beam in the XY plane of the waveguide is calculated according to the following formula: ； in, The azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide. The X-axis component of the wave vector as the illumination beam propagates within the waveguide after being coupled into it. The Y-axis component of the wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being coupled into it.

5. The AR glasses eye-tracking design method according to claim 4, characterized in that, The step of determining the position of the illumination transition region in the imaging exit region based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide, taking the position coordinates of the illumination coupling region as the starting point, wherein the nearest intersection point between the illumination beam and the imaging exit region is the position coordinate of the illumination transition region includes the following steps: The four endpoints of the imaging coupling region are defined as (L / 2, W / 2, 0), (-L / 2, W / 2, 0), (-L / 2, -W / 2, 0), and (L / 2, -W / 2, 0), where L is the length of the imaging coupling region and W is the width of the imaging coupling region; and Based on the propagation azimuth angle of the illumination beam in the XY plane of the waveguide after it is coupled into the waveguide. The position coordinates of the illumination coupling area ( , Starting from (0), determine the nearest intersection point between the illumination beam and the imaging coupling region as ( , ,0).

6. The AR glasses eye-tracking design method according to any one of claims 3 to 5, characterized in that, The step of determining the settable range of the lighting coupling area based on the grating vector and position coordinates of the lighting transition area, and setting at least one lighting coupling area within the settable range of the lighting coupling area, includes the following steps: Set the grating vector of the illumination transition zone, and determine the wave vector of the illumination beam when it propagates in the waveguide after being coupled into the waveguide and the grating vector of the illumination transition zone. Based on the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region, determine the angle between the illumination beam after being deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide. Based on the position coordinates of the illumination transition region and the angle between the illumination beam after being turned by the illumination transition region and the X-axis of the waveguide's XY plane, the propagation range of the illumination beam after being turned by the illumination transition region is determined, thereby determining the settable range of the illumination coupling region; and Within the settable range of the lighting coupling zone, the coordinates of the center position of the lighting coupling zone are selected as ( , ,0).

7. The AR glasses eye-tracking design method according to claim 6, characterized in that, In the step of setting the grating vector of the illumination transition region, and determining the wave vector of the illumination beam propagating in the waveguide after being deflected by the illumination transition region, based on the wave vector of the illumination beam propagating in the waveguide after being coupled into the waveguide and the grating vector of the illumination transition region, the wave vector of the illumination beam propagating in the waveguide after being deflected by the illumination transition region is calculated according to the following relationship: ； in, This is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled into the waveguide by the illumination coupling region.

8. The AR glasses eye-tracking design method according to claim 7, characterized in that, In the step of determining the angle between the illumination beam after it has been deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide, based on the wave vector as the illumination beam propagates within the waveguide, the angle between the illumination beam after it has been deflected by the illumination deflection region and the X-axis of the XY plane of the waveguide is calculated according to the following formula: ； in, The angle between the illumination beam and the X-axis of the waveguide's XY plane after the illumination beam is deflected by the illumination deflection region. Let X be the X-axis component of the wave vector as the illumination beam propagates within the waveguide after being deflected by the illumination deflection region. The Y-axis component of the wave vector is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region.

9. The AR glasses eye-tracking design method according to claim 6, characterized in that, In the step of determining the target azimuth angle after the illumination beam is coupled out of the illumination coupling area based on the center position coordinates of the illumination coupling area and the vertical distance between the eyeball and the XY plane of the waveguide, the target azimuth angle after the illumination beam is coupled out of the illumination coupling area is calculated according to the following formula: ； ； in, The angle between the illumination beam after it is coupled out by the illumination coupling region and the XY plane of the waveguide. The angle between the projection of the illumination beam, after being coupled out by the illumination coupling region, into the XY plane of the waveguide and the X-axis. The X-axis coordinate of the center position of the lighting coupling area. The Y-axis coordinate of the center position of the lighting coupling area. This represents the vertical distance between the eyeball and the waveguide.

10. The AR glasses eye-tracking design method according to claim 7, characterized in that, The step of determining the grating parameters of the illumination coupling grating based on the target azimuth angle after the illumination beam is coupled out of the waveguide by the illumination coupling region includes the following steps: By converting the target azimuth angle after the illumination beam is coupled out of the illumination coupling region to the K-domain diagram, the wave vector after the illumination beam is coupled out of the waveguide by the illumination coupling region is determined. The grating vector of the illumination coupling region is determined based on the wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region; and Based on the grating vector of the illumination coupling area, determine the grating clock angle and grating period of the illumination coupling area.

11. The AR glasses eye-tracking design method according to claim 10, characterized in that, In the step of determining the wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region by converting the target azimuth angle of the illumination beam coupled out of the illumination coupling region to the K-domain diagram, the wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region is calculated according to the following relationship: ； in, The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. The angle between the illumination beam after it is coupled out by the illumination coupling region and the XY plane of the waveguide. The angle between the projection of the illumination beam, after being coupled out by the illumination coupling region, onto the XY plane of the waveguide and the X-axis.

12. The AR glasses eye-tracking design method according to claim 11, characterized in that, In the step of determining the grating vector of the illumination coupling region based on the wave vector of the illumination beam after being coupled out of the waveguide by the illumination coupling region, the grating vector of the illumination coupling region is calculated according to the following relationship: ； in, The grating vector of the illumination coupling region. The wave vector of the illumination beam after it has been coupled out of the waveguide by the illumination coupling region. This is the wave vector of the illumination beam as it propagates within the waveguide after being deflected by the illumination deflection region. This is the grating vector for the illumination transition zone. The wave vector of the illumination beam before it is coupled into the waveguide by the illumination coupling region. This is the grating vector of the illumination coupling zone.

13. The AR glasses eye-tracking design method according to claim 12, characterized in that, In the step of determining the grating clock angle and grating period of the illumination coupling region based on the grating vector of the illumination coupling region, the grating clock angle and grating period of the illumination coupling region are calculated according to the following formula: ； ； in, The grating clock angle for the illumination coupling area. The grating period of the illumination coupling region, Let X be the grating vector along the X direction in the XY plane of the waveguide for the illumination coupling region. The grating vector of the illumination coupling region along the Y direction in the XY plane of the waveguide.

14. The AR glasses eye-tracking design method according to any one of claims 1 to 5, characterized in that, The AR glasses eye-tracking design method further includes the following steps: An imaging coupling region and an imaging transition region are formed on the waveguide, wherein the imaging coupling region, the imaging transition region, and the imaging coupling out region satisfy the following relationship: ； in, This is the wave vector of the imaging coupling region. This is the wave vector of the imaging transition region. This is the wave vector of the imaging coupling region.

15. An AR glasses, characterized in that, The AR glasses are designed according to the AR glasses eye-tracking design method as described in any one of claims 1 to 14, including: The main body of the eyeglasses includes a frame and a pair of temples connected to the frame; A pair of optical-mechanical components, the two optical-mechanical components being respectively fixed to the two temples, for emitting imaging beams; A pair of eye-tracking light sources, each fixed to one of the two optomechanical components, for emitting an illumination beam; A pair of waveguides, fixed to the lens frame, for transmitting the imaging beam emitted by the optomechanical assembly and the image beam emitted by the eye-tracking light source in the form of total internal reflection; and A transmission component includes an illumination coupling grating, an illumination coupling grating, an imaging coupling grating, an imaging deflection grating, and an imaging coupling grating, respectively disposed on the waveguide, to form an illumination coupling region, an illumination coupling region, an imaging coupling region, an imaging deflection region, and an imaging coupling region on the waveguide, respectively; the illumination coupling region is used to couple the illumination beam emitted by the eye-tracking light source into the waveguide and cause the illumination beam to propagate toward the imaging coupling region by total internal reflection; the imaging coupling region is used to deflect the illumination beam and cause the illumination beam to propagate toward the illumination coupling region by total internal reflection; the illumination coupling region is used to allow the illumination beam to exit to the eyeball.

Images