Near-eye display device and eye tracking method

Abstract

An embodiment of the present invention provides a near-eye display device and an eye tracking method. The near-eye display device includes an optical waveguide, a light source assembly, an image acquisition unit, and a processing unit. The optical waveguide includes multiple first coupling structures, and the first coupling structures can switch between a coupling state and a non-coupling state; the light source assembly is used to emit infrared light toward the optical waveguide; the image acquisition unit is used to capture an image of the eye; the processing unit is electrically connected to the optical waveguide and the image acquisition unit, and is used to: determine the position of a preset eye area based on the image of the eye; determine a target coupling structure from multiple first coupling structures based on the position of the preset eye area; control the target coupling structure to be in a coupling state so that infrared light is coupled from the target coupling structure to the pupil area of ​​the eye; and determine the gaze direction of the eye based on the light spot formed by the infrared light in the image of the eye. The technical solution of the embodiment of the present invention aims to expand the range of eye tracking, so that infrared light is accurately transmitted to the pupil area of ​​the eye, and improve the accuracy of eye tracking.

Description

Technical Field

[0001] The present invention relates to the field of eye tracking technology, and in particular to a near-eye display device and an eye tracking method. Background Art

[0002] Near-eye display devices are usually equipped with an eye tracking function to achieve human-computer interaction by tracking the movement of the human eye. In the related art, infrared lamp beads are used to provide infrared light. The infrared light is reflected after irradiating the human eye, and the camera collects the image of the human eye, so as to judge the gaze direction of the human eye based on the collected image of the human eye and realize eye tracking. However, the infrared light irradiation range provided by the infrared lamp beads is fixed. When the human eye looks straight ahead, the infrared light irradiates the pupil of the human eye, forming a clear bright spot on the cornea. The camera can collect a clear image of the human eye. When the human eye looks at the edge, the infrared light irradiates the sclera and is diffusely reflected, forming speckles on the sclera, which makes it difficult to achieve high-precision eye tracking of the human eye image collected by the camera. In other words, the range of eye tracking is limited. Summary of the Invention

[0003] Embodiments of the present invention provide a near-eye display device and an eye tracking method, which aim to expand the range of eye tracking, enable infrared light to be accurately transmitted to the pupil area of ​​the eye, and improve the accuracy of eye tracking.

[0004] In a first aspect, an embodiment of the present invention provides a near-eye display device, including:

[0005] An optical waveguide comprising a plurality of first outcoupling structures, wherein the first outcoupling structures are switchable between an outcoupling state and a non-outcoupling state;

[0006] a light source assembly for emitting infrared light toward the light waveguide;

[0007] An image acquisition unit, configured to acquire images of the eye;

[0008] a processing unit, electrically connected to the optical waveguide and the image acquisition unit, the processing unit being configured to:

[0009] determining a position of a preset eye area according to the image of the eye;

[0010] Determining a target out-coupling structure among the plurality of first out-coupling structures according to the position of the preset eye area;

[0011] controlling the target outcoupling structure to be in the outcoupling state so that the infrared light is coupled out from the target outcoupling structure to the pupil area of ​​the eye;

[0012] The gaze direction of the eye is determined according to a light spot formed by the infrared light in the image of the eye.

[0013] Optionally, the preset eye area includes at least one of the following: a pupil area, a cornea area;

[0014] The distance between the position of the target outcoupling structure and the pupil area is smaller than the distance between other first outcoupling structures in the plurality of first outcoupling structures and the pupil area; and / or

[0015] The distance between the target outcoupling structure and the cornea region is smaller than the distance between other first outcoupling structures in the plurality of first outcoupling structures and the cornea region.

[0016] Optionally, the preset eye area includes the pupil area, cornea area and sclera area;

[0017] The determining the position of the preset eye area according to the eye image includes:

[0018] Determining the positional relationship between the pupil area, the cornea area, and the sclera area according to the image of the eye; and determining a target outcoupling structure from the plurality of first outcoupling structures according to the position of the preset eye area, comprising:

[0019] The target outcoupling structure is determined among the plurality of first outcoupling structures according to a positional relationship among the pupil area, the cornea area, and the sclera area.

[0020] Optionally, when determining a target out-coupling structure from among the plurality of first out-coupling structures according to the position of the preset eye area, the processing unit is configured to:

[0021] Based on the correspondence between the preset first outcoupling structures and the positions of the preset eye areas, a target outcoupling structure is determined among the plurality of first outcoupling structures according to the positions of the preset eye areas.

[0022] Optionally, the processing unit is further configured to control the outcoupling angle of the infrared light when the target outcoupling structure is in the outcoupling state.

[0023] Optionally, the first outcoupling structure includes a first electrode layer, a birefringent material layer and a second electrode layer, and the birefringent material layer is located between the first electrode layer and the second electrode layer;

[0024] The processing unit is electrically connected to the first electrode layer and the second electrode layer. The processing unit controls the first out-coupling structure to switch to the out-coupling state or the non-out-coupling state by adjusting the voltage applied to the first electrode layer and the second electrode layer.

[0025] Optionally, the first outcoupling structure further includes an alignment layer, and the alignment layer is provided between the first electrode layer and the birefringent material layer.

[0026] Optionally, the light source assembly is further configured to emit visible light toward the light waveguide, and the light waveguide further comprises:

[0027] The first waveguide body is provided with a second outcoupling structure and a plurality of the first outcoupling structures, wherein the second outcoupling structure is used to couple out the visible light coupled into the optical waveguide.

[0028] Optionally, the optical waveguide further comprises a first coupling structure, wherein the first coupling structure is provided on the first waveguide body, and the visible light and the infrared light emitted by the light source assembly are both coupled into the first waveguide body through the first coupling structure; or

[0029] The optical waveguide includes a first coupling structure and a second coupling structure, both of which are arranged on the first waveguide body. The visible light is coupled into the first waveguide body through the first coupling structure, and the infrared light is coupled into the first waveguide body through the second coupling structure.

[0030] Optionally, the first outcoupling structure and the second outcoupling structure are located on the same side of the first waveguide body, and a plurality of the first outcoupling structures are arranged around a central area of ​​the second outcoupling structure; or

[0031] The first out-coupling structure and the second out-coupling structure are located on opposite sides of the first waveguide body.

[0032] Optionally, the light source assembly is further configured to emit visible light toward the light waveguide, and the light waveguide further comprises:

[0033] A first waveguide body is provided with a first coupling-in structure and a second coupling-out structure, wherein the visible light is coupled into the first waveguide body through the first coupling-in structure, and is transmitted to the second coupling-out structure and then coupled out through the second coupling-out structure;

[0034] The second waveguide body is provided with a second coupling-in structure and a plurality of the first coupling-out structures, and the infrared light is coupled into the second waveguide body through the second coupling-in structure.

[0035] In a second aspect, an embodiment of the present invention further provides an eye tracking method for a near-eye display device, wherein the near-eye display device includes a light source assembly, an optical waveguide, and an image acquisition unit, wherein the optical waveguide includes a plurality of first outcoupling structures, each of which is switchable between an outcoupling state and a non-outcoupling state; the light source assembly is configured to emit infrared light toward the optical waveguide; and the image acquisition unit is configured to capture an image of the eye.

[0036] The eye tracking method comprises:

[0037] acquiring an image of the eye;

[0038] determining a position of a preset eye area according to the image;

[0039] Determining a target out-coupling structure among the plurality of first out-coupling structures according to the position of the preset eye area;

[0040] controlling the target outcoupling structure to be in the outcoupling state so that the infrared light is coupled out from the target outcoupling structure to the pupil area of ​​the eye;

[0041] acquiring an image of the eye again;

[0042] The gaze direction of the eye is determined according to the light spot formed by the infrared light in the re-acquired image.

[0043] Embodiments of the present invention provide a near-eye display device and eye tracking method. An image acquisition unit captures an image of the eye and determines the location of a preset eye region. A target outcoupling structure is then determined from multiple first outcoupling structures based on the location of the preset eye region. The target outcoupling structure is controlled to be in an outcoupling state, so that infrared light emitted by a light source assembly toward an optical waveguide is coupled out to the pupil region of the eye via the incoupling target outcoupling structure, forming a clear light spot on the cornea. This allows the eye's gaze direction to be determined based on an image of the eye with the light spot captured again by the image acquisition unit. The infrared light, after being transmitted within the optical waveguide and coupled out from the multiple first outcoupling structures, can cover a wider range, facilitating an increase in the range of eye tracking. The location of the preset eye region is determined based on the eye image captured by the image acquisition unit, allowing the optical waveguide to determine the target outcoupling structure based on the location of the preset eye region. This allows the target outcoupling structure to couple out infrared light, facilitating improved transmission position accuracy of the infrared light. The coupled infrared light is accurately transmitted to the cornea, forming a light spot there, enabling high-precision eye tracking. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0045] Figure 1 A schematic diagram of a light spot formed on the eye in the related art provided by the present invention;

[0046] Figure 2 A structural block diagram of a near-eye display device provided by one embodiment of the present invention;

[0047] Figure 3A schematic diagram of a light spot formed on the eye according to an embodiment of the present invention;

[0048] Figure 4 A diagram illustrating an application scenario of a near-eye display device provided by one embodiment of the present invention;

[0049] Figure 5 A diagram illustrating an application scenario of another near-eye display device provided by an embodiment of the present invention;

[0050] Figure 6 A schematic structural diagram of a first outcoupling structure provided in one embodiment of the present invention;

[0051] Figure 7 A schematic structural diagram of a near-eye display device provided by one embodiment of the present invention;

[0052] Figure 8 A top view of a near-eye display device provided by one embodiment of the present invention;

[0053] Figure 9 A top view of another near-eye display device provided by an embodiment of the present invention;

[0054] Figure 10 A schematic structural diagram of a near-eye display device provided by another embodiment of the present invention;

[0055] Figure 11 A schematic structural diagram of a near-eye display device provided in yet another embodiment of the present invention;

[0056] Figure 12 A flowchart of an eye tracking method for a near-eye display device is provided in accordance with an embodiment of the present invention.

[0057] Description of main reference numerals:

[0058] 100. Optical waveguide; 101. First outcoupling structure; 1011. First electrode layer; 1012. Birefringent material layer; 1013. Second electrode layer; 1014. Orientation layer; 102. First waveguide body; 103. Second outcoupling structure; 104. First incoupling structure; 105. Second incoupling structure; 106. Second waveguide body; 107. Turning grating structure; 200. Light source assembly; 300. Image acquisition unit; 301. Infrared camera; 400. Processing unit. DETAILED DESCRIPTION

[0059] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0060] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.

[0061] It should be understood that the terms used in this specification are only for the purpose of describing particular embodiments and are not intended to limit the present invention. As used in the specification and appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0062] The following embodiments of the present invention are described in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features therein may be combined with each other.

[0063] like Figure 1 As shown, in the related art, when the eye looks straight ahead, infrared light directly enters the eye, and the light spot formed on the cornea of ​​the eye is relatively clear. However, when the eye turns to look in other directions, for example, when it turns to the inner corner of the eye to look to the lower left, the cornea of ​​the eye rotates, and the infrared light still directly enters the eye, and is diffusely reflected by the sclera of the eye to form stray light. At the same time, less or even no light spot is formed on the cornea of ​​the eye, resulting in the inability to perform eye tracking, that is, the range of eye tracking is limited, or the accuracy of eye tracking is poor.

[0064] In order to solve the above problems, an embodiment of the present invention provides a near-eye display device, which may include augmented reality (AR) glasses, virtual reality (VR) glasses, AR helmets, VR helmets, etc., without specific limitation.

[0065] like Figures 2 to 5As shown, the near-eye display device includes an optical waveguide 100, a light source assembly 200, an image acquisition unit 300, and a processing unit 400. The optical waveguide 100 includes multiple first outcoupling structures 101, each of which is switchable between an outcoupling state and a non-outcoupling state. The light source assembly 200 is configured to emit infrared light toward the optical waveguide 100. The image acquisition unit 300 is configured to capture an image of the eye. The processing unit 400 is electrically connected to the optical waveguide 100 and the image acquisition unit 300. The processing unit 400 is configured to determine the location of a preset eye region based on the image of the eye. Based on the location of the preset eye region, a target outcoupling structure is identified from the multiple first outcoupling structures 101. The target outcoupling structure is controlled to be in an outcoupling state so that infrared light is coupled from the target outcoupling structure to the pupil region of the eye. The gaze direction of the eye is determined based on the light spot formed by the infrared light in the image of the eye.

[0066] Optionally, the target outcoupling structure may include one or more first outcoupling structures 101. For example, the optical waveguide 100 includes six first outcoupling structures 101, and the target outcoupling structure may be one, three, or four first outcoupling structures 101 determined according to the location of the preset eye area.

[0067] For example, when a user wears a near-eye display device, the image acquisition unit 300 captures an image of the eye and transmits it to the processing unit 400. The processing unit 400 can determine the location of a preset eye area based on the acquired eye image, such as the location of the pupil area or cornea area of ​​the eye. Then, based on the location of the preset eye area, it determines a target coupling structure among the multiple first coupling structures 101 and controls the target coupling structure to be in a coupling state. The infrared light emitted by the light source assembly 200 toward the optical waveguide 100 is coupled into the optical waveguide 100 and transmitted within the optical waveguide 100. Part of the infrared light transmitted to the target coupling structure can be coupled out to the pupil area of ​​the eye via the target coupling structure to form a clear light spot in the cornea area of ​​the eye. The image acquisition unit 300 captures the image of the eye again and transmits it to the processing unit 400. The processing unit 400 can determine the gaze direction of the eye based on the light spot formed by the infrared light in the image of the eye, thereby achieving eye tracking.

[0068] It can be understood that after the infrared light is transmitted within the optical waveguide 100 and coupled out from the multiple first coupling structures 101, it can cover a wider range. This helps ensure that when the pupil area of ​​the eye is at any position, the infrared light can be coupled out from the corresponding target coupling structure and transmitted to the pupil area of ​​the eye, thereby increasing the range of eye tracking. After determining the position of the preset eye area based on the image of the eye, the target coupling structure is determined based on the position of the preset eye area, so that the target coupling structure is in a coupling state and couples out the infrared light. This helps improve the position transmission accuracy of the coupled infrared light, allowing the coupled infrared light to be more accurately transmitted to the pupil area of ​​the eye, avoiding the infrared light being transmitted to the sclera area and reflected by the sclera to form stray light. The infrared light can form a clear light spot in the cornea area of ​​the eye. Accordingly, the light spot in the image of the eye captured by the image acquisition unit 300 is also clearer, which is conducive to achieving high-precision eye tracking.

[0069] Figure 3 FIG2 shows a schematic diagram of a light spot formed in the cornea area of ​​the eye when infrared light enters the eye during eye tracking in a near-eye display device according to an embodiment of the present invention. Figure 3 As shown, when the eyes look in different directions, for example, when looking straight ahead, or when turning to the inner corner of the eye to look to the lower left, after determining the position of the preset eye area according to the image of the eye, the target coupling structure determined according to the preset eye position is controlled to be in a coupling state, and the other first coupling structures are in a non-coupling state, so that the target coupling structure can couple the infrared light to the pupil area of ​​the eye, and can form a clear light spot in the cornea area of ​​the eye, thereby realizing high-precision eye tracking.

[0070] Exemplarily, the image acquisition unit 300 may include an infrared camera 301 , and an image of a light spot formed on the cornea of ​​the eye by the infrared camera 301 is acquired.

[0071] Exemplarily, the image acquisition unit 300 may include an infrared camera 301, which acquires an image of the eye through the infrared camera 301, determines the position of a preset area of ​​the eye based on the image of the eye, and acquires an image of the eye again through the infrared camera 301 to determine the gaze direction of the eye based on the light spot formed by the infrared light in the image of the eye acquired again.

[0072] Exemplarily, the image acquisition unit 300 may include a visible light camera and an infrared camera 301, the visible light camera includes a CCD (Charge Coupled Device) camera and a CMOS (Complementary Metal Oxide Semiconductor) camera, the image of the eye is acquired by the visible light camera, and the position of the preset area of ​​the eye is determined based on the image of the eye, and the image of the eye is acquired again by the infrared camera 301 to determine the gaze direction of the eye based on the light spot formed by the infrared light in the again acquired image of the eye.

[0073] like Figure 4 As shown, Figure 4 The dotted line in the figure shows the transmission path of the infrared light. In some embodiments, the optical waveguide 100 further includes a turning grating structure 107. After being transmitted to the turning grating structure 107, the infrared light coupled into the optical waveguide 100 can be reflected by the turning grating at different angles and along different paths, allowing the infrared light to be transmitted to multiple first outcoupling structures 101. This helps expand the range of infrared light coverage and enhances the scope of eye tracking.

[0074] For example, Figure 4 As shown, multiple first outcoupling structures 101 are arranged in an array along the left-right and front-to-back directions. A turning grating is located on the left side of the multiple first outcoupling structures 101. When infrared light is coupled into the optical waveguide 100 and then transmitted to the turning grating structure 107, a portion of the infrared light is reflected by the turning grating structure 107 and transmitted toward the multiple first outcoupling structures 101 on the right side. Another portion of the infrared light is reflected by the turning grating structure 107 and transmitted toward the back side of the turning grating structure 107. After passing through the turning grating structure 107 again, a portion of the infrared light is transmitted toward the multiple first outcoupling structures 101 on the right side. This allows the infrared light to transmit through each of the first outcoupling structures 101.

[0075] In some embodiments, the preset eye area includes at least one of the following: a pupil area and a corneal area. The distance between the position of the target outcoupling structure and the pupil area is less than the distance between other first outcoupling structures 101 in the plurality of first outcoupling structures 101 and the pupil area, and / or the distance between the position of the target outcoupling structure and the corneal area is less than the distance between other first outcoupling structures 101 in the plurality of first outcoupling structures 101 and the corneal area. It can be understood that when the eye looks in different directions, the pupil and the cornea of ​​the eye have a corresponding positional relationship. After the position of the corneal area is determined based on the image of the eye, the pupil area is also determined. Therefore, the target outcoupling structure can be directly determined based on the pupil area, and / or the target outcoupling structure can be determined based on the corneal area.

[0076] For example, the distance between the first outcoupling structure 101 and the pupil area can be represented by the distance between the geometric center of the first outcoupling structure 101 and the center of the pupil area. The distance between the first outcoupling structure 101 and the cornea area can be represented by the distance between the geometric center of the first outcoupling structure 101 and the center of the cornea area.

[0077] For example, Figure 5 The dotted line in the figure shows the transmission path of infrared light. Figure 5 As shown in Figure (A), the three first coupling structures 101 are arranged in sequence along the width direction of the eye. When the eye looks forward, the pupil area and cornea area of ​​the eye are located in the middle of the eye image. At this time, the distance from the first coupling structure 101 in the middle of the three first coupling structures 101 to the pupil area and cornea area of ​​the eye is smaller than the distance from the left and right first coupling structures 101 to the pupil area and cornea area of ​​the eye. The first coupling structure 101 in the middle can be used as the target coupling structure to be in the coupling state and couple the infrared light to the pupil area. Figure 5 As shown in Figure (B), when the eye looks to the left, the pupil area and cornea area of ​​the eye are located on the left side of the eye image. At this time, the distance between the first outcoupling structure 101 on the left and the pupil area and cornea area of ​​the eye is smaller than the distance between the two first outcoupling structures 101 on the right and the pupil area and cornea area of ​​the eye. The first outcoupling structure 101 on the left can be used as the target outcoupling structure to be in an outcoupling state and couple infrared light to the pupil area. Figure 5 As shown in Figure (C), when the eye looks to the right, the pupil area and cornea area of ​​the eye are located on the right side of the eye image. At this time, the distance between the first outcoupling structure 101 on the right side of the three first outcoupling structures 101 and the pupil area and cornea area of ​​the eye is smaller than the distance between the two first outcoupling structures 101 on the left side and the pupil area and cornea area of ​​the eye. The first outcoupling structure 101 on the right side can be used as a target outcoupling structure to be in an outcoupling state and couple the infrared light to the pupil area.

[0078] In some embodiments, the plurality of first outcoupling structures 101 are located on the same plane, and the target outcoupling structure can be determined according to the position of the projection of the preset eye area on the plane.

[0079] Illustratively, the distance between the position of the target outcoupling structure and the projection of the pupil area of ​​the eye on the plane is smaller than the distance between the other first outcoupling structures 101 and the projection of the pupil area of ​​the eye on the plane. Alternatively, the position of the target outcoupling structure and the projection of the pupil area of ​​the eye on the plane at least partially overlap.

[0080] In some embodiments, the preset eye region includes a pupil region, a corneal region, and a scleral region. Determining the position of the preset eye region based on an image of the eye includes: determining a positional relationship between the pupil region, the corneal region, and the scleral region based on the image of the eye. Determining a target outcoupling structure from a plurality of first outcoupling structures based on the position of the preset eye region includes: determining the target outcoupling structure from the plurality of first outcoupling structures based on the positional relationship between the pupil region, the corneal region, and the scleral region. It can be understood that the position of the image acquisition unit in the near-eye display device is fixed. When the eye looks in different directions, the relative relationship between the pupil area, the corneal area and the sclera area in the image of the eye captured by the image acquisition unit is different. Therefore, based on the positional relationship between the pupil area, the corneal area and the sclera area, the gaze direction of the eye can be preliminarily determined, that is, the position of the pupil area where the infrared light needs to be transmitted is determined, so that the target coupling structure can be determined from multiple first coupling structures, so that the infrared light coupled out by the target coupling structure can be accurately transmitted to the pupil area of ​​the eye, further determining the gaze direction of the eye and achieving high-precision eye tracking.

[0081] For example, Figure 5 The middle figure (A) shows an image of the eye when the eye is looking diagonally to the left front. In this image, the pupil region and the cornea region are located relatively in the middle of the sclera region. Figure 5 The middle figure (B) shows an image of the eye when the eye is looking straight ahead, in which the pupil region and the cornea region are located to the relative right of the sclera region. Figure 5 The middle figure (C) shows an image of the eye when the eye is looking diagonally to the right front. In this image, the pupil region and the cornea region are located to the right of the sclera region 23 .

[0082] In some embodiments, when the processing unit 400 determines a target outcoupling structure from among the plurality of first outcoupling structures 101 based on the location of the preset eye region, the processing unit 400 is configured to: determine the target outcoupling structure from among the plurality of first outcoupling structures 101 based on the location of the preset eye region, based on the correspondence between the preset first outcoupling structures 101 and the location of the preset eye region. It will be appreciated that, based on any position that the preset eye region can be located at, the processing unit 400 may pre-set one or more first outcoupling structures 101 corresponding thereto. After determining the location of the preset eye region based on the eye image, the pre-set one or more first outcoupling structures 101 may be used as the target outcoupling structure.

[0083] For example, if Figure 5As shown, assuming that three first coupling structures 101 are arranged in sequence along the width direction of the eye, the first coupling structure 101 on the left side may correspond to the position when the preset eye area moves to the left side in the width direction of the eye, the first coupling structure 101 in the middle may correspond to the position when the preset eye area moves to the middle side in the width direction of the eye, and the first coupling structure 101 on the right side may correspond to the position when the preset eye area moves to the right side in the width direction of the eye. After the position of the preset eye area is determined according to the image of the eye, if the preset eye area is located on the left side in the width direction of the eye, the first coupling structure 101 on the left side may be used as the target coupling structure. If the preset eye area is located in the middle side in the width direction of the eye, the first coupling structure 101 in the middle may be used as the target coupling structure. If the preset eye area is located on the right side in the width direction of the eye, the first coupling structure 101 on the right side may be used as the target coupling structure.

[0084] In some embodiments, the processing unit 400 is further configured to control the outcoupling angle of the infrared light coupled out by the target outcoupling structure when the target outcoupling structure is in an outcoupling state. It is understandable that the outcoupling angle of the infrared light is adjustable, so that the outcoupling infrared light can be transmitted over a wider range, which is beneficial to increasing the range of eye tracking, and the outcoupling angle of the infrared light can be adjusted according to the location of the target outcoupling structure and the location of the preset eye area, so that the infrared light falls more accurately on the preset eye area. In addition, the adjustable outcoupling angle of the infrared light can not only reduce the number of first outcoupling structures 101, but also reduce the restrictions on the position of the first outcoupling structure 101, so that the first outcoupling structure 101 can be adjusted according to the design requirements of other structures, so as to facilitate the design and preparation of near-eye display devices.

[0085] For example, Figure 4 As shown in Figures (A) and (B) in the figure, the target coupling structure may include multiple first coupling structures 101. By controlling the target coupling structure and adjusting the coupling angle of the infrared light, the multiple first coupling structures 101 in the target coupling structure couple the infrared light to different positions of the pupil area. For example, one beam of infrared light is coupled to the central area of ​​the pupil area, and the remaining multiple beams of infrared light are coupled to the peripheral area of ​​the pupil area, and the light spots formed by the multiple beams of infrared light are arranged in a ring to improve the accuracy of eye tracking.

[0086] like Figure 6As shown, in some embodiments, the first outcoupling structure 101 includes a first electrode layer 1011, a birefringent material layer 1012, and a second electrode layer 1013, wherein the birefringent material layer 1012 is located between the first electrode layer 1011 and the second electrode layer 1013. The processing unit 400 is electrically connected to the first electrode layer 1011 and the second electrode layer 1013. The processing unit 400 controls the first outcoupling structure 101 to switch between the outcoupling state and the non-outcoupling state by adjusting the voltage applied to the first electrode layer 1011 and the second electrode layer 1013.

[0087] For example, Figure 6 As shown in Figure (A), the first electrode layer 1011 and the second electrode layer 1013 are not connected to voltage. At this time, the birefringent material does not rotate, and the first outcoupling structure 101 is in a non-outcoupling state, unable to diffract infrared light, and the infrared light cannot be coupled out. Figure 6 As shown in Figure (B), the first electrode layer 1011 and the second electrode layer 1013 are connected to a voltage, and the birefringent material rotates under the action of the electric field formed by the first electrode layer 1011 and the second electrode layer 1013, so that the first coupling-out structure 101 switches to the coupling-out state, thereby being able to diffract the infrared light and couple the infrared light out to the pupil area of ​​the eye.

[0088] Exemplarily, the birefringent material includes an electro-optic birefringent material, a magneto-optic birefringent material, or an acousto-optic birefringent material.

[0089] Furthermore, by adjusting the voltage applied to the first electrode layer 1011 and the second electrode layer 1013 , the outcoupling angle of the infrared light coupled out by the target outcoupling structure can also be controlled.

[0090] Furthermore, if Figure 6 As shown, the first outcoupling structure 101 further includes an orientation layer 1014, which is disposed between the first electrode layer 1011 and the birefringent material layer 1012. The orientation layer 1014 guides the birefringent material to align in a specific direction and angle, so that the birefringent material responds uniformly to the electric fields of the first electrode layer 1011 and the second electrode layer 1013, thereby facilitating outcoupling of infrared light toward the pupil region of the eye.

[0091] Specifically, the alignment layer 1014 has a plurality of grooves arranged at intervals, and the birefringent material can be evenly arranged along the extending direction of the grooves.

[0092] In some embodiments, the diffraction period of different first outcoupling structures 101 can be changed by changing the refractive index of the birefringent material in the birefringent material layer 1012 in different first outcoupling structures 101, or the refractive index of the material of the orientation layer 1014, so that different first outcoupling structures 101 can couple out infrared light at different outcoupling angles when in the outcoupling state.

[0093] In some embodiments, the light source assembly 200 is further configured to emit visible light toward the optical waveguide 100. The optical waveguide 100 further includes a second outcoupling structure 103 configured to outcouple the visible light emitted from the optical waveguide 100. The outcoupling visible light can be transmitted to the eye or a predetermined component, allowing the user to see the displayed virtual image.

[0094] It is understood that the first outcoupling structure 101 and the second outcoupling structure 103 are different. The first outcoupling structure 101 can couple out infrared light, while the second outcoupling structure 103 can couple out visible light. Infrared light can be light with a wavelength range of 780 nm to 940 nm, and visible light can be light with a wavelength range of 400 nm to 760 nm.

[0095] like Figure 7 As shown, Figure 7 The dashed line in FIG. 1 shows the transmission path of infrared light, and the dotted line shows the transmission path of visible light. In some embodiments, the light source assembly 200 is configured to emit visible light and infrared light toward the optical waveguide 100. The optical waveguide 100 further includes a first waveguide body 102, which is provided with a second outcoupling structure 103 and a plurality of first outcoupling structures 101. The second outcoupling structure 103 is configured to outcouple the visible light coupled into the optical waveguide 100.

[0096] It can be understood that the first outcoupling structure 101 and the second outcoupling structure 103 are both arranged on the first waveguide body 102, and the visible light and the infrared light are both coupled into the first waveguide body 102 and transmitted in the first waveguide body 102, and then pass through the second outcoupling structure 103 and the first outcoupling structure 101 respectively. In this way, the structural multiplexing of the first waveguide body 102 is realized, the volume of the optical waveguide 100 is controlled, and the miniaturized design of the near-eye display device is realized.

[0097] It is worth noting that the near-eye display device can only obtain images of the human left eye / right eye and couple infrared light only to the human left eye / right eye, or it can simultaneously obtain images of the human left eye and right eye and simultaneously couple infrared light to the human left eye and right eye.

[0098] Exemplarily, the optical waveguide 100 includes a first waveguide unit and a second waveguide unit, each of which includes a first waveguide body 102, a second outcoupling structure 103 provided on the first waveguide body 102, and a plurality of first outcoupling structures 101 provided on the first waveguide body 102. The first waveguide unit and the second waveguide unit are respectively provided corresponding to the left eye and the right eye of the human body, and simultaneously couple visible light and infrared light for the left eye and the right eye of the human body.

[0099] Combine Figure 8 and Figure 9As shown, in an optional embodiment, the first outcoupling structure 101 and the second outcoupling structure 103 are located on the same side of the first waveguide body 102, and multiple first outcoupling structures 101 are arranged around the central area of ​​the second outcoupling structure 103. It can be understood that the multiple first outcoupling structures 101 are arranged around the central area of ​​the second outcoupling structure 103 so that the infrared light coupled out by the multiple first outcoupling areas can be transmitted to the pupil area of ​​the eye when the preset eye area moves to any position.

[0100] Optionally, the first waveguide body 102 has a side facing the eye and a side facing away from the eye, and the first outcoupling structure 101 and the second outcoupling structure may be located simultaneously on the side of the first waveguide body 102 facing the eye, or simultaneously on the side of the first waveguide body 102 facing away from the eye.

[0101] Optionally, the first outcoupling structure 101 may be a reflective diffraction structure or a transmissive diffraction structure, and the second outcoupling structure 103 may be a reflective diffraction structure or a transmissive diffraction structure, which can be specifically adjusted according to the setting positions of the first outcoupling structure 101 and the second outcoupling structure 103.

[0102] An exemplary example, Figure 8 As shown, there are multiple second outcoupling structures 103, and the multiple second outcoupling structures 103 are arranged in a rectangular array. The multiple second outcoupling structures 103 form a central area and a peripheral area located outside the central area. The multiple first outcoupling structures 101 are interspersed in the multiple second outcoupling structures 103 to ensure the integrity of the image displayed by the near-eye display device. Multiple first coupling structures 101 are arranged around the central area of ​​multiple second coupling structures 103. When the preset eye area moves to the upper part in the height direction of the eye, the two upper first coupling structures 101 can couple out infrared light to the pupil area of ​​the eye. When the preset eye area moves to the lower part in the height direction of the eye, the two lower first coupling structures 101 can couple out infrared light to the pupil area of ​​the eye. When the preset eye area moves to the left side in the width direction of the eye, the two first coupling structures 101 on the left side can couple out infrared light to the pupil area of ​​the eye. When the preset eye area moves to the right side in the width direction of the eye, the two first coupling structures 101 on the right side can couple out infrared light to the pupil area of ​​the eye.

[0103] Another exemplary example is Figure 9 As shown, multiple first outcoupling structures 101 are arranged around the second outcoupling structure 103, and the multiple first outcoupling structures 101 can be closely arranged. At this time, the distance between the multiple first outcoupling structures 101 and the eyes is relatively far. The close arrangement of the multiple first outcoupling structures 101 can ensure that when the preset area of ​​the eye moves to any position, the infrared light can be coupled out to the pupil area of ​​the eye.

[0104] like Figure 8 As shown, in an optional embodiment, the optical waveguide 100 further includes a first coupling structure 104, which is provided on the first waveguide body 102, and the visible light and infrared light emitted by the light source assembly 200 are coupled into the first waveguide body 102 through the first coupling structure 104.

[0105] Figure 9 As shown, in another optional embodiment, the optical waveguide 100 includes a first coupling structure 104 and a second coupling structure 105, both of which are arranged on the first waveguide body 102, and visible light is coupled into the first waveguide body 102 through the first coupling structure 104, and infrared light is coupled into the first waveguide body 102 through the second coupling structure 105.

[0106] For example, the first coupling structure 104 and the second coupling structure 105 may be located on the same side of the first waveguide body 102 , or the first coupling structure 104 and the second coupling structure 105 may be located on opposite sides of the first waveguide body 102 .

[0107] For example, when the first coupling structure 104 and the second coupling structure 105 are located on the same side of the first waveguide body 102, the second coupling decoupling strand may be located on the periphery of the first coupling structure 104, and as shown in FIG. Figure 7 As shown, there can be a plurality of second coupling structures 105 , and the plurality of second coupling structures 105 are disposed around the periphery of the first coupling structure 104 and are spaced apart.

[0108] Exemplarily, the first coupling structure 104 may be a reflective diffraction structure or a transmissive diffraction structure, and the second coupling structure 105 may be a reflective diffraction structure or a transmissive diffraction structure, which can be specifically adjusted according to the setting positions of the first coupling structure 104 and the second coupling structure 105.

[0109] like Figure 10 As shown, Figure 10 The dashed line in FIG shows the transmission path of infrared light, and the dotted line shows the transmission path of visible light. In another optional embodiment, the first outcoupling structure 101 and the second outcoupling structure 103 are located on opposite sides of the first waveguide body 102. It is understood that the first outcoupling structure 101 and the second outcoupling structure 103 can be located on the side of the first waveguide body 102 facing the eye and the side facing away from the eye, respectively.

[0110] For example, Figure 10As shown, the first outcoupling structure 101 is located on the side of the first waveguide body 102 away from the eye, and the second outcoupling structure 103 is located on the side of the first waveguide body 102 facing the eye. At this time, the first outcoupling structure 101 can be a reflective diffraction structure, so that after the infrared light is transmitted to the first outcoupling structure 101 in a direction away from the eye, it is diffracted by the first outcoupling structure 101, so that the infrared light is coupled out of the first waveguide body 102 and transmitted to the eye. The second outcoupling structure 103 can be a transmissive diffraction structure, so that after the visible light is transmitted to the second outcoupling structure 103 in a direction toward the eye, it is diffracted by the second outcoupling structure 103, so that the visible light is coupled out of the first waveguide body 102 and transmitted to the eye.

[0111] Furthermore, the first outcoupling structure 101 can be a structure that couples out infrared light through visible light, and / or the second outcoupling structure 103 can be a structure that couples out visible light through infrared light. In this way, the position setting of the first outcoupling structure 101 and the second outcoupling structure 103 is more flexible, and it is beneficial for the first outcoupling structure 101 to couple out infrared light to the pupil area of ​​the eye.

[0112] For example, when the first outcoupling structure 101 and the second outcoupling structure 103 are located on opposite sides of the first waveguide body 102, the first outcoupling structure 101 may be partially projected onto the second outcoupling structure 103. Figure 8 As shown, the first outcoupling structure 101 is located on the side of the first waveguide body 102 away from the eye, and the second outcoupling structure 103 is located on the side of the first waveguide body 102 facing the eye. The first outcoupling structure 101 can be partially projected onto the second outcoupling structure 103. At this time, the second outcoupling structure 103 can be a structure that transmits infrared light and couples out visible light, so that the infrared light diffracted and coupled out by the first outcoupling structure 101 can be transmitted to the pupil area of ​​the eye after passing through the second outcoupling structure 103.

[0113] like Figure 11 As shown, in some embodiments, the light source assembly 200 is further configured to emit visible light toward the optical waveguide 100. The optical waveguide 100 further includes a first waveguide body 102 and a second waveguide body 106. The first waveguide body 102 is provided with a first coupling-in structure 104 and a second coupling-out structure 103. Visible light is coupled into the first waveguide body 102 via the first coupling-in structure 104, transmitted to the second coupling-out structure 103, and then coupled out via the second coupling-out structure 103. The second waveguide body 106 is provided with a second coupling-in structure 105 and a plurality of first coupling-out structures 101. Infrared light is coupled into the second waveguide body 106 via the second coupling-in structure 105.

[0114] Exemplarily, the first outcoupling structure 101 and the second outcoupling structure 103 are respectively arranged on different waveguide bodies. The structures of the first waveguide body 102 and the second waveguide body 106 can be adjusted according to actual needs to change the transmission path of visible light in the first waveguide body 102 and the transmission path of infrared light in the second waveguide body 106.

[0115] For example, Figure 11 As shown, the first waveguide body 102 and the second waveguide body 106 are spaced apart along the visual direction of the eye, the second outcoupling structure 103 can be provided on the side of the first waveguide body 102 facing the eye, or on the side away from the eye, and the first outcoupling structure 101 can be provided on the side of the second waveguide body 106 facing the first waveguide body 102, or on the side away from the first waveguide body 102.

[0116] Please refer to Figure 12 An embodiment of the present invention provides an eye tracking method for a near-eye display device. The eye tracking method can be applied to a near-eye display device, which may be AR glasses, VR glasses, an AR helmet, a VR helmet, or the like. Specifically, the near-eye display device includes a light source assembly, an optical waveguide, and an image acquisition unit. The optical waveguide includes a plurality of first outcoupling structures, and the first outcoupling structures are capable of switching between an outcoupling state and a non-outcoupling state. The light source assembly is used to emit infrared light toward the optical waveguide, and the image acquisition unit is used to capture an image of the eye. The eye tracking method for a near-eye display device includes steps S101 to S106.

[0117] Step S101: Acquire an image of the eye.

[0118] For example, the image acquisition unit in the near-eye display device can capture the user's eyes and obtain an image of the eyes.

[0119] Step S102: Determine the position of the preset eye area according to the image.

[0120] Exemplarily, the preset eye area includes at least one of a pupil area and a cornea area. Specifically, the range of the preset eye area in the image can be determined by performing image recognition on the image, and the position of the preset eye area in the coordinate system of the image acquisition unit or in real coordinates can be determined.

[0121] Step S103 : determining a target outcoupling structure from a plurality of first outcoupling structures according to the position of the preset eye area.

[0122] Exemplarily, the target outcoupling structure may be determined based on the distance between the position of the preset eye area and a plurality of first outcoupling structures, or the target outcoupling structure may be determined based on the correspondence between the preset first outcoupling structures and the position of the preset eye area.

[0123] Step S104 : controlling the target outcoupling structure to be in an outcoupling state, so that the infrared light is coupled out from the target outcoupling structure to the pupil area of ​​the eye.

[0124] Step S105: Acquire the eye image again.

[0125] Exemplarily, the image acquisition unit may include an infrared camera, which is used to acquire an image of a light spot formed by infrared light on the cornea of ​​the eye.

[0126] Step S106: Determine the gaze direction of the eye based on the light spot formed by the infrared light in the re-acquired image.

[0127] In the eye tracking method for a near-eye display device provided in the above-mentioned embodiment, the infrared light, after being transmitted within the optical waveguide and coupled out from the multiple first coupling structures, can cover a wider range. This helps ensure that when the pupil area of ​​the eye is at any position, the infrared light can be coupled out from the corresponding target coupling structure and transmitted to the pupil area of ​​the eye, thereby increasing the range of eye tracking. After determining the position of the preset eye area based on the image of the eye, the target coupling structure is determined based on the position of the eye area, so that the target coupling structure is in a coupling state and couples out the infrared light. This helps improve the position transmission accuracy of the coupled infrared light, allowing the coupled infrared light to be more accurately transmitted to the pupil area of ​​the eye, thereby forming a clear light spot on the cornea of ​​the eye. Accordingly, the light spot in the image of the eye captured by the image acquisition unit is also clearer, which helps achieve high-precision eye tracking.

[0128] In some embodiments, image recognition can be performed on the re-acquired image to determine the position of the pupil area in the image and the position of the light spot in the image, and based on the position of the pupil area in the image and the position of the light spot in the image, the position offset of the light spot relative to the user's pupil can be determined, thereby determining the gaze direction of the eye and achieving eye tracking.

[0129] Furthermore, if the image includes multiple light spots, the positional offset of each light spot relative to the pupil region can be determined, and the gaze direction can be determined based on the average of the multiple offsets. Of course, this is not limiting. If the image includes multiple light spots, the average of the positions of all light spots in the image can also be determined. Based on the average of the positions of all light spots in the image and the position of the pupil region in the image, the positional offset of the light spots relative to the user's pupil region is determined, thereby determining the user's eye movement information.

[0130] In some embodiments, the image acquisition unit can obtain a visible light image of the eye to identify a preset eye area based on the visible light image and determine the location of the preset eye area. Exemplarily, the light source assembly is further configured to emit visible light toward the optical waveguide, and the visible light is coupled into the optical waveguide and then coupled out to the eye, so that the user can view the image displayed by the near-eye display device. When the visible light is coupled out to the eye, the image acquisition unit can obtain an image of the eye under visible light. After the processing unit obtains the visible light image, it determines the preset eye area through image recognition and determines the location of the preset eye area.

[0131] In some embodiments, it is determined whether the eye is in a gaze state, a motion state, or a scan state by comparing images collected at different time frames.

[0132] Exemplarily, when the difference between the position offsets corresponding to images captured by at least two adjacent time frames is less than or equal to a first preset difference, it is determined that the user's eyes are in a gaze state. For example, it can be determined that the user is gazing at or focusing on a certain position on the screen displayed by the near-eye display device.

[0133] Exemplarily, when the position offset corresponding to the images of at least two adjacent time frames is greater than a first preset difference and less than or equal to a second preset difference, it is determined that the user's eyes are in a moving tracking state. For example, it can be determined that the user is tracking or observing a moving object on the screen of a near-eye display device.

[0134] Exemplarily, when the position offset corresponding to the images of at least two adjacent time frames is greater than a second preset difference, it is determined that the user's eyes are in a scanning state. For example, it can be determined that the user is scanning different positions of the screen of the near-eye display device.

[0135] It is understood that by determining the gaze direction and implementing eye tracking, the near-eye display device can be adjusted based on the user's eye state to achieve various interactive and perceptual functions. For example, the human-computer interaction interface of the near-eye display device can be designed based on the user's eye state, the user's psychological usage of the near-eye display device can be studied based on the user's eye state, and the driver's driving performance can be monitored based on the driver's eye state, etc., without limitation.

[0136] The method of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multi-processor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

[0137] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The method implemented when the computer program is executed by a processor can refer to the various embodiments of the eye tracking method for a near-eye display device of the present application.

[0138] The computer-readable storage medium may be an internal storage unit of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the near-eye display device. The computer-readable storage medium may also be an external storage device of the near-eye display device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash card, etc., equipped on the near-eye display device.

[0139] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware embodiment, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As is well known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable, and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media generally embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0140] It should be understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system that includes a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements that are inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system that includes the element.

[0141] The serial numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The above description is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be based on the scope of protection of the claims.

Claims

1. A near-eye display device, characterized in that: include: An optical waveguide comprising a plurality of first outcoupling structures, wherein the first outcoupling structures are switchable between an outcoupling state and a non-outcoupling state; a light source assembly for emitting infrared light toward the light waveguide; An image acquisition unit, configured to acquire images of the eye; a processing unit, electrically connected to the plurality of first coupling-out structures and the image acquisition unit, the processing unit being configured to: determining a position of a preset eye area according to the image of the eye; Determining a target out-coupling structure among the plurality of first out-coupling structures according to the position of the preset eye area; controlling the target outcoupling structure to be in the outcoupling state so that the infrared light is coupled out from the target outcoupling structure to the pupil area of ​​the eye; The gaze direction of the eye is determined according to a light spot formed by the infrared light in the image of the eye.

2. The near-eye display device according to claim 1, wherein: The preset eye area includes at least one of the following: a pupil area and a cornea area; The distance between the position of the target outcoupling structure and the pupil area is smaller than the distance between other first outcoupling structures in the plurality of first outcoupling structures and the pupil area; and / or The distance between the target outcoupling structure and the cornea region is smaller than the distance between other first outcoupling structures in the plurality of first outcoupling structures and the cornea region.

3. The near-eye display device according to claim 1, wherein: The preset eye area includes the pupil area, cornea area and sclera area; The determining the position of the preset eye area according to the eye image includes: determining a positional relationship among the pupil area, the cornea area, and the sclera area based on the image of the eye; The step of determining a target out-coupling structure from among the plurality of first out-coupling structures according to the position of the preset eye area includes: The target outcoupling structure is determined among the plurality of first outcoupling structures according to a positional relationship among the pupil area, the cornea area, and the sclera area.

4. The near-eye display device according to claim 1, wherein: The processing unit is configured to, when determining a target out-coupling structure from among the plurality of first out-coupling structures according to the position of the preset eye area,: Based on the correspondence between the preset first outcoupling structures and the positions of the preset eye areas, a target outcoupling structure is determined among the plurality of first outcoupling structures according to the positions of the preset eye areas.

5. The near-eye display device according to claim 1, wherein: The processing unit is further configured to control the outcoupling angle of the infrared light when the target outcoupling structure is in the outcoupling state.

6. The near-eye display device according to claim 1, wherein: The first outcoupling structure includes a first electrode layer, a birefringent material layer and a second electrode layer, wherein the birefringent material layer is located between the first electrode layer and the second electrode layer; The processing unit is electrically connected to the first electrode layer and the second electrode layer. The processing unit controls the first out-coupling structure to switch to the out-coupling state or the non-out-coupling state by adjusting the voltage applied to the first electrode layer and the second electrode layer.

7. The near-eye display device according to claim 6, wherein: The first outcoupling structure further includes an alignment layer, and the alignment layer is provided between the first electrode layer and the birefringent material layer.

8. The near-eye display device according to claim 1, wherein: The light source assembly is further configured to emit visible light toward the light waveguide, wherein the light waveguide further comprises: The first waveguide body is provided with a second outcoupling structure and a plurality of the first outcoupling structures, wherein the second outcoupling structure is used to couple out the visible light coupled into the optical waveguide.

9. The near-eye display device according to claim 8, wherein: The optical waveguide further includes a first coupling structure, which is provided on the first waveguide body, and the visible light and the infrared light emitted by the light source assembly are coupled into the first waveguide body through the first coupling structure; or The optical waveguide includes a first coupling structure and a second coupling structure, both of which are arranged on the first waveguide body. The visible light is coupled into the first waveguide body through the first coupling structure, and the infrared light is coupled into the first waveguide body through the second coupling structure.

10. The near-eye display device according to claim 8, wherein: The first outcoupling structure and the second outcoupling structure are located on the same side of the first waveguide body, and a plurality of the first outcoupling structures are arranged around a central area of ​​the second outcoupling structure; or The first out-coupling structure and the second out-coupling structure are located on opposite sides of the first waveguide body.

11. The near-eye display device according to claim 1, wherein: The light source assembly is further configured to emit visible light toward the light waveguide, wherein the light waveguide further comprises: A first waveguide body is provided with a first coupling-in structure and a second coupling-out structure, wherein the visible light is coupled into the first waveguide body through the first coupling-in structure, and is transmitted to the second coupling-out structure and then coupled out through the second coupling-out structure; The second waveguide body is provided with a second coupling-in structure and a plurality of the first coupling-out structures, and the infrared light is coupled into the second waveguide body through the second coupling-in structure.

12. An eye tracking method for a near-eye display device, characterized in that: The near-eye display device includes a light source assembly, an optical waveguide, and an image acquisition unit. The optical waveguide includes a plurality of first outcoupling structures, and the first outcoupling structures are switchable between an outcoupling state and a non-outcoupling state. The light source assembly is configured to emit infrared light toward the optical waveguide. The image acquisition unit is configured to acquire an image of the eye. The eye tracking method comprises: acquiring an image of the eye; determining a position of a preset eye area according to the image; Determining a target out-coupling structure among the plurality of first out-coupling structures according to the position of the preset eye area; controlling the target outcoupling structure to be in the outcoupling state so that the infrared light is coupled out from the target outcoupling structure to the pupil area of ​​the eye; acquiring an image of the eye again; The gaze direction of the eye is determined according to the light spot formed by the infrared light in the re-acquired image.

Images