Augmented reality device and method for detecting a user's line of sight
By using a combination of a first polarizing plate and a second polarizing plate in the augmented reality device, the problem of external light noise interference is solved, and the accuracy of line-of-sight detection is improved.
Patent Information
- Application Number
- CN202480086373.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-01-31
- Filing Date
- 2024-11-18
- Publication Date
- 2026-08-25
AI Technical Summary
In existing augmented reality devices, because the camera faces outwards from the glasses, external light acts as noise interference, affecting the accuracy of gaze detection.
By using a combination of a first polarizing plate and a second polarizing plate, the noise light is polarized and blocked from reaching the light receiver, and the user's line of sight information is obtained through the light receiver.
It effectively eliminates external light noise interference and improves the accuracy of line-of-sight detection.
Smart Images

Figure CN122641807A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to an augmented reality (AR) apparatus and method for detecting a user's gaze, and more specifically, to an AR apparatus and method for removing noise from external light while detecting a user's gaze. Background Technology
[0002] Augmented reality (AR) refers to technologies used to display images by overlaying virtual images onto real-world objects in physical space. AR devices can be worn on a user's face or head to allow the user to view both real-world scenes and virtual images. For example, glasses-type devices can use see-through displays such as waveguides.
[0003] With the latest developments in AR technology, wearable devices of various shapes are being released or are about to be released. For example, in new eyeglass-style devices, a camera can be placed on the temples of the glasses to track the user's gaze. In this case, since the camera faces outwards from the glasses, external light from outside the glasses can act as noise. As the amount of noise increases, the accuracy of gaze detection using the camera deteriorates. Summary of the Invention
[0004] Solution to the problem According to one aspect of this disclosure, an augmented reality (AR) device is provided, comprising: a waveguide; a support portion configured to attach the AR device to a user's face; a light receiver disposed in the support portion; at least one processor configured to obtain the user's gaze information based on light reflected from the user's eyeball and obtained by the light receiver; a first polarizer configured to polarize noise light traveling toward the light receiver; and a second polarizer configured to block the polarized noise light from the first polarizer from reaching the light receiver.
[0005] According to another aspect of this disclosure, a method for tracking a user's gaze is provided, the method comprising: obtaining gaze information of the user based on light reflected from the user's eyeball and obtained by a light receiver; polarizing noise light traveling toward the light receiver by a first polarizing plate; and blocking the linearly polarized noise light from reaching the light receiver by a second polarizing plate.
[0006] According to another aspect of this disclosure, a computer-readable recording medium is provided, on which is recorded a program for performing a method on a computer comprising the following steps: obtaining gaze information of a user based on light reflected from a user's eyeball and obtained by a light receiver; polarizing noise light traveling toward the light receiver by a first polarizing plate; and blocking the linearly polarized noise light from reaching the light receiver by a second polarizing plate. Attached Figure Description
[0007] Figure 1 This is a diagram illustrating an example of an augmented reality (AR) device according to an embodiment of the present disclosure.
[0008] Figure 2 This is a block diagram of an AR device according to an embodiment of the present disclosure.
[0009] Figure 3 This is a conceptual diagram for describing in detail the configuration of an AR device according to embodiments of the present disclosure.
[0010] Figure 4 This is a conceptual diagram illustrating a method for blocking noise through the configuration of an AR device according to embodiments of the present disclosure.
[0011] Figure 5 This is a conceptual diagram illustrating a process for blocking noise according to embodiments of the present disclosure.
[0012] Figure 6 This is a conceptual diagram illustrating a method for blocking noise in an AR device according to embodiments of the present disclosure.
[0013] Figure 7 This is a conceptual diagram illustrating the configuration of an AR device according to embodiments of the present disclosure.
[0014] Figure 8 This is a conceptual diagram illustrating the configuration of an AR device according to embodiments of the present disclosure.
[0015] Figure 9a This is a conceptual diagram illustrating a method for blocking noise through the configuration of an AR device according to embodiments of the present disclosure.
[0016] Figure 9b This is a conceptual diagram illustrating a method for ensuring a user's field of vision through the configuration of an AR device according to embodiments of the present disclosure.
[0017] Figure 10 This is a conceptual diagram illustrating a process for blocking noise according to embodiments of the present disclosure.
[0018] Figure 11 This is a flowchart describing the operation of blocking noise according to embodiments of the present disclosure. Detailed Implementation
[0019] In the following description, the present disclosure will be given more fully with reference to the accompanying drawings so that those skilled in the art can easily perform embodiments of the present disclosure. However, the present disclosure may be implemented in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, for clarity, portions unrelated to embodiments of the present disclosure are not shown, and throughout the disclosure, the same reference numerals denote the same elements.
[0020] Throughout this specification, it will also be understood that when an element is referred to as being "connected to" or "combined" with another element, it may be directly connected to or combined with the other element, or it may be electrically connected to or combined with the other element by inserting an intermediate element between them. Furthermore, when a component is referred to as "comprising" or "including" an element, the component may also include other elements, without excluding other elements, unless there is a specific description to the contrary.
[0021] The embodiments described herein may be described and illustrated in terms of blocks that perform one or more of the described functions. These blocks are physically implemented (hereinafter referred to as managers, units, modules, hardware components, etc.) by analog and / or digital circuitry such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hardwired circuits, etc., and may optionally be driven by firmware (hereinafter referred to as managers, units, modules, hardware components, etc.). For example, the circuitry may be implemented in one or more semiconductor chips, or on a substrate support such as a printed circuit board. The circuitry constituting the blocks may be implemented by dedicated hardware, by processors (e.g., one or more programmed microprocessors and associated circuitry), or by a combination of dedicated hardware performing some functions of the blocks and processors performing other functions of the blocks. Each block of an embodiment may be physically divided into two or more interacting and discrete blocks without departing from the scope of this disclosure. Similarly, the blocks of an embodiment may be physically combined into more complex blocks without departing from the scope of this disclosure. As used herein, elements denoted as, for example, “…device,” “…unit,” “…module,” etc., may represent two or more elements combined into one element or a unit in which one element is divided into two or more elements according to its function. Furthermore, in addition to their primary functions, each element described below may additionally perform some or all of the functions of another element, and some primary functions of each element may be specifically performed by another element. According to one or more embodiments of this disclosure, “augmented reality (AR)” may refer to the simultaneous display of virtual images and real-world scenes in physical space, or the simultaneous display of real-world objects and virtual images in physical space.
[0022] Furthermore, augmented reality devices are devices capable of representing "augmented reality," and may include not only eyeglasses-type augmented reality glasses worn on the face, but also head-mounted display (HMD) devices or augmented reality helmets (HMDs) worn on the head.
[0023] "Real-world scene" can refer to a real-world scene viewed by a user through an AR device, and may include real-world objects. "Virtual image" can refer to an image generated by an optical engine, and may include both still and moving images. Virtual images can be observed along with the real-world scene, and can be information about real-world objects in the real-world scene, or information about the operation of the AR device, such as images of control menus.
[0024] Therefore, an AR device according to an example embodiment of this disclosure includes an optical engine and a waveguide, wherein the optical engine is configured to generate a virtual image formed by light generated by a light source, and the waveguide includes a transparent material to guide the virtual image generated by the optical engine to the user's eyes and allow the user to view a real-world scene together. As mentioned above, AR devices that require viewing real-world scenes need optical elements to alter the path of light, which is essentially linear, in order to guide the light generated by the optical engine to the user's eyes via the waveguide. In this regard, the path of light can be altered by using reflections such as mirrors, or by using diffraction of diffraction elements (such as diffractive optical elements (DOE), holographic optical elements (HOE), etc.).
[0025] In the following description, this disclosure will now be made with reference to the accompanying drawings.
[0026] Figure 1 This is a diagram illustrating an example of an AR device according to an embodiment of the present disclosure.
[0027] Reference Figure 1 The AR device 1000 can block noise light transmitted from an external light source. For example, the AR device 1000 may include a first polarizer 130 and a second polarizer 140 configured to block noise light. Noise light may include light generated in an external light source. Noise light may include light traveling in a straight line from the external light source toward the light receiver 1520. Noise light may include light that is not reflected by the user's eyeball but travels from the external light source toward the light receiver 1520.
[0028] According to embodiments of this disclosure, the AR device 1000 can receive light via a light receiver 1520 and can detect a user's gaze based on the received light. The received light may include light obtained by filtering out noise light using a first polarizer 130 and a second polarizer 140.
[0029] For example, the light traveling toward the light receiver may include signal light and noise light. Signal light may include light reflected by the user's eyeball for use in detecting the user's gaze. Noise light may not be reflected by the user's eyeball and may include light that is unnecessary for detecting the user's gaze. For example, noise light may include light traveling straight toward the light receiver from an external light source.
[0030] For example, Figure 1 The configuration of an AR device 1000 according to an embodiment of the present disclosure is illustrated schematically, and Figures 2 to 10 A method for blocking noise according to an embodiment of the present disclosure is specifically illustrated.
[0031] AR device 1000 is an eyeglasses-type display device that may include an eyeglasses-type main body configured to be worn by a user.
[0032] The eyeglass-type main body may include a frame 110 and support portions 190 (191 and 192), and the support portions 190 are used to secure the AR device 1000 to the face of a user of the AR device 1000. The support portions 190 may extend from the frame 110 for placing the AR device 1000 on the user's head. The support portions 190 may include temples 191 (191L and 191R) and nose support portions 192 (192L and 192R).
[0033] Temples 191 may extend from frame 110 around waveguide 170 for securing AR device 1000 to a user's head. For example, temples 191 may be positioned on the side portion of the eyeglass-like body. Temples 191 may extend from frame 110 for placing AR device 1000 under the user's ear.
[0034] The nose support portion 192 may extend from the frame 110 for placing the AR device 1000 on the user's nose, and may include, for example, a nose bridge and a nose pad, but this disclosure is not limited thereto.
[0035] Furthermore, a waveguide 170 with a first polarizer 130 attached may be disposed at the frame 110. The frame 110 may be formed to surround the outer peripheral surface of the waveguide 170, and the waveguide 170 may be configured to receive input transmitted light in the input region and output at least a portion of the input light in the output region. The waveguide 170 may include a waveguide 170L for the left eye and a waveguide 170R for the right eye.
[0036] Waveguide 170 is configured to transmit first light from the virtual image generated by optical engine 120 and light from the external scene to the user's pupil. Waveguide 170 may have a flat plate shape. Waveguide 170 may be formed as a single-layer or multi-layer transparent material through which light can be propagated by internal reflection. Here, transparent material refers to a material through which light in the visible light band can pass, and its transparency may not be 100%, and the transparent material may have a preset color. According to an embodiment, waveguide 170 may include transparent material, and therefore, the user can view not only virtual images through AR device 1000 but also real scenes. Thus, AR device 1000 can realize augmented reality. Waveguide 170 may be disposed on each of the left and right eyes corresponding to optical engine 120, or may be disposed on only one side.
[0037] Furthermore, the optical engine 120 of the projector, configured to project display light including an image, may include an optical engine 120L for the left eye and an optical engine 120R for the right eye. The optical engine 120L for the left eye and the optical engine 120R for the right eye may be located on either side of the AR device 1000. Optionally, the optical engine 120 may be included in a central portion surrounding the nose support portion 192 of the AR device 1000. Light emitted from the optical engine 120 may be displayed via a waveguide 170.
[0038] The light receiver 1520 of the gaze detection module 1500 may be disposed at the support portion 190. The light receiver 1520 may be placed on the inner portion of the support portion 190 of the AR device 1000, located between the support portion 190 and the user's eye. The light receiver 1520 may be placed at the support portion 190 of the AR device 1000 so as to face the waveguide 170. For example, in order to emit and receive IR light without interference such as the user's hair, the light receiver 1520 may be placed on the side surface of the temple 191 of the AR device 1000 so as to be approximately 10 mm to approximately 15 mm away from the frame 110.
[0039] The light emitter 1510 of the gaze detection module 1500 can be placed on the inner portion of the frame 110, between the frame 110 of the AR device 1000 and the user's eyes. The light emitter 1510 is positioned on the frame 110 of the AR device 1000 to emit light toward the user's eyes. The light emitter 1510 is positioned on the inner side of the frame 110 so as not to obstruct the user's field of vision, away from the user's forward field of vision. For example, the light emitter 1510 can be placed on the inner side of the frame 110 so as to be adjacent to the nose support portion 192.
[0040] Although Figure 1The light emitter 1510 is shown to be placed inside the frame 110 of the AR device 1000, but the position of the light emitter 1510 does not limit the technical concept of this disclosure. For example, the light emitter 1510 may be placed inside the support portion 190 of the AR device 1000, which is located between the support portion 190 and the user's eyes.
[0041] The first polarizer 130 is configured to polarize the transmitted light. The first polarizer 130 can transmit the light component vibrating in a first direction of the external incident light and can block the light component vibrating in a direction different from the first direction. For example, light emitted from an external light source outside the AR device 1000 can be polarized in the first direction by passing through the first polarizer 130.
[0042] The first polarizer 130 may include a first polarizer 130L for the left eye and a first polarizer 130R for the right eye. The first polarizer 130L for the left eye and the waveguide 170L for the left eye may be positioned at a location corresponding to the user's left eye, and the first polarizer 130R for the right eye and the waveguide 170R for the right eye may be positioned at a location corresponding to the user's right eye. For example, the first polarizer 130L for the left eye may be attached to the waveguide 170L for the left eye, or the first polarizer 130R for the right eye may be attached to the waveguide 170R for the right eye, but this disclosure is not limited thereto. Additionally, for example, the first polarizer 130L for the left eye may be coated on the inner side of the waveguide 170L for the left eye for attachment, or the first polarizer 130R for the right eye may be coated on the inner surface of the waveguide 170R for the right eye for attachment.
[0043] The second polarizer 140 is configured to polarize transmitted light. The second polarizer 140 is configured to filter light components in a second direction that have already been polarized in a first direction by the first polarizer 130. The first and second directions may be perpendicular to each other. The second polarizer 140 can polarize light components that have already been polarized in the first direction by the first polarizer 130 in a second direction, thus blocking light components polarized in the first direction. The second polarizer 140 can transmit light components of external incident light vibrating in the second direction and can block light components vibrating in directions different from the second direction. For example, light components polarized in the first direction by the first polarizer 130 of the AR device 1000 can be blocked by passing through the second polarizer 140.
[0044] The first polarizer 130 and the second polarizer 140 are configured to linearly polarize the transmitted light in directions perpendicular to each other. The method of linearly polarizing the transmitted light in directions perpendicular to each other does not limit the technical concept of this disclosure. For example, the first polarizer 130 and the second polarizer 140 may have the same configuration for linearly polarizing the transmitted light in directions perpendicular to each other, with variations in placement. The first polarizer 130 and the second polarizer 140 may be sequentially placed on the path of noise light emitted directly from an external light source toward the light receiver 1520, leading to the light receiver 1520.
[0045] Figure 2 This is a block diagram of an AR device according to an embodiment of the present disclosure.
[0046] Reference Figure 2 The AR device 1000 according to embodiments of the present disclosure may include a user input unit 1100, a microphone 1200, a display unit 1300, a noise blocking unit 1400, a gaze detection module 1500, a communication interface 1600, a memory 1700, and a processor 1800. Furthermore, the noise blocking unit 1400 may include a first polarizing plate 1410 and a second polarizing plate 1420, and the gaze detection module 1500 may include a light emitter 1510 and a light receiver 1520.
[0047] The user input unit 1100 instructs the user to input data for controlling the AR device 1000. For example, the user input unit 1100 may include at least one of a keypad, a dome switch, a touchpad (using a touch capacitive method, a piezoresistive layer method, an infrared sensing method, a surface ultrasonic conductivity method, a bulk tension measurement method, a piezoelectric effect method, etc.), a scroll wheel, or a scroll wheel switch, but this disclosure is not limited thereto.
[0048] Microphone 1200 receives external sound signal input and processes it into electronic voice data. For example, microphone 1200 may receive sound signals from an external device or speaker. Various noise removal algorithms can be used to remove noise that occurs during the processing of the received external sound signal input. Microphone 1200 may also receive user voice input for controlling AR device 1000.
[0049] Display unit 1300 displays and outputs information processed by AR device 1000. For example, display unit 1300 may display information related to services provided by the user interface for capturing the environment of AR device 1000, as well as captured images of the environment of AR device 1000.
[0050] According to embodiments of this disclosure, the display unit 1300 can provide AR images. According to embodiments of this disclosure, the display unit 1300 may include a waveguide 170 and an optical engine 120, such as... Figure 1As shown. Waveguide 170 may include a transparent material through which a portion of the rear surface can be viewed when the user wears AR device 1000. Waveguide 170 may be formed as a flat plate having a single-layer or multi-layer structure including transparent material, through which light can be propagated by internal reflection. Waveguide 170 may face the light-emitting surface of optical engine 120, thus receiving input light from virtual images emitted from optical engine 120. Here, transparent material refers to a material through which light can pass, and its transparency may not be 100%, and the transparent material may have a preset color. According to embodiments of this disclosure, since waveguide 170 includes transparent material, the user can not only view virtual objects of virtual images, but also view the external real scene through display unit 1300, making waveguide 170 also referred to as a see-through display. Display unit 1300 can provide AR images by outputting virtual objects of virtual images via waveguide. In the example case where AR device 1000 is a glasses-type display device, display unit 1300 may include a left display unit and a right display unit.
[0051] The noise blocking unit 1400 may include a first polarizer 1410 and a second polarizer 1420 for blocking noise light appearing in an external light source. Each of the first polarizer 1410 and the second polarizer 1420 can filter polarization components vibrating in one direction from external incident light. The first polarizer 1410 may be configured to linearly polarize the incident light in the first direction, and the second polarizer 1420 may be configured to linearly polarize the incident light in a second direction perpendicular to the first direction. The first polarizer 1410 can initially polarize the noise light, and the second polarizer 1420 can repolarize the initially polarized noise light, thereby blocking the noise light.
[0052] The first polarizer 1410 and the second polarizer 1420 can be sequentially placed on the path of the noise light emitted directly from the external light source toward the light receiver 1520. The noise light emitted directly from the external light source toward the light receiver 1520 can be polarized for the first time by the first polarizer 1410, and then polarized again by the second polarizer 1420.
[0053] The first polarizer 1410 may be placed on the waveguide 170. For example, the first polarizer 1410 may be positioned to be attached to the waveguide 170. The first polarizer 1410 may be placed on the outer surface of the waveguide 170, but this does not limit the technical concept of this disclosure. For example, the first polarizer 1410 may be placed on the inner side of the waveguide 170.
[0054] The second polarizer 1420 may be placed on the light receiver 1520. For example, the second polarizer 1420 may be placed in front of the lens of the light receiver 1520. As another example, the second polarizer 1420 may be included as an internal configuration of the light receiver 1520, and in this respect, the second polarizer 1420 and the light receiving sensor may be sequentially placed in the path of the noise light, thereby preventing the noise light from reaching the light receiving sensor of the light receiver 1520.
[0055] The gaze detection module 1500 may include a light emitter 1510 configured to emit infrared (IR) light for detecting a user's gaze and a light receiver 1520 configured to receive the IR light, and may detect data related to the gaze of a user wearing the AR device 1000. For example, the light emitter 1510 may include an IR light source.
[0056] The light emitter 1510 of the gaze detection module 1500 emits IR light toward the user's eyes. The emitted IR light can be sequentially reflected by the user's eyes and the waveguide 170. The light emitter 1510 can be placed in a position on the AR device 1000 such that it emits IR light toward the user's eyes. For example, the light emitter 1510 can be located at... Figure 1 The AR device 1000 is supported on the nose support part 192 of the user's face.
[0057] Furthermore, the IR light emitted from the light emitter 1510 can be reflected from the user's eye and can also be incident on the waveguide 170. In the example case where the emitted IR light passes through the waveguide 170, it may be difficult to detect the user's line of sight. Therefore, in order to ensure that most of the IR light is reflected from the waveguide 170, a light reflector can be attached to the inside of the waveguide 170 (see [link to relevant documentation]). Figure 6 (See reference numeral 172). The optical reflector can be coated onto waveguide 170.
[0058] For example, IR light reflected from the user's eye can be reflected by waveguide 170 or a light reflector, and thus can be received by light receiver 1520. IR light traveling to the user's eye can be reflected from the user's eye, and the IR light reflected from the user's eye can be reflected by waveguide 170 or a light reflector, and light receiver 1520 can receive the IR light reflected by the light reflector.
[0059] According to embodiments of this disclosure, the light receiver 1520 may include a camera, image sensor, detector, etc., for detecting light.
[0060] For example, the light receiver 1520 may be a two-dimensional (2D) sensor assembled in the form of an array comprising a plurality of pixels arranged in a matrix, and each of the plurality of pixels may include at least one photoelectric conversion element. The light receiver 1520 may detect light by using the photoelectric conversion element and may output an image signal as an electrical signal based on the detected light.
[0061] The optical receiver 1520 can be placed in the AR device 1000 at a location that facilitates receiving IR light reflected from the optical reflector. For example, the optical receiver 1520 can be located at... Figure 2 The AR device 1000 is supported on the user's face at the support part 190, such as... Figure 1 The temples 191 and the nose support portion 192. Furthermore, for example, Figure 2 The nasal support portion 192 may include a nasal bridge and a nasal pad. The nasal bridge and the nasal pad may be formed as one piece, but this disclosure is not limited thereto.
[0062] The location of the light emitter 1510 is merely an example and does not limit the technical concept of this disclosure. For example, the light emitter 1510 may be located in... Figure 1 The AR device 1000 is supported on the temple 191 of a pair of glasses on the user's face. An infrared emitter 1510 emits infrared light toward a light reflector, so that the infrared light reflected from the light reflector attached to the inside of the waveguide 170 travels to the user's eyes. The light emitter 1510 also emits IR light toward the light reflector; the emitted IR light is reflected by the light reflector, and the reflected IR light travels to the user's eyes. The light emitter 1510 can be positioned on the AR device 1000 at a location that facilitates the emission of IR light toward the light reflector.
[0063] IR light reflected from the user's eye can be reflected by a light reflector and thus received by the light receiver 1520 of the gaze detection module 1500. IR light traveling towards the user's eye can be reflected from the user's eye, the IR light reflected from the user's eye can be reflected by a light reflector, and the light receiver 1520 can receive the IR light reflected by the light reflector.
[0064] The optical receiver 1520 can be placed in the AR device 1000 at a location that facilitates receiving IR light reflected from the optical reflector. For example, the optical receiver 1520 can be located at... Figure 2 The AR device 1000 is supported on the user's face at the support part 190, such as... Figure 2 The temples 191 and the nose support portion 192. Furthermore, for example, Figure 2 The nasal support portion 192 may include a nasal bridge and a nasal pad. The nasal bridge and the nasal pad may be formed as one piece, but this disclosure is not limited thereto.
[0065] The light emitter 1510 may be an IR light-emitting diode (IR LED), and the light receiver 1520 may be an IR camera configured to capture IR light. In this case, the IR camera can capture images of the user's eyes using IR light reflected by the waveguide 170 or a light reflector. In the example where the light emitter 1510 is an IR LED and the light receiver 1520 is an IR camera, the light emitter 1510 may emit planar IR light toward the user's eyes, and the light receiver 1520 may receive planar IR light sequentially reflected from the user's eyes and the waveguide 170 or the light reflector. The planar light may be light emitted in a planar form, and the area to which the planar light is emitted may be configured to cover the user's eyes.
[0066] In the example where the light emitter 1510 is an IR scanner and the light receiver 1520 is an IR detector, the light emitter 1510 can emit point or line IR light toward the user's eye, and the light receiver 1520 can receive the point or line IR light reflected from the user's eye. In this case, the light emitter 1510 can sequentially emit IR light while moving along the light emission direction of the light emitter 1510, such that the point or line IR light covers the space where the user's eye is located. The IR scanner can be configured as a microelectromechanical system (MEMS) mirror capable of reflecting IR light by controlling the direction of the IR light emitted from the IR LED, and is described as an IR scanner. Furthermore, according to an embodiment, the IR detector can be mounted in such a manner that multiple photodiodes are installed at the portion where light needs to be detected, and is described as an IR detector.
[0067] In the example where the AR device 1000 is an eyeglasses-type device, the light receiver 1520 can be placed at the temple 191 of the AR device 1000. For example, refer to... Figure 1 The light receiver 1520 can be placed on the inner portion of the temple 191 of the AR device 1000, which is located between the temple 191 and the user's eye. For example, see reference... Figure 1 The optical receiver 1520 can be placed on the side surface of the temple 191 of the AR device 1000, so as to be about 10 mm to about 15 mm away from the frame 110. The optical receiver 1520 can be placed on the temple 191 of the AR device 1000 so as to face the waveguide 170.
[0068] Furthermore, the light emitter 1510 can be placed at the nose support portion 192 of the AR device 1000. The light emitter 1510 can be placed on the inner portion of the nose support portion 192 of the AR device 1000, which is located between the nose support portion 192 and the user's eyes. For example, see... Figure 1The light emitter 1510 can be placed on the side surface of the nose support portion 192 of the AR device 1000, so as to be about 10 mm to about 15 mm away from the frame 110. The light emitter 1510 can be placed on the nose support portion 192 of the AR device 1000 so as to face the user's eyes.
[0069] Reference Figure 1 In the example where the AR device 1000 is an eyeglasses-type device, the light emitter 1510 and the light receiver 1520 can be placed at the temple 191 of the AR device 1000. For example, refer to... Figure 1 The light emitter 1510 and the light receiver 1520 can be placed on the inner portion of the temple 191 of the AR device 1000, which is located between the temple 191 and the user's eye. For example, see reference... Figure 1 The light emitter 1510 and the light receiver 1520 can be placed on the side surface of the temple 191 of the AR device 1000 so as to be about 10 mm to about 15 mm away from the frame 110. The light emitter 1510 and the light receiver 1520 can be placed on the temple 191 of the AR device 1000 so as to face the waveguide 170.
[0070] The gaze detection module 1500 can provide the processor 1800 with gaze-related data of the user's eyes, and the processor 1800 can obtain the user's gaze information based on the gaze-related data. The gaze-related data is data obtained by the gaze detection module 1500 and may include the type of IR light emitted from the light emitter 1510 (e.g., point light, line light, plane light), the characteristics of the IR light emitted from the light emitter 1510, data about the emission area of the IR light emitted from the light emitter 1510, and data indicating the characteristics of the IR light received by the light receiver 1520. Furthermore, the user's gaze information can be gaze-related information of the user's eyes, which can be generated by analyzing the gaze-related data of the user's eyes, and may include, for example, information about the position of the user's pupil, the position of the pupil's center point, the position of the user's iris, the center of the user's eye, the position of the user's glint feature point, the user's fixation point, and the user's gaze direction, but this disclosure is not limited thereto. The user's gaze direction may be, for example, the gaze direction from the center of the user's eye toward the user's fixation point. For example, the user's eye gaze direction can be represented by the values of the vectors from the center of the user's left eye toward the gaze point and the values of the vectors from the center of the user's right eye toward the gaze point, but this disclosure is not limited thereto. According to embodiments of this disclosure, the gaze detection module 1500 can detect data related to the gaze of a user wearing the AR device 1000 at preset time intervals.
[0071] The communication interface 1600 can send data for receiving services related to the AR device 1000 to external devices and servers, and receive data for receiving services related to the AR device 1000 from external devices and servers.
[0072] The memory 1700 may store programs to be executed by the processor 1800, which will be described below, and may also store data input to or output from the AR device 1000.
[0073] The memory 1700 may include at least one of internal or external memory. The internal memory may include at least one of, for example, volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), non-volatile memory (e.g., one-time programmable ROM (OTPROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), mask ROM, flash ROM, etc.), hard disk drive (HDD), or solid-state drive (SSD). According to embodiments of this disclosure, the processor 1800 may load commands or data received from at least one of the non-volatile memory or other components into the volatile memory, and may process the commands or data. Furthermore, the processor 1800 may store data received or generated from other components in the non-volatile memory. The external memory may include at least one of, for example, compact flash memory (CF), secure digital storage (SD), micro-secure digital storage (Micro-SD), mini-secure digital storage (Mini-SD), extreme digital storage (xD), or Memory Stick.
[0074] According to an embodiment, programs stored in memory 1700 can be categorized into multiple modules based on their functions. For example, memory 1700 may store software code and / or instruction sets that perform various functions or operations. For example, the multiple modules may include, but are not limited to, a light emitting module 1710, a light receiving module 1720, an eye feature detection module 1730, a pupil position detection module 1740, and a gaze detection module 1750. For example, gaze detection module 1500 may include memory, and in this case, light emitting module 1710 and light receiving module 1720 may be stored as firmware in the memory included in gaze detection module 1500.
[0075] The processor 1800 can control all operations of the AR device 1000. For example, the processor 1800 can control the user input unit 1100, microphone 1200, display unit 1300, light reflector, gaze detection module 1500, communication interface 1600, memory 1700, etc. by executing programs stored in memory 1700.
[0076] The processor 1800 can determine the user's gaze point and gaze direction by running the light emitting module 1710, light receiving module 1720, eye feature detection module 1730, pupil position detection module 1740 and gaze detection module 1750 stored in the memory 1700.
[0077] According to embodiments of this disclosure, the AR device 1000 may include a plurality of processors 1800, and the plurality of processors 1800 may run a light emitting module 1710, a light receiving module 1720, an eye feature detection module 1730, a pupil position detection module 1740 and a gaze detection module 1750 stored in a memory 1700.
[0078] For example, some parts of the light emitting module 1710, light receiving module 1720, eye feature detection module 1730, pupil position detection module 1740, and gaze detection module 1750 may be operated by a first processor, and other parts of the light emitting module 1710, light receiving module 1720, eye feature detection module 1730, pupil position detection module 1740, and gaze detection module 1750 may be operated by a second processor, but this disclosure is not limited thereto.
[0079] For example, the gaze detection module 1500 may include another processor and a memory, and the other processor may run the light emitting module 1710 and the light receiving module 1720 stored in the memory, and the processor 1800 may run the eye feature detection module 1730, the pupil position detection module 1740 and the gaze detection module 1750 stored in the memory 1700.
[0080] The processor 1800 can run the light emitting module 1710 stored in the memory 1700 to cause the light emitter 1510 to emit IR light toward the user's eyes. The processor 1800 can control the light emitter 1510 by running the light emitting module 1710, and the light emitter 1510 controlled by the processor 1800 can emit IR light such that the emitted IR light can cover the user's eyes.
[0081] In the example case where the light receiver 1520 is an infrared camera, the light emitter 1510 can be an IR LED, and in order for the IR camera to capture the user's eye, the processor 1800 can control the IR LED in such a way that the IR light emitted from the IR LED is emitted into the area including the user's eye. For example, in order for the IR light emitted from the IR LED to be emitted into the area including the user's eye, the processor 1800 can control the emission direction of the IR light emitted from the IR LED, and can apply power to the IR LED, thereby controlling the emission of IR light from the IR LED.
[0082] According to embodiments of this disclosure, for example, in order for the IR camera to capture the entire area of a user's eye, the IR camera may be mounted facing the waveguide 170 or light reflector of the AR device 1000, and the IR LED may be mounted facing the user's eye. The processor 1800 can control the IR LED mounted facing the user's eye to emit IR light.
[0083] In the example where the light receiver 1520 is an IR detector, the light emitter 1510 can be an IR scanner, and in order for the IR detector to detect the user's eye, the processor 1800 can control the IR scanner in such a way that the IR light emitted from the IR scanner is reflected by the waveguide 170 or a light reflector to scan the user's eye. For example, in order for the IR light emitted from the IR scanner to scan the user's eye, the processor 1800 can control the emission direction of the IR light emitted from the IR scanner and can apply power to the IR scanner to control the emission of IR light from the IR scanner.
[0084] The processor 1800 can run the light receiving module 1720 stored in the memory 1700 so that the light receiver 1520 receives light reflected from the user's eyes. The processor 1800 can control the light receiver 1520 by running the light receiving module 1720, and the light receiver 1520 controlled by the processor 1800 can receive light reflected from the user's eyes.
[0085] In the example case where the light emitter 1510 is an IR LED, the light receiver 1520 can be an IR camera, and the processor 1800 can control the IR camera to photograph the user's eyes via light reflected from the user's eyes.
[0086] Processor 1800 can run eye feature detection module 1730 stored in memory 1700 to detect features related to the user's eye gaze. For example, processor 1800 can run eye feature detection module 1730 to detect the positions of pupil feature points and bright spot feature points of the user's eyes. The pupil feature point can be the center point of the pupil, and the bright spot feature point can be a point from the detection area of the eye with a brightness equal to or greater than a preset value. The positions of the pupil feature point and the bright spot feature point can be identified by coordinate values indicating their positions in the coordinate system of light receiver 1520. For example, the coordinate system of light receiver 1520 can be the coordinate system of an IR camera or an IR detector, and the coordinate values in the coordinate system of light receiver 1520 can be 2D coordinate values.
[0087] Processor 1800 can detect features related to eye gaze by analyzing the light received by light receiver 1520. In the example where light receiver 1520 is an IR camera, processor 1800 can identify the locations of pupil feature points and bright spot feature points from the image captured by the IR camera. In the example where light receiver 1520 is an IR detector, processor 1800 can identify the locations of pupil feature points and bright spot feature points by detecting the IR light detected by the IR detector.
[0088] The processor 1800 can run a pupil position detection module 1740 stored in memory 1700 to detect the position of the user's pupil. The pupil position detection module 1740 can identify the position of the user's pupil based on IR light emitted from a light reflector.
[0089] In the example where the light receiver 1520 is an IR camera, the pupil position detection module 1740 can identify the position of the user's pupil in the image captured by the IR camera. In the example where the light receiver 1520 is an IR detector, the pupil position detection module 1740 can calculate the position of the user's pupil by analyzing the IR light sequentially obtained by the IR detector.
[0090] The pupil position detection module 1740 can identify the position of the user's pupil by recognizing the center point of the user's pupil.
[0091] The processor 1800 can run the gaze detection module 1750 stored in the memory 1700 to obtain the user's gaze information. The processor 1800 can run the gaze detection module 1750 to calculate the position of the center of the user's eyes. The center of the user's eyes can be the center of the user's eyeballs.
[0092] The processor 1800 can run the gaze detection module 1750 to calculate the position of the user's gaze point. Furthermore, the user's gaze direction can be determined based on the position of the eye center calculated by the gaze detection module 1750 and the user's gaze point.
[0093] Figure 3 This is a conceptual diagram for describing in detail the configuration of an AR device according to embodiments of the present disclosure.
[0094] For example, Figure 3 This is a conceptual diagram illustrating, according to embodiments of the present disclosure, the type of light obtained by the light receiver 1520 of the AR device 1000 for detecting the line of sight and the operation of blocking noise light. For ease of description, simplifications or omissions are provided. Figure 1 and Figure 2 The description is redundant.
[0095] For example, Figure 3 Different types of light are shown obtained by the light receiver 1520 of the AR device 1000. For example, the types of light can be first light L1, second light L3, and third light L3. The definitions of first light L1, second light L3, and third light L3 are described below.
[0096] Reference Figure 3 The AR device 1000 may include a gaze detection module, which includes a waveguide 170, a light emitter 1510, and a light receiver 1520. The AR device may also include a first polarizer 130 and a second polarizer 140. According to an embodiment, the first polarizer 130 and the second polarizer 140 can block unwanted noise light when detecting the gaze.
[0097] According to embodiments of this disclosure, a first light L1 may be emitted from an external light source 10. The first light L1 may be unpolarized light. For example, the first light L1 may be natural light. However, this disclosure is not limited thereto, and therefore, the first light L1 may include another type of light. For example, the first light L1 may include artificial light. The first light L1 may include light generated by the external light source 10. The first light L1 may include light propagating from the external light source 10 toward the light receiver 1520. For example, the path of the first light L1 may be directly (or straight) from the external light source 10 toward the light receiver 1520. The first light L1 may include light that is not reflected by the user's eyeball and travels from the external light source 10 toward the light receiver 1520. The first light L1 may be noisy light that is unnecessary when detecting the user's gaze. For example, the first light L1 may be noisy light that adversely affects gaze detection operations.
[0098] The first light L1 can be initially polarized by a first polarizer 130 positioned on a straight path. The first light L1 can be linearly polarized by the first polarizer 130. The first light L1 can be filtered into a polarization component vibrating in a first direction by the first polarizer 130.
[0099] The first light L1 can be repolarized by a second polarizer 140 placed on a straight path. The first light L1 can be linearly polarized by the second polarizer 140. The first light L1, initially polarized by the first polarizer 130, can be blocked by the second polarizer 140. The first light L1 can be filtered by the second polarizer 140 into a polarization component vibrating in a second direction perpendicular to the first direction, and ultimately, the first light L1 can be blocked by both the first polarizer 130 and the second polarizer 140. The first light L1 will not reach the light receiver 1520. For example, the AR device 1000 can block the first light L1 by using the first polarizer 130 and the second polarizer 140.
[0100] According to embodiments of this disclosure, a second light L2 may be emitted from an external light source 10. The second light L2 may be unpolarized light, and for example, may be natural light. However, this disclosure is not limited thereto, and therefore, the second light L2 may include another type of light. For example, the second light L2 may include artificial light. The second light L2 may include light generated by the external light source 10. The second light L2 may include light emitted from the external light source 10, reflected by the user's eyeball, and then traveling toward the light receiver 1520. The second light L2 may include light that does not pass through the first polarizer 130. The first light L1 may be a signal light used when detecting the user's gaze. The AR device 1000 may receive the first light L1 using the light receiver 1520 and may track the user's gaze based on the first light L1.
[0101] According to embodiments of this disclosure, a third light L3 may be emitted from the light emitter 1510. The third light L3 may be, for example, IR light. However, this disclosure is not limited thereto, and the third light L3 may include another type of light. The third light L3 may include light emitted from the light emitter 1510, reflected by the user's eyeball, and then traveling toward the light receiver 1520. The third light L3 may include light that does not pass through the first polarizer 130. The third light L3 may be signal light used when detecting the user's gaze. The AR device 1000 may receive a second light L2 using the light receiver 1520 and may track the user's gaze based on the second light L2.
[0102] Figure 4 This is a conceptual diagram illustrating a method for blocking noise through the configuration of an AR device according to embodiments of the present disclosure.
[0103] For example, Figure 4The operation of the first polarizer 130 and the second polarizer 140 according to the embodiment is shown to sequentially polarize the incident light IL emitted from the external light source 10. Figure 4 The incident light IL can correspond to Figure 3 The first light L1. For ease of description, the connection to... is simplified or omitted. Figures 1 to 3 The description is redundant.
[0104] Reference Figure 4 An incident light IL can be emitted from an external light source 10. The incident light IL can be unpolarized light, and for example, it can be natural light. However, this disclosure is not limited to this, and therefore, the first light L1 can include another type of light. For example, the first light L1 can include artificial light. The incident light IL can include light traveling in a straight line from the external light source 10 toward the light receiver 1520. The incident light IL can be noise light that is unnecessary when detecting the user's line of sight. The incident light IL can be unpolarized light comprising multiple polarization components vibrating in various directions.
[0105] The first polarizer 130 may include a first polarization axis X1 extending in the first direction X. The first polarizer 130 can polarize the incident light IL in the first direction X.
[0106] The incident light IL can be polarized in the first direction X by the first polarizer 130. When the incident light IL passes through the first polarizer 130, the polarization component vibrating in the first direction X can be transmitted, and the polarization component vibrating in a direction different from the first direction X can be blocked. The transmitted light of the polarization component of the incident light IL vibrating in the first direction X can be the first polarized light PL1. The first polarized light PL1 can travel towards the optical receiver 1520.
[0107] The second polarizer 140 may include a second polarization axis X2 extending in the second direction Y. The second polarizer 140 can polarize the first polarized light PL1 in the second direction Y. The second polarizer 140 can also polarize the first polarized light PL1 vibrating in the first direction X in the second direction Y, thereby blocking the first polarized light PL1.
[0108] The first polarized light PL1 can be polarized in the second direction Y by the second polarizing plate 140. The second direction Y can be perpendicular to the first direction X. When the first polarized light PL1 passes through the second polarizing plate 140, the polarization component vibrating in the second direction Y can be transmitted, and the polarization component vibrating in a direction different from the second direction Y can be blocked. Therefore, the first polarized light PL1 can be blocked by the second polarizing plate 140.
[0109] AR device 1000 can block incident light IL by using a first polarizer 130 and a second polarizer 140. The incident light IL can be unnecessary light when detecting a user's gaze. AR device 1000 can block the incident light IL, which is noise, that will be transmitted to light receiver 1520, and can obtain only the light necessary for detecting the user's gaze via light receiver 1520. AR devices according to embodiments of this disclosure can filter the light used for detecting the user's gaze by blocking noisy light, and the filtered light can help improve image sharpness for detecting the user's gaze.
[0110] Figure 5 This is a conceptual diagram illustrating a process for blocking noise according to embodiments of the present disclosure.
[0111] For example, Figure 5 The shift in polarization direction of light passing through the first polarizer 130 and the second polarizer 140 according to the embodiment is shown in detail. For ease of description, details are simplified or omitted. Figure 4 The description is redundant.
[0112] according to Figure 5 In the embodiment shown, the type of light emitted from the external light source is classified as a fourth light L4 traveling toward the light receiver and a fifth light L5 incident on the user's eyeball.
[0113] According to embodiments of this disclosure, the external light source 10 can emit light. The external light source 10 can be, for example, the sun. The external light source 10 can emit unpolarized light, polarized light vibrating in a first direction X, or polarized light vibrating in a second direction Y. The second direction Y can be perpendicular to the first direction X.
[0114] According to embodiments of this disclosure, the fourth light L4 may be light traveling toward the light receiver. The fourth light L4 may be a reference light. Figure 3 The first light L1 is described. The fourth light L4 can act as noise when the AR device detects the user's gaze. The AR device 1000 can be configured such that a first polarizing plate 130 and a second polarizing plate 140 are disposed in the path of the fourth light L4, and the fourth light L4 can be blocked by the first polarizing plate 130 and the second polarizing plate 140.
[0115] In Example 1, the external light source 10 can emit unpolarized fourth light L4. The unpolarized fourth light L4 can be light comprising multiple polarization components vibrating in various directions. For example, the unpolarized fourth light L4 can vibrate in multiple directions. The unpolarized fourth light L4 can be polarized in a first direction by a first polarizing plate 130. The polarization component of the unpolarized fourth light L4 vibrating in the first direction can be transmitted through the first polarizing plate 130, and the polarization component of the unpolarized fourth light L4 vibrating in a direction different from the first direction can be transmitted through a second polarizing plate 140.
[0116] The fourth light L4, which is polarized in the first direction X, can be polarized in the second direction by the second polarizing plate 140. The fourth light L4, which is polarized in the first direction X, can be blocked by the second polarizing plate 140. Therefore, the unpolarized fourth light L4 is blocked by the first polarizing plate 130 and the second polarizing plate 140 and will not reach the light receiver.
[0117] In Example 3, the external light source 10 can emit a fourth light L4 polarized in the first direction X. The fourth light L4 polarized in the first direction X can be polarized in the first direction by the first polarizing plate 130. The fourth light L4 polarized in the first direction X can be completely transmitted through the first polarizing plate 130.
[0118] The fourth light L4, which is polarized in the first direction X, can be polarized in the second direction by the second polarizing plate 140. The fourth light L4, which is polarized in the first direction X, can be blocked by the second polarizing plate 140. Therefore, the unpolarized fourth light L4 is blocked by the first polarizing plate 130 and the second polarizing plate 140 and will not reach the light receiver.
[0119] In Example 5, the external light source 10 can emit a fourth light L4 polarized in the second direction Y. The fourth light L4 polarized in the second direction Y can be polarized in the first direction by a first polarizing plate 130. The fourth light L4 polarized in the second direction Y can be blocked by the first polarizing plate 130. Therefore, the unpolarized fourth light L4 is blocked by the first polarizing plate 130 and the second polarizing plate 140 and will not reach the light receiver.
[0120] According to embodiments of this disclosure, the fifth light L5 can be light traveling towards the user's eyeball. The user can ensure their field of vision based on the fifth light L5. For example, the fifth light L5 can be image light emitted from a display device, and the user can view an image based on the fifth light L5. The fifth light L5 can be used to ensure the user's field of vision. In example cases where the fifth light L5 does not reach the user's eyeball, the user may not be able to ensure their field of vision based on the fifth light L5.
[0121] Although both the fourth light L4 and the fifth light L5 are emitted from the external light source 10, the fourth light L4 may act as noise when it reaches the light receiver. Therefore, it is necessary to block the fourth light L4, and the fifth light L5 must reach the user's eyeball to ensure the user's field of vision.
[0122] In Example 2, the external light source 10 can emit unpolarized fifth light L5. The unpolarized fifth light L5 can be light comprising multiple polarization components vibrating in various directions. The unpolarized fifth light L5 can be polarized in a first direction by a first polarizing plate 130. The polarization component of the unpolarized fifth light L5 vibrating in the first direction can be transmitted through the first polarizing plate 130, and the first polarizing plate 130 can block the polarization component of the unpolarized fifth light L5 vibrating in a direction different from the first direction.
[0123] A fifth beam L5, polarized in the first direction X, can reach the user's eye. The user can ensure forward visibility based on the fifth beam L5 polarized in the first direction X. For example, the user can identify image light polarized in the first direction X and view an image based on the image light.
[0124] In Example 4, the external light source 10 can emit a fifth light L5 polarized in the first direction X. The fifth light L5 polarized in the first direction X can be polarized in the first direction by the first polarizing plate 130. The fifth light L5 polarized in the first direction X can be completely transmitted through the first polarizing plate 130.
[0125] A fifth beam L5, polarized in the first direction X, can reach the user's eye. The user can ensure forward visibility based on the fifth beam L5 polarized in the first direction X. For example, the user can identify image light polarized in the first direction X and view an image based on the image light.
[0126] In Example 5, the external light source 10 can emit a fifth light L5 polarized in the second direction Y. The fifth light L5 polarized in the second direction Y can be polarized in the first direction by the first polarizing plate 130. The fifth light L5 polarized in the second direction Y can be blocked by the first polarizing plate 130.
[0127] In Example 6, the fifth light, L5, may not reach the user's eye. When the fifth light, L5, is blocked, the user may not be able to ensure their forward field of vision. For example, the user may not be able to recognize the blocked image light and may not be able to view the image based on the image light. For example, see below. Figures 8 to 10 An embodiment for improving Example 6 is described.
[0128] Figure 6 This is a conceptual diagram illustrating a method for blocking noise in an AR device according to embodiments of the present disclosure.
[0129] For example, Figure 6 The operation of blocking noise light by the light reflector 172 of the AR device according to an embodiment of this disclosure is illustrated. For ease of description, simplifications or omissions are provided. Figures 1 to 3 The description is redundant.
[0130] Reference Figure 6 The AR device 1000 may include a waveguide 170 and a gaze detection module including a light emitter 1510 and a light receiver 1520. The AR device 1000 may also include a light reflector 172, a first polarizer 130, and a second polarizer 140. The AR device 1000 can guide a large portion of the light necessary for gaze detection to the light receiver 1520 by using the light reflector 172, and can guide a small portion of the light not necessary for gaze detection to the light receiver 1520. The AR device 1000 can block noise light not necessary for gaze detection by using the first polarizer 130 and the second polarizer 140.
[0131] The light reflector 172 can emit light emitted from the light emitter 1510 or the external light source 10. The light reflector 172 and the waveguide 170 can be positioned facing the user's eyes and can be attached to each other. For example, the light reflector 172 can be coated on at least a portion of the waveguide 170. In addition, the light reflector 172 can be attached to or coated on other components included in the eyeglass-type AR device besides the waveguide, including vision-correcting lenses for vision correction or cover glass mounted to protect the waveguide.
[0132] The light reflector 172 may be formed of a material capable of reflecting IR light emitted from the light emitter 1510 or the external light source 10. The light reflector 172 may include, for example, silver, gold, copper, or one or more of these metallic materials, but this disclosure is not limited thereto. Thus, the IR light emitted from the light emitter 1510 can be reflected by the user's eye and then travel towards the light reflector 172, while the IR light reflected back from the light reflector 172 can travel towards the light receiver 1520. Optionally, the first light L1 emitted from the external light source 10 may be unwanted noise light when detecting the user's gaze and can be reflected by the light reflector 172, then only a portion of the first light L1 can pass through the light reflector 172 and continue towards the light receiver 1520.
[0133] According to embodiments of this disclosure, a first light L1 can be emitted from an external light source 10. The first light L1 can be initially polarized in a first direction by a first polarizer 130 disposed on a straight path. The first light L1 can be reflected by a light reflector 172, and only a portion of the first light L1 can pass through the light reflector 172 and continue towards the light receiver 1520. The portion of the first light L1 that has passed through the light reflector 172 can be repolarized in a second direction perpendicular to the first direction by a second polarizer 140 disposed on the straight path. The AR device 1000 can block the first light L1 by using the first polarizer 130 and the second polarizer 140.
[0134] According to embodiments of this disclosure, the second light L2 may be light reflected from the user's eye and traveling toward the light receiver 1520. The second light L2 may be emitted from an external light source (10 or a separate light source not shown). The second light L2 is emitted from the external light source and reflected by the user's eye. For example, the external light source may include an IR light source. The IR light source may be disposed on a waveguide. The second light L2 may be reflected by the user's eye, then reflected by the light reflector 172, and then travel toward the light receiver 1520. The light reflector 172 may improve the reflection efficiency of the incident second light L2. The second light L2 may include light traveling toward the light receiver 1520. The second light L2 may include light that does not pass through the third polarizer 130. The first light L1 may be a signal light used to detect the user's gaze.
[0135] According to embodiments of this disclosure, a third light L3 may be emitted from a light emitter 1510. The third light L3 may be, for example, IR light. The third light L3 is emitted from the light emitter 1510 and reflected by the user's eye. The third light L3 may be reflected by the user's eye, then reflected by a light reflector 172, and then travel toward a light receiver 1520. The light reflector 172 may improve the reflection efficiency of the incident third light L3. The third light L3 may include light traveling toward the light receiver 1520. The third light L3 may include light that does not pass through the third polarizer 130. The third light L3 may be a signal light used to detect the user's gaze.
[0136] Figure 7 This is a conceptual diagram illustrating the configuration of an AR device according to embodiments of the present disclosure.
[0137] According to embodiments of this disclosure, a light emitter 1510 may be disposed on the temple 191. A light emitter 1510 and a light receiver 1520 for detecting a user's gaze may be disposed on the temple portion of the AR device 1000, and the AR device 1000 can effectively identify the user's eyes by using the light emitter 1510 and light receiver 1520 disposed on the temple portion. IR light may be emitted from the light emitter 1510 disposed on the temple portion toward the waveguide 170 of the AR device 1000. The emitted IR light is reflected by the waveguide 170 and thus travels to the user's eyes. The IR light reflected from the user's eyes and then reflected again by the waveguide 170 or a light reflector may be received by the light receiver 1520. Furthermore, the AR device 1000 may obtain information about the user's eyes based on the received IR light, and may detect the direction of the user's gaze by using the obtained information about the eyes.
[0138] According to embodiments of this disclosure, a third light L3 may be emitted from an optical emitter 1510. The third light L3 may be, for example, IR light. The third light L3 is emitted from the optical emitter 1510 toward a waveguide 170 or an optical reflector 172, reflected by the waveguide 170 or the optical reflector 172, and then reflected by the user's eye. After being reflected by the user's eye, the third light L3 may be reflected again by the waveguide 170 or the optical reflector 172, and thus may travel toward the optical receiver 1520. The third light L3 may include light that does not pass through the third polarizer 130. The third light L3 may be a signal light used to detect the user's gaze.
[0139] Figure 8 This is a conceptual diagram illustrating the configuration of an AR device according to embodiments of the present disclosure.
[0140] For example, Figure 8 The function of the quarter-wave plate 174 of the AR device is shown, and Figure 9a , Figure 9b and Figure 10 This is a diagram used to describe in detail the function of the quarter-wave plate 174 and its operation in blocking noisy light. For ease of description, details related to... Figures 1 to 3 The description is redundant.
[0141] Reference Figure 8The AR device 1000 may include a waveguide 170 and a gaze detection module including a light emitter 1510 and a light receiver 1520. The AR device 1000 may also include a quarter-wave plate 174, a first polarizer 130, and a second polarizer 140. The AR device 1000 can polarize light that would otherwise be blocked as noise, emitted from an external light source and then reaching the light receiver 1520, by using the quarter-wave plate 174, the first polarizer 130, and the second polarizer 140. The AR device 1000 can also polarize light that will be transmitted for the user's forward field of vision, emitted from an external light source and then reaching the user's eye, by using the quarter-wave plate 174.
[0142] A quarter-wave plate 174 is configured to phase-shift the incident light by 90°. The quarter-wave plate 174 is also configured to circularly polarize the transmitted linearly polarized light. In an example case of incident circularly polarized light, the quarter-wave plate 174 can shift the circularly polarized light into linearly polarized light. For example, light emitted from an external light source in front of the AR device 1000 can pass through the quarter-wave plate 174 and thus be circularly polarized.
[0143] According to embodiments of this disclosure, a quarter-wave plate 174, a first polarizer 130, and a second polarizer 140 may be sequentially arranged on the path of the first light L1 emitted directly from the external light source 10 toward the light receiver 1520 to reach the light receiver 1520. The quarter-wave plate 174 may be disposed on the waveguide 170.
[0144] Figure 9a This is a conceptual diagram illustrating a method for blocking noise through the configuration of an AR device according to embodiments of the present disclosure.
[0145] Figure 9a The diagram illustrates the operation of sequentially polarizing a first incident light IL1 emitted from an external light source 10 (hereinafter also referred to as the first external light source 10) via a quarter-wave plate 174, a first polarizer 130, and a second polarizer 140. Figure 9a This is a conceptual diagram showing the path of the first incident light IL1 traveling from the first external light source 10 toward the light receiver 1520.
[0146] Reference Figure 9a According to the disclosed embodiments, the first light (see...) Figure 8 L1 may include the first incident light IL1.
[0147] The first incident light IL1 can be noise light emitted from the first external light source 10. The first incident light IL1 can be unpolarized light, and for example, natural light. The first incident light IL1 can include light traveling in a straight line from the first external light source 10 toward the light receiver 1520. The first incident light IL1 can include light that is not reflected by the user's eyeball and travels from the first external light source 10 toward the light receiver 1520. The first incident light IL1 can be unwanted noise when detecting the user's gaze.
[0148] According to embodiments of this disclosure, the first incident light IL1 can be initially polarized by a quarter-wave plate 174 disposed on a straight path. The first incident light IL1 can also be circularly polarized by the quarter-wave plate 174. Here, the first incident light IL1 can be unpolarized light comprising multiple polarization components vibrating in various directions, and the light polarized from the first incident light IL1 by the quarter-wave plate 174 can still be unpolarized light comprising multiple polarization components vibrating in various directions. The light circularly polarized from the first incident light IL1 by the quarter-wave plate 174 can be a first polarized light PL1_1. The first polarized light PL1_1 can travel towards the light receiver 1520.
[0149] The first polarized light PL1_1 can be repolarized by a first polarizer 130 positioned on a straight path. The first polarizer 130 can also linearly polarize the first polarized light PL1_1. The first polarizer 130 can filter the first polarized light PL1_1 into a polarization component vibrating in a first direction. The light polarized from the first polarized light PL1_1 by the first polarizer 130 can be a second polarized light PL1_2. The second polarized light PL1_2 can travel towards the light receiver 1520.
[0150] The second polarized light PL1_2 can be polarized a third time by a second polarizer 140 positioned on the straight path. The second polarizer 140 can also linearly polarize the second polarized light PL1_2. The second polarizer 140 can block the second polarized light PL1_2 that has been repolarized by the first polarizer 130. The second polarizer 140 can filter the second polarized light PL1_2 into a polarization component vibrating in a second direction perpendicular to the first direction. Finally, the quarter-wave plate 174, the first polarizer 130, and the second polarizer 140 can block the first incident light IL1. The first incident light IL1 may not reach the optical receiver 1520. In other words, the AR device 1000 can block the first incident light IL1 by using the quarter-wave plate 174, the first polarizer 130, and the second polarizer 140.
[0151] Figure 9b This is a conceptual diagram illustrating a method for ensuring a user's field of view through the configuration of an AR device according to embodiments of the present disclosure. For ease of description, details will now be provided... Figure 9a The descriptions are different.
[0152] Figure 9b The diagram illustrates the operation of a second incident light IL2 emitted from a second external light source 20 being sequentially polarized by a quarter-wave plate 174 and a first polarizing plate 130. Figure 9b This is a conceptual diagram showing the path of the second incident light IL2 traveling from the second external light source 20 toward the user's eye E.
[0153] Reference Figure 9b According to the disclosed embodiments, the second incident light IL2 may be light emitted from the second external light source 20 and then traveling toward the user's eye E. The user can ensure the forward field of view on the AR device through the second incident light IL2.
[0154] The second incident light IL2 may include light emitted from the second external light source 20. The second incident light IL2 may be, for example, light polarized in the second direction Y, and may be, for example, light emitted from a display device relating to an image. The second incident light IL2 may include light traveling in a straight line from the second external light source 20 toward the user's eye. The second incident light IL2 may be light used by the user to identify the second external light source 20. The user can identify the second external light source 20 based on the second incident light IL2.
[0155] According to embodiments of this disclosure, the second incident light IL2 can be initially polarized by a quarter-wave plate 174 disposed on a straight path. The second incident light IL2 can be circularly polarized by the quarter-wave plate 174. For example, the second incident light IL2 incident on the quarter-wave plate 174 can be polarized according to right-hand circular polarization (RHCP). The light circularly polarized from the second incident light IL2 by the quarter-wave plate 174 can be a first polarized light PL2_1. The first polarized light PL2_1 can travel towards the light receiver 1520.
[0156] The first polarized light PL2_1 can be repolarized by a first polarizing plate 130 positioned on a straight path. The first polarizing light PL2_1 can be linearly polarized by the first polarizing plate 130. The first polarizing light PL2_1 can be filtered into a polarization component vibrating in a first direction by the first polarizing plate 130.
[0157] Because the first polarized light PL2_1, which previously vibrated in the second direction, is circularly polarized by the quarter-wave plate 174, the polarized component vibrating in the first direction can still pass through the first polarizing plate 130 even when the first polarizing plate 130 polarizes the first polarized light PL2_1. The polarized component transmitted in the first direction by the first polarized light PL2_1 can be the second polarized light PL2_2. The second polarized light PL2_2 can reach the user's eye. The user can identify the second external light source 20 based on the second polarized light PL2_2.
[0158] Figure 10 This is a conceptual diagram illustrating a process for blocking noise according to embodiments of the present disclosure.
[0159] Figure 10 The diagram illustrates the shift in polarization direction of light passing through the quarter-wave plate 174, the first polarizer 130, and the second polarizer 140 according to an embodiment. For ease of description, details related to... are simplified or omitted. Figure 5 The description in Figure 9 is redundant.
[0160] according to Figure 10 In the embodiment shown, the types of light emitted from the external light source are classified as a fourth light L4 traveling toward the light receiver and a fifth light L5 incident on the user's eyeball. Specifically, the types of light are classified as the fourth light L4 emitted from the first external light source 10 and then traveling toward the light receiver, and the fifth light L5 emitted from the second external light source 20 and then incident on the user's eyeball.
[0161] According to embodiments of this disclosure, an external light source, including a first external light source 10 and a second external light source 20, can emit light. The external light source can be, for example, the sun, or, as another example, a display. The external light source can emit unpolarized light, polarized light vibrating in a first direction X, or polarized light vibrating in a second direction Y. The second direction Y can be perpendicular to the first direction X.
[0162] According to embodiments of this disclosure, the fourth light L4 may be light traveling toward the light receiver 1520. The fourth light L4 may be a reference light. Figure 9a The first incident light IL1 is described. The fourth light L4 can act as noise when the AR device detects the user's line of sight. The AR device 1000 can be configured such that a quarter-wave plate 174, a first polarizer 130, and a second polarizer 140 are disposed in the path of the fourth light L4, and the fourth light L4 can be blocked by the quarter-wave plate 174, the first polarizer 130, and the second polarizer 140.
[0163] In detail, in Example 1, the first external light source 10 can emit a fourth light L4 polarized in the first direction X. The fourth light L4 polarized in the first direction X can be circularly polarized according to left-hand circular polarization (LHCP) by a quarter-wave plate 174.
[0164] The fourth light L4, which is circularly polarized according to LHCP, can be polarized in the first direction X by the first polarizing plate 130.
[0165] The fourth light L4, which is polarized in the first direction X, can be polarized in the second direction by the second polarizing plate 140. The fourth light L4, which is polarized in the first direction X, can be blocked by the second polarizing plate 140. Therefore, the unpolarized fourth light L4 is blocked by the first polarizing plate 130 and the second polarizing plate 140 and will not reach the light receiver 1520.
[0166] In Example 3, the external light source 10 can emit a fourth light L4 polarized in the second direction Y. The fourth light L4 polarized in the second direction Y can be circularly polarized according to RHCP by a quarter-wave plate 174.
[0167] The fourth light L4, which is polarized according to RHCP, can be polarized in the first direction X by the first polarizing plate 130.
[0168] The fourth light L4, which is polarized in the first direction X, can be polarized in the second direction by the second polarizing plate 140. The fourth light L4, which is polarized in the first direction X, can be blocked by the second polarizing plate 140. Therefore, the unpolarized fourth light L4 is blocked by the first polarizing plate 130 and the second polarizing plate 140 and will not reach the light receiver 1520.
[0169] In Example 5, the first external light source 10 can emit an unpolarized fourth light L4. The unpolarized fourth light L4 can be light comprising multiple polarization components vibrating in various directions. The unpolarized fourth light L4 can be phase-shifted by 90° by a quarter-wave plate 174. The fourth light L4 polarized by the quarter-wave plate 174 is the result of phase-shifting each of the multiple polarization components of the unpolarized fourth light L4 by 90°, and can still be unpolarized light comprising multiple polarization components vibrating in various directions.
[0170] The unpolarized fourth light L4 can be polarized in the first direction by the first polarizing plate 130. The polarization component of the unpolarized fourth light L4 vibrating in the first direction can be transmitted through the first polarizing plate 130, and the polarization component of the unpolarized fourth light L4 vibrating in a direction different from the first direction can be blocked by the first polarizing plate 130.
[0171] The fourth light L4, which is polarized in the first direction X, can be polarized in the second direction by the second polarizing plate 140. The fourth light L4, which is polarized in the first direction X, can be blocked by the second polarizing plate 140. Therefore, the unpolarized fourth light L4 is blocked by the first polarizing plate 130 and the second polarizing plate 140 and will not reach the light receiver 1520.
[0172] According to embodiments of this disclosure, the fifth light L5 can be light traveling toward the user's eyeball. The user can ensure their field of vision based on the fifth light L5. For example, the fifth light L5 can be image light emitted from a display device, and the user can view an image based on the fifth light L5. The fifth light L5 can be used to ensure the user's field of vision. In example cases where the fifth light L5 does not reach the user's eyeball, the user may not be able to ensure their field of vision based on the fifth light L5.
[0173] Although the fourth beam L4 and the fifth beam L5 are emitted from their respective external light sources, the fourth beam L4 may act as noise when it reaches the light receiver 1520. Therefore, it is necessary to block the fourth beam L4, and the fifth beam L5 must reach the user's eyeball to ensure the user's field of vision. The AR device 1000 can be configured such that a quarter-wave plate 174, a first polarizer 130, and a second polarizer 140 are sequentially arranged in the path of the fourth beam L4, and the fourth beam L4 can be blocked by the quarter-wave plate 174, the first polarizer 130, and the second polarizer 140. The AR device 1000 can also be configured such that a quarter-wave plate 174 and a first polarizer 130 are sequentially arranged in the path of the fifth beam L5, and the fifth beam L5 can pass through the quarter-wave plate 174 and the first polarizer 130.
[0174] In detail, in Example 2, the second external light source 20 can emit a fifth light L5 polarized in the first direction X. The fifth light L5 polarized in the first direction X can be circularly polarized according to LHCP by a quarter-wave plate 174.
[0175] The fifth light L5, which is circularly polarized according to LHCP, can be polarized in the first direction X by the first polarizer 130. The fifth light L5 polarized in the first direction X can reach the user's eyeball. The user can ensure the forward field of vision based on the fifth light L5 polarized in the first direction X. For example, the user can identify the image light L12 polarized in the first direction X and view the image based on the image light L12.
[0176] In Example 4, the second external light source 20 can emit a fifth light L5 polarized in the second direction Y. The fifth light L5 polarized in the second direction Y can be circularly polarized according to RHCP by a quarter-wave plate 174.
[0177] The fifth light L5, which is circularly polarized according to RHCP, can be polarized in the first direction X by the first polarizer 130. The fifth light L5 polarized in the first direction X can reach the user's eye. The user can ensure the forward field of view based on the fifth light L5 polarized in the first direction X. For example, the user can identify the image light L12 polarized in the first direction X and view the image based on the image light.
[0178] In Example 6, the second external light source 20 can emit an unpolarized fifth light L5. The unpolarized fifth light L5 can be light comprising multiple polarization components vibrating in various directions. The unpolarized fifth light L5 can be phase-shifted by 90° by a quarter-wave plate 174. The fifth light L5 polarized by the quarter-wave plate 174 is the result of phase-shifting each of the multiple polarization components of the unpolarized fifth light L5 by 90°, and can still be unpolarized light comprising multiple polarization components vibrating in various directions.
[0179] The unpolarized fifth light L5 can be polarized in the first direction by the first polarizing plate 130. The polarization component of the unpolarized fifth light L5 vibrating in the first direction can be transmitted through the first polarizing plate 130, and the polarization component of the unpolarized fifth light L5 vibrating in a direction different from the first direction can be blocked by the first polarizing plate 130.
[0180] A fifth light L5, polarized in the first direction X, can reach the user's eye. The user can ensure their forward field of vision based on the fifth light L5 polarized in the first direction X. For example, the user can identify the image light L12 polarized in the first direction X and view the image based on the image light.
[0181] Figure 11 This is a flowchart describing the operation of blocking noise according to embodiments of the present disclosure.
[0182] For ease of description, simplification or omission of [related terms] Figures 1 to 10 The description is redundant.
[0183] Reference Figure 11 In operation S1110, the method may include receiving light reflected from a user's eye. For example, an AR device may receive light reflected from a user's eye via a light receiver.
[0184] According to embodiments of this disclosure, an AR device may include: a waveguide and a processor for providing AR to a user; a gaze detection module, including a light emitter and a light receiver, for detecting the user's gaze; and a first polarizer and a second polarizer for filtering noise from light to be received by the light receiver.
[0185] An optical emitter can emit light. For example, an optical emitter can be mounted on a waveguide and can emit light toward a user's eye. The light emitted from the optical emitter can be reflected by the user's eye, reflected by the waveguide, and then received by an optical receiver. According to embodiments of this disclosure, an optical reflector is attached to the waveguide, thereby improving the light reflection efficiency.
[0186] An external light source can also emit light toward the user's eyes. The light emitted from the external light source can be reflected by the user's eyes, reflected by the waveguide, and then received by a light receiver. According to embodiments of this disclosure, a light reflector is attached to the waveguide, thereby improving the light reflection efficiency.
[0187] Light can be emitted from a light emitter or an external light source toward the user's eye. The light reflected from the user's eye can be used as signal light to track the user's gaze.
[0188] According to embodiments of this disclosure, noise light can be emitted from an external light source toward a light receiver. The noise light can be unwanted noise when tracking a user's gaze. The AR device can block the noise light by using a first polarizing plate and a second polarizing plate.
[0189] The light traveling toward the light receiver may include signal light and noise light. According to embodiments of this disclosure, the AR device can block noise light by using a first polarizer and a second polarizer, and can obtain the user's gaze information based on the signal light obtained by using the light receiver. According to embodiments of this disclosure, the AR device can block noise light by using a quarter-wave plate, a first polarizer, and a second polarizer, and can obtain the user's gaze information based on the signal light obtained by using the light receiver.
[0190] For example, an AR device can polarize noise light in a first direction using a first polarizer. The AR device can also polarize noise light in a second direction using a second polarizer. The second direction may be perpendicular to the first direction. Therefore, noise light polarized in the first direction by the first polarizer can be blocked by the second polarizer, which polarizes the incident light in the second direction. An AR device can block noise light by using both a first polarizer and a second polarizer.
[0191] In operation S1120, the method may include obtaining the user's gaze information based on the received light. For example, an AR device may obtain the user's gaze information based on the received signal light.
[0192] According to embodiments of this disclosure, the received signal light does not include noise light emitted directly from an external light source to the light receiver. The received signal light may be light reflected from the user's eyeball and may be used when detecting the user's gaze. The AR device can obtain the user's gaze information based on the received signal light.
[0193] According to embodiments of this disclosure, the AR device can detect features related to the user's eye gaze. For example, the AR device can detect the positions of pupil feature points and bright spot feature points of the user's eyes. The pupil feature point can be the center point of the pupil, and the bright spot feature point can be a point from the detection area of the eye with a brightness equal to or greater than a preset value. The positions of the pupil feature points and bright spot feature points can be identified by coordinate values indicating their positions in the coordinate system of a light receiver. For example, the coordinate system of the light receiver can be the coordinate system of an IR camera or an IR detector, and the coordinate values in the coordinate system of the light receiver can be 2D coordinate values.
[0194] AR devices can detect features related to the eye's gaze by analyzing light received by a light receiver. In an example scenario where the light receiver is an IR camera, the AR device can identify the location of pupil feature points and bright spot feature points from an image captured by the IR camera.
[0195] AR devices can detect the position of a user's pupil based on received signal light. In an example where the light receiver is an IR camera, the AR device can identify the position of the user's pupil in an image captured by the IR camera.
[0196] AR devices can identify the position of a user's pupil by recognizing the center point of the pupil based on the received signal light.
[0197] AR devices can obtain information about a user's gaze based on received signal light. The AR device can calculate the position of the center of the user's eye. The center of the user's eye can be the center of the user's eyeball.
[0198] AR devices can calculate the position of the user's gaze point. Furthermore, the user's gaze direction can be determined based on the calculated position of the eye center and the calculated gaze point.
[0199] According to embodiments of this disclosure, an AR device may include a waveguide, a support portion, a light receiver, a first polarizer, a second polarizer, and at least one processor. The support portion may be configured to attach the AR device to a user's face. The light receiver may be mounted on the support portion. The first polarizer may be configured to polarize noise light traveling toward the light receiver; and the second polarizer may be configured to block polarized noise light from the first polarizer from reaching the light receiver. At least one processor may be configured to obtain user gaze information based on light reflected from the user's eyeball and received via the light receiver. Noise light traveling toward the light receiver may be linearly polarized in a first direction by the first polarizer. Linearly polarized light from the noise light may be blocked by the second polarizer.
[0200] According to embodiments of this disclosure, the support portion may include a temple extending from a frame adjacent to the waveguide and positioned on the user's ear. The support portion may also include a nose support portion extending from the frame and positioned on the user's nose. A light receiver may be mounted on the temple.
[0201] According to embodiments of this disclosure, a first polarizing plate may be disposed on a waveguide.
[0202] According to embodiments of this disclosure, a second polarizing plate may be disposed on the optical receiver.
[0203] According to embodiments of this disclosure, a first polarizing plate and a second polarizing plate may be sequentially disposed on the path of noise light emitted from an external light source toward a light receiver.
[0204] According to embodiments of this disclosure, a first polarizer may be configured to linearly polarize transmitted light in a first direction. A second polarizer may be configured to linearly polarize the transmitted light in a second direction perpendicular to the first direction.
[0205] According to embodiments of this disclosure, the AR device may also include a light reflector coated on a waveguide.
[0206] According to embodiments of this disclosure, the AR device may further include a light emitter. The light obtained via the light receiver may include a first signal light emitted from an external light source and reflected from the user's eyeball, and a second signal light emitted from the light emitter and reflected from the user's eyeball.
[0207] According to embodiments of this disclosure, an optical transmitter may be disposed on a waveguide.
[0208] According to embodiments of this disclosure, the support portion may include temples extending from a frame adjacent to the waveguide and positioned on the user's ear. A light emitter may be mounted on the temples.
[0209] According to embodiments of this disclosure, the AR device may further include a quarter-wave plate configured to circularly polarize transmitted light. The quarter-wave plate can be used to circularly polarize noise light. A first polarizing plate can be used to linearly polarize light from the circularly polarized noise light in a first direction. A second polarizing plate can be used to block light from the circularly polarized noise light.
[0210] According to embodiments of this disclosure, a quarter-wave plate, a first polarizer, and a second polarizer may be sequentially arranged on the path of the noise light emitted from an external light source toward the light receiver.
[0211] According to embodiments of this disclosure, a quarter-wave plate may be disposed on a waveguide.
[0212] According to embodiments of the present disclosure, a method may include: obtaining user gaze information based on light reflected from a user's eyeball and obtained by a light receiver; polarizing noise light traveling toward the light receiver via a first polarizing plate; and blocking linearly polarized noise light from reaching the light receiver via a second polarizing plate.
[0213] According to embodiments of this disclosure, noise light can be blocked by a first polarizing plate and a second polarizing plate, which are sequentially arranged on the path of noise light emitted directly from an external light source toward the light receiver to reach the light receiver.
[0214] According to embodiments of this disclosure, a first polarizer may be configured to linearly polarize the transmitted light in a first direction. A second polarizer may be configured to linearly polarize the transmitted light in a second direction perpendicular to the first direction.
[0215] According to embodiments of this disclosure, the light obtained via the light receiver may include a first signal light emitted from an external light source and reflected from the user's eyeball, and a second signal light emitted from a light emitter and reflected from the user's eyeball.
[0216] According to embodiments of this disclosure, noise light can be circularly polarized using a quarter-wave plate configured to circularly polarize transmitted light. Light circularly polarized from the noise light can be linearly polarized in a first direction using a first polarizing plate. Light polarized from the noise light can be blocked using a second polarizing plate.
[0217] According to embodiments of this disclosure, noise light can be blocked by a quarter-wave plate, a first polarizer, and a second polarizer sequentially disposed on the path of noise light emitted directly from an external light source toward the light receiver.
[0218] To address the aforementioned problems, embodiments of this disclosure provide a computer-readable recording medium on which a program to be executed on a computer is recorded.
[0219] Machine-readable storage media may be provided in the form of non-transitory storage media. In this respect, the term "non-transitory storage media" simply means that the storage media is a tangible device and does not include signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently in the storage media and cases where data is temporarily stored in the storage media. For example, a non-transitory storage media may include a buffer for temporarily storing data.
[0220] According to embodiments of this disclosure, methods according to various embodiments of this disclosure can be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)), or distributed online via an app store (e.g., downloaded or uploaded), or directly between two user devices (e.g., smartphones). For electronic distribution, at least a portion of the computer program product (e.g., a downloadable application) can be temporarily generated or at least temporarily stored in a machine-readable storage medium (e.g., the memory of a manufacturer's server, an app store's server, or a relay server).
Claims
1. An augmented reality (AR) device, comprising: waveguide; The support portion is configured to attach the AR device to the user's face; A light receiver is disposed on the support portion; At least one processor is configured to obtain the user's gaze information based on light reflected from the user's eyeball and obtained by the light receiver; A first polarizing plate is configured to polarize noise light traveling toward the light receiver; as well as A second polarizing plate is configured to block the noise light polarized from the first polarizing plate from reaching the light receiver.
2. The AR device according to claim 1, wherein, A first polarizer is placed on the waveguide.
3. The AR device according to any one of claims 1 to 2, wherein, A second polarizer is placed on the optical receiver.
4. The AR device according to any one of claims 1 to 3, wherein, The first polarizer and the second polarizer are placed sequentially in the path of the noise light emitted from the external light source toward the light receiver.
5. The AR device according to any one of claims 1 to 4, wherein, The first polarizer is configured to linearly polarize the noise light in a first direction, and The second polarizer is configured to linearly polarize the linearly polarized noise light in a second direction perpendicular to the first direction.
6. The AR device according to any one of claims 1 to 5, further comprising: A light reflector is coated on the waveguide.
7. The AR device according to any one of claims 1 to 6, further comprising: A quarter-wave plate is configured to circularly polarize the noisy light. The first polarizer is configured to linearly polarize the circularly polarized noise light in a first direction, and The second polarizing plate is configured to block the linearly polarized noise light from the first polarizing plate.
8. The AR device according to claim 7, wherein, The quarter-wave plate, the first polarizer, and the second polarizer are sequentially arranged on the path of the noise light emitted from the external light source toward the light receiver.
9. The AR device according to any one of claims 7 and 8, wherein, The quarter-wave plate is disposed on the waveguide.
10. A method for tracking a user's gaze, the method comprising: The user's gaze information is obtained based on light reflected from the user's eyeball and received by a light receiver; The noise light rays traveling toward the light receiver are polarized by a first polarizing plate; as well as The second polarizer blocks the linearly polarized noise light from reaching the light receiver.
11. The method according to claim 10, wherein, The first polarizer and the second polarizer are sequentially positioned on the path of the noise light emitted from the external light source toward the light receiver.
12. The method according to any one of claims 10 and 11, further comprising: The noise light is linearly polarized in a first direction by a first polarizing plate, and The linearly polarized noise light is linearly polarized in a second direction perpendicular to the first direction by a second polarizing plate.
13. The method according to any one of claims 10 to 12, further comprising: The noise light is circularly polarized by a quarter-wave plate. The circularly polarized noise light is linearly polarized in a first direction by the first polarizing plate, and The linearly polarized noise light is linearly polarized in a second direction perpendicular to the first direction by a second polarizing plate.
14. The method according to claim 13, wherein, The noise light is blocked by a quarter-wave plate, a first polarizer, and a second polarizer, which are sequentially positioned along the path of the noise light emitted from an external light source toward the light receiver.
15. A computer-readable recording medium having a program recorded thereon for performing the method according to any one of claims 10 to 14 on a computer.