Augmented reality device and method for detecting user's gaze
By using polarizing plates to filter noise light, the accuracy of gaze detection in augmented reality devices is improved by blocking external light interference, enhancing the precision of gaze tracking systems.
Patent Information
- Application Number
- PCT/KR2024/096627
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-31
- Filing Date
- 2024-11-18
- Publication Date
- 2025-08-07
AI Technical Summary
External light entering AR devices through cameras positioned on the temples interferes with accurate gaze detection, degrading the performance of camera-based gaze tracking systems.
Incorporation of a first and second polarizing plate to filter and block noise light, allowing only signal light reflected from the user's eye to be detected by the light receiving unit.
Enhances the accuracy of gaze detection by reducing interference from external light, thereby improving the precision of gaze tracking in augmented reality devices.
Smart Images

Figure KR2024096627_07082025_PF_FP_ABST
Abstract
Description
Augmented reality device and method for detecting a user's gaze
[0001] The present disclosure relates to an augmented reality device and method for detecting a user's gaze, and more particularly, to an augmented reality device and method for removing unnecessary light for detecting a user's gaze.
[0002] Augmented reality (AR) is a technology that projects virtual images onto real-world physical spaces or objects, creating a single image. AR devices are worn on the user's face or head, allowing them to view real-world scenes and virtual images simultaneously. For example, see-through displays such as waveguides can be used.
[0003] As research into these AR devices continues, various types of wearable devices are being released or are expected to be released. New glasses-type AR devices sometimes feature cameras positioned on the temples to track the user's gaze. In these cases, because the camera faces the outside of the glasses, external light entering from outside the glasses can act as noise. The greater the noise, the less accurate the camera-based gaze detection becomes.
[0004] In order to solve the above-described technical problem, an augmented reality device according to an embodiment of the present disclosure may include a waveguide, a support, a light receiving unit, a first polarizing plate, a second polarizing plate, and at least one processor. The support unit may be configured to secure the augmented reality device to a user's face. The light receiving unit may be provided on the support unit. At least one processor may be configured to obtain gaze information of the user based on light reflected from the user's eye and obtained through the light receiving unit. The first polarizing plate, which is configured to move toward the light receiving unit, may be configured to polarize noise light moving toward the light receiving unit. The second polarizing plate may be configured to block polarized noise light from the first polarizing plate from reaching the light receiving unit.
[0005] In order to solve the above-described technical problem, a method for tracking a user's gaze according to an embodiment of the present disclosure may include a step of obtaining information about the user's gaze based on light reflected from the user's eye and acquired through a light receiving unit. The method may include a step of linearly polarizing noise light traveling toward the light receiving unit using a first polarizing plate. The method may include a step of blocking the linearly polarized noise light from reaching the light receiving unit using a second polarizing plate.
[0006] In order to solve the above-described technical problem, one embodiment of the present disclosure provides a computer-readable recording medium having recorded thereon a program to be executed on a computer.
[0007] FIG. 1 is a drawing showing an example of an augmented reality device according to one embodiment of the present disclosure.
[0008] FIG. 2 is a block diagram of an augmented reality device according to an embodiment of the present disclosure.
[0009] FIG. 3 is a conceptual diagram for explaining in detail the configuration of an augmented reality device according to one embodiment of the present disclosure.
[0010] FIG. 4 is a conceptual diagram illustrating a method for blocking noise by a configuration of an augmented reality device according to an embodiment of the present disclosure.
[0011] FIG. 5 is a conceptual diagram illustrating a process of blocking noise according to one embodiment of the present disclosure.
[0012] FIG. 6 is a conceptual diagram illustrating a method for blocking noise in an augmented reality device according to an embodiment of the present disclosure.
[0013] FIG. 7 is a conceptual diagram illustrating the configuration of an augmented reality device according to one embodiment of the present disclosure.
[0014] FIG. 8 is a conceptual diagram illustrating the configuration of an augmented reality device according to an embodiment of the present disclosure.
[0015] FIG. 9A is a conceptual diagram illustrating a method for blocking noise by a configuration of an augmented reality device according to an embodiment of the present disclosure.
[0016] FIG. 9b is a conceptual diagram illustrating a method for securing a user's field of view by configuring an augmented reality device according to an embodiment of the present disclosure.
[0017] FIG. 10 is a conceptual diagram illustrating a process of blocking noise according to one embodiment of the present disclosure.
[0018] FIG. 11 is a flowchart illustrating an operation for blocking noise according to one embodiment of the present disclosure.
[0019] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, for the purpose of clearly explaining the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar parts are designated with similar reference numerals throughout the specification.
[0020] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where the parts are "directly connected" but also the cases where the parts are "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather includes other components, unless otherwise stated.
[0021] Embodiments of the present disclosure may be described in terms of blocks that perform the described functions. These blocks, which may be referred to herein as managers, units, modules, hardware components, etc., are physically implemented by analog and / or digital circuits such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hard-wired circuits, etc., and may optionally be driven by firmware. The circuits may be implemented on, for example, one or more semiconductor chips or a substrate support such as a printed circuit board. The circuits constituting the blocks may be implemented by dedicated hardware or processors (e.g., one or more programmed microprocessors and associated circuitry), or a combination of dedicated hardware that performs some functions of the block and processors that perform other functions of the block. Each block of the embodiments may be physically separated into two or more interacting individual blocks without departing from the scope of the present disclosure. Similarly, the blocks of the embodiments may be physically combined into more complex blocks without departing from the scope of the present disclosure. As used herein, elements expressed as, for example, '...unit', '...module', etc. may represent a unit in which two or more elements are combined into one element or one element is divided into two or more elements depending on its function. In addition, each element described below may additionally perform some or all of the functions of other elements in addition to its main function, and some of the main functions of each element may be exclusively performed by other elements. In the present disclosure, 'Augmented Reality (AR)' means displaying a virtual image together in a physical space of the real world or displaying a real object and a virtual image together.
[0022] In addition, the term 'Augmented Reality Device' refers to a device that can express 'Augmented Reality', and generally includes not only the Augmented Reality Glasses device in the form of glasses that the user wears on the face, but also the Head Mounted Display Apparatus (HMD) that is worn on the head, or the Augmented Reality Helmet.
[0023] Meanwhile, a "real scene" refers to a real-world scene viewed by a user through an AR device, and may include real-world objects. Furthermore, a "virtual image" refers to an image generated by an optical engine and may include both static and dynamic images. These virtual images are observed alongside the real scene and may contain information about real objects within the real scene, information about the operation of the AR device, or control menus.
[0024] Therefore, a typical augmented reality device includes an optical engine for generating a virtual image composed of light generated from a light source, and a waveguide formed of a transparent material to guide the virtual image generated by the optical engine to the user's eyes and also allow the user to view scenes from the real world. As described above, the augmented reality device must be able to observe scenes from the real world as well, so in order to guide the light generated by the optical engine to the user's eyes through the waveguide, an optical element is required to change the path of the light, which basically has a straight path. At this time, the light path can be changed by using reflection by a mirror, etc., or the light path can be changed by diffraction by a diffractive optical element such as a DOE (Diffractive optical element) or a HOE (Holographic optical element), but is not limited thereto.
[0025] The present disclosure will be described in detail with reference to the attached drawings below.
[0026] FIG. 1 is a drawing showing an example of an augmented reality device according to one embodiment of the present disclosure.
[0027] Referring to FIG. 1, the augmented reality device (1000) can block noise light transmitted from an external light source. For example, the augmented reality device (1000) can include a first polarizing plate (130) and a second polarizing plate (140) for blocking noise light. The noise light can include light generated from an external light source. The noise light can include light that has traveled straight from the external light source toward the light receiving unit (1520). The noise light can include light that has traveled from the external light source toward the light receiving unit (1520) without being reflected by the user's eyes.
[0028] In one embodiment, the augmented reality device (1000) receives light through a light receiving unit (1520), and the augmented reality device (1000) can detect the user's gaze based on the received light. The received light may include light from which noise light has been filtered by the first polarizing plate (130) and the second polarizing plate (140).
[0029] For example, light traveling toward the light receiver may include signal light and noise light. Signal light may include light reflected from the user's eye and used to detect the user's gaze. Noise light may include light that is not reflected from the user's eye and is unnecessary for detecting the user's gaze. For example, noise light may include light traveling directly toward the light receiver from an external light source.
[0030] For example, FIG. 1 schematically describes the configuration of an augmented reality device (1000) according to one embodiment of the present disclosure, and FIGS. 2 to 10 specifically describe a method for blocking noise according to one embodiment.
[0031] The augmented reality device (1000) may include a glasses-type display device and a glasses-type body configured to be worn by a user.
[0032] The glasses-type body may include a frame (110) and a support (190; 191, 192), wherein the support (190) may be used to secure the augmented reality device (1000) to the face of a user of the augmented reality device. The support (190) may extend from the frame (110) and be used to secure the augmented reality device to the head of the user. The support (190) may include a temple (191; 191L, 191R) and a nose support (192; 192L, 192R).
[0033] The temple (191) may be extended from the frame (110) around the waveguide (170) and used to secure the augmented reality device (1000) to the user's head. For example, the temple (191) may be positioned on the side of the glasses-type body. The temple (191) may be extended from the frame (110) and used to secure the augmented reality device (1000) to the user's ear.
[0034] The nose support (192) may be extended from the frame (110) and used to secure the augmented reality device (1000) to the user's nose, and may include, but is not limited to, a nose bridge and a glasses nose.
[0035] Additionally, a waveguide (170) having a first polarizing plate (130) attached thereto may be positioned on the frame (110). The frame may be formed to surround an outer circumference of the waveguide (170), and the waveguide (170) may be configured to receive projected light in an input region and output at least a portion of the input light in an output region. The waveguide (170) may include a left-eye waveguide (170L) and a right-eye waveguide (170R).
[0036] The waveguide (170) is configured to transmit the first light of the virtual image generated by the optical engine (120) and the light of the external scene to the user's pupil. The waveguide (170) may have a flat plate shape. The waveguide (170) may be formed of a single-layer or multi-layer structure of a transparent material through which light can be propagated while being reflected internally. Here, the transparent material means a material through which light in the visible light band can pass, and the transparency may not be 100% and may have a predetermined color. Since the waveguide (170) is formed of a transparent material, the user can view not only the virtual image but also the real scene through the augmented reality device (1000), and thus the augmented reality device (1000) can implement augmented reality. The waveguide (170) may be provided in each of the left and right eyes corresponding to the optical engine (120), or may be provided in only one of them.
[0037] Additionally, the optical engine (120) of the projector that projects display light containing an image may include a left-eye optical engine (120L) and a right-eye optical engine (120R). The left-eye optical engine (120L) and the right-eye optical engine (120R) may be located on both sides of the augmented reality device (1000). Alternatively, one optical engine (120) may be included in a central portion around the nose support (192) of the augmented reality device (1000). The light emitted from the optical engine (120) may be displayed through a waveguide (170).
[0038] The light receiving unit (1520) of the gaze detection module (1500) may be installed in the support unit (190). The light receiving unit (1520) may be placed on the inner side of the support unit (190) of the augmented reality device (1000), which is a location between the support unit (190) and the user's eyes. The light receiving unit (1520) may be placed so as to face the waveguide (170) in the support unit (190) of the augmented reality device (1000). For example, the light receiving unit (1520) may be placed at a position spaced apart from the frame by about 10 mm to 15 mm among the sides of the temple (191) of the augmented reality device (1000) so as to emit and receive IR light without being obstructed by the user's hair, etc.
[0039] The light emitting unit (1510) of the gaze detection module (1500) may be disposed on an inner side portion of the frame (110) between the frame (110) of the augmented reality device (1000) and the user's eyes. The light emitting unit (1510) may be disposed to emit light from the frame (110) of the augmented reality device (1000) toward the user's eyes. The light emitting unit (1510) may be disposed at a location spaced apart from the user's forward field of vision among the inner side of the frame (110) so as not to restrict the user's field of vision. For example, the light emitting unit (1510) may be disposed adjacent to the nose support unit (192) among the inner side of the frame (110).
[0040] However, although the light emitting unit (1510) in FIG. 1 is illustrated as being positioned on the inner side of the frame (110) of the augmented reality device (1000), the position of the light emitting unit (1510) does not limit the technical idea of the present disclosure. For example, the light emitting unit (1510) may be positioned on the inner side of the support unit (190) of the augmented reality device (1000), which is a position between the support unit (190) and the user's eyes.
[0041] The first polarizing plate (130) is configured to linearly polarize transmitted light. The first polarizing plate (130) can transmit a light component vibrating in a first direction among external incident light and block a light component vibrating in a direction different from the first direction. For example, light emitted from an external light source located in front of the augmented reality device (1000) can be polarized in the first direction by transmitting through the first polarizing plate (130).
[0042] The first polarizing plate (130) may include a first polarizing plate (130L) for the left eye and a first polarizing plate (130R) for the right eye. The first polarizing plate (130L) for the left eye and the waveguide (170L) for the left eye may be positioned corresponding to the user's left eye, and the first polarizing plate (130R) for the right eye and the waveguide (170R) for the right eye may be positioned corresponding to the user's right eye. For example, the first polarizing plate (130L) for the left eye may be attached to the waveguide (170L) for the left eye, or the first polarizing plate (130R) for the right eye may be attached to the waveguide (170R) for the right eye, but is not limited thereto. Additionally, for example, the first polarizing plate (130L) for the left eye may be attached to the left eye waveguide (170L) by being coated on the inner surface of the left eye waveguide (170L), or the first polarizing plate (130R) for the right eye may be attached to the right eye waveguide (170R) by being coated on the inner surface of the right eye waveguide (170R).
[0043] The second polarizing plate (140) is configured to linearly polarize transmitted light. The second polarizing plate (140) is configured to filter a light component polarized in a first direction by the first polarizing plate (130) in a second direction. The first direction may be perpendicular to the second direction. The second polarizing plate (140) polarizes the light component polarized in the first direction by the first polarizing plate (130) in a second direction perpendicular to the first direction, thereby blocking the light component polarized in the first direction. The second polarizing plate (140) can transmit a light component vibrating in the second direction among external incident light, and block a light component vibrating in a direction different from the second direction. For example, a light component polarized in the first direction by the first polarizing plate (130) of the augmented reality device (1000) can be blocked by transmitting it through the second polarizing plate (140).
[0044] The first polarizing plate (130) and the second polarizing plate (140) are configured to linearly polarize the transmitted light in mutually perpendicular directions. The method for linearly polarizing the transmitted light in mutually perpendicular directions does not limit the technical idea of the present disclosure. For example, the first polarizing plate (130) and the second polarizing plate (140) may be configured to linearly polarize the transmitted light in mutually perpendicular directions through the same configuration or different arrangements. The first polarizing plate (130) and the second polarizing plate (140) may be sequentially arranged on the path along which noise light directly emitted from an external light source toward the light receiving unit (1520) reaches the light receiving unit (1520).
[0045] FIG. 2 is a block diagram of an augmented reality device according to an embodiment of the present disclosure.
[0046] Referring to FIG. 2, an augmented reality device (1000) according to one embodiment of the present disclosure may include a user input unit (1100), a microphone (1200), a display unit (1300), a noise blocking unit (1400), a gaze detection module (1500), a communication interface (1600), a storage unit (1700), and a processor (1800). In addition, the noise blocking unit (1400) may include a first polarizing plate (1410) and a second polarizing plate (1420), and the gaze detection module (1500) may include a light emitting unit (1510) and a light receiving unit (1520).
[0047] The user input unit (1100) refers to a means for a user to input data for controlling the augmented reality device (1000). For example, the user input unit (1100) may include, but is not limited to, at least one of a key pad, a dome switch, a touch pad (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, or a jog switch.
[0048] The microphone (1200) receives an external acoustic signal and processes it into electrical voice data. For example, the microphone (1200) can receive an acoustic signal from an external device or a speaker. Various noise removal algorithms can be used to remove noise generated during the process of receiving an external acoustic signal through the microphone (1200). The microphone (1200) can receive a user's voice input for controlling the augmented reality device (1000).
[0049] The display unit (1300) displays and outputs information processed in the augmented reality device (1000). For example, the display unit (1300) may display a user interface for capturing the surroundings of the augmented reality device (1000) and information related to services provided based on captured images of the surroundings of the augmented reality device (1000).
[0050] According to one embodiment, the display unit (1300) can provide an AR (Augmented Reality) image. The display unit (1300) according to one embodiment can include a waveguide (170) and an optical engine (120), as shown in FIG. 1. The waveguide (170) can be made of a transparent material through which a portion of the back surface is visible when the user wears the augmented reality device (1000). The waveguide (170) can be made of a single-layer or multi-layer flat plate made of a transparent material through which light can be reflected and propagated internally. The waveguide (170) can receive light of a virtual image projected from the optical engine (120) by facing the exit surface of the optical engine (120). Here, the transparent material means a material through which light can pass, and the transparency may not be 100% and may have a predetermined color. In one embodiment, since the waveguide (170) is formed of a transparent material, the user can view not only a virtual object of a virtual image through the display unit (1300), but also an external actual scene, and thus the waveguide (170) may be referred to as a see-through display. The display unit (1300) may provide an augmented reality image by outputting a virtual object of a virtual image through the waveguide. When the augmented reality device (1000) is a device in the form of glasses, the display unit (1300) may include a left display unit and a right display unit.
[0051] The noise blocking unit (1400) may include a first polarizing plate (1410) and a second polarizing plate (1420) for blocking noise light generated from an external light source. The first polarizing plate (1410) and the second polarizing plate (1420) may each filter a polarization component vibrating in one direction from external incident light. The first polarizing plate (1410) may be configured to linearly polarize the incident light in a first direction, and the second polarizing plate (1420) may be configured to linearly polarize the incident light in a second direction perpendicular to the first direction. The first polarizing plate (1410) may primarily polarize the noise light, and the second polarizing plate (1420) may secondarily polarize the primarily polarized noise light, thereby blocking the noise light.
[0052] The first polarizing plate (1410) and the second polarizing plate (1420) may be sequentially arranged on the path along which noise light directly emitted from an external light source toward the light receiving unit (1520) reaches the light receiving unit (1520). The noise light directly emitted from the external light source toward the light receiving unit (1520) may be primarily polarized by the first polarizing plate (1410) and secondarily polarized by the second polarizing plate (1420).
[0053] The first polarizing plate (1410) may be placed on the waveguide (170). For example, the first polarizing plate (1410) may be placed so as to be attached to the waveguide (170). The first polarizing plate (1410) may be placed on the outer surface of the waveguide (170), but this does not limit the technical idea of the present disclosure. For example, the first polarizing plate (1410) may also be placed on the inner surface of the waveguide (170).
[0054] The second polarizing plate (1420) may be placed on the light receiving unit (1520). For example, the second polarizing plate (1420) may be placed in front of the lens of the light receiving unit (1520). As another example, the second polarizing plate (1420) may be included as an internal component of the light receiving unit (1520), but the second polarizing plate (1420) and the light receiving sensor may be sequentially placed on the path of noise light to prevent noise light from reaching the light receiving sensor of the light receiving unit (1520).
[0055] The gaze detection module (1500) includes a light emitting unit (1510) that emits IR light to detect the user's gaze and a light receiving unit (1520) that receives the IR light, and can detect data related to the gaze of a user wearing the augmented reality device (1000). For example, the light emitting unit (1510) may include an infrared light source.
[0056] The light emitting unit (1510) of the gaze detection module (1500) can emit IR light toward the user's eyes. The emitted IR light can be sequentially reflected by the user's eyes and the waveguide (170). The light emitting unit (1510) can be positioned at a location in the augmented reality device (1000) where it can emit IR light toward the user's eyes. The light emitting unit (1510) can be positioned, for example, on the nose support unit (192) of FIG. 1, which supports the augmented reality device (1000) on the user's face.
[0057] In addition, the IR light emitted by the light emitting unit (1510) may be reflected from the user's eyes and enter the waveguide (170). At this time, if the emitted IR light passes through the waveguide (170), it may be disadvantageous for detecting the user's line of sight. Therefore, a light reflecting unit (172 in FIG. 6) may be attached to the inner surface of the waveguide (170) so that most of the IR light can be reflected from the waveguide (170). The light reflecting unit may be formed by coating on the waveguide (170).
[0058] For example, IR light reflected from the user's eye may be reflected by the waveguide (170) or the light reflector and received by the light receiving unit (1520) of the gaze detection module (1500). IR light directed at the user's eye may be reflected from the user's eye, and IR light reflected from the user's eye may be reflected by the waveguide (170) or the light reflector, and the light receiving unit (1520) may receive the IR light reflected by the light reflector.
[0059] In one embodiment, the light receiving unit (1520) may include a camera, image sensor, detector, etc. that detects light.
[0060] For example, the light receiving unit (1520) may be a two-dimensional image sensor assembled in the form of an array including a plurality of pixels arranged in a matrix, and each of the plurality of pixels may include at least one photoelectric conversion element. The light receiving unit (1520) may detect light using the photoelectric conversion element and output an image signal, which is an electrical signal according to the detected light.
[0061] The light receiving unit (1520) may be positioned at a location capable of receiving IR light reflected from the light reflecting unit in the augmented reality device (1000). The light receiving unit (1520) may be positioned, for example, in the support unit (190) of FIG. 2, which supports the augmented reality device (1000) on the user's face, such as the temple (191) and the nose support unit (192) of FIG. 1. In addition, for example, the nose support unit (192) of FIG. 2 may include a nose bridge and a glasses nose. In addition, the nose bridge and the glasses nose may be configured as an integrated unit, but are not limited thereto.
[0062] The position of the light emitting unit (1510) is only an example and does not limit the technical idea of the present disclosure. For example, the light emitting unit (1510) may be positioned on the temple (191) of FIG. 1, which supports the augmented reality device (1000) on the user's face. The light emitting unit (1510) may emit IR light toward the light reflector so that the IR light reflected by the light reflector attached to the inner surface of the waveguide (170) may be directed toward the user's eyes. The light emitting unit (1510) may emit IR light toward the light reflector, the emitted IR light may be reflected by the light reflector, and the reflected IR light may be directed toward the user's eyes. The light emitting unit (1510) may be positioned in the augmented reality device (1000) so as to emit IR light toward the light reflector.
[0063] IR light reflected from the user's eyes can be reflected by the light reflector and received by the light receiving unit (1520) of the gaze detection module (1500). IR light directed at the user's eyes can be reflected from the user's eyes, the IR light reflected from the user's eyes can be reflected by the light reflector, and the light receiving unit (1520) can receive the IR light reflected by the light reflector.
[0064] The light receiving unit (1520) may be positioned at a location where it can receive IR light reflected from the light reflector in the augmented reality device (1000). The light receiving unit (1520) may be positioned, for example, on the support unit (190) of FIG. 2, which supports the augmented reality device (1000) on the user's face, such as the temple (191) and the nose support unit (192) of FIG. 2. In addition, for example, the nose support unit (192) of FIG. 2 may include a nose bridge and a glasses nose. In addition, the nose bridge and the glasses nose may be configured as an integrated unit, but are not limited thereto.
[0065] The light emitting unit (1510) may be an IR LED that emits IR light, and the light receiving unit (1520) may be an IR camera that photographs the IR light. In this case, the IR camera may photograph the user's eyes using IR light reflected by the waveguide (170) or the light reflector. When the light emitting unit (1510) is an IR LED and the light receiving unit (1520) is an IR camera, the light emitting unit (1510) may emit IR light of planar light toward the user's eyes, and the light receiving unit (1520) may receive IR light of planar light sequentially reflected from the user's eyes and the waveguide (170) or the light reflector. The planar light may be light emitted in the form of a plane, and an area in which the planar light is emitted may be set so as to cover the user's eyes.
[0066] When the light emitting unit (1510) is an IR scanner and the light receiving unit (1520) is an IR detector, the light emitting unit (1510) emits IR light of a point light or a line light toward the user's eyes, and the light receiving unit (1520) can receive IR light of a point light or a line light reflected from the user's eyes. In this case, the light emitting unit (1510) can sequentially emit IR light while moving the light emission direction of the light emitting unit (1510) so that the IR light of the point light or the line light can cover the space where the user's eyes are located. The IR scanner may be composed of an IR LED and a MEMS (Micro-Electro Mechanical Systems) mirror that can control and reflect the direction of the IR light emitted from the IR LED, but will be collectively referred to as an IR scanner hereinafter. In addition, in one embodiment, the IR detector may also be installed in a portion where multiple photodiodes are required to detect light, but will be described hereinafter as an IR detector.
[0067] When the augmented reality device (1000) is a device in the form of glasses, the light receiving unit (1520) may be placed on the temple (191) of the augmented reality device (1000). For example, referring to FIG. 1, the light receiving unit (1520) may be placed on the inner side portion of the temple (191) of the augmented reality device (1000), which is a location between the temple (191) and the user's eye. For example, referring to FIG. 1, the light receiving unit (1520) may be placed on the side of the temple (191) of the augmented reality device (1000), at a position spaced apart from the frame (110) by about 10 mm to 15 mm. The light receiving unit (1520) may be placed on the temple (191) of the augmented reality device (1000) so as to face the waveguide (170).
[0068] In addition, the light emitting unit (1510) may be placed on the nose support unit (192) of the augmented reality device (1000). The light emitting unit (1510) may be placed on the inner side portion between the nose support unit (192) of the augmented reality device (1000) and the user's eyes. For example, referring to FIG. 1, the light emitting unit (1510) may be placed on the side of the nose support unit (192) of the augmented reality device (1000) at a position spaced apart from the frame (110) by about 10 mm to 15 mm. The light emitting unit (1510) may be placed so as to face the user's eyes from the nose support unit (192) of the augmented reality device (1000).
[0069] Referring to FIG. 1, when the augmented reality device (1000) is a device in the form of glasses, the light emitting unit (1510) and the light receiving unit (1520) may be placed on the temple (191) of the augmented reality device (1000). For example, referring to FIG. 1, the light emitting unit (1510) and the light receiving unit (1520) may be placed on the inner side portion of the temple (191) of the augmented reality device (1000), which is a position between the temple (191) and the user's eye. For example, referring to FIG. 1, the light emitting unit (1510) and the light receiving unit (1520) may be placed on a side of the temple (191) of the augmented reality device (1000), at a position spaced apart from the frame (110) by about 10 mm to 15 mm. The light emitting unit (1510) and the light receiving unit (1520) can be positioned so as to face the waveguide (170) or the light reflecting unit in the temple (191) of the augmented reality device (1000).
[0070] The gaze detection module (1500) can provide data related to the gaze of the user's eyes to the processor (1800), and the processor (1800) can obtain the user's gaze information based on the data related to the gaze of the user's eyes. The data related to the gaze of the user's eyes is data obtained by the gaze detection module (1500), and can include data indicating the type of IR light emitted from the light emitting unit (1510) (e.g., point light, linear light, area light), the characteristics of the IR light emitted from the light emitting unit (1510), the emission area of the IR light emitted from the light emitting unit (1510), and the characteristics of the IR light received from the light receiving unit (1520). In addition, the user's gaze information is information related to the user's gaze, and can be generated by analyzing data related to the gaze of the user's eyes, and can include, for example, information about the position of the user's pupil, the position of the pupil's center, the position of the user's iris, the center of the user's eye, the position of the user's eye's twinkle feature point, the user's gaze point, the user's gaze direction, etc., but is not limited thereto. The user's gaze direction can be, for example, the direction of the gaze from the center of the user's eye toward the gaze point at which the user is gazing. For example, the user's gaze direction can be represented by, but is not limited to, a vector value from the center of the user's left eye toward the gaze point and a vector value from the center of the user's right eye toward the gaze point. According to one embodiment, the gaze detection module (1500) can detect data related to the gaze of the eyes of a user wearing the augmented reality device (1000) at predetermined time intervals.
[0071] The communication interface (1600) can transmit and receive data to and from external devices and servers for providing services related to the augmented reality device (1000).
[0072] The storage unit (1700) can store a program to be executed by the processor (1800) to be described later, and can store data input to or output from the augmented reality device (1000).
[0073] The storage unit (1700) may include at least one of internal memory and external memory. The internal memory may include, for example, at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), non-volatile memory (e.g., one-time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, etc.), hard disk drive (HDD), or solid state drive (SSD). According to one embodiment, the processor (1800) may load a command or data received from at least one of the non-volatile memory or other components into the volatile memory and process it. In addition, the processor (1800) may store data received or generated from other components in the non-volatile memory. The external memory may include, for example, at least one of CF (Compact Flash), SD (Secure Digital), Micro-SD (Micro Secure Digital), Mini-SD (Mini Secure Digital), xD (extreme Digital), and Memory Stick.
[0074] In one embodiment, the programs stored in the storage unit (1700) may be classified into a plurality of modules according to their functions. For example, the storage unit (1700) may store software codes and / or instruction sets that perform various functions or tasks. For example, the plurality of modules may include, but are not limited to, a light irradiation module (1710), a light reception module (1720), an eye feature detection module (1730), a pupil position detection module (1740), and a gaze determination module (1750). For example, the gaze detection module (1500) may include a memory, and in this case, the light irradiation module (1710) and the light reception module (1720) may be stored as firmware in the memory included in the gaze detection module (1500).
[0075] The processor (1800) can control the overall operation of the augmented reality device (1000). For example, the processor (1800) can control the user input unit (1100), microphone (1200), display unit (1300), light reflector, gaze detection module (1500), communication interface (1600), and storage unit (1700) by executing programs stored in the storage unit (1700).
[0076] The processor (1800) can determine the user's gaze point and gaze direction by executing the light irradiation module (1710), the light receiving module (1720), the eye feature detection module (1730), the pupil position detection module (1740), and the gaze determination module (1750) stored in the storage unit (1700).
[0077] According to one embodiment, the augmented reality device (1000) may include a plurality of processors (1800), and a light irradiation module (1710), a light reception module (1720), an eye feature detection module (1730), a pupil position detection module (1740), and a gaze determination module (1750) may be executed by the plurality of processors (1800).
[0078] For example, some of the light irradiation module (1710), the light reception module (1720), the eye feature detection module (1730), the pupil position detection module (1740), and the gaze determination module (1750) may be executed by the first processor, and the rest of the light irradiation module (1710), the light reception module (1720), the eye feature detection module (1730), the pupil position detection module (1740), and the gaze determination module (1750) may be executed by the second processor, but is not limited thereto.
[0079] For example, the gaze detection module (1500) may include another processor and memory, and the other processor may execute a light irradiation module (1710) and a light reception module (1720) stored in the memory, and the processor (1800) may execute an eye feature detection module (1730), a pupil position detection module (1740), and a gaze determination module (1750) stored in the storage (1700).
[0080] The processor (1800) can cause the light emitting unit (1510) to emit IR light toward the user's eyes by executing the light emitting module (1710) stored in the storage unit (1700). The processor (1800) can control the light emitting unit (1510) by executing the light emitting module (1710), and the light emitting unit (1510) controlled by the processor (1800) can emit IR light so that the emitted IR light can cover the user's eyes.
[0081] For example, if the light receiving unit (1520) is an IR camera, the light emitting unit (1510) may be an IR LED, and the processor (1800) may control the IR LED so that IR light emitted from the IR LED is irradiated to an area including the user's eye so that the IR camera can capture the user's eye. For example, in order to irradiate the light emitted from the IR LED to an area including the user's eye, the processor (1800) may control the irradiation direction of the IR light emitted from the IR LED and control the emission of IR light from the IR LED by applying power to the IR LED.
[0082] In one embodiment, for example, the IR camera may be installed toward the waveguide (170) or light reflector of the augmented reality device (1000) so that the IR camera can capture the entire area of the user's eyes, and the IR LED may be installed toward the user's eyes. The processor (1800) may control the IR LED installed toward the user's eyes to emit IR light.
[0083] For example, when the light receiving unit (1520) is an IR detector, the light emitting unit (1510) may be an IR scanner, and the processor (1800) may control the IR scanner so that the IR light emitted from the IR scanner is reflected by the waveguide (170) or the light reflector to scan the user's eye so that the IR detector can detect the user's eye. For example, in order for the IR light emitted from the IR scanner to scan the user's eye, the processor (1800) may control the irradiation direction of the IR light emitted from the IR scanner and control the emission of the IR light from the IR scanner by applying power to the IR scanner.
[0084] The processor (1800) can execute the light receiving module (1720) stored in the storage unit (1700) to enable the light receiving unit (1520) to receive light reflected from the user's eyes. The processor (1800) can control the light receiving unit (1520) by executing the light receiving module (1720), and the light receiving unit (1520) controlled by the processor (1800) can receive light reflected from the user's eyes.
[0085] For example, if the light emitting unit (1510) is an IR LED, the light receiving unit (1520) may be an IR camera, and the processor (1800) may control the IR camera to capture the user's eye through light reflected from the user's eye.
[0086] The processor (1800) can detect features related to the gaze of the user's eyes by executing the eye feature detection module (1730) stored in the storage unit (1700). For example, the processor (1800) can detect the location of a pupil feature point and a glint feature point of the user's eyes by executing the eye feature detection module (1730). The pupil feature point may be, for example, the center point of the pupil, and the glint feature point of the eyes may be a portion of the detected area of the eyes having a brightness greater than a predetermined value. The location of the pupil feature point and the location of the glint feature point of the eyes may be identified, for example, by coordinate values indicating the location in the coordinate system of the light receiving unit (1520). For example, the coordinate system of the light receiving unit (1520) may be the coordinate system of the IR camera or the coordinate system of the IR detector, and the coordinate values in the coordinate system of the light receiving unit (1520) may be 2D coordinate values.
[0087] The processor (1800) can detect features related to the gaze of the eye by analyzing the light received by the light receiving unit (1520). For example, when the light receiving unit (1520) is an IR camera, the processor (1800) can identify the location of the pupil feature point and the location of the eye twinkling feature point in an image captured by the IR camera. For example, when the light receiving unit (1520) is an IR detector, the processor (1800) can identify the location of the pupil feature point and the location of the eye twinkling feature point by analyzing the IR light detected by the IR detector.
[0088] The processor (1800) can detect the position of the pupil of the user's eye by executing the pupil position detection module (1740) stored in the storage unit (1700). The pupil position detection module (1740) can identify the position of the pupil of the user's eye based on IR light reflected from the light reflector.
[0089] For example, if the light receiving unit (1520) is an IR camera, the pupil position detection module (1740) can identify the position of the pupil of the user's eye within the image captured by the IR camera. For example, if the light receiving unit (1520) is an IR detector, the pupil position detection module (1740) can calculate the position of the pupil of the user's eye by analyzing IR light sequentially acquired by the IR detector.
[0090] The pupil position detection module (1740) can identify the position of the pupil of the user's eye by identifying the center point of the pupil of the user's eye.
[0091] The processor (1800) can obtain information about the user's gaze by executing the gaze determination module (1750) stored in the storage unit (1700). The processor (1800) can calculate the position of the center of the user's eyes by executing the gaze determination module (1750). The center of the user's eyes may be the center of the user's eyeballs.
[0092] The processor (1800) can calculate the position of the user's gaze point by executing the gaze determination module (1750). In addition, the user's gaze direction can be determined based on the position of the center point of the eye calculated by the gaze determination module (1750) and the user's gaze point.
[0093] FIG. 3 is a conceptual diagram for explaining in detail the configuration of an augmented reality device according to one embodiment of the present disclosure.
[0094] For example, FIG. 3 is a conceptual diagram illustrating the type of light acquired by the light receiving unit (1520) of the augmented reality device (1000) for gaze detection according to one embodiment of the present disclosure, and explaining the operation of blocking noise light. For convenience of explanation, details that overlap with those described using FIGS. 1 and 2 are simplified or omitted.
[0095] For example, FIG. 3 illustrates the types of light acquired by the light receiving unit (1520) of the augmented reality device (1000). For example, the types of light may be first to third lights (L1, L2, L3). Definitions of the first to third lights (L1, L2, L3) are described below.
[0096] Referring to FIG. 3, the augmented reality device (1000) may include a waveguide (170) and a gaze detection module including a light emitting unit (1510) and a light receiving unit (1520). The augmented reality device may further include a first polarizing plate (130) and a second polarizing plate (140). In one embodiment, the first polarizing plate (130) and the second polarizing plate (140) may block noise light unnecessary for gaze detection.
[0097] In one embodiment, a first light (L1) may be emitted from an external light source (10). The first light (L1) may be unpolarized light. For example, the first light (L1) may be natural light. However, the present disclosure is not limited thereto, and the first light (L1) may include other types of light. For example, the first light (L1) may include artificial light. The first light (L1) may include light generated from the external light source (10). The first light (L1) may include light that travels straight from the external light source (10) toward the light receiving unit (1520). For example, the path of the first light (L1) may extend straight from the external light source (10) toward the light receiving unit (1520). The first light (L1) may include light that is not reflected by the user's eyes and is transmitted from an external light source (10) toward the light receiving unit (1520). The first light (L1) may be noise light that is unnecessary for detecting the user's gaze. For example, the first light (L1) may be noise light that negatively affects the gaze detection operation.
[0098] The first light (L1) can be primarily polarized by the first polarizing plate (130) provided on the straight path. The first light (L1) can be linearly polarized by the first polarizing plate (130). The first light (L1) can be filtered by the first polarizing plate (130) into a polarization component vibrating in the first direction.
[0099] The first light (L1) can be secondarily polarized by the second polarizing plate (140) placed on the straight path. The first light (L1) can be linearly polarized by the second polarizing plate (140). The first light (L1) that is primarily polarized by the first polarizing plate (130) can be blocked by the second polarizing plate (140). The first light (L1) can be filtered by the second polarizing plate (140) into a polarization component that vibrates in a second direction perpendicular to the first direction, and ultimately, the first light (L1) can be blocked by the first polarizing plate (130) and the second polarizing plate (140). The first light (L1) may not reach the light receiving unit (1520). That is, the augmented reality device (1000) can block the first light (L1) using the first polarizing plate (130) and the second polarizing plate (140).
[0100] In one embodiment, a second light (L2) may be emitted from an external light source (10). The second light (L2) may be unpolarized light, for example, natural light. However, the present disclosure is not limited thereto, and the second light (L2) may include other types of light. For example, the second light (L2) may include artificial light. The second light (L2) may include light generated from the external light source (10). The second light (L2) may include light that is emitted from the external light source (10), reflected by the user's eye, and then travels toward the light receiving unit (1520). The second light (L2) may include light that does not transmit through the first polarizing plate (130). The first light (L1) may be signal light used to detect the user's gaze. The augmented reality device (1000) receives the first light (L1) using a light receiving unit (1520) and can track the user's gaze based on the first light (L1).
[0101] In one embodiment, a third light (L3) may be emitted from the light emitting unit (1510). The third light (L3) may be, for example, IR light. However, the present disclosure is not limited thereto, and the third light (L3) may include other types of light. The third light (L3) may include light that is emitted from the light emitting unit (1510), reflected by the user's eye, and then travels toward the light receiving unit (1520). The third light (L3) may include light that does not transmit through the first polarizing plate (130). The third light (L3) may be a signal light used to detect the user's gaze. The augmented reality device (1000) may receive the second light (L2) using the light receiving unit (1520) and track the user's gaze based on the second light (L2).
[0102] FIG. 4 is a conceptual diagram illustrating a method for blocking noise by a configuration of an augmented reality device according to an embodiment of the present disclosure.
[0103] For example, FIG. 4 illustrates an operation in which incident light (IL) emitted from an external light source (10) is sequentially polarized by a first polarizing plate (130) and a second polarizing plate (140) according to one embodiment. The incident light (IL) of FIG. 4 may correspond to the first light (L1) of FIG. 3. For convenience of explanation, details that overlap with those described using FIGS. 1 to 3 are simplified or omitted.
[0104] Referring to FIG. 4, incident light (IL) may be emitted from an external light source (10). The incident light (IL) may be unpolarized light, for example, natural light. However, the present disclosure is not limited thereto, and the first light (L1) may include other types of light. For example, the first light (L1) may include artificial light. The incident light (IL) may include light that is directed straight from the external light source (10) toward the light receiving unit (1520). The incident light (IL) may be noise light that is unnecessary for detecting the user's gaze. The incident light (IL) may be unpolarized light that includes a plurality of polarization components that vibrate in each direction.
[0105] The first polarizing plate (130) may include a first polarizing axis (X1) extending in a first direction (X). The first polarizing plate (130) may polarize incident light (IL) in the first direction (X).
[0106] Incident light (IL) can be polarized in a first direction (X) by the first polarizing plate (130). As the incident light (IL) passes through the first polarizing plate (130), a polarization component vibrating in the first direction (X) can be transmitted, and a polarization component vibrating in a direction other than the first direction (X) can be blocked. Light in which the polarization component vibrating in the first direction (X) among the incident light (IL) is transmitted can be first polarization (PL1). The first polarization (PL1) can propagate toward the light receiving unit (1520).
[0107] The second polarizing plate (140) may include a second polarizing axis (X2) extending in the second direction (Y). The second polarizing plate (140) may polarize the incident first polarized light (PL1) in the second direction (X). The second polarizing plate (140) may block the first polarized light (PL1) by polarizing the first polarized light (PL1) vibrating in the first direction (X) in the second direction (X).
[0108] The first polarization (PL1) can be polarized in the second direction (Y) by the second polarization plate (140). The second direction (Y) can be perpendicular to the first direction (X). As the first polarization (PL1) passes through the second polarization plate (140), the polarization component vibrating in the second direction (Y) can be transmitted, and the polarization component vibrating in a direction other than the second direction (Y) can be blocked. Therefore, the first polarization (PL1) can be blocked by the second polarization plate (140).
[0109] The augmented reality device (1000) can block incident light (IL) using the first polarizing plate (130) and the second polarizing plate (140). The incident light (IL) may be unnecessary light for detecting the user's gaze. The augmented reality device (1000) can block the incident light (IL) to be transmitted to the light receiving unit (1520) as noise and obtain only the light necessary for detecting the user's gaze through the light receiving unit (1520). The augmented reality device according to one embodiment of the present disclosure filters the light to be used for detecting the user's gaze by blocking noise light, and the filtered light can help improve the image clarity for detecting the user's gaze.
[0110] FIG. 5 is a conceptual diagram illustrating a process of blocking noise according to one embodiment of the present disclosure.
[0111] For example, FIG. 5 illustrates changes in the polarization direction of light transmitted by the first polarizing plate (130) and the second polarizing plate (140) according to one embodiment. For convenience of explanation, details that overlap with those described using FIG. 4 are simplified or omitted.
[0112] In one embodiment illustrated in FIG. 5, the types of light emitted from an external light source are classified into fourth light (L4) that travels toward the light receiving portion and fifth light (L5) that enters the user's eye.
[0113] In one embodiment, an external light source (10) can emit light. The external light source (10) can be, for example, the sun. The external light source (10) can emit unpolarized light, can emit polarized light that vibrates in a first direction (X), or can emit polarized light that vibrates in a second direction (Y). The second direction (Y) can be perpendicular to the first direction (X).
[0114] In one embodiment, the fourth light (L4) may be light traveling toward the light receiving unit. The fourth light (L4) may be the first light (L1) described in FIG. 3. The fourth light (L4) may act as noise when the augmented reality device detects the user's gaze. The augmented reality device (1000) is configured such that a first polarizing plate (130) and a second polarizing plate (140) are provided on the path of the fourth light (L4), and the fourth light (L4) may be blocked by the first polarizing plate (130) and the second polarizing plate (140).
[0115] In Example 1, an external light source (10) can emit unpolarized fourth light (L4). The unpolarized fourth light (L4) can be light including multiple polarization components vibrating in different directions. For example, the unpolarized fourth light (L4) can vibrate in multiple directions. The unpolarized fourth light (L4) can be polarized in a first direction by the first polarizing plate (130). The polarization component vibrating in the first direction among the unpolarized fourth light (L4) can be transmitted by the first polarizing plate (130), and the polarization component vibrating in a direction other than the first direction among the unpolarized fourth light (L4) can be blocked by the first polarizing plate (130).
[0116] The fourth light (L4) polarized in the first direction (X) can be polarized in the second direction by the second polarizing plate (140). The fourth light (L4) polarized in the first direction (X) can be blocked by the second polarizing plate (140). Therefore, the unpolarized fourth light (L4) is blocked by the first polarizing plate (130) and the second polarizing plate (140) and does not reach the light receiving unit.
[0117] In case 3, the external light source (10) can emit fourth light (L4) polarized in the first direction (X). The fourth light (L4) polarized in the first direction (X) can be polarized in the first direction by the first polarizing plate (130). The fourth light (L4) polarized in the first direction (X) can be completely transmitted by the first polarizing plate (130).
[0118] The fourth light (L4) polarized in the first direction (X) can be polarized in the second direction by the second polarizing plate (140). The fourth light (L4) polarized in the first direction (X) can be blocked by the second polarizing plate (140). Therefore, the unpolarized fourth light (L4) is blocked by the first polarizing plate (130) and the second polarizing plate (140) and does not reach the light receiving unit.
[0119] In case 5, the external light source (10) can emit fourth light (L4) polarized in the second direction (Y). The fourth light (L4) polarized in the second direction (Y) can be polarized in the first direction by the first polarizing plate (130). The fourth light (L4) polarized in the second direction (Y) can be blocked by the first polarizing plate (130). Therefore, the unpolarized fourth light (L4) is blocked by the first polarizing plate (130) and the second polarizing plate (140) and does not reach the light receiving unit.
[0120] In one embodiment, the fifth light (L5) may be light directed toward the user's eyes. The user may secure a field of vision based on the fifth light (L5). For example, the fifth light (L5) may be image light emitted from a display device, and the user may view an image based on the fifth light (L5). The fifth light (L5) may be used to secure the user's field of vision. If the fifth light (L5) does not reach the user's eyes, the user may not be able to secure a field of vision based on the fifth light (L5).
[0121] The fourth light (L4) and the fifth light (L5) are both emitted from an external light source (10), but the fourth light (L4) can act as noise when reaching the light receiving unit, so it is advantageous to block it, and the fifth light (L5) must be able to reach the user's eye so that the user's field of vision can be secured.
[0122] In case 2, the external light source (10) can emit unpolarized fifth light (L5). The unpolarized fifth light (L5) can be light including multiple polarization components vibrating in different directions. The unpolarized fifth light (L5) can be polarized in a first direction by the first polarizing plate (130). The polarization component vibrating in the first direction among the unpolarized fifth light (L5) can be transmitted by the first polarizing plate (130), and the polarization component vibrating in a direction other than the first direction among the unpolarized fifth light (L5) can be blocked by the first polarizing plate (130).
[0123] The fifth light (L5) polarized in the first direction (X) can reach the user's eyes. The user can secure a forward view based on the fifth light (L5) polarized in the first direction (X). For example, the user can recognize the image light polarized in the first direction (X) and see an image according to the image light.
[0124] In case 4, the external light source (10) can emit fifth light (L5) polarized in the first direction (X). The fifth light (L5) polarized in the first direction (X) can be polarized in the first direction by the first polarizing plate (130). The fifth light (L5) polarized in the first direction (X) can be completely transmitted by the first polarizing plate (130).
[0125] The fifth light (L5) polarized in the first direction (X) can reach the user's eyes. The user can secure a forward view based on the fifth light (L5) polarized in the first direction (X). For example, the user can recognize the image light polarized in the first direction (X) and see an image according to the image light.
[0126] In Case 5, the external light source (10) can emit fifth light (L5) polarized in the second direction (Y). The fifth light (L5) polarized in the second direction (Y) can be polarized in the first direction by the first polarizing plate (130). The fifth light (L5) polarized in the second direction (Y) can be blocked by the first polarizing plate (130).
[0127] In Case 6, the fifth light (L5) may not reach the user's eyes. The user may not be able to secure forward vision due to the fifth light (L5) being blocked. For example, the user may not be able to perceive the blocked image light and may not be able to see the image based on the image light. For example, an embodiment for improving Case 6 will be described below using FIGS. 8 to 10.
[0128] FIG. 6 is a conceptual diagram illustrating a method for blocking noise in an augmented reality device according to an embodiment of the present disclosure.
[0129] For example, FIG. 6 illustrates an operation of blocking noise light, focusing on the function of the light reflector (172) of an augmented reality device according to one embodiment of the present disclosure. For convenience of explanation, details that overlap with those described using FIGS. 1 to 3 are simplified or omitted.
[0130] Referring to FIG. 6, the augmented reality device (1000) may include a waveguide (170) and a gaze detection module including a light emitting unit (1510) and a light receiving unit (1520). The augmented reality device (1000) may further include a light reflecting unit (172), a first polarizing plate (130), and a second polarizing plate (140). The augmented reality device (1000) may induce a large amount of light necessary for gaze detection to reach the light receiving unit (1520) using the light reflecting unit (172), and may induce a small amount of light unnecessary for gaze detection to reach the light receiving unit (1520). The augmented reality device (1000) may block noise light unnecessary for gaze detection using the first polarizing plate (130) and the second polarizing plate (140).
[0131] The light reflector (172) can reflect light emitted from the light emitting unit (1510) or an external light source (10). The light reflector (172) and the waveguide (170) can be provided at a position facing the user's eyes, and the light reflector (172) and the waveguide (170) can be attached to each other. For example, the light reflector (172) can be coated on at least a portion of the waveguide (170). In addition, the light reflector (172) can be attached to or coated on other components included in an augmented reality device in the form of glasses, such as a vision correction lens for vision correction or a cover glass installed to protect the waveguide.
[0132] The light reflector (172) may be formed of a material capable of reflecting IR light emitted from the light emitting unit (1510) or the external light source (10). The light reflector (172) may be, for example, a material including silver, gold, copper, or one or more of these metals, but is not limited thereto. Accordingly, the IR light emitted from the light emitting unit (1510) may be reflected by the user's eye and directed toward the light reflector (172), and the IR light reflected again from the light reflector (172) may be directed toward the light receiving unit (1520). Alternatively, the first light (L1) emitted from the external light source (10) may be noise light unnecessary for detecting the user's gaze, and the first light (L1) may be reflected by the light reflector (172), such that only a portion of the first light (L1) may pass through the light reflector (172) and proceed toward the light receiving unit (1520).
[0133] In one embodiment, a first light (L1) may be emitted from an external light source (10). The first light (L1) may be primarily polarized in a first direction by a first polarizing plate (130) provided on a straight path. The first light (L1) may be reflected by a light reflecting portion (172), and only a portion of the first light (L1) may be transmitted through the light reflecting portion (172) and may proceed toward a light receiving portion (1520). A portion of the first light (L1) transmitted through the light reflecting portion (172) may be secondarily polarized in a second direction perpendicular to the first direction by a second polarizing plate (140) provided on the straight path. The augmented reality device (1000) may block the first light (L1) by using the first polarizing plate (130) and the second polarizing plate (140).
[0134] In one embodiment, the second light (L2) may be light that is reflected from the user's eye and travels toward the light receiving unit (1520). The second light (L2) may be emitted from an external light source (10 or a separate light source not shown). The second light (L2) is emitted from the external light source and reflected by the user's eye. For example, the external light source may include an infrared light source. The infrared light source may be provided on a waveguide. The second light (L2) may be reflected by the user's eye and then reflected by the light reflecting unit (172) and travels toward the light receiving unit (1520). The light reflecting unit (172) may increase the reflection efficiency of the incident second light (L2). The second light (L2) may include light that travels toward the light receiving unit (1520). The second light (L2) may include light that does not transmit through the first polarizing plate (130). The first light (L1) may be a signal light used to detect the user's gaze.
[0135] In one embodiment, a third light (L3) may be emitted from the light emitting unit (1510). The third light (L3) may be, for example, IR light. The third light (L3) is emitted from the light emitting unit (1510) and reflected by the user's eyes. After being reflected by the user's eyes, the third light (L3) may be reflected by the light reflecting unit (172) and may proceed toward the light receiving unit (1520). The light reflecting unit (172) may increase the reflection efficiency of the incident third light (L3). The third light (L3) may include light that proceeds toward the light receiving unit (1520). The third light (L3) may include light that does not transmit through the first polarizing plate (130). The third light (L3) may be a signal light used to detect the user's gaze.
[0136] FIG. 7 is a conceptual diagram illustrating the configuration of an augmented reality device according to one embodiment of the present disclosure.
[0137] In one embodiment, the light emitting unit (1510) may be provided on the temple (191). The light emitting unit (1510) and the light receiving unit (1520) used to detect the user's gaze may be provided, for example, on the temple portion of the augmented reality device (1000), and the augmented reality device (1000) may effectively identify the user's eyes by using the light emitting unit (1510) and the light receiving unit (1520) provided on the temple portion. IR light may be emitted from the light emitting unit (1510) provided on the temple portion toward the waveguide (170) of the augmented reality device (1000). The emitted IR light is reflected by the waveguide (170) and directed toward the user's eyes. IR light reflected from the user's eyes and then reflected again by the waveguide (170) or the light reflecting unit may be received through the light receiving unit (1520) provided on the temple portion. Additionally, the augmented reality device (1000) can obtain information about the user's eyes based on the received IR light and detect the user's gaze direction using the obtained information about the eyes.
[0138] In one embodiment, a third light (L3) may be emitted from the light emitting unit (1510). The third light (L3) may be, for example, IR light. The third light (L3) is emitted from the light emitting unit (1510) toward the waveguide (170) or the light reflecting unit (172), is reflected by the waveguide (170) or the light reflecting unit (172), and then is reflected by the user's eyes. The third light (L3) may be reflected by the user's eyes, and then be reflected again by the waveguide (170) or the light reflecting unit (172) and may proceed toward the light receiving unit (1520). The third light (L3) may include light that does not transmit through the first polarizing plate (130). The third light (L3) may be a signal light used to detect the user's gaze.
[0139] FIG. 8 is a conceptual diagram illustrating the configuration of an augmented reality device according to an embodiment of the present disclosure.
[0140] For example, FIG. 8 illustrates the function of a quarter wave plate (174) of an augmented reality device, and the function of the quarter wave plate (174) and the operation of blocking noise light are specifically explained using FIGS. 9a, 9b, and 10. For convenience of explanation, details that overlap with those explained using FIGS. 1 to 3 are simplified or omitted.
[0141] Referring to FIG. 8, the augmented reality device (1000) may include a waveguide (170) and a gaze detection module including a light emitting unit (1510) and a light receiving unit (1520). The augmented reality device (1000) may further include a quarter wave plate (174), a first polarizing plate (130), and a second polarizing plate (140). The augmented reality device (1000) may polarize light emitted from an external light source and reaching the light receiving unit (1520) so as to be blocked as noise by using the quarter wave plate (174), the first polarizing plate (130), and the second polarizing plate (140). The augmented reality device (1000) may polarize light emitted from an external light source and reaching the user's eyes so as to pass through for the user's forward view by using the quarter wave plate (174).
[0142] The quarter wave plate (174) is configured to phase shift the incident light by 90°. The quarter wave plate (174) is configured to circularly polarize the transmitted linearly polarized light. The quarter wave plate (174) can also change the incident circularly polarized light into linearly polarized light. For example, light emitted from an external light source located in front of the augmented reality device (1000) can be circularly polarized by transmitting through the quarter wave plate (174).
[0143] In one embodiment, the quarter wave plate (174), the first polarizing plate (130), and the second polarizing plate (140) may be sequentially provided on a path along which the first light (L1) emitted directly from an external light source (10) toward the light receiving unit (1520) reaches the light receiving unit (1520). The quarter wave plate (174) may be provided on the waveguide (170).
[0144] FIG. 9A is a conceptual diagram illustrating a method for blocking noise by a configuration of an augmented reality device according to an embodiment of the present disclosure.
[0145] For example, FIG. 9a illustrates an operation in which the first incident light (IL1) emitted from the first external light source (10) is sequentially polarized by the quarter wave plate (174), the first polarizing plate (130), and the second polarizing plate (140). FIG. 9a is a conceptual diagram centered on the path of the first incident light (IL1) traveling from the first external light source (10) toward the light receiving unit (1520).
[0146] Referring to FIG. 9a, in one embodiment, the first light (L1 of FIG. 8) may include a first incident light (IL1).
[0147] The first incident light (IL1) may be noise light, which is light emitted from the first external light source (10). The first incident light (IL1) may be unpolarized light, and may be, for example, natural light. The first incident light (IL1) may include light that has traveled straight from the first external light source (10) toward the light receiving unit (1520). The first incident light (IL1) may include light that has traveled from the first external light source (10) toward the light receiving unit (1520) without being reflected by the user's eyes. The first incident light (IL1) may be noise that is unnecessary for detecting the user's gaze.
[0148] In one embodiment, the first incident light (IL1) may be primarily polarized by a quarter wave plate (174) provided on a straight path. The first incident light (IL1) may be circularly polarized by the quarter wave plate (174). However, the first incident light (IL1) may be unpolarized light including polarization components vibrating in each direction, and the light in which the first incident light (IL1) is polarized by the quarter wave plate (174) may still be unpolarized light including polarization components vibrating in each direction. The light in which the first incident light (IL1) is circularly polarized by the quarter wave plate (174) may be the first polarization (PL1_1). The first polarization (PL1_1) may propagate toward the light receiving unit (1520).
[0149] The first polarization (PL1_1) can be secondarily polarized by the first polarizing plate (130) provided on the straight path. The first polarization (PL1_1) can be linearly polarized by the first polarizing plate (130). The first polarization (PL1_1) can be filtered by the first polarizing plate (130) into a polarization component that vibrates in the first direction. The light polarized by the first polarizing plate (130) of the first polarization (PL1_1) can be second polarization (PL1_2). The second polarization (PL1_2) can propagate toward the light receiving unit (1520).
[0150] The second polarization (PL1_2) can be tertiarily polarized by the second polarizing plate (140) provided on the straight path. The second polarization (PL1_2) can be linearly polarized by the second polarizing plate (140). The second polarization (PL1_2) secondarily polarized by the first polarizing plate (130) can be blocked by the second polarizing plate (140). The second polarization (PL1_2) can be filtered by the second polarizing plate (140) into a polarization component vibrating in a second direction perpendicular to the first direction, and finally, the first incident light (IL1) can be blocked by the quarter wave plate (174), the first polarizing plate (130), and the second polarizing plate (140). The first incident light (IL1) may not reach the light receiving unit (1520). That is, the augmented reality device (1000) can block the first incident light (IL1) by using the quarter wave plate (174), the first polarizing plate (130), and the second polarizing plate (140).
[0151] FIG. 9b is a conceptual diagram illustrating a method for securing a user's field of view using an augmented reality device according to an embodiment of the present disclosure. For convenience of explanation, the description will focus on differences from the description using FIG. 9a.
[0152] For example, Fig. 9b illustrates an operation in which second incident light (IL2) emitted from a second external light source (20) is sequentially polarized by a quarter wave plate (174) and a first polarizing plate (130). Fig. 9b is a conceptual diagram illustrating the path of second incident light (IL2) traveling from the second external light source (20) toward the user's eye (E).
[0153] Referring to FIG. 9b, in one embodiment, the second incident light (IL2) may be light emitted from a second external light source (20) and directed toward the user's eye (E). The user may secure a forward view beyond the augmented reality device through the second incident light (IL2).
[0154] The second incident light (IL2) may include light emitted from a second external light source (20). The second incident light (IL2) may be, for example, light polarized in the second direction (Y), and may be, for example, light for an image emitted from a display device. The second incident light (IL2) may include light directed straight from the second external light source (20) toward the user's eyes. The second incident light (IL2) may be light for the user to recognize the second external light source (20). The user may recognize the second external light source (20) based on the second incident light (IL2).
[0155] In one embodiment, the second incident light (IL2) may be primarily polarized by a quarter wave plate (174) provided on a straight path. The second incident light (IL2) may be circularly polarized by the quarter wave plate (174). For example, the second incident light (IL2) incident on the quarter wave plate (174) may be polarized into right-handed circular polarization (RHCP) by the quarter wave plate (174). The second incident light (IL2) circularly polarized by the quarter wave plate (174) may be a first polarization (PL2_1). The first polarization (PL2_1) may propagate toward the light receiving unit (1520).
[0156] The first polarization (PL2_1) can be secondarily polarized by the first polarizing plate (130) provided on the straight path. The first polarization (PL2_1) can be linearly polarized by the first polarizing plate (130). The first polarization (PL2_1) can be filtered into a polarization component vibrating in the first direction by the first polarizing plate (130).
[0157] The first polarization (PL2_1), which was a polarization component vibrating in the second direction, is circularly polarized by the quarter wave plate (174), so that even if the first polarization (PL2_1) is polarized by the first polarizing plate (130) thereafter, the polarization component vibrating in the first direction can pass through the first polarizing plate (130). The polarization component of the first direction that passes through the first polarization (PL2_1) can be the second polarization (PL2_2). The second polarization (PL2_2) can reach the user's eyes. The user can recognize the second external light source (20) based on the second polarization (PL2_2).
[0158] FIG. 10 is a conceptual diagram illustrating a process of blocking noise according to one embodiment of the present disclosure.
[0159] For example, FIG. 10 illustrates changes in the polarization direction of light transmitted by a quarter wave plate (174), a first polarizing plate (130), and a second polarizing plate (140) according to one embodiment. For convenience of explanation, details that overlap with those described using FIGS. 5 and 9 are simplified or omitted.
[0160] In one embodiment illustrated in FIG. 10, the types of light emitted from an external light source are classified into a fourth light (L4) that travels toward the light receiving portion and a fifth light (L5) that enters the user's eye. Specifically, the types of light are classified into a fourth light (L4) that is emitted from a first external light source (10) and travels toward the light receiving portion and a fifth light (L5) that is emitted from a second external light source (20) and enters the user's eye.
[0161] In one embodiment, an external light source including a first external light source (10) and a second external light source (20) can emit light. The external light source can be, for example, the sun, or, as another example, a display. The external light source can emit unpolarized light, can emit polarized light that vibrates in a first direction (X), or can emit polarized light that vibrates in a second direction (Y). The second direction (Y) can be perpendicular to the first direction (X).
[0162] In one embodiment, the fourth light (L4) may be light traveling toward the light receiving unit (1520). The fourth light (L4) may be the first incident light (IL1) described in FIG. 9A. The fourth light (L4) may act as noise when the augmented reality device detects the user's gaze. The augmented reality device (1000) is configured such that a quarter-wave plate (174), a first polarizing plate (130), and a second polarizing plate (140) are provided on the path of the fourth light (L4), and the fourth light (L4) may be blocked by the quarter-wave plate (174), the first polarizing plate (130), and the second polarizing plate (140).
[0163] Specifically, in Case 1, the first external light source (10) can emit fourth light (L4) polarized in the first direction (X). The fourth light (L4) polarized in the first direction (X) can be circularly polarized into left-handed circular polarization (LHCP) by a quarter-wave plate (174).
[0164] The fourth light (L4) that is circularly polarized with a left-handed circular polarization can be polarized in the first direction (X) by the first polarizing plate (130).
[0165] The fourth light (L4) polarized in the first direction (X) can be polarized in the second direction by the second polarizing plate (140). The fourth light (L4) polarized in the first direction (X) can be blocked by the second polarizing plate (140). Therefore, the unpolarized fourth light (L4) is blocked by the first polarizing plate (130) and the second polarizing plate (140) and does not reach the light receiving unit (1520).
[0166] In Case 3, the first external light source (10) can emit fourth light (L4) polarized in the second direction (Y). The fourth light (L4) polarized in the second direction (Y) can be circularly polarized into right-handed circular polarization (RHCP) by a quarter-wave plate (174).
[0167] The fourth light (L4) that is circularly polarized with a priority rotation circular polarization can be polarized in the first direction (X) by the first polarizing plate (130).
[0168] The fourth light (L4) polarized in the first direction (X) can be polarized in the second direction by the second polarizing plate (140). The fourth light (L4) polarized in the first direction (X) can be blocked by the second polarizing plate (140). Therefore, the unpolarized fourth light (L4) is blocked by the first polarizing plate (130) and the second polarizing plate (140) and does not reach the light receiving unit (1520).
[0169] In Example 5, the first external light source (10) may emit unpolarized fourth light (L4). The unpolarized fourth light (L4) may be light including multiple polarization components vibrating in each direction. The unpolarized fourth light (L4) may be phase-shifted by 90° by the quarter-wave plate (174). As a result of each of the multiple polarization components of the fourth light (L4) being phase-shifted by 90°, the fourth light (L4) polarized by the quarter-wave plate (174) may still be unpolarized light including polarization components vibrating in each direction.
[0170] The unpolarized fourth light (L4) can be polarized in the first direction by the first polarizing plate (130). The polarization component vibrating in the first direction among the unpolarized fourth light (L4) can be transmitted by the first polarizing plate (130), and the polarization component vibrating in a direction other than the first direction among the unpolarized fourth light (L4) can be blocked by the first polarizing plate (130).
[0171] The fourth light (L4) polarized in the first direction (X) can be polarized in the second direction by the second polarizing plate (140). The fourth light (L4) polarized in the first direction (X) can be blocked by the second polarizing plate (140). Therefore, the unpolarized fourth light (L4) is blocked by the first polarizing plate (130) and the second polarizing plate (140) and does not reach the light receiving unit (1520).
[0172] In one embodiment, the fifth light (L5) may be light directed toward the user's eyes. The user may secure a field of vision based on the fifth light (L5). For example, the fifth light (L5) may be image light emitted from a display device, and the user may view an image based on the fifth light (L5). The fifth light (L5) may be used to secure the user's field of vision. If the fifth light (L5) does not reach the user's eyes, the user may not be able to secure a field of vision based on the fifth light (L5).
[0173] The fourth light (L4) and the fifth light (L5) are emitted from their respective external light sources, but the fourth light (L4) can act as noise when reaching the light receiving unit (1520), so it is advantageous to block it, and the fifth light (L5) must be able to reach the user's eyes so that the user's field of vision can be secured. The augmented reality device (1000) is configured so that a quarter-wave plate (174), a first polarizing plate (130), and a second polarizing plate (140) are sequentially provided on the path of the fourth light (L4), and the fourth light (L4) can be blocked by the quarter-wave plate (174), the first polarizing plate (130), and the second polarizing plate (140). The augmented reality device (1000) is configured so that a quarter wave plate (174) and a first polarizing plate (130) are sequentially provided on the path of the fifth light (L5), and the fifth light (L5) can pass through the quarter wave plate (174) and the first polarizing plate (130).
[0174] Specifically, in case 2, the second external light source (20) can emit fifth light (L5) polarized in the first direction (X). The fifth light (L5) polarized in the first direction (X) can be circularly polarized into a left-handed circular polarization (LHCP) by a quarter-wave plate (174).
[0175] The fifth light (L5) that is circularly polarized with a left-handed circular polarization can be polarized in a first direction (X) by the first polarizing plate (130). The fifth light (L5) that is polarized in the first direction (X) can reach the user's eyes. The user can secure a forward field of vision based on the fifth light (L5) that is polarized in the first direction (X). For example, the user can recognize the image light (L12) that is polarized in the first direction (X) and see an image according to the image light (L12).
[0176] In Case 4, the second external light source (20) can emit fifth light (L5) polarized in the second direction (Y). The fifth light (L5) polarized in the second direction (Y) can be circularly polarized into right-hand circular polarization (RHCP) by a quarter-wave plate (174).
[0177] The fifth light (L5) that is circularly polarized with a priority circular polarization can be polarized in the first direction (X) by the first polarizing plate (130). The fifth light (L5) polarized in the first direction (X) can reach the user's eyes. The user can secure a forward view based on the fifth light (L5) polarized in the first direction (X). For example, the user can recognize the image light polarized in the first direction (X) and see an image according to the image light.
[0178] In Example 6, the second external light source (20) may emit unpolarized fifth light (L5). The unpolarized fifth light (L5) may be light including multiple polarization components vibrating in each direction. The unpolarized fifth light (L5) may be phase-shifted by 90° by the quarter-wave plate (174). As a result of each of the multiple polarization components of the fifth light (L5) being phase-shifted by 90°, the fifth light (L5) polarized by the quarter-wave plate (174) may still be unpolarized light including polarization components vibrating in each direction.
[0179] The unpolarized fifth light (L5) can be polarized in the first direction by the first polarizing plate (130). The polarization component vibrating in the first direction among the unpolarized fifth light (L5) can be transmitted by the first polarizing plate (130), and the polarization component vibrating in a direction other than the first direction among the unpolarized fifth light (L5) can be blocked by the first polarizing plate (130).
[0180] The fifth light (L5) polarized in the first direction (X) can reach the user's eyes. The user can secure a forward view based on the fifth light (L5) polarized in the first direction (X). For example, the user can recognize the image light polarized in the first direction (X) and see an image according to the image light.
[0181] FIG. 11 is a flowchart illustrating an operation for blocking noise according to one embodiment of the present disclosure.
[0182] For convenience of explanation, parts that overlap with those described using Figures 1 to 10 are simplified or omitted.
[0183] Referring to FIG. 11, in step S1110, the method may include an operation of receiving a signal light reflected from the user's eye. For example, the augmented reality device may receive a signal light reflected from the user's eye through a light receiving unit.
[0184] In one embodiment, the augmented reality device may include a waveguide and a processor for providing augmented reality to a user, a gaze detection module including a light emitter and a light receiver for detecting the gaze of the user, and a first polarizing plate and a second polarizing plate for filtering out noise from light to be received by the light receiver.
[0185] The light emitter can emit light. For example, the light emitter can be provided on a waveguide and emit light toward the user's eye. The light emitted by the light emitter can be reflected by the user's eye, and after being reflected by the waveguide, can be received by the light receiver. In one embodiment, the light reflection efficiency can be increased by attaching a light reflector on the waveguide.
[0186] Light can also be emitted toward the user's eyes from an external light source. The light emitted by the external light source can be reflected by the user's eyes, reflected by the waveguide, and then received by the light receiving unit. In one embodiment, a light reflector can be attached to the waveguide to increase light reflection efficiency.
[0187] Light may be emitted toward the user's eyes by a light source or an external light source. The light reflected by the user's eyes may be a signal light used to track the user's gaze.
[0188] In one embodiment, noise light may be emitted from an external light source toward the light receiving unit. The noise light may be unnecessary noise for user gaze tracking. The augmented reality device may block the noise light using a first polarizing plate and a second polarizing plate.
[0189] The light traveling toward the light receiving unit may include signal light and noise light. In one embodiment, the augmented reality device may block noise light using a first polarizing plate and a second polarizing plate, and obtain information about the user's gaze based on the signal light acquired using the light receiving unit. In one embodiment, the augmented reality device may block noise light using a quarter-wave plate, a first polarizing plate, and a second polarizing plate, and obtain information about the user's gaze based on the signal light acquired using the light receiving unit.
[0190] For example, an augmented reality device can polarize noise light in a first direction using a first polarizing plate. The augmented reality device can polarize noise light in a second direction using a second polarizing plate. The second direction may be perpendicular to the first direction. Therefore, noise light polarized in the first direction by the first polarizing plate can be blocked by the second polarizing plate that polarizes incident light in the second direction. The augmented reality device can block noise light using the first polarizing plate and the second polarizing plate.
[0191] In step S1120, the method may include an operation of acquiring user gaze information based on the received signal light. The augmented reality device may acquire user gaze information based on the received signal light.
[0192] In one embodiment, the received signal light does not include noise light directly emitted from an external light source toward the light receiving unit. The received signal light may be light reflected from the user's eye and used to detect the user's gaze. The augmented reality device can obtain information about the user's gaze based on the received signal light.
[0193] In one embodiment, the augmented reality device can detect features related to the gaze of the user's eyes. For example, the augmented reality device can detect the location of a pupil feature point and a glint feature point of the user's eyes based on the received signal light. The pupil feature point may be, for example, the center point of the pupil, and the glint feature point may be a portion of a detected area of the eye having a brightness greater than a predetermined value. The location of the pupil feature point and the location of the glint feature point may be identified, for example, by coordinate values representing the location in a coordinate system of a light receiving unit. For example, the coordinate system of the light receiving unit may be a coordinate system of an IR camera or a coordinate system of an IR detector, and the coordinate values in the coordinate system of the light receiving unit may be 2D coordinate values.
[0194] An augmented reality device can detect features related to the eye's gaze by analyzing the light signals received by the photodetector. For example, if the photodetector is an IR camera, the augmented reality device can identify the location of features such as pupils and eye glints in images captured by the IR camera.
[0195] The augmented reality device can detect the position of the user's eye pupil based on the received signal light. For example, if the light receiving unit is an IR camera, the augmented reality device can identify the position of the user's eye pupil within the image captured by the IR camera.
[0196] The augmented reality device can identify the position of the pupil of the user's eye by identifying the center point of the pupil of the user's eye based on the received signal light.
[0197] The augmented reality device can obtain information about the user's gaze based on the received signal light. The augmented reality device can calculate the location of the center of the user's eyes. The center of the user's eyes may be the center of the user's eyeball.
[0198] The augmented reality device can calculate the location of the user's gaze point. Furthermore, the user's gaze direction can be determined based on the calculated location of the center of the eye and the user's gaze point.
[0199] An augmented reality device according to one embodiment of the present disclosure may include a waveguide, a support, a light receiving unit, a first polarizing plate, a second polarizing plate, and at least one processor. The support unit may be configured to secure the augmented reality device to a user's face. The light receiving unit may be provided on the support unit. At least one processor may be configured to obtain gaze information of the user based on light reflected from the user's eye and obtained through the light receiving unit. The first polarizing plate, which is configured to move toward the light receiving unit, may be configured to polarize noise light moving toward the light receiving unit. The second polarizing plate may be configured to block polarized noise light from the first polarizing plate from reaching the light receiving unit.
[0200] In one embodiment, the support may include a temple extending from a frame surrounding the waveguide and provided to the user's ear. The support may include a nose support extending from the frame and provided to the user's nose. The light receiving unit may be provided on the temple.
[0201] In one embodiment, the first polarizing plate may be provided on the waveguide.
[0202] In one embodiment, a second polarizing plate may be provided on the light receiving portion.
[0203] In one embodiment, the first polarizing plate and the second polarizing plate may be sequentially provided on the path of noise light emitted from an external light source toward the light receiving portion.
[0204] In one embodiment, the first polarizing plate may be configured to linearly polarize the noise light in a first direction. The second polarizing plate may be configured to linearly polarize the linearly polarized noise light in a second direction perpendicular to the first direction.
[0205] In one embodiment, the augmented reality device may further include an optical reflector formed by coating on the waveguide.
[0206] In one embodiment, the augmented reality device may further include a light-emitting unit. Light acquired through the light-receiving unit may include a first signal light emitted from an external light source and reflected from the user's eye, and a second signal light emitted from the light-emitting unit and reflected from the user's eye.
[0207] In one embodiment, the light emitting portion may be provided on the waveguide.
[0208] In one embodiment, the support may include a temple configured to extend from a frame surrounding the waveguide and be provided to the user's ear. The light-emitting portion may be provided on the temple.
[0209] In one embodiment, the augmented reality device may further include a quarter-wave plate configured to circularly polarize noise light. The first polarizer may be configured to linearly polarize the circularly polarized noise light in a first direction. The second polarizer may be configured to block the linearly polarized noise light from the first polarizer.
[0210] In one embodiment, the quarter wave plate, the first polarizing plate, and the second polarizing plate may be sequentially provided on the path of noise light emitted from an external light source toward the light receiving portion.
[0211] In one embodiment, a quarter wave plate may be provided on a waveguide.
[0212] A method according to one embodiment of the present disclosure may include a step of obtaining information about a user's gaze based on light reflected from the user's eye and acquired through a light receiving unit. The method may include a step of linearly polarizing noise light traveling toward the light receiving unit using a first polarizing plate. The method may include a step of blocking the linearly polarized noise light from reaching the light receiving unit using a second polarizing plate.
[0213] In one embodiment, the first polarizing plate and the second polarizing plate may be sequentially provided on the path of noise light emitted from an external light source toward the light receiving unit.
[0214] In one embodiment, the method may include a step of linearly polarizing noise light in a first direction by a first polarizing plate. The method may include a step of linearly polarizing the linearly polarized noise light in a second direction perpendicular to the first direction by a second polarizing plate.
[0215] In one embodiment, the light acquired through the light receiving unit may include a first signal light emitted from an external light source and reflected from the user's eye, and a second signal light emitted from the light emitting unit and reflected from the user's eye.
[0216] In one embodiment, the method may include a step of circularly polarizing noise light by a quarter wave plate. The method may include a step of linearly polarizing the circularly polarized noise light in a first direction by a first polarizing plate. The method may include a step of linearly polarizing the linearly polarized noise light in a second direction perpendicular to the first direction by a second polarizing plate.
[0217] In one embodiment, noise light can be blocked by a quarter wave plate, a first polarizing plate, and a second polarizing plate sequentially provided on the path of noise light emitted from an external light source toward a light receiving portion.
[0218] In order to solve the above-described technical problem, one embodiment of the present disclosure provides a computer-readable recording medium having recorded thereon a program to be executed on a computer.
[0219] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0220] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
Claims
1. Waveguide; A support for fixing an augmented reality device to a user's face; A light receiving unit provided on the above support; At least one processor that obtains the user's gaze information based on light reflected from the user's eye and obtained through the light receiving unit; A first polarizing plate configured to polarize noise light traveling toward the light receiving portion; and An augmented reality device comprising a second polarizing plate configured to block the polarized noise light from the first polarizing plate from reaching the light receiving unit.
2. In paragraph 1, An augmented reality device, wherein the first polarizing plate is provided on the waveguide.
3. In any one of paragraphs 1 and 2, An augmented reality device, wherein the second polarizing plate is provided on the light receiving unit.
4. In any one of the clauses 1 to 3, An augmented reality device, wherein the first polarizing plate and the second polarizing plate are sequentially provided on the path of the noise light emitted from an external light source toward the light receiving unit.
5. In any one of paragraphs 1 to 4, The first polarizing plate is configured to linearly polarize the noise light in the first direction, An augmented reality device, wherein the second polarizing plate is configured to linearly polarize the linearly polarized noise light in a second direction perpendicular to the first direction.
6. In any one of paragraphs 1 to 5, An augmented reality device further comprising a light reflector formed by coating on the waveguide.
7. In any one of paragraphs 1 to 6, Further comprising a quarter-wave plate configured to circularly polarize the noise light, The first polarizing plate is configured to linearly polarize the circularly polarized noise light in the first direction, An augmented reality device, wherein the second polarizing plate is configured to block the linearly polarized noise light from the first polarizing plate.
8. In paragraph 7, An augmented reality device, wherein the quarter wave plate, the first polarizing plate, and the second polarizing plate are sequentially provided on the path of the noise light emitted from an external light source toward the light receiving unit.
9. In any one of paragraphs 7 and 8, An augmented reality device wherein the above quarter wave plate is provided on the above waveguide.
10. In the method of tracking the user's gaze, A step of acquiring the user's gaze information based on light reflected from the user's eye and acquired through a light receiving unit; A step of linearly polarizing noise light traveling toward a light receiving portion by a first polarizing plate; and A method comprising a step of blocking the linearly polarized noise light from reaching the light receiving portion by a second polarizing plate.
11. In paragraph 10, A method wherein the first polarizing plate and the second polarizing plate are sequentially provided on the path of the noise light emitted from an external light source toward the light receiving unit.
12. In any one of paragraphs 10 and 11, A step of linearly polarizing the noise light in the first direction by the first polarizing plate; and A method further comprising the step of linearly polarizing the linearly polarized noise light in a second direction perpendicular to the first direction by the second polarizing plate.
13. In any one of the clauses 10 to 12, A step of circularly polarizing the noise light by a quarter wave plate; A step of linearly polarizing the circularly polarized noise light in the first direction by the first polarizing plate; and A method comprising the step of linearly polarizing the linearly polarized noise light in a second direction perpendicular to the first direction by the second polarizing plate.
14. In paragraph 13, A method in which the noise light is blocked by the quarter wave plate, the first polarizing plate, and the second polarizing plate sequentially provided on the path of the noise light emitted from an external light source toward the light receiving unit.
15. A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 10 to 14 on a computer.
Citation Information
Patent Citations
Wiper type washing device of belt press
KR102309991B1
Method and device for reconstructing neural rendering-based geometric color integrated 3D mesh
KR102559691B1
Manufacturing method of functional chicken sauce
KR102579455B1
Adaptive lenses for near-eye displays
US20200018962A1
Viewing field-based optical correction using spatially varying polarizers
US20210247614A1