Wearable device and method for adjusting brightness of environment, and non-transitory computer-readable recording medium
Patent Information
- Application Number
- PCT/KR2024/010321
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-17
- Filing Date
- 2024-07-17
- Publication Date
- 2025-02-27
Smart Images

Figure KR2024010321_27022025_PF_FP_ABST
Abstract
Description
Wearable device, method, and non-transitory computer-readable recording medium for controlling brightness of an environment
[0001] The following descriptions relate to a wearable device, a method, and a non-transitory computer-readable recording medium for controlling the brightness of an environment.
[0002] To provide an enhanced user experience, electronic devices are being developed that provide augmented reality (AR) services, which display computer-generated information in conjunction with external objects in the real world. These electronic devices may be wearable devices worn by the user. For example, these electronic devices may be AR glasses and / or head-mounted devices (HMDs).
[0003] An electronic device is disclosed. The electronic device may include at least one display arranged to face a user's eyes when the electronic device is worn by the user. The electronic device may include at least one camera arranged to face the user's eyes when the electronic device is worn by the user. The electronic device may include at least one processor including a processing circuit. The electronic device may include a memory storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to obtain an authentication request from the user. The processor, based on obtaining the authentication request, may cause the wearable device to identify at least one area in an environment visible to the user through the at least one display. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to control the at least one display such that brightness of the at least one identified area is adjusted. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to acquire an iris image of the eye through the at least one camera while the brightness of the at least one identified area is adjusted. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to authenticate the user based on an iris of the eye identified in the iris image.
[0004] A method is disclosed. The method may be performed in an electronic device, the electronic device including at least one display arranged to face a user's eye when the electronic device is worn by the user, and at least one camera arranged to face the eye when the electronic device is worn by the user. The method may include an operation of obtaining an authentication request from the user. The method may include an operation of identifying at least one area in an environment visible to the user through the at least one display based on the obtaining of the authentication request. The method may include an operation of identifying an operation of controlling the at least one display so that brightness of the at least one identified area is adjusted. The method may include an operation of identifying an operation of obtaining an iris image of the eye through the at least one camera while the brightness of the at least one identified area is adjusted. The method may include an operation of identifying an operation of authenticating the user based on an iris of the eye identified in the iris image.
[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program including instructions. The instructions, when executed by at least one processor of the electronic device, may be configured to cause the electronic device to obtain an authentication request from the user, the electronic device including at least one display arranged to face the eye of the user when the electronic device is worn by the user, and at least one camera arranged to face the eye of the user when the electronic device is worn by the user. The processor may be configured to identify at least one area in an environment visible to the user through the at least one display based on obtaining the authentication request. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to control the at least one display such that brightness of the at least one area is adjusted. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to acquire an iris image of the eye through the at least one camera while the brightness of the at least one identified area is adjusted. The instructions, when executed by the at least one processor, may be configured to cause the electronic device to authenticate the user based on an iris of the eye identified in the iris image.
[0006] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
[0007] FIG. 2A illustrates an example of a perspective view of a wearable device according to one embodiment.
[0008] FIG. 2b illustrates an example of one or more hardware elements arranged within a wearable device, according to one embodiment.
[0009] FIG. 3A illustrates an example of an appearance of a wearable device according to one embodiment.
[0010] FIG. 3b illustrates an example of an appearance of a wearable device according to one embodiment.
[0011] Figure 4 is a block diagram of an electronic device according to one embodiment.
[0012] Figure 5 shows an example of iris data acquired depending on the condition of the eye.
[0013] FIG. 6A illustrates an example of an environment visible to a user, according to one embodiment.
[0014] FIG. 6b illustrates an example of an environment visible to a user, according to one embodiment.
[0015] FIG. 6c illustrates an example of an environment visible to a user, according to one embodiment.
[0016] FIG. 6d illustrates an example of an environment visible to a user, according to one embodiment.
[0017] FIG. 6e illustrates an example of an environment visible to a user, according to one embodiment.
[0018] FIG. 6f illustrates an example of an environment visible to a user, according to one embodiment.
[0019] FIG. 7 illustrates an example of an environment visible to a user, according to one embodiment.
[0020] Figure 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0021] FIG. 9 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0022] FIG. 10 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0023] FIG. 11 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0024] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.
[0025] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0026] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0027] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0028] The memory (130) can store various data used by at least one component (e.g., the processor (120) or the sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., the program (140)) and input data or output data for commands related thereto. The memory (130) can include a volatile memory (132) or a non-volatile memory (134).
[0029] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0030] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0031] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0032] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0033] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0034] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0035] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0036] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0037] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0038] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0039] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0040] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0041] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0042] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 664 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for URLLC realization.
[0043] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0044] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0045] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0046] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0047] FIG. 2A illustrates an example of a perspective view of a wearable device (200), according to an embodiment. FIG. 2B illustrates an example of one or more hardware elements disposed within a wearable device (200), according to an embodiment. The wearable device (200) of FIGS. 2A and 2B may correspond to the electronic device (101) of FIG. 1. As shown in FIG. 2A, the wearable device (200), according to an embodiment, may include at least one display (250) and a frame supporting the at least one display (250).
[0048] According to one embodiment, a wearable device (200) may be worn on a part of a user's body. The wearable device (200) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to a user wearing the wearable device (200). For example, the wearable device (200) may output a virtual reality image to the user through at least one display (250) in response to a user's designated gesture acquired through the motion recognition cameras (240-2, 240-5) of FIG. 2B.
[0049] According to one embodiment, at least one display (250) within a wearable device (200) may provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.
[0050] Referring to FIG. 2B, at least one display (250) may form a display area on a lens to provide a user wearing the wearable device (200) with visual information contained in external light passing through the lens, along with other visual information distinct from the visual information. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. The display area formed by at least one display (250) may be formed on the second surface (232) among the first surface (231) and the second surface (232) of the lens. When the user wears the wearable device (200), external light may be incident on the first surface (231) and transmitted through the second surface (232) to be transmitted to the user. As another example, at least one display (250) may display a virtual reality image to be combined with a real screen transmitted through the external light. The virtual reality image output from at least one display (250) can be transmitted to the user's eyes through one or more hardware (e.g., optical devices (282, 284), and / or at least one waveguide (233, 234)) included in the wearable device (200).
[0051] According to one embodiment, a wearable device (200) may include waveguides (233, 234) that diffract light transmitted from at least one display (250) and relayed by optical devices (282, 284) and transmit the diffracted light to a user. The waveguides (233, 234) may be formed based on at least one of glass, plastic, or polymer. A nanopattern may be formed on at least a portion of the exterior or interior of the waveguides (233, 234). The nanopattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the waveguides (233, 234) may be propagated to the other end of the waveguides (233, 234) by the nanopattern. The wave guides (233, 234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, the wave guides (233, 234) may be arranged within the wearable device (200) to guide a screen displayed by at least one display (250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) occurring within the wave guides (233, 234).
[0052] According to one embodiment, the wearable device (200) may analyze an object included in a real image collected through a capturing camera (240-3, 240-6), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (250). The virtual object may include at least one of text and an image regarding various information related to the object included in the real image. The wearable device (200) may analyze the object based on a multi-camera, such as a stereo camera. For the object analysis, the wearable device (200) may execute time-of-flight (ToF) and / or simultaneous localization and mapping (SLAM) supported by the multi-camera. A user wearing the wearable device (200) may view an image displayed on at least one display (250).
[0053] According to one embodiment, the frame may be formed as a physical structure that allows the wearable device (200) to be worn on the user's body. According to one embodiment, the frame may be configured so that, when the user wears the wearable device (200), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame may support at least one display (250). For example, the frame may support the first display (250-1) and the second display (250-2) to be positioned corresponding to the user's left and right eyes.
[0054] Referring to FIG. 2A, the frame may include a region (220) that at least partially contacts a part of the user's body when the user wears the wearable device (200). For example, the region (220) of the frame that contacts a part of the user's body may include a region that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the wearable device (200) makes contact with. According to one embodiment, the frame may include a nose pad (210) that contacts a part of the user's body. When the wearable device (200) is worn by the user, the nose pad (210) may contact a part of the user's nose. The frame may include a first temple (204) and a second temple (205) that contact a part of the user's body that is distinct from the part of the user's body.
[0055] For example, the frame may include a first rim (201) that surrounds at least a portion of the first display (250-1), a second rim (202) that surrounds at least a portion of the second display (250-2), a bridge (203) that is disposed between the first rim (201) and the second rim (202), a first pad (211) that is disposed along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) that is disposed along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) that extends from the first rim (201) and is fixed to a portion of an ear of the wearer, and a second temple (205) that extends from the second rim (202) and is fixed to a portion of an ear opposite the ear. The first pad (211) and the second pad (212) may be in contact with a portion of the user's nose, and the first temple (204) and the second temple (205) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through the first hinge unit (206) disposed between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through the second hinge unit (207) disposed between the second rim (202) and the second temple (205). According to one embodiment, the wearable device (200) can identify an external object (e.g., a user's fingertip) touching the frame and / or a gesture performed by the external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame.
[0056] According to one embodiment, the wearable device (200) may include hardware that performs various functions. For example, the hardware may include a battery module (270), an antenna module (275), optical devices (282, 284), speakers (292-1, 292-2), microphones (294-1, 294-2, 294-3), a light-emitting module (not shown), and / or a printed circuit board (290). The various hardware may be arranged within the frame.
[0057] According to one embodiment, the microphones (294-1, 294-2, 294-3) of the wearable device (200) may be arranged on at least a portion of the frame to acquire a sound signal. A first microphone (294-1) arranged on the nose pad (210), a second microphone (294-2) arranged on the second rim (202), and a third microphone (294-3) arranged on the first rim (201) are illustrated in FIG. 2B, but the number and arrangement of the microphones (294) are not limited to the embodiment of FIG. 2B. When the number of microphones (294) included in the wearable device (200) is two or more, the wearable device (200) may identify the direction of the sound signal by using a plurality of microphones arranged on different portions of the frame.
[0058] According to one embodiment, the optical devices (282, 284) can transmit a virtual object transmitted from at least one display (250) to the wave guides (233, 234). For example, the optical devices (282, 284) can be projectors. The optical devices (282, 284) can be positioned adjacent to at least one display (250) or can be included within at least one display (250) as a part of at least one display (250). The first optical device (282) can correspond to the first display (250-1), and the second optical device (284) can correspond to the second display (250-2). The first optical device (282) can transmit light output from the first display (250-1) to the first wave guide (233), and the second optical device (284) can transmit light output from the second display (250-2) to the second wave guide (234).
[0059] In one embodiment, the camera may include an eye tracking camera (ET CAM) (240-1, 240-4), a motion recognition camera (240-2, 240-5), and / or a recording camera (240-3, 240-6). The recording camera, the eye tracking camera (240-1, 240-4), and the motion recognition camera (240-2, 240-5) may be positioned at different positions on the frame and may perform different functions. The eye tracking camera (240-1, 240-4) may output data representing the gaze of a user wearing the wearable device (200). For example, the wearable device (200) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (240-1, 240-4). An example in which the gaze tracking camera (240-1, 240-4) is positioned toward the user's right eye is illustrated in FIG. 2B, but the embodiment is not limited thereto, and the gaze tracking camera (240-1, 240-4) may be positioned solely toward the user's left eye, or may be positioned toward both eyes.
[0060] In one embodiment, the capturing camera (240-3, 240-6) can capture an actual image or background to be aligned with a virtual image in order to implement augmented reality or mixed reality content. The capturing camera can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (250). The at least one display (250) can display a single image in which information about an actual image or background including an image of the specific object acquired using the capturing camera and a virtual image provided through optical devices (282, 284) are superimposed. In one embodiment, the capturing camera can be placed on a bridge (203) placed between the first rim (201) and the second rim (202).
[0061] In one embodiment, the gaze tracking camera (240-1, 240-4) can implement more realistic augmented reality by tracking the gaze of a user wearing the wearable device (200), thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the wearable device (200) looks straight ahead, the wearable device (200) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (250). The gaze tracking camera (240-1, 240-4) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (240-1, 240-4) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking cameras (240-1, 240-4) may be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking cameras (240-1, 240-4) may be positioned within the first rim (201) and / or the second rim (202) so as to face the direction in which the user wearing the wearable device (200) is positioned.
[0062] In one embodiment, the gesture recognition camera (240-2, 240-5) can provide a specific event on a screen provided on at least one display (250) by recognizing the movement of the user's whole or part of the body, such as the user's torso, hand, or face. The gesture recognition camera (240-2, 240-5) can recognize the user's gesture (gesture recognition), obtain a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (250). The processor can identify the signal corresponding to the gesture and perform a designated function based on the identification. In one embodiment, the gesture recognition camera (240-2, 240-5) can be disposed on the first rim (201) and / or the second rim (202).
[0063] In one embodiment, the cameras included in the wearable device (200) are not limited to the above-described gaze tracking cameras (240-1, 240-4) and motion recognition cameras (240-2, 240-5). For example, the wearable device (200) can identify an external object included in the FoV using the photographing cameras (240-3, 240-6) positioned toward the user's FoV. The wearable device (200) can identify an external object based on a sensor for identifying the distance between the wearable device (200) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera positioned toward the FoV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (200) may include a camera (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (200).
[0064] Although not shown, the wearable device (200) according to one embodiment may further include a light source (e.g., an LED) that emits light toward a subject being photographed using the camera (e.g., a user's eyes, face, and / or an external object within the FoV). The light source may include an infrared wavelength LED. The light source may be disposed on at least one of the frame and hinge units (206, 207).
[0065] According to one embodiment, the battery module (270) may supply power to electronic components of the wearable device (200). In one embodiment, the battery module (270) may be disposed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may be disposed within each of the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be disposed at an end of the first temple (204) and / or the second temple (205).
[0066] According to one embodiment, the antenna module (275) can transmit a signal or power to the outside of the wearable device (200), or receive a signal or power from the outside. The antenna module (275) can be electrically and / or operatively connected to the communication module (190) of FIG. 1. In one embodiment, the antenna module (275) can be positioned within the first temple (204) and / or the second temple (205). For example, the antenna module (275) can be positioned close to one surface of the first temple (204) and / or the second temple (205).
[0067] According to one embodiment, the speakers (292-1, 292-2) may output audio signals to the outside of the wearable device (200). The audio output module may be referred to as a speaker. In one embodiment, the speakers (292-1, 292-2) may be positioned within the first temple (204) and / or the second temple (205) so as to be positioned adjacent to the ears of a user wearing the wearable device (200). For example, the wearable device (200) may include a second speaker (292-2) positioned within the first temple (204) and thus adjacent to the user's left ear, and a first speaker (292-1) positioned within the second temple (205) and thus adjacent to the user's right ear.
[0068] In one embodiment, the light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the wearable device (200) to the user. For example, when the wearable device (200) requires charging, the wearable device (200) may repeatedly emit red light at a designated time. In one embodiment, the light-emitting module may be disposed on the first rim (201) and / or the second rim (202).
[0069] Referring to FIG. 2B, according to one embodiment, a wearable device (200) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of the first temple (204) or the second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. One or more hardware components included in the wearable device (200) may be disposed on the PCB (290). The wearable device (200) may include a flexible PCB (FPCB) for interconnecting the hardware components.
[0070] According to one embodiment, a wearable device (200) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (200) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (200). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., the x-axis, the y-axis, and the z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., the x-axis, the y-axis, and the z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (200) may identify a user's motion and / or gesture performed to execute or stop a specific function of the wearable device (200) based on the IMU.
[0071] FIGS. 3A and 3B illustrate an example of an exterior appearance of a wearable device (300) according to an embodiment. The wearable device (300) of FIGS. 3A and 3B may be included in the electronic device (21) of FIG. 1. An example of an exterior appearance of a first side (310) of a housing of the wearable device (300) according to an embodiment is illustrated in FIG. 3A, and an example of an exterior appearance of a second side (320) opposite to the first side (310) may be illustrated in FIG. 3B.
[0072] Referring to FIG. 3A, a first surface (310) of a wearable device (300) according to an embodiment may have a form attachable to a body part of a user (e.g., the face of the user). Although not shown, the wearable device (300) may further include a strap for fixing to a body part of a user, and / or one or more temples (e.g., the first temple (204) and / or the second temple (205) of FIGS. 2A and 2B). A first display (350-1) for outputting an image to a left eye among the user's two eyes, and a second display (350-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (310). The wearable device (300) is formed on the first surface (310) and may further include a rubber or silicone packing to prevent interference by light (e.g., ambient light) different from the light emitted from the first display (350-1) and the second display (350-2).
[0073] According to one embodiment, a wearable device (300) may include cameras (340-1, 340-2) for photographing and / or tracking both eyes of a user adjacent to the first display (350-1) and the second display (350-2), respectively. The cameras (340-1, 340-2) may be referred to as ET cameras. According to one embodiment, a wearable device (300) may include cameras (340-3, 340-4) for photographing and / or recognizing a face of a user. The cameras (340-3, 340-4) may be referred to as FT cameras.
[0074] Referring to FIG. 3B, a camera (e.g., cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10)) and / or a sensor (e.g., depth sensor (330)) for obtaining information related to the external environment of the wearable device (300) may be disposed on a second surface (320) opposite to the first surface (310) of FIG. 3A. For example, the cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) may be disposed on the second surface (320) to recognize an external object different from the wearable device (300). For example, using cameras (340-9, 340-10), the wearable device (300) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (340-9) can be placed on the second face (320) of the wearable device (300) to obtain an image to be displayed through the second display (350-2) corresponding to the right eye among the two eyes. The camera (340-10) can be placed on the second face (320) of the wearable device (300) to obtain an image to be displayed through the first display (350-1) corresponding to the left eye among the two eyes.
[0075] According to one embodiment, the wearable device (300) may include a depth sensor (330) disposed on the second surface (320) to identify a distance between the wearable device (300) and an external object. Using the depth sensor (330), the wearable device (300) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (300).
[0076] Although not shown, a microphone may be placed on the second side (320) of the wearable device (300) to acquire sound output from an external object. The number of microphones may be one or more depending on the embodiment.
[0077] As described above, according to one embodiment, the wearable device (300) may have a form factor for being worn on a user's head. The wearable device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the head. Using cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) for recording video of an external space, the wearable device (300) and a server connected to the wearable device (300) (e.g., server (108) of FIG. 1) may provide an on-demand service that provides video of a location and / or place selected by the user, and / or a metaverse service.
[0078] According to one embodiment, the wearable device (300) may display frames acquired through cameras (340-9, 340-10) on each of the first display (350-1) and the second display (350-2). The wearable device (300) may combine virtual objects within frames including real objects, which are displayed through the first display (350-1) and the second display (350-2), to provide a user with a mixed user experience of real objects and virtual objects (e.g., video see-through (VST)). The wearable device (300) can change the virtual object based on information acquired by the cameras (340-1, 340-2, 340-3, 340-4, 340-5, 340-6, 340-7, 340-8) and / or the depth sensor (330). For example, if a visual object corresponding to a real object and a virtual object at least partially overlap within the frame, the wearable device (300) can stop displaying the virtual object based on detecting a motion for interacting with the real object. By stopping displaying the virtual object, the wearable device (300) can prevent the visibility of the real object from being reduced as the visual object corresponding to the real object is occluded by the virtual object.
[0079] FIG. 4 is a block diagram of an electronic device (401) according to one embodiment.
[0080] Referring to FIG. 4, the electronic device (401) may include an input module (450), a display (460), a microphone (470), a first camera (481), a second camera (485), a third camera (489), a processor (120), and a memory (130).
[0081] The input module (450) of FIG. 4 may correspond to the input module (150) of FIG. 1. The display (460) of FIG. 4 may correspond to the display module (160) of FIG. 1. The display (460) of FIG. 4 may correspond to the displays (250, 250-1, 250-2) of FIGS. 2A and 2B. The display (460) of FIG. 4 may correspond to the displays (350-1, 350-2) of FIGS. 3A and 3B. The microphone (470) of FIG. 4 may correspond to the audio module (170) of FIG. 1. The microphone (470) of FIG. 4 may correspond to the microphones (294-1, 294-2, 294-3) of FIGS. 2A and 2B. The cameras (481, 485, 489) of FIG. 4 may correspond to the camera module (180) of FIG. 1. The first camera (481) of FIG. 4 may correspond to the photographing cameras (240-3, 240-6) of FIGS. 2A and 2B. It may correspond to the photographing cameras (340-9, 340-10) of FIGS. 3A and 3B. The second camera (485) of FIG. 4 may correspond to the photographing cameras (240-1, 240-4) of FIGS. 2A and 2B. The second camera (485) of FIG. 4 may correspond to the gaze tracking cameras (340-1, 340-2) of FIGS. 3A and 3B. The second camera (485) of FIG. 4 may correspond to the gaze tracking cameras (240-1, 240-4) of FIGS. 2A and 2B. The third camera (489) of FIG. 4 may correspond to the gaze tracking cameras (340-1, 340-2) of FIGS. 3A and 3B. The cameras (485, 489) of FIG. 4 may be a single integrated camera. The processor (120) of FIG. 4 may correspond to the processor (120) of FIG. 1. The memory (130) of FIG. 4 may correspond to the memory (130) of FIG. 1.
[0082] Below, an operation of performing user authentication in an environment visible to the user (or, the user's field of view (FOV)) by an electronic device (401) is described.
[0083] FIG. 5 illustrates an example of an environment visible to a user, according to one embodiment.
[0084] FIG. 5 may be described with reference to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, and FIG. 4. Hereinafter, the first camera (481) may be a camera that captures an environment (or, the user's field of view (FOV)) shown to the user (510), the second camera (485) may be a camera for iris recognition, and the third camera (489) may be a gaze tracking camera.
[0085] FIG. 5 illustrates an environment (501) (or, the user's field of view (FOV)) shown to a user (510) while the user (510) is wearing an electronic device (401).
[0086] In one embodiment, the processor (120) of the electronic device (401) can provide a user (510) with augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality.
[0087] In one embodiment, augmented reality (AR) may be an environment in which at least one image object is displayed (or superimposed) on an external environment that is shown to a user (510) through (or through) a display (460, 250, 250-1, 250-2, 350-1, 350-2). For example, the augmented reality (AR) may be a see-through environment. For example, augmented reality (AR) may include a method in which external light passes through the display (460, 250, 250-1, 250-2, 350-1, 350-2) to directly reach the user (510), and / or an image representing an external environment captured by the first camera (481) is displayed through the display (460, 250, 250-1, 250-2, 350-1, 350-2), thereby being displayed to the user (510). However, the present invention is not limited thereto. For example, an image representing an external environment captured by the first camera (481) may be an image having binocular parallax. For example, an image representing an external environment captured by the first camera (481) may be a stereoscopic image.
[0088] Virtual reality (VR) may be an environment in which a virtual environment that is distinct from (or does not reflect) the external environment rendered through a processor (120) is shown to a user (510) through a display (460, 250, 250-1, 250-2, 350-1, 350-2).
[0089] Hereinafter, the environment (501) of FIG. 5 may be exemplified as augmented reality. However, it is not limited thereto. For example, the environment (501) of FIG. 5 may be virtual reality, or mixed reality combining augmented reality and virtual reality.
[0090] In one embodiment, the processor (120) can identify and / or track the gaze (521) of the user (510). For example, the processor (120) can identify the gaze (521) of the user (510) based on images captured by the third camera (489) for eye tracking (ET). For example, the images captured by the third camera (489) may be glint images. For example, the processor (120) can identify the gaze (521) of the user (510) based on the position of the eye included in the images captured by the third camera (489). For example, the processor (120) can identify the gaze (521) of the user (510) based on the position of the iris included in the images captured by the third camera (489). For example, the processor (120) can identify the gaze (521) of the user (510) by tracking the position of the iris. However, the present invention is not limited thereto.
[0091] In one embodiment, the processor (120) may obtain an authentication request from the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition. For example, the processor (120) may obtain the authentication request while the environment (501) is provided to the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition generated by the program (140) while the program (140) is executing.
[0092] In one embodiment, the processor (120) may determine whether user authentication based on iris recognition is possible in response to an authentication request from the user (510). In one embodiment, the processor (120) may determine whether iris recognition is possible in response to an authentication request based on the iris of the user (510).
[0093] In one embodiment, the processor (120) may determine whether user authentication based on iris recognition is possible based on the size of the iris of the user's (510) eye. For example, the processor (120) may identify the size of the iris based on an image of the user's (510) eye acquired through the second camera (485). The processor (120) may determine whether iris recognition is possible based on the size of the iris identified based on the image of the eye. For example, if the size of the iris exceeds a first specified size, iris recognition may be determined to be possible. For example, if the size of the iris is less than or equal to the first specified size, iris recognition may be determined to not be possible. The processor (120) may determine whether iris recognition is possible based on a second size of the pupil identified based on the image of the eye. For example, if the second pupil size is less than or equal to a specified second size, iris recognition may be determined to be possible. For example, if the second pupil size exceeds a specified second size, iris recognition may be determined to be impossible. For example, the specified first size and / or the specified second size may be preset.
[0094] In one embodiment, if it is determined that user authentication based on iris recognition is possible, the processor (120) may authenticate the user based on iris recognition using an image acquired through the second camera (485). In one embodiment, if the size of the iris exceeds a specified first size, the processor (120) may authenticate the user based on iris recognition using an image for iris recognition. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye.
[0095] In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. Hereinafter, an operation for increasing the size of the iris of the user's (510) eye of the electronic device (401) will be described with reference to FIGS. 6A, 6B, 6C, 6D, 6E, 6F, and 7.
[0096] Below, the operation of the electronic device (401) to adjust the brightness of the area where the user's (510) gaze (521) is located is described.
[0097] FIG. 6A illustrates an example of an environment visible to a user, according to one embodiment.
[0098] Fig. 6a can be explained with reference to Figs. 1, 2a, 2b, 3a, 3b, 4, and 5. Hereinafter, the first camera (481) may be a camera that captures an environment (or, the user's field of view (FOV)) shown to the user (510), the second camera (485) may be a camera for iris recognition, and the third camera (489) may be a gaze tracking camera.
[0099] FIG. 6A illustrates an environment (601) (or a user's field of view) visible to a user (510) while the user (510) is wearing an electronic device (401). The environment (601) of FIG. 6A may be visible to the user (510) after the environment (501) of FIG. 5 is visible to the user (510). Hereinafter, the environment visible to the user (or the user's field of view) may be referred to as an environment.
[0100] In one embodiment, the processor (120) may select an area (611) within the environment (601). In one embodiment, the processor (120) may select an area (611) within the environment (601) if it is determined that user authentication based on iris recognition is not possible. In one embodiment, the processor (120) may select an area (611) within the environment (601) to perform an operation to increase the size of the iris of the eye of the user (510). In one embodiment, the processor (120) may select an area (611) within the environment (601) if iris recognition using an image for iris recognition fails. In one embodiment, the processor (120) may select an area (611) within the environment (601) if iris recognition using an image for iris recognition fails before performing an operation to increase the size of the iris of the eye of the user (510). In one embodiment, the processor (120) may select an area (611) in the environment (601) whose brightness is greater than or equal to a specified brightness to perform an operation for increasing the size of the iris of the user's (510) eye. In one embodiment, when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails, the processor (120) may select an area (611) whose brightness is greater than or equal to a specified brightness to perform an operation for increasing the size of the iris of the user's (510) eye.
[0101] In one embodiment, the processor (120) may select an area (611) in which the user's gaze (521) is located within the environment (601). In one embodiment, the processor (120) may select an area (611) in which the user's gaze (521) is located based on images acquired through the third camera (489) for ET. In one embodiment, the processor (120) may identify an area (611) in which the gaze (521) is located. In one embodiment, the processor (120) may select an area (611) located within a specified distance from the gaze (521). In one embodiment, the processor (120) may identify an area (611) located within a specified distance from the gaze (521). However, the present invention is not limited thereto. In one embodiment, the processor (120) may select at least one area located outside a specified distance from the gaze (521). In one embodiment, the processor (120) can identify at least one area located outside a specified distance from the line of sight (521).
[0102] In one embodiment, the processor (120) may adjust (e.g., increase) the brightness of the selected area (611). In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may adjust (e.g., increase) the brightness of the selected area (611). By adjusting (e.g., increasing) the brightness of the area (611) within the environment (601), the size of the iris of the user's (510) eye may increase. Here, adjusting (e.g., increasing) the brightness may mean adjusting the transparency of a transparent or translucent lens included in at least one display (250) within the wearable device (200) of FIGS. 2A and 2B to be transparent. For example, by increasing the transparency of a transparent or translucent lens included in at least one display (250) in the wearable device (200) of FIGS. 2A and 2B, the intensity of external light passing through the lens of the display (250) can be increased. For example, adjusting (e.g., increasing) brightness can mean increasing the brightness of an area displayed through at least one display (250) in the wearable device (200) of FIGS. 2A and 2B. For example, adjusting (e.g., increasing) brightness can mean increasing the intensity of light emitted from a selected area of an image displayed through at least one display (250) to provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality. For example, adjusting (e.g., increasing) brightness may mean increasing the brightness of an area displayed through at least one display (350-1, 350-2) within the wearable device (300) of FIGS. 3A and 3B. For example, adjusting (e.g., increasing) brightness may mean increasing the intensity of light emitted from a selected area of an image displayed through at least one display (350-1, 350-2) to provide augmented reality (AR), virtual reality (VR), or mixed reality (MR).For example, adjusting (e.g., increasing) brightness may mean superimposing a transparent and / or translucent layer on an image displayed through at least one display (350-1, 350-2) to provide augmented reality (AR), virtual reality (VR), or mixed reality (MR). Here, the transparent and / or translucent layer may have a brightness greater than or equal to a specified brightness in a selected area of the image. The layer may be transparent in an area other than the selected area of the image. The layer may have a brightness greater than or equal to a specified brightness in an area selected from the image.
[0103] In one embodiment, the processor (120) may obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) may obtain an image for iris recognition through the second camera (485). The image for iris recognition may include an image object representing the eye of the user (510). The image for iris recognition may include an image object representing the iris of the eye of the user (510).
[0104] In one embodiment, the processor (120) can obtain an image for iris recognition while the brightness of the environment (601) is adjusted. In one embodiment, the processor (120) can obtain an image for iris recognition while the brightness of an area (611) within the environment (601) is adjusted. In one embodiment, the processor (120) can obtain an image for iris recognition while the brightness of an area (611) where the gaze (521) of the user (510) within the environment (601) is located is adjusted.
[0105] In one embodiment, the processor (120) may authenticate the user (510) based on the iris included in the image for iris recognition. In one embodiment, the processor (120) may authenticate the user (510) based on the iris included in the image for iris recognition acquired while the brightness of the area (611) is adjusted. In one embodiment, the processor (120) may authenticate the user (510) based on the iris included in the image for iris recognition acquired while the brightness of the area (611) where the gaze (521) is located is adjusted.
[0106] As described above, when adjusting brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light for iris recognition. When adjusting brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light in the area (611) where the user's (510's) gaze (521) is located.
[0107] Below, the operation of the electronic device (401) to adjust the brightness of an area that can be brightly expressed in the field of view (or environment) of the user (510) is described.
[0108] FIG. 6b illustrates an example of an environment visible to a user, according to one embodiment.
[0109] Fig. 6b can be described with reference to Figs. 1, 2a, 2b, 3a, 3b, 4, and 5. Hereinafter, the first camera (481) may be a camera that captures an environment (or, the user's field of view (FOV)) shown to the user (510), the second camera (485) may be a camera for iris recognition, and the third camera (489) may be a gaze tracking camera.
[0110] FIG. 6B illustrates an environment (602) (or, the user's field of view) visible to the user (510) while the user (510) is wearing the electronic device (401). The environment (602) of FIG. 6B may be visible to the user (510) after the environment (501) of FIG. 5 is visible to the user (510). Hereinafter, the environment visible to the user (or, the user's field of view) may be referred to as an environment.
[0111] In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0112] In one embodiment, the processor (120) may analyze the environment (602). In one embodiment, the analysis of the environment (602) may be performed in the background. In one embodiment, the processor (120) may be continuously performing the analysis of the environment (602). For example, analyzing the environment (602) may mean identifying one or more objects in an image representing the environment (602) acquired through the first camera (481). For example, analyzing the environment (602) may mean identifying one or more objects in an image representing the environment (602) acquired through the first camera (481) while augmented reality (AR) and / or mixed reality (MR) is provided to the user (510). However, the present invention is not limited thereto. For example, analyzing the environment (602) may mean identifying one or more objects in an image representing the environment (602) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2). For example, analyzing the environment (602) may mean identifying one or more objects in an image representing the environment (602) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2) while virtual reality (VR) and / or mixed reality (MR) is provided to a user (510).
[0113] In one embodiment, the processor (120) may identify at least one area (612, 613, 614) in the analyzed environment (602) when it is determined that user authentication based on iris recognition is not possible. In one embodiment, the processor (120) may identify at least one area (612, 613, 614) in the analyzed environment (602) when the environment (602) has a brightness that makes user authentication not possible. In one embodiment, the processor (120) may identify at least one area (612, 613, 614) in the analyzed environment (602) for performing an operation to increase the size of the iris of the eye of the user (510). In one embodiment, the processor (120) can identify at least one area (612, 613, 614) in the analyzed environment (602) if iris recognition using an image for iris recognition fails. In one embodiment, the processor (120) can identify at least one area (612, 613, 614) in the analyzed environment (602) if iris recognition using an image for iris recognition fails before performing an operation to increase the size of the iris of the eye of the user (510).
[0114] In one embodiment, the processor (120) can select at least one area (612, 613, 614) within the environment (602). In one embodiment, the processor (120) can select at least one area (612, 613, 614) identified in the analyzed environment (602). In one embodiment, the processor (120) can select at least one area (612, 613, 614) that can be brightly expressed in the environment (602) for performing an operation to increase the size of the iris of the eye of the user (510). In one embodiment, the processor (120) may select at least one area (612, 613, 614) that can be expressed brightly in the environment (602) to perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0115] In one embodiment, the processor (120) can select at least one region (612, 613, 614) of at least one object that can be represented brightly within the environment (602). In one embodiment, the processor (120) can identify at least one region (612, 613, 614) of at least one object. In one embodiment, the processor (120) can select at least one region (612, 613, 614) located within a specified distance from at least one object that can be represented brightly within the environment (602). In one embodiment, the processor (120) can identify at least one region (612, 613, 614) located within a specified distance from at least one object. For example, the at least one object that can be represented brightly can include a light, a window, an object that reflects and / or radiates light (e.g., the moon, a star, the ocean, and / or a shiny object).
[0116] Referring to FIG. 6B, the processor (120) may select an area (612) that includes a window within the environment (602). In one embodiment, the processor (120) may select an area (613) that includes a light within the environment (602). In one embodiment, the processor (120) may select an area (614) that includes an indirect light within the environment (602). However, the present invention is not limited thereto. In one embodiment, the processor (120) may select an area that includes an illuminating object (e.g., a television, a display device) within the environment (602) and / or an object that can transmit or reflect external light (e.g., a mirror and / or a glossy object).
[0117] In one embodiment, the processor (120) can select (and / or identify) at least one object from among one or more objects that can be brightly represented within the environment (602). In one embodiment, the processor (120) can select (and / or identify) at least one area (612, 613, 614) based on the at least one selected object. For example, the processor (120) can select at least one object from among a window, a light, or an indirect light, and select (and / or identify) at least one area (612, 613, 614) corresponding to the selected object.
[0118] In one embodiment, the processor (120) may select (and / or identify) at least one object that is adjacent to the line of sight (521) of the user (510) among one or more objects that may be brightly expressed within the environment (602). Here, at least one object being adjacent to the line of sight (521) may mean that at least one object is located within a specified distance from the line of sight (521), but is not limited thereto. For example, the processor (120) may select (and / or identify) at least one object that is outside the specified distance from the line of sight (521) of the user (510) among one or more objects that may be brightly expressed within the environment (602).
[0119] In one embodiment, the processor (120) may select (and / or identify) a specified number of objects from among one or more objects that may be brightly represented within the environment (602). Here, the specified number may be the number of objects required to increase the size of the iris of the user (510). The specified number may vary depending on the brightness of the environment (602). For example, the specified number when the environment (602) is bright may be less than the specified number when the environment (602) is dark.
[0120] In one embodiment, the processor (120) may adjust (e.g., increase) the brightness of at least one selected area (612, 613, 614). In one embodiment, the processor (120) may adjust (e.g., increase) the brightness of at least one selected area (612, 613, 614) when it is determined that user authentication based on iris recognition is not possible. By adjusting (e.g., increasing) the brightness of at least one area (612, 613, 614) within the environment (602), the size of the iris of the eye of the user (510) may increase. Here, adjusting (e.g., increasing) the brightness may mean adjusting the transparency of a transparent or translucent lens included in at least one display (250) within the wearable device (200) of FIG. 2A and / or FIG. 2B to be transparent. For example, adjusting (e.g., increasing) brightness may mean increasing the brightness of an area displayed through at least one display (250) in the wearable device (200) of FIG. 2A and / or FIG. 2B. For example, adjusting (e.g., increasing) brightness may mean increasing the brightness of an area displayed through at least one display (350-1, 350-2) in the wearable device (300) of FIG. 3A and / or FIG. 3B. For example, adjusting (e.g., increasing) brightness may mean superimposing a transparent and / or translucent layer on an image displayed through at least one display (350-1, 350-2) to provide augmented reality (AR), virtual reality (VR), or mixed reality (MR). Here, the transparent and / or translucent layer may have a brightness higher than a specified brightness in a selected area of the image. The layer may be transparent in an area other than the selected area of the image. A layer can have a selected area in the image that has a brightness greater than the specified brightness.
[0121] In one embodiment, the processor (120) can obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) can obtain an image for iris recognition through the second camera (485).
[0122] In one embodiment, the processor (120) can obtain an image for iris recognition while the brightness of the environment (602) is adjusted. In one embodiment, the processor (120) can obtain an image for iris recognition while the brightness of at least one area (612, 613, 614) within the environment (602) is adjusted. In one embodiment, the processor (120) can obtain an image for iris recognition while the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly within the environment (602) is adjusted.
[0123] In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition acquired while the brightness of at least one area (612, 613, 614) is adjusted.
[0124] As described above, when adjusting brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light for iris recognition. When adjusting brightness for iris recognition, the electronic device (401) can provide the user (510) with a naturally adjusted brightness environment (602) by optimizing the intensity of light of at least one area (612, 613, 614) of an object that can be expressed brightly in the environment (602) (or, minimize the sense of incongruity to the user (510).
[0125] Below, the operation of the electronic device (401) to adjust the brightness of the environment visible to the user to be uniform is described.
[0126] In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0127] In one embodiment, the processor (120) may analyze the environment (602). In one embodiment, the processor (120) may identify at least one relatively bright region (612, 613, 614) and at least one relatively dark region within the environment (602). For example, the at least one relatively bright region (612, 613, 614) may be a region that includes a light, a window, an object that reflects and / or emits light (e.g., the moon, stars, the ocean, and / or a shiny object). For example, the at least one relatively dark region may be a region that includes an object that absorbs light (e.g., a matte object, an object with a dark color), and / or a shadow.
[0128] In one embodiment, the processor (120) may adjust the brightness of the environment (602) to be uniform. In one embodiment, the processor (120) may decrease the brightness of at least one relatively bright region (612, 613, 614) within the environment (602) and increase the brightness of at least one relatively dark region. Here, increasing the brightness may mean adjusting the transparency of a transparent or translucent lens included in at least one display (250) within the wearable device (200) of FIGS. 2A and 2B to be transparent. For example, increasing the brightness may mean increasing the brightness of an region displayed through at least one display (250) within the wearable device (200) of FIGS. 2A and 2B. For example, increasing the brightness may mean increasing the brightness of an area displayed through at least one display (350-1, 350-2) in the wearable device (300) of FIGS. 3A and 3B. For example, increasing the brightness may mean superimposing (or overlaying) an additional layer of a visual object on an image displayed through at least one display (350-1, 350-2) in the wearable device (300) of FIGS. 3A and 3B. For example, increasing the brightness may mean superimposing (or overlaying) a transparent and / or translucent layer of a visual object on an image acquired through the first camera (481) that captures the front of the electronic device (401). Here, the transparent and / or translucent layer may have a brightness higher than a specified brightness in an area selected from the image. The layer may be transparent in an area other than an area selected from the image. A layer may have a brightness greater than a specified brightness in a selected area of an image. For example, reducing brightness may mean adjusting the transparency of a transparent or translucent lens included in at least one display (250) within the wearable device (200) of FIGS. 2A and 2B to opaque.For example, reducing brightness may mean reducing the brightness of an area displayed through at least one display (250) in the wearable device (200) of FIGS. 2A and 2B. For example, reducing brightness may mean reducing the brightness of an area displayed through at least one display (350-1, 350-2) in the wearable device (300) of FIGS. 3A and 3B. For example, reducing brightness may mean superimposing (or overlaying) an additional layer of visual objects on an image displayed through at least one display (350-1, 350-2) in the wearable device (300) of FIGS. 3A and 3B. For example, reducing brightness may mean superimposing (or overlaying) a visual object with a transparent and / or translucent layer on an image acquired through a first camera (481) that captures the front of the electronic device (401). Here, the transparent and / or translucent layer may have a brightness lower than a specified brightness in a selected area of the image. The layer may be transparent in an area other than the selected area of the image. The layer may have a brightness higher than the specified brightness in an area selected from the image.
[0129] In one embodiment, the processor (120) can obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) can obtain an image for iris recognition through the second camera (485).
[0130] In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of the environment (602) is adjusted to be uniform. In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of at least one relatively bright region (612, 613, 614) is decreased and the brightness of at least one relatively dark region is increased.
[0131] In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition acquired while the brightness of at least one relatively bright region (612, 613, 614) is decreased and the brightness of at least one relatively dark region is increased.
[0132] As described above, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by equalizing the intensity of light for iris recognition when adjusting the brightness for iris recognition.
[0133] Below, an operation of guiding the movement of the user's (510) gaze (521) to an area that can be brightly expressed in the user's (510) field of vision (or environment) by the electronic device (401) is described.
[0134] FIG. 6c illustrates an example of an environment visible to a user, according to one embodiment.
[0135] Fig. 6c can be described with reference to Figs. 1, 2a, 2b, 3a, 3b, 4, and 5. Hereinafter, the first camera (481) may be a camera that captures an environment (or, the user's field of view (FOV)) shown to the user (510), the second camera (485) may be a camera for iris recognition, and the third camera (489) may be a gaze tracking camera.
[0136] FIG. 6C illustrates environments (603, 604) (or, the user's fields of view) visible to the user (510) while the user (510) is wearing the electronic device (401). The environments (603, 604) of FIG. 6C may be visible to the user (510) after the environment (501) of FIG. 5 is visible to the user (510). The environment (604) of FIG. 6C may be visible to the user (510) after the environment (603) of FIG. 6C is visible to the user (510). Hereinafter, the environment visible to the user (or, the user's fields of view) may be referred to as an environment.
[0137] In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0138] In one embodiment, the processor (120) may analyze the environment (603). In one embodiment, the analysis of the environment (603) may be performed in the background. In one embodiment, the processor (120) may be continuously performing the analysis of the environment (603). For example, analyzing the environment (603) may mean identifying one or more objects in an image representing the environment (603) displayed through a display (460, 250, 250-1, 250-2, 350-1, 350-2). For example, analyzing an environment (603) may mean identifying one or more objects in an image representing the environment (603) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2) while virtual reality (VR) and / or mixed reality (MR) is provided to a user (510).
[0139] In one embodiment, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521). In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521). In one embodiment, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521) in order to perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521). In one embodiment, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521) when iris recognition using an image for iris recognition fails before performing an operation to increase the size of the iris of the user's (510) eye.
[0140] In one embodiment, the processor (120) may display an image object (621) based on analyzing the environment (603). In one embodiment, the processor (120) may display the image object (621) based on the location of at least one object that can be expressed brightly within the environment (603). For example, the processor (120) may display the image object (621) that guides the movement of the gaze (521) to at least one object that can be expressed brightly within the environment (603). For example, the processor (120) may display the image object (621) based on at least one object that can be expressed brightly within the environment (603) being a specified distance away from the gaze (521). For example, the at least one object that can be expressed brightly may include a light, a window, an object that reflects and / or radiates light (e.g., the moon, a star, the sea, and / or a shiny object).
[0141] In one embodiment, the processor (120) may display an image object (621) based on the location of at least one object that can be expressed brightly within the environment (603) to perform an operation to increase the size of the iris of the eye of the user (510). In one embodiment, when the brightness of the area where the gaze (521) of the user (510) is located is insufficient and user authentication based on iris recognition fails, the processor (120) may display an image object (621) based on the location of at least one object that can be expressed brightly within the environment (603) to perform an operation to increase the size of the iris of the eye of the user (510).
[0142] Referring to FIG. 6c, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521) toward a light within the environment (603). However, the present invention is not limited thereto. For example, the processor (120) may display an image object that guides the movement of the user's (510) gaze (521) toward a window, indirect light, a light-emitting object (e.g., a TV, a display device), and / or an object that can transmit or reflect external light (e.g., a mirror and / or a glossy object) within the environment (603).
[0143] In one embodiment, the processor (120) may select (and / or identify) at least one object from among one or more objects that may be brightly represented within the environment (603). In one embodiment, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521) based on the at least one selected object. For example, the processor (120) may select at least one object among a window, a light, or an indirect light, and display an image object (621) that guides the movement of the user's (510) gaze (521) to the selected object.
[0144] In one embodiment, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521) to at least one object adjacent to the user's (510) gaze (521) among one or more objects that can be brightly expressed within the environment (603). Here, at least one object being adjacent to the gaze (521) may mean that at least one object is located within a specified distance from the gaze (521). However, the present invention is not limited thereto. For example, the processor (120) may display an image object (621) that guides the movement of the user's (510) gaze (521) to at least one object outside the specified distance from the user's (510) gaze (521) among one or more objects that can be brightly expressed within the environment (603).
[0145] In one embodiment, the processor (120) can identify and / or track the gaze (521) of the user (510). For example, the processor (120) can identify the gaze (521) of the user (510) based on images acquired by the third camera (489). In one embodiment, the processor (120) can identify and / or track the gaze (521) of the user (510) after displaying an image object (621). In one embodiment, the processor (120) can identify that the gaze (521) has moved to at least one object that can be brightly expressed. In one embodiment, the processor (120) can identify that the gaze (521) has moved in a direction (and / or location) indicated by the image object (621).
[0146] In one embodiment, the processor (120) may adjust (e.g., increase) the brightness of the selected area (613). In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may adjust (e.g., increase) the brightness of the selected area (613). By adjusting (e.g., increasing) the brightness of the area (613) within the environment (604), the size of the iris of the user's (510) eye may increase. Here, adjusting (e.g., increasing) the brightness may mean adjusting the transparency of a transparent or translucent lens included in at least one display (250) within the wearable device (200) of FIG. 2A and / or FIG. 2B to be transparent. For example, adjusting (e.g., increasing) brightness may mean increasing the brightness of an area displayed through at least one display (250) in the wearable device (200) of FIG. 2A and / or FIG. 2B. For example, adjusting (e.g., increasing) brightness may mean increasing the brightness of an area displayed through at least one display (350-1, 350-2) in the wearable device (300) of FIG. 3A and / or FIG. 3B. For example, adjusting (e.g., increasing) brightness may mean superimposing a transparent and / or translucent layer on an image displayed through at least one display (350-1, 350-2) to provide augmented reality (AR), virtual reality (VR), or mixed reality (MR). Here, the transparent and / or translucent layer may have a brightness higher than a specified brightness in a selected area of the image. The layer may be transparent in an area other than the selected area of the image. A layer can have a selected area in the image that has a brightness greater than the specified brightness.
[0147] In one embodiment, the processor (120) can obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) can obtain an image for iris recognition through the second camera (485).
[0148] In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of the environment (604) is adjusted. In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of an area (613) within the environment (604) is adjusted. In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of an area (613) of a user (510) within the environment (604) is adjusted.
[0149] In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition acquired while the brightness of an area (613) is adjusted.
[0150] As described above, when adjusting brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light for iris recognition. When adjusting brightness for iris recognition, the electronic device (401) can guide the user's (510) gaze (521) to an object that can be expressed brightly in the environment (604), thereby relatively reducing the intensity of light in the area (613) where the gaze (521) is located.
[0151] Below, the operation of guiding the user's movement to an area that can be brightly expressed in the previous field of view (or environment) by the electronic device (401) is described.
[0152] FIG. 6d illustrates an example of an environment visible to a user, according to one embodiment.
[0153] FIG. 6d can be described with reference to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4, and FIG. 5. Hereinafter, the first camera (481) may be a camera that captures an environment (or, the user's field of view (FOV)) shown to the user (510), the second camera (485) may be a camera for iris recognition, and the third camera (489) may be a gaze tracking camera.
[0154] FIG. 6d illustrates environments (605, 606) (or, the user's fields of view) visible to the user (510) while the user (510) is wearing the electronic device (401). The environments (605, 606) of FIG. 6d may be visible to the user (510) after the environment (501) of FIG. 5 is visible to the user (510). The environment (606) of FIG. 6d may be visible to the user (510) after the environment (605) of FIG. 6d is visible to the user (510). Hereinafter, the environment visible to the user (or, the user's fields of view) may be referred to as an environment.
[0155] In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0156] In one embodiment, the processor (120) can analyze the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605). In one embodiment, the analysis of the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605) can be performed in the background. In one embodiment, the processor (120) can be continuously performing the analysis of the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605). For example, analyzing the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605) can mean identifying one or more objects in an image representing the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605) acquired through the first camera (481). For example, analyzing the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605) may mean, but is not limited to, identifying one or more objects in an image representing the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605) obtained through the first camera (481) while augmented reality (AR) and / or mixed reality (MR) is provided to the user (510). For example, analyzing an environment (605) and / or an environment (606) provided to a user (510) prior to the environment (605) may mean identifying one or more objects in an image representing the environment (605) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2) and / or the environment (606) provided to a user (510) prior to the environment (605).For example, analyzing the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605) may mean identifying one or more objects in an image representing the environment (605) and / or the environment (606) provided to the user (510) prior to the environment (605) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2) while virtual reality (VR) and / or mixed reality (MR) is provided to the user (510). For example, the environment (606) may be different from the environment (605). For example, the environment (606) being different from the environment (605) may mean that a space (e.g., a kitchen) of the environment (606) is different from a space (e.g., a living room) of the environment (605). For example, the fact that the environment (606) is different from the environment (605) may mean that the user's (510) field of view is different in the same space (e.g., living room). For example, the environment (606) may be an environment provided to the user (510) when looking in a first direction in the same space (e.g., living room), and the environment (605) may be an environment provided to the user (510) when looking in a second direction different from the first direction in the same space (e.g., living room). However, the present invention is not limited thereto.
[0157] In one embodiment, the processor (120) may determine whether an object that can be expressed brightly exists within the environment (605) based on analyzing the environment (605). In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (605). In one embodiment, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (605) in order to perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (605). In one embodiment, the processor (120) can determine whether there is an object that can be brightly expressed within the analyzed environment (605) if iris recognition using an image for iris recognition fails before performing an operation to increase the size of the iris of the user's (510) eye.
[0158] In one embodiment, the processor (120) may determine whether an object that can be expressed brightly exists within the previous environment (606) based on analyzing the previous environment (606). In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (606). In one embodiment, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (606) in order to perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (606). In one embodiment, the processor (120) can determine whether there is an object that can be brightly expressed within the analyzed environment (606) if iris recognition using an image for iris recognition fails before performing an action to increase the size of the iris of the user's (510) eye.
[0159] In one embodiment, the processor (120) may display an image object (622) that guides the movement of the user (510). In one embodiment, the processor (120) may display the image object (622) based on analyzing the environment (605) and / or the environment (606). In one embodiment, the processor (120) may display the image object (622) based on a location in the environment (606). For example, the processor (120) may display the image object (622) that guides the movement of the user (510) from the environment (605) to the environment (606).
[0160] Referring to FIG. 6d, the processor (120) may display an image object (622) pointing to a door that can move to the environment (606), but is not limited thereto.
[0161] In one embodiment, the processor (120) may select (and / or identify) one environment (606) from among one or more previous environments that are movable within the environment (605). In one embodiment, the processor (120) may display an image object (622) that guides the movement of the user (510) based on the selected environment (606).
[0162] In one embodiment, the processor (120) may display an image object (622) that guides movement of the user (510) to an environment (606) adjacent to the user (510) among one or more previous environments movable within the environment (605). Here, the environment (606) being adjacent to the user (510) may mean that the environment (606) is located within a specified distance from the user (510).
[0163] In one embodiment, the processor (120) may identify and / or track the movement of the user (510) and / or the movement of the gaze (521).
[0164] For example, the processor (120) can identify the movement of the user (510) through a sensor (e.g., the sensor module (176) of FIG. 1). For example, the processor (120) can identify the movement of the user (510) through an inertial sensor. For example, the processor (120) can identify the movement of the user (510) and / or the movement of the gaze (521) based on images acquired by the third camera (489). In one embodiment, the processor (120) can identify and / or track the movement of the user (510) and / or the movement of the gaze (521) after displaying an image object (622). In one embodiment, the processor (120) can identify that the user (510) is moving into the environment (606). In one embodiment, the processor (120) may identify that the user (510) has moved into an environment (606) indicated by an image object (622).
[0165] In one embodiment, the processor (120) can adjust (e.g., increase) the brightness of at least one selected region (615, 616). In one embodiment, the processor (120) can adjust (e.g., increase) the brightness of at least one selected region (615, 616) in response to the user (510) moving into an environment (606) indicated by the image object (622). By adjusting (e.g., increasing) the brightness of at least one region (615, 616) within the environment (606), the size of the iris of the user's (510) eye can be increased. Here, adjusting (e.g., increasing) the brightness can mean adjusting the transparency of a transparent or translucent lens included in at least one display (250) within the wearable device (200) of FIG. 2A and / or FIG. 2B to be transparent. For example, adjusting (e.g., increasing) brightness may mean increasing the brightness of an area displayed through at least one display (250) in the wearable device (200) of FIG. 2A and / or FIG. 2B. For example, adjusting (e.g., increasing) brightness may mean increasing the brightness of an area displayed through at least one display (350-1, 350-2) in the wearable device (300) of FIG. 3A and / or FIG. 3B. For example, adjusting (e.g., increasing) brightness may mean superimposing a transparent and / or translucent layer on an image displayed through at least one display (350-1, 350-2) to provide augmented reality (AR), virtual reality (VR), or mixed reality (MR). Here, the transparent and / or translucent layer may have a brightness higher than a specified brightness in a selected area of the image. The layer may be transparent in an area other than the selected area of the image. A layer can have a selected area in the image that has a brightness greater than the specified brightness.
[0166] In one embodiment, the processor (120) can obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) can obtain an image for iris recognition through the second camera (485).
[0167] In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of the environment (606) is adjusted. In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of at least one area (615, 616) within the environment (606) is adjusted. In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of at least one area (615, 616) of the user (510) within the environment (606) is adjusted.
[0168] In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition acquired while the brightness of at least one area (615, 616) is adjusted.
[0169] As described above, when adjusting brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light for iris recognition. When adjusting brightness for iris recognition, the electronic device (401) can relatively slightly increase the brightness of the environment provided to the user (510) by guiding the user (510) to an environment (606) in which objects that can be expressed brightly exist.
[0170] In FIG. 6d, the electronic device (401) is illustrated as guiding the user's movement to an area that can be brightly expressed in the previous field of view (or environment), but this is merely an example. In some embodiments, the electronic device (401) may also guide the user's movement of the field of view within the same space without requiring the user to move spatially.
[0171] In one embodiment, the processor (120) may analyze the environment (605). In one embodiment, the analysis of the environment (605) may be performed in the background. In one embodiment, the processor (120) may be continuously performing the analysis of the environment (605). For example, analyzing the environment (605) may mean identifying one or more objects in an image representing the environment (605) acquired through the first camera (481). For example, analyzing the environment (605) may mean identifying one or more objects in an image representing the environment (605) acquired through the first camera (481) while augmented reality (AR) and / or mixed reality (MR) is provided to the user (510). However, the present invention is not limited thereto. For example, analyzing an environment (605) may mean identifying one or more objects in an image representing the environment (605) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2). For example:
[0172] In one embodiment, the processor (120) may determine whether an object that can be expressed brightly exists within the environment (605) based on analyzing the environment (605). In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (605). In one embodiment, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (605) in order to perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may determine whether an object that can be expressed brightly exists within the analyzed environment (605). In one embodiment, the processor (120) can determine whether there is an object that can be brightly expressed within the analyzed environment (605) if iris recognition using an image for iris recognition fails before performing an operation to increase the size of the iris of the user's (510) eye.
[0173] In one embodiment, the processor (120) may analyze another environment provided to the user (510) within the same space as the environment (605). In one embodiment, the processor (120) may analyze the another environment to perform an operation to increase the size of the iris of the user's (510) eye. Here, the environment (605) and the other environment may be an environment that may be provided to the user (510) according to a change in the field of view (FOV) of the user (510) with respect to the environment (605) (or, rotation of the field of view). For example, the environment (605) and the other environment may be an environment that may be provided to the user (510) when the position of the face when looking at the environment (605) is rotated to the right or left. The environment (605) and the other environment may mean that the field of view of the user (510) is different from each other in the same space (e.g., a living room). For example, an environment (605) and another environment may be an environment provided to a user (510) when looking in a first direction in the same space (e.g., a living room), and an environment (605) and another environment may be an environment provided to a user (510) when looking in a second direction different from the first direction in the same space (e.g., a living room). However, this is not limited thereto.
[0174] In one embodiment, the processor (120) may determine, based on analyzing the environment (605) and other environments, whether there is an object that can be brightly expressed within the environment (605) and other environments.
[0175] In one embodiment, the processor (120) may display an image object that guides the movement of the user's (510) field of view. In one embodiment, the processor (120) may display the image object based on analysis of the environment (605) and / or an environment different from the environment (605). In one embodiment, the processor (120) may display the image object based on a location in the environment (605) and the environment different from the environment. For example, the processor (120) may display an image object that guides the movement of the user's (510) field of view from an environment to an environment different from the environment (605).
[0176] In one embodiment, the processor (120) may select (and / or identify) one other environment from among one or more other environments that are movable within the environment. In one embodiment, the processor (120) may display an image object that guides the movement of the user's (510) field of view based on the selected other environment.
[0177] In one embodiment, the processor (120) may identify and / or track movement of the user's (510) field of view.
[0178] For example, the processor (120) can identify movement of the user's (510) field of view through a sensor (e.g., the sensor module (176) of FIG. 1). For example, the processor (120) can identify movement of the user's (510) field of view through an inertial sensor. For example, the processor (120) can identify movement of the user's (510) field of view based on images acquired by the third camera (489).
[0179] In one embodiment, the processor (120) may adjust (e.g., increase) the brightness of at least one area selected in another environment where the user's (510) field of view has shifted. In one embodiment, the processor (120) may acquire an image for iris recognition while the brightness of at least one area selected in another environment is adjusted. In one embodiment, the processor (120) may authenticate the user (510) based on the iris included in the image for iris recognition.
[0180] As described above, when adjusting brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light for iris recognition. When adjusting brightness for iris recognition, the electronic device (401) can relatively slightly increase the brightness of the environment provided to the user (510) by guiding the user (510) to a different visual environment in which objects that can be expressed brightly exist.
[0181] Below, the operation of overlaying an image object on an area that can be brightly expressed in the field of view of an electronic device (401) is described.
[0182] FIG. 6e illustrates an example of an environment visible to a user, according to one embodiment.
[0183] FIG. 6E may be described with reference to FIG. 1, FIG. 2A, FIG. 2B, FIG. 3A, FIG. 3B, FIG. 4, and FIG. 5. Hereinafter, the first camera (481) may be a camera that photographs an environment (or, the user's field of view (FOV)) shown to the user (510), the second camera (485) may be a camera for iris recognition, and the third camera (489) may be a gaze tracking camera.
[0184] FIG. 6e illustrates an environment (607) (or, the user's field of view) visible to the user (510) while the user (510) is wearing the electronic device (401). The environment (607) of FIG. 6e may be visible to the user (510) after the environment (501) of FIG. 5 is visible to the user (510). Hereinafter, the environment visible to the user (or, the user's field of view) may be referred to as an environment.
[0185] In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0186] In one embodiment, the processor (120) may analyze the environment (607). In one embodiment, the analysis of the environment (607) may be performed in the background. In one embodiment, the processor (120) may be continuously performing the analysis of the environment (607). For example, analyzing the environment (607) may mean identifying one or more objects in an image representing the environment (607) displayed through a display (460, 250, 250-1, 250-2, 350-1, 350-2). For example, analyzing an environment (607) may mean identifying one or more objects in an image representing the environment (607) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2) while virtual reality (VR) and / or mixed reality (MR) is provided to a user (510).
[0187] In one embodiment, the processor (120) may select at least one area (623, 624) within the environment (607). In one embodiment, the processor (120) may select at least one area (623, 624) based on analyzing the environment (607). In one embodiment, the processor (120) may select at least one area (623, 624) within the environment (607) when it is determined that user authentication based on iris recognition is not possible. In one embodiment, the processor (120) may select at least one area (623, 624) within the environment (607) to perform an operation to increase the size of the iris of the eye of the user (510). In one embodiment, the processor (120) may select at least one area (623, 624) within the environment (607) when iris recognition using an image for iris recognition fails. In one embodiment, the processor (120) may select at least one area (623, 624) within the environment (607) if iris recognition using an image for iris recognition fails prior to performing an operation to increase the size of the iris of the eye of the user (510).
[0188] In one embodiment, the processor (120) can select at least one area (623, 624) of at least one object within the environment (607) on which visual objects can overlap. In one embodiment, the processor (120) can identify at least one area (623, 624) of at least one object. For example, the at least one object on which visual objects can overlap may include furniture (e.g., sofa, table, bed), appliances (e.g., TV, washing machine, refrigerator), structures (e.g., walls, pillars, ceilings, floors), and / or other objects (e.g., toys, bags, wallets, electronic devices).
[0189] Referring to FIG. 6e, the processor (120) may select an area (623) including a sofa within the environment (607). In one embodiment, the processor (120) may select an area (624) including a table within the environment (607). However, the present invention is not limited thereto.
[0190] In one embodiment, the processor (120) can select (and / or identify) at least one object from among one or more objects that can overlap visual objects within the environment (607). In one embodiment, the processor (120) can select (and / or identify) at least one area (623, 624) based on the at least one selected object. For example, the processor (120) can select at least one object from among a sofa and a table, and select (and / or identify) at least one area (623, 624) corresponding to the selected object.
[0191] In one embodiment, the processor (120) may select (and / or identify) at least one object adjacent to the line of sight (521) of the user (510) among one or more objects capable of overlapping visual objects within the environment (607). Here, at least one object being adjacent to the line of sight (521) may mean that at least one object is located within a specified distance from the line of sight (521), but is not limited thereto.
[0192] In one embodiment, the processor (120) may select (and / or identify) a specified number of objects from among one or more objects that can overlap visual objects within the environment (607). Here, the specified number may be the number of objects required to increase the size of the iris of the user (510). The specified number may vary depending on the brightness of the environment (607). For example, the specified number when the environment (607) is bright may be less than the specified number when the environment (607) is dark.
[0193] In one embodiment, the processor (120) may superimpose (or overlay) a visual object on at least one selected region (623, 624). For example, the processor (120) may generate a visual object having a shape corresponding to at least one selected object, and superimpose (or overlay) the generated visual object on at least one selected region (623, 624). In one embodiment, the processor (120) may superimpose (or overlay) a layer including a visual object on an image including at least one selected region (623, 624). In one embodiment, the processor (120) may superimpose (or overlay) a layer including a visual object corresponding to at least one selected object on an image including at least one selected region (623, 624). The correspondence of a visual object to at least one selected object may mean that the size, shape, and relative position of the visual object within the layer correspond to the size, shape, and relative position of the at least one selected object within the image. For example, the generated visual object may be brighter than the original object in the environment (607). Here, overlaying (or overlaying) a visual object may mean displaying the visual object through at least one display (250) in the wearable device (200) of FIG. 2A and / or FIG. 2B. For example, overlaying (or overlaying) a visual object may mean displaying the visual object through at least one display (350-1, 350-2) in the wearable device (300) of FIG. 3A and / or FIG. 3B. For example, adjusting (e.g., increasing) brightness may mean overlaying a transparent and / or translucent layer on an image displayed through at least one display (350-1, 350-2) to provide augmented reality (AR), virtual reality (VR), or mixed reality (MR). Here, the transparent and / or translucent layer may have a brightness greater than or equal to a specified brightness in a selected area of the image.A layer can be transparent in areas other than the selected area of the image. A layer can have a brightness higher than the specified brightness in areas other than the selected area of the image.
[0194] In one embodiment, the brightness of the environment (607) can be adjusted (or increased) by overlaying a visual object on at least one selected area (623, 624).
[0195] In one embodiment, the processor (120) can obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) can obtain an image for iris recognition through the second camera (485).
[0196] In one embodiment, the processor (120) may acquire an image for iris recognition while a visual object is superimposed (or overlaid) on at least one selected area (623, 624). In one embodiment, the processor (120) may acquire an image for iris recognition while the brightness of the environment (607) is adjusted.
[0197] In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate a user (510) based on an iris included in an image for iris recognition acquired while the brightness of at least one area (623, 624) is adjusted.
[0198] As described above, when adjusting brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light for iris recognition. When adjusting brightness for iris recognition, the electronic device (401) can provide the user (510) with a naturally adjusted brightness environment (607) by superimposing an image object that is brighter than an object located in the environment (607) (or, minimize the user's (510) sense of incongruity).
[0199] Below, the operation of changing the electronic device (401) to a see-through environment is described.
[0200] FIG. 6f illustrates an example of an environment visible to a user, according to one embodiment.
[0201] FIG. 6f can be explained with reference to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4, and FIG. 5.
[0202] FIG. 6F illustrates environments (608, 609) (or, the user's fields of view) visible to the user (510) while the user (510) is wearing the electronic device (401). The environments (608, 609) of FIG. 6F may be visible to the user (510) before the environment (501) of FIG. 5 is visible to the user (510). The environment (609) of FIG. 6F may be visible to the user (510) after the environment (608) of FIG. 6F is visible to the user (510). The environment (501) of FIG. 5 may be visible to the user (510) after the environment (609) of FIG. 6F is visible to the user (510). Hereinafter, the environment visible to the user (or, the user's fields of view) may be referred to as an environment.
[0203] The environment (608) of FIG. 6F may be an environment that provides virtual reality (VR) or mixed reality (MR) to the user (510) while the user (510) is wearing the electronic device (401). The environment (608) of FIG. 6F may be an environment that provides a virtual environment that is distinct from the external environment rendered through the processor (120) (or does not reflect the external environment) to the user (510) through the display (460, 250, 250-1, 250-2, 350-1, 350-2).
[0204] In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0205] In one embodiment, the processor (120) can identify and / or track the gaze (521) of the user (510). For example, the processor (120) can identify the gaze (521) of the user (510) based on images captured by the third camera (489) for eye tracking (ET). For example, the images captured by the third camera (489) may be glint images. For example, the processor (120) can identify the gaze (521) of the user (510) based on the position of the eye included in the images captured by the third camera (489). For example, the processor (120) can identify the gaze (521) of the user (510) based on the position of the iris included in the images captured by the third camera (489). For example, the processor (120) can identify the gaze (521) of the user (510) by tracking the position of the iris. However, the present invention is not limited thereto.
[0206] In one embodiment, the processor (120) may obtain an authentication request from the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition. For example, the processor (120) may obtain the authentication request while the environment (608) is being provided to the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition generated by the program (140) while the program (140) is being executed.
[0207] In one embodiment, the processor (120) may determine whether user authentication based on iris recognition is possible in response to an authentication request from the user (510). In one embodiment, the processor (120) may determine whether iris recognition is possible in response to an authentication request based on the iris of the user (510). In one embodiment, the processor (120) may determine whether iris recognition-based user authentication is possible based on the size of the iris of the user's (510) eye.
[0208] In one embodiment, if it is determined that user authentication based on iris recognition is possible, the processor (120) may authenticate the user based on iris recognition using an image acquired through the second camera (485). In one embodiment, if it is determined that user authentication based on iris recognition is possible, the processor (120) may authenticate the user based on iris recognition using an image for iris recognition while providing virtual reality (VR) or mixed reality (MR) through the environment (608). In one embodiment, if iris recognition using an image for iris recognition fails while providing virtual reality (VR) or mixed reality (MR) through the environment (608), the processor (120) may perform an operation to increase the size of the iris of the eye of the user (510).
[0209] In one embodiment, if it is determined that user authentication based on iris recognition is not possible, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye.
[0210] In one embodiment, the processor (120) may determine whether a transition to another environment (or external environment) distinct from the environment (608) is required. For example, the processor (120) may determine whether a transition to another environment (or external environment) is required based on analyzing the environment (608). For example, the processor (120) may determine whether a transition to another environment (or external environment) is required based on analyzing the other environment (or external environment). In one embodiment, the processor (120) may determine whether a transition to another environment (or external environment) is required to perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails, the processor (120) may determine whether a transition to another environment (or external environment) is necessary to perform an operation to increase the size of the iris of the user's (510) eye.
[0211] In one embodiment, the processor (120) can analyze the environment (608). In one embodiment, the analysis of the environment (608) can be performed in the background. In one embodiment, the processor (120) can be in a state of continuously performing the analysis of the environment (608). For example, analyzing the environment (608) can mean identifying one or more objects in an image representing the environment (608) displayed through a display (460, 250, 250-1, 250-2, 350-1, 350-2). For example, analyzing an environment (608) may mean identifying one or more objects in an image representing the environment (608) displayed via a display (460, 250, 250-1, 250-2, 350-1, 350-2) while augmented reality (AR) and / or mixed reality (MR) is provided to a user (510).
[0212] In one embodiment, the processor (120) may determine, based on analyzing the environment (608), whether brightness adjustment of at least one area within the environment (608) is possible. For example, the processor (120) may determine whether brightness adjustment of an area including the line of sight (521) within the environment (608) is possible. For example, the processor (120) may determine whether an object that can be expressed brightly exists within the environment (608).
[0213] In one embodiment, the processor (120) may determine whether brightness adjustment of at least one area within the other environment is possible based on analyzing another environment (or external environment) distinct from the environment (608). In one embodiment, the processor (120) may determine whether brightness of the other environment is greater than or equal to a specified brightness based on analyzing another environment (or external environment) distinct from the environment (608). For example, the other environment may include an external environment captured through the first camera (481).
[0214] In one embodiment, the processor (120) may perform iris recognition while providing the environment (608) to the user (510) if it is determined that brightness of at least one area within the environment (608) is adjustable. In one embodiment, the processor (120) may perform iris recognition while adjusting the brightness of at least one area within the environment (608) if it is determined that brightness of at least one area within the environment (608) is adjustable.
[0215] In one embodiment, the processor (120) may determine to transition from the environment (608) to another environment if it is determined that brightness adjustment of at least one area within the environment (608) is not possible. In one embodiment, the processor (120) may determine to transition from the environment (608) to another environment if it is determined that brightness adjustment of at least one area within the other environment is possible. In one embodiment, the processor (120) may determine to transition from the environment (608) to another environment if it is determined that the brightness of the other environment is greater than or equal to a specified brightness.
[0216] In one embodiment, the processor (120) may display a text object (625) notifying that the screen is switched in the environment (609). In one embodiment, when a switch from the environment (608) to another environment is determined, the processor (120) may display a text object (625) notifying that the screen is switched. In one embodiment, when a switch from the environment (608) to another environment is determined, the processor (120) may display a text object (625) notifying that the screen is switched from the environment (609) to the environment (501).
[0217] In one embodiment, the processor (120) may provide the environment (501) to the user (510) after displaying the text object (625). In one embodiment, the processor (120) may determine whether user authentication based on iris recognition is possible after switching from the environment (609) to the environment (501). In one embodiment, the processor (120) may determine whether user authentication based on iris recognition is possible while providing the environment (501) to the user (510).
[0218] In one embodiment, if the processor (120) determines that user authentication based on iris recognition is possible after switching from the environment (609) to the environment (501), the processor (120) may authenticate the user based on iris recognition using an image acquired through the second camera (485). In one embodiment, if the processor (120) determines that user authentication based on iris recognition is not possible, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, if iris recognition using an image for iris recognition fails, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye.
[0219] Below, the operation of the electronic device (401) guiding the movement of the user's gaze in the direction of the second camera (485) is described.
[0220] FIG. 7 illustrates an example of an environment visible to a user, according to one embodiment.
[0221] Fig. 7 can be described with reference to Figs. 1, 2a, 2b, 3a, 3b, 4, and 5. Hereinafter, the first camera (481) may be a camera that captures an environment (or, the user's field of view (FOV)) shown to the user (510), the second camera (485) may be a camera for iris recognition, and the third camera (489) may be a gaze tracking camera.
[0222] FIG. 7 illustrates an environment (701) (or, the user's field of view) visible to a user (510) while the user (510) is wearing an electronic device (401). The environment (701) of FIG. 7 may be visible to the user (510) after the environment (501) of FIG. 5 is visible to the user (510). Hereinafter, the environment visible to the user (or, the user's field of view) may be referred to as an environment.
[0223] In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye. In one embodiment, the processor (120) may perform an operation to increase the size of the iris of the user's (510) eye when the brightness of the area where the user's (510) gaze (521) is located is insufficient and user authentication based on iris recognition fails.
[0224] In one embodiment, the processor (120) may display an image object (721, 722) that guides the movement of the user's (510) gaze (521). In one embodiment, the processor (120) may display an image object (721, 722) that guides the movement of the user's (510) gaze (521) to an area (711, 712) where the second camera (485) is located. In one embodiment, the processor (120) may display an image object (721, 722) that guides the movement of the user's (510) gaze (521) to an area (711, 712) adjacent to a bright area among one or more areas where the second camera (485) is located. For example, the processor (120) may display an image object (721) that guides the movement of the user's (510) gaze (521) to an area (711) adjacent to a bright area among one or more areas (711, 712) where the second camera (485) is located.
[0225] In one embodiment, the processor (120) can identify and / or track the gaze (521) of the user (510). For example, the processor (120) can identify the gaze (521) of the user (510) based on images acquired by the third camera (489). In one embodiment, the processor (120) can identify and / or track the gaze (521) of the user (510) after displaying image objects (721, 722). In one embodiment, the processor (120) can identify that the gaze (521) has moved to an area (711, 712) where the second camera (485) is located. In one embodiment, the processor (120) can identify that the gaze (521) has moved in a direction (and / or location) indicated by the image objects (721, 722).
[0226] In one embodiment, the processor (120) may obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) may obtain an image for iris recognition through the second camera (485). In one embodiment, the processor (120) may authenticate the user (510) based on the iris included in the image for iris recognition.
[0227] According to an embodiment, the processor (120) may increase the brightness of an area (711, 712) guided by an image object (721, 722). In one embodiment, the processor (120) may acquire an image of the eye through the second camera (485) while the brightness of the area (711, 712) is increased.
[0228] As described above, when adjusting the brightness for iris recognition, the electronic device (401) can reduce discomfort (e.g., glare) to the user (510) by optimizing the intensity of light for iris recognition. When acquiring an image of the eye for iris recognition, the electronic device (401) can acquire a clearer image of the eye (or, looking at the second camera (485)) by directing the gaze (521) of the user (510) toward the second camera (485).
[0229] Figure 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0230] FIG. 8 can be explained with reference to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4, FIG. 5, FIG. 6a, FIG. 6b, FIG. 6c, FIG. 6d, FIG. 6e, and FIG. 6f.
[0231] Referring to FIG. 8, at operation 810, the processor (120) may obtain an authentication request. For example, the processor (120) may obtain an authentication request based on iris recognition. For example, the processor (120) may obtain the authentication request while the environment (501) is provided to the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition generated by the program (140) while the program (140) is executed. The processor (120) may obtain an authentication request based on iris recognition while providing augmented reality (AR), virtual reality (VR), or mixed reality (MR) to the user (510).
[0232] In operation 820, the processor (120) may select a portion of a field of view. In one embodiment, the processor (120) may select a region (611) where the user's gaze (521) is located within the field of view (or environment (601)). In one embodiment, the processor (120) may select at least one region (612, 613, 614) of at least one object that may be expressed brightly within the field of view (or environment (602)). In one embodiment, the processor (120) may select at least one relatively bright region (612, 613, 614) and at least one relatively dark region within the field of view (or environment (602)).
[0233] In operation 830, the processor (120) can adjust the brightness of some areas.
[0234] In one embodiment, the processor (120) can adjust the brightness of an area (611) within the field of view (or environment (601)) where the user's gaze (521) is located. For example, the processor (120) can increase the brightness of an area (611) within the field of view (or environment (601)) where the user's gaze (521) is located.
[0235] In one embodiment, the processor (120) can adjust the brightness of at least one region (612, 613, 614) of at least one object that can be brightly represented within the field of view (or environment (602)). In one embodiment, the processor (120) can increase the brightness of at least one region (612, 613, 614) of at least one object that can be brightly represented within the field of view (or environment (602)).
[0236] In one embodiment, the processor (120) can adjust the brightness of at least one relatively bright region (612, 613, 614) and at least one relatively dark region within the field of view (or environment (602)). In one embodiment, the processor (120) can decrease the brightness of at least one relatively bright region (612, 613, 614) and increase the brightness of at least one relatively dark region within the field of view (or environment (602)).
[0237] In operation 840, the processor (120) may obtain an image for iris recognition. In one embodiment, the processor (120) may obtain an image of the eye through the second camera (485). In one embodiment, the processor (120) may obtain an image for iris recognition through the second camera (485).
[0238] In operation 850, the processor (120) may authenticate the user. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition acquired while the brightness of a certain area is adjusted.
[0239] FIG. 9 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0240] FIG. 9 can be explained with reference to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4, FIG. 5, FIG. 6a, FIG. 6b, FIG. 6c, FIG. 6d, FIG. 6e, and FIG. 6f.
[0241] Referring to FIG. 9, at operation 910, the processor (120) may obtain an authentication request. For example, the processor (120) may obtain an authentication request based on iris recognition. For example, the processor (120) may obtain the authentication request while the environment (501) is provided to the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition generated by the program (140) while the program (140) is executed. The processor (120) may obtain an authentication request based on iris recognition while providing augmented reality (AR), virtual reality (VR), or mixed reality (MR) to the user (510).
[0242] At operation 920, the processor (120) may determine whether iris recognition is possible. In one embodiment, the processor (120) may determine whether iris recognition is possible in response to an authentication request from the user (510). In one embodiment, the processor (120) may determine whether iris recognition is possible in response to an authentication request based on the iris of the user (510).
[0243] In one embodiment, the processor (120) may determine whether iris recognition is possible based on the size of the iris of the user's (510) eye. For example, the processor (120) may identify the size of the iris based on an image of the user's (510) eye acquired through the second camera (485). The processor (120) may determine whether iris recognition is possible based on the size of the iris identified based on the image of the eye. For example, if the size of the iris exceeds a specified first size, it may be determined that iris recognition is possible. For example, if the size of the iris is less than or equal to the specified first size, it may be determined that iris recognition is not possible. The processor (120) may determine whether iris recognition is possible based on a second size of the pupil identified based on the image of the eye. For example, if the second size of the pupil is less than or equal to the specified second size, it may be determined that iris recognition is possible. For example, if the second size of the pupil exceeds a specified second size, it may be determined that iris recognition is not possible. For example, the specified first size and / or the specified second size may be preset.
[0244] In operation 920, if it is determined that iris recognition is possible, the processor (120) may perform operation 930. In operation 920, if it is determined that iris recognition is not possible, the processor (120) may perform operation 940.
[0245] In operation 930, the processor (120) may acquire an image for iris recognition. In one embodiment, if it is determined that user authentication based on iris recognition is possible, the processor (120) may acquire the image through the second camera (485).
[0246] In operation 940, the processor (120) may determine whether the brightness of a certain area is adjustable. The processor (120) may determine whether there is at least one object whose brightness can be adjusted in the field of view (or environment) of the user (510). For example, the processor (120) may determine whether the brightness of an area including the line of sight (521) within the environment (501) is adjustable. For example, the processor (120) may determine whether there is an object within the environment (501) that can be expressed brightly.
[0247] In one embodiment, if there is at least one object whose brightness can be adjusted in the field of view (or environment) of the user (510), the processor (120) may determine that the brightness of a certain area is adjustable. In one embodiment, if the brightness of an area including the line of sight (521) in the environment (501) is adjustable, the processor (120) may determine that the brightness of the certain area is adjustable. In one embodiment, if there is an object in the environment (501) that can be expressed brightly, the processor (120) may determine that the brightness of the certain area is adjustable.
[0248] In one embodiment, if there is no object in the field of view (or environment) of the user (510) whose brightness can be adjusted, the processor (120) may determine that the brightness of some areas is adjustable. In one embodiment, if the brightness of an area including the line of sight (521) in the environment (501) is not adjustable, the processor (120) may determine that the brightness of some areas is adjustable. In one embodiment, if there is no object in the environment (501) that can be expressed as bright, the processor (120) may determine that the brightness of some areas is adjustable.
[0249] In operation 940, if it is determined that the brightness of some areas is adjustable, the processor (120) may perform operation 950. In operation 940, if it is determined that the brightness of some areas is not adjustable, the processor (120) may perform operation 970.
[0250] In operation 950, the processor (120) may adjust the brightness of some areas. In one embodiment, the processor (120) may adjust the brightness of an area (611) where the user's gaze (521) is located within the environment (601). In one embodiment, the processor (120) may adjust the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly within the environment (602). The processor (120) may superimpose (or overlay) a relatively bright visual object onto at least one area (623, 624) within the environment (607).
[0251] In operation 960, the processor (120) may obtain an image for iris recognition. In one embodiment, the processor (120) may obtain an image for iris recognition while the brightness of an area (611) where the gaze (521) of the user (510) is located in the environment (601) is adjusted. In one embodiment, the processor (120) may obtain an image for iris recognition while the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly in the environment (602) is adjusted. In one embodiment, the processor (120) may obtain an image for iris recognition while a relatively bright visual object is overlapped (or overlaid) in at least one area (623, 624).
[0252] In operation 970, the processor (120) can adjust the brightness of the entire area. The processor (120) can increase the brightness of the entire area.
[0253] In operation 980, the processor (120) may obtain an image for iris recognition. In one embodiment, the processor (120) may obtain an image for iris recognition while the brightness of the entire area is adjusted.
[0254] In operation 990, the processor (120) may authenticate the user. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition acquired while the brightness of a certain area is adjusted.
[0255] FIG. 10 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0256] FIG. 10 can be explained with reference to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4, FIG. 5, FIG. 6a, FIG. 6b, FIG. 6c, FIG. 6d, FIG. 6e, and FIG. 6f.
[0257] Referring to FIG. 10, in operation 1010, the processor (120) may obtain an authentication request. The authentication request may be obtained. For example, the processor (120) may obtain an authentication request based on iris recognition. For example, the processor (120) may obtain the authentication request while the environment (501) is provided to the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition generated by the program (140) while the program (140) is executed. The processor (120) may obtain an authentication request based on iris recognition while providing augmented reality (AR), virtual reality (VR), or mixed reality (MR) to the user (510).
[0258] In operation 1020, the processor (120) may determine whether brightness adjustment of a portion of the current field of view is possible. The processor (120) may determine whether at least one object whose brightness can be adjusted exists in the current field of view (or environment) of the user (510). For example, the processor (120) may determine whether brightness adjustment of an area including the line of sight (521) within the environment (501) is possible. For example, the processor (120) may determine whether an object that can be expressed brightly exists within the environment (501).
[0259] In one embodiment, if there is at least one object whose brightness can be adjusted in the current field of view (or environment) of the user (510), the processor (120) may determine that the brightness of a certain area is adjustable. In one embodiment, if the brightness of an area including the line of sight (521) in the environment (501) is adjustable, the processor (120) may determine that the brightness of a certain area is adjustable. In one embodiment, if there is an object in the environment (501) that can be expressed brightly, the processor (120) may determine that the brightness of a certain area is adjustable.
[0260] In one embodiment, if there is no object in the user's (510) current field of view (or environment) whose brightness can be adjusted, the processor (120) may determine that the brightness of some areas is adjustable. In one embodiment, if the brightness of an area including the line of sight (521) in the environment (501) is not adjustable, the processor (120) may determine that the brightness of some areas is adjustable. In one embodiment, if there is no object in the environment (501) that can be expressed as bright, the processor (120) may determine that the brightness of some areas is adjustable.
[0261] In operation 1020, if it is determined that the brightness of some areas is adjustable, the processor (120) may perform operation 1040. In operation 1020, if it is determined that the brightness of some areas is not adjustable, the processor (120) may perform operation 1030.
[0262] In operation 1030, the processor (120) may display an image object (622) that guides the user (510) to a portion of the previous field of view. The processor (120) may display an image object (622) that guides the user's (510) movement. For example, the processor (120) may display an image object (622) that guides the user's (510) movement from the current field of view (e.g., environment (605)) to the previous field of view (e.g., environment (606)).
[0263] In operation 1040, the processor (120) can adjust the brightness of some areas.
[0264] In one embodiment, the processor (120) can adjust the brightness of an area where the user's gaze (521) is located within the current field of view (e.g., environment (605)). In one embodiment, the processor (120) can adjust the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly within the current field of view (e.g., environment (605)). The processor (120) can superimpose (or overlay) a relatively bright visual object onto at least one area within the current field of view (e.g., environment (605)).
[0265] In one embodiment, the processor (120) can adjust the brightness of an area where the user's gaze (521) is located within a previous field of view (e.g., environment (606)). In one embodiment, the processor (120) can adjust the brightness of at least one area (615, 616) of at least one object that can be expressed brightly within the previous field of view (e.g., environment (606)). The processor (120) can superimpose (or overlay) a relatively bright visual object onto at least one area within the previous field of view (e.g., environment (606)).
[0266] In operation 1050, the processor (120) may obtain an image for iris recognition.
[0267] In one embodiment, the processor (120) may acquire an image for iris recognition while the brightness of an area where the user's gaze (521) is located within the current field of view (e.g., environment (605)) is adjusted. In one embodiment, the processor (120) may acquire an image for iris recognition while the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly within the current field of view (e.g., environment (605)) is adjusted. In one embodiment, the processor (120) may acquire an image for iris recognition while a relatively bright visual object is superimposed (or overlaid) upon at least one area within the current field of view (e.g., environment (605)).
[0268] In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of an area where the user's gaze (521) is located within a previous field of view (e.g., environment (606)) is adjusted. In one embodiment, the processor (120) can acquire an image for iris recognition while the brightness of at least one area (615, 616) of at least one object that can be expressed brightly within the previous field of view (e.g., environment (606)) is adjusted. In one embodiment, the processor (120) can acquire an image for iris recognition while a relatively bright visual object is superimposed (or overlaid) upon at least one area within the previous field of view (e.g., environment (606)).
[0269] In operation 1060, the processor (120) may authenticate the user. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition acquired while the brightness of a certain area is adjusted.
[0270] FIG. 11 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0271] FIG. 11 can be explained with reference to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4, FIG. 5, FIG. 6a, FIG. 6b, FIG. 6c, FIG. 6d, FIG. 6e, and FIG. 6f.
[0272] FIG. 11 may be disclosed when virtual reality (VR) or mixed reality (MR) is provided to a user (510).
[0273] Referring to FIG. 11, in operation 1110, the processor (120) may obtain an authentication request. The authentication request may be obtained. For example, the processor (120) may obtain an authentication request based on iris recognition. For example, the processor (120) may obtain the authentication request while the environment (501) is provided to the user (510). For example, the processor (120) may obtain an authentication request based on iris recognition generated by the program (140) while the program (140) is executed. The processor (120) may obtain an authentication request based on iris recognition while providing virtual reality (VR) or mixed reality (MR) to the user (510).
[0274] In operation 1120, the processor (120) may determine whether the brightness of a portion of the field of view is adjustable. The processor (120) may determine whether there is at least one object in the user's (510) current field of view (or environment) whose brightness can be adjusted. For example, the processor (120) may determine whether the brightness of an area including the line of sight (521) within the environment (501) can be adjusted. For example, the processor (120) may determine whether there is an object in the environment (501) that can be expressed brightly.
[0275] In one embodiment, if there is at least one object whose brightness can be adjusted in the current field of view (or environment) of the user (510), the processor (120) may determine that the brightness of a certain area is adjustable. In one embodiment, if the brightness of an area including the line of sight (521) in the environment (501) is adjustable, the processor (120) may determine that the brightness of a certain area is adjustable. In one embodiment, if there is an object in the environment (501) that can be expressed brightly, the processor (120) may determine that the brightness of a certain area is adjustable.
[0276] In one embodiment, if there is no object in the user's (510) current field of view (or environment) whose brightness can be adjusted, the processor (120) may determine that the brightness of some areas is adjustable. In one embodiment, if the brightness of an area including the line of sight (521) in the environment (501) is not adjustable, the processor (120) may determine that the brightness of some areas is adjustable. In one embodiment, if there is no object in the environment (501) that can be expressed as bright, the processor (120) may determine that the brightness of some areas is adjustable.
[0277] In operation 1120, if it is determined that the brightness of some areas is adjustable, the processor (120) may perform operation 1130. In operation 1120, if it is determined that the brightness of some areas is not adjustable, the processor (120) may perform operation 1140.
[0278] In operation 1130, the processor (120) may adjust the brightness of some areas. In one embodiment, the processor (120) may adjust the brightness of an area (611) where the user's gaze (521) is located within the environment (601). In one embodiment, the processor (120) may adjust the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly within the environment (602). The processor (120) may superimpose (or overlay) a relatively bright visual object onto at least one area (623, 624) within the environment (607).
[0279] In operation 1140, the processor (120) may analyze an image for see-through. In one embodiment, the processor (120) may analyze an image for providing an environment (or field of view) for providing see-through (or augmented reality) to the user (510). Here, the image for providing augmented reality to the user (510) may be an image acquired through the first camera (481).
[0280] For example, the processor (120) may determine whether there is at least one object whose brightness can be adjusted in an image for providing augmented reality. For example, the processor (120) may determine whether there is an object that can be expressed brightly in an image for providing augmented reality.
[0281] In operation 1150, the processor (120) can determine whether the brightness of a portion of the field of view for see-through is adjustable. The processor (120) can determine whether at least one object for which brightness can be adjusted exists in the field of view (or environment) for see-through acquired through the first camera (481). For example, the processor (120) can determine whether an object that can be expressed brightly exists in the field of view (or environment) for see-through acquired through the first camera (481).
[0282] In one embodiment, if there is at least one object whose brightness can be adjusted in the field of view (or environment) for see-through acquired through the first camera (481), the processor (120) can determine that the brightness of a portion of the field of view for see-through is adjustable. In one embodiment, if there is an object that can be expressed brightly in the field of view (or environment) for see-through acquired through the first camera (481), the processor (120) can determine that the brightness of a portion of the field of view for see-through is adjustable.
[0283] In operation 1150, if it is determined that the brightness of a portion of the field of view for see-through is adjustable, the processor (120) may perform operation 1160. In operation 1150, if it is determined that the brightness of a portion of the field of view for see-through is not adjustable, the processor (120) may perform operation 1155.
[0284] In operation 1155, the processor (120) can adjust the brightness of the entire area. The processor (120) can increase the brightness of the entire area.
[0285] In operation 1160, the processor (120) can switch to a see-through environment. The processor (120) can display a field of view (or environment) for see-through acquired through the first camera (481).
[0286] In operation 1170, the processor (120) may adjust the brightness of some areas. In one embodiment, the processor (120) may adjust the brightness of an area (611) where the user's gaze (521) is located within the environment (601). In one embodiment, the processor (120) may adjust the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly within the environment (602). The processor (120) may superimpose (or overlay) a relatively bright visual object onto at least one area (623, 624) within the environment (607).
[0287] In operation 1180, the processor (120) may obtain an image for iris recognition. In one embodiment, the processor (120) may obtain an image for iris recognition while the brightness of an area (611) where the gaze (521) of the user (510) is located in the environment (601) is adjusted. In one embodiment, the processor (120) may obtain an image for iris recognition while the brightness of at least one area (612, 613, 614) of at least one object that can be expressed brightly in the environment (602) is adjusted. In one embodiment, the processor (120) may obtain an image for iris recognition while a relatively bright visual object is overlapped (or overlaid) in at least one area (623, 624).
[0288] In operation 1190, the processor (120) may authenticate the user. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition. In one embodiment, the processor (120) may authenticate the user (510) based on an iris included in an image for iris recognition acquired while the brightness of a certain area is adjusted.
[0289] As described above, the electronic device (101, 200, 300, 401) may include at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) arranged to face the eyes of the user (510) when the electronic device (101, 200, 300, 401) is worn by the user (510). The electronic device (101, 200, 300, 401) may include at least one camera (485, 240-1, 240-4, 340-1, 340-2) arranged to face the eyes of the user (510) when the electronic device (101, 200, 300, 401) is worn by the user (510). The electronic device (101, 200, 300, 401) may include at least one processor (120) including a processing circuit. The electronic device (101, 200, 300, 401) may include a memory (130) that stores instructions and includes one or more storage media. The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to obtain an authentication request from the user (510). The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify at least one area (611, 612, 613, 614, 615, 616, 623, 624) in an environment (501, 601, 602, 603, 604, 605, 607, 608, 609) visible to a user (510) through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) based on obtaining the authentication request.The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to control the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) is adjusted. The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to acquire an iris image of the eye through the at least one camera (485, 240-1, 240-4, 340-1, 340-2) while the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) is adjusted. The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to authenticate the user (510) based on the iris of the eye identified in the iris image.
[0290] The processor (120), in response to obtaining the authentication request, may cause the processor (120) to identify the size of the iris of the eye of the user (510). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to, in response to the size of the iris being greater than or equal to a specified size, obtain another iris image of the eye of the user (510) through the at least one camera (485, 240-1, 240-4, 340-1, 340-2) while the brightness is not adjusted. The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to authenticate the user (510) based on the iris identified in the other iris image in response to the size of the iris being greater than or equal to a specified size. The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to authenticate the user (510) based on the iris identified in the iris image acquired while the brightness was adjusted in response to the size of the iris being less than a specified size.
[0291] The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to control the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) to adjust the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) in response to a failure in authentication of the user (510) based on the iris identified in the other iris image. The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to authenticate the user (510) based on the iris identified in the iris image acquired while the brightness is adjusted.
[0292] At least one of the above areas (611, 612, 613, 614, 615, 616, 623, 624) may be adjacent to an area where the camera (485, 240-1, 240-4, 340-1, 340-2) is located.
[0293] The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify the gaze (521) of the user (510) in an image acquired through the camera (485, 240-1, 240-4, 340-1, 340-2). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify the at least one area (611) including a point toward which the gaze (521) of the user (510) is directed.
[0294] The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify the gaze (521) of the user (510) in an image acquired through the camera (485, 240-1, 240-4, 340-1, 340-2). The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to display an image object (621) through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) that guides the gaze (521) to move to the at least one area (612, 613, 614, 615, 616, 623, 624).
[0295] The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to adjust the transparency of an area of the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) corresponding to the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) such that the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) is adjusted.
[0296] The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify at least some other area (615, 616) in a previous environment (606) previously shown to the user (510) based on the at least one area (611, 612, 613, 614, 615, 616, 623, 624) being unidentified. The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to display an image object (622) through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) that guides the user (510) to move to the previous environment (501, 601, 602, 603, 604, 605, 607, 608, 609) based on the identification of at least some other area in the previous environment (501, 601, 602, 603, 604, 605, 607, 608, 609).
[0297] The electronic device (101, 200, 300, 401) may further include at least one other camera (481) arranged to photograph the surrounding environment (501, 601, 602, 603, 604, 605, 607). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to obtain the authentication request while the environment (608, 609) is displayed on the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2). The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to, in response to obtaining the authentication request, identify at least some other area (611, 612, 613, 614, 615, 616, 623, 624) in the surrounding environment (501, 601, 602, 603, 604, 605, 607) obtained through the at least one other camera (481). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to control the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the surrounding environment (501, 601, 602, 603, 604, 605, 607) is shown to the user (510) instead of the environment (608, 609) in response to the at least some other area (611, 612, 613, 614, 615, 616, 623, 624) being identified.The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to acquire the iris image while the surrounding environment (501, 601, 602, 603, 604, 605, 607) is visible to the user (510). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to authenticate the user (510) based on the iris identified in the iris image.
[0298] The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify at least one first region (612, 613, 614) having a first brightness equal to or greater than a specified first brightness and at least one second region equal to or less than a second brightness among a plurality of regions within the environment (501, 601, 602, 603, 604, 605, 607, 608, 609). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to control the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the brightness of the at least one first region (612, 613, 614) is decreased and the brightness of the at least one second region is increased based on the at least one first region (612, 613, 614) and the at least one second region being identified.
[0299] The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify at least one area (611, 612, 613, 614, 615, 616, 623, 624) of which brightness is adjustable among a plurality of areas within the environment (501, 601, 602, 603, 604, 605, 607, 608, 609). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to control the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) to increase the brightness of the at least one area (611, 612, 613, 614, 615, 616, 623, 624) based on the at least one area (611, 612, 613, 614, 615, 616, 623, 624) being identified.
[0300] The above instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify the gaze (521) of the user (510) in an image acquired through the camera (485, 240-1, 240-4, 340-1, 340-2). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to identify at least one area (611, 612, 613, 614, 623, 624) within a specified distance from the line of sight (521) among the one or more areas within the environment (501, 601, 602, 603, 604, 605, 607) whose brightness is adjustable. The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to control the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the brightness of the at least one area (611, 612, 613, 614, 623, 624) is increased based on the at least one area (611, 612, 613, 614, 623, 624) being identified.
[0301] The at least one area (611, 612, 613, 614, 615, 616, 623, 624) can be visible to the user (510) by light from the at least one area (611, 612, 613, 614, 615, 616, 623, 624) passing through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2). The instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable device (101) to adjust the brightness of the identified at least one area (611, 612, 613, 614, 615, 616, 623, 624) by displaying an image object corresponding to the at least one area (611, 612, 613, 614, 615, 616, 623, 624) visible to the user (510) on the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2).
[0302] As described above, the method can be performed in an electronic device (101, 200, 300, 401) including at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) arranged to face the eyes of a user (510) when the electronic device (101, 200, 300, 401) is worn by the user (510), and at least one camera (485, 240-1, 240-4, 340-1, 340-2) arranged to face the eyes of the user (510) when the electronic device (101, 200, 300, 401) is worn by the user (510). The method can include an operation of obtaining an authentication request of the user (510). The method may include an operation of identifying at least one area (611, 612, 613, 614, 615, 616, 623, 624) in an environment (501, 601, 602, 603, 604, 605, 607, 608, 609) visible to a user (510) through at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) based on obtaining the authentication request. The method may include an operation of identifying an operation of controlling the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the brightness of the at least one identified region (611, 612, 613, 614, 615, 616, 623, 624) is adjusted. The method may include an operation of identifying an operation of acquiring an iris image of the eye through the at least one camera (485, 240-1, 240-4, 340-1, 340-2) while the brightness of the at least one identified region (611, 612, 613, 614, 615, 616, 623, 624) is adjusted. The method may include an operation of identifying an operation for authenticating the user (510) based on the iris of the eye identified in the iris image.
[0303] The method may include, in response to obtaining the authentication request, an operation of identifying a size of the iris of the eye of the user (510). The method may include, in response to the size of the iris being greater than or equal to a specified size, an operation of acquiring another iris image of the eye of the user (510) through the at least one camera (485, 240-1, 240-4, 340-1, 340-2) while the brightness is not adjusted, and identifying an operation of authenticating the user (510) based on the iris identified in the other iris image. The method may include, in response to the size of the iris being less than a specified size, an operation of authenticating the user (510) based on the iris identified in the iris image acquired while the brightness is adjusted.
[0304] The method may include an operation of identifying, in response to a failure in authentication of the user (510) based on the iris identified in the other iris image, an operation of controlling the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the brightness of the at least one identified region (611, 612, 613, 614, 615, 616, 623, 624) is adjusted. The method may include an operation of identifying, based on the iris identified in the iris image acquired while the brightness is adjusted, an operation of authenticating the user (510).
[0305] The method may include an operation of identifying the gaze (521) of the user (510) in an image acquired through the camera (485, 240-1, 240-4, 340-1, 340-2). The method may include an operation of identifying at least one area (611) including a point toward which the gaze (521) of the user (510) is directed. The method may include an operation of identifying the gaze (521) of the user (510) in an image acquired through the camera (485, 240-1, 240-4, 340-1, 340-2). The method may include an action of identifying an action of displaying an image object through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) that guides the gaze (521) to move to the at least one area (612, 613, 614, 615, 616, 623, 624). The method may include an operation of identifying an operation of adjusting transparency of an area of the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) corresponding to the at least one identified area (611, 612, 613, 614, 623, 624) such that brightness of the at least one identified area (611, 612, 613, 614, 623, 624) is adjusted. The method may include an operation of identifying an operation of obtaining the authentication request while the environment (608, 609) is displayed on the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2).The method may include, in response to obtaining the authentication request, identifying at least some other area (611, 612, 613, 614, 615, 616, 623, 624) in the surrounding environment (501, 601, 602, 603, 604, 605, 607) obtained through at least one other camera (481) arranged to photograph the surrounding environment (501, 601, 602, 603, 604, 605, 607). The method may include an action of identifying, in response to the identification of at least some other area (611, 612, 613, 614, 615, 616, 623, 624), an action of controlling the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the surrounding environment (501, 601, 602, 603, 604, 605, 607) is visible to the user (510) instead of the environment (608, 609). The method may include an action of identifying an action of acquiring the iris image while the surrounding environment (501, 601, 602, 603, 604, 605, 607) is visible to the user (510). The method may include an operation of identifying an operation for authenticating the user (510) based on the iris identified in the iris image.
[0306] As described above, a non-transitory computer readable storage medium can store a program (140) including instructions. The above instructions, when executed by at least one processor (120) of the electronic device (101, 200, 300, 401), which includes at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) arranged to face the eyes of the user (510) when the electronic device (101, 200, 300, 401) is worn by the user (510), and at least one camera (485, 240-1, 240-4, 340-1, 340-2) arranged to face the eyes of the user (510) when the electronic device (101, 200, 300, 401) is worn by the user (510), cause the electronic device (101, 200, 300, 401) to: It may be configured to obtain an authentication request from a user (510). The processor (120) may be configured to identify at least one area (611, 612, 613, 614, 615, 616, 623, 624) in an environment (501, 601, 602, 603, 604, 605, 607, 608, 609) visible to the user (510) through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) based on obtaining the authentication request. The above instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101, 200, 300, 401) to control the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) such that the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) is adjusted.The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101, 200, 300, 401) to acquire an iris image of the eye through the at least one camera (485, 240-1, 240-4, 340-1, 340-2) while the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) is adjusted. The instructions, when executed by the at least one processor (120), may be configured to cause the electronic device (101, 200, 300, 401) to authenticate the user (510) based on the iris of the eye identified in the iris image.
[0307] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.
[0308] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0309] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0310] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0311] According to one embodiment, the method according to the various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0312] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In a wearable device (101, 200, 300, 401), When the wearable device (101, 200, 300, 401) is worn by a user (510), at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) arranged to face the eyes of the user (510) When the wearable device (101, 200, 300, 401) is worn by a user (510), at least one camera (485, 240-1, 240-4, 340-1, 340-2) arranged to face the eye, At least one processor (120) comprising a processing circuit, and A wearable device (101) comprises a memory (130) storing instructions and including one or more storage media, wherein the instructions, when individually or collectively executed by the at least one processor (120), Obtaining an authentication request from the above user (510), Based on obtaining the above authentication request, identifying at least one area (611, 612, 613, 614, 615, 616, 623, 624) in an environment (501, 601, 602, 603, 604, 605, 607, 608, 609) visible to a user (510) through at least one display (460, 250, 250-1, 250-2, 350-1, 350-2), Controlling at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) so that the brightness of at least one area (611, 612, 613, 614, 615, 616, 623, 624) identified above is adjusted, While the brightness of at least one of the identified areas (611, 612, 613, 614, 615, 616, 623, 624) is adjusted, an image of the iris of the eye is acquired through at least one camera (485, 240-1, 240-4, 340-1, 340-2), Causing to authenticate the user (510) based on the iris of the eye identified in the iris image; Wearable devices.
2. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: In response to obtaining the above authentication request, the size of the iris of the eye of the user (510) is identified, In response to the size of the iris being greater than or equal to a specified size, while the brightness is not adjusted, another iris image of the eye of the user (510) is acquired through the at least one camera (485, 240-1, 240-4, 340-1, 340-2), and based on the iris identified in the other iris image, the user (510) is authenticated. In response to the size of the iris being less than a specified size, causing the user (510) to be authenticated based on the iris identified in the iris image acquired while the brightness is adjusted. Wearable devices.
3. In claim 2, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: In response to a failure of authentication of the user (510) based on the iris identified in the other iris image, controlling the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) so that the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) is adjusted, Causing to authenticate the user (510) based on the iris identified in the iris image acquired while the brightness is adjusted. Wearable devices.
4. In claim 1, At least one of the above regions (611, 612, 613, 614, 615, 616, 623, 624) is adjacent to the region where the camera (485, 240-1, 240-4, 340-1, 340-2) is located. Wearable devices.
5. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: Identifying the gaze (521) of the user (510) from the image acquired through the above camera (485, 240-1, 240-4, 340-1, 340-2), Causing to identify at least one area (611) including a point toward which the gaze (521) of the user (510) is directed; Wearable devices.
6. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: Identifying the gaze (521) of the user (510) from the image acquired through the above camera (485, 240-1, 240-4, 340-1, 340-2), Causing the image object (621) to be displayed through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) to guide the above gaze (521) to move to the at least one area (612, 613, 614, 615, 616, 623, 624). Wearable devices.
7. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: causing the brightness of at least one of the identified areas (611, 612, 613, 614, 615, 616, 623, 624) to be adjusted, thereby causing the transparency of an area of at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) corresponding to the identified at least one area (611, 612, 613, 614, 615, 616, 623, 624) to be adjusted; Wearable devices.
8. In claim 7, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: Based on the fact that at least one of the above regions (611, 612, 613, 614, 615, 616, 623, 624) is not identified, at least some other regions (615, 616) are identified in the previous environment (606) previously shown to the user (510), Causing to display an image object (622) through at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) that guides the user (510) to move to the previous environment (501, 601, 602, 603, 604, 605, 607, 608, 609), based on the identification of at least some other area in the previous environment (501, 601, 602, 603, 604, 605, 607, 608, 609). Wearable devices.
9. In claim 1, further comprising at least one other camera (481) arranged to capture the surrounding environment (501, 601, 602, 603, 604, 605, 607); The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: While the environment (608, 609) is displayed on at least one display (460, 250, 250-1, 250-2, 350-1, 350-2), the authentication request is obtained, In response to obtaining the above authentication request, identifying at least some other area (611, 612, 613, 614, 615, 616, 623, 624) in the surrounding environment (501, 601, 602, 603, 604, 605, 607) obtained through the at least one other camera (481), In response to identifying at least some other area (611, 612, 613, 614, 615, 616, 623, 624) above, controlling at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) so that the surrounding environment (501, 601, 602, 603, 604, 605, 607) instead of the environment (608, 609) is shown to the user (510), Acquire the iris image while the above surrounding environment (501, 601, 602, 603, 604, 605, 607) is visible to the user (510), Causing to authenticate the user (510) based on the iris identified in the iris image; Wearable devices.
10. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: Identifying at least one first region (612, 613, 614) having a first brightness higher than or equal to a specified first brightness and at least one second region having a second brightness lower than or equal to a specified second brightness among a plurality of regions within the above environment (501, 601, 602, 603, 604, 605, 607, 608, 609), Based on the identification of at least one first region (612, 613, 614) and at least one second region, causing the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) to be controlled so that the brightness of the at least one first region (612, 613, 614) is decreased and the brightness of the at least one second region is increased. Wearable devices.
11. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: Identifying at least one area (611, 612, 613, 614, 615, 616, 623, 624) whose brightness can be adjusted among a plurality of areas within the above environment (501, 601, 602, 603, 604, 605, 607, 608, 609), Based on the identification of at least one area (611, 612, 613, 614, 615, 616, 623, 624), causing the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) to be controlled so as to increase the brightness of the at least one area (611, 612, 613, 614, 615, 616, 623, 624). Wearable devices.
12. In claim 11, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: Identifying the gaze (521) of the user (510) from the image acquired through the above camera (485, 240-1, 240-4, 340-1, 340-2), Identifying at least one area (611, 612, 613, 614, 623, 624) within a specified distance from the line of sight (521) among one or more areas in the above environment (501, 601, 602, 603, 604, 605, 607) in which brightness can be adjusted, Based on the identification of at least one area (611, 612, 613, 614, 623, 624), causing the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) to be controlled so as to increase the brightness of the at least one area (611, 612, 613, 614, 623, 624). Wearable devices.
13. In claim 1, The at least one area (611, 612, 613, 614, 615, 616, 623, 624) is visible to the user (510) by light from the at least one area (611, 612, 613, 614, 615, 616, 623, 624) passing through the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2), The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device (101) to: By displaying an image object corresponding to at least one area (611, 612, 613, 614, 615, 616, 623, 624) visible to the user (510) on the at least one display (460, 250, 250-1, 250-2, 350-1, 350-2), causing the brightness of the identified at least one area (611, 612, 613, 614, 615, 616, 623, 624) to be adjusted, Wearable devices.
14. A method performed in a wearable device (101, 200, 300, 401), comprising at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) arranged to face the eyes of a user (510) when the wearable device (101, 200, 300, 401) is worn by the user (510), and at least one camera (485, 240-1, 240-4, 340-1, 340-2) arranged to face the eyes of the user (510) when the wearable device (101, 200, 300, 401) is worn by the user (510), An action for obtaining an authentication request from the above user (510); Based on obtaining the above authentication request, an operation of identifying at least one area (611, 612, 613, 614, 615, 616, 623, 624) in an environment (501, 601, 602, 603, 604, 605, 607, 608, 609) visible to a user (510) through at least one display (460, 250, 250-1, 250-2, 350-1, 350-2), An operation of controlling at least one display (460, 250, 250-1, 250-2, 350-1, 350-2) so as to adjust the brightness of at least one area (611, 612, 613, 614, 615, 616, 623, 624) identified above, An operation of acquiring an iris image of the eye through the at least one camera (485, 240-1, 240-4, 340-1, 340-2) while the brightness of the at least one identified area (611, 612, 613, 614, 615, 616, 623, 624) is adjusted, and An operation for authenticating the user (510) based on the iris of the eye identified in the iris image. method.
15. In claim 14, In response to obtaining the above authentication request, an operation of identifying the size of the iris of the eye of the user (510); In response to the size of the iris being greater than or equal to a specified size, while the brightness is not adjusted, an operation of acquiring another iris image of the eye of the user (510) through the at least one camera (485, 240-1, 240-4, 340-1, 340-2), and authenticating the user (510) based on the iris identified in the other iris image; and In response to the size of the iris being less than a specified size, an operation of authenticating the user (510) based on the iris identified in the iris image acquired while the brightness is adjusted. method.
Citation Information
Patent Citations
Electronic apparatus and information processing method and program
JP2018124733A
Apparatus and method for iris recognition using display information
KR1020160091114A
Head Mounted Electronic Device
KR1020170042877A
Support bracket for fire extinguisher
KR1020240015273A
A head mounted display apparatus with automatic screen illumination intensity adjustment according to the user
KR102260393B1