Electronic device, method, and non-transitory computer-readable recording medium for authenticating user through wearable device

Abstract

An electronic device is disclosed. The electronic device may receive an input requesting user authentication based on an image to be acquired through a camera. The electronic device may acquire an image through the camera in response to the input. On the basis that another object that corresponds to a wearable device and covers an object corresponding to a user's face is included in the image acquired through the camera, the electronic device may request, through a communication circuit, another user authentication for the user from the wearable device. The electronic device may receive, through the communication circuit, a result of the other user authentication for the user from the wearable device. The electronic device may determine whether to authenticate the user on the basis of the result of the other user authentication.

Description

Electronic device, method, and non-transitory computer-readable recording medium for authenticating a user through a wearable device

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable recording media for authenticating a user via a wearable device.

[0002] To provide an enhanced user experience, electronic devices are being developed that provide augmented reality (AR) services that display computer-generated information in conjunction with external objects in the real world. The electronic devices may be wearable devices that can be worn by a user. For example, the electronic devices may be AR glasses and / or head-mounted devices (HMDs). The display of the electronic devices may display the screen of an external electronic device.

[0003] An electronic device is disclosed. The electronic device may include a camera, communication circuitry for wireless connection with a wearable device, at least one processor including a processing circuit; and a memory storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive an input requesting user authentication based on an image acquired through the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device, in response to the input, to acquire an image through the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to request another user authentication of the user from the wearable device through the communication circuitry based on the inclusion of another object corresponding to the wearable device that obscures an object corresponding to the user's face in the image acquired through the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive, through the communication circuit, a result of the other user authentication for the user from the wearable device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine whether to authenticate the user based on the result of the other user authentication.

[0004] An electronic device is disclosed. The electronic device may include a camera, a communication circuit, a memory storing instructions, and at least one processor. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to detect an event related to user authentication via the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, in relation to the event, whether a wearable device is worn on the user's face. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to transmit, via the communication circuit, a request to the wearable device to authenticate the user based on determining that the wearable device is worn on the user's face. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide specified content based on information received from the wearable device indicating that the user has been authenticated.

[0005] A method is disclosed. The method may be performed by an electronic device including a camera and communication circuitry for wireless connection with a wearable device. The method may include receiving an input requesting user authentication based on an image acquired through the camera. The method may include acquiring an image through the camera in response to the input. The method may include requesting another user authentication for the user from the wearable device through the communication circuitry based on the inclusion of another object corresponding to the wearable device that obscures an object corresponding to the user's face in the image acquired through the camera. The method may include receiving a result of the other user authentication for the user from the wearable device through the communication circuitry. The method may include determining whether to authenticate the user based on the result of the other user authentication.

[0006] A method is disclosed. The method may be performed by an electronic device including a camera and communication circuitry. The method may include an operation of detecting an event related to user authentication via the electronic device. The method may include an operation of determining, in relation to the event, whether a wearable device is worn on the user's face. The method may include an operation of transmitting a request to the wearable device to authenticate the user via the communication circuitry based on a determination that the wearable device is worn on the user's face. The method may include an operation of providing designated content based on information received from the wearable device indicating that the user has been authenticated.

[0007] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a camera and communication circuitry for wireless connection with a wearable device, may cause the electronic device to receive an input requesting user authentication based on an image acquired through the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device, in response to the input, to acquire an image through the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to request another user authentication of the user from the wearable device through the communication circuitry based on the inclusion of another object corresponding to the wearable device that obscures an object corresponding to the user's face in the image acquired through the camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive, through the communication circuit, a result of the other user authentication for the user from the wearable device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine whether to authenticate the user based on the result of the other user authentication.

[0008] A non-transitory computer-readable recording medium is disclosed. The non-transitory computer-readable recording medium can store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a camera and communication circuitry, can cause the electronic device to detect an event associated with user authentication via the electronic device. The instructions, when individually or collectively executed by the at least one processor, can cause the electronic device to determine, in relation to the event, whether a wearable device is worn on the user's face. The instructions, when individually or collectively executed by the at least one processor, can cause the electronic device to transmit, via the communication circuitry, a request to authenticate the user to the wearable device based on determining that the wearable device is worn on the user's face. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide specified content based on information received from the wearable device indicating that the user has been authenticated.

[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0010] FIG. 2A illustrates an example of a perspective view of a wearable device, according to one embodiment.

[0011] FIG. 2b illustrates an example of one or more hardware elements disposed within a wearable device, according to one embodiment.

[0012] FIG. 3A illustrates an example of an appearance of a wearable device according to one embodiment.

[0013] FIG. 3b illustrates an example of an appearance of a wearable device according to one embodiment.

[0014] FIG. 4 illustrates an example block diagram of an electronic device according to one embodiment.

[0015] FIG. 5a is a diagram illustrating a situation in which a user performs user authentication through an electronic device while wearing a wearable device.

[0016] FIG. 5b is a diagram illustrating a user wearing a wearable device within an image acquired for user authentication.

[0017] FIG. 5c is a diagram illustrating an example of an electronic device displaying a UI indicating that user authentication has failed, according to one embodiment.

[0018] FIG. 5D is a diagram illustrating a situation in which a wearable device displays a screen including an electronic device through VST (video see through), according to one embodiment.

[0019] FIG. 6 is a flowchart illustrating an operation of an electronic device performing user authentication according to one embodiment.

[0020] FIG. 7 is a flowchart illustrating an operation of an electronic device performing user authentication according to one embodiment.

[0021] FIG. 8A is a flowchart illustrating an operation of an electronic device performing user authentication according to one embodiment.

[0022] FIG. 8b is a diagram illustrating an example of an electronic device displaying user information according to one embodiment.

[0023] FIG. 8c is a diagram illustrating an example of a wearable device displaying user information according to one embodiment.

[0024] FIG. 9A is a flowchart illustrating an operation of an electronic device performing user authentication according to one embodiment.

[0025] FIG. 9b is a diagram illustrating a situation in which an electronic device and a wearable device face each other, according to one embodiment.

[0026] FIG. 9c is a diagram illustrating a situation in which an electronic device and a wearable device do not face each other, according to one embodiment.

[0027] FIG. 10A is a flowchart illustrating an operation of an electronic device performing user authentication according to one embodiment.

[0028] FIG. 10b is a diagram illustrating a situation in which a wearable device identifies that a user's gaze is directed toward an electronic device, according to one embodiment.

[0029] FIG. 10c is a diagram illustrating a situation in which a wearable device identifies that a user's gaze is not directed toward the electronic device, according to one embodiment.

[0030] FIG. 10d is a diagram illustrating a situation in which a wearable device displays a UI that guides the location of an electronic device, according to one embodiment.

[0031] FIG. 11 is a flowchart illustrating an operation of an electronic device providing content based on a user authentication result according to one embodiment.

[0032] FIG. 12A is a diagram illustrating an example of a screen displayed by an electronic device based on user authentication, according to one embodiment.

[0033] FIG. 12B is a diagram illustrating an example of a screen that an electronic device provides to a wearable device based on user authentication, according to one embodiment.

[0034] FIG. 13 is a diagram illustrating an example of a screen displayed by an electronic device based on user authentication, according to one embodiment.

[0035] FIG. 14A is a diagram illustrating an example of a screen that guides performing user authentication through a wearable device displayed by an electronic device according to one embodiment.

[0036] FIG. 14b is a diagram illustrating an example of a screen that guides an attempt to unlock an electronic device through a wearable device displayed by the wearable device according to one embodiment.

[0037] FIG. 14c is a diagram illustrating an example of a screen that queries whether to attempt to unlock an electronic device through a wearable device displayed by a wearable device, according to one embodiment.

[0038] FIG. 15a is a diagram illustrating a situation in which a user performs user authentication through an electronic device while wearing a wearable device.

[0039] FIG. 15b is a diagram illustrating a user wearing a wearable device within an image acquired for user authentication.

[0040] FIG. 15c is a diagram illustrating an example of an electronic device displaying a UI indicating that user authentication has failed, according to one embodiment.

[0041] FIG. 15d is a diagram illustrating a situation in which a wearable device displays a screen including an electronic device through VST according to one embodiment.

[0042] FIG. 15e is a diagram illustrating an example of a screen displayed by an electronic device based on user authentication, according to one embodiment.

[0043] FIG. 15F is a diagram illustrating an example of a screen that an electronic device provides to a wearable device based on user authentication, according to one embodiment.

[0044] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0045] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0046] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134).

[0047] According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0048] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0049] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0050] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0051] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0052] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0053] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0054] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0055] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0056] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0057] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0058] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0059] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0060] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0061] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0062] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0063] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, a loss coverage (e.g., 664 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for realizing URLLC.

[0064] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0065] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0066] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0067] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0068] FIG. 2A illustrates an example of a perspective view of a wearable device (200), according to one embodiment. FIG. 2B illustrates an example of one or more hardware elements disposed within a wearable device (200), according to one embodiment. The wearable device (200) of FIGS. 2A and 2B may correspond to the electronic device (101) of FIG. 1. As shown in FIG. 2A, the wearable device (200), according to one embodiment, may include at least one display (250) and a frame supporting the at least one display (250).

[0069] According to one embodiment, the wearable device (200) can be worn on a part of a user's body. The wearable device (200) can provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the wearable device (200). For example, the wearable device (200) can output a virtual reality image to the user through at least one display (250) in response to a designated gesture of the user acquired through the motion recognition camera (240-2) of FIG. 2B.

[0070] According to one embodiment, at least one display (250) within a wearable device (200) may provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.

[0071] Referring to FIG. 2B, at least one display (250) may form a display area on a lens to provide a user wearing the wearable device (200) with visual information contained in external light passing through the lens, along with other visual information distinct from the visual information. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. The display area formed by at least one display (250) may be formed on the second surface (232) among the first surface (231) and the second surface (232) of the lens. When the user wears the wearable device (200), external light may be incident on the first surface (231) and transmitted through the second surface (232) to be transmitted to the user. As another example, at least one display (250) may display a virtual reality image to be combined with a real screen transmitted through the external light. The virtual reality image output from at least one display (250) can be transmitted to the user's eyes through one or more hardware (e.g., optical devices (282, 284), and / or at least one waveguide (233, 234)) included in the wearable device (200).

[0072] According to one embodiment, a wearable device (200) may include waveguides (233, 234) that diffract light transmitted from at least one display (250) and relayed by optical devices (282, 284) and transmit the diffracted light to a user. The waveguides (233, 234) may be formed based on at least one of glass, plastic, or polymer. Nanopatterns may be formed on at least a portion of the exterior or interior of the waveguides (233, 234). The nanopatterns may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the waveguides (233, 234) may be propagated to the other end of the waveguides (233, 234) by the nanopatterns. The waveguides (233, 234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, the waveguides (233, 234) may be arranged within the wearable device (200) to guide a screen displayed by at least one display (250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) ​​occurring within the waveguides (233, 234).

[0073] According to one embodiment, the wearable device (200) may analyze an object included in a real image collected through a capturing camera (240-1), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (250). The virtual object may include at least one of text and an image regarding various information related to the object included in the real image. The wearable device (200) may analyze the object based on a multi-camera, such as a stereo camera. For the object analysis, the wearable device (200) may execute time-of-flight (ToF) and / or simultaneous localization and mapping (SLAM) supported by the multi-camera. A user wearing the wearable device (200) may view an image displayed on at least one display (250).

[0074] According to one embodiment, the frame may be formed as a physical structure that allows the wearable device (200) to be worn on the user's body. According to one embodiment, the frame may be configured so that, when the user wears the wearable device (200), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame may support at least one display (250). For example, the frame may support the first display (250-1) and the second display (250-2) to be positioned corresponding to the user's left and right eyes.

[0075] Referring to FIG. 2A, the frame may include a region (220) that at least partially contacts a part of the user's body when the user wears the wearable device (200). For example, the region (220) of the frame that contacts a part of the user's body may include a region that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the wearable device (200) makes contact with. According to one embodiment, the frame may include a nose pad (210) that contacts a part of the user's body. When the wearable device (200) is worn by the user, the nose pad (210) may contact a part of the user's nose. The frame may include a first temple (204) and a second temple (205) that contact a part of the user's body that is distinct from the part of the user's body.

[0076] For example, the frame may include a first rim (201) that surrounds at least a portion of the first display (250-1), a second rim (202) that surrounds at least a portion of the second display (250-2), a bridge (203) that is disposed between the first rim (201) and the second rim (202), a first pad (211) that is disposed along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) that is disposed along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) that extends from the first rim (201) and is fixed to a portion of an ear of the wearer, and a second temple (205) that extends from the second rim (202) and is fixed to a portion of an ear opposite the ear. The first pad (211) and the second pad (212) may be in contact with a portion of the user's nose, and the first temple (204) and the second temple (205) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through the first hinge unit (206) disposed between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through the second hinge unit (207) disposed between the second rim (202) and the second temple (205). According to one embodiment, the wearable device (200) can identify an external object (e.g., a user's fingertip) touching the frame and / or a gesture performed by the external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame.

[0077] According to one embodiment, the wearable device (200) may include hardwares that perform various functions (e.g., hardwares described above based on the block diagram of FIG. 1). For example, the hardwares may include a battery module (270), an antenna module (275), optical devices (282, 284), speakers (292-1, 292-2), microphones (294-1, 294-2, 294-3), a light-emitting module (not shown), and / or a printed circuit board (290). The various hardwares may be arranged within a frame.

[0078] According to one embodiment, the microphones (294-1, 294-2, 294-3) of the wearable device (200) may be arranged on at least a portion of the frame to acquire a sound signal. A first microphone (294-1) arranged on the nose pad (210), a second microphone (294-2) arranged on the second rim (202), and a third microphone (294-3) arranged on the first rim (201) are illustrated in FIG. 2B, but the number and arrangement of the microphones (294) are not limited to the embodiment of FIG. 2B. When the number of microphones (294) included in the wearable device (200) is two or more, the wearable device (200) may identify the direction of the sound signal by using a plurality of microphones arranged on different portions of the frame.

[0079] According to one embodiment, the optical devices (282, 284) can transmit a virtual object transmitted from at least one display (250) to the wave guides (233, 234). For example, the optical devices (282, 284) can be projectors. For example, the optical devices (282, 284) (or projector) can provide augmented reality (AR) to a user by projecting an image (e.g., a two-dimensional image or a three-dimensional image) onto lenses (or eyeglass lenses). Here, the three-dimensional image can be an image having binocular parallax displayed on the lenses.

[0080] The optical devices (282, 284) may be disposed adjacent to at least one display (250) or may be included within at least one display (250) as a part of at least one display (250). The first optical device (282) may correspond to the first display (250-1), and the second optical device (284) may correspond to the second display (250-2). The first optical device (282) may transmit light output from the first display (250-1) to the first waveguide (233), and the second optical device (284) may transmit light output from the second display (250-2) to the second waveguide (234).

[0081] In one embodiment, the camera (240) may include an eye tracking camera (ET CAM) (240-1), a motion recognition camera (240-2), and / or a recording camera (240-3). The recording camera, the eye tracking camera (240-1), and the motion recognition camera (240-2) may be positioned at different locations on the frame and may perform different functions. The eye tracking camera (240-1) may output data representing the gaze of a user wearing the wearable device (200). For example, the wearable device (200) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (240-1). An example in which the gaze tracking camera (240-1) is positioned toward the user's right eye is illustrated in FIG. 2B, but the embodiment is not limited thereto, and the gaze tracking camera (240-1) may be positioned solely toward the user's left eye, or may be positioned toward both eyes.

[0082] In one embodiment, the capturing camera (240-3) can capture an actual image or background to be aligned with a virtual image to implement augmented reality or mixed reality content. The capturing camera can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (250). The at least one display (250) can display a single image in which information about the actual image or background including the image of the specific object acquired using the capturing camera is superimposed on a virtual image provided through optical devices (282, 284). In one embodiment, the capturing camera can be placed on a bridge (203) disposed between the first rim (201) and the second rim (202).

[0083] In one embodiment, the gaze tracking camera (240-1) can implement more realistic augmented reality by tracking the gaze of a user wearing the wearable device (200) and thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the wearable device (200) looks straight ahead, the wearable device (200) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (250). The gaze tracking camera (240-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (240-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (240-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (240-1) may be positioned within the first rim (201) and / or the second rim (202) to face the direction in which the user wearing the wearable device (200) is positioned.

[0084] In one embodiment, the gesture recognition camera (240-2) can provide a specific event on a screen provided on at least one display (250) by recognizing the movement of the user's entire body or a part of the user's body, such as the user's torso, hands, or face. The gesture recognition camera (240-2) can recognize the user's gesture, obtain a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (250). The processor can identify the signal corresponding to the gesture and perform a designated function based on the identification. In one embodiment, the gesture recognition camera (240-2) can be disposed on the first rim (201) and / or the second rim (202).

[0085] In one embodiment, the camera (240) included in the wearable device (200) is not limited to the gaze tracking camera (240-1) and the motion recognition camera (240-2) described above. For example, the wearable device (200) can identify an external object included in the FOV (field of view) of the user using the photographing camera (240-3) positioned toward the FOV. The wearable device (200) can identify an external object based on a sensor for identifying the distance between the wearable device (200) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (240) positioned toward the FOV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (200) may include a camera (240) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (200).

[0086] Although not shown, in one embodiment, the wearable device (200) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FOV) being photographed using the camera (240). The light source may include an infrared wavelength LED. The light source may be disposed on at least one of the frame and hinge units (206, 207).

[0087] According to one embodiment, the battery module (270) may supply power to electronic components of the wearable device (200). In one embodiment, the battery module (270) may be disposed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may be disposed within each of the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be disposed at an end of the first temple (204) and / or the second temple (205).

[0088] According to one embodiment, the antenna module (275) can transmit signals or power to the outside of the wearable device (200), or receive signals or power from the outside. The antenna module (275) can be electrically and / or operatively connected to the communication module (190) of FIG. 1. In one embodiment, the antenna module (275) can be positioned within the first temple (204) and / or the second temple (205). For example, the antenna module (275) can be positioned close to one surface of the first temple (204) and / or the second temple (205).

[0089] According to one embodiment, the speakers (292-1, 292-2) may output audio signals to the outside of the wearable device (200). The audio output module may be referred to as a speaker. In one embodiment, the speakers (292-1, 292-2) may be positioned within the first temple (204) and / or the second temple (205) so as to be positioned adjacent to the ears of a user wearing the wearable device (200). For example, the wearable device (200) may include a second speaker (292-2) positioned within the first temple (204) and thus adjacent to the user's left ear, and a first speaker (292-1) positioned within the second temple (205) and thus adjacent to the user's right ear.

[0090] In one embodiment, the light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state to visually provide information regarding a specific state of the wearable device (200) to the user. For example, when the wearable device (200) requires charging, the wearable device (200) may repeatedly emit red light at a designated time. In one embodiment, the light-emitting module may be disposed on the first rim (201) and / or the second rim (202).

[0091] Referring to FIG. 2B, according to one embodiment, a wearable device (200) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of the first temple (204) and the second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. One or more hardware components included in the wearable device (200) may be disposed on the PCB (290). The wearable device (200) may include a flexible PCB (FPCB) for interconnecting the hardware components.

[0092] According to one embodiment, a wearable device (200) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (200) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (200). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., the x-axis, the y-axis, and the z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., the x-axis, the y-axis, and the z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (200) may identify a user's motion and / or gesture performed to execute or terminate a specific function of the wearable device (200) based on the IMU.

[0093] In some embodiments, the wearable device (200) may not include displays (250-1, 250-2) (or optical devices (282, 284), and / or wave guides (233, 234)). For example, the glass lenses surrounding each of the rims (201, 202) may not include displays (250-1, 250-2) (or optical devices (282, 284), and / or wave guides (233, 234)). Since there are no displays (250-1, 250-2) (or optical devices (282, 284), and / or wave guides (233, 234)) in the glasses, a user wearing the wearable device (200) can view actual reality as distinct from augmented reality or mixed reality through the light passing through the glasses. For example, even if the wearable device (200) does not have displays (250-1, 250-2) (or optical devices (282, 284), and / or waveguides (233, 234)), the wearable device (200) may include other components (e.g., a camera (240), a battery module (270), an antenna module (275), speakers (292-1, 292-2), microphones (294-3), a light-emitting module (not shown), a sensor (not shown), and / or a printed circuit board (290)).

[0094] FIGS. 3A and 3B illustrate an example of an exterior appearance of a wearable device (300) according to one embodiment. The wearable device (300) of FIGS. 3A and 3B may be included in the electronic device (101) of FIG. 1. An example of an exterior appearance of a first side (310) of a housing of the wearable device (300) according to one embodiment is illustrated in FIG. 3A, and an example of an exterior appearance of a second side (320) opposite to the first side (310) may be illustrated in FIG. 3B.

[0095] Referring to FIG. 3A, according to one embodiment, a first surface (310) of a wearable device (300) may have a form attachable to a body part of a user (e.g., the face of the user). Although not shown, the wearable device (300) may further include a strap for fixing to a body part of a user, and / or one or more temples (e.g., the first temple (204) and / or the second temple (205) of FIGS. 2A and 2B). A first display (350-1) for outputting an image to a left eye among the user's two eyes, and a second display (350-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (310). The wearable device (300) is formed on the first surface (310) and may further include a rubber or silicone packing to prevent interference by light (e.g., ambient light) different from the light emitted from the first display (350-1) and the second display (350-2).

[0096] According to one embodiment, the wearable device (300) may include cameras (340-1, 340-2) for photographing and / or tracking the user's two eyes adjacent to the first display (350-1) and the second display (350-2), respectively. The cameras (340-1, 340-2) may be referred to as ET cameras. According to one embodiment, the wearable device (300) may include cameras (340-3, 340-4) for photographing and / or recognizing the user's face. The cameras (340-3, 340-4) may be referred to as FT cameras.

[0097] Referring to FIG. 3B, a camera (e.g., cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10)) and / or a sensor (e.g., depth sensor (330)) for obtaining information related to the external environment of the wearable device (300) may be disposed on a second surface (320) opposite to the first surface (310) of FIG. 3A. For example, the cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) may be disposed on the second surface (320) to recognize an external object different from the wearable device (300). For example, using cameras (340-9, 340-10), the wearable device (300) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (340-9) can be placed on the second face (320) of the wearable device (300) to obtain an image to be displayed through the second display (350-2) corresponding to the right eye among the two eyes. The camera (340-10) can be placed on the second face (320) of the wearable device (300) to obtain an image to be displayed through the first display (350-1) corresponding to the left eye among the two eyes.

[0098] According to one embodiment, the wearable device (300) may include a depth sensor (330) disposed on the second surface (320) to identify a distance between the wearable device (300) and an external object. Using the depth sensor (330), the wearable device (300) may obtain spatial information (e.g., a depth map) for at least a portion of the FOV of a user wearing the wearable device (300).

[0099] Although not shown, a microphone may be placed on the second side (320) of the wearable device (300) to acquire sound output from an external object. The number of microphones may be one or more depending on the embodiment.

[0100] As described above, according to one embodiment, the wearable device (300) may have a form factor for being worn on a user's head. The wearable device (300), while worn on the head, may provide a user experience based on augmented reality, virtual reality, and / or mixed reality. Using cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) for recording video of an external space, the wearable device (300) and a server connected to the wearable device (300) (e.g., server (110) of FIG. 1) may provide an on-demand service that provides video of a location and / or place selected by the user, and / or a metaverse service.

[0101] According to one embodiment, the wearable device (300) can display frames acquired through cameras (340-9, 340-10) on the first display (350-1) and the second display (350-2), respectively. The wearable device (300) can provide a user with a mixed user experience of real objects and virtual objects (e.g., video see-through (VST)) by combining virtual objects within frames displayed through the first display (350-1) and the second display (350-2) and including real objects. The wearable device (300) can change the virtual objects based on information acquired by the cameras (340-1, 340-2, 340-3, 340-4, 340-5, 340-6, 340-7, 340-8) and / or the depth sensor (330). For example, if a visual object corresponding to a real object and a virtual object at least partially overlap within the frame, the wearable device (300) may stop displaying the virtual object based on detecting a motion for interacting with the real object. By stopping displaying the virtual object, the wearable device (300) may prevent the visibility of the real object from being reduced as the visual object corresponding to the real object is occluded by the virtual object.

[0102] FIG. 4 illustrates an example block diagram of an electronic device according to one embodiment.

[0103] The electronic device (101) of FIG. 4 may correspond to the electronic device (101) of FIG. 1. The wearable device (401) of FIG. 4 may correspond to the electronic device (102) of FIG. 1. The wearable device (401) of FIG. 4 may correspond to the wearable device (200) of FIGS. 2A and 2B. The wearable device (401) of FIG. 4 may correspond to the wearable device (300) of FIGS. 3A and 3B.

[0104] Referring to FIG. 4, the electronic device (101) may include at least one of a processor (420), a memory (430), a display (460), a camera (480), a sensor (470), or a communication circuit (490). The processor (420) of FIG. 4 may correspond to the processor (120) of FIG. 1. The memory (430) of FIG. 4 may correspond to the memory (130) of FIG. 1. The display (460) of FIG. 4 may correspond to the display module (160) of FIG. 1. The camera (480) of FIG. 4 may correspond to the camera module (180) of FIG. 1. The sensor (470) of FIG. 4 may correspond to the sensor module (176) of FIG. 1. The communication circuit (490) of FIG. 4 may correspond to the communication module (190) of FIG. 1.

[0105] In one embodiment, the processor (420) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), and / or a central processing unit (CPU). The number of processors (420) may be one or more. For example, the processor (420) may have a multi-core processor structure, such as a dual core, a quad core, or a hexa core.

[0106] In one embodiment, the memory (430) may include a hardware component for storing data and / or instructions input and / or output to the processor (420). The memory (430) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, and embedded multi media card (eMMC).

[0107] In one embodiment, the memory (430) may include a user information database (DB) (441). In one embodiment, the user information DB (441) may include information about a user account. In one embodiment, the user information DB (441) may include information about a user account logged into the electronic device (101). In one embodiment, the number of user accounts stored in the user information DB (441) may be one or more (or multiple). In one embodiment, the information about the user account may be information received through a server (e.g., 108 of FIG. 1). In one embodiment, the information about the user account may include information about one or more electronic devices owned by the user (or logged into with the same user account). In one embodiment, the information about the user account may include information for user authentication (e.g., biometric information (e.g., face, iris, vein), password, and / or gesture).

[0108] In one embodiment, the display (460) can output visualized information to a user of the electronic device (101). For example, the display (460) can be controlled by a processor (420) including a circuit such as a graphic processing unit (GPU) to output visualized information to the user. The display (460) can include a flat panel display (FPD) and / or electronic paper. The FPD can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs).

[0109] In one embodiment, the camera (480) of the electronic device (101) may include one or more light sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light (e.g., ultraviolet, infrared, and / or visible light). In one embodiment, the camera (480) may be implemented with sensors, structures, and / or functions for measuring the distance between the electronic device (101) and an external object, such as a depth sensor and / or a time of flight (ToF) sensor.

[0110] A plurality of optical sensors included in the camera (480) may be arranged in the form of a two-dimensional grid. The camera (480) may acquire electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate two-dimensional frame data corresponding to light reaching the optical sensors of the two-dimensional grid. For example, photographic data captured using the camera (480) may mean one two-dimensional frame data acquired from the camera (480). For example, video data captured using the camera (480) may mean a sequence of a plurality of two-dimensional frame data acquired from the camera (480) according to a frame rate. The camera (480) may further include a flash light that is arranged to face a direction in which the camera (480) receives light and outputs light toward the direction.

[0111] In one embodiment, the camera (480) may include a plurality of cameras positioned in different directions. At least one of the plurality of cameras may be positioned on the same side as the display (460). At least one other camera of the plurality of cameras may be positioned on a different side from the display (460).

[0112] In one embodiment, the sensor (470) may generate electrical information that may be processed by the processor (420) and / or the memory (430) of the electronic device (101) from non-electronic information related to the electronic device (101). The information may be referred to as sensor data. The sensor (470) may include a global positioning system (GPS) sensor, an image sensor, an ambient light sensor, and / or a time-of-flight (ToF) sensor for detecting a geographic location of the electronic device (101), and an inertial measurement unit (IMU) for detecting a physical motion of the electronic device (101).

[0113] In one embodiment, the communication circuit (490) may include hardware components for supporting transmission and / or reception of electrical signals between the electronic device (101) and the external electronic device (102). The communication circuit (490) may include, for example, at least one of a modem (MODEM), an antenna, and an optical / electronic (O / E) converter. The communication circuit (490) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G NR (new radio), and / or 6G.

[0114] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (420) of the electronic device (101) may be stored within the memory (430) of the electronic device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the electronic device (101) and / or the processor (420) may perform at least one of the operations of FIG. 6, FIG. 7, FIG. 8A, FIG. 9A, FIG. 10A, or FIG. 11 when a set of multiple instructions distributed in the form of an operating system, firmware, driver, and / or application is executed. Hereinafter, the fact that an application is installed in an electronic device (101) may mean that one or more instructions provided in the form of an application are stored in a memory (430), and that the one or more applications are stored in a format executable by the processor (420) (e.g., a file having an extension specified by the operating system of the electronic device (101). As an example, an application may include a program and / or a library related to a service provided to a user.

[0115] Referring to FIG. 4, the wearable device (401) may include at least one of a processor (425), a memory (435), displays (465, 469), cameras (485, 489), a sensor (475), or a communication circuit (495).

[0116] The processor (425) of FIG. 4 may correspond to the processor (120) of FIG. 1. The memory (435) of FIG. 4 may correspond to the memory (130) of FIG. 1. The displays (465, 469) of FIG. 4 may correspond to the display module (160) of FIG. 1. The display (465) of FIG. 4 may correspond to the display (250) of FIGS. 2A and 2B, or the display (350) of FIGS. 3A and 3B. The display (469) of FIG. 4 may be placed on the front of the wearable device (401) (or, the side that does not face the user when the wearable device (401) is worn by the user).

[0117] The cameras (485, 489) of FIG. 4 may correspond to the camera module (180) of FIG. 1. The camera (485) of FIG. 4 may be positioned to capture the rear of the wearable device (401) (or the side facing the user when the wearable device (401) is worn by the user). The camera (485) of FIG. 4 may correspond to the cameras (240-1, 240-2) of FIGS. 2A and 2B, or the cameras (340-1, 340-2, 340-3, 340-4) of FIGS. 3A and 3B.

[0118] The camera (489) of FIG. 4 may be positioned to capture the front of the wearable device (401) (or, the side of the wearable device (401) that does not face the user when the wearable device (401) is worn by the user). The camera (489) of FIG. 4 may correspond to the camera (240-3) of FIGS. 2A and 2B, or the cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) of FIGS. 3A and 3B.

[0119] The sensor (475) of Fig. 4 may correspond to the sensor module (176) of Fig. 1. The communication circuit (495) of Fig. 4 may correspond to the communication module (190) of Fig. 1.

[0120] In one embodiment, the memory (435) may include a user information DB (445). In one embodiment, the user information DB (445) may include information about a user account. In one embodiment, the user information DB (445) may include information about a user account logged into the wearable device (401). In one embodiment, the number of user accounts stored in the user information DB (445) may be one or more (or multiple). In one embodiment, the information about the user account may be information received via the server (108). In one embodiment, the information about the user account may include information about one or more electronic devices owned by the user (or logged into with the same user account). In one embodiment, the information about the user account may include information for user authentication (e.g., biometric information (e.g., face, iris, vein), password, and / or gesture).

[0121] FIG. 5A is a diagram illustrating a situation in which a user performs user authentication through an electronic device while wearing a wearable device. FIG. 5B is a diagram illustrating a user wearing a wearable device in an image acquired for user authentication. FIG. 5C is a diagram illustrating an example in which an electronic device displays a UI indicating that user authentication has failed, according to an embodiment. FIG. 5D is a diagram illustrating a situation in which a wearable device displays a screen including an electronic device through a video see-through (VST), according to an embodiment.

[0122] Figures 5a to 5d can be explained with reference to Figures 1 to 4.

[0123] Referring to FIG. 5A, a wearable device (401) can be worn by a user (501). In one embodiment, the wearable device (401) can identify that the wearable device (401) is worn by the user (501) based on a change in a sensing value obtained using a sensor (e.g., a proximity sensor, a biometric sensor, an inertial sensor, a temperature sensor, and / or an electrode sensor) when the user (501) wears the wearable device (401). In one embodiment, the wearable device (401) can identify that the wearable device (401) is worn by the user (501) based on a change in a resistance value and / or a current value identified through electrodes arranged to contact the skin of the user (501) when the user (501) wears the wearable device (401). In one embodiment, the wearable device (401) can identify that the wearable device (401) is worn by the user (501) based on a change in a distance value identified by a proximity sensor arranged to measure a distance between the face of the user (501) and the wearable device (401) when the user (501) wears the wearable device (401). In one embodiment, the wearable device (401) can identify that the wearable device (401) is taken off from the user (501) based on information acquired using at least one sensor (475) (e.g., a proximity sensor, a biometric sensor, an inertial sensor, a temperature sensor, and / or an electrode sensor). In one embodiment, the wearable device (401) can identify whether the wearable device (401) is worn or not worn by the user (501) based on information obtained using at least one sensor (475).

[0124] In one embodiment, the electronic device (101) may receive a user input requesting user authentication through the electronic device (101) while the user (501) wears the wearable device (401). For example, the electronic device (101) may receive a user input for unlocking while displaying a lock screen (510) indicating a locked state. However, the present invention is not limited thereto. For example, the electronic device (101) may receive a user input for unlocking while the electronic device (101) is turned off. For example, the electronic device (101) may receive a user input requesting payment while displaying a user interface (UI) for payment. For example, the electronic device (101) may receive a user input requesting login while displaying a UI for logging into a user account. Hereinafter, user input for unlocking, user input for requesting payment, and / or user input for requesting login may be referred to as user input for requesting user authentication.

[0125] In one embodiment, the electronic device (101) may acquire an image for user authentication through the camera (480) based on a user input. For example, referring to FIG. 5B, the image (520) may include an object (521) representing the user (501) and an object (525) representing the wearable device (401). In one embodiment, the image (520) for user authentication may not be displayed through the display (460) of the electronic device (101), but may be an image used internally (or through the processor (420)) of the electronic device (101) for user authentication. In one embodiment, the use of the image (520) internally (or via the processor (420)) of the electronic device (101) for user authentication may include comparing the image (520) with a user's face template stored in the memory (430) of the electronic device (101) (or a designated area (e.g., a secure area (or secure element)) for user authentication (e.g., facial recognition).

[0126] In one embodiment, the electronic device (101) may fail to authenticate the user through the face (530) of the user (501) included in the image (520) for user authentication. For example, the face of the user (501) is identified in some parts (531, 535) of the face (530) in the image (520), but the face of the user (501) is obscured by an object (525) representing a wearable device in other parts (533) of the face (530) in the image (520), so the electronic device (101) may fail to authenticate the user through the face (530) of the user included in the image (520).

[0127] In one embodiment, in response to a failure in user authentication based on the image (520), the electronic device (101) may display a UI (540) (e.g., “Face not recognized”) within the lock screen (510) via the display (460) indicating that the user authentication has failed. However, the present invention is not limited thereto. For example, in response to a failure in user authentication based on the image (520), the electronic device (101) may display a UI (540) indicating that the user authentication has failed while displaying a UI for payment. For example, in response to a failure in user authentication based on the image (520), the electronic device (101) may display a UI (540) indicating that the user authentication has failed while displaying a UI for logging into a user account.

[0128] Referring to FIG. 5D, the wearable device (401) may display a visual object (560) representing an electronic device (101) within the FOV (550) and a screen (570) corresponding to the screen (510). In one embodiment, the visual object (560) and the screen (570) may be displayed on the display (465) based on a stereoscopic image. The stereoscopic image may be an image that takes into account the binocular disparity of the user (501). The stereoscopic image may be an image for providing a three-dimensional (3D) sense of space to the user (501). Here, the visual object (560) may represent the electronic device (101) located in an actual space. Here, indicating an electronic device (101) located in a real space may mean that the electronic device (101) existing in the real space can be shown to the user (501) through the display (465) via VST (video see through). Indicating an electronic device (101) located in a real space may mean that an image representing the real space obtained through the camera (489) (or the front camera (240-3, 340-9, 340-10)) via VST is provided to the user (501).

[0129] In one embodiment, the wearable device (401) may display a visual object (580) corresponding to the UI (540) as the electronic device (101) displays the UI (540). In one embodiment, the user (501) may determine that user authentication has failed as the visual object (580) corresponding to the UI (540) is displayed within the FOV (550).

[0130] As described above, when an electronic device (101) authenticates a user (501) wearing a wearable device (401) using the face of the user, the user authentication may fail. Accordingly, the user (501) may experience the inconvenience of having to perform user authentication again after taking off the wearable device (401).

[0131] Accordingly, a method for performing user authentication of an electronic device (101) even when a user (501) is wearing a wearable device (401) may be required. Hereinafter, with reference to FIGS. 6 to 14c, an operation for authenticating a user through collaboration between an electronic device (101) and a wearable device (401) may be described.

[0132] FIG. 6 is a flowchart illustrating an operation of an electronic device performing user authentication according to one embodiment.

[0133] Figure 6 can be explained with reference to Figures 1 to 5d.

[0134] Referring to FIG. 6, in operation 610, the electronic device (101) may receive an input that causes user authentication. In one embodiment, the input that causes user authentication may be an input requesting user authentication.

[0135] In one embodiment, the input that causes user authentication may be an input requesting unlocking of the electronic device (101) in a locked state (e.g., a push on the power button, a touch input toward the display (460), a voice command (e.g., "unlock"), a specified movement of the user identified by the electronic device (101) (or the camera (480) of the electronic device (101) or the sensor (470) (e.g., the user approaching the electronic device (101)), and / or a specified movement using the electronic device (101). In one embodiment, the input that causes user authentication may be a specified gesture of the user toward the electronic device (101) (e.g., a specified pattern of touch input toward the electronic device (101) (or the display (460) of the electronic device (101)). In one embodiment, the input that causes user authentication may be a specified gesture of the user using the electronic device (101) (e.g., a specified movement using the electronic device (101) (e.g., an electronic (101) may be moved in a specific direction and / or to a specific location). In one embodiment, the input causing user authentication may be an input requesting payment (e.g., a touch input to a visual object for payment (e.g., “payment”) included in a user interface (UI) displayed through the display (460). In one embodiment, the input causing user authentication may be an input requesting entry into a setting screen related to security of the electronic device (101) (e.g., a screen for changing a password, a screen for recording biometric information). In one embodiment, the input causing user authentication may be an input requesting login to a user account.

[0136] In one embodiment, the receipt of an input that triggers user authentication may be included in an event related to user authentication. For example, the electronic device (101) receiving an input that triggers user authentication may correspond to the electronic device (101) detecting an event related to user authentication.

[0137] In operation 620, the electronic device (101) may obtain an image (520) through the camera (480). In one embodiment, the electronic device (101) may obtain an image (520) for user authentication through the camera (480) based on receiving an input that causes user authentication. In one embodiment, the electronic device (101) may obtain an image (520) for user authentication through the camera (480) based on a request for face authentication (or iris authentication) of the user (501) by the input that causes user authentication. In one embodiment, the electronic device (101) may obtain an image (520) in which the face of the user (501) is identified through the camera (480) based on a request for face authentication (or iris authentication) of the user (501). In one embodiment, the electronic device (101) may obtain an image (520) including the face of the user (501) through the camera (480) based on a request for facial authentication (or iris authentication) of the user (501).

[0138] In one embodiment, the request for face authentication (or iris authentication) of the user (501) by an input causing user authentication may mean that the face authentication (or iris authentication) of the user (501) is requested when requesting user authentication according to the security settings of the electronic device (101) (e.g., settings for user authentication methods (e.g., PIN (personal identification number), password (e.g., combination of alphabets or Arabic numerals), pattern, drag, biometrics (e.g., face, iris, or fingerprint)). In one embodiment, the request for face authentication (or iris authentication) of the user (501) by an input causing user authentication may mean that the user (501) performs face authentication (or iris authentication) among various user authentication methods.

[0139] According to an embodiment, the wearable device (401) may identify, through the camera (489), a gesture (e.g., an action of the user (501) wearing the wearable device (401) to request a face-based user authentication from the electronic device (101) (e.g., the user (501) moves the electronic device (101) so that the face of the user (501) faces the electronic device (101), and / or the user (501) moves the face of the user (501). In one embodiment, based on the identification of a gesture for requesting face-based user authentication to the electronic device (101), the wearable device (401) may display specific information on a display (469) facing the outside (or the front of the wearable device (401)) of the wearable device (401) (or the side of the wearable device (401) that does not face the user when the wearable device (401) is worn by the user (501)) so that the electronic device (101) may perform user authentication. In one embodiment, the specific information displayed on the display (469) may include a visual representation (e.g., a QR code, a lighting pattern) corresponding to a user account of the user (501) of the wirelessly connected electronic device (101) in the user information DB (445). However, the present invention is not limited thereto. For example, the specific information displayed on the display (469) may include an image of the user (501) acquired via the camera (485). For example, the specific information displayed on the display (469) may include an image of at least a portion of the user's (501) face obtained through the camera (485) of the wearable device (401). For example, the specific information displayed on the display (469) may be an image of a portion of the user's (501) face that is covered by the wearable device (401) (e.g., at least one of the eyes, nose, ears, or mouth).In an embodiment, when the display (469) is a transparent display that allows external light to pass through to the face of the user (501), based on the identification of a gesture for requesting face-based user authentication to the electronic device (101), the wearable device (401) can adjust the transparency of the display (469) so that the electronic device (101) can capture an image of a portion (e.g., at least one of the eyes, nose, ears, or mouth) covered by the wearable device (401).

[0140] In one embodiment, the electronic device (101) can obtain an image (520) including specific information displayed on the display (469) through the camera (480). In one embodiment, the electronic device (101) can obtain an image (520) including the face of the user (501) passing through the display (469) through the camera (480).

[0141] In operation 630, the electronic device (101) may determine whether user authentication is possible. In one embodiment, the electronic device (101) may determine whether user authentication is possible based on an image (520). In one embodiment, the electronic device (101) may determine whether user authentication is possible based on the face of the user (501) included in the image (520).

[0142] In one embodiment, the electronic device (101) may determine that the user is not authenticated if at least a portion of the user's (501) face (e.g., at least one of the eyes, nose, ears, or mouth) is covered by an object. In one embodiment, the electronic device (101) may determine the type of object covering at least a portion of the user's (501) face. In one embodiment, the type of object may include a device covering the user's eyes (e.g., a head mounted display (HMD), a glasses-type device, an eye mask-type device), a device worn on the user's ears (e.g., a headset, earbuds, earrings), or a device covering the user's mouth and / or nose (e.g., a mask). In one embodiment, the electronic device (101) may determine the type of object based on the shape (or form) of the object covering at least a portion of the user's (501) face.

[0143] In one embodiment, the electronic device (101) may determine that the user is not authenticable based on the fact that an object (525) corresponding to the wearable device (401) covers an object (530) corresponding to the face of the user (501) in an image (520) acquired through the camera (480). In one embodiment, the electronic device (101) may determine that the user is authenticable based on the fact that an object (525) corresponding to the wearable device (401) does not cover an object (530) corresponding to the face of the user (501) in an image (520) acquired through the camera (480).

[0144] In one embodiment, the electronic device (101) may determine that the user is not authenticated if at least a portion of the user's (501) face is covered by the wearable device (401). In one embodiment, the electronic device (101) may determine that the user is not authenticated if the user (501) wears the wearable device (401) on the face. In one embodiment, the electronic device (101) may determine that the user is not authenticated if an object (525) of the wearable device (401) that covers an object (530) representing the user's (501) face is identified.

[0145] In one embodiment, the electronic device (101) may determine whether user authentication is possible based on a user selected from among the plurality of users when multiple users are identified in the image (520). In one embodiment, the electronic device (101) may determine that user authentication is not possible when a user selected from among the plurality of users identified in the image (520) wears a wearable device (401) on his or her face. In one embodiment, the selected user may be a user located at the center of the image (520) from among the plurality of users. In one embodiment, the selected user may be a user having a face corresponding to the user's face image from among the plurality of users. In one embodiment, the face corresponding to the face image may include the face and the face image being similar to each other. In one embodiment, the face corresponding to the face image may include the face and the face image corresponding to a specified similarity (or, a threshold level of similarity) or higher.

[0146] In one embodiment, the electronic device (101) may determine that a user is authenticable based on specific information being displayed on the display (469) through an image (520) acquired through the camera (480). In one embodiment, the electronic device (101) may determine that a user is authenticable based on identification of a face of a user (501) passing through the display (469) through an image (520) acquired through the camera (480).

[0147] In operation 630, based on determining that user authentication is not possible, the electronic device (101) may perform operation 640. In operation 630, based on determining that user authentication is possible, the electronic device (101) may perform operation 670.

[0148] In operation 640, the electronic device (101) may request user authentication from the wearable device (401). In one embodiment, the electronic device (101) may request user authentication for a user associated with a user account included in the user information DB (441) from the wearable device (401).

[0149] In one embodiment, the electronic device (101) may display a UI (e.g., 1410 of FIG. 14a) indicating an attempt to unlock the electronic device (101) through the wearable device (401) within the screen (510) based on a request for user authentication from the wearable device (101). In one embodiment, the wearable device (401) may display a UI (e.g., 1420 of FIG. 14b) indicating an attempt to unlock the electronic device (101) through the wearable device (401) within the FOV (550) around an object (560) representing the electronic device (101) based on receiving a request for user authentication from the electronic device (101).

[0150] In one embodiment, the electronic device (101) may request user authentication from the wearable device (401) identified through the communication circuit (490). In one embodiment, the electronic device (101) may identify the wearable device (401) based on the electronic device (101) receiving an advertisement packet requesting a wireless connection based on short-range wireless communication (e.g., WiFi, WiFi Direct, Bluetooth, BLE (Bluetooth low energy)). In one embodiment, the identification of the wearable device (401) through the communication circuit (490) may include that the electronic device (101) recognizes the wearable device (401). In one embodiment, the wearable device (401) being identified through the communication circuit (490) may include a state before a wireless connection is established between the electronic device (101) and the wearable device (401) after the electronic device (101) recognizes the wearable device (401).

[0151] In one embodiment, the electronic device (101) may request user authentication from the wirelessly connected wearable device (401) via the communication circuit (490). In one embodiment, the wireless connection between the electronic device (101) and the wearable device (401) may be established before operation 610 of FIG. 6 , but is not limited thereto. The wireless connection between the electronic device (101) and the wearable device (401) may be established after operation 610 of FIG. 6 . For example, the electronic device (101) may establish a wireless connection with the wearable device (401) based on determining that user authentication is not possible. In one embodiment, the wireless connection between the electronic device (101) and the wearable device (401) may include a wireless connection based on short-range wireless communication and / or a wireless connection based on long-range wireless communication. According to an embodiment, the electronic device (101) may request user authentication from the identified wearable device (401) according to the order of the plurality of wireless communication techniques. For example, the electronic device (101) may identify the wearable device (401) connected to the electronic device (101) in the order of BT and WiFi. For example, the electronic device (101) may identify the wearable device (401) connected based on WiFi based on the fact that the wearable device (401) connected based on BT is not identified.

[0152] In one embodiment, the electronic device (101) may request user authentication from a wearable device (401) that is wirelessly connected to the electronic device (101) based on short-range wireless communication (e.g., WiFi, Bluetooth, BLE).

[0153] In one embodiment, the electronic device (101) can establish a wireless connection with a wearable device (401) selected by a user from among electronic devices that have a history of establishing a wireless connection (or, pairing history). In one embodiment, the electronic device (101) can establish a wireless connection with a wearable device (401) selected from a list of electronic devices that have a history of establishing a wireless connection (or, pairing list). In one embodiment, the electronic device (101) can establish a wireless connection with a wearable device (401) that transmits a signal with the strongest signal strength among signals received from electronic devices.

[0154] In one embodiment, the electronic device (101) may establish a wireless connection with the wearable device (401) based on broadcasting an advertising packet requesting a wireless connection to the wearable device (401). In one embodiment, the electronic device (101) may establish a wireless connection with the wearable device (401) based on broadcasting an advertising packet based on the wearable device (401) not being identified in the pairing list (or has never been wirelessly connected to the wearable device (401).

[0155] In one embodiment, the electronic device (101) may establish a wireless connection with the wearable device (401) based on receiving an advertising packet broadcast from the wearable device (401). In one embodiment, the electronic device (101) may establish a wireless connection with the wearable device (401) based on receiving an advertising packet based on the wearable device (401) not being identified in the pairing list (or has never been wirelessly connected to the wearable device (401).

[0156] In one embodiment, the electronic device (101) can establish a wireless connection with a wearable device (401) that is closest to the electronic device (101) among the electronic devices. In one embodiment, the distances between the electronic device (101) and the electronic devices can be measured using a communication technique for distance measurement (e.g., ultra-wide band (UWB)), but is not limited thereto. The distances can be measured based on the signal strengths of signals received by the electronic device (101) (e.g., received signal strength indicator (RSSI)).

[0157] In one embodiment, the electronic device (101) may request user authentication from a wearable device (401) wirelessly connected to the electronic device (101) based on long-range wireless communication (e.g., a cellular network). For example, the electronic device (101) may be connected to a wearable device (401) that is logged in with the same user account as the user account logged in to the electronic device (101) through a server (e.g., 108 of FIG. 1). In one embodiment, information about the user account and / or information about the wearable device (401) may be included in a user information DB (441). In one embodiment, the user information DB (441) may be received from the server (108).

[0158] In one embodiment, the electronic device (101) may request user authentication from the wearable device (401) identified in the image (520). In one embodiment, the electronic device (101) may request user authentication from the wearable device (401) that covers the face of the user (501). In one embodiment, the electronic device (101) may determine whether the object (530) representing the face of the user (501) corresponds to (or is similar to) a face image included in the user information DB (441). For example, the electronic device (101) may determine whether the object (530) representing the face of the user (501) corresponds to a face image. For example, the electronic device (101) may determine whether a portion of an object (530) representing a face of a user (501) (e.g., an area (531, 535) not covered by an object (525) representing a wearable device (401)) corresponds to (or is similar to) a face image. In one embodiment, the object (530) corresponding to a face image may include that the object (530) and the face image are similar to each other. In one embodiment, the object (530) corresponding to a face image may include that the object (530) and the face image correspond to a specified similarity (or a threshold level of similarity) or higher.

[0159] In one embodiment, the electronic device (101) may request user authentication from the wearable device (401) closest to the electronic device (101). For example, the distance between the wearable device (401) and the electronic device (101) may be measured by the electronic device (101) based on a communication technique for distance measurement and / or signal strength.

[0160] In one embodiment, the electronic device (101) may request the display of a visual indication (e.g., a QR (quick response) code, a lighting pattern) to a plurality of electronic devices (e.g., wearable devices (401, 402) of FIG. 15A) based on the identification of a plurality of electronic devices around the electronic device (101). In one embodiment, the electronic device (101) may request the display of a visual indication (e.g., a QR code, a lighting pattern) corresponding to a user account to a plurality of electronic devices (e.g., wearable devices (401, 402) of FIG. 15A). In one embodiment, the wearable device (401) may display a visual indication (e.g., a QR code, a lighting pattern) corresponding to a user account in the user information DB (445) through an external display (469). In one embodiment, the external display (469) may be placed on the front (or the side that does not face the user) of the wearable device (401). In one embodiment, the electronic device (101) may identify the wearable device (401) included in the image as the wearable device (401) owned by the user (501) based on identifying a visual indication (e.g., a QR code, a lighting pattern) through another image acquired through the camera (480). In one embodiment, the electronic device (101) may identify the wearable device (401) for which user authentication is to be requested based on identifying a visual indication (e.g., a QR code, a lighting pattern) through another image acquired through the camera (480).

[0161] In one embodiment, the electronic device (101) may display a visual indication (e.g., a QR code, a lighting pattern) corresponding to a user account through the display (460) based on the identification of multiple electronic devices around the electronic device (101). In one embodiment, the wearable device (401) may acquire an image including the visual indication (e.g., a QR code, a lighting pattern) through the camera (489). In one embodiment, the wearable device (401) may broadcast an advertising packet requesting a wireless connection to the electronic device (101) through the communication circuit (495) in response to the visual indication (e.g., a QR code, a lighting pattern) being a visual indication corresponding to a user account in the user information DB (445). In one embodiment, the electronic device (101) may identify the wearable device (401) from which user authentication is to be requested based on receiving the advertising packet.

[0162] In operation 650, the wearable device (401) can authenticate the user (501).

[0163] In one embodiment, the wearable device (401) may authenticate the user (501) based on a user account of a user requested by the electronic device (101) among user accounts of a plurality of users registered in the user information DB (445). In one embodiment, the wearable device (401) may authenticate the user (501) based on a user account registered in the electronic device (101) among user accounts of a plurality of users registered in the user information DB (445). Authenticating the user (501) based on the user account of the user requested by the electronic device (101) may include authenticating the user (501) using an authentication method set for the user account of the user requested by the electronic device (101) among the user accounts of the plurality of users.

[0164] In one embodiment, the wearable device (401) can authenticate a user (501) associated with a user account included in a user information DB (445). In one embodiment, the wearable device (401) can authenticate a user (501) based on biometric information of the user (501) included in the user information DB (445). In one embodiment, the wearable device (401) can authenticate a user (501) based on biometric information registered for a user account corresponding to the user (501) among a plurality of user accounts included in the user information DB (445) (or biometric information of the user (501)).

[0165] In one embodiment, the wearable device (401) may, based on receiving a request for user authentication from the electronic device (101), display a UI (e.g., 1430 of FIG. 14C) around an object (560) representing the electronic device (101) within the FOV (550) that queries whether to attempt to unlock the electronic device (101) through the wearable device (401). In one embodiment, the wearable device (401) may authenticate the user (501) based on a user input selecting yes (1440) to the UI (1430). In one embodiment, the wearable device (401) may abort the authentication of the user (501) based on a user input selecting no (1445) to the UI (1430).

[0166] For example, the wearable device (401) can authenticate the user (501) using an image of the user's (501) eyes acquired through the camera (485). For example, the wearable device (401) can authenticate the user (501) based on the identification of the user's (501) iris in the image of the user's (501) eyes acquired through the camera (485). For example, the wearable device (401) can authenticate the user (501) based on the correspondence of the feature map of the iris of the user's (501) eyes acquired from the image acquired through the camera (485) to the feature map of the iris of the user's (501) iris included in the user information DB (445). However, the present invention is not limited thereto. For example, the wearable device (401) may authenticate the user (501) using various user authentication methods (e.g., other biometrics (e.g., face, vein, or fingerprint), gesture, PIN, password, and / or pattern) for the user (501). In one embodiment, other biometrics (e.g., fingerprint, and / or vein) of the user (501) may be performed based on data obtained from the hand or wrist of the user (501) in contact with the wearable device (401) via the sensor (475). In one embodiment, other biometrics (e.g., face) of the user (501) may be performed based on data obtained from the face of the user (501) worn on the wearable device (401) via the camera (485).

[0167] In one embodiment, the wearable device (401) can authenticate the user (501) through cooperation with the electronic device (101). For example, the electronic device (101) can perform part of the authentication of the user (501) through some parts (531, 535) of the face (530) of the user (501) included in the image (520) that are not covered by the object (525), and the wearable device (401) can perform another part of the authentication of the user (501) through an image acquired through a camera (485) that captures some parts of the face (530) of the user (501) that are covered by the object (525). In one embodiment, the wearable device (401) may authenticate the user (501) based on the results of performing some of the authentication of the user (501) performed on the electronic device (101) and the results of performing other parts of the authentication of the user (501) performed on the wearable device (401). In one embodiment, the wearable device (401) may authenticate the user (501) based on a combination of the results of performing some of the authentication of the user (501) performed on the electronic device (101) and the results of performing other parts of the authentication of the user (501) performed on the wearable device (401).

[0168] For example, the electronic device (101) can transmit the image (520) to the wearable device (401). For example, the wearable device (401) can perform part of the authentication of the user (501) through some parts (531, 535) of the face (530) of the user (501) included in the image (520) that are not covered by the object (525), and can perform another part of the authentication of the user (501) through an image acquired through a camera (485) that captures some parts of the face (530) of the user (501) that are covered by the object (525). In one embodiment, the wearable device (401) may authenticate the user (501) based on the results of performing some of the authentication of the user (501) based on an image (520) received from the electronic device (101) and the results of performing other of the authentication of the user (501) based on an image acquired through the camera (485).

[0169] In one embodiment, the wearable device (401) may provide an image of a user (501) acquired through a camera (485) to the electronic device (101) based on receiving a request for user authentication from the electronic device (101). In one embodiment, the image of the user (501) acquired through the camera (485) of the wearable device (401) may be an image of at least a portion of the face of the user (501). For example, the image of the user (501) acquired through the camera (485) may be an image of a portion of the face of the user (501) that is covered by the wearable device (401) (e.g., at least one of the eyes, nose, ears, or mouth).

[0170] For example, the electronic device (101) can transmit the image (520) to the wearable device (401). For example, the electronic device (101) can perform part of the authentication of the user (501) through some parts (531, 535) of the face (530) of the user (501) included in the image (520) that are not covered by the object (525) through the image (520) and the image of at least a part of the face received from the wearable device (401), and can perform another part of the authentication of the user (501) through an image acquired through a camera (485) that captures some parts of the face (530) of the user (501) that are covered by the object (525). In one embodiment, the electronic device (101) may authenticate the user (501) based on the results of performing some of the authentication of the user (501) based on the image (520) and the results of performing other of the authentication of the user (501) based on the image acquired through the camera (485) received from the wearable device (401).

[0171] In one embodiment, the wearable device (401) can identify a user authentication result without additional authentication of the user (501) after receiving a user authentication request. In one embodiment, the wearable device (401) can identify a user authentication result without additional authentication of the user (501) if authentication of the user (501) is completed using at least one user authentication method before receiving the user authentication request.

[0172] According to an embodiment, the wearable device (401) may identify, through the camera (489), a gesture (e.g., an action of the user (501) moving the electronic device (101) so that the face of the user (501) faces the electronic device (101) and / or moving the face of the user (501)) for requesting face-based user authentication to the electronic device (101). In one embodiment, based on the identification of the gesture for requesting face-based user authentication to the electronic device (101), the wearable device (401) may identify a user authentication result. In one embodiment, while the wearable device (401) is wirelessly connected to the electronic device (101), based on the identification of the gesture for requesting face-based user authentication to the electronic device (101), the wearable device (401) may identify a user authentication result. In one embodiment, when the wearable device (401) completes authentication for the user (501) using at least one user authentication method, the wearable device (401) can identify a user authentication result based on the gesture identified for requesting face-based user authentication from the electronic device (101). In one embodiment, the wearable device (401) can transmit the identified user authentication result to the electronic device (101) without receiving a user authentication request from the electronic device (101).

[0173] In one embodiment, the wearable device (401) may identify a user authentication result without performing additional authentication on the user (501) if a user authentication request is received within a specified time after completing authentication on the user (501). In one embodiment, the wearable device (401) may identify a user authentication result based on performing additional authentication on the user (501) if a user authentication request is received after a specified time after completing authentication on the user (501). However, the present invention is not limited thereto. The wearable device (401) may identify a user authentication result based on performing additional authentication on the user (501) if a user authentication request is received, regardless of whether authentication on the user (501) is completed.

[0174] In one embodiment, the wearable device (401) can identify a user authentication result without performing additional authentication for the user (501) if a user authentication request is received while the wearable device (401) is located within a specified distance range from a location where authentication for the user (501) was completed. In one embodiment, the wearable device (401) can identify a user authentication result based on performing additional authentication for the user (501) if a user authentication request is received while the wearable device (401) is located outside a specified distance from a location where authentication for the user (501) was completed.

[0175] In one embodiment, the wearable device (401) may identify a user authentication result without additional authentication of the user (501) if a user authentication request is received while the wearable device (401) is being worn after authentication for the user (501) has been completed. In one embodiment, the wearable device (401) may identify a user authentication result based on performing authentication for the user (501) if a user authentication request is received while authentication for the user (501) has not been completed after the wearable device (401) is being worn.

[0176] In operation 660, the wearable device (401) may transmit a user authentication result to the electronic device (101). In one embodiment, the wearable device (401) may transmit a user authentication result indicating whether a user corresponding to a user who has requested authentication to the electronic device (101) has worn the wearable device (401). In one embodiment, the wearable device (401) may transmit a user authentication result indicating whether user authentication for a user corresponding to a user who has requested authentication to the electronic device (101) has been successful.

[0177] In operation 670, the electronic device (101) can authenticate the user (501) based on the image (520). In one embodiment, the electronic device (101) can authenticate the user (501) based on comparing the pattern (or feature map) of the facial features of the user (501) identified in the image (520) with information for user authentication stored in the user information DB (441) (e.g., information representing the pattern (or feature map) of the facial features of the user (501)).

[0178] In operation 680, the electronic device (101) may perform a function based on the user authentication result. In one embodiment, the electronic device (101) may display a UI (e.g., 540 of FIG. 5c) indicating that the user authentication has failed based on the user authentication result indicating that the user authentication has failed.

[0179] In one embodiment, the electronic device (101) may perform a function indicated by an input that causes user authentication based on a user authentication result indicating that the user authentication was successful.

[0180] In one embodiment, the electronic device (101) may unlock the electronic device (101) based on the user authentication result indicating that the user authentication is successful. In one embodiment, the electronic device (101) may display a home screen (e.g., 1310 of FIG. 13) through the display (460) based on unlocking the electronic device (101).

[0181] In one embodiment, the electronic device (101) may unlock the electronic device (101) in response to an input requesting unlocking of the electronic device (101) in a locked state if the user authentication result indicates successful user authentication. In one embodiment, the electronic device (101) may proceed with payment in response to an input requesting payment in a locked state if the user authentication result indicates successful user authentication.

[0182] In one embodiment, the electronic device (101) may, if the user authentication result indicates successful user authentication, proceed with payment in response to an input requesting payment in a locked state. In one embodiment, the electronic device (101) may, if the user authentication result indicates successful user authentication, display a UI indicating that payment is completed in response to an input requesting payment in a locked state. In one embodiment, the electronic device (101) may, if the user authentication result indicates successful user authentication, display a security-related settings screen in response to an input requesting entry into a security-related settings screen. In one embodiment, the electronic device (101) may, if the user authentication result indicates successful user authentication, log in using a user account in response to an input requesting login to a user account. In one embodiment, the electronic device (101) may, if the user authentication result indicates successful user authentication, display a UI indicating that login is completed using a user account in response to an input requesting login to a user account.

[0183] In one embodiment, the electronic device (101) may mirror (or display) a screen (e.g., 1220 of FIG. 12B) generated by the electronic device (101) on the wearable device (401) when the user authentication result indicates successful user authentication. For example, the electronic device (101) may transmit data (or image frames) representing the screen generated by the electronic device (101) to the wearable device (401) when the user authentication result indicates successful user authentication. In one embodiment, the wearable device (401) may display the screen of the electronic device (101) within the FOV (550) of the wearable device (401) based on the data representing the screen. In one embodiment, displaying the screen of the electronic device (101) within the FOV (550) of the wearable device (401) may be distinguished from displaying an image acquired through the camera (485) of the wearable device (401) in the FOV (550). In one embodiment, the display (460) of the electronic device (101) may be turned off while mirroring (or displaying) the screen generated by the electronic device (101) on the wearable device (401). In one embodiment, when the user authentication result indicates successful user authentication, the electronic device (101) may transmit an image frame to the wearable device (401) through the communication circuit (490) so that the image frame generated by the electronic device (101) is displayed through the display (465) of the wearable device (401) without turning on the display (460) in the turned-off state. In one embodiment, the electronic device (101) may turn off the display (460) displaying the lock screen when the user authentication result indicates that the user authentication is successful. In one embodiment, the electronic device (101) may turn off the display (460) displaying the lock screen based on initiating mirroring (or display) of the screen generated by the electronic device (101) when the user authentication result indicates that the user authentication is successful.The electronic device (101) may generate a screen (1220) to be displayed on the wearable device (401) while the electronic device (101) displays a lock screen (e.g., 1210 of FIG. 12A) (or maintains a turned-off state) (or maintains a locked state) (or does not change the lock screen (1210)), if the user authentication result indicates a successful user authentication.

[0184] In one embodiment, the electronic device (101) may display a user interface (UI) for controlling content within the screen being mirrored through the display (460) while the screen generated by the electronic device (101) is mirrored (or displayed) on the wearable device (401).

[0185] In one embodiment, the electronic device (101) may perform a function based on a user authentication result only while a specified condition is satisfied when a user is authenticated through the wearable device (401). For example, the electronic device (101) may perform a function based on a user authentication result only while the electronic device (101) and the wearable device (401) are wirelessly connected when a user is authenticated through the wearable device (401). For example, the electronic device (101) may perform a function based on a user authentication result only while the electronic device (101) and the wearable device (401) are located within a specified distance when a user is authenticated through the wearable device (401).

[0186] For example, if a user is authenticated through a wearable device (401), the unlocking (or unlocked state) of the electronic device (101) may be maintained only while a specified condition is met. For example, if the electronic device (101) is unlocked as a result of a user being authenticated through the wearable device (401), the electronic device (101) may switch the electronic device (101) to a locked state based on identifying that the specified condition is not met. In one embodiment, the locked state may be a state in which access to at least one function of the electronic device (101) is restricted.

[0187] In one embodiment, when a user is authenticated through a wearable device (401), the electronic device (101) may monitor whether a specified condition is met. For example, when a user is authenticated through a wearable device (401), the electronic device (101) may monitor whether a wireless connection between the electronic device (101) and the wearable device (401) is maintained. For example, when a user is authenticated through the wearable device (401), the electronic device (101) may monitor whether the electronic device (101) is located within a specified distance from the wearable device (401). In one embodiment, the distance between the electronic device (101) and the wearable device (401) may be measured based on the strength of a signal transmitted from the wearable device (401) that the electronic device (101) receives.

[0188] In one embodiment, the distance between the electronic device (101) and the wearable device (401) can be measured using a communication technique for distance measurement (e.g., ultra-wide band (UWB)). In one embodiment, the distance between the electronic device (101) and the wearable device (401) can be measured using a change in the position of the electronic device (101) measured by the movement of the electronic device (101) identified through the sensor (470). In one embodiment, the distance between the electronic device (101) and the wearable device (401) can be measured based on a movement distance identification algorithm (e.g., pedestrian dead reckoning (PDR)). In one embodiment, the electronic device (101) may identify a moving direction, moving speed, and / or moving distance of the electronic device (101) using a moving distance identification algorithm, and may identify a distance between the electronic device (101) and the wearable device (401) through the identified moving direction, moving speed, and / or moving distance.

[0189] As described above, when a user (501) wearing a wearable device (401) requests face-based user authentication from an electronic device (101), the electronic device (101) can perform user authentication through the wearable device (401). Accordingly, the electronic device (101) can authenticate the user without the user (501) taking off the wearable device (401).

[0190] When a wearable device is worn and authenticated by a user and an electronic device is connected to the wearable device, and the user attempts to recognize the face of the mobile phone, the mobile phone detects the attempt to recognize the face through the camera of the wearable device, and then displays specific information on the display facing the outside of the wearable device (e.g., displays a QR code or, if it is a transparent display, controls the display to be transparent so that a part of the user's face that is covered can be seen from the outside), so that the electronic device can be unlocked.

[0191] FIG. 7 is a flowchart illustrating an operation of an electronic device performing user authentication according to one embodiment.

[0192] FIG. 7 may be described with reference to FIGS. 1 to 5d. Operations 640 and 670 of FIG. 7 may correspond to operations 640 and 670 of FIG. 6. Operations 710 to 730 of FIG. 7 may be included in operation 630 of FIG. 6.

[0193] Referring to FIG. 7, in operation 710, the electronic device (101) can identify the face of the user (501) in an image (520) acquired through the camera (480). The electronic device (101) can identify an object (530) representing the face of the user (501) in the image (520) acquired through the camera (480).

[0194] In operation 720, the electronic device (101) can determine whether the face is covered. In one embodiment, the electronic device (101) can determine whether at least a portion (533) (e.g., at least one of the eyes, nose, ears, or mouth) of an object (530) representing the face of the user (501) in the image (520) is covered.

[0195] At operation 720, based on the face being covered, the electronic device (101) can perform operation 730. At operation 720, based on the face not being covered, the electronic device (101) can perform operation 670.

[0196] In operation 730, the electronic device (101) can determine whether the device covering the face is a wearable device (401). In one embodiment, the electronic device (101) can determine whether the object (525) covering the object (530) corresponding to the face of the user (501) in the image (520) acquired through the camera (480) is the wearable device (401). In one embodiment, the electronic device (101) can determine whether the object (525) covering the object (530) corresponding to the face of the user (501) in the image (520) acquired through the camera (480) has the shape (or form) of the wearable device (401). When the object (525) has the shape (or form) of a wearable device (401), the electronic device (101) can determine that the device covering the face is a wearable device (401).

[0197] In operation 730, based on the fact that the device covering the face is a wearable device (401), the electronic device (101) can perform operation 640. In operation 730, based on the fact that the device covering the face is not a wearable device (401), the electronic device (101) can perform operation 670.

[0198] At operation 640, the electronic device (101) may request user authentication. At operation 670, the electronic device (101) may authenticate the user (501) based on the image (520).

[0199] FIG. 8A is a flowchart illustrating an operation of an electronic device performing user authentication according to an embodiment. FIG. 8B is a diagram illustrating an example of an electronic device displaying user information according to an embodiment. FIG. 8C is a diagram illustrating an example of a wearable device displaying user information according to an embodiment.

[0200] FIGS. 8A to 8C may be described with reference to FIGS. 1 to 5D. Operations 640 and 670 of FIG. 8A may correspond to operations 640 and 670 of FIG. 6. Operations 810 to 830 of FIG. 8A may be included in operation 630 of FIG. 6.

[0201] Referring to FIG. 8A, in operation 810, the electronic device (101) can identify a device that covers a face in an image (520). The electronic device (101) can identify an object (530) representing the face of a user (501) in the image (520) acquired through the camera (480). In one embodiment, the electronic device (101) can identify an object (525) representing a device that covers at least a portion (533) (e.g., at least one of an eye, a nose, an ear, or a mouth) of the object (530) representing the face of the user (501) in the image (520).

[0202] In operation 820, the electronic device (101) may cause the display of a visual object. For example, referring to FIG. 8B, the electronic device (101) may cause the display of a visual indication (830) corresponding to a user account of the electronic device (101) through the display (460). However, the present invention is not limited thereto. For example, referring to FIG. 8C, the electronic device (101) may transmit a request to the wearable device (401) through an external display (840) of the wearable device (401) (or the display (469) of FIG. 4) to cause the display of a visual indication (850) corresponding to a user account of the electronic device (101).

[0203] In operation 830, the electronic device (101) can determine whether the device covering the face is the wearable device (401) of the user (501).

[0204] In one embodiment, the electronic device (101) may identify the face-obscuring device as the wearable device (401) of the user (501) based on receiving an advertising packet requesting a wireless connection broadcast from the wearable device (401) after displaying a visual indication (830) through the display (460) while identifying the face-obscuring device through the camera (480). In one embodiment, the advertising packet may include information about the visual indication (830) (or information about the user account). In one embodiment, the electronic device (101) may identify the face-obscuring device as the wearable device (401) of the user (501) based on the fact that the advertising packet requesting a wireless connection broadcast from the wearable device (401) includes information about the visual indication (830) while the face-obscuring device is identified through the camera (480), by displaying a visual indication (830) through the display (460).

[0205] In one embodiment, the electronic device (101) may identify that the face-obscuring device is not the wearable device (401) of the user (501) based on not receiving an advertising packet requesting a wireless connection broadcast from the wearable device (401) after displaying a visual indication (830) through the display (460) while identifying the face-obscuring device through the camera (480). In one embodiment, the electronic device (101) may identify that the face-obscuring device is not the wearable device (401) of the user (501) based on not receiving an advertising packet requesting a wireless connection broadcast from the wearable device (401) after displaying a visual indication (830) through the display (460) while identifying the face-obscuring device through the camera (480) while identifying the face-obscuring device through the camera (480) while not receiving an advertising packet requesting a wireless connection broadcast from the wearable device (401) that does not include information about the visual indication (830) (or information about the user account).

[0206] In one embodiment, the electronic device (101) can identify that the face-obscuring device is the wearable device (401) of the user (501) based on identifying that the face-obscuring device displays a visual indication (850) while identifying the face-obscuring device through the camera (480). In one embodiment, the electronic device (101) can identify that the face-obscuring device is not the wearable device (401) of the user (501) based on identifying that the face-obscuring device does not display a visual indication (850) while identifying the face-obscuring device through the camera (480). In one embodiment, the electronic device (101) can identify that the face-obscuring device is not the wearable device (401) of the user (501) based on identifying that the face-obscuring device displays a visual indication that does not correspond to a user account while identifying the face-obscuring device through the camera (480).

[0207] At operation 830, based on the fact that the device covering the face is the wearable device (401) of the user (501), the electronic device (101) can perform operation 640. At operation 830, based on the fact that the device covering the face is not the wearable device (401) of the user (501), the electronic device (101) can perform operation 670.

[0208] At operation 640, the electronic device (101) may request user authentication. At operation 670, the electronic device (101) may authenticate the user (501) based on the image (520).

[0209] FIG. 9A is a flowchart illustrating an operation of an electronic device performing user authentication according to an embodiment. FIG. 9B is a diagram illustrating a situation in which an electronic device and a wearable device face each other, according to an embodiment. FIG. 9C is a diagram illustrating a situation in which the electronic device and the wearable device do not face each other, according to an embodiment.

[0210] FIGS. 9A to 9C may be described with reference to FIGS. 1 to 5D. Operations 640 and 670 of FIG. 9A may correspond to operations 640 and 670 of FIG. 6. Operations 910 to 930 of FIG. 9A may be included in operation 630 of FIG. 6.

[0211] Referring to FIG. 9A, in operation 910, the electronic device (101) can identify a wearable device (401) whose face is covered in the image (520).

[0212] In operation 920, the electronic device (101) can identify the orientation of the wearable device (401) whose face is covered in the image (520). In one embodiment, the electronic device (101) can identify the orientation of the wearable device (401) toward the electronic device (101) in the image (520).

[0213] For example, referring to FIG. 9B, the orientation (935) of the wearable device (401) toward the electronic device (101) may be directed toward the electronic device (101). For example, referring to FIG. 9B, while the orientation (931) of the electronic device (101) may be directed toward the wearable device (401), the orientation (935) of the wearable device (401) toward the electronic device (101) may be directed toward the electronic device (101). For example, the orientation (935) toward the electronic device (101) may include the front of the wearable device (401) (e.g., the surface of the display (840) on the outside of the wearable device (401)) being directed toward the front of the electronic device (101) (or the surface including the display (460)). For example, orientation (931) toward the wearable device (401) may include that the front of the electronic device (101) (or the side including the display (460)) is facing the front of the wearable device (401) (e.g., the side of the display (840) on the outside of the wearable device (401).

[0214] For example, referring to FIG. 9C, the orientation (945) of the wearable device (401) toward the electronic device (101) may not be directed toward the electronic device (101). For example, referring to FIG. 9C, while the orientation (941) of the electronic device (101) may be directed toward the wearable device (401), the orientation (945) of the wearable device (401) toward the electronic device (101) may not be directed toward the electronic device (101). For example, the orientation (945) not being directed toward the electronic device (101) may include that the front of the wearable device (401) (e.g., the surface of the display (840) on the outside of the wearable device (401)) is not directed toward the front of the electronic device (101) (or the surface including the display (460)). For example, orientation (945) not facing the electronic device (101) may include that the front of the wearable device (401) (e.g., the face of the display (840) on the outside of the wearable device (401)) faces a face other than the front of the electronic device (101) (or the face including the display (460)). For example, orientation (941) facing the wearable device (401) may include that the front of the electronic device (101) (or the face including the display (460)) does not face the front of the wearable device (401) (e.g., the face of the display (840) on the outside of the wearable device (401). For example, orientation (941) toward the wearable device (401) may include that the front of the electronic device (101) (or the side including the display (460)) is facing a side other than the front of the wearable device (401) (e.g., the side of the display (840) on the outside of the wearable device (401).

[0215] In operation 930, the electronic device (101) may determine whether the electronic device (101) and the wearable device (401) are arranged to face each other. In one embodiment, the electronic device (101) and the wearable device (401) facing each other may include that the orientation of the electronic device (101) is toward the wearable device (401) and the orientation of the wearable device (401) is toward the electronic device (101). For example, referring to FIG. 9B, since the orientation (931) of the electronic device (101) is toward the wearable device (401) and the orientation (935) of the wearable device (401) toward the electronic device (101) is toward the electronic device (101), the electronic device (101) and the wearable device (401) may be evaluated as facing each other. For example, referring to FIG. 9c, since the orientation (941) of the electronic device (101) is directed toward the wearable device (401), and the orientation (945) of the wearable device (401) toward the electronic device (101) is not directed toward the electronic device (101), the electronic device (101) and the wearable device (401) can be evaluated as not facing each other.

[0216] In operation 930, based on the electronic device (101) and the wearable device (401) being arranged to face each other, the electronic device (101) can perform operation 640. In operation 930, based on the electronic device (101) and the wearable device (401) not being arranged to face each other, the electronic device (101) can perform operation 670.

[0217] At operation 640, the electronic device (101) may request user authentication. At operation 670, the electronic device (101) may authenticate the user (501) based on the image (520).

[0218] FIG. 10A is a flowchart illustrating an operation of an electronic device performing user authentication according to an embodiment. FIG. 10B is a diagram illustrating a situation in which a wearable device identifies that a user's gaze is directed toward the electronic device according to an embodiment. FIG. 10C is a diagram illustrating a situation in which a wearable device identifies that a user's gaze is not directed toward the electronic device according to an embodiment. FIG. 10D is a diagram illustrating a situation in which a wearable device displays a UI that guides the location of the electronic device according to an embodiment.

[0219] FIGS. 10A to 10D may be described with reference to FIGS. 1 to 5D. Operations 640 and 670 of FIG. 10A may correspond to operations 640 and 670 of FIG. 6. Operations 1010 to 1040 of FIG. 10A may be included in operation 630 of FIG. 6.

[0220] Referring to FIG. 10A, in operation 1010, the electronic device (101) can identify a device that covers a face in an image (520). The electronic device (101) can identify an object (530) representing the face of a user (501) in the image (520) acquired through the camera (480). In one embodiment, the electronic device (101) can identify an object (525) representing a device that covers at least a portion (533) (e.g., at least one of an eye, a nose, an ear, or a mouth) of the object (530) representing the face of the user (501) in the image (520).

[0221] In operation 1020, the electronic device (101) may query the wearable device (401) whether the user (501) is looking at the electronic device (101). In one embodiment, the electronic device (101) may query the wearable device (401) whether the gaze of the user (501) wearing the wearable device (401) is directed toward the electronic device (101).

[0222] In one embodiment, the wearable device (401) can determine, based on receiving a query, whether the user's (501) gaze is directed toward the electronic device (101).

[0223] For example, referring to FIG. 10b, the wearable device (401) may determine, based on receiving a query, that the user's (501) gaze (1051) is directed toward the electronic device (101), based on the user's (501) gaze (1051) being directed toward a visual object (560) representing the electronic device (101). For example, referring to FIG. 10b, the wearable device (401) may determine, based on receiving a query, that the user's (501) gaze (1051) is positioned within a screen (570) corresponding to the screen (510), based on the user's (501) gaze being directed toward the electronic device (101).

[0224] For example, referring to FIG. 10c, the wearable device (401) may determine, based on receiving a query, that the user's (501) gaze (1050) is not directed toward the electronic device (101) based on the user's (501) gaze being directed in a direction other than a visual object (560) representing the electronic device (101). For example, referring to FIG. 10c, the wearable device (401) may determine, based on receiving a query, that the user's (501) gaze (1051) is located outside a screen (570) corresponding to the screen (510), based on the user's (501) gaze being directed not toward the electronic device (101).

[0225] According to an embodiment, referring to FIG. 10d, the wearable device (401) may display a UI (1060) indicating information for moving the position of the electronic device (101) to the user (501) based on determining that the user's (501) gaze is not directed toward the electronic device (101). For example, after displaying the UI (1060), if the user (501) positions the electronic device (101) in an area designated by the UI (1060), the wearable device (401) may determine again whether the user's (501) gaze is directed toward the electronic device (101). For example, if the wearable device (401) does not position the electronic device (101) in an area designated by the UI (1060) after displaying the UI (1060), the wearable device (401) can determine that the user's (501) gaze is not directed toward the electronic device (101) without determining whether the user's (501) gaze is directed toward the electronic device (101).

[0226] In one embodiment, the UI (1060) may guide (e.g., guide using interface elements (e.g., lines and / or colors)) the area where the electronic device (101) should be positioned for user authentication. In one embodiment, the wearable device (401) may authenticate the user in response to a user request from the electronic device (101) while the electronic device (101) is positioned in the area where the electronic device (101) should be positioned for user authentication.

[0227] In one embodiment, the wearable device (401) may transmit information related to the gaze of the user (501) to the electronic device (101). In one embodiment, the information related to the gaze of the user (501) may indicate whether the gaze of the user (501) is directed toward the electronic device (101).

[0228] In operation 1030, the electronic device (101) may receive information related to the gaze of the user (501) from the wearable device (401).

[0229] In operation 1040, the electronic device (101) can determine whether the gaze is located on the electronic device (101). In one embodiment, the electronic device (101) can determine whether the gaze is located on the electronic device (101) based on information related to the gaze of the user (501) received from the wearable device (401).

[0230] At operation 1040, based on the gaze being located at the electronic device (101), the electronic device (101) may perform operation 640. At operation 1040, based on the gaze not being located at the electronic device (101), the electronic device (101) may perform operation 670.

[0231] At operation 640, the electronic device (101) may request user authentication. At operation 670, the electronic device (101) may authenticate the user (501) based on the image (520).

[0232] FIG. 11 is a flowchart illustrating an operation of an electronic device providing content based on a user authentication result according to one embodiment.

[0233] Figure 11 can be explained with reference to Figures 1 to 5d.

[0234] Referring to FIG. 11, in operation 1110, the electronic device (101) can identify an event. The electronic device (101) can detect an event related to user authentication through the electronic device (101).

[0235] In operation 1120, the electronic device (101) can identify that the wearable device (401) is worn on the face of the user (501). In one embodiment, the electronic device (101) can determine whether the wearable device (401) is worn on the face of the user (501) in relation to an event. In one embodiment, the electronic device (101) can determine whether the wearable device (401) is worn to cover the eyes of the user (501) based on an image (520) of the user (501) acquired through the camera (480). In one embodiment, the image (520) can be captured to release a state in which at least one function of the electronic device (101) is restricted through facial recognition.

[0236] In operation 1130, the electronic device (101) may request user authentication from the wearable device (401).

[0237] In one embodiment, the electronic device (101) may transmit a request to the wearable device (401) to authenticate the user (501) through the communication circuit (490) based on determining that the wearable device (401) is worn on the face of the user (501).

[0238] In one embodiment, the electronic device (101) may identify that user authentication has failed based on the image (520). In one embodiment, the electronic device (101) may transmit the request to the wearable device (401) based on a determination that facial recognition has failed based on the image (520).

[0239] In one embodiment, the electronic device (101) can determine whether the wearable device (401) is in communication connection with the electronic device (101). In one embodiment, the electronic device (101) can perform an operation for establishing a communication connection between the electronic device (101) and the wearable device (401) based on determining that the wearable device (401) is not in communication connection with the electronic device (101). For example, the electronic device (101) can display a visual display (or graphical information) including information of the electronic device (101) through the display (460) of the electronic device (101) based on determining that the wearable device (401) is not in communication connection with the electronic device (101). In one embodiment, the visual display (or graphical information) can include information for establishing a communication connection with the electronic device (101). The visual display (or graphic information) may correspond to 830 of FIG. 8b.

[0240] In operation 1140, the electronic device (101) may provide designated content based on a user authentication result received from the wearable device (401). In one embodiment, the electronic device (101) may provide the designated content to the user (501) based on information received from the wearable device (401) indicating that the user (501) has been authenticated. For example, the information indicating that the user (501) has been authenticated may be transmitted from the wearable device (401) to the electronic device (101) based at least in part on a successful iris recognition through the wearable device (401). For example, the information indicating that the user (501) has been authenticated may be received by the electronic device (101) based on a user authentication (e.g., iris recognition) performed on the wearable device (401) after a request is transmitted from the electronic device (101) to the wearable device (401). In one embodiment, the specified content may include a screen that mirrors the screen of the electronic device (101).

[0241] For example, information indicating that a user (501) has been authenticated may be received by the electronic device (101) based on user authentication (e.g., iris recognition) performed on the wearable device (401) before a request is transmitted from the electronic device (101) to the wearable device (401) and a determination by the wearable device (401) that the user (501) has been wearing the wearable device (401) after the user authentication (e.g., iris recognition).

[0242] For example, information indicating that a user (501) has been authenticated may be received by the electronic device (101) based on a determination that a relative location of the electronic device (101) to the wearable device (401) is a designated location. In one embodiment, the designated location may be a location that satisfies that the distance between the electronic device (101) and the wearable device (401) is within a designated distance.

[0243] For example, based on information indicating that a user (501) has been authenticated, the electronic device (101) may transmit content to the wearable device (401) such that at least a portion of the specified content may be provided through the user interface of the wearable device (401).

[0244] In one embodiment, the electronic device (101) may stop providing the specified content if the wearable device (401) moves away from the electronic device (101) by a certain distance after providing the specified content. In one embodiment, the electronic device (101) may disconnect the communication connection with the wearable device (401) if the wearable device (401) moves away from the electronic device (101) by a certain distance after providing the specified content.

[0245] For example, the electronic device (101) may display a notification guiding that user authentication via the wearable device (401) may be canceled (or the electronic device (101) may be switched to a locked state) when the wearable device (401) exceeds a first distance specified from the electronic device (101). For example, the electronic device (101) may switch to a locked state when the wearable device (401) exceeds a second distance specified from the electronic device (101). For example, as the electronic device (101) switches to a locked state, the electronic device (101) may stop providing the specified content to the wearable device (401). For example, as the electronic device (101) switches to a locked state, the electronic device (101) may display a guide requesting user authentication for unlocking. In one embodiment, the second distance may be longer than the first distance. According to an embodiment, the electronic device (101) may be switched to a locked state when the wearable device (401) exceeds a specified second distance from the electronic device (101) without displaying a notification guiding that user authentication via the wearable device (401) may be released (or the electronic device (101) may be switched to a locked state).

[0246] In one embodiment, information of the wearable device (401) may be pre-registered in a user information DB (441) linked to a user account of the electronic device (101) for user authentication of the electronic device (101). Similarly, information of the electronic device (101) may be pre-registered in a user information DB (445) linked to a user account of the wearable device (401) for user authentication of the wearable device (401).

[0247] In one embodiment, while the wearable device (401) and the electronic device (101) are in communication connection with each other, based on a request for user authentication or unlocking from the electronic device (101) and / or the wearable device (401), the electronic device (101) may display a UI (or a notification) on the screen that inquires whether to link the user authentication or unlocking with the wearable device (401). In one embodiment, while the wearable device (401) and the electronic device (101) are in communication connection with each other, based on a request for user authentication or unlocking from the electronic device (101) and / or the wearable device (401), the wearable device (401) may display a UI (or a notification) on the screen that inquires whether to link the user authentication or unlocking with the electronic device (101). In one embodiment, the UI (or notification) may be displayed on at least one of the electronic device (101) or the wearable device (401).

[0248] In one embodiment, the electronic device (101) may, after displaying a UI (or notification), link user authentication or unlocking between the electronic device (101) and the wearable device (401) based on an input requesting linkage of user authentication or unlocking. In one embodiment, the wearable device (401) may, after displaying a UI (or notification), link user authentication or unlocking between the electronic device (101) and the wearable device (401) based on an input requesting linkage of user authentication or unlocking. For example, when user authentication or unlocking is performed on the wearable device (401), the electronic device (101) may be authenticated or unlocked without a separate user authentication or unlocking procedure. For example, when user authentication or unlocking is performed on the electronic device (101), the wearable device (401) may be authenticated or unlocked without a separate user authentication or unlocking procedure.

[0249] According to an embodiment, the linkage of user authentication or unlocking between the wearable device (401) and the electronic device (101) may be additionally set in the wearable device (401) and / or the electronic device (101).

[0250] For example, the wearable device (401) and / or the electronic device (101) may additionally set whether to link user authentication or unlocking based on the operating environment (e.g., the communication connection method (e.g., the method of short-range wireless communication) between the wearable device (401) and the electronic device (101) and identification information (e.g., MAC (medium access control)). For example, the wearable device (401) and / or the electronic device (101) may link user authentication or unlocking based on whether the wearable device (401) and / or the electronic device (101) are connected using a specified communication connection method.

[0251] For example, the wearable device (401) and / or the electronic device (101) may additionally set whether to link user authentication or unlocking based on at least one state of the wearable device (401) or the electronic device (101) (e.g., size, shape, operation time, location, place, or distance between the wearable device (401) or the electronic device (101) and the electronic device (101). For example, the wearable device (401) and / or the electronic device (101) may link user authentication or unlocking based on at least one state of the wearable device (401) and / or the electronic device (101) having a designated state.

[0252] For example, the wearable device (401) and / or the electronic device (101) may additionally set whether to link user authentication or unlocking based on the function execution status of at least one of the wearable device (401) or the electronic device (101) (e.g., the function or application being performed by the wearable device (401) or the electronic device (101). For example, the wearable device (401) and / or the electronic device (101) may link user authentication or unlocking based on at least one of the wearable device (401) and / or the electronic device (101) executing a specified function or application.

[0253] In some embodiments, the linkage of user authentication or unlocking may be set (or triggered) through an artificial intelligence model. For example, based on a user (501) attempting facial recognition through an electronic device (101) while wearing the wearable device (401) a specified number of times or more, the artificial intelligence model may link the user authentication or unlocking between the wearable device (401) and the electronic device (101). For example, based on a user (501) attempting facial recognition through the electronic device (101) while wearing the wearable device (401) a specified number of times or more, the artificial intelligence model may link the user authentication or unlocking between the wearable device (401) and the electronic device (101). For example, if user authentication is successful based on another user authentication method after facial recognition through the electronic device (101) fails while the user (501) is wearing the wearable device (401) a specified number of times or more, the artificial intelligence model can link user authentication or unlocking between the wearable device (401) and the electronic device (101).

[0254] In one embodiment, the artificial intelligence model may link user authentication or unlocking between the wearable device (401) and the electronic device (101) by setting specified conditions for linking user authentication or unlocking between the wearable device (401) and the electronic device (101).

[0255] For example, a specified condition may be identified as being satisfied when an image of a face (520) captured by an electronic device (101) and an image of a face captured by a wearable device (401) correspond to each other.

[0256] For example, a specified condition may be identified as being met when the electronic device (101) and the wearable device (401) are wirelessly connected to each other.

[0257] For example, a specified condition may be identified as being satisfied if a user account logged into the electronic device (101) is the same as a user account logged into the wearable device (401).

[0258] For example, a specified condition may be identified as being satisfied if an object (525) representing a wearable device (401) is included in an image acquired from the electronic device (101).

[0259] For example, a specified condition may be identified as being satisfied if an image acquired from the wearable device (401) includes an object representing an electronic device (101) facing the wearable device (401).

[0260] In one embodiment, the artificial intelligence model may output a query (e.g., audio output, and / or video output) regarding whether to link user authentication or unlocking between the electronic device (101) and the wearable device (401) based on whether a specified condition is met.

[0261] In one embodiment, the artificial intelligence model may determine whether to link user authentication or unlocking based on input from the user (501), such as the user's speech and / or touch input. In one embodiment, the artificial intelligence model may determine whether to link user authentication or unlocking based on user speech obtained using a conversational assistant function capable of natural language processing. In one embodiment, the artificial intelligence model may link user authentication or unlocking between the electronic device (101) and the wearable device (401) based on a response from the user (501) requesting linkage of user authentication or unlocking, based on specified conditions.

[0262] In one embodiment, the artificial intelligence model may be a deep learning model trained to suggest a user authentication method (e.g., a sequence of actions that can be performed for user authentication) based on the success or failure of user authentication of the electronic device (101) and / or the wearable device (401), and the context for the success or failure (e.g., the user authentication method, the device connected at the time of authentication, the location of the authentication attempt, the reason for the failure, the number of failures, and the function performed after the failure).

[0263] In one embodiment, the artificial intelligence model may include a deep learning model (or machine learning model) trained to correlate the usage pattern of the electronic device (101) with at least one task that can be provided through the electronic device (101). For example, the artificial intelligence model may be a generative artificial intelligence model trained to suggest a task that can perform a series of repeated operations using fewer steps when the series of operations are repeatedly performed in the electronic device (101) a specified number of times or more. The training may include initial training and retraining. For example, the training may include supervised training, unsupervised training, semi-supervised training, or reinforcement learning. In one embodiment, the artificial intelligence model may correspond to a large language model (LLM) or a large vision model (LVM), which are artificial neural network-based language models that have learned a large amount of data through pre-training. For example, the artificial neural network may be a combination of a deep neural network (DNN), a CNN, an RNN, an RBM, a DBN, a BRDNN, or a deep Q-network. The electronic device (101) may generate a prompt to obtain a recommended task and operation steps for performing the recommended task using an artificial intelligence model when a specified condition is satisfied (e.g., a specified series of operations are repeatedly performed). The prompt may include text information or image information including commands specifying functions and restrictions to be performed through the artificial intelligence model, data corresponding to the specified condition, or various contextual information of the electronic device (101). The electronic device (101) may obtain a recommended task based on a usage pattern of the electronic device (101) by inputting the generated prompt into the artificial intelligence model. The artificial intelligence model may be loaded from the memory (130) of the electronic device (101).

[0264] FIG. 12A is a diagram illustrating an example of a screen that an electronic device displays based on user authentication, according to one embodiment. FIG. 12B is a diagram illustrating an example of a screen that an electronic device provides to a wearable device based on user authentication, according to one embodiment.

[0265] Figures 12a and 12b can be explained with reference to Figures 1 to 5d.

[0266] In one embodiment, FIGS. 12A and 12B may illustrate an example of an electronic device (101) mirroring its screen to a wearable device (401).

[0267] Referring to FIG. 12A, when the user authentication result indicates a successful user authentication, the electronic device (101) can generate a screen to be displayed on the wearable device (401) while the electronic device (101) displays a lock screen (1210) (or maintains a turned-off state) (or maintains a locked state) (or does not change the lock screen (1210)).

[0268] Referring to FIG. 12b, the wearable device (401) can display the screen (1220) of the electronic device (101) within the FOV (550) of the wearable device (401) based on data representing the screen transmitted from the electronic device (101).

[0269] FIG. 13 is a diagram illustrating an example of a screen displayed by an electronic device based on user authentication, according to one embodiment.

[0270] Referring to FIG. 13, if the user authentication result indicates that the user authentication is successful, the electronic device (101) may change the screen displayed by the electronic device (101) through the display (460) from a lock screen (e.g., 1210 of FIG. 12a) to a home screen (1310). However, this is not limited thereto. If the user authentication result indicates that the user authentication is successful, the electronic device (101) may change the screen displayed by the electronic device (101) through the display (460) from a lock screen (e.g., 1210 of FIG. 12a) to a screen of an application whose execution is requested by an input that triggered user authentication.

[0271] FIG. 14A is a diagram illustrating an example of a screen that guides user authentication through a wearable device displayed by an electronic device according to an embodiment. FIG. 14B is a diagram illustrating an example of a screen that guides an attempt to unlock an electronic device through a wearable device displayed by a wearable device according to an embodiment. FIG. 14C is a diagram illustrating an example of a screen that inquires whether to attempt to unlock an electronic device through a wearable device displayed by a wearable device according to an embodiment.

[0272] In one embodiment, referring to FIG. 14a, the electronic device (101) may, based on a request for user authentication from the wearable device (401), display a UI (1410) indicating an attempt to unlock the electronic device (101) through the wearable device (401) within the screen (510). In one embodiment, referring to FIG. 14b, the wearable device (401) may, based on receiving a request for user authentication from the electronic device (101), display a UI (1420) indicating an attempt to unlock the electronic device (101) through the wearable device (401) within the FOV (550) around an object (560) representing the electronic device (101).

[0273] In one embodiment, referring to FIG. 14C, upon receiving a request for user authentication from the electronic device (101), the wearable device (401) may display a UI (1430) around an object (560) representing the electronic device (101) within the FOV (550) to inquire whether to attempt to unlock the electronic device (101) through the wearable device (401). In one embodiment, the wearable device (401) may authenticate the user (501) based on a user input selecting Yes (1440) to the UI (1430). In one embodiment, the wearable device (401) may stop authenticating the user (501) based on a user input selecting No (1445) to the UI (1430).

[0274] FIG. 15A is a diagram illustrating a situation in which a user performs user authentication through an electronic device while wearing a wearable device. FIG. 15B is a diagram illustrating a user wearing a wearable device in an image acquired for user authentication. FIG. 15C is a diagram illustrating an example in which an electronic device displays a UI indicating that user authentication has failed, according to an embodiment. FIG. 15D is a diagram illustrating a situation in which a wearable device displays a screen including an electronic device through a VST, according to an embodiment. FIG. 15E is a diagram illustrating an example in which a screen is displayed by an electronic device based on user authentication, according to an embodiment. FIG. 15F is a diagram illustrating an example in which a screen is provided by an electronic device to a wearable device based on user authentication, according to an embodiment.

[0275] Figures 15a to 15f can be explained with reference to Figures 1 to 4.

[0276] Referring to FIG. 15A, a wearable device (401) may be worn by a user (501), and another wearable device (402) may be worn by another user (502). In one embodiment, the wearable device (401) may identify that the wearable device (401) is worn by the user (501) based on a change in a sensing value obtained using a sensor (e.g., a proximity sensor, a biometric sensor, and / or an electrode sensor) when the user (501) wears the wearable device (401).

[0277] In one embodiment, the electronic device (101) may receive a user input requesting user authentication via the electronic device (101) while the user (501) is wearing the wearable device (401). For example, the electronic device (101) may receive a user input to unlock the device while displaying a lock screen (1510) indicating a locked state. However, the present invention is not limited thereto. For example, the electronic device (101) may receive a user input requesting payment. For example, the electronic device (101) may receive a user input requesting login.

[0278] In one embodiment, the electronic device (101) may acquire an image for user authentication through the camera (480) based on a user input. For example, referring to FIG. 15B, the image (1515) may include multiple users (501, 502). In one embodiment, the image (1515) for user authentication may not be displayed through the display (460) of the electronic device (101), but may be an image used internally (or through the processor (420)) of the electronic device (101) for user authentication.

[0279] In one embodiment, the electronic device (101) may fail to authenticate a user (501) because the image (1515) for user authentication includes multiple users (501, 502). For example, the user authentication may fail because the faces of the multiple users (501, 502) in the image (1515) are not fully identified due to the wearable devices (401, 402) being worn on them.

[0280] In one embodiment, in response to a failure in user authentication based on the image (1515), the electronic device (101) may display a UI (e.g., “Face not recognized”) within the lock screen (1510) via the display (460) indicating that the user authentication has failed.

[0281] Referring to FIG. 15c, the wearable device (401) can display a visual object (1520) representing the electronic device (101) within the FOV (550) and a screen (1530) corresponding to the screen (1510). In one embodiment, the visual object (1520) and the screen (1530) can be displayed based on a stereoscopic image on the display (465).

[0282] In one embodiment, the wearable device (401) may display a visual object (1535) corresponding to the UI (e.g., “Face not recognized”) as the electronic device (101) displays the UI (e.g., “Face not recognized”). In one embodiment, the user (501) may determine that user authentication has failed as the visual object (1535) is displayed within the FOV (550).

[0283] Accordingly, a method may be required to perform user authentication of an electronic device (101) even when multiple users (501, 502) wearing wearable devices (401, 402) are included in an image (1515) of the electronic device (101).

[0284] In one embodiment, when the electronic device (101) acquires an image (1515) including a plurality of users (501, 502) wearing a plurality of wearable devices (401, 402), the electronic device (101) may transmit a signal to the plurality of wearable devices (401, 402) requesting the output (or transmission) of a designated visual display (e.g., a quick response (QR) code, a lighting pattern, and / or a blinking pattern) in response to a user authentication request of the electronic device (101). In one embodiment, when the electronic device (101) acquires an image (1515) including a plurality of users (501, 502) wearing a plurality of wearable devices (401, 402), the electronic device (101) may transmit a signal to the plurality of wearable devices (401, 402) requesting the output (or transmission) of a visual display (e.g., a QR code, a lighting pattern, and / or a blinking pattern) corresponding to a user account registered in the electronic device (101).

[0285] In one embodiment, a plurality of wearable devices (401, 402) that receive a signal requesting the output (or transmission) of a visual display may display a visual display (e.g., a QR code, a lighting pattern) corresponding to a user account in a user information DB (445) through external displays. For example, referring to FIG. 15D , the wearable device (401) may display a visual display (1540) corresponding to a user account in the user information DB (445) through an external display (469).

[0286] In one embodiment, the electronic device (101) may identify a wearable device (401) among a plurality of wearable devices (401, 402) that outputs (or transmits) a designated visual indication (e.g., a QR code, a lighting pattern, and / or a blinking pattern) in response to a user authentication request of the electronic device (101).

[0287] In one embodiment, the electronic device (101) can identify the wearable device (401) included in the image as the wearable device (401) owned by the user (501) based on identifying the visual indication (1540) through another image acquired through the camera (480). In one embodiment, the electronic device (101) can identify the wearable device (401) to request user authentication based on identifying the visual indication (1540) through another image acquired through the camera (480). In one embodiment, the electronic device (101) can request authentication of the user (501) from the wearable device (401) that broadcasted the visual indication (1540) identified through another image acquired through the camera (480).

[0288] In one embodiment, the wearable device (401) can authenticate a user (501). In one embodiment, the wearable device (401) can authenticate a user (501) based on a user account of a user requested by the electronic device (101) among user accounts of multiple users registered in the user information DB (445).

[0289] In one embodiment, the wearable device (401) may transmit a user authentication result to the electronic device (101). In one embodiment, the wearable device (401) may transmit a user authentication result indicating whether a user corresponding to a user who has requested authentication to the electronic device (101) has worn the wearable device (401). In one embodiment, the wearable device (401) may transmit a user authentication result indicating whether user authentication for a user corresponding to a user who has requested authentication to the electronic device (101) has been successful.

[0290] In one embodiment, the electronic device (101) may perform a function based on the user authentication result. In one embodiment, the electronic device (101) may display a UI (e.g., 1535 of FIG. 15c) indicating that the user authentication has failed, based on the user authentication result indicating that the user authentication has failed.

[0291] In one embodiment, the electronic device (101) may perform a function indicated by an input that causes user authentication based on whether the user authentication result indicates successful user authentication. For example, the electronic device (101) may unlock the electronic device (101) based on whether the user authentication result indicates successful user authentication.

[0292] In one embodiment, referring to FIG. 15e, when the user authentication result indicates a successful user authentication, the electronic device (101) may generate a screen to be displayed on the wearable device (401) while the electronic device (101) displays a lock screen (1540) (or maintains a turned-off state) (or maintains a locked state) (or does not change the lock screen (1540)).

[0293] In one embodiment, referring to FIG. 15F, the wearable device (401) may display a screen (1550) of the electronic device (101) within the FOV (550) of the wearable device (401) based on data representing a screen transmitted from the electronic device (101). Accordingly, a user (501) of the wearable device (401) that outputs the screen (1550) generated by the electronic device (101) may see the screen (1550), whereas a user (502) of the wearable device (402) that takes a picture of the electronic device (101) that displays the lock screen (1540) may not see the screen (1550) generated by the electronic device (101).

[0294] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.

[0295] As described above, the electronic device (101) may include a camera (480), a communication circuit (490) for wireless connection with a wearable device (401), at least one processor (420) including a processing circuit; and a memory (430) storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive an input requesting user authentication based on an image (520) to be acquired through the camera (480). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to acquire an image (520) through the camera (480) in response to the input. The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the inclusion of another object (525) corresponding to the wearable device (401) that obscures an object (530) corresponding to the face of the user (501) in the image (520) acquired through the camera (480). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive, through the communication circuit (490), a result of the another user authentication for the user (501) from the wearable device (401).The above instructions, when executed individually or collectively by the at least one processor (420), may cause the electronic device (101) to determine whether to authenticate the user (501) based on the result of the other user authentication.

[0296] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request the wearable device (401) through the communication circuit (490) for the other user authentication based on the object (530) being obscured by the other object (525) in the image (520). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to perform the user authentication based on the image (520) based on the object (530) not being obscured by the other object (525) in the image (520).

[0297] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive, during a locked state of the electronic device (101), the input requesting the user authentication to unlock the locked state. The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to unlock the locked state based on determining that the authentication of the user (501) is successful based on the result of the other user authentication.

[0298] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive, during a locked state of the electronic device (101) with the display (460) turned off, the input requesting the user authentication to unlock the locked state. The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to transmit, through the communication circuit (490), the image frame generated by the electronic device (101) so as to be displayed through the display (465) of the wearable device (401) without turning on the display (460), based on determining that the authentication of the user (501) is successful.

[0299] The above instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the other object (525) corresponding to the wearable device (401) in the image (520) being directly facing the electronic device (101).

[0300] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to determine whether the object (530) is similar to a facial image of a user (501) of the electronic device (101) based on whether the other object (525) that obscures the object (525) is included in the image (520). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the determination that the object (530) is similar to the facial image above a threshold level.

[0301] The above instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to determine whether the object (525) is similar to the face image based on a portion (531, 535) of the object (530) that is not obscured by the other object (525) in the image (520).

[0302] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to identify a visual indication displayed through a display (469) disposed on the front of the wearable device (401) using another image acquired through the camera (480) based on whether another object (525) that obscures the object (530) is included in the image (520). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to determine, based on the visual indication, whether the wearable device (401) is a wearable device (401) owned by a user (501) of the electronic device (101). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the visual indication being determined to be a wearable device (401) owned by the user (501) of the electronic device (101).

[0303] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to query the wearable device (401) through the communication circuit (490) whether the gaze of a user (501) wearing the wearable device (401) is directed toward the electronic device (101), based on the other object (525) corresponding to the wearable device (401) in the image (520) being directed toward the electronic device (101). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive a response to the query from the wearable device (401) through the communication circuit (490). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request another user authentication for the user (501) through the communication circuit (490) based on the response indicating that the gaze of the user (501) wearing the wearable device (401) is directed toward the electronic device (101).

[0304] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to display a visual object (1420) indicating that the wearable device (401) is attempting user authentication through the display (460) based on the object (530) being obscured by the other object (525) in the image (520).

[0305] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to display, through the display (460), a visual indication representing the electronic device (101) based on the object (530) being obscured by the other object (525) in the image (520). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive, based on the visual indication, a signal from the wearable device (401) indicating that the user (501) of the electronic device (101) is the same user (501) wearing the wearable device (401). The above instructions, when executed individually or collectively by the at least one processor (420), may cause the electronic device (101) to request another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on receiving the signal.

[0306] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive identification information from at least one electronic device (101) in the vicinity of the electronic device (101) through the communication circuit (490) based on the object (530) being obscured by the other object (525) in the image (520). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to identify, based on the identification information, the wearable device (401) registered to the user account of the user (501) of the electronic device (101) among the at least one electronic device (101). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request a communication connection to the wearable device (401) registered to the user account through the communication circuit (490). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request another user authentication to the wearable device (401) connected to the communication through the communication circuit (490).

[0307] As described above, the method may be performed by an electronic device (101) including a camera (480) and a communication circuit (490) for wireless connection with a wearable device (401). The method may include an operation of receiving an input requesting user authentication based on an image (520) to be acquired through the camera (480). The method may include an operation of acquiring the image (520) through the camera (480) in response to the input. The method may include an operation of requesting another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the inclusion of another object (525) corresponding to the wearable device (401) that obscures an object (530) corresponding to the face of the user (501) in the image (520) acquired through the camera (480). The method may include an operation of receiving the result of another user authentication for the user (501) from the wearable device (401) via the communication circuit (490). The method may include an operation of determining whether to authenticate the user (501) based on the result of the other user authentication.

[0308] The method may include an operation of requesting the wearable device (401) to authenticate another user through the communication circuit (490) based on whether the object (530) in the image (520) is obscured by the other object (525). The method may include an operation of performing the user authentication based on the image (520) based on whether the object (530) in the image (520) is not obscured by the other object (525).

[0309] The method may include an operation of receiving, during a locked state of the electronic device (101), an input requesting the user authentication for unlocking the locked state. The method may include an operation of unlocking the locked state based on the result of the other user authentication determining that the authentication of the user (501) is successful.

[0310] The method may include an operation of receiving an input requesting user authentication to unlock the locked state of the electronic device (101) while the display (460) of the electronic device (101) is turned off. The method may include an operation of transmitting an image frame generated by the electronic device (101) through the communication circuit (490) so that the image frame is displayed through the display (465) of the wearable device (401) without turning on the display (460) based on determining that the authentication of the user (501) is successful.

[0311] The method may include an operation of requesting another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the other object (525) corresponding to the wearable device (401) in the image (520) being directly directed toward the electronic device (101).

[0312] The method may include an operation of determining whether the object (530) is similar to a facial image of a user (501) of the electronic device (101) based on whether the other object (525) that obscures the object (530) is included in the image (520). The method may include an operation of requesting another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the object (530) being determined to be similar to the facial image above a threshold level.

[0313] The method may include an operation of receiving identification information from at least one electronic device (101) surrounding the electronic device (101) through the communication circuit (490) based on the object (530) being covered by the other object (525) in the image (520). The method may include an operation of identifying, based on the identification information, the wearable device (401) registered in the user account of the user (501) of the electronic device (101) among the at least one electronic device (101). The method may include an operation of requesting a communication connection to the wearable device (401) registered in the user account through the communication circuit (490). The method may include an operation of requesting another user authentication to the wearable device (401) connected to the communication through the communication circuit (490).

[0314] As described above, a non-transitory computer readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by at least one processor (420) of an electronic device (101) including a camera (480) and a communication circuit (490) for wireless connection with a wearable device (401), can cause the electronic device (101) to receive an input requesting user authentication based on an image (520) to be acquired through the camera (480). The instructions, when individually or collectively executed by the at least one processor (420), can cause the electronic device (101) to acquire an image (520) through the camera (480) in response to the input. The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to request another user authentication for the user (501) from the wearable device (401) through the communication circuit (490) based on the inclusion of another object (525) corresponding to the wearable device (401) that obscures an object (530) corresponding to the face of the user (501) in the image (520) acquired through the camera (480). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to receive, through the communication circuit (490), a result of the another user authentication for the user (501) from the wearable device (401).The above instructions, when executed individually or collectively by the at least one processor (420), may cause the electronic device (101) to determine whether to authenticate the user (501) based on the result of the other user authentication.

[0315] As described above, the electronic device (101) may include a camera (480), a communication circuit (490), a memory (430) for storing instructions, and at least one processor (420). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to detect an event related to user authentication via the electronic device (101). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to determine, in relation to the event, whether a wearable device (401) is worn on the face of the user (501). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to transmit, through the communication circuit (490), a request to the wearable device (401) to authenticate the user (501) based on determining that the wearable device (401) is worn on the face of the user (501). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to provide specified content based on information received from the wearable device (401) indicating that the user (501) has been authenticated.

[0316] The above instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to determine, based on an image (520) of the user (501) acquired through the camera (480), whether the wearable device (401) is worn so as to obscure the eyes of the user (501).

[0317] The image (520) may be captured to release at least one function of the electronic device (101) from a restricted state through facial recognition. The request may be transmitted based on a determination that the facial recognition has failed.

[0318] Information indicating that the user (501) has been authenticated may be received based at least in part on the success of iris recognition via the wearable device (401).

[0319] Information indicating that the user (501) has been authenticated may be received based on the iris recognition performed after the request is transmitted.

[0320] Information indicating that the user (501) has been authenticated may be received based on the iris recognition performed before the request is transmitted and a determination that the user (501) has maintained wearing the wearable device (401) after the iris recognition.

[0321] Information indicating that the user (501) has been authenticated may be received based on a determination that the relative position of the electronic device (101) to the wearable device (401) is a designated position.

[0322] The above instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to display graphical information, through the display (460) of the electronic device (101), that can be used to connect the electronic device (101) via the communication circuit (490), based on a determination that the wearable device (401) is not connected to the electronic device (101).

[0323] The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to transmit the content to the wearable device (401) such that at least a portion of the designated content may be provided through a user interface of the wearable device (401) based on information indicating that the user (501) has been authenticated.

[0324] The above instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to stop providing the specified content if the wearable device (401) moves away from the electronic device (101) by a certain distance or more after providing the specified content.

[0325] As described above, the method may be performed by an electronic device (101) including a camera (480) and a communication circuit (490). The method may include an operation of detecting an event related to user authentication via the electronic device (101). The method may include an operation of determining, in relation to the event, whether a wearable device (401) is worn on the face of a user (501). Based on determining that the wearable device (401) is worn on the face of the user (501), the method may include an operation of transmitting, via the communication circuit (490), a request to the wearable device (401) to authenticate the user (501). The method may include an operation of providing specified content based on information received from the wearable device (401) indicating that the user (501) has been authenticated.

[0326] The method may include, as at least part of the verification, an operation of verifying whether the wearable device (401) is worn so as to cover the eyes of the user (501), based on an image (520) of the user (501) obtained through the camera (480).

[0327] The method may include an operation of displaying graphic information that can be used to connect the electronic device (101) through the communication circuit (490) via a display (460) of the electronic device (101) based on a determination that the wearable device (401) is not connected to the electronic device (101).

[0328] The method may include transmitting the designated content to the wearable device (401) so that at least a portion of the designated content can be provided through a user interface of the wearable device (401) based on information indicating that the user (501) has been authenticated.

[0329] The method may include an operation of identifying a distance between the wearable device (401) and the electronic device (101) during at least a portion of the time during which the specified content is provided. The method may include an operation of stopping the provision of the specified content based on a determination that the distance between the wearable device (401) and the electronic device (101) satisfies a specified condition.

[0330] As described above, a non-transitory computer readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by at least one processor (420) of an electronic device (101) including a camera (480) and a communication circuit (490), can cause the electronic device (101) to detect an event related to user authentication via the electronic device (101). The instructions, when individually or collectively executed by the at least one processor (420), can cause the electronic device (101) to determine, in relation to the event, whether a wearable device (401) is worn on the face of a user (501). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to transmit, through the communication circuit (490), a request to the wearable device (401) to authenticate the user (501) based on determining that the wearable device (401) is worn on the face of the user (501). The instructions, when individually or collectively executed by the at least one processor (420), may cause the electronic device (101) to provide specified content based on information received from the wearable device (401) indicating that the user (501) has been authenticated.

[0331] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.

[0332] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0333] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0334] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0335] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0336] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0337] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), Camera (480), Communication circuit (490) for wireless connection with a wearable device (401); At least one processor (420) comprising a processing circuit; and A memory (430) storing instructions and including one or more storage media, wherein the instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Receive an input requesting user authentication based on an image (520) acquired through the above camera (480), In response to the above input, an image (520) is acquired through the camera (480), Based on the fact that another object (525) corresponding to the wearable device (401) that covers the object (530) corresponding to the face of the user (501) in the image (520) acquired through the camera (480) is included, another user authentication for the user (501) is requested to the wearable device (401) through the communication circuit (490), Through the above communication circuit (490), the result of the other user authentication for the user (501) is received from the wearable device (401), Based on the above results of the above other user authentication, causing a decision to be made as to whether or not the user (501) is authenticated. Electronic devices.

2. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Based on the fact that the object (530) in the image (520) is covered by the other object (525), the wearable device (401) is requested to authenticate the other user through the communication circuit (490). Based on the fact that the object (530) in the image (520) is not covered by the other object (525), causing the user authentication based on the image (520) to be performed, Electronic devices.

3. In claim 1 or claim 2, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: During the locked state of the electronic device (101), receiving the input requesting the user authentication to unlock the locked state, Based on the result of the above other user authentication, it is determined that the above authentication of the user (501) is successful, causing the above lock state to be released. Electronic devices.

4. In claim 3, including a display (460), The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: While the electronic device (101) is in a locked state with the display (460) turned off, the input requesting the user authentication to unlock the locked state is received, Based on the determination that the authentication of the user (501) is successful, causing the image frame generated by the electronic device (101) to be displayed through the display (465) of the wearable device (401) without turning on the display (460), to be transmitted through the communication circuit (490). Electronic devices.

5. In any one of claims 1 to 4, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Based on the fact that the other object (525) corresponding to the wearable device (401) in the image (520) is directly facing the electronic device (101), causing the wearable device (401) to request another user authentication for the user (501) through the communication circuit (490). Electronic devices.

6. In any one of claims 1 to 5, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Based on the fact that the other object (525) that obscures the object (530) is included in the image (520), it is determined whether the object (530) is similar to a facial image of a user (501) of the electronic device (101), Based on the determination that the object (530) is similar to the face image by a threshold level or more, causing the wearable device (401) to request another user authentication for the user (501) through the communication circuit (490). Electronic devices.

7. In claim 6, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Based on a part (531, 535) of the object (530) that is not covered by the other object (525) in the image (520), causing it to be determined whether the object (530) is similar to the face image. Electronic devices.

8. In any one of claims 1 to 7, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Based on the fact that the other object (525) that obscures the object (530) is included in the image (520), using another image acquired through the camera (480), a visual indication displayed through the display (469) arranged on the front of the wearable device (401) is identified, Based on the above visual display, it is determined whether the wearable device (401) is a wearable device (401) owned by the user (501) of the electronic device (101), Based on the above visual indication, it is determined that the wearable device (401) is owned by the user (501) of the electronic device (101), and causes the wearable device (401) to request another user authentication for the user (501) through the communication circuit (490). Electronic devices.

9. In any one of claims 1 to 8, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Based on the fact that the other object (525) corresponding to the wearable device (401) in the image (520) is directly facing the electronic device (101), the wearable device (401) is asked through the communication circuit (490) whether the gaze of the user (501) wearing the wearable device (401) is directed toward the electronic device (101). Receive a response to a query from the wearable device (401) through the communication circuit (490), Based on the above response indicating that the gaze of the user (501) wearing the wearable device (401) is directed toward the electronic device (101), causing the wearable device (401) to request another user authentication for the user (501) through the communication circuit (490). Electronic devices.

10. A method of an electronic device (101) including a communication circuit (490) for wireless connection with a camera (480) and a wearable device (401), An action of receiving an input requesting user authentication based on an image (520) acquired through the above camera (480); In response to the above input, an operation of acquiring an image (520) through the camera (480); An operation of requesting another user authentication for the user (501) to the wearable device (401) through the communication circuit (490) based on the fact that another object (525) corresponding to the wearable device (401) is included that covers the object (530) corresponding to the face of the user (501) in the image (520) acquired through the camera (480). An operation of receiving the result of another user authentication for the user (501) from the wearable device (401) through the communication circuit (490), and Based on the above result of the other user authentication, including an action of determining whether the user (501) is authenticated. method.

11. In the electronic device (101), Camera (480), Communication circuit (490), Memory (430) for storing instructions, and comprising at least one processor (420), The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: Detecting an event related to user authentication through the above electronic device (101), In relation to the above event, it is checked whether the wearable device (401) is worn on the face of the user (501), Based on determining that the wearable device (401) is worn on the face of the user (501), a request for authentication of the user (501) is transmitted to the wearable device (401) through the communication circuit (490), and Causing to provide specified content based on information received from the wearable device (401) indicating that the user (501) has been authenticated. Electronic devices.

12. In claim 11, The above instructions, when individually or collectively executed by the at least one processor (420), cause the electronic device (101) to: As at least part of the above verification, based on an image (520) of the user (501) acquired through the camera (480), causing the wearable device (401) to be checked whether the user (501) is worn so as to cover the eyes. Electronic devices.

13. In claim 12, The above image (520) is captured to release at least one function of the electronic device (101) from a restricted state through facial recognition, The above request is sent based on a determination that the above facial recognition has failed. Electronic devices.

14. In any one of claims 11 to 13, Information indicating that the user (501) has been authenticated is received based at least in part on the success of iris recognition via the wearable device (401). Electronic devices.

15. In claim 14, Information indicating that the user (501) has been authenticated is received based on the iris recognition performed after the request is transmitted. Electronic devices.

Images