Electronic device, method, and non-transitory computer readable storage medium to perform user authentication based on gesture

Abstract

The electronic device may include a memory for storing instructions, a communication circuit, one or more sensors, and at least one processor. The at least one processor may cause the electronic device to identify a first gesture through one or more sensors while a communication link between the electronic device and an external electronic device is established using the communication circuit, execute a mode for performing user authentication based on a determination that the first gesture is a defined gesture, acquire data through one or more sensors that is expressed by a part of the user associated with the electronic device and represents a characteristic of a second gesture following the first gesture, and transmit a signal indicating the success of user authentication to the external electronic device through the communication link using the communication circuit based on a determination that the difference between the reference data representing a characteristic of the reference gesture and the data is within a reference range.

Description

Technology Field

[0001] The present disclosure relates to an electronic device, a method, and a non-transient computer-readable storage medium for performing user authentication based on gestures. Background Technology

[0002] An electronic device may be used to perform payment. The electronic device may perform user authentication to perform payment. To perform user authentication using biometric information, the electronic device may include a first sensor for fingerprint recognition and / or a second sensor for iris recognition. Based on receiving user input for performing user authentication, the electronic device may perform user authentication using the user's biometric information through the first sensor and / or the second sensor. For example, the electronic device may be used to provide services such as payment based on the user authentication.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure.

[0004] No claim or determination is made as to whether any of the foregoing can be applied as prior art related to the present disclosure. means of solving the problem

[0005] An electronic device is described. The electronic device may include a memory comprising one or more storage media for storing instructions. The electronic device may include a communication circuit. The electronic device may include one or more sensors. The electronic device may include at least one processor comprising a processing circuit. The instructions may cause the electronic device to identify a first gesture through the one or more sensors while a communication link between the electronic device and an external electronic device is established using the communication circuit when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to execute a mode for performing user authentication based on a determination that the first gesture is a defined gesture when executed individually or collectively by the at least one processor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire, through the one or more sensors, data representing the characteristics of a second gesture following a first gesture, which is expressed by a part of the user associated with the electronic device when the mode is executed. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to transmit a signal indicating the success of the user authentication to the external electronic device via the communication link using the communication circuit, based on a determination that the difference between the reference data representing the characteristics of a reference gesture and the data is within a reference range.

[0006] A method is provided. The method may be executed within an electronic device having a communication circuit and one or more sensors. The method may include an operation of identifying a first gesture through the one or more sensors while a communication link between the electronic device and an external electronic device is established using the communication circuit. The method may include an operation of executing a mode for performing user authentication based on a determination that the first gesture is a defined gesture. The method may include, when executing the mode, an operation of obtaining data through the one or more sensors that is expressed by a part of the user associated with the electronic device and represents the characteristics of a second gesture following the first gesture. The method may include an operation of transmitting a signal indicating the success of user authentication to the external electronic device via the communication link using the communication circuit, based on a determination that the difference between the reference data representing the characteristics of a reference gesture and the data is within a reference range.

[0007] A non-transient computer-readable storage medium is provided. The non-transient computer-readable storage medium may store one or more programs. The one or more programs may include instructions that cause the electronic device to identify a first gesture through the one or more sensors while a communication link between the electronic device and an external electronic device is established using the communication circuit when executed by the electronic device having a communication circuit and one or more sensors. The one or more programs may include instructions that cause the electronic device to execute a mode for performing user authentication based on a determination that the first gesture is a defined gesture when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to obtain, through the one or more sensors, data representing a feature of a second gesture following the first gesture, which is expressed by a part of the user associated with the electronic device and when the mode is executed when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to transmit a signal indicating the success of the user authentication to the external electronic device via the communication link using the communication circuit, based on a determination that the difference between the reference data representing the characteristics of the reference gesture and the data is within a reference range when executed by the electronic device. Brief explanation of the drawing

[0008] Figure 1 illustrates an example of an electronic device that performs user authentication for payment. Figure 2 is a simplified block diagram of an exemplary electronic device. Figure 3 is a flowchart illustrating the operation of an electronic device that performs user authentication based on the identification of gestures. FIG. 4 illustrates examples of operations performed within an electronic device and a first external electronic device. FIG. 5 illustrates an exemplary operation of an electronic device that determines reference axes in vector space based on gestures. FIG. 6 illustrates an exemplary operation of an electronic device for acquiring data representing the characteristics of a gesture. FIG. 7 illustrates an exemplary operation of an electronic device that changes the size of an image to match an image. FIG. 8 illustrates an exemplary operation of an electronic device that identifies a gesture to control an external electronic device. FIG. 9 illustrates examples of operations performed within an electronic device and a first external electronic device to perform payment. FIG. 10 illustrates examples of operations performed within an electronic device and a first external electronic device to acquire reference data. FIG. 11 illustrates an exemplary operation of a first external electronic device displaying a visual indication to guide a gesture. FIG. 12 is a flowchart illustrating the operation of an electronic device that deletes reference data used to perform user authentication. FIG. 13 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 14a shows a perspective view of an exemplary electronic device according to one embodiment. FIG. 14b is an example of a partial cross-sectional view of an electronic device according to one embodiment. Specific details for implementing the invention

[0009] Figure 1 illustrates an example of an electronic device that performs user authentication for payment.

[0010] Referring to FIG. 1, the environment (150) may include a user (120), a user (140), and an electronic device (100). The user (120) may attempt to make a payment using the electronic device (100). The electronic device (100) may be used to perform user authentication before making a payment. The electronic device (100) may include a smart ring. However, embodiments of the present disclosure are not limited thereto. For example, the electronic device (100) may include a stylus pen.

[0011] The electronic device (100) may include a near field communication (NFC) circuit (e.g., the NFC circuit (216) of FIG. 2). The electronic device (100) may perform a service provided through user authentication using the NFC circuit. For example, the service may include a service for performing payment using the electronic device (100). The electronic device (100) may perform the service by using the NFC circuit to transmit information about the credit card of the user (120) of the electronic device (100) to an external electronic device (160) that is in contact (or tagged) with the electronic device (100). For example, since the service requires the use of privacy information such as information about the credit card of the electronic device (100), the service may be provided through user authentication.

[0012] The electronic device (100) can perform user authentication using biometric information. For example, the electronic device (100) may include one of a sensor for iris recognition, a sensor for fingerprint recognition, and a sensor for face recognition. The electronic device (100) can determine whether a user (120) is a legitimate user of the electronic device (100) by using one of the sensor for iris recognition, a sensor for fingerprint recognition, and a sensor for face recognition. For example, the electronic device (100) can perform user authentication through one of the sensor for iris recognition, a sensor for fingerprint recognition, and a sensor for face recognition.

[0013] The electronic device (100) may be worn on a part of the body (e.g., a finger). For example, the electronic device (100) may be required to be miniaturized so that it can be worn by a user (120). For example, if at least one of a sensor for iris recognition, a sensor for fingerprint recognition, and a sensor for face recognition is included in the electronic device (100), it may be difficult to miniaturize the electronic device (100) due to the size of said at least one. For example, the electronic device (100) may be required to maintain a small size and / or light weight. For example, the electronic device (100) may be required to perform user authentication while maintaining a small size and / or light weight.

[0014] The electronic device (100) can acquire feature data corresponding to a gesture expressed through a part (e.g., a finger) of the user (120) wearing the electronic device (100) through one or more sensors (e.g., one or more sensors (212) of FIG. 2). For example, the electronic device (100) can identify the difference between the acquired feature data and reference data stored within a security element (e.g., security element (214) of FIG. 2). For example, the feature data may be described as data in which the features of the gesture are represented as vectors. For example, the feature data may be described as data that represents features (e.g., handwriting) that differ from person to person to represent the same character, rather than features for distinguishing one character (a) from another character. For example, the reference data may be described as data for determining the validity of user authentication that was acquired before the feature data was acquired. For example, the reference data may be described as data in which the features of the reference gesture are represented as vectors. The electronic device (100) can determine the success of the user authentication based on the determination that the difference is within a reference range.

[0015] For example, the electronic device (100) may include hardware components used to perform or execute the above operations. The hardware components are described and illustrated with reference to FIG. 2.

[0016] Figure 2 is a simplified block diagram of an exemplary electronic device.

[0017] Referring to FIG. 2, the electronic device (100) may include a communication circuit (205), one or more sensors (212), a security element (214), at least one processor (207), and a memory (206).

[0018] At least one processor (207) may include a hardware component for processing data using instructions stored in memory (206). The hardware component for processing data may include a CPU (central processing unit) (e.g., including processing circuits). The hardware component for processing data may include a GPU (graphic processing unit) (e.g., including processing circuits). The hardware component for processing data may include a DPU (display processing unit) (e.g., including processing circuits). The hardware component for processing data may include a NPU (neural processing unit) (e.g., including processing circuits).

[0019] At least one processor (207) may include one or more cores. For example, at least one processor (207) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.

[0020] Memory (206) may include a hardware component for storing data and / or instructions that are input to and / or output from at least one processor (207). Memory (206) may include, for example, volatile memory such as RAM (random-access memory) and / or non-volatile memory such as ROM (read-only memory). Volatile memory may include, for example, at least one of DRAM (dynamic RAM), SRAM (static RAM), cache RAM, and PSRAM (pseudo SRAM). Non-volatile memory may include, for example, at least one of PROM (programmable ROM), EPROM (erasable PROM), EEPROM (electrically erasable PROM), flash memory, hard disk, compact disk, and EMMC (embedded multimedia card).

[0021] The communication circuit (205) may include hardware components to support the transmission and / or reception of signals between the electronic device (100) and an external electronic device. The communication circuit (205) may include, for example, at least one of a modem, an antenna, and an O / E (optic / electronic) converter. The communication circuit (205) may support the transmission and / or reception of signals based on various types of protocols such as Ethernet, LAN (local area network), WAN (wide area network), WiFi (wireless fidelity), Bluetooth, BLE (Bluetooth low energy), Zigbee, LTE (long term evolution), and 5G NR (new radio).

[0022] The NFC circuit (216) may be configured to perform NFC. For example, NFC may be described as a wireless communication technology that enables two devices to recognize each other and exchange data in a band of about 13.56 MHz (e.g., from about 13.56 MHz to 13.57 MHz). For example, the NFC circuit (216) may be configured to receive a signal (or data) from an external electronic device or to transmit a signal (or data) to an external electronic device.

[0023] One or more sensors (212) may be used to identify movement (e.g., change of position and / or rotation) of the electronic device (100). One or more sensors (212) may be used to identify whether the electronic device (100) is being gripped or worn by a user (120). For example, one or more sensors (212) may include at least one of an accelerometer, a gyroscope, a geomagnetic sensor, a temperature sensor, and a PPG (photoplethysmogram) sensor.

[0024] The security element (214) may be used to perform user authentication. For example, when performing user authentication using a gesture, the security element (214) may store reference data representing a reference gesture. Data stored within the security element (214) may not be transmitted to an external electronic device for security purposes. The security element (214) may be used to manage personal information (e.g., eSIM (embedded subscriber identity module)). For example, the security element (214) may be included in at least one processor (207) or NFC circuit (216). However, it is not limited thereto. For example, the security element (214) may be composed of a circuit distinct from at least one processor (207) or NFC circuit (216).

[0025] At least one processor (207) can identify a first gesture through one or more sensors (212) while a communication link between the electronic device (100) and the first external electronic device (400) is established using a communication circuit (205). At least one processor (207) can execute a second mode for performing user authentication based on the determination that the first gesture is a first defined gesture. When executing the second mode, at least one processor (207) can obtain feature data through one or more sensors (212) that is expressed by a part of the user (120) associated with the electronic device (100) and indicates the features of a second gesture following the first gesture. At least one processor (207) can transmit a signal indicating the success of user authentication to a first external electronic device (400) via a communication link using a communication circuit (205), based on a determination that the difference between reference data and feature data representing the features of a reference gesture is within a reference range, which is stored within a security element (214).

[0026] FIG. 3 is a flowchart illustrating the operation of an electronic device that performs user authentication based on the identification of a gesture. This method may be executed by the electronic device (100) illustrated in FIG. 2 or by at least one processor (207) of the electronic device (100).

[0027] Referring to FIG. 3, in operation 310, the electronic device (100) can identify the first gesture through one or more sensors (212) while a communication link is established between the electronic device (100) and the first external electronic device (e.g., the first external electronic device (400) of FIG. 4) using the communication circuit (205). The electronic device (100) can identify the first gesture through one or more sensors (212) when a communication link is established between the electronic device (100) and the first external electronic device (e.g., the first external electronic device (400) of FIG. 4) using the communication circuit (205). For example, the electronic device (100) can establish a communication link between the electronic device (100) and the first external electronic device (e.g., the first external electronic device (400) of FIG. 4) using the communication circuit (205). For example, the establishment of the communication link may be described as pairing between the electronic device (100) and the first external electronic device. The electronic device (100) may identify the first gesture through one or more sensors (212). For example, the electronic device (100) may identify the first gesture through an accelerometer included in one or more sensors (212).

[0028] In operation 320, the electronic device (100) may execute a mode for performing user authentication based on the determination that the first gesture is the first defined gesture. For example, when the electronic device (100) identifies the first gesture through one or more sensors (212), it may obtain sensor data representing the first gesture. For example, the electronic device (100) may use the sensor data to determine whether the first gesture is the first defined gesture (e.g., double tap, triple tap, double pinch). For example, executing a mode may include changing or switching the mode. For example, the electronic device (100) may change or switch the mode of the electronic device (100) from the first mode (e.g., low power mode) to the second mode (e.g., authentication mode) based on the determination that the first gesture is the first defined gesture. For example, the first mode may be described as a mode for low power consumption. For example, the first mode may be referred to as a low-power mode or a power-saving mode. For example, the second mode may be referred to as a mode for user authentication, an authentication mode, or a payment mode.

[0029] According to one embodiment, a first portion of one or more sensors (212) may be turned on in a first mode, and a second portion different from the first portion may be turned off in the first mode. For example, since the first mode is a mode for reducing power consumption within the electronic device (100), some of the sensors included in the one or more sensors (212) may be turned off in the first mode. For example, among the one or more sensors (212), the sensor turned on in the first mode may be used to identify a gesture. For example, among the one or more sensors (212), the accelerometer may be turned on in the first mode and the second mode to identify a gesture. For example, the gyroscope and geomagnetic sensors included in the one or more sensors (212) may be turned off in the first mode and turned on in the second mode. However, they are not limited thereto.

[0030] In operation 330, when the electronic device (100) executes the second mode, it may acquire feature data through one or more sensors (212) that represents the features of a second gesture (e.g., second gesture (525) of FIG. 5) following a first gesture, which is expressed by a part (e.g., finger) of the user (120) associated with the electronic device (100). For example, the electronic device (100) may identify the second gesture through one or more sensors (212) while being worn on a part of the user (120). For example, the second gesture may be different from the first gesture and may be described as a gesture identified after the first gesture. For example, the feature data may be described as data that represents the features of the second gesture and is expressed as a vector. For example, the second gesture may be described as an air gesture (or signature gesture) expressed by a part of a user (120) wearing an electronic device (100) to perform user authentication. For example, feature data may be described as a vector representing the features of the second gesture in a vector space. For example, the features of the second gesture may include a change in the vector exceeding a threshold value. For example, the features of the second gesture may include a change in the direction of the second gesture. For example, the features of the second gesture may include corner points of the signature gesture. The acquisition of the feature data will be described later with reference to FIG. 6.

[0031] In operation 340, the electronic device (100) may transmit a signal indicating the success of user authentication to the first external electronic device (400) via a communication link using a communication circuit (205), based on the determination that the difference between the reference data and the feature data stored within the security element (214) is within a reference range. For example, the electronic device (100) may identify the difference between the feature data and the reference data based on acquiring the feature data. For example, the reference data may be described as data representing the features of a signature gesture that serves as a reference for performing user authentication as a vector. For example, the reference data may be acquired before identifying the second gesture and may be stored within the security element (214). For example, the reference data may be acquired before identifying the second gesture to perform user authentication and may represent vectors corresponding to the reference gesture expressed by a part of the user (120). For example, the reference range may be changed or determined based on user input. For example, the electronic device (100) can control the security level related to user authentication by controlling the reference range. For example, in the case of a second reference range that is wider than the first reference range, the security level according to the first reference range may be higher than the security level according to the second reference range.

[0032] For example, the electronic device (100) can identify the difference between vectors represented by reference data and vectors represented by feature data. For example, the electronic device (100) can determine that a second gesture corresponding to the feature data matches a reference gesture corresponding to the reference data based on the determination that the difference is within a reference range. For example, the electronic device (100) can determine the success of user authentication based on the determination. The reference range may be changed based on user input. For example, the electronic device (100) can transmit a signal indicating the success to a first external electronic device (e.g., the first external electronic device (400) of FIG. 4) via a communication link using a communication circuit (205).

[0033] The electronic device (100) can identify similarity between reference data and feature data. For example, the reference data and feature data each may represent a vector table. For example, the vector table may represent a change value of the vector according to a distinguished gesture and the time at which the distinguished gesture was identified. For example, the electronic device (100) may determine that the feature data is (substantially) identical to the reference data based on the determination that the similarity between the reference data and the feature data is less than a threshold similarity.

[0034] According to one embodiment, the electronic device (100) can perform user authentication using an artificial intelligence model. For example, the artificial intelligence model can learn a repeating pattern when identifying a gesture (e.g., the second gesture (525) of FIG. 5). For example, since the electronic device (100) performs user authentication through the artificial intelligence model, the accuracy of user authentication can be improved and the time required to perform user authentication can be reduced.

[0035] The electronic device (100) can identify a first gesture before identifying a second gesture. The electronic device (100) can determine whether the identified first gesture is a first definition gesture. For example, the electronic device (100) can change the mode of the electronic device (100) from a first mode to a third mode based on the determination that the first gesture is a second definition gesture. For example, the third mode may be described as a mode for controlling an external electronic device. For example, the execution of the third mode is described and illustrated in more detail with reference to FIG. 4.

[0036] FIG. 4 illustrates examples of operations performed within an electronic device and a first external electronic device.

[0037] Referring to FIG. 4, the electronic device (100) may be tagged (or contacted) with an external electronic device (e.g., the external electronic device (160) of FIG. 1) to perform services provided through user authentication via a near-field communication method (e.g., NFC method or MST (magnetic secure transmission) method). For example, the services provided through user authentication may include an electronic wallet service provided based on linkage with the external electronic device, a service of performing payment using the electronic device (100) by providing information about the user's credit card to the external electronic device, a service of opening the gate of a secure area using the electronic device (100) by providing the user's identification information to the external electronic device, a service of opening the door of the vehicle or starting the engine of the vehicle using the electronic device (100) by providing the user's vehicle information to the external electronic device, or a service of performing a bank transfer using the electronic device (100) by providing information about the user's account to the external electronic device. However, it is not limited thereto.

[0038] At least one processor (207) can detect an external magnetic field using an NFC circuit (216) (or an MST circuit (not shown)) based on an external electronic device tagged (or in contact) with the electronic device (100). For example, the service may be provided by the electronic device (100) emitting information for the service externally (or transmitting it to the external electronic device) using the NFC circuit (216). For example, since the service requires the use of privacy information such as information about the credit card, identification information, vehicle information, or account information, the service may be provided through user authentication. For example, the user authentication may be performed using reference data stored within a security element (214).

[0039] In operation 410, the electronic device (100) can establish a communication link between the electronic device (100) and the first external electronic device (400) using a communication circuit (205). The communication link between the electronic device (100) and the first external electronic device (400) can be described as a communication link for direct wireless communication. For example, at least one processor (not shown) of the first external electronic device (400) can advertise (or broadcast) an advertising packet using a communication circuit (not shown). At least one processor (207) can receive the advertised (or broadcast) advertising packet from the first external electronic device (400) using a communication circuit (205). At least one processor (207) may transmit a connection request to the first external electronic device (400) using a communication circuit (205) based on receiving an advertising packet. At least one processor included in the first external electronic device (400) may receive a connection request from the electronic device (100) using a communication circuit included in the first external electronic device (400). At least one processor included in the first external electronic device (400) may establish the communication link using a communication circuit included in the first external electronic device (400) based on receiving a connection request from the electronic device (100). At least one processor (207) may establish the communication link using a communication circuit (205) based on transmitting a connection request. For example, at least one processor (207) may perform the following operations (e.g., operations 320 to 480) while the communication link is established.

[0040] In operation 420, the electronic device (100) can identify the first gesture through one or more sensors (212) after establishing a communication link. For example, the electronic device (100) can identify the first gesture while executing the first mode.

[0041] In operation 430, the electronic device (100) may execute operation 440 based on a determination that the first gesture is a first defined gesture (e.g., double tap, triple tap, double pinch), and may execute operation 450 based on a determination that the first gesture is not a first defined gesture. For example, the electronic device (100) may identify whether the first gesture is a first defined gesture by using first sensor data corresponding to the first gesture obtained when identifying the first gesture. For example, when executing the first mode, the electronic device (100) may identify whether the first gesture is a first defined gesture by using an accelerometer included in one or more sensors (212) to identify the first gesture.

[0042] In operation 440, the electronic device (100) may execute a second mode for performing user authentication based on the determination that the first gesture is the first defined gesture. For example, the electronic device (100) may change the mode of the electronic device (100) from the first mode to the second mode based on the determination that the first gesture is the first defined gesture.

[0043] In operation 450, the electronic device (100) may execute a third mode for controlling an external electronic device (e.g., the second external electronic device (810) of FIG. 8) based on a determination that the first gesture is not the first defined gesture. For example, the electronic device (100) may execute a third mode for controlling an external electronic device (e.g., the second external electronic device (810) of FIG. 8) based on a determination that the first gesture is the second defined gesture (e.g., a single tap gesture). For example, the electronic device (100) may change or switch the mode of the electronic device (100) from the first mode to the third mode based on a determination that the first gesture is the second defined gesture. For example, the electronic device (100) may execute a third mode for controlling a plurality of external electronic devices (e.g., the second external electronic device (810) of FIG. 8) based on identifying the second defined gesture. The operation of controlling an external electronic device (e.g., the second external electronic device (810) of FIG. 8) when executing the third mode will be described later with reference to FIG. 8.

[0044] In operation 460, when the electronic device (100) executes the second mode, it can acquire data representing the characteristics of the second gesture following the first gesture. For example, when the electronic device (100) identifies the second gesture through one or more sensors (212), it can acquire feature data representing the characteristics of the second gesture. For example, the feature data may be determined according to a relatively large displacement among the vectors acquired when identifying the second gesture. For example, operation 460 of FIG. 4 may correspond to operation 330 of FIG. 3.

[0045] In operation 470, based on acquiring feature data, the electronic device (100) can identify the difference between reference data and feature data. For example, the electronic device (100) can identify the difference between reference data and feature data stored within a security element (214). For example, the electronic device (100) can identify whether the difference is within a reference range. For example, the reference range may be changed based on user input.

[0046] In operation 480, the electronic device (100) may transmit a first signal indicating success of user authentication to a first external electronic device (400) via a communication link established in operation 410 using a communication circuit (205), based on a determination that the difference between reference data and feature data is within a reference range. For example, the first external electronic device (400) may provide a service (e.g., payment) based on the success of user authentication upon receiving the first signal. For example, operation 480 of FIG. 4 may correspond to operation 340 of FIG. 3.

[0047] The electronic device (100) can identify a third definition gesture for determining reference axes of feature data through one or more sensors (212) before identifying a second gesture. For example, the electronic device (100) can determine reference axes for defining feature data using sensor data representing the third definition gesture based on identifying the third definition gesture. For example, the operation of defining reference axes using the third definition gesture is described and illustrated in more detail with reference to FIG. 5.

[0048] FIG. 5 illustrates an exemplary operation of an electronic device that determines reference axes in vector space based on gestures.

[0049] Referring to FIG. 5, the state (510) may be described as a state for identifying a third definition gesture. For example, the electronic device (100) may identify a third definition gesture for defining or determining reference axes in a vector space through one or more sensors (212) before acquiring feature data representing the features of a second gesture. For example, the electronic device (100) worn on a part (e.g., a finger) of the user (120) may identify gestures (502, 504) included in the third definition gesture. For example, the third definition gesture may be described as a gesture for defining reference axes. For example, the third definition gesture may include a square-shaped gesture. For example, the third definition gesture may include a continuous air gesture representing a square. However, it is not limited thereto.

[0050] State (520) may be described as a state in which a second gesture (525) is identified within a third definition gesture. For example, the electronic device (100) may determine or define reference axes (e.g., x-axis, y-axis, and z-axis) in a vector space based on identifying a third definition gesture that includes gestures (502, 504, 506, 508). For example, when identifying the third definition gesture, the electronic device (100) may determine the y-axis according to the first identified gesture (502). For example, when identifying the third definition gesture, the electronic device (100) may determine the x-axis according to the gesture (504) that is perpendicular to the gesture (502). For example, the z-axis may be determined as an axis perpendicular to the x-axis and the y-axis, respectively. However, it is not limited thereto.

[0051] The electronic device (100) can determine or define reference axes constituting a vector space through gestures (502, 504, 506, 508). Each of the gestures (502, 504, 506, 508) can be described as consecutive gestures, but is not limited thereto. The electronic device (100) can determine or obtain the absolute coordinates of the second gesture (525) using a geomagnetic sensor among one or more sensors (212). For example, the electronic device (100) can obtain data representing the direction and distance of the second gesture (525) based on the absolute coordinates determined through the geomagnetic sensor. However, when the electronic device (100) defines reference axes that constitute a vector space using gestures (502, 504, 506, 508), it can obtain a more precise (or accurate) direction and distance than the direction and distance obtained through a geomagnetic sensor. For example, since the electronic device (100) identifies the direction and distance of the second gesture (525) using gestures (502, 504, 506, 508), it can obtain feature data representing the characteristics of the second gesture (525) in more detail. For example, when the electronic device (100) defines reference axes using gestures (502, 504, 506, 508), it can identify changes in the vector more specifically while identifying the second gesture (525).

[0052] According to one embodiment, an electronic device (100) can identify a second gesture (525) within an area identified by gestures (502, 504, 506, 508) through one or more sensors (212). Based on identifying the second gesture (525) within an area identified by gestures (502, 504, 506, 508) (e.g., a rectangular area), the electronic device (100) can acquire an image representing the second gesture (525). For example, the electronic device (100) can determine the size of the image. For example, since the size of the image is determined, it may be easy to compare it with another image (e.g., an image represented by reference data). For example, an operation to perform image comparison with respect to images will be described later with reference to FIG. 7.

[0053] When the electronic device (100) identifies the second gesture (525) through one or more sensors (212), it can identify the amount of change in the vector. For example, the electronic device (100) can extract or acquire features of the second gesture (525) based on the amount of change in the vector. For example, the operation of acquiring features of the second gesture (525) is described and illustrated in more detail with reference to FIG. 6.

[0054] FIG. 6 illustrates an exemplary operation of an electronic device for acquiring data representing the characteristics of a gesture.

[0055] Referring to FIG. 6, the state (610) can be described as a state that identifies the second gesture (525). For example, the electronic device (100) can acquire feature data representing the characteristics of the second gesture (525) through one or more sensors (212) along the trajectory of the second gesture (525). For example, the electronic device (100) worn on a part of the user (120) (e.g., a finger) can identify the second gesture (525) through one or more sensors (212). For example, when the electronic device (100) identifies the second gesture (525), it may obtain or identify a vector corresponding to each of the gestures (612, 614, 616, 618, 620, 622, 624, 626, 628, 630) included in the second gesture (525). For example, the electronic device (100) may determine the vector as a separate vector based on a determination that the amount of change of the vector exceeds a threshold amount of change. For example, the electronic device (100) may obtain a separate vector according to the corner point of the second gesture (525). For example, when the electronic device (100) identifies the second gesture (525), it can obtain vectors for the gestures (612, 614, 616, 618, 620, 622, 624, 626, 628, 630).

[0056] For example, when identifying the second gesture (525), the acquired vector may be expressed as (x, y, z). However, it is not limited thereto. For example, when the electronic device (100) identifies the gesture (612), it may represent (-5, -5, 0) and acquire a vector corresponding to the gesture (612). For example, when the electronic device (100) identifies the gesture (614), it may represent (4, 0, 0) and acquire a vector corresponding to the gesture (614). For example, when the electronic device (100) identifies the gesture (616), it may represent (2, -2, 0) and acquire a vector corresponding to the gesture (616). For example, when the electronic device (100) identifies a gesture (618), it may indicate (-5, -1, 0) and obtain a vector corresponding to the gesture (618). For example, when the electronic device (100) identifies a gesture (620), it may indicate (0, 0, -1) and obtain a vector corresponding to the gesture (620). For example, when the electronic device (100) identifies a gesture (622), it may indicate (-5, -4, 0) and obtain a vector corresponding to the gesture (622). For example, when the electronic device (100) identifies a gesture (624), it may indicate (4, -1, 0) and obtain a vector corresponding to the gesture (624). For example, when the electronic device (100) identifies a gesture (626), it may indicate (1, -3, 0) and obtain a vector corresponding to the gesture (626). For example, when the electronic device (100) identifies a gesture (628), it may indicate (-3, 0, 0) and obtain a vector corresponding to the gesture (628). For example, when the electronic device (100) identifies a gesture (630), it may indicate (0, 0, -1) and obtain a vector corresponding to the gesture (612).

[0057] According to one embodiment, when an electronic device (100) performs user authentication using a time represented by reference data and a time represented by feature data, it may use a relative ratio of time. For example, the electronic device (100) may perform user authentication using a first ratio of the first time in which the gesture (612) is identified to the total time in which the second gesture (525) is identified. For example, the electronic device (100) may identify the difference between the first ratio and the second ratio represented by reference data that corresponds to the gesture (612). For example, the electronic device (100) may determine that the gesture (612) is (substantially) identical to some of the reference gestures represented by reference data, based further on the determination that the difference between the first ratio and the second ratio is within a reference range.

[0058] According to one embodiment, when the electronic device (100) acquires the second gesture (525), it can identify the difference between the acquired vectors and other vectors represented by reference data stored in the security element (214). For example, the electronic device (100) can determine that the second gesture (525) is identical to the reference gesture represented by the reference data based on the determination that the difference between the vectors and the other vectors is within a reference range. For example, the electronic device (100) can determine that user authentication is successful based on the determination.

[0059] According to one embodiment, the electronic device (100) may further include an input device. For example, the electronic device (100) may acquire a vector representing a second gesture (525) through one or more sensors (212) based on receiving user input to the input device. For example, the electronic device (100) may acquire a vector representing a gesture through one or more sensors (212) while receiving user input to the input device. For example, since the electronic device (100) controls the acquisition of the vector based on the input device, it may acquire vectors corresponding to the second gesture (525) in greater detail. For example, when the electronic device (100) controls the acquisition of the vector based on the input device, it may improve the accuracy of user authentication by preventing or reducing the acquisition of a vector representing a gesture unrelated to the second gesture (525). Although the operation of controlling the acquisition of a vector using an input device has been described above, the embodiment is not limited thereto. For example, the electronic device (100) may further include a touch sensor. For example, when the electronic device (100) identifies a touch input through the touch sensor, it may obtain a vector representing a gesture through one or more sensors (212). For example, the touch sensor may be placed on a surface different from the surface that is contacted when the electronic device (100) is worn on a part of the user (120) (e.g., a finger). For example, the touch sensor may be placed on an outer surface of the electronic device (100).

[0060] According to one embodiment, when the electronic device (100) identifies the second gesture (525) through one or more sensors (212), it may acquire feature data representing the characteristics of the second gesture (525). For example, the feature data may differ depending on the part of the user (120) to which the second gesture (525) is worn. For example, the feature data acquired when worn on the first part of the user (120) (e.g., index finger) may differ from the feature data acquired when worn on the second part of the user (120) (e.g., middle finger). For example, the electronic device (100) may store reference data for each part of the user (120) to which the electronic device (100) can be worn within a security element (214). For example, the electronic device (100) can perform user authentication by identifying the difference between reference data and feature data corresponding to parts of the user (120) to which the electronic device (100) is worn. Although the operation of performing user authentication using reference data corresponding to each part of the user has been described above, the embodiments are not limited thereto. For example, the first external electronic device (400) can display an image (or text) that guides the electronic device (100) to be worn on a defined part of the user (120) (e.g., index finger) through a display included in the first external electronic device (400).

[0061] The electronic device (100) may perform an image comparison on an image represented by the vectors to perform user authentication. For example, before performing the image comparison, the electronic device (100) may change the size of the image corresponding to the second gesture (525) to the size of the image represented by the reference data. The change in the size of the image is described and illustrated in more detail with reference to FIG. 7.

[0062] FIG. 7 illustrates an exemplary operation of an electronic device that changes the size of an image to match an image.

[0063] Referring to FIG. 7, the electronic device (100) can acquire an image representing a second gesture (525). For example, the electronic device (100) can acquire images (702, 704, 706) of various sizes based on the size of the second gesture (525) identified when performing user authentication. For example, the size of each of the images may correspond to the size of the area determined by the gestures (502, 504, 506, 508) of FIG. 5.

[0064] According to one embodiment, the electronic device (100) may perform image comparison to perform user authentication. For example, the electronic device (100) may acquire each of the images (702, 704, 706) using vectors representing the second gesture (525) based on identifying the second gesture (525). Reference data stored in the security element (214) may represent a single image. For example, the electronic device (100) may change the size of each of the images (702, 704, 706) to the size of the image represented by the reference data in order to perform image comparison with respect to the image and images (702, 704, 706) represented by the reference data stored in the security element (214). For example, the change in the size of the image may be referred to as normalization of the image size. For example, the electronic device (100) can obtain an image (710) having a defined size by changing the size of each of the images (702, 704, 706) to the size of the image represented by reference data. For example, the electronic device (100) can perform user authentication by performing an image comparison with respect to the image (710) and the image represented by reference data stored in the security element (214). Although the operation of changing the size of the image representing the second gesture (525) has been described above, the embodiment is not limited thereto. For example, the electronic device (100) can obtain an animation representing the second gesture (525) and change the size of the animation. For example, when the electronic device (100) uses the animation representing the second gesture (525) to perform user authentication, it can provide higher security.

[0065] According to one embodiment, the electronic device (100) may perform image comparison using a first trained model while executing a second mode. For example, the first trained model may include a model trained through machine learning (or deep learning) techniques. For example, the first trained model may be described as a model trained to determine whether images are identical to each other by performing image comparison on images. For example, the electronic device (100) may acquire an image representing the second gesture (525) (e.g., image (702)) based on providing feature data acquired when identifying the second gesture (525) through one or more sensors (212) to the first trained model. For example, the electronic device (100) may perform image comparison on an image corresponding to the feature data (e.g., image (702)) and an image corresponding to the reference data using the first trained model. For example, the electronic device (100) can identify, based on the image comparison, whether an image corresponding to feature data (e.g., image (702)) is (substantially) identical to an image corresponding to reference data. For example, the electronic device (100) can determine that user authentication is completed based on the determination that the image corresponding to feature data (e.g., image (702)) is (substantially) identical to an image corresponding to reference data. Although the operation of performing user authentication by performing image comparison has been described above, the embodiments are not limited thereto. For example, the electronic device (100) can perform video (or animation) comparison using a first trained model. For example, the electronic device (100) can perform user authentication by determining, using the first trained model, whether a video corresponding to feature data and a video corresponding to reference data are (substantially) identical.

[0066] The electronic device (100) may change or switch the mode of the electronic device (100) to a third mode based on the determination that the first gesture is a second defined gesture. For example, while executing the third mode, the electronic device (100) may control an external electronic device based on identifying gestures (e.g., gestures (825, 827) of FIG. 8). For example, the control of an external electronic device based on the third mode is described and illustrated in more detail with reference to FIG. 8.

[0067] FIG. 8 illustrates an exemplary operation of an electronic device that identifies a gesture to control an external electronic device.

[0068] Referring to FIG. 8, the electronic device (100) can identify a third gesture for controlling the second external electronic device (810) while executing a third mode for controlling the external electronic device (e.g., a second external electronic device (810)). For example, the electronic device (100) worn on a part (e.g., a finger) of the user (120) can identify gestures (825, 827) when executing the third mode. For example, when the electronic device (100) identifies the gestures (825, 827), it can determine the second external electronic device (810) corresponding to the gesture (825) identified first. For example, when the electronic device (100) identifies the gestures (825, 827), it can determine a function (e.g., turn-on or turn-off) corresponding to the gesture (827) identified later. For example, when the electronic device (100) identifies two consecutive words, it can determine an external electronic device (e.g., a second external electronic device (810)) to control based on the first word identified first among the two words, and determine a command (or function) to execute based on the second word identified later among the two words.

[0069] According to one embodiment, the electronic device (100) can perform character recognition using a second trained model. For example, the second trained model may be described as a model trained to recognize characters using sensor data obtained through one or more sensors (212). For example, the second trained model may include a model trained through machine learning (or deep learning) techniques. When the electronic device (100) identifies a gesture (825) through one or more sensors (212), it can acquire sensor data corresponding to the gesture (825). For example, the electronic device (100) can acquire or identify at least one of text, an image, and a video appearing by the gesture (825) by providing sensor data corresponding to the gesture (825) to the second trained model. For example, when the electronic device (100) identifies a third gesture through one or more sensors (212), it can identify the time at which the third gesture is identified. For example, the electronic device (100) can acquire a video expressing a third gesture using the time. For example, the video expressing the third gesture can be used to provide higher security because it includes information about time as well as two-dimensional or three-dimensional information.

[0070] For example, the electronic device (100) may acquire sensor data representing gestures (825, 827) based on identifying gestures (825, 827) through one or more sensors (212). For example, the electronic device (100) may identify or determine a word (or character) corresponding to the sensor data. However, it is not limited thereto. For example, the electronic device (100) may acquire an image corresponding to the sensor data using the sensor data. For example, the electronic device (100) may acquire words corresponding to the gestures (825, 827) by performing character recognition on the image. For example, the electronic device (100) may transmit a signal through the communication circuit (205) that causes a function (e.g., turn-off) corresponding to the gesture (827) to be executed within a second external electronic device (810) corresponding to the gesture (825). For example, the electronic device (100) may transmit the signal to a first external electronic device (400). However, it is not limited thereto. For example, the electronic device (100) may transmit the signal to an IoT (Internet of Things) hub via a communication circuit (205). For example, the IoT hub may cause the function to be executed within a second external electronic device (810) based on receiving the signal.

[0071] According to one embodiment, the first external electronic device (400) or IoT hub may provide a notification based on receiving the signal. For example, the notification may indicate the execution of a function corresponding to the signal. For example, the notification may indicate the reception of the signal. For example, the first external electronic device (400) or IoT hub may output audio indicating whether the function is executed based on receiving the signal, through a speaker included in the first external electronic device (400) or a speaker included in the IoT. For example, the first external electronic device (400) or IoT hub may display an image indicating whether the function is executed based on receiving the signal, through a display included in the first external electronic device (400) or a display included in the IoT hub.

[0072] While the electronic device (100) is executing the first mode, it may receive a second signal that causes user authentication to be performed from a first external electronic device (400) via a communication link using a communication circuit (205). For example, the reception of the second signal is described and illustrated in more detail with reference to FIG. 9.

[0073] FIG. 9 illustrates examples of operations performed within an electronic device and a first external electronic device to perform payment.

[0074] Referring to FIG. 9, in operation 910, the electronic device (100) can establish a communication link between the electronic device (100) and the first external electronic device (400) using a communication circuit (205). For example, operation 910 of FIG. 9 may correspond to operation 410 of FIG. 4.

[0075] In operation 920, the electronic device (100) may execute a first mode for low power consumption (e.g., low power mode). For example, while executing the first mode, the electronic device (100) may turn off some of the one or more sensors (212) to reduce power consumption. For example, while executing the first mode, the electronic device (100) may turn off some of the one or more sensors (212) and turn on the remaining one or more sensors (212). For example, while executing the first mode, the electronic device (100) may turn on an accelerometer for identifying a first gesture.

[0076] In operation 930, the first external electronic device (400) may receive a first user input for performing a payment using card information. For example, the first external electronic device (400) may receive a first user input for providing a service (e.g., payment) based on performing user authentication. For example, the first user input may be described as a user input for performing user authentication using the electronic device (100).

[0077] In operation 940, the first external electronic device (400) can transmit a second signal indicating that user authentication will be performed to the electronic device (100) via a communication link using a communication circuit (205).

[0078] In operation 950, the electronic device (100) may execute a second mode for performing user authentication based on receiving the second signal. For example, while executing the first mode, the electronic device (100) may change or switch the mode of the electronic device (100) from the first mode to the second mode based on receiving the second signal. For example, the electronic device (100) may execute the second mode without identifying the first gesture.

[0079] In operation 960, while the electronic device (100) is executing the second mode, feature data representing the features of the second gesture can be obtained through one or more sensors (212). For example, operation 960 of FIG. 9 may correspond to operation 330 of FIG. 3.

[0080] In operation 970, the electronic device (100) can identify the difference between reference data and feature data. For example, operation 970 of FIG. 9 can correspond to operation 470 of FIG. 4.

[0081] In operation 980, the electronic device (100) may transmit a first signal indicating success of user authentication to a first external electronic device (400) via a communication link using a communication circuit (205), based on a determination that the difference between reference data and feature data is within a reference range. For example, operation 980 of FIG. 9 may correspond to operation 480 of FIG. 4.

[0082] In operation 990, the first external electronic device (400) can perform payment using card information based on receiving the first signal. For example, the first external electronic device (400) can receive the first signal from the electronic device (100) via a communication link using a communication circuit (205).

[0083] FIG. 10 illustrates examples of operations performed within an electronic device and a first external electronic device to acquire reference data.

[0084] Referring to FIG. 10, in operation 1010, the electronic device (100) can establish a communication link between the electronic device (100) and a first external electronic device (400) using a communication circuit (205). For example, operation 1010 of FIG. 10 may correspond to operation 410 of FIG. 4.

[0085] In operation 1020, the electronic device (100) can execute a first mode. For example, operation 1020 of FIG. 10 can correspond to operation 920 of FIG. 9.

[0086] In operation 1025, the first external electronic device (400) may receive a second user input for obtaining reference data. For example, the reference data may be described as data represented as a vector to be used to perform user authentication. For example, the first external electronic device (400) may receive a second user input for obtaining reference data for performing user authentication in order to provide a service that requires user authentication.

[0087] In operation 1035, the first external electronic device (400) may transmit a second signal to the electronic device (100) via a communication link using the communication circuit (205) based on receiving a second user input. For example, the first external electronic device (400) may transmit a second signal to the electronic device (100) via a communication link using the communication circuit (205) that causes the mode of the electronic device (100) to change to a second mode.

[0088] In operation 1040, the electronic device (100) may execute a second mode for performing user authentication based on receiving a second signal. For example, the electronic device (100) may change the mode of the electronic device (100) from a first mode to a second mode based on receiving a second signal. For example, operation 1040 of FIG. 10 may correspond to operation 440 of FIG. 4.

[0089] In operation 1045, the first external electronic device (400) may display a visual indication (e.g., the second visual indication (1116) of FIG. 11) for guiding a reference gesture through a display included in the first external electronic device (400). For example, the reference gesture may be described as a gesture that appears by reference data for performing user authentication. For example, the visual indication may be described as a visual indication that induces a user of the electronic device (100) to take a reference gesture corresponding to the reference data while wearing the electronic device (100). The display of the visual indication will be described later with reference to FIG. 11.

[0090] In operation 1050, the electronic device (100) can acquire reference data representing the characteristics of a reference gesture while executing a second mode. For example, when executing the second mode, the electronic device (100) can identify the reference gesture through one or more sensors (212). For example, when the electronic device (100) identifies the reference gesture, it can acquire reference data representing the characteristics of the reference gesture. For example, the characteristics of the reference gesture may include corner points of the reference gesture. For example, the characteristics of the reference gesture may include vectors that exceed a threshold change amount among the vectors represented by the reference gesture. For example, the reference data may be described by vectors representing the reference gesture. For example, the reference data may include vectors that exceed a threshold change amount among the vectors representing the reference gesture. For example, the reference data may represent the time (e.g., 0.2 seconds) at which each of the vectors representing the reference gesture was acquired.

[0091] In operation 1060, the electronic device (100) may transmit a third signal to a first external electronic device (400) via a communication link using a communication circuit (205) based on acquiring reference data. For example, the third signal may be described as a signal indicating the acquisition of reference data.

[0092] In operation 1065, the first external electronic device (400) can identify whether the acquisition of reference data is completed based on receiving a third signal. For example, the first external electronic device (400) can identify whether a second reference data substantially identical to the first reference data acquired in operation 1050 is acquired. For example, the first external electronic device (400) can identify whether the second reference data substantially identical to the first reference data is repeatedly acquired in order to determine whether the acquisition of reference data is completed. For example, if the difference between the first reference data and the second reference data is within a reference range, the first external electronic device (400) can determine that the acquisition of reference data is completed. Although the operation of the first external electronic device (400) determining whether the acquisition of reference data is completed has been described above, the embodiments are not limited thereto. For example, the electronic device (100) can determine whether the difference between the first reference data and the second reference data is within a reference range. For example, the electronic device (100) can transmit a signal indicating the above decision to a first external electronic device (400) via a communication link using a communication circuit (205).

[0093] In operation 1075, the first external electronic device (400) may display a window (e.g., window (1122) of FIG. 11) indicating the completion of the acquisition of reference data through a display included in the first external electronic device (400). For example, the first external electronic device (400) may display an image (e.g., image (1124) of FIG. 11) representing a reference gesture together with the window through the display. The display of the window is described and illustrated in more detail with reference to FIG. 11.

[0094] FIG. 11 illustrates an exemplary operation of a first external electronic device displaying a visual indication to guide a gesture.

[0095] Referring to FIG. 11, the state (1110) can be described as a state in which a first visual indication (1106) for guiding a third definition gesture is displayed. For example, the first external electronic device (400) may include a display. For example, the first external electronic device (400) may display, through the display, a window (1102) for guiding a third definition gesture for setting reference axes in vector space. The window (1102) may include text for guiding a third definition gesture. For example, the first external electronic device (400) may display an image (1104) for guiding a third definition gesture through the display. For example, the image may include a first visual indication (1106) for guiding a third definition gesture.

[0096] A state (1120) may be described as a state in which a second visual indication (1116) for guiding a second gesture is displayed. For example, the first external electronic device (400) may display an image (1114) for guiding a second gesture through the display. For example, the image (1114) may include a second visual indication (1116) for guiding a gesture (or signature gesture) expressed by a part of the user (120) wearing the electronic device (100).

[0097] A state (1130) may be described as a state in which an image (1124) representing a second gesture identified through the electronic device (100) is displayed. For example, the first external electronic device (400) may display, through the display, an image (1124) representing a second gesture that appears through data obtained through one or more sensors (212) of the electronic device (100). For example, a user (120) may check or review the user's (120) second gesture using the image (1116) and / or the image (1124). For example, the electronic device (100) may determine whether the second gesture is correctly identified based on displaying the image (1116) and / or the image (1124) through the display.

[0098] According to one embodiment, the first external electronic device (400) may display a window (1122) through the display based on the completion of acquiring reference data. For example, the window (1122) may include text indicating the completion of signature registration. However, the embodiment is not limited thereto. For example, the first external electronic device (400) may display text (or a window) through the display indicating that user authentication has been completed based on performing user authentication.

[0099] When the electronic device (100) performs user authentication, it may use reference data stored within the security element (214). For example, the reference data stored within the security element (214) may be used to perform user authentication and may be controlled so as not to be transmitted to an external electronic device. For example, the reference data stored within the security element (214) may be deleted according to specific conditions. For example, the deletion of reference data is described and illustrated in more detail with reference to FIG. 12.

[0100] FIG. 12 is a flowchart illustrating the operation of an electronic device that deletes reference data used to perform user authentication.

[0101] Referring to FIG. 12, in operation 1210, the electronic device (100) can identify whether the electronic device (100) is being worn by a user (120) through a sensor. For example, the sensor may include one of a touch sensor, a PPG sensor, a temperature sensor, an accelerometer, and a gyroscope.

[0102] In operation 1220, the electronic device (100) can identify the time when the electronic device (100) is not worn by the user (120). For example, the electronic device (100) can identify the time when the electronic device (100) is not worn by the user (120) based on the determination that the electronic device (100) is not worn by the user (120).

[0103] In operation 1230, the electronic device (100) may delete reference data stored in the security element (214) based on a determination that the time the electronic device (100) has not been worn by the user (120) exceeds a threshold time (e.g., 12 hours). For example, the electronic device (100) may be required to delete reference data stored in the security element (214) to prevent or reduce the use of the electronic device (100) by an unauthorized person different from the user (120) of the electronic device (100) to perform user authentication. For example, the electronic device (100) may delete reference data stored in the security element (214) based on the time the electronic device (100) has not been worn by the user (120) to prevent or reduce the use of a service requiring user authentication by an unauthorized person using the electronic device (100). The user (120) may wear or not wear the electronic device (100) depending on an event (e.g., when the user (120) washes their hands in the restroom). For example, if the electronic device (100) immediately deletes reference data based on the decision that the electronic device (100) is not worn by the user (120), the electronic device (100) may be required to create or acquire new reference data to perform user authentication. For the convenience of the user, the electronic device (100) may refrain from deleting reference data stored in the security element (214) even if the electronic device (100) is not worn on part of the user (120) within the aforementioned threshold time.

[0104] FIG. 13 is a block diagram of an electronic device in a network environment according to various embodiments.

[0105] FIG. 13 is a block diagram of an electronic device (1301) in a network environment (1300) according to various embodiments. Referring to FIG. 13, in the network environment (1300), the electronic device (1301) may communicate with an electronic device (1302) through a first network (1398) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (1304) or a server (1308) through a second network (1399) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1301) may communicate with the electronic device (1304) through a server (1308). According to one embodiment, the electronic device (1301) may include a processor (1320), memory (1330), input module (1350), sound output module (1355), display module (1360), audio module (1370), sensor module (1376), interface (1377), connection terminal (1378), haptic module (1379), camera module (1380), power management module (1388), battery (1389), communication module (1390), subscriber identification module (1396), or antenna module (1397). In some embodiments, at least one of these components (e.g., connection terminal (1378)) may be omitted from the electronic device (1301), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1376), camera module (1380), or antenna module (1397)) may be integrated into a single component (e.g., display module (1360)).

[0106] The processor (1320) can, for example, execute software (e.g., program (1340)) to control at least one other component (e.g., hardware or software component) of the electronic device (1301) connected to the processor (1320) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1320) can store commands or data received from other components (e.g., sensor module (1376) or communication module (1390)) in volatile memory (1332), process the commands or data stored in volatile memory (1332), and store the resulting data in non-volatile memory (1334). According to one embodiment, the processor (1320) may include a main processor (1321) (e.g., a central processing unit or an application processor) or an auxiliary processor (1323) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1301) includes a main processor (1321) and an auxiliary processor (1323), the auxiliary processor (1323) may be configured to use less power than the main processor (1321) or to be specialized for a specified function. The auxiliary processor (1323) may be implemented separately from the main processor (1321) or as part thereof.

[0107] The auxiliary processor (1323) may control at least some of the functions or states associated with at least one component of the electronic device (1301) (e.g., display module (1360), sensor module (1376), or communication module (1390)) on behalf of the main processor (1321) while the main processor (1321) is in an inactive (e.g., sleep) state, or together with the main processor (1321) while the main processor (1321) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1323) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1380) or communication module (1390)). According to one embodiment, the auxiliary processor (1323) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1301) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1308)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0108] The memory (1330) can store various data used by at least one component of the electronic device (1301) (e.g., processor (1320) or sensor module (1376)). The data may include, for example, input data or output data for software (e.g., program (1340)) and related commands. The memory (1330) may include volatile memory (1332) or non-volatile memory (1334).

[0109] The program (1340) may be stored as software in memory (1330) and may include, for example, an operating system (1342), middleware (1344), or an application (1346).

[0110] The input module (1350) can receive commands or data to be used for a component of the electronic device (1301) (e.g., processor (1320)) from outside the electronic device (1301) (e.g., user). The input module (1350) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0111] The sound output module (1355) can output a sound signal to the outside of the electronic device (1301). The sound output module (1355) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0112] The display module (1360) can visually provide information to an external (e.g., user) of the electronic device (1301). The display module (1360) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1360) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0113] The audio module (1370) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1370) can acquire sound through the input module (1350) or output sound through the sound output module (1355) or an external electronic device (e.g., electronic device (1302)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1301).

[0114] The sensor module (1376) can detect the operating state of the electronic device (1301) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1376) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0115] The interface (1377) may support one or more specified protocols that can be used for the electronic device (1301) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1302)). According to one embodiment, the interface (1377) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0116] The connection terminal (1378) may include a connector through which the electronic device (1301) can be physically connected to an external electronic device (e.g., electronic device (1302)). According to one embodiment, the connection terminal (1378) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0117] The haptic module (1379) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (1379) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0118] The camera module (1380) can capture still images and video. According to one embodiment, the camera module (1380) may include one or more lenses, image sensors, image signal processors, or flashes.

[0119] The power management module (1388) can manage the power supplied to the electronic device (1301). According to one embodiment, the power management module (1388) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0120] The battery (1389) can supply power to at least one component of the electronic device (1301). According to one embodiment, the battery (1389) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0121] The communication module (1390) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1301) and an external electronic device (e.g., electronic device (1302), electronic device (1304), or server (1308)), and the performance of communication through the established communication channel. The communication module (1390) may include one or more communication processors that operate independently of the processor (1320) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1390) may include a wireless communication module (1392) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1394) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1304) through a first network (1398) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1399) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1392) can identify or authenticate the electronic device (1301) within a communication network such as the first network (1398) or the second network (1399) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1396).

[0122] The wireless communication module (1392) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1392) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1392) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1392) can support various requirements specified in the electronic device (1301), external electronic device (e.g., electronic device (1304)), or network system (e.g., second network (1399)). According to one embodiment, the wireless communication module (1392) can support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0123] An antenna module (1397) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1397) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1397) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1398) or a second network (1399), may be selected from the plurality of antennas, for example, by a communication module (1390). A signal or power may be transmitted or received between the communication module (1390) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1397).

[0124] According to various embodiments, the antenna module (1397) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0125] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0126] According to one embodiment, commands or data may be transmitted or received between the electronic device (1301) and an external electronic device (1304) through a server (1308) connected to a second network (1399). Each of the external electronic devices (1302, or 1304) may be the same or a different type of device as the electronic device (1301). According to one embodiment, all or part of the operations performed on the electronic device (1301) may be performed on one or more of the external electronic devices (1302, 1304, or 1308). For example, if the electronic device (1301) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1301) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1301). The electronic device (1301) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1301) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1304) may include an Internet of Things (IoT) device. The server (1308) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1304) or server (1308) may be included within the second network (1399). The electronic device (1301) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0127] FIG. 14a shows a perspective view of an exemplary electronic device according to one embodiment.

[0128] Referring to FIG. 14a, a wearable device (1400) (e.g., the electronic device (100) of FIG. 1) may include a housing (1401) comprising a first surface (1411) facing a part of the user's body (e.g., a finger) and a second surface (1412) opposite to the first surface (1411). For example, the wearable device (1400) may include a ring-shaped housing (1401). For example, the wearable device (1400) may be configured in a ring shape.

[0129] For example, the wearable device (1400) may be referred to as a wearable device that can be worn by a user. The wearable device (1400) may be worn on a part of the user's body (e.g., a finger). For example, the wearable device (1400) may be worn on a part of the user's body. For example, the wearable device (1400) may be fastened to a part of the user's body. For example, the wearable device (1400) may be detachable from a part of the user's body. For example, the wearable device (1400) may have a shape corresponding to a part of the user's body in order to be worn on a part of the user's body.

[0130] For example, the wearable device (1400) may come into contact with a part of the user's body by being worn by the user. For example, the wearable device (1400) may be configured to obtain information about the user through a part of the user's body by being worn by the user. For example, the information about the user may include the user's health information. However, it is not limited thereto. For example, the wearable device (1400) may provide information about the user through the wearable device (1400) and / or an external electronic device connected to the wearable device (1400). However, it is not limited thereto.

[0131] For example, at least a portion of the first surface (1411) may come into contact with a portion of the user's body when the wearable device (1400) is worn by the user. For example, the first surface (1411) may surround a portion of the user's body where the wearable device (1400) is worn. For example, the first surface (1411) may cover a portion of the user's body where the wearable device (1400) is worn. For example, the first surface (1411) may be configured so that the wearable device (1400) is fastened to a portion of the body by pressurizing a portion of the user's body when the wearable device (1400) is worn by the user. For example, the first surface (1411) may be deformable by a portion of the user's body. For example, the wearable device (1400) can provide information about the user through the first surface (1411) based on haptic technology.

[0132] For example, the second surface (1412) can form the exterior of the wearable device (1400) together with the first surface (1411). For example, the second surface (1412) can form a ring-shaped housing (1401) together with the first surface (1411). For example, the second surface (1412) may be a surface spaced apart from a part of the user's body when the wearable device (1400) is worn by the user. For example, the first surface (1411) may be referred to as the inner circumference surface of the housing (1401). The second surface (1412), opposite to the first surface (1411), may be referred to as the outer circumference surface of the housing (1401).

[0133] For example, the second surface (1412) may be exposed to the outside while the wearable device (1400) is worn by the user. The second surface (1412) may be composed of at least one of titanium, stainless steel, and ceramic. The second surface (1412) may be composed of a material for protection against external impact and / or scratches. For example, the second surface (1412) may be coated with an additional material to protect the color of the wearable device (1400) and / or the appearance of the wearable device (1400).

[0134] For example, the first surface (1411) may be composed of the same and / or similar material as the second surface (1412). For example, at least a portion of the first surface (1411) may be composed of at least one of a molding material for acquiring data, a transparent plastic, and / or glass. For example, at least a portion of the first surface (1411) may be composed of a metal for identifying biosignals.

[0135] For example, the wearable device (1400) may further include a hole (1470) formed by a first surface (1411) to allow a part of the user's body to pass through when the wearable device (1400) is worn by the user. For example, the hole (1470) may be penetrated by a part of the user's body when the wearable device (1400) is worn by the user. The wearable device (1400) may be configured to be fastened to a part of the user's body when the user wears the wearable device (1400) by including a hole (1470) configured to allow said part of the user's body to pass through.

[0136] For example, the wearable device (1400) may further include one or more components between the first surface (1411) and the second surface (1412). For example, the wearable device (1400) may include a communication circuit, one or more sensors, and / or a processor between the first surface (1411) and the second surface (1412). The arrangement of one or more components will be described later in FIG. 14b.

[0137]

[0138] FIG. 14b is an example of a partial cross-sectional view of an electronic device according to one embodiment.

[0139] ​Referring to FIG. 14b, the wearable device (1400) may be formed in a ring shape. For example, the housing (1401) of the wearable device (1400) may be formed in the shape of a ring that can be worn on a user's finger. FIG. 14a and FIG. 14b illustrate a wearable device (1400) in the shape of a ring with a smooth surface as an example, but are not limited thereto. For example, the wearable device (1400) may be implemented as a housing comprising a plurality of planes. For example, a wearable device (1400) in the shape of a ring with a non-smooth surface may also be understood as an embodiment of the present disclosure.

[0140] For example, the ring-shaped housing (1401) may include a first surface (1411) that contacts the user's body when worn by the user, a second surface (1412) that is exposed to the outside, and a side between the first surface (1411) and the second surface (1412). For example, the space between the first surface (1411) and the second surface (1412) may include a space for including (or placing) at least one component (e.g., at least one processor (207), memory (206), one or more sensors (212), a communication circuit (205), and a security element (214)).

[0141] For example, a PCB may be placed between the first surface (1411) and the second surface (1412) of the wearable device (1400). For example, at least one processor (1410), a communication circuit (1420), an accelerometer, a gyroscope, a PPG sensor, a temperature sensor, a memory (1440), and / or a PMIC (1454) may be placed on the PCB (1451). For example, the PCB (1451) may be composed of a rigid region and a flexible region. For example, the rigid region may be referred to as a rigid flexible printed circuit board (RFPCB). For example, the flexible region may be referred to as a flexible printed circuit board (FPCB).

[0142] For example, the PPG sensor may include one or more light-emitting circuits (1433-1), one or more light-receiving circuits (1433-2), and a control circuit (1433-3). For example, one or more light-emitting circuits (1433-1) and one or more light-receiving circuits (1433-2) may be positioned toward a first surface (1411). For example, the control circuit (1433-3) may be positioned toward a second surface (1412).

[0143] For example, the PMIC (1454) may be used to manage the power of the wearable device (1400). The PMIC (1454) may be used to provide (or distribute) power to components in the wearable device (1400) that require power. The PMIC (1454) may support a wired charging method (e.g., terminal, pogo pin) or a wireless charging method (e.g., WPC (wireless power consortium), NFC) for charging the wearable device (1400) through the charging interface (1453).

[0144] For example, a battery (1452) may be disposed between a first surface (1411) and a second surface (1412) of a wearable device (1400). The battery (1452) may consist of at least one battery (or battery pack). For example, the battery (1452) may be configured such that at least one battery is connected in series and / or parallel. For example, the battery (1452) may consist of a flexible battery pack. For example, the battery (1452) may be charged and / or discharged as a secondary battery. For example, the material constituting the battery (1452) may be configured in various ways. For example, the material constituting the battery (1452) may include at least one of lithium ion and mercury.

[0145] For example, an antenna (1455) may be positioned between the first surface (1411) and the second surface (1412) of the wearable device (1400). For example, the antenna (1455) may be composed of a single antenna and / or multiple segmented antennas. For example, the antenna (1455) may be formed as part of the housing (1401) of the wearable device (1400). For example, the antenna (1455) may be electrically connected to a communication circuit (1420) via a PCB (1451).

[0146] Although not illustrated, the wearable device (1400) may include various additional components in addition to the illustrated components. For example, the wearable device (1400) may include a display. The display may be placed on the outer surface of the housing (1401).

[0147] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0148] An electronic device as described above (e.g., electronic device (100)) may include a memory (e.g., memory (206)) for storing instructions. The electronic device may include a communication circuit (e.g., communication circuit (205)). The electronic device may include one or more sensors (e.g., one or more sensors (212)). The electronic device may include at least one processor (e.g., at least one processor (207)). The instructions may cause the electronic device to identify a first gesture through the one or more sensors while a communication link between the electronic device and an external electronic device is established using the communication circuit when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to execute a mode for performing user authentication based on a determination that the first gesture is a defined gesture when executed individually or collectively by the at least one processor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire, through the one or more sensors, data representing the characteristics of a second gesture following a first gesture, which is expressed by a part of the user associated with the electronic device when the mode is executed. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to transmit a signal indicating the success of the user authentication to the external electronic device via the communication link using the communication circuit, based on a determination that the difference between the reference data representing the characteristics of a reference gesture and the data is within a reference range.

[0149] According to one embodiment, the mode may be a first mode (e.g., an authentication mode). When the instructions are executed individually or collectively by the at least one processor, they may cause the electronic device to change the mode of the electronic device from a second mode for low power consumption (e.g., a low-power mode) to the first mode based on a determination that the first gesture is the defining gesture. Some of the one or more sensors may be turned on in the first mode and turned off in the second mode. Some of the remaining one or more sensors may be turned on in the first mode and the second mode.

[0150] According to one embodiment, the mode may be a first mode. The definition gesture may be a first definition gesture. The external electronic device may be a first external electronic device. The instructions may cause the electronic device to execute a second mode for controlling the external electronic device based on a determination that the first gesture is a second definition gesture when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to identify, through the one or more sensors, a third gesture representing a word expressed by the part of the user based on the execution of the second mode when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to transmit a control signal to the first external electronic device via the communication link to control a second external electronic device corresponding to the word using the communication circuit, based on the identification of the third gesture when executed individually or collectively by the at least one processor.

[0151] According to one embodiment, the data may be first data. When the instructions are executed individually or collectively by the at least one processor, when the mode is executed, the electronic device may be caused to acquire, through the one or more sensors, second data representing a third defined gesture expressed by the part of the user, before acquiring the first data. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to determine reference axes in a vector space for defining a vector represented by the first data using the second data.

[0152] According to one embodiment, the third definition gesture may include a continuous gesture representing a square.

[0153] According to one embodiment, the instructions may cause the electronic device to acquire a first image representing the second gesture using the data, based on identifying the second gesture through the one or more sensors when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to change the first size of the first image to the second size of the second image corresponding to the reference data when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to identify whether the first image is identical to the second image based on performing an image comparison with respect to the first image having the second size and the second image having the second size when executed individually or collectively by the at least one processor. The above instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to transmit the signal to the external electronic device via the communication link using the communication circuit, further based on the determination that the first image is identical to the second image.

[0154] According to one embodiment, the electronic device may further include a security element. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to identify whether the electronic device is being worn by the user by using the one or more sensors. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to identify the time during which the electronic device is not being worn by the user based on a determination that the electronic device is not being worn by the user. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to delete the reference data stored within the security element based on a determination that the time exceeds a threshold time.

[0155] According to one embodiment, the second gesture may include an air gesture representing a signature. The feature of the second gesture may include a corner point of the signature.

[0156] According to one embodiment, the reference data is obtained before identifying the second gesture to perform the user authentication, and may represent vectors corresponding to the reference gesture expressed by a part of the user.

[0157] According to one embodiment, the one or more sensors may include at least one of an accelerometer, a gyroscope, and a geomagnetic sensor.

[0158] According to one embodiment, the electronic device may further include a security element. The reference data may be stored within the security element.

[0159] A method performed by an electronic device (e.g., electronic device (100)) having a communication circuit (e.g., communication circuit (205)) and one or more sensors (e.g., one or more sensors (212)) as described above may include an operation of identifying a first gesture through the one or more sensors while a communication link between the electronic device and an external electronic device is established using the communication circuit. The method may include an operation of executing a mode for performing user authentication based on a determination that the first gesture is a defined gesture. The method may include, when executing the mode, an operation of obtaining data through the one or more sensors that is expressed by a part of the user associated with the electronic device and represents the characteristics of a second gesture following the first gesture. The method may include an operation of transmitting a signal indicating the success of user authentication to the external electronic device via the communication link using the communication circuit, based on a determination that the difference between the reference data representing the characteristics of a reference gesture and the data is within a reference range.

[0160] According to one embodiment, the mode may be a first mode. The method may include an operation of changing the mode of the electronic device from a second mode for low power consumption to the first mode based on a determination that the first gesture is the defining gesture. Some of the one or more sensors may be turned on in the first mode and turned off in the second mode. Some of the remaining of the one or more sensors may be turned on in the first mode and the second mode.

[0161] According to one embodiment, the mode may be a first mode. The definition gesture may be a first definition gesture. The external electronic device may be a first external electronic device. The method may include an operation of executing a second mode for controlling an external electronic device based on a determination that the first gesture is a second definition gesture. The method may include an operation of identifying, through one or more sensors, a third gesture that is expressed by the part of the user and represents a word, based on executing the second mode. The method may include an operation of transmitting a control signal to the first external electronic device via the communication link to control a second external electronic device corresponding to the word using the communication circuit, based on identifying the third gesture.

[0162] According to one embodiment, the data may be a first data. The method may include, when executing the mode, acquiring a second data representing a third defined gesture expressed by a part of the user through one or more sensors before acquiring the first data. The method may include, using the second data, determining reference axes in a vector space for defining a vector represented by the first data.

[0163] According to one embodiment, the third definition gesture may include a continuous gesture representing a square.

[0164] According to one embodiment, the method may include an operation of acquiring a first image representing the second gesture using the data based on identifying the second gesture through the one or more sensors. The method may include an operation of changing the first size of the first image to the second size of the second image corresponding to the reference data. The method may include an operation of identifying whether the first image is identical to the second image based on performing an image comparison with respect to the first image having the second size and the second image having the second size. The method may further include an operation of transmitting the signal to the external electronic device via the communication link using the communication circuit based on the determination that the first image is identical to the second image.

[0165] According to one embodiment, the electronic device may further include a security element. The method may include an operation of identifying whether the electronic device is worn by the user using the one or more sensors. The method may include an operation of identifying the time during which the electronic device is not worn by the user based on a determination that the electronic device is not worn by the user. The method may include an operation of deleting the reference data stored within the security element based on a determination that the time exceeds a threshold time.

[0166] According to one embodiment, the second gesture may include an air gesture representing a signature. The feature of the second gesture may include a corner point of the signature.

[0167] According to one embodiment, the reference data is obtained before identifying the second gesture to perform the user authentication, and may represent vectors corresponding to the reference gesture expressed by a part of the user.

[0168] According to one embodiment, the one or more sensors may include at least one of an accelerometer, a gyroscope, and a geomagnetic sensor.

[0169] According to one embodiment, the electronic device may further include a security element. The reference data may be stored within the security element.

[0170] In a computer-readable storage medium in which one or more programs as described above are stored, the one or more programs may include instructions that cause the electronic device (e.g., electronic device (100)) having a communication circuit (e.g., communication circuit (205)) and one or more sensors (e.g., one or more sensors (212)) to identify a first gesture through the one or more sensors while a communication link between the electronic device and an external electronic device is established using the communication circuit. The one or more programs may include instructions that cause the electronic device to execute a mode for performing user authentication based on a determination that the first gesture is a defined gesture when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to acquire, through the one or more sensors, data representing the characteristics of a second gesture following a first gesture, which is expressed by a part of the user associated with the electronic device when the mode is executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to transmit a signal indicating the success of the user authentication to the external electronic device via the communication link using the communication circuit, based on a determination that the difference between the reference data representing the characteristics of a reference gesture and the data is within a reference range when executed by the electronic device.

[0171] According to one embodiment, the mode may be a first mode. The one or more programs may include instructions that cause the electronic device to change the mode of the electronic device from a second mode for low power consumption to the first mode based on a determination that the first gesture is the defined gesture when executed by the electronic device. Some of the one or more sensors may be turned on in the first mode and turned off in the second mode. The remaining some of the one or more sensors may be turned on in the first mode and the second mode.

[0172] According to one embodiment, the mode may be a first mode. The definition gesture may be a first definition gesture. The external electronic device may be a first external electronic device. The one or more programs may include instructions that cause the electronic device to execute a second mode for controlling the external electronic device based on a determination that the first gesture is a second definition gesture when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to identify, through the one or more sensors, a third gesture representing a word expressed by the part of the user based on executing the second mode when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to transmit a control signal to the first external electronic device via the communication link to control a second external electronic device corresponding to the word using the communication circuit based on identifying the third gesture when executed by the electronic device.

[0173] According to one embodiment, the data may be a first data. The one or more programs may include instructions that cause the electronic device to acquire, through the one or more sensors, second data representing a third defined gesture expressed by the part of the user, before acquiring the first data when the mode is executed by the electronic device. The one or more programs may include instructions that cause the electronic device to determine reference axes in a vector space for defining a vector represented by the first data using the second data when executed by the electronic device.

[0174] According to one embodiment, the third definition gesture may include a continuous gesture representing a square.

[0175] According to one embodiment, the one or more programs may include instructions that cause the electronic device to acquire a first image representing the second gesture using the data, based on identifying the second gesture through the one or more sensors when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to change the first size of the first image to the second size of the second image corresponding to the reference data when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to identify whether the first image is identical to the second image based on performing an image comparison with respect to the first image having the second size and the second image having the second size when executed by the electronic device. The above one or more programs may include instructions that cause the electronic device to transmit the signal to the external electronic device via the communication link using the communication circuit, further based on the determination that the first image is identical to the second image when executed by the electronic device.

[0176] According to one embodiment, the electronic device may further include a security element. The one or more programs may include instructions that cause the electronic device to identify whether the electronic device is worn by the user by using the one or more sensors when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to identify the time during which the electronic device is not worn by the user based on a determination that the electronic device is not worn by the user when executed by the electronic device. The one or more programs may include instructions that cause the electronic device to delete the reference data stored within the security element based on a determination that the time exceeds a threshold time when executed by the electronic device.

[0177] According to one embodiment, the second gesture may include an air gesture representing a signature. The feature of the second gesture may include a corner point of the signature.

[0178] According to one embodiment, the reference data is obtained before identifying the second gesture to perform the user authentication, and may represent vectors corresponding to the reference gesture expressed by a part of the user.

[0179] According to one embodiment, the one or more sensors may include at least one of an accelerometer, a gyroscope, and a geomagnetic sensor.

[0180] According to one embodiment, the electronic device may further include a security element. The reference data may be stored within the security element.

[0181] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0182] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0183] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0184] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a computer-executable program, or temporarily store it for execution or download. Additionally, the medium may be various recording or storage means in the form of a single or several combined hardware, and may not be limited to a medium directly connected to a computer system but may exist distributed over a network. Examples of media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to store program instructions, including ROM, RAM, and flash memory. Additionally, other examples of media may include recording or storage media managed by app stores that distribute applications or sites and servers that supply or distribute various other software.

[0185] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0186] Therefore, other implementations, other embodiments, and equivalents to the claims set forth below are also within the scope of the claims. According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0187] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

Claim 1 In an electronic device (100), a communication circuit (205); one or more sensors (212); and a memory (206) comprising one or more storage media for storing instructions; The invention includes at least one processor (207) comprising a processing circuitry, wherein the instructions are executed individually or collectively by the at least one processor (207), while a communication link between the electronic device (100) and an external electronic device (100) is established using the communication circuit (205), a first gesture is identified through the one or more sensors (212), and a mode for performing user authentication is executed based on a determination that the first gesture is a defined gesture, and when the mode is executed, data representing a feature of a second gesture (525) following the first gesture is expressed by a part of the user associated with the electronic device (100) is obtained through the one or more sensors (212), and a signal indicating the success of the user authentication is obtained using the communication circuit (205) based on a determination that the difference between the reference data representing a feature of the reference gesture and the data is within a reference range. An electronic device (100) that causes the electronic device (100) to transmit to the external electronic device (100) via a communication link. Claim 2 In claim 1, the mode is a first mode, and the instructions, when executed individually or collectively by the at least one processor (207), cause the electronic device (100) to change the mode of the electronic device (100) from a second mode for low power consumption to the first mode based on the determination that the first gesture is the defining gesture, and some of the one or more sensors (212) are turned on in the first mode and turned off in the second mode, and some of the remaining of the one or more sensors (212) are turned on in the first mode and the second mode, electronic device (100). Claim 3 In claim 1, the mode is a first mode, the definition gesture is a first definition gesture, the external electronic device (100) is a first external electronic device (100), and the instructions, when executed individually or collectively by the at least one processor (207), execute a second mode for controlling the external electronic device (100) based on the determination that the first gesture is a second definition gesture, and based on executing the second mode, identify a third gesture represented by a part of the user and indicating a word through the one or more sensors (212), and based on identifying the third gesture, cause the electronic device (100) to transmit a control signal to the first external electronic device (100) via the communication link to control a second external electronic device (810) corresponding to the word using the communication circuit (205). Claim 4 In claim 1, the data is first data, and the instructions, when executed individually or collectively by the at least one processor (207), when executing the mode, before acquiring the first data, acquire second data representing a third defined gesture expressed by the part of the user through the one or more sensors (212), and use the second data to determine reference axes in a vector space for defining a vector represented by the first data, thereby causing the electronic device (100). Claim 5 In claim 4, the third definition gesture comprises a continuous gesture representing a square, an electronic device (100). Claim 6 In claim 1, the instructions, when executed individually or collectively by the at least one processor (207), cause the electronic device (100) to obtain a first image representing the second gesture (525) using the data based on identifying the second gesture (525) through the one or more sensors (212), change the first size of the first image to a second size of the second image corresponding to the reference data, identify whether the first image is identical to the second image based on performing an image comparison with respect to the first image having the second size and the second image having the second size, and further cause the electronic device (100) to transmit the signal to the external electronic device (100) through the communication link using the communication circuit (205) based on the determination that the first image is identical to the second image. Claim 7 The electronic device of claim 1 further comprises a security element, wherein the instructions, when executed individually or collectively by the at least one processor (207), use the one or more sensors (212) to identify whether the electronic device (100) is worn by the user, identify the time during which the electronic device (100) is not worn by the user based on the determination that the electronic device (100) is not worn by the user, and cause the electronic device (100) to delete the reference data stored in the security element based on the determination that the time exceeds a threshold time. Claim 8 An electronic device (100), wherein the second gesture (525) comprises an air gesture expressing a signature, and the feature of the second gesture (525) comprises a corner point of the signature. Claim 9 An electronic device (100), wherein the reference data is obtained before identifying the second gesture (525) to perform the user authentication, and represents vectors corresponding to the reference gesture expressed by a part of the user. Claim 10 In claim 1, the electronic device (100), wherein the one or more sensors (212) include at least one of an accelerometer, a gyroscope, and a geomagnetic sensor. Claim 11 The electronic device of claim 1 further comprises a secure element (214), and the reference data is stored within the secure element, the electronic device (100). Claim 12 In a non-transient computer-readable storage medium storing one or more programs, the one or more programs, when executed by an electronic device (100) having a communication circuit (205) and one or more sensors (212), identify a first gesture through the one or more sensors (212) while a communication link between the electronic device (100) and an external electronic device (100) is established using the communication circuit (205), execute a mode for performing user authentication based on a determination that the first gesture is a defined gesture, and when the mode is executed, obtain data through the one or more sensors (212) that is expressed by a part of the user associated with the electronic device (100) and represents a characteristic of a second gesture (525) following the first gesture, and, based on a determination that the difference between the reference data representing a characteristic of the reference gesture and the data is within a reference range, transmit a signal indicating the success of the user authentication through the communication link using the communication circuit (205). A non-transient computer-readable storage medium comprising instructions that cause the electronic device (100) to transmit to an external electronic device (100). Claim 13 A non-transient computer-readable storage medium according to claim 12, wherein the mode is a first mode, and the one or more programs include instructions that cause the electronic device (100) to change the mode of the electronic device (100) from a second mode for low power consumption to the first mode based on a determination that the first gesture is the defining gesture when executed by the electronic device (100), and some of the one or more sensors (212) are turned on in the first mode and turned off in the second mode, and some of the remaining of the one or more sensors (212) are turned on in the first mode and the second mode. Claim 14 A non-transient computer-readable storage medium according to claim 12, wherein the mode is a first mode, the definition gesture is a first definition gesture, the external electronic device (100) is a first external electronic device (100), and the one or more programs include instructions that cause the electronic device (100) to transmit a control signal to the first external electronic device (100) via the communication link, to control a second external electronic device (810) corresponding to the word using the communication circuit (205), based on the execution of the second mode, a second mode for controlling the external electronic device (100) based on the execution of the second mode, a third gesture representing a word expressed by the part of the user, through the one or more sensors (212), and based on the identification of the third gesture. Claim 15 A non-transient computer-readable storage medium according to claim 12, wherein the data is a first data, and the one or more programs, when executed by the electronic device (100), when executing the mode, acquire a second data representing a third defined gesture expressed by the part of the user through the one or more sensors (212) before acquiring the first data, and include instructions that cause the electronic device (100) to determine reference axes in a vector space for defining a vector represented by the first data using the second data. Claim 16 In claim 15, the third definition gesture comprises a continuous gesture representing a square, a non-transient computer-readable storage medium. Claim 17 A non-transient computer-readable storage medium according to claim 12, wherein the one or more programs include instructions that cause the electronic device (100) to transmit the signal to the external electronic device (100) via the communication circuit (205) through the communication link, based on identifying the second gesture (525) through the one or more sensors (212) when executed by the electronic device (100), to acquire a first image representing the second gesture (525) using the data, change the first size of the first image to a second size of the second image corresponding to the reference data, identify whether the first image is identical to the second image based on performing an image comparison with respect to the first image having the second size and the second image having the second size, and further based on the determination that the first image is identical to the second image. Claim 18 A non-transient computer-readable storage medium according to claim 12, wherein the electronic device further comprises a security element, and the one or more programs include instructions that cause the electronic device (100) to use the one or more sensors (212), when executed by the electronic device (100), to identify whether the electronic device (100) is worn by the user, to identify the time during which the electronic device (100) is not worn by the user based on the determination that the electronic device (100) is not worn by the user, and to delete the reference data stored in the security element based on the determination that the time exceeds a threshold time. Claim 19 A non-transient computer-readable storage medium according to claim 12, wherein the second gesture (525) comprises an air gesture representing a signature, and the feature of the second gesture (525) comprises a corner point of the signature. Claim 20 A method performed within an electronic device (100) comprising a communication circuit (205) and one or more sensors (212), comprising: an operation of identifying a first gesture through the one or more sensors (212) while a communication link between the electronic device (100) and an external electronic device (100) is established using the communication circuit (205); an operation of executing a mode for performing user authentication based on a determination that the first gesture is a defined gesture; an operation of obtaining, through the one or more sensors (212), data that is expressed by a part of the user associated with the electronic device (100) and represents a characteristic of a second gesture (525) following the first gesture, when the mode is executed; and an operation of transmitting a signal indicating the success of the user authentication to the external electronic device (100) through the communication link using the communication circuit (205), based on a determination that the difference between the reference data representing a characteristic of the reference gesture and the data is within a reference range.

Images