Electronic device and method for communicating with wearable electronic device

Abstract

According to the present disclosure, an electronic device and a method for operating the electronic device are disclosed. The electronic device according to the present disclosure may comprise: a communication circuit; a memory including at least one storage medium storing instructions; and at least one processor including processing circuitry. The instructions, when individually or collectively executed by at least one processor, may cause the electronic device to: receive, through the communication circuit, first sensor data of a first wearable electronic device and second sensor data of a second wearable electronic device periodically or aperiodically for a predetermined time; acquire, on the basis of the first sensor data and the second sensor data, first direction information about the orientation of the first wearable electronic device and second direction information about the orientation of the second wearable electronic device; and identify, on the basis of the first direction information and the second direction information, which fingers are a first finger on which the first wearable electronic device is worn and a second finger on which the second wearable electronic device is worn. The first direction information and the second direction information are based on the same reference frame and may be time-sequential information.

Description

Electronic device and method communicating with a wearable electronic device

[0001] The present disclosure relates to an electronic device and a method for communicating with a wearable electronic device.

[0002] Wearable electronic devices are electronic devices that can be used while worn by the user, and they are becoming increasingly widely used to provide convenience and efficiency in daily life. Among them, small wearable electronic devices such as smart rings are small in size and weight, offer excellent comfort when worn, and can detect data using various built-in sensors.

[0003] Recently, users have been using multiple wearable electronic devices simultaneously rather than just one, which enables a more sophisticated user experience. In this case, by collecting and analyzing data from multiple wearable electronic devices, it is possible to achieve more precise control over the devices connected to the wearable electronic devices.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] According to one embodiment, an electronic device may be provided. The electronic device may include at least one processor including a communication circuit and a processing circuit, and a memory including at least one storage medium for storing instructions. The instructions may cause the electronic device to perform at least one operation when executed individually or collectively by at least one processor. The at least one operation may include: receiving first sensor data of a first wearable electronic device and second sensor data of a second wearable electronic device periodically or non-periodically through the communication circuit; obtaining first orientation information regarding the orientation of the first wearable electronic device and second orientation information regarding the orientation of the second wearable electronic device based on the first sensor data and the second sensor data; or identifying a first finger on which the first wearable electronic device is worn and a second finger on which the second wearable electronic device is worn based on the first orientation information and the second orientation information. The above first direction information and the above second direction information are based on the same reference frame and may be time-sequential information.

[0006] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: acquiring first motion data of a first wearable electronic device and second motion data of a second wearable electronic device based on first sensor data and second sensor data; recognizing a gesture input based on information of identified first finger and second finger, first motion data and second motion data; and performing at least one control operation corresponding to the gesture input based on recognizing the gesture input. The first motion data and second motion data may be time-series data including information about direction.

[0007] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: acquiring finger-specific reference motion data associated with at least one specific gesture; identifying motion data of a first finger and a second finger among finger-specific motion data associated with the specific gesture; or recognizing a gesture input based on the first motion data, the second motion data, and the motion data of the first finger and the second finger associated with the specific gesture. The finger-specific motion data associated with the specific gesture may be time-series data including information about direction.

[0008] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following actions: acquiring information about the direction of a finger associated with a directing gesture; providing information about the guidance of the directing gesture; acquiring first direction information and second direction information; or identifying a first finger and a second finger based on the first direction information, second direction information and information about the direction of a finger associated with the directing gesture. The directing gesture may be a gesture for identifying a finger wearing a wearable electronic device, and the first direction information and second direction information may include information about the change in direction of the first wearable electronic device and the second wearable electronic device following the provision of information about the guidance of the directing gesture.

[0009] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: acquiring information about finger-specific directions associated with a plurality of gestures; or identifying which finger the first finger and the second finger are based on the first direction information, the second direction information, and the information about finger-specific directions associated with a plurality of gestures.

[0010] According to one embodiment, the instruction gesture may include a spread gesture of spreading all fingers. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following actions: identifying that the first finger or the second finger is a thumb based on identifying that the magnitude of rotation about a specific axis of the first wearable electronic device or the second wearable electronic device exceeds a first threshold; identifying that the first finger or the second finger is a middle finger based on identifying that the magnitude of rotation about a specific axis is less than a second threshold, which is a value smaller than the first threshold; or obtaining first direction information and second direction information including information about the magnitude of rotation about a specific axis.

[0011] According to one embodiment, at least one specific gesture may include a first thumb swipe gesture, and the first thumb swipe gesture may be a gesture in which the thumb swipes along the proximal phalanges of the remaining fingers. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device performs the action of recognizing a first thumb swipe gesture input based on orientation information of a first wearable electronic device, orientation information of a second wearable electronic device, and motion data of the first finger and the second finger associated with the first thumb swipe gesture when either the first finger or the second finger is identified as a thumb; and the action of recognizing a first thumb swipe gesture input based on acceleration change data associated with the first wearable electronic device, acceleration change data associated with the second wearable electronic device, and motion data of the first finger and the second finger associated with the first thumb swipe gesture when both the first finger and the second finger are identified as fingers other than the thumb. Alternatively, it may cause to perform at least one of the actions of processing first motion data, second motion data, and finger-specific motion data related to at least one specific gesture, including time-series data related to acceleration.

[0012] According to one embodiment, at least one specific gesture may further include a second thumb swipe gesture, and the second thumb swipe gesture may be a gesture in which the thumb swipes along the side of the index finger. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the operations of recognizing a second thumb swipe gesture input based on the orientation information of the first wearable electronic device, the orientation information of the second wearable electronic device, and motion data of the first finger and the second finger associated with the second thumb swipe gesture, when either the first finger or the second finger is identified as a thumb.

[0013] According to one embodiment, at least one control operation may include at least one of a scroll operation, a volume control operation, an undo and redo operation, a brightness control operation, a media playback control operation, or a page transition operation.

[0014] According to one embodiment, at least one specific gesture may include a grab gesture, and the grab gesture may be a gesture that includes the action of contracting the fingers while the fingers are in an extended state. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may cause the grab gesture input to be recognized based on first motion data, second motion data, and motion data of a first finger and a second finger associated with the grab gesture. The first motion data, second motion data, and finger-specific motion data associated with the grab gesture may be time-series data including information about direction and information about acceleration.

[0015] According to one embodiment, at least one specific gesture may include a tap gesture, the tap gesture may include an action of contacting the distal phalanx of any one of the remaining fingers with the thumb, and at least one control action may include different control actions corresponding to each finger contacting the thumb in response to the tap gesture input. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may cause to perform at least one of the following actions: an action of recognizing a tap gesture input for a specific finger based on first motion data, second motion data, and motion data of a first finger and a second finger associated with the tap gesture; or an action of performing a control action corresponding to a specific finger based on recognizing a tap gesture input for a specific finger. The first motion data, second motion data, and motion data of a first finger and a second finger associated with the tap gesture may be time-series data including information about acceleration.

[0016] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: identifying the activation of a gesture control mode; or transmitting a sensor activation signal to at least one of a first wearable electronic device or a second wearable electronic device based on identifying the activation of a gesture control mode.

[0017] According to one embodiment, the gesture control mode may be a mode capable of performing at least one control operation based on a gesture input related to wearable electronic devices wirelessly connected to an electronic device, and may be activated based on the execution of at least one specific command among commands, a specific signal received from the outside through a communication circuit, or user input. The inertial sensor activation signal may be a signal that causes the first wearable electronic device or the second wearable electronic device to activate at least a part of the built-in sensor.

[0018] According to one embodiment, a wearable electronic device may be provided. A wearable electronic device according to one embodiment may include a communication circuit, an inertial sensor, a memory including at least one storage medium for storing instructions, and at least one processor including a processing circuit. The instructions may cause the wearable electronic device to perform at least one operation when executed individually or collectively by at least one processor. The at least one operation may include: an operation of identifying that a sensor-wide activation condition is satisfied; an operation of activating the entire inertial sensor based on identifying that the sensor-wide activation condition is satisfied; an operation of acquiring motion data of the wearable electronic device periodically or non-periodically; an operation of recognizing a gesture input based on the motion data; or an operation of transmitting a control command corresponding to the gesture input based on recognizing the gesture input.

[0019] According to one embodiment, a method for operating an electronic device may be provided. A method for operating an electronic device according to one embodiment may include: an operation of receiving first sensor data of a first wearable electronic device and second sensor data of a second wearable electronic device periodically or non-periodically; an operation of obtaining first direction information regarding the direction of the first wearable electronic device and second direction information regarding the direction of the second wearable electronic device based on the first sensor data and the second sensor data; and / or an operation of identifying a first finger on which the first wearable electronic device is worn and a second finger on which the second wearable electronic device is worn based on the first direction information and the second direction information.

[0020] According to one embodiment, a method for operating an electronic device may include: acquiring first motion data of a first wearable electronic device and second motion data of a second wearable electronic device based on first sensor data and second sensor data; recognizing a gesture input based on information of identified first finger and second finger, first motion data and second motion data; and / or performing at least one control operation corresponding to the gesture input based on recognizing the gesture input.

[0021] According to one embodiment, a method for operating an electronic device may include: acquiring finger-specific reference motion data associated with at least one specific gesture; identifying motion data of a first finger and a second finger among finger-specific motion data associated with the specific gesture; and / or recognizing a gesture input based on the first motion data, the second motion data, and the motion data of the first finger and the second finger associated with the specific gesture.

[0022] According to one embodiment, a method for operating an electronic device may include: an action of identifying whether a thumb is included among a first finger or a second finger; an action of recognizing a first thumb swipe gesture input based on information regarding the orientation of a first wearable electronic device, information regarding the orientation of a second wearable electronic device, and motion data of the first finger and the second finger related to the first thumb swipe gesture, if it is identified that a thumb is included among the first finger or the second finger; and / or an action of recognizing a first thumb swipe gesture input based on data regarding the acceleration change of the first wearable electronic device, data regarding the acceleration change of the second wearable electronic device, and motion data of the first finger and the second finger related to the first thumb swipe gesture, if it is identified that a thumb is not included among the first finger or the second finger.

[0023] According to one embodiment, a method for operating an electronic device may include, when it is identified that a thumb is included among the first finger or the second finger, an operation of recognizing a second thumb swipe gesture input based on information about the direction of the first wearable electronic device, information about the direction of the second wearable electronic device, and motion data of the first finger and the second finger related to the second thumb swipe gesture.

[0024] According to one embodiment, a method for operating an electronic device may include: an action of recognizing a tap gesture input for a specific finger based on first motion data, second motion data, and motion data of a first finger and a second finger associated with a tap gesture; and / or an action of performing a control action corresponding to a tap gesture for a specific finger based on recognizing the tap gesture input for a specific finger.

[0025] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0026] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment of the present disclosure.

[0027] FIG. 2a illustrates the configuration of a wearable electronic device according to one embodiment of the present disclosure.

[0028] FIG. 2b is a drawing showing a first wearable electronic device and a second wearable electronic device worn according to one embodiment of the present disclosure.

[0029] FIG. 3 is a diagram showing an inertial sensor and a reference coordinate system according to one embodiment of the present disclosure.

[0030] FIGS. 4a and FIGS. 4b are flowcharts illustrating the operation of an electronic device according to one embodiment of the present disclosure.

[0031] FIG. 5 is a flowchart of an operation in which an electronic device according to one embodiment of the present disclosure identifies a finger wearing wearable electronic devices using an instruction gesture.

[0032] FIG. 6a illustrates an unfolding gesture, which is an example of a directive gesture according to one embodiment of the present disclosure.

[0033] FIG. 6b is a diagram showing the change in direction of each finger according to the performance of an unfolding gesture according to one embodiment of the present disclosure.

[0034] FIG. 7 is a diagram showing an electronic device according to one embodiment of the present disclosure displaying information related to guidance of an instruction gesture.

[0035] FIG. 8 is a flowchart of an operation in which an electronic device according to one embodiment of the present disclosure identifies a finger wearing wearable electronic devices using a plurality of gestures.

[0036] FIG. 9 is an operation to explain the operation of an electronic device according to one embodiment of the present disclosure using a combination of finger directions according to various hand gestures.

[0037] FIGS. 10a and FIGS. 10b are drawings illustrating a method for an electronic device according to one embodiment of the present disclosure to recognize a first thumb swipe gesture.

[0038] FIG. 11 is a flowchart of operations in which an electronic device according to one embodiment of the present disclosure recognizes a first thumb swipe gesture and performs a control operation.

[0039] FIG. 12 is a drawing illustrating a method for an electronic device according to one embodiment of the present disclosure to recognize a second thumb swipe gesture.

[0040] FIGS. 13a and FIGS. 13b are drawings for explaining a method for an electronic device to recognize a grab gesture according to one embodiment of the present disclosure.

[0041] FIG. 14 is a drawing illustrating a method for an electronic device to recognize a tap gesture according to one embodiment of the present disclosure.

[0042] FIG. 15 is a drawing illustrating a method for an electronic device according to one embodiment of the present disclosure to recognize a flick gesture.

[0043] FIG. 16 is a drawing for explaining how an electronic device according to one embodiment of the present disclosure recognizes a wrist rotation gesture.

[0044] FIG. 17 is a drawing for explaining a screen and UI displayed by an electronic device according to one embodiment of the present disclosure.

[0045] FIG. 18 illustrates a screen and UI in which an electronic device according to one embodiment of the present disclosure provides gesture guidance.

[0046] FIG. 19 is a diagram illustrating a control operation associated with a first swipe gesture input according to one embodiment of the present disclosure.

[0047] FIG. 20 is a diagram illustrating a control operation associated with a second thumb swipe gesture input according to one embodiment of the present disclosure.

[0048] FIG. 21 is a diagram illustrating a control operation associated with the combination of a first swipe gesture input and a second thumb swipe gesture input according to one embodiment of the present disclosure.

[0049] FIG. 22 is a drawing for explaining the operation of an electronic device amplifying a signal according to one embodiment of the present disclosure.

[0050] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0051] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.

[0052] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0053] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0054] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0055] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0056] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0057] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0058] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0059] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0060] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0061] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0062] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0063] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0064] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0065] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0066] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0067] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0068] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a communication module (192) (e.g., cellular communication module, short-range communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0069] The communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0070] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197). According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, a mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0071] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface) and exchange signals (e.g., commands or data) with each other.

[0072] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0073] FIG. 2a is a drawing showing the configuration of a wearable electronic device according to one embodiment of the present disclosure.

[0074] The components and operations of the components described with reference to FIG. 2a may be, in part or in whole, identical to the components and operations of the components described with reference to FIG. 1. The components and operations of the components described with reference to FIG. 2a may be, in part or in whole, identical to the components and operations of the components described with reference to FIG. 2b through FIG. 15, which will be described later.

[0075] Referring to FIG. 2a, according to one embodiment, a wearable electronic device (200) that interacts with an electronic device (e.g., the electronic device (101) of FIG. 1) supports biometric information sensing functions, touch functions, and wireless communication functions, and may be an electronic device that can be worn on a user's body.

[0076] The wearable electronic device (200) illustrated in FIG. 2a is shown as a ring type (e.g., smart ring) that a user wears on their finger, but is not limited thereto and may be implemented as other types of wearable electronic devices such as a watch type (e.g., smart watch) or a band type (e.g., smart band).

[0077] According to one embodiment, a wearable electronic device (200) may include an annular first housing (e.g., an outer ring housing, a first ring housing, or a first housing portion), and an annular second housing (e.g., an inner ring housing, a second ring housing, or a second housing portion) coupled to the first housing and including an opening. The opening may be formed to a size into which a user's finger can be inserted. For example, the first housing may be formed of a material that withstands external impact or scratches, such as a metal material, ceramic, or stainless steel. The first housing may also undergo a separate fixing or coating process for color implementation. The second housing may be formed of the same material as the first housing, or may be formed of a material such as a molding material for sensing, plastic, or glass. The second housing may also be formed such that a metal material for biometric measurement is composed of at least a portion thereof.

[0078] According to one embodiment, the wearable electronic device (200) may include a processor (210), memory (220), communication module (230), antenna (225), battery (240), charging interface (245), at least one biometric sensor (250), touch sensor (260), inertial sensor (270), temperature sensor (280), and / or a power management integrated circuit (PMIC) (290) disposed in the space between a first housing and a second housing. Some components may be disposed on a substrate (295) (e.g., FPCB, flexible printed circuit board) that is flexible to correspond to the curvature of the wearable electronic device (200).

[0079] According to one embodiment, the wearable electronic device (200) may further include other components (e.g., a display, an ultrasonic sensor, an audio output device) in addition to the illustrated components.

[0080] According to one embodiment, the communication module (230) may include various hardware and / or software configurations to support wireless communication with an external electronic device (e.g., the electronic device (101) of FIG. 1). The wearable electronic device (200) may transmit and receive various data or control commands to and from the electronic device (101) via wired or wireless means through the communication module (230). In one embodiment, the communication module may support near-field wireless communication. Near-field wireless communication includes, but is not limited to, Bluetooth, BLE (Bluetooth Low Energy), ZigBee, ANT+, Wi-Fi, Cellular (LTE, 5G, 6G, NB-IoT), NFC (near field communication), RFID (radio frequency identification), UWB (ultra-wideband), GNSS (global navigation satellite system), or / and MST (magnetic secure transmission). According to one embodiment, the communication module (230) may be implemented in a form integrated with the processor (210).

[0081] According to one embodiment, the antenna (225) may be connected to a communication module (230) through a substrate (295). The wearable electronic device (200) may transmit or receive communication signals / data to or from the outside through the antenna (225). The antenna (225) may include a single or multiple antennas. According to one embodiment, a part of the first housing (210) (e.g., a metal member) may be designed to be used as the antenna (225).

[0082] According to one embodiment, the battery (240) may be formed in a curved shape to have a curvature corresponding to the curvature of the space between the first housing (210) and the second housing (220). The battery (240) may be configured such that a plurality of battery packs are arranged separately. The battery (240) may be connected to a charging interface (245).

[0083] According to one embodiment, the charging interface (245) may be electrically connected to a PMIC (290) mounted on the substrate (295) via the substrate (295). The charging interface (245) may support wired charging (e.g., terminal) or wireless charging (e.g., WPC, NFC) methods for charging.

[0084] According to one embodiment, at least one biometric sensor (250) can acquire various biometric information of a user using an optical signal. For example, the biometric sensor (250) may be a photoplethysmogram (PPG) sensor or an optical sensor capable of acquiring various biometric information such as heart rate and blood circulation by measuring a plethysmogram according to an optical signal, but is not limited thereto. The biometric sensor (250) may acquire biometric information such as heart rate (HR), blood pressure, saturation of percutaneous oxygen (SpO2), galvanic skin response (GSR), electrocardiography (ECG), blood flow velocity, and bioelectrical impedance, but is not limited thereto.

[0085] According to one embodiment, the biometric sensor (250) may include a fingerprint sensor.

[0086] A biometric sensor (250) according to one embodiment may include a sensor controller (250a), a plurality of emitters (250b) that output a light signal, and a plurality of receivers (250c) that receive a light signal. The emitters (250b) may include a light-emitting element that emits various wavelengths or colors (e.g., Green, Red) to measure a biometric signal. The emitters (250b) may be formed as at least one of a light-emitting diode (LED), a laser diode (LD), an infrared (IR) diode, and a VCSEL. The receivers (250c) may be formed as a photodiode (PD) or a complementary metal-oxide-semiconductor (CMOS) camera. The receivers (250c) may convert the received light signal through an analog-to-digital converter (ADC) and store it in a processor (210) or memory (220). The sensor controller (250a) can control the light-emitting part (250b) and the light-receiving part (250c).

[0087] According to one embodiment, the touch sensor (260) can detect a touch signal from a user touching the wearable electronic device (200). The touch sensor (260) may be formed in at least one of, for example, pressure, capacitive, optical, or ultrasonic methods. According to one embodiment, the touch sensor (260) may be omitted.

[0088] According to one embodiment, the inertial sensor (270) can acquire movement information of the wearable electronic device (200). For example, the inertial sensor (270) can detect motion, gesture, impact, posture and / or activity (e.g., sedentary, moving, sports). The inertial sensor (270) may be formed as a 3-axis accelerometer, may be formed as a 6-axis sensor including an accelerometer and a gyroscope, and may be formed as a 9-axis sensor including an accelerometer, a gyroscope, and a magnetometer, but is not limited thereto. The inertial sensor (270) may also be referred to as an IMU (inertial measurement unit) sensor.

[0089] According to one embodiment, a wearable electronic device (200) can acquire various data using an inertial sensor (270). The various data acquired using the inertial sensor (270) is data related to a physical state in space, and may include data directly detected by the inertial sensor (270) (e.g., acceleration, angular velocity) and / or data acquired by processing the data directly detected by the inertial sensor (270). Hereinafter, the data directly detected by the inertial sensor (270) may be referred to as 'sensor data', and the various data acquired using the inertial sensor (270) may be referred to as 'motion data'.

[0090] According to one embodiment, the accelerometer included in the inertial sensor (270) can detect three-axis (e.g., x-axis, y-axis, z-axis) acceleration, the gyroscope can detect three-axis angular velocity, and the magnetometer can detect three-axis magnetic field data to detect orientation toward the magnetic north pole. The processor (210) can process the detected data to produce data such as velocity, quaternion, position, displacement, rotation angle with respect to a specific axis (e.g., roll angle, pitch angle, yaw angle), total rotation angle, and angular acceleration, and can identify vibration and / or shock patterns.

[0091] According to one embodiment, the temperature sensor (280) can measure the body temperature of a user or the temperature of a component (e.g., an electronic component) included in the wearable electronic device (200). The temperature sensor (280) may be formed in a contact or non-contact manner and may vary depending on the design. The wearable electronic device (201) may use the temperature information recorded through the temperature sensor (280) to record in memory or, under the control of a processor, to measure the user's body temperature, estimate skin temperature, or estimate situational awareness.

[0092] According to one embodiment, the PMIC (290) can manage power delivered from the battery (240) to each component of the wearable electronic device (201).

[0093] According to one embodiment, the memory (220) can store various instructions that can be executed by the processor (210). Such instructions may include control instructions such as arithmetic and logical operations, data movement, or input / output that can be recognized by the processor (210).

[0094] According to one embodiment, the processor (210) may be configured to perform operations or data processing regarding the control and / or communication of each component of the wearable electronic device (200), and may be composed of one or more processors. There may be no limitations on the operations and data processing functions that the processor (210) can implement on the wearable electronic device (200), but in the present disclosure, it may process various operations to support authentication in conjunction with the electronic device (101).

[0095] FIG. 2b illustrates wearable electronic devices according to one embodiment of the present disclosure being worn.

[0096] According to one embodiment, there may be a first wearable electronic device (201) and a second wearable electronic device (202). The first wearable electronic device (201) and the second wearable electronic device (202) may have a configuration such as, for example, the wearable electronic device (200) of FIG. 2a.

[0097] Referring to FIG. 2b, according to one embodiment, a first wearable electronic device (201) may be worn on a first finger (f201), and a second wearable electronic device (202) may be worn on a second finger (f202). In FIG. 2b, the first finger (f201) is shown as an index finger and the second finger (f202) as a ring finger, but this is merely an example and is not limited thereto. For example, the first wearable electronic device (201) and the second wearable electronic device (202) may be worn in a total of 20 different ways, even if limited only to cases where they are worn on different fingers of the same hand. Meanwhile, at least one of the first wearable electronic device (201) or the second wearable electronic device (202) may be a wearable electronic device worn on a different part of the hand or on the wrist.

[0098] Meanwhile, according to one embodiment, in order to reduce costs, some of the configurations described in FIG. 2a may be omitted from at least one of the first wearable electronic device (201) and the second wearable electronic device (202). For example, all or part of the configurations, excluding the processor (210), memory (220), communication module (230), battery (240), and inertial sensor (270), may be omitted.

[0099] According to one embodiment, the fingers wearing the first wearable electronic device (201) and / or the second wearable electronic device (202), namely the first finger (f201) and / or the second finger (f202), may change continuously. For example, the first finger (f201) may be the index finger at a certain point in time and the middle finger at another point in time, and the second finger (f202) may be the ring finger at a certain point in time and the thumb at another point in time. For the convenience of the user, the user may freely wear the wearable electronic device at any desired location within the limits of its structurally possible, and accordingly, consistent interaction may be required regardless of the wearing position.

[0100] According to one embodiment, the first wearable electronic device (201) and the second wearable electronic device (202) can recognize the performance of a specific gesture using motion data acquired using an embedded inertial sensor (e.g., the inertial sensor (270) of FIG. 2a). The specific gesture may be a gesture associated with a control command for controlling the wearable electronic device or another connected electronic device (e.g., the electronic device (101) of FIG. 1). In this case, even if the same hand gesture is performed, if the first finger (f201) and / or the second finger (f202) are changed, the motion data (e.g., rotation angle) of the first wearable electronic device (201) and the second wearable electronic device (202) resulting from the performance of the same hand gesture may differ.

[0101] According to one embodiment, by identifying which fingers the first finger (f201) and the second finger (f202) are, spatial state data of the first wearable electronic device (201) and the second wearable electronic device (202) can be interpreted more accurately. For example, based on identifying that the first finger (f201) is the thumb and the second finger (f202) is the index finger, data showing an increase in the angle between the first wearable electronic device (201) and the second wearable electronic device (202) can be interpreted as the performance of a pinch-out gesture.

[0102] FIG. 3 is a drawing for explaining an inertial sensor and a reference coordinate system according to one embodiment of the present disclosure.

[0103] According to one embodiment, an absolute direction can be recognized on a reference frame (300) using a 9-axis inertial sensor that includes a magnetic field. Referring to FIG. 4, the reference frame (300) may be a coordinate system defined by x-axis (310), y-axis (320), and z-axis (330) that are orthogonal to each other in space. The reference frame (300) may be, for example, a world coordinate system set with respect to the Earth's magnetic field. The reference frame (300) can be used as a reference to determine the absolute direction from data measured through the inertial sensor (e.g., 3-axis magnetic field data).

[0104] Referring to FIG. 4, according to one embodiment, rotation in space can be indicated using roll (315), pitch (325), and yaw (335). For example, roll (315) can represent rotation about the x-axis, pitch (325) can represent rotation about the y-axis, and yaw (335) can represent rotation about the z-axis. The signs of roll (315), pitch (325), and yaw (335) can be determined according to the right-hand rule.

[0105] Meanwhile, according to one embodiment, the angle between two objects can be calculated using a quaternion representing the orientation of the objects in the same reference coordinate system (300). A quaternion is a mathematical expression used to represent the rotational state of an object in three-dimensional space and may be a four-dimensional vector consisting of four complex values. For example, the quaternion of the first wearable electronic device (201) and the quaternion of the second wearable electronic device (202) When, the relative rotation between two objects is It can be calculated as, and the angle between two objects can be calculated from the relative rotation.

[0106] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2a, the first wearable electronic device (201) or the second wearable electronic device (202)) can obtain a rotation angle about any axis using roll (315), pitch (325) and yaw (335). This can be calculated by performing a coordinate axis transformation from a reference coordinate system (300). The transformation can be performed by transforming the coordinate values ​​of the x-axis (310), y-axis (320), and z-axis (330) using a rotation matrix, or by transforming a quaternion of the reference coordinate system into a quaternion of the new coordinate system.

[0107] FIG. 4a is a flowchart illustrating the operation of an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure.

[0108] In operation 410, the electronic device (101) can identify a surrounding first wearable electronic device (201) and a second wearable electronic device (202) connected via wireless communication through a communication module (190). Identification of the wearable electronic devices may include identifying that the connected wearable electronic devices are worn by the user. For example, the first wearable electronic device (201) and / or the second wearable electronic device (202) may detect that they are worn using a biometric sensor (e.g., the biometric sensor (250) of FIG. 2a).

[0109] In operation 420, the electronic device (101) may receive first sensor data from the first wearable electronic device (201) and second sensor data from the second wearable electronic device (202). The first sensor data and the second sensor data may include data detected through an inertial sensor (e.g., the inertial sensor (270) of FIG. 2a or FIG. 3). The electronic device (101) may not receive the first sensor data and the second sensor data only once at a specific point in time, but may receive them continuously, for example, periodically or non-periodically. The first sensor data and / or the second sensor data may include data regarding angular velocity, acceleration, and direction (e.g., azimuth). The first sensor data and / or the second sensor data may include time-series data.

[0110] In operation 430, the electronic device (101) may acquire first motion data using first sensor data and acquire second motion data using second sensor data. Motion data is data representing the physical movement or state of an object in space, and may include sensor data (e.g., direction, acceleration) and / or data obtained by processing sensor data (e.g., rotation in space (roll, pitch, yaw), velocity). The first motion data and / or second motion data may include information about direction (e.g., direction, change of direction, rotation, angle of rotation).

[0111] The notations 'first sensor data', 'first motion data', 'second sensor data', and 'second motion data' in the present disclosure, including FIG. 4a, refer only to data for the first wearable electronic device (201) and the second wearable electronic device (202), respectively, and do not refer to the same data as 'first sensor data', 'first motion data', 'second sensor data', and 'second motion data' in other descriptions of the present disclosure. For example, the first sensor data (e.g., direction) detected at a certain point in time (e.g., first point in time) may be different from the first sensor data (e.g., direction) detected at another point in time (e.g., second point in time).

[0112] In operation 440, the electronic device (101) can identify which finger the first wearable electronic device (201) and the second wearable electronic device (202) are each worn on based on information regarding the orientation of the first wearable electronic device (201) and the second wearable electronic device (202). For example, the electronic device (101) can identify the finger the first wearable electronic device (201) is worn on as a thumb from the orientation, rotation pattern, and / or change in direction over time of the first wearable electronic device (201).

[0113] FIG. 4b is a flowchart illustrating the operation of an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure.

[0114] According to one embodiment, operations 450 to 460 of the electronic device (101) of FIG. 4b may be operations that follow in time from operations 410 to 440 of FIG. 4a, but are not limited thereto.

[0115] As described above in operation 440 of FIG. 4a, the electronic device (101) can identify which fingers the first finger (f201) and the second finger (f202) are, respectively, to which the first wearable electronic device (201) and the second wearable electronic device (202) are worn.

[0116] In operation 450, the electronic device (101) can acquire finger-specific motion data associated with a specific gesture. The finger-specific motion data may include, for example, predefined data. The finger-specific motion data may include time-series data, such as data stored in advance regarding the movement and / or direction of each finger associated with the performance of a specific gesture, and may be used as reference data for recognizing the user's gesture. The finger-specific motion data that serves as a criterion for matching for gesture recognition may also be referred to as 'reference motion data'.

[0117] In operation 460, the electronic device (101) can re-acquire first motion data and second motion data from the first wearable electronic device (201) and the second wearable electronic device (202), respectively. The first motion data and the second motion data may include information about direction and / or information about acceleration (e.g., time-series acceleration data, acceleration change patterns) and may be used to track the spatial state of the fingers (f201, f202) worn by the first wearable electronic device (201) and the second wearable electronic device (202).

[0118] In operation 470, the electronic device (101) can recognize a gesture input based on the acquired first motion data and second motion data. At this time, according to one embodiment, the electronic device (101) can recognize a gesture input based on the finger information identified in operation 440, that is, information about the first finger (f201) and the second finger (f202), the first motion data, and the second motion data.

[0119] According to one embodiment, the electronic device (101) can recognize a gesture input based on finger-specific reference motion data, first motion data, and second motion data in motion 450. For example, according to one embodiment, the electronic device (101) can recognize a gesture input by matching the first motion data and second motion data in motion 460 to the reference motion data.

[0120] According to one embodiment, the matching of the first motion data and the second motion data with the reference motion data can be performed using, for example, a pattern matching technique (e.g., DTW (dynamic time warping), CNN (convolutional neural network), LSTM (long short-term memory)). The electronic device (101) may normalize the data prior to performing the matching between the data.

[0121] According to one embodiment, an electronic device (101) may determine that a specific gesture has been performed when the similarity of the matching result between finger-specific reference motion data related to a specific gesture and the first motion data and the second motion data exceeds a reference value (e.g., a predetermined reference value), that is, when the motion data matches or there is only a difference within a tolerance (e.g., a predetermined tolerance). The similarity and / or error may be calculated using at least one mathematical tool related to appropriate data analysis (e.g., DTW, cosine similarity, mean squared error) as needed. For example, the electronic device (101) may determine that a gesture has been performed when the DTW distance between finger-specific reference motion data related to a specific gesture and the first motion data and the second motion data is less than or equal to 0.9, the cosine similarity is greater than or equal to 0.9, and / or the mean squared error is less than or equal to 10.

[0122] In operation 480, the electronic device (101) can perform at least one control action corresponding to the recognized gesture input. For example, if the gesture input is a swipe action in a specific direction, the electronic device (101) can perform a control action such as screen scrolling or application switching.

[0123] FIG. 5 is a flowchart illustrating the operation of an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure identifying a finger using information related to a pointing gesture.

[0124] In operation 510, the electronic device (101) can identify the first wearable electronic device (201) and the second wearable electronic device (202), for example, as in operation 410.

[0125] In operation 520, the electronic device (101) can acquire time-series data regarding finger-specific directions associated with an instruction gesture. The instruction gesture may be a user gesture pre-set to accurately identify the finger on which the wearable electronic device is worn. The time-series data regarding directions may include, for example, information regarding the rotation angle and / or rotation direction of each finger in relation to the performance of the instruction gesture.

[0126] In operation 530, the electronic device (101) can output information related to the guide of the instruction gesture. The information related to the guide of the instruction gesture may be output visually with a user interface (UI) through a display of the electronic device (101) (e.g., the display module (160) of FIG. 1) or audibly through a speaker (e.g., the sound output module (155) of FIG. 1).

[0127] In operation 540, the electronic device (101) can obtain information regarding the direction of the first wearable electronic device (201) and the second wearable electronic device (202) following the guidance of the instruction gesture. The information regarding the direction may include information related to changes in direction and / or rotation following the performance of the instruction gesture. The electronic device (101) can obtain information regarding the direction by receiving it from the first wearable electronic device (201) and the second wearable electronic device (202), or by processing the received information (e.g., performing operations based on the received information).

[0128] In operation 550, the electronic device (101) can identify the fingers (f201, f202) on which the first wearable electronic device (201) and the second wearable electronic device (202) are worn based on information regarding the orientation of the first wearable electronic device (201) and the second wearable electronic device (202). For example, if the rotation angle about a specific axis in relation to the performance of a directive gesture is predefined to be 70° or more only for the thumb, the electronic device (101) can identify the first finger (f201) on which the first wearable electronic device (201) is worn as the thumb based on obtaining information that the rotation angle about the specific axis of the first wearable electronic device (201) is 80°.

[0129] FIG. 6a is a drawing for illustrating an example of a directing gesture (e.g., the directing gesture of FIG. 5) according to one embodiment of the present disclosure.

[0130] FIG. 6b is a drawing illustrating an example of an angle change with respect to a specific axis of rotation of each finger according to the performance of an instruction gesture according to one embodiment of the present disclosure. In FIG. 6b, the counterclockwise direction is described as the positive direction of rotation.

[0131] Referring to FIG. 6a, according to one embodiment, an axis perpendicular to the palm surface and facing the palm direction can be set as the rotation axis (630). Since the direction of the rotation axis (630) may change over time (e.g., due to changes caused by the user's hand movements), the electronic device (101) can calculate accurate rotation and / or direction data relative to the rotation axis (630) despite changes in the direction of the rotation axis (630) by performing dynamic coordinate axis transformation based on a reference coordinate system (e.g., the reference coordinate system (300) of FIG. 3).

[0132] Referring to FIG. 6a, according to one embodiment, the instruction gesture may be an opening gesture, that is, a gesture from a position with fingers together (610) to a position with fingers extended (620). In this case, generally, the angle difference between the rotation about the axis of rotation (630) in the opening gesture, that is, the position with fingers extended (620) and the position with fingers together (610), may differ for each finger.

[0133] According to one embodiment, the guidance of the instruction gesture may include a direction of the rotation axis (630). For example, if the instruction gesture is an open gesture starting from a palm-up gesture, the guidance of the instruction gesture includes the direction of the palm, and in this case, the rotation axis (630) may be set in the opposite direction of gravity. However, as described above, since the electronic device (101) can perform coordinate axis transformation operations, a direction of the rotation axis (630) may not necessarily be required.

[0134] Referring to FIG. 6b, according to one embodiment, in a position with fingers together (610), the direction of each finger may be the same as the illustrated thumb (611), index finger (612), middle finger (613), ring finger (614), and little finger (615). In a position with fingers extended (620), the direction of each finger may be the same as the illustrated thumb (621), index finger (622), middle finger (623), ring finger (624), and little finger (625). Generally, the rotation angle of the middle finger with respect to the axis of rotation (630) is close to 0, and the ring finger and little finger may rotate in a positive direction, while the thumb and index finger may rotate in a negative direction.

[0135] According to one embodiment, the electronic device (101) can identify the first finger (f201) and the second finger (f202) based on information regarding the orientation of the first wearable electronic device (201) and information regarding the orientation of the second wearable electronic device (202). For example, the electronic device (101) can identify the first finger (f201) and the second finger (f202) by analyzing the change in angle with respect to the rotation axis (630) of each wearable electronic device in an open gesture and matching it with a unique rotation pattern for each finger (e.g., a predefined rotation pattern for each finger).

[0136] According to one embodiment, the electronic device (101) may analyze a general finger-specific rotation pattern resulting from the performance of an open gesture and set conditions for identifying each finger in advance. The conditions for identifying fingers may be related to information regarding finger-specific rotation. For example, the electronic device (101) may identify that the wearable electronic device is worn on the thumb if the magnitude of the rotation angle exceeds 70°, on the little finger if it exceeds 40° and is 70° or less, on the index or ring finger if it exceeds 10° and is 40° or less, and on the middle finger if it is 10° or less. Based on these finger identification conditions, for example, if the rotation angle of the first wearable electronic device (201) is -80° and the rotation angle of the second wearable electronic device (202) is -30°, the electronic device (101) may identify that the first finger (f201) is the thumb and the second finger (f202) is the index finger. For example, the rotation angle of the first wearable electronic device (201) When the angle of rotation of the second wearable electronic device (202) is less than 10° and the angle of rotation is +60°, the electronic device (101) can identify that the first finger (f201) is the middle finger and the second finger (f202) is the little finger. The specific angle reference values ​​described above are exemplary and the present disclosure is not limited thereto.

[0137] Meanwhile, it may be difficult to distinguish between the index finger and the ring finger using only the method described above. For example, when the rotation angle of the first wearable electronic device (201) is -30° and the rotation angle of the second wearable electronic device (202) is +30°, depending on whether the hand being worn is the left or right hand and the direction of the axis of rotation, the first finger (f201) may be the index finger and the second finger (f202) may be the ring finger, or the first finger (f201) may be the ring finger and the second finger (f202) may be the index finger. The specific angle reference values ​​described above are exemplary and the present disclosure is not limited thereto.

[0138] Accordingly, according to one embodiment, the electronic device (101) may output guidance for a gesture of direction, including indicating the direction of the hand to distinguish between the index finger and the ring finger (e.g., guidance to perform the gesture with the palm facing the direction of gravity for the left hand, and the palm facing the opposite direction of gravity for the right hand). Additionally, the electronic device (101) may guide the performance of an additional gesture of direction to distinguish between the index finger and the ring finger (e.g., V gesture for the index and middle fingers). The electronic device (101) can also distinguish between the index finger and the ring finger by using the direction of the hand and / or the additional gesture of direction, and ultimately, the user can identify the worn finger regardless of where the first wearable electronic device (201) and the second wearable electronic device (202) are worn.

[0139] According to one embodiment, the instruction gesture of the present disclosure may be implemented as various gestures for accurately identifying the fingers worn by the wearable electronic device, in addition to the spreading gesture exemplarily illustrated in FIG. 6a and 6b. For example, the instruction gesture may be a pinch gesture in which the thumb and index finger come together, in which case the electronic device (101) may identify the first finger (f201) and / or the second finger (f202) using finger-specific motion data (e.g., acceleration change pattern, vibration pattern) that occurs when the thumb and index finger collide.

[0140] FIG. 7 is a drawing illustrating visual guidance of an instruction gesture according to one embodiment of the present disclosure.

[0141] Referring to FIG. 7, according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) can visually output information (710) guiding a directing gesture (e.g., the spreading gesture of FIG. 6a) through a display (e.g., the display module (160) of FIG. 1). At this time, as described above, information specifying the direction of the hand to distinguish between the index finger and the ring finger may be included.

[0142] According to one embodiment, after the electronic device (101) outputs information related to guidance of a instruction gesture, it can obtain information about the direction of the first wearable electronic device (201) and the second wearable electronic device (202), match this with information about the direction related to the instruction gesture (e.g., predefined direction information related to the instruction gesture), identify the first finger (f201) and the second finger (f202), and output information (720) indicating that the fingers have been recognized through a display.

[0143] FIG. 8 is a flowchart illustrating an operation in which an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure identifies a finger using information related to a plurality of gestures.

[0144] FIG. 9 is a diagram illustrating the operation of an electronic device (101) according to one embodiment of the present disclosure identifying a finger using a finger direction combination database associated with a plurality of gestures.

[0145] In operation 810, the electronic device (101) can identify the first wearable electronic device (201) and the second wearable electronic device (202), for example, as in operation 410 of FIG. 4a.

[0146] Referring to FIGS. 8 and 9, in operation 820, the electronic device (101) can obtain information regarding finger-specific directions associated with a plurality of gestures. The plurality of gestures may include various hand movements and / or hand postures (910), for example, that may occur in daily life. The information regarding finger-specific directions associated with the plurality of gestures may include finger-specific direction information corresponding to various hand movements and / or hand postures (910), for example.

[0147] According to one embodiment, finger-specific direction information may be stored individually for each finger, or two finger direction information combinations (920) may be stored in a combined state of two direction information by combining two fingers (e.g., a combination of thumb and index finger). The direction information combinations (920) may be stored, for example, in an external database (930) or in an internal storage space (e.g., memory (130) of FIG. 1).

[0148] According to one embodiment, when using a combination of two directional information (920), the finger being worn by the wearable electronic device can be identified more accurately than when using directional information individually for each finger. This is because, by considering the positional and / or directional relationship between the two fingers, similar movements that are difficult to distinguish with the directional data of a single finger (e.g., finger movements overlapping at a specific angle) can be identified more clearly. For example, a combination of directional information where the thumb and index finger are combined at a specific angle can enable the accurate identification of a specific gesture that is difficult to identify with the directional information of either the thumb or the index finger.

[0149] Referring to FIGS. 8 and FIGS. 9, in operation 830, the electronic device (101) can obtain information (940) about the orientation of the first wearable electronic device (201) and the second wearable electronic device (202), for example, as in operation 540 of FIG. 5.

[0150] Referring to FIGS. 8 and 9, in operation 840, the electronic device (101) can identify a first finger (f201) and a second finger (f202) based on information regarding the orientation of a first wearable electronic device (201) and a second wearable electronic device (202), and information regarding the orientation associated with a plurality of gestures. The operation of identifying the first finger (f201) and the second finger (f202) may include an operation of matching information (940) regarding the orientation of the first wearable electronic device and the second wearable electronic device with information in a finger orientation combination database (930). For example, the electronic device (101) can determine that the first finger (f201) and the second finger (f202) are the index finger and the ring finger if the information (940) regarding the orientation of the first wearable electronic device and the second wearable electronic device matches a specific combination of finger orientation information combinations (e.g., a combination of the index finger and the ring finger) with a predetermined value (e.g., 90%) or higher.

[0151] FIGS. 10a and FIGS. 10b are drawings illustrating a method for an electronic device to recognize gesture input according to one embodiment of the present disclosure.

[0152] Hereinafter, the gesture of the thumb swiping along the proximal phalanges of the other four fingers is referred to as the ‘first thumb swipe gesture (1000).’

[0153] According to one embodiment, the electronic device (101) can identify, for example, cases where a thumb is included in either the first finger (f201) or the second finger (f202) and cases where no thumb is included, respectively, by performing at least some of the operations of FIG. 5 and / or FIG. 8. FIG. 10a is illustrated as the first finger (f201) on which the first wearable electronic device (201) is worn being a thumb and the second finger (f202) on which the second wearable electronic device (202) is worn being a ring finger, and FIG. 10b is illustrated as the first finger (f201) being an index finger and the second finger (f202) being a ring finger, but these are merely examples of cases where a thumb is included and cases where it is not, respectively, and the present disclosure is not limited thereto.

[0154] Referring to FIG. 10a and FIG. 10b, the first thumb swipe gesture (1000) may include a series of movements leading to a position where the thumb is in contact with the index finger (1010), a position where the thumb is in contact with the middle finger (1020), a position where the thumb is in contact with the ring finger (1030), and a position where the thumb is in contact with the little finger (1040), and / or the reverse of the movements.

[0155] According to one embodiment, in a position (1010) where the thumb is in contact with the index finger, the angle between the direction (1011) of the first wearable electronic device (201) and the direction (1012) of the second wearable electronic device (202) may be relatively small (e.g., 10° or less). In a position (1010) where the thumb is in contact with the index finger, the maximum acceleration corresponding to the maximum amplitude of the time-series acceleration data (1051) included in the first motion data of the first wearable electronic device (201) may be relatively large (e.g., 20g or more with respect to gravitational acceleration g), and the maximum amplitude of the time-series acceleration data (1052) included in the second motion data of the second wearable electronic device (202) may be relatively small (e.g., 1 to 3g). According to one embodiment, the maximum amplitude of the waveform in the time-series acceleration data may be proportional to the intensity of the impact.

[0156] According to one embodiment, in a posture (1020) where the thumb is in contact with the middle finger, the angle between the direction (1021) of the first wearable electronic device (201) and the direction (1022) of the second wearable electronic device (202) may be slightly increased compared to the posture (1010) where the thumb is in contact with the index finger (e.g., greater than 10° and less than or equal to 30°). Additionally, the maximum amplitude of the acceleration data (1061) included in the first motion data and the maximum amplitude of the acceleration data (1062) included in the second motion data may be at a similar level to each other, and may be approximately midway between the maximum amplitudes of the acceleration data (1051, 1052) in the posture (1010) where the thumb is in contact with the index finger (e.g., 5g to 15g).

[0157] According to one embodiment, in a position (1030) where the thumb is in contact with the ring finger, the angle between the direction (1031) of the first wearable electronic device (201) and the direction (1032) of the second wearable electronic device (202) may be slightly increased (e.g., greater than 30° and less than or equal to 50°). Also, the maximum amplitude of the acceleration data (1071) of the first wearable electronic device (201) may be reduced (e.g., 1 to 3g), and the maximum amplitude of the acceleration data (1072) of the second wearable electronic device (202) may be increased (e.g., more than 20g).

[0158] According to one embodiment, in a posture (1040) where the thumb is in contact with the little finger, the angle between the direction (1031) of the first wearable electronic device (201) and the direction (1042) of the second wearable electronic device (202) may be further increased (e.g., greater than 50°). Additionally, compared to a posture (1030) where the thumb is in contact with the ring finger, the acceleration data (1081) of the first wearable electronic device (201) and the acceleration data (1082) of the second wearable electronic device (202) may both be decreased.

[0159] According to one embodiment, when a thumb is included among the first finger (f201) and the second finger (f202), the electronic device (101) can estimate the direction of the first swipe gesture (1000) and the degree of the swipe based on the relative angle between the direction of the first wearable electronic device (201) and the direction of the second wearable electronic device (202). Specifically, the angle between the direction of the first wearable electronic device (201) and the direction of the second wearable electronic device (202) If so, the degree of swiping is tan( It can be proportional to ).

[0160] According to one embodiment, when the thumb is not present among the first finger (f201) and the second finger (f202), the electronic device (101) can detect the degree of impact based on acceleration data and estimate the direction and degree of swipe of the first swipe gesture (1000). When the greatest acceleration is detected in the first wearable electronic device (201), it can be estimated that the thumb is in contact with the first finger (f201), and when the greatest acceleration is detected in the second wearable electronic device (202), it can be estimated that the thumb is in contact with the second finger (f202), and the distance between the finger currently in contact with the thumb and the second finger (f202) or the first finger (f201) can be estimated from the magnitude of the relative acceleration.

[0161] According to one embodiment, if either the first finger (f201) or the second finger (f202) is the little finger and the other is a finger other than the thumb (e.g., if the first finger (f201) is the index finger and the second finger (f202) is the little finger), the change in acceleration of the wearable electronic device worn on the little finger may not be significant even when the first thumb swipe gesture (1000) is performed. This may be because, during the thumb swipe motion, the thumb does not go down well to the little finger, or even if it does, it touches with a relatively weak force. Accordingly, for the wearable electronic device worn on the little finger, hardware and / or software amplification of acceleration data may be required.

[0162] According to one embodiment, data of weak impact or small acceleration change can be amplified using a hardware amplifier circuit. By amplifying the weak signal to a detectable range through the amplifier circuit, the sensitivity of the sensor can be increased and accurate analysis of the impact data can be made possible. The amplifier circuit may be a component included in the electronic device (101) or may be a component included in the wearable electronic device (e.g., the wearable electronic device (200) of FIG. 2, the first wearable electronic device (201), the second wearable electronic device (202)). Meanwhile, a low noise amplifier (LNA) may be used to prevent excessive amplification of noise and to maintain the signal-to-noise ratio (SNR).

[0163] According to one embodiment, data regarding weak impacts or small acceleration changes can be amplified by performing software-based upsampling. Upsampling may be a technique for interpolating data to a higher sampling frequency. Upsampling can be combined with a signal processing algorithm to improve sensitivity and accuracy to weak impacts.

[0164] FIG. 11 is a flowchart illustrating the process in which an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure performs a control operation in response to a first thumb swipe gesture (1000) input.

[0165] In operation 1110, the electronic device (101) can identify the first finger (f201) and the second finger (f202). The electronic device (101) can identify the fingers by performing, for example, at least some of the operations in FIG. 5 and / or FIG. 8.

[0166] In operation 1120, the electronic device (101) can identify whether the thumb is included among the first finger (f201) or the second finger (f202). This may be because the method of recognizing the first thumb swipe gesture (1000) varies depending on whether the thumb is included, for example, as in FIG. 10a and FIG. 10b.

[0167] In operation 1131, the electronic device (101) can acquire orientation data of the first wearable electronic device (201) and the second wearable electronic device (202) based on identifying whether the thumb is included among the first finger (f201) or the second finger (f202). The orientation data may include at least one of each absolute direction (e.g., direction in a reference coordinate system) or the relative direction between the two.

[0168] In operation 1141, the electronic device (101) can recognize the input of a first thumb swipe gesture (1000) based on direction data, for example, using the angle between the direction of the first wearable electronic device (201) and the direction of the second wearable electronic device as in FIG. 10a. The recognition of the gesture (1000) input may include the direction of the swipe and / or the degree of the swipe.

[0169] In operation 1132, the electronic device (101) may acquire acceleration data of the wearable electronic device (201) and the second wearable electronic device (202) based on identifying that the thumb is not included among the first finger (f201) or the second finger (f202). The acceleration data may include time-series acceleration data. Meanwhile, the data acquired in operation 1131 and / or operation 1132 may include time-series data.

[0170] In operation 1142, the electronic device (101) can recognize the input of a first thumb swipe gesture (1000) based on acceleration data, for example, by using the acceleration change over time of the first wearable electronic device (201) and the second wearable electronic device (202) as in FIG. 10b.

[0171] In operation 1150, the electronic device (101) may perform at least one corresponding control operation based on recognizing the input of the first thumb swipe gesture (1000). The at least one control operation may include, for example, at least one of a scroll operation, a volume control operation, an undo or redo operation, a brightness control operation, a media playback control operation, or a page transition operation.

[0172] FIG. 12 is a drawing for explaining a method in which an electronic device according to one embodiment of the present disclosure recognizes a gesture input.

[0173] Hereinafter, a gesture in which the thumb swipes along the side of the index finger as in FIG. 12 is referred to as the ‘second thumb swipe gesture (1200)’.

[0174] Referring to FIG. 12, according to one embodiment, the second thumb swipe gesture (1200) may include a movement from a position (1210) in which the thumb is positioned at the fingertip of the index finger (e.g., distal phalanx) to a position in which the thumb is positioned at the back of the index finger (e.g., proximal phalanx or metacarpal bone) and / or the reverse movement.

[0175] According to one embodiment, the rotation of the thumb in each of the first thumb swipe gesture (1000) and the second thumb swipe gesture (1200) may occur on planes perpendicular to each other. That is, the rotation axes of the thumb in each may be orthogonal to each other. For example, if the rotation of the thumb in the first thumb swipe gesture (1000) is in the yaw direction, the rotation of the thumb in the second thumb swipe gesture (1200) may be in the roll or pitch direction.

[0176] According to one embodiment, the electronic device (101) has an angle between the direction of the first wearable electronic device (201) and the direction of the second wearable electronic device (202) when the thumb is included among the first finger (f201) or the second finger (f202). Based on the change, the direction and / or degree of the second thumb swipe gesture (1200) input can be recognized. For example, if the direction in which the relative angle increases is a gesture input from a posture (1210) where the thumb is positioned at the tip of the index finger to a posture (1220) where the thumb is positioned behind the index finger, and the degree of the swipe is cos It can be proportional to the amount of change.

[0177] According to one embodiment, the electronic device (101) can perform 2D navigating control actions based on inputs of a first thumb swipe gesture (1000) and a second thumb swipe gesture (1200). For example, a user can scroll horizontally through the first thumb swipe gesture (1000) and scroll vertically through the second thumb swipe gesture (1200). The user can perform control actions, such as scrolling in a desired direction and / or moving a cursor on a 2D display, intuitively and conveniently by combining the first thumb swipe gesture (1000) and the second thumb swipe gesture (1200), without being restricted by the wearing position of the wearable electronic device.

[0178] According to one embodiment, the first thumb swipe gesture (1000) and / or the second thumb swipe gesture (1200) may be referred to by other expressions to the extent that the action signified is substantially the same. For example, the first thumb swipe gesture (1000) and / or the second thumb swipe gesture (1200) may be referred to by expressions such as a 'thumb sweeping gesture,' which signifies a gesture in which the thumb moves while rubbing against another part (e.g., another finger).

[0179] FIGS. 13a and FIGS. 13b are drawings for explaining a method for an electronic device to recognize a grab gesture input according to one embodiment of the present disclosure.

[0180] According to one embodiment, the electronic device (101) can identify, for example, a case where a thumb is included in either the first finger (f201) or the second finger (f202) and a case where no thumb is included, respectively, by performing at least some of the operations of FIG. 5 and / or FIG. 8. FIG. 13a and FIG. 13b illustrate examples of cases where a thumb is included in the first finger (f201) or the second finger (f202) and cases where it is not, respectively.

[0181] Referring to FIGS. 13a and 13b, the grab gesture (1300) may be a gesture that includes a movement from an open hand position (1310) to a clenched hand position (1320). The grab gesture may be a gesture that includes an event in which fingers that were not in contact come into contact.

[0182] Referring to FIG. 13a, according to one embodiment, a first wearable electronic device (201) worn on the thumb and a second wearable electronic device (202) worn on one of the fingers other than the thumb may have different rotation directions when performing a grab gesture (1300). Additionally, the angle between the direction (1311) of the first wearable electronic device (201) and the direction (1312) of the second wearable electronic device (202) in an open hand position (1310) may be greater than the angle between the direction (1321) of the first wearable electronic device (201) and the direction (1322) of the second wearable electronic device (202) in a clenched hand position (1320).

[0183] On the other hand, referring to FIG. 13b, according to one embodiment, the first wearable electronic device (201) and the second wearable electronic device (202), both worn on fingers other than the thumb, may have a rotation direction that matches or is similar to the performance of the grab gesture (1300). Additionally, the angle between the direction (1331) of the first wearable electronic device (201) and the direction (1332) of the second wearable electronic device (202) in an open hand position (1310) may not differ significantly from the angle between the direction (1341) of the first wearable electronic device (201) and the direction (1342) of the second wearable electronic device (202) in a clenched hand position (1320).

[0184] According to one embodiment, the electronic device (101) can recognize the input of the same grab gesture (1300) in different ways depending on whether there is a thumb among the first finger (f201) or the second finger (f202), as in FIG. 11. The electronic device (101) can recognize the input of a grab gesture (1300) from motion data in which the angle between the first wearable electronic device (201) and the second wearable electronic device (202) decreases as they rotate in different directions based on identifying whether there is a thumb among the first finger (f201) or the second finger (f202), and can recognize the input of a grab gesture (1300) from motion data in which the angle between the first wearable electronic device (201) and the second wearable electronic device (202) hardly changes as they rotate together in similar directions based on identifying whether there is no thumb among the first finger (f201) or the second finger (f202).

[0185] Meanwhile, referring to FIGS. 13a and 13b, according to one embodiment, two or more fingers may come into contact with each other as a result of performing a grab gesture (1300), thereby causing an impact (1323). The electronic device (101) can detect the impact (1323) from a sudden change in acceleration of the first wearable electronic device (201) and the second wearable electronic device (202). In this case, the impact may be detected weakly, particularly in the wearable electronic device worn on the little hand, in which case signal amplification (amplification circuit and / or upsampling) may be utilized as described above in the description of FIG. 11.

[0186] According to one embodiment, the electronic device (101) can recognize that a grab gesture (1300) has been input only when the occurrence of an impact (1323) following the rotation and / or angle change between the first wearable electronic device (201) and the second wearable electronic device (202) is detected, thereby reducing the possibility of false recognition and enabling stable gesture recognition. Likewise, for various gestures other than those described above, the electronic device (101) can improve the accuracy of gesture recognition by comprehensively analyzing patterns of various motion data (e.g., direction, rotation, acceleration change, etc.) after identifying the finger on which the wearable electronic devices are worn.

[0187] According to one embodiment, an electronic device (101), an external server and / or cloud platform may continuously collect and / or analyze reference motion data related to a specific gesture (e.g., motion data per finger in motion 450 of FIG. 4b) to update and improve the reference data and / or gesture recognition algorithm based on the accumulation of data.

[0188] According to one embodiment, since there may be differences in finger movements among users even when performing the same gesture, the electronic device (101) can generate a personalized gesture recognition model for each user by utilizing a deep learning algorithm. This personalized model can further improve the accuracy of gesture recognition and the user experience by learning each user's finger movement patterns.

[0189] FIG. 14 is a drawing for explaining a tap gesture, which is an example of a gesture according to one embodiment of the present disclosure.

[0190] Referring to FIG. 14, according to one embodiment, a tap gesture (1400) may include a gesture of tapping the index finger with the thumb (1410), a gesture of tapping the middle finger (1420), a gesture of tapping the ring finger (1430), and a gesture of tapping the little finger (1440). The electronic device (101) can first identify the fingers on which the wearable electronic devices are worn, and then use motion data to distinguish and recognize the input of each finger tap gesture.

[0191] According to one embodiment, when the thumb is not included among the first finger (f201) or the second finger (f202) (e.g., worn on the index and ring fingers), the position of the tapped finger can be determined using acceleration data from the first wearable electronic device (201) and the second wearable electronic device (202). As in FIG. 10b, the maximum amplitude (or intensity of impact) in the time-series acceleration change data may be related to how close the distance is between the thumb-tapped finger and the wearable electronic device. Accordingly, the electronic device (101) can distinguish which finger was tapped by comparing the relative magnitude of the intensity of impact detected by the first wearable electronic device (201) and the intensity of impact detected by the second wearable electronic device (202).

[0192] For example, if the first finger (f201) is the index finger and the second finger (f202) is the little finger, the electronic device (101) can recognize which finger was tapped by using the fact that the intensity of the impact detected by the first wearable electronic device (201) decreases and the intensity of the impact detected by the second wearable electronic device (202) increases in the order of the thumb tapping gesture (1410) of the index finger, the middle finger tapping gesture (1420), the ring finger tapping gesture (1430), and the little finger tapping gesture (1440).

[0193] According to one embodiment, if the thumb is included among the first finger (f201) or the second finger (f202), the electronic device (101) can distinguish and recognize the gesture input using acceleration data and / or direction data.

[0194] For example, if the first finger (f201) is the thumb and the second finger (f202) is the ring finger, the electronic device (101) can distinguish and recognize gesture inputs from the angle at the point where an impact caused by the tap is detected by utilizing the fact that the angle between the first wearable electronic device (201) and the second wearable electronic device (202) increases in the order of a gesture of tapping the index finger with the thumb (1410), a gesture of tapping the middle finger (1420), a gesture of tapping the ring finger (1430), and a gesture of tapping the little finger (1440). Additionally, the accuracy of gesture input recognition can be increased by utilizing the fact that the intensity of the impact detected by the second wearable electronic device (202) increases as the finger tapped by the thumb gets closer to the second finger (f202).

[0195] According to one embodiment, the electronic device (101) can maximize user convenience by mapping different control actions to each tap gesture (1410, 1420, 1430 and / or 1440). For example, on a video playback screen, by mapping a play / pause function to the index finger tap gesture (1410), a volume increase function to the stop tap gesture (1420), a volume decrease function to the ring finger tap gesture (1430), and a fast-forward function to the little finger tap gesture (1440), the user can have a convenient viewing experience by quickly accessing various functions during video playback with just simple gestures.

[0196] According to one embodiment, the electronic device (101) can assist in control through user gesture input by outputting guidance information for various gestures, including the examples described above and the examples to be described below, and control actions corresponding to the various gestures. For example, the electronic device (101) can output guidance on performing a gesture (e.g., a first thumb swipe gesture (1000)) and / or information on a corresponding control function (e.g., a scroll function) visually through a display.

[0197] FIG. 15 is a drawing for explaining how an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure recognizes a flick gesture.

[0198] According to one embodiment, the flick gesture may include a flicking quickly in a specific direction (e.g., left or right) while at least one finger (e.g., index finger, index and middle finger) is extended. When performing the flick gesture, generally, high acceleration and / or a change in acceleration may be detected in the fingers.

[0199] FIG. 15 illustrates an example in which the first finger (e.g., the first finger (f201) in FIG. 2b) is the index finger and the second finger (e.g., the second finger (f202) in FIG. 2b) is the middle finger, but embodiments of the present disclosure are not limited thereto.

[0200] According to one embodiment, the electronic device (101) can distinguish between a one-finger flick gesture (1520) performed with either a first finger (f201) or a second finger (f202) and a two-finger flick gesture (1510) performed with both the first finger (f201) and the second finger (f202). By doing so, the electronic device (101) can map different control actions to each of the two-finger flick gesture (1510) and the one-finger flick gesture (1520), and then perform control actions based on the gesture input.

[0201] According to one embodiment, the electronic device (101) can recognize the input of a two-finger flick gesture (1510) based on identifying that the direction of the first wearable electronic device (201) and the direction of the second wearable electronic device (202) match within a predetermined error range (e.g., 10°) while the first wearable electronic device (201) and the second wearable electronic device (202) move in the same direction based on first motion data and second motion data.

[0202] According to one embodiment, the electronic device (101) can recognize the input of a one-finger flick gesture (1520) based on identifying that the difference between the direction of the first wearable electronic device (201) and the direction of the second wearable electronic device (202) is greater than a predetermined error range, based on first motion data and second motion data, while the first wearable electronic device (201) and the second wearable electronic device (202) move in the same direction.

[0203] According to one embodiment, the electronic device (101) can perform at least one control action, such as turning pages, fast scrolling, fast playback or reverse playback, or switching apps, based on recognizing the input of a flick gesture. The recognition of the input of the flick gesture may include recognition of at least one of whether it is one finger or two fingers, the direction of the flick, or the speed of the flick.

[0204] FIG. 16 is a drawing for explaining how an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure recognizes a wrist rotation gesture.

[0205] According to one embodiment, the wrist rotation gesture may be a gesture that includes rotating only the wrist in one direction while maintaining the position of the hand (e.g., while clenching a fist).

[0206] Referring to FIG. 16, according to one embodiment, an electronic device (101) can recognize the input of a wrist rotation gesture based on identifying that the first wearable electronic device (201) and the second wearable electronic device (202) are rotating in the same direction based on first motion data and second motion data.

[0207] According to one embodiment, the electronic device (101) can perform at least one control action, such as adjusting system setting values ​​(e.g., volume control, screen brightness control), rotating an image, or manipulating an object in a virtual environment (e.g., AR), based on recognizing a wrist rotation gesture input. Recognition of the wrist rotation gesture input may include recognition of the direction of rotation and / or the angle of rotation.

[0208] FIG. 17 is a drawing for explaining a screen and UI displayed by an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure.

[0209] Referring to FIG. 17, according to one embodiment, an electronic device (101) may have one or more modes for identifying a finger (e.g., a first finger (f201), a second finger (f202)) on which a wearable device (e.g., a first wearable electronic device (201), a second wearable electronic device (202)) is worn. One or more modes may include a first mode that performs a directing gesture and a second mode that does not perform a directing gesture.

[0210] According to one embodiment, the first mode may be a mode that includes, for example, at least some of the operations of FIG. 5. The instruction gesture may include, for example, the unfolding gesture described in FIG. 6a and FIG. 6b.

[0211] According to one embodiment, the second mode may be a mode that includes, for example, at least some of the operations of FIG. 8. For example, as described in FIG. 9, the electronic device (101) may include an operation of collecting information (940) about the orientation of wearable devices in daily life and / or an operation of identifying worn fingers by matching said information about the orientation (940) with a finger orientation combination database (930).

[0212] According to one embodiment, the electronic device (101) provides a mode selection UI for selecting either a first mode or a second mode, and the wearable device can determine a mode for identifying a finger worn based on user input through the mode selection UI. The mode selection UI may be a UI for directly selecting a mode (e.g., "Select a mode for finger recognition: First Mode / Second Mode"), or a UI for indirectly selecting whether to perform a command gesture (e.g., "Would you like to perform a gesture for finger recognition? Yes / No")

[0213] According to one embodiment, the electronic device (101) can determine a mode for identifying fingers based on whether the user performs a gesture after outputting information related to the guidance of a gesture (e.g., information guiding the gesture of FIG. 7 (710)).

[0214] According to one embodiment, after outputting information related to guidance for a guidance gesture, if a user performs a guidance gesture, the electronic device (101) can identify a worn finger based on motion data of a wearable electronic device that follows the output of information related to guidance for a guidance gesture using a first mode. Based on identifying the worn finger, the electronic device (101) can visually output a screen (1710) containing information that finger identification is complete through a display (e.g., a display module (160)). The screen (1710) containing information that finger identification is complete may include, for example, information (720) indicating that the finger of FIG. 7 has been recognized.

[0215] According to one embodiment, when the user does not perform a command gesture, the electronic device (101) can use a second mode to periodically or non-periodically acquire motion data (e.g., first motion data, second motion data) of wearable devices (e.g., first wearable electronic device (201), second wearable electronic device (202)) for a set period of time, and then identify the finger on which the wearable devices are worn by matching it with finger-specific motion data (e.g., finger direction combination database (930) of FIG. 9) associated with a plurality of gestures. The set period of time may be a predetermined fixed time, or a variable time until the wearable devices identify the finger on which they are worn with sufficient confidence (e.g., matching accuracy 90%, data similarity 90%).

[0216] According to one embodiment, the electronic device (101) may output a screen (1721) containing a notice that motion data of the wearable device is being collected, prior to acquiring motion data of the wearable device for a certain period of time in a second mode. The electronic device (101) may output a screen (1722) containing information that finger identification is completed, through a display, after finger identification is completed in the second mode.

[0217] FIG. 18 illustrates a screen and UI in which an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure provides gesture guidance.

[0218] Referring to FIG. 18, according to one embodiment, an electronic device (101) may output guidance for at least one gesture for controlling the electronic device (101) through a display (e.g., the display module (160) of FIG. 1). The guidance for at least one gesture may include, for example, guidance for a common gesture independent of the finger wearing the wearable devices (e.g., guidance for a first thumb swipe gesture (1810)) and guidance for a gesture specialized according to the finger wearing the devices (e.g., guidance for a one-finger or two-finger flick gesture (1820)).

[0219] FIG. 19 is a diagram illustrating a control operation associated with a first thumb swipe gesture input according to one embodiment of the present disclosure.

[0220] Referring to FIG. 19, according to one embodiment, an electronic device (101) can perform control operations such as, for example, an upward scrolling operation (1911), a volume increase operation (1912), and a toggle on operation (1913) based on the input of an upward first thumb swipe gesture (1910).

[0221] According to one embodiment, the electronic device (101) can perform control actions such as, for example, a downward scrolling action (1921), a volume reduction action (1922), and a toggle off action (1923) based on the input of a downward first thumb swipe gesture (1920).

[0222] FIG. 20 is a diagram illustrating a control operation associated with a second thumb swipe gesture input according to one embodiment of the present disclosure.

[0223] Referring to FIG. 20, according to one embodiment, an electronic device (101) can perform, for example, a right scroll action (2015) and / or a right drag action based on a right-direction second thumb swipe gesture (2010) input.

[0224] According to one embodiment, since the first thumb swipe gesture and the second thumb swipe gesture are common in that they are swipe actions, differing only in direction, control actions (e.g., scrolling, volume control) that can be performed with the first thumb swipe gesture input may also be performed with the second thumb swipe gesture input.

[0225] FIG. 21 is a diagram illustrating a control operation associated with the combination of a first thumb swipe gesture input and a second thumb swipe gesture input according to one embodiment of the present disclosure.

[0226] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) can perform a 2D navigating control operation as described above in FIG. 12 based on a first thumb swipe gesture input and a second thumb swipe gesture input. For example, the electronic device (101) can move the position of a cursor on a display in correspondence with the position of the thumb.

[0227] Referring to FIG. 21, according to one embodiment, the cursor may be positioned at a first position (2115) in response to the user’s thumb being positioned at the side of the end joint of the index finger (2110). As the user performs a second thumb swipe gesture in the right direction, the cursor may be moved to the right and positioned at a second position (2125) in response to the thumb being positioned at the side of the first joint of the index finger (2120). As the user performs a first thumb swipe gesture in the downward direction, the cursor may be moved downward and positioned at a third position (2135) in response to the thumb being positioned at the first joint of the ring finger or little finger (2130).

[0228] FIG. 22 is a drawing for explaining the operation of an electronic device amplifying a signal according to one embodiment of the present disclosure.

[0229] Referring to FIG. 22, according to one embodiment, when the first finger (f201) and the second finger (f202) are the ring finger and little finger, the detected shock or acceleration change may be very small. Accordingly, for accurate data analysis, hardware and / or software amplification of the signal may be required as described in FIG. 10b.

[0230] According to one embodiment, the electronic device (101) may include an amplification circuit. The amplification circuit can amplify the amplitude of the data to enable detection of a weak signal (2220). By doing so, the electronic device (101) can improve the sensitivity of signal detection.

[0231] According to one embodiment, the electronic device (101) can increase the frequency of existing data through upsampling to amplify the resolution of the data (2230). Through this, the electronic device (101) can improve the precision of signal analysis.

[0232] According to one embodiment of the present disclosure, an electronic device may be provided. The electronic device may include at least one processor including a communication circuit and a processing circuit, and a memory including at least one storage medium for storing instructions. The instructions may cause the electronic device to perform at least one operation when executed individually or collectively by at least one processor. The at least one operation may include: receiving first sensor data of a first wearable electronic device and second sensor data of a second wearable electronic device periodically or non-periodically through the communication circuit; obtaining first orientation information regarding the orientation of the first wearable electronic device and second orientation information regarding the orientation of the second wearable electronic device based on the first sensor data and the second sensor data; or identifying a first finger on which the first wearable electronic device is worn and a second finger on which the second wearable electronic device is worn based on the first orientation information and the second orientation information. The above first direction information and the above second direction information are based on the same reference frame and may be time-sequential information.

[0233] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: acquiring first motion data of a first wearable electronic device and second motion data of a second wearable electronic device based on first sensor data and second sensor data; recognizing a gesture input based on information of identified first finger and second finger, first motion data and second motion data; and performing at least one control operation corresponding to the gesture input based on recognizing the gesture input. The first motion data and second motion data may be time-series data including information about direction.

[0234] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: acquiring finger-specific reference motion data associated with at least one specific gesture; identifying motion data of a first finger and a second finger among finger-specific motion data associated with the specific gesture; or recognizing a gesture input based on the first motion data, the second motion data, and the motion data of the first finger and the second finger associated with the specific gesture. The finger-specific motion data associated with the specific gesture may be time-series data including information about direction.

[0235] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following actions: acquiring information about the direction of a finger associated with a directing gesture; providing information about the guidance of the directing gesture; acquiring first direction information and second direction information; or identifying a first finger and a second finger based on the first direction information, second direction information and information about the direction of a finger associated with the directing gesture. The directing gesture may be a gesture for identifying a finger wearing a wearable electronic device, and the first direction information and second direction information may include information about the change in direction of the first wearable electronic device and the second wearable electronic device following the provision of information about the guidance of the directing gesture.

[0236] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: acquiring information about finger-specific directions associated with a plurality of gestures; or identifying which finger the first finger and the second finger are based on the first direction information, the second direction information, and the information about finger-specific directions associated with a plurality of gestures.

[0237] According to one embodiment, the instruction gesture may include a spread gesture of spreading all fingers. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following actions: identifying that the first finger or the second finger is a thumb based on identifying that the magnitude of rotation about a specific axis of the first wearable electronic device or the second wearable electronic device exceeds a first threshold; identifying that the first finger or the second finger is a middle finger based on identifying that the magnitude of rotation about a specific axis is less than a second threshold, which is a value smaller than the first threshold; or obtaining first direction information and second direction information including information about the magnitude of rotation about a specific axis.

[0238] According to one embodiment, at least one specific gesture may include a first thumb swipe gesture, and the first thumb swipe gesture may be a gesture in which the thumb swipes along the proximal phalanges of the remaining fingers. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device performs the action of recognizing a first thumb swipe gesture input based on orientation information of a first wearable electronic device, orientation information of a second wearable electronic device, and motion data of the first finger and the second finger associated with the first thumb swipe gesture when either the first finger or the second finger is identified as a thumb; and the action of recognizing a first thumb swipe gesture input based on acceleration change data associated with the first wearable electronic device, acceleration change data associated with the second wearable electronic device, and motion data of the first finger and the second finger associated with the first thumb swipe gesture when both the first finger and the second finger are identified as fingers other than the thumb. Alternatively, it may cause to perform at least one of the actions of processing first motion data, second motion data, and finger-specific motion data related to at least one specific gesture, including time-series data related to acceleration.

[0239] According to one embodiment, at least one specific gesture may further include a second thumb swipe gesture, and the second thumb swipe gesture may be a gesture in which the thumb swipes along the side of the index finger. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the operations of recognizing a second thumb swipe gesture input based on the orientation information of the first wearable electronic device, the orientation information of the second wearable electronic device, and motion data of the first finger and the second finger associated with the second thumb swipe gesture, when either the first finger or the second finger is identified as a thumb.

[0240] According to one embodiment, at least one control operation may include at least one of a scroll operation, a volume control operation, an undo and redo operation, a brightness control operation, a media playback control operation, or a page transition operation.

[0241] According to one embodiment, at least one specific gesture may include a grab gesture, and the grab gesture may be a gesture that includes the action of contracting the fingers while the fingers are in an extended state. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may cause the grab gesture input to be recognized based on first motion data, second motion data, and motion data of a first finger and a second finger associated with the grab gesture. The first motion data, second motion data, and finger-specific motion data associated with the grab gesture may be time-series data including information about direction and information about acceleration.

[0242] According to one embodiment, at least one specific gesture may include a tap gesture, the tap gesture may include an action of contacting the distal phalanx of any one of the remaining fingers with the thumb, and at least one control action may include different control actions corresponding to each finger contacting the thumb in response to the tap gesture input. According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may cause to perform at least one of the following actions: an action of recognizing a tap gesture input for a specific finger based on first motion data, second motion data, and motion data of a first finger and a second finger associated with the tap gesture; or an action of performing a control action corresponding to a specific finger based on recognizing a tap gesture input for a specific finger. The first motion data, second motion data, and motion data of a first finger and a second finger associated with the tap gesture may be time-series data including information about acceleration.

[0243] According to one embodiment, when the instructions are executed individually or collectively by at least one processor, the electronic device may be caused to perform at least one of the following operations: identifying the activation of a gesture control mode; or transmitting a sensor activation signal to at least one of a first wearable electronic device or a second wearable electronic device based on identifying the activation of a gesture control mode.

[0244] According to one embodiment, the gesture control mode may be a mode capable of performing at least one control operation based on a gesture input related to wearable electronic devices wirelessly connected to an electronic device, and may be activated based on the execution of at least one specific command among commands, a specific signal received from the outside through a communication circuit, or user input. The inertial sensor activation signal may be a signal that causes the first wearable electronic device or the second wearable electronic device to activate at least a part of the built-in sensor.

[0245] According to one embodiment of the present disclosure, a wearable electronic device may be provided. A wearable electronic device according to one embodiment may include a communication circuit, an inertial sensor, a memory including at least one storage medium for storing instructions, and at least one processor including a processing circuit. The instructions may cause the wearable electronic device to perform at least one operation when executed individually or collectively by the at least one processor. The at least one operation may include: an operation of identifying that a sensor-wide activation condition is satisfied; an operation of activating the entire inertial sensor based on identifying that the sensor-wide activation condition is satisfied; an operation of acquiring motion data of the wearable electronic device periodically or non-periodically; an operation of recognizing a gesture input based on the motion data; or an operation of transmitting a control command corresponding to the gesture input based on recognizing the gesture input.

[0246] According to one embodiment of the present disclosure, a method for operating an electronic device may be provided. A method for operating an electronic device according to one embodiment may include: receiving first sensor data of a first wearable electronic device and second sensor data of a second wearable electronic device periodically or non-periodically; obtaining first direction information regarding the direction of the first wearable electronic device and second direction information regarding the direction of the second wearable electronic device based on the first sensor data and the second sensor data; and / or identifying a first finger on which the first wearable electronic device is worn and a second finger on which the second wearable electronic device is worn based on the first direction information and the second direction information.

[0247] According to one embodiment, a method for operating an electronic device may include: acquiring first motion data of a first wearable electronic device and second motion data of a second wearable electronic device based on first sensor data and second sensor data; recognizing a gesture input based on information of identified first finger and second finger, first motion data and second motion data; and / or performing at least one control operation corresponding to the gesture input based on recognizing the gesture input.

[0248] According to one embodiment, a method for operating an electronic device may include: acquiring finger-specific reference motion data associated with at least one specific gesture; identifying motion data of a first finger and a second finger among finger-specific motion data associated with the specific gesture; and / or recognizing a gesture input based on the first motion data, the second motion data, and the motion data of the first finger and the second finger associated with the specific gesture.

[0249] According to one embodiment, a method for operating an electronic device may include: an action of identifying whether a thumb is included among a first finger or a second finger; an action of recognizing a first thumb swipe gesture input based on information regarding the orientation of a first wearable electronic device, information regarding the orientation of a second wearable electronic device, and motion data of the first finger and the second finger related to the first thumb swipe gesture, if it is identified that a thumb is included among the first finger or the second finger; and / or an action of recognizing a first thumb swipe gesture input based on data regarding the acceleration change of the first wearable electronic device, data regarding the acceleration change of the second wearable electronic device, and motion data of the first finger and the second finger related to the first thumb swipe gesture, if it is identified that a thumb is not included among the first finger or the second finger.

[0250] According to one embodiment, a method for operating an electronic device may include, when it is identified that a thumb is included among the first finger or the second finger, an operation of recognizing a second thumb swipe gesture input based on information about the direction of the first wearable electronic device, information about the direction of the second wearable electronic device, and motion data of the first finger and the second finger related to the second thumb swipe gesture.

[0251] According to one embodiment, a method for operating an electronic device may include: an action of recognizing a tap gesture input for a specific finger based on first motion data, second motion data, and motion data of a first finger and a second finger associated with a tap gesture; and / or an action of performing a control action corresponding to a tap gesture for a specific finger based on recognizing the tap gesture input for a specific finger.

[0252] Meanwhile, the various embodiments described above may be implemented in software containing instructions stored on a device-readable storage medium, included in a computer program product in the form of a device-readable storage medium or distributed online through an application store, or implemented within a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

[0253] In the various embodiments described above, the first wearable electronic device (201) and the second wearable electronic device (202) have been described as separate external wearable electronic devices distinct from the electronic device (101), but the embodiments of the present disclosure are not limited thereto. For example, the first wearable electronic device (201) or the second wearable electronic device (202) may be implemented as the same device as the electronic device (101), or may be implemented in a configuration where one device is included in the other device.

[0254] Each component according to the various embodiments described above may be composed of a single or multiple entities, and some auxiliary components may be omitted or additionally included. Some components may be integrated into a single entity to perform the same or similar functions as those performed by each corresponding component prior to integration.

[0255] The operations according to the various embodiments described above may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

Claims

1. In an electronic device, Communication circuit; Memory comprising at least one storage medium for storing instructions; and at least one processor including a processing circuit; comprising, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Through the communication circuit above, the first sensor data of the first wearable electronic device and the second sensor data of the second wearable electronic device are received periodically or non-periodically, and Based on the first sensor data and the second sensor data, first orientation information regarding the orientation of the first wearable electronic device and second orientation information regarding the orientation of the second wearable electronic device are obtained, and the first orientation information and the second orientation information are based on the same reference frame and are time-sequential information. Based on the first direction information and the second direction information, causing the first wearable electronic device to identify a first finger worn by the first wearable electronic device and the second wearable electronic device to identify a second finger worn by the second wearable electronic device, Electronic device.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the first sensor data and the second sensor data, first motion data of the first wearable electronic device and second motion data of the second wearable electronic device are obtained, and the first motion data and the second motion data are time-series data including information about direction, and Recognizing gesture input based on the identified information of the first finger and the second finger, the first motion data and the second motion data, and Causing to perform at least one control action corresponding to the gesture input based on recognizing the gesture input, Electronic device.

3. In Paragraph 2, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on information regarding the identified first finger and the identified second finger, reference motion data of the first finger and reference motion data of the second finger are obtained from finger-specific reference motion data associated with at least one specific gesture, and the finger-specific reference motion data associated with the specific gesture is time-series data including information about direction. Recognizing gesture input based on the first motion data, the second motion data, and reference motion data of the first finger and the second finger associated with the specific gesture. Electronic device.

4. In Paragraph 1, Paragraph 2, or Paragraph 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Information regarding the direction of each finger associated with a directive gesture is obtained, and the directive gesture is a gesture for identifying a finger wearing a wearable electronic device, and It provides information related to the guidance of the above instruction gesture, and Based on the first sensor data and the second sensor data obtained after providing the above information, the first direction information and the second direction information are obtained, and the first direction information and the second direction information include information regarding the change in direction of the first wearable electronic device and the second wearable electronic device. Based on the first direction information, the second direction information, and information regarding the direction of each finger associated with the instruction gesture, causing to identify the first finger and the second finger, Electronic device.

5. In any one of paragraphs 1 through 4, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Acquire information on finger-specific directions related to multiple gestures, and Based on the first direction information, the second direction information, and information regarding finger-specific directions related to the plurality of gestures, causing to identify the first finger and the second finger, Electronic device.

6. In Paragraph 4, The above instruction gesture includes a spread gesture of spreading all fingers, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on identifying that the magnitude of rotation about a specific axis of the first wearable electronic device or the second wearable electronic device exceeds a first threshold, the first finger or the second finger is identified as a thumb, and Based on identifying that the magnitude of rotation about the specific axis of the first wearable electronic device or the second wearable electronic device is less than a second threshold value which is smaller than the first threshold value, the first finger or the second finger is identified as a middle finger, and The first direction information and the second direction information include information regarding the magnitude of rotation about the specific axis. Electronic device.

7. In Paragraph 3, The above at least one specific gesture includes a first thumb swipe gesture, wherein the first thumb swipe gesture is a gesture in which the thumb swipes along the proximal phalanges of the remaining fingers, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: If either of the first finger or the second finger is identified as a thumb, Based on information regarding the orientation of the first wearable electronic device, information regarding the orientation of the second wearable electronic device, and motion data of the first finger and the second finger associated with the first thumb swipe gesture, the first thumb swipe gesture input is recognized, If both the first finger and the second finger are identified as fingers other than thumbs, Causing to recognize the first thumb swipe gesture input based on data related to the acceleration change of the first wearable electronic device, data related to the acceleration change of the second wearable electronic device, and motion data of the first finger and the second finger related to the first thumb swipe gesture, The first motion data, the second motion data, and the finger-specific motion data associated with the at least one specific gesture include time-series data related to acceleration. Electronic device.

8. In Paragraph 3 or 7, The above at least one specific gesture further includes a second thumb swipe gesture, wherein the second thumb swipe gesture is a gesture in which the thumb swipes along the side of the index finger, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: If either of the first finger or the second finger is identified as a thumb, Based on information regarding the orientation of the first wearable electronic device, information regarding the orientation of the second wearable electronic device, and motion data of the first finger and the second finger associated with the second thumb swipe gesture, causing the second thumb swipe gesture input to be recognized, Electronic device.

9. In Paragraph 7, The above at least one control operation includes at least one of a scroll operation, a volume control operation, an undo and redo operation, a brightness control operation, a media playback control operation, or a page transition operation. Electronic device.

10. In Paragraph 3, The above at least one specific gesture includes a grab gesture, and the grab gesture is a gesture that includes the action of contracting the fingers while the fingers are in an extended state. When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the first motion data, the second motion data, and the motion data of the first finger and the second finger associated with the grab gesture, the grab gesture input is recognized, and The first motion data, the second motion data, and the finger-specific motion data associated with the grab gesture are time-series data including information about direction and information about acceleration. Electronic device.

11. In Paragraph 3, The above at least one specific gesture includes a tap gesture, and the tap gesture includes the action of contacting the distal phalanx of any one of the remaining fingers with the thumb, and The above at least one control action includes, for the tap gesture input, a control action corresponding to each finger in contact with the thumb, respectively. When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the first motion data, the second motion data, and the motion data of the first finger and the second finger associated with the tap gesture, a tap gesture input for a specific finger is recognized, and the first motion data, the second motion data, and the motion data of the first finger and the second finger associated with the tap gesture are time-series data including information about acceleration. Based on recognizing a tap gesture input for the specific finger, causing a control action corresponding to the tap gesture for the specific finger to be performed. Electronic device.

12. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Identifying the activation of a gesture control mode, wherein the gesture control mode is a mode capable of performing at least one control operation based on a gesture input, and is activated based on the execution of at least one specific command among the commands, a specific signal received from the outside through the communication circuit, or user input. Based on identifying the activation of the gesture control mode, the sensor activation signal is transmitted to at least one of the first wearable electronic device or the second wearable electronic device, and the sensor activation signal is a signal that causes the first wearable electronic device or the second wearable electronic device to activate at least a portion of an embedded inertial sensor. Electronic device.

13. In a wearable electronic device, Communication circuit; Inertial sensor; Memory comprising at least one storage medium for storing instructions; and at least one processor including a processing circuit; comprising, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device: Identify that the sensor-wide activation condition is satisfied, and said sensor-wide activation condition is satisfied based on the occurrence of a specific event detected by a part of the inertial sensor that was activated, a specific signal received through the communication circuit, or user input, and Based on identifying that the condition for full activation of the above sensor is satisfied, the entire inertial sensor is activated, and Motion data of the above-mentioned wearable electronic device is acquired periodically or non-periodically, and Recognizes gesture input based on the above motion data, Based on recognizing the gesture input, causing to transmit a control command corresponding to the gesture input, Wearable electronic device.

14. In a method of operating an electronic device, The operation of receiving first sensor data of a first wearable electronic device and second sensor data of a second wearable electronic device periodically or non-periodically; Based on the first sensor data and the second sensor data, the operation of obtaining first direction information regarding the direction of the first wearable electronic device and second direction information regarding the direction of the second wearable electronic device; and Based on the first direction information and the second direction information, the operation of identifying a first finger on which the first wearable electronic device is worn and a second finger on which the second wearable electronic device is worn; is included. The above first direction information and the above second direction information are based on the same reference coordinate system and are time-series information, method.

15. In Paragraph 14, An operation of acquiring first motion data of the first wearable electronic device and second motion data of the second wearable electronic device based on the first sensor data and the second sensor data; An operation to recognize a gesture input based on the identified information of the first finger and the second finger, the first motion data and the second motion data; and The operation of performing at least one control operation corresponding to the gesture input based on recognizing the gesture input; further comprising The first motion data and the second motion data are time-series data containing information about direction, method.

Images