Wearable device and control method therefor

Abstract

This wearable device comprises a communication interface, a memory for storing instructions, and a processor, wherein the processor is configured to: acquire strength information about the strength of a first signal transmitted by an external device; acquire strength information about the strength of a second signal transmitted by an external wearable device; receive, from the external wearable device via the communication interface, strength information about the strength of a third signal received by the external wearable device; acquire information about an angle formed by a line between the wearable device and the external device and a line between the external wearable device and the external device on the basis of the pieces of strength information about the first signal, the second signal, and the third signal; and identify, on the basis of whether the angle is not larger than a threshold value, whether the external device is a to-be-controlled device.

Description

Wearable device and method for controlling the same

[0001] The present disclosure relates to a wearable device and a control method thereof, and more particularly, to a wearable device and a control method thereof that can control an external device pointed at by a user wearing the wearable device.

[0002] Recently, with the advancement of IoT (Internet of Things) technology, various devices can be controlled through other interfaces (e.g. voice, mobile applications, etc.) rather than directly.

[0003] In particular, there is a growing demand for improved user convenience and intuitive device control, such as through gesture-based operation. However, when multiple devices are present in the user's vicinity, it can be difficult to determine which device to control when using gestures to control at least one of the multiple devices.

[0004] Therefore, a method is required to identify an external device that exists in the closest direction to the direction pointed by the user.

[0005] According to one aspect of the present disclosure, a wearable device includes a communication interface; a memory storing instructions; and at least one processor configured to individually or collectively execute the instructions. Wherein, when the instructions are individually or collectively executed by the at least one processor, the wearable device obtains intensity information about the intensity of a first signal transmitted by an external device, obtains intensity information about the intensity of a second signal transmitted by the external wearable device, receives intensity information about the intensity of a third signal received by the external wearable device from the external wearable device through the communication interface, obtains information about an angle formed by a line between the wearable device and the external device and a line between the external wearable device and the external device based on the intensity information about the first signal, the second signal, and the third signal, and identifies whether the external device is a controlled device based on whether the angle is less than or equal to a threshold value.

[0006] The above instructions, when individually or collectively executed by at least one processor, may cause the wearable device to further obtain information about a hand gesture of a user wearing the wearable device based on a sensing value detected by a motion sensor, wherein the motion sensor is included in at least one of the wearable device and the external wearable device, and transmit a control command corresponding to the information about the hand gesture to the external device through the communication interface.

[0007] The above instructions, when individually or collectively executed by at least one processor, may further cause the wearable device to obtain user profile information including user hand size information, and to correct the threshold based on a correction value corresponding to the user's hand size.

[0008] The above instructions, when individually or collectively executed by at least one processor, may further cause the wearable device to obtain a correction value corresponding to the external device based on an initial setting for a mode of controlling the external device using the wearable device, and when the external device is identified, to correct the threshold value based on the obtained correction value.

[0009] When the instructions are individually or collectively executed by at least one processor, the wearable device may further identify, using an external server, whether an external communication interface of at least one device among a plurality of devices existing in the home is activated, and, when the external communication interface of at least one device among the plurality of devices existing in the home is identified as not activated, transmit a request signal for activating the external communication interface of at least one device among the plurality of devices existing in the home to the external server through the communication interface.

[0010] When the instructions are individually or collectively executed by at least one processor, the wearable device may further obtain information about an area where a user wearing the wearable device is located based on information about a peripheral device included in a signal received through the communication interface, and transmit a request signal for activating at least one external communication interface of at least one device located in the area among the plurality of devices existing in the home to the external server through the communication interface.

[0011] When the above instructions are individually or collectively executed by at least one processor, the wearable device may additionally receive a sensing value detected by a motion sensor of the external wearable device from the external wearable device through the communication interface, and detect a pointing gesture of the user based on the received sensing value.

[0012] The instructions, when individually or collectively executed by at least one processor, may cause the wearable device to further obtain intensity information about the intensity of each of the first signals transmitted from each of a plurality of external devices, wherein the plurality of external devices include the external devices, and, based on the intensity information of each of the first signals, the second signal, and the third signal, obtain information about each angle formed by a line between the wearable device and each of the plurality of external devices and a line between the external wearable device and the external device, and, when it is determined that all of the angles are less than or equal to the threshold value, identify the external device associated with the greatest signal intensity among the plurality of external devices as the controlled device.

[0013] The above instructions, when individually or collectively executed by at least one processor, may further cause the wearable device to provide guide information including information about the identified external device and information about a mode for controlling the external device.

[0014] The wearable device may include a device worn on the user's wrist, and the external wearable device may include a device worn on the user's finger.

[0015] According to one embodiment of the present disclosure, a method for controlling a wearable device includes: obtaining intensity information on the intensity of a first signal transmitted by an external device; obtaining intensity information on the intensity of a second signal transmitted by the external wearable device; receiving intensity information on the intensity of a third signal received by the external wearable device from the external wearable device through a communication interface of the wearable device; obtaining information on an angle formed by a line between the wearable device and the external device and a line between the external wearable device and the external device based on the intensity information on the first signal, the second signal, and the third signal; and identifying whether the external device is a control target device based on whether the angle is less than or equal to a threshold value.

[0016] The control method may further include: an operation of obtaining information about a hand gesture of a user wearing the wearable device based on a sensing value detected by a motion sensor; and an operation of transmitting a control command corresponding to the information about the hand gesture to the external device through the communication interface, wherein the motion sensor is included in at least one of the wearable device and the external wearable device.

[0017] The above control method may further include an operation of acquiring user profile information including user hand size information; and an operation of correcting the threshold value based on a correction value corresponding to the user's hand size.

[0018] The above control method may further include an operation of obtaining a correction value corresponding to the external device based on an initial setting for a mode of controlling the external device using the wearable device; and an operation of correcting the threshold value based on the obtained correction value when the external device is identified.

[0019] The above control method may further include an operation of identifying whether an external communication interface of at least one device among a plurality of devices existing in a home is activated using an external server; and an operation of transmitting a request signal for activating the external communication interface of at least one device among the plurality of devices existing in the home to the external server when the external communication interface of at least one device among the plurality of devices existing in the home is identified as not activated.

[0020] According to one embodiment of the present disclosure, a non-transitory computer-readable medium stores instructions, which, when individually or collectively executed by the at least one processor, cause a method for controlling a wearable device to be executed, the method comprising: obtaining intensity information about the intensity of a first signal transmitted by an external device; obtaining intensity information about the intensity of a second signal transmitted by the external wearable device; receiving intensity information about the intensity of a third signal received by the external wearable device from the external wearable device through a communication interface of the wearable device; obtaining information about an angle formed by a line between the wearable device and the external device and a line between the external wearable device and the external device based on the intensity information about the first signal, the second signal, and the third signal; and identifying whether the external device is a control target device based on whether the angle is less than or equal to a threshold value.

[0021] For the non-transitory computer-readable medium, the control method may further include: an operation of obtaining information about a hand gesture of a user wearing the wearable device based on a sensing value detected by a motion sensor; and an operation of transmitting a control command corresponding to the information about the hand gesture to the external device through the communication interface, wherein the motion sensor is included in at least one of the wearable device and the external wearable device.

[0022] For the non-transitory computer-readable medium, the control method may further include: an operation of acquiring user profile information including user hand size information; and an operation of correcting the threshold value based on a correction value corresponding to the user's hand size.

[0023] For the non-transitory computer-readable medium, the control method may further include: an operation of obtaining a correction value corresponding to the external device based on an initial setting for a mode of controlling the external device using the wearable device; and an operation of correcting the threshold value based on the obtained correction value when the external device is identified.

[0024] For the non-transitory computer-readable medium, the control method may further include: an operation of identifying whether an external communication interface of at least one device among a plurality of devices existing in a home is activated using an external server; and an operation of transmitting a request signal for activating the external communication interface of at least one device among the plurality of devices existing in the home to the external server when the external communication interface of at least one device among the plurality of devices existing in the home is identified as not activated.

[0025] The above and other aspects and features of specific embodiments of the present disclosure can be more clearly understood by referring to the following description taken in conjunction with the accompanying drawings.

[0026] FIG. 1 is a diagram illustrating a system for identifying an external device pointed at by a wearable device, according to one or more embodiments of the present disclosure;

[0027] FIG. 2 is a block diagram showing the configuration of a wearable device according to one or more embodiments of the present disclosure;

[0028] FIG. 3 is a diagram illustrating a software module included in a system according to one or more embodiments of the present disclosure;

[0029] FIG. 4 is a flowchart illustrating a method for a wearable device to control an external device pointed by a user, according to one or more embodiments of the present disclosure;

[0030] FIG. 5 is a sequence diagram illustrating a method for a wearable device to detect a pointing gesture according to one or more embodiments of the present disclosure;

[0031] FIG. 6 is a diagram illustrating a method for identifying an external device pointed at by a wearable device according to one or more embodiments of the present disclosure;

[0032] FIG. 7 and FIG. 8 are diagrams illustrating a method for correcting a threshold value according to user profile information according to one or more embodiments of the present disclosure;

[0033] FIG. 9 is a flowchart illustrating a method for identifying an external device pointed by a user among a plurality of external devices according to one or more embodiments of the present disclosure;

[0034] FIG. 10 is a diagram illustrating a method for identifying an external device pointed by a user among a plurality of external devices according to one or more embodiments of the present disclosure;

[0035] FIG. 11 is a drawing including guide information for guiding a controlled device according to one or more embodiments of the present disclosure;

[0036] FIG. 12 is a flowchart illustrating an embodiment of changing a controlled device according to a change in a user's pointing direction, according to one or more embodiments of the present disclosure;

[0037] FIG. 13, FIG. 14a, FIG. 14b and FIG. 15 are drawings for explaining a method of activating a communication interface of an external device according to various embodiments of the present disclosure, and

[0038] FIG. 16 is a diagram illustrating an initial setting for a mode of controlling an external device using a wearable device according to one or more embodiments of the present disclosure.

[0039] The present embodiments may be modified and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0040] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0041] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0042] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0043] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0044] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0045] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0046] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0047] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0048] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0049] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0050] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0051] In connection with any method or process described herein, identification codes may be used for convenience of explanation, but are not intended to indicate the order of each step or operation. Unless the context clearly dictates otherwise, each step or operation may be implemented differently from the order shown in the drawings. Furthermore, unless the context clearly dictates otherwise, one or more steps or operations may be omitted.

[0052] The various actions, operations, blocks, steps, etc. shown in the flowchart may be performed in the order presented, in a different order, or simultaneously. Furthermore, in one or more embodiments, some actions, operations, blocks, steps, etc. may be omitted, added, modified, skipped, etc., without departing from the scope of the present disclosure.

[0053] The various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacings drawn in the attached drawings.

[0054] Hereinafter, the present disclosure will be described in more detail with reference to the drawings.

[0055] FIG. 1 is a diagram illustrating a system for identifying an external device pointed at by a wearable device, according to one or more embodiments of the present disclosure. As illustrated in FIG. 1, the system may include a wearable device (100), an external wearable device (200), and an external device (300). In this case, the wearable device (100) and the external wearable device (200) are devices worn at different locations and may be worn at a certain distance apart from each other. In one or more embodiments, the wearable device (100) is a wearable device worn on a user's wrist, such as a smart watch; however, this is merely an example, and the wearable device may be implemented as another wearable device (e.g., a smart bracelet, etc.). The external wearable device (200) is a wearable device worn on a finger by a user wearing the wearable device (100), such as a smart ring. Additionally, the external device (300) can be implemented as a home appliance, and for example, can be implemented as various devices such as a TV, an air conditioner, a refrigerator, etc.

[0056] The wearable device (100) and the external wearable device (200) may be connected to communicate with each other. In one or more embodiments, the wearable device (100) and the external wearable device (200) may be connected to each other via a Bluetooth interface.

[0057] When a user wearing a wearable device (100) and an external wearable device (200) points at an external device (300), the wearable device (100) can detect the pointing gesture based on a sensing value acquired by at least one of the wearable device (100) and the external wearable device (200).

[0058] When a pointing gesture is detected, the wearable device (100) can obtain intensity information about the intensity of a first signal transmitted by the external device (300), obtain intensity information about the intensity of a second signal transmitted by the external wearable device (200), and receive intensity information about a third signal received by the external wearable device (200) from the external device (300).

[0059] At this time, since the signal intensity information is inversely proportional to the distance, the wearable device (100) can obtain information about the angle (θ) formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) based on the intensity information of the first to third signals. Here, the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) may be a virtual line rather than a line that actually exists between the two devices.

[0060] And, the wearable device (100) can identify whether the external device (300) is a control target device based on whether the angle (θ) is within a threshold value. Here, the control target device may be a device that the user points to and wishes to control. Specifically, if the angle (θ) is identified as being less than or equal to the threshold value, the wearable device (100) can identify the external device (300) as a control target device. If the threshold value is defined as a range having an upper limit and a lower limit, the wearable device (100) can identify the external device (300) as a control target device if the angle θ is between the lower limit and the upper limit. If the threshold value corresponds only to the upper limit, the wearable device (100) can identify the external device (300) as a control target device if the angle θ is less than or equal to the upper limit.

[0061] When the control target device is identified, the wearable device (100) can switch to a control mode for controlling the external device (300). At this time, the control mode may be a mode for controlling the control target device according to a user gesture (or hand gesture) detected through the wearable device (100) or the external wearable device (200).

[0062] When a user gesture is detected through the wearable device (100) or the external wearable device (200) during the control mode, the wearable device (100) can identify a control command for controlling a function of the external device (300) corresponding to the detected user gesture and transmit the control command to the external device (300).

[0063] FIG. 2 is a block diagram illustrating a configuration of a wearable device according to one or more embodiments of the present disclosure. As illustrated in FIG. 2, the wearable device (100) may include a communication interface (110), a sensor (120), a display (130), a memory (140), and a processor (150). Meanwhile, the configuration of the wearable device (100) as illustrated in FIG. 1 is merely an example, and some components may be deleted or added depending on the implementation example of the wearable device (100).

[0064] The communication interface (110) is a component that performs communication with various types of external devices according to various types of communication methods. The communication interface (110) may include at least one wireless communication module. Here, each communication module may be implemented in the form of at least one hardware chip. The wireless communication module may be a module that wirelessly communicates with an external device. For example, the wireless communication module may include at least one module among a Wi-Fi interface, a Bluetooth interface, an infrared communication interface, or other communication interfaces. In addition to the above-described communication methods, the other communication interface may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0065] In particular, the Bluetooth interface can communicate via Bluetooth. When using a Bluetooth interface, devices establish a communication connection through a pairing process, exchanging authentication and encrypted link keys, and then transmitting and receiving various types of information.

[0066] In particular, the communication interface (110) can receive a signal via a Bluetooth interface. In particular, the communication interface (110) can receive a first signal from an external device (300) and a second signal from an external wearable device (200). Here, the processor (150) can obtain intensity information of the first and second signals received via the communication interface (110).

[0067] Additionally, the communication interface (110) can receive, from the external wearable device (200), information on the intensity of a third signal received from the external device (300).

[0068] The sensor (120) can obtain data about the surrounding environment of the wearable device (100) or about the user using the wearable device (100). The sensor (120) can include a light sensor, an inertial sensor, a magnetic sensor, a barometric pressure sensor, a biometric sensor, a temperature sensor, and an electrode sensor.

[0069] The light sensor can obtain a sensing value for the brightness of external light to control the brightness of the display (130). The inertial sensor can detect inertia, such as an acceleration sensor or a gyroscope. The inertial sensor can be equipped with only an acceleration sensor (3-axis), or can be equipped with a 6-axis sensor including an acceleration sensor and a gyroscope. The inertial sensor can obtain sensing values ​​for the motion, gesture, impact, posture, and activity (sedentary, moving, sports) of the wearable device (100). The magnetic sensor can detect external magnetism and obtain a sensing value for measuring direction by detecting the Earth's magnetic field. The barometric sensor can detect air pressure and estimate altitude using the barometric sensor. The biosensor is a sensor that irradiates light onto a living body and receives the light absorbed, scattered, and reflected. The emitter of the biosensor emits light of various bands and may be composed of elements such as an LED, a laser, and a vertical cavity surface emitting laser (VCSEL). The band of the emitter may be composed of various wavelengths such as green, red, infrared (IR), blue, yellow, and ultraviolet (UV). The light receiving unit of the biosensor receives light reflected or transmitted from the light irradiated from the emitter and stores the converted value through an analog to digital converter (ADC) in a memory (140) or a sensor buffer. The light receiving unit of the biosensor may include a photodiode (PD) or a complementary metal-oxide-semiconductor (CMOS) (camera). The light receiving unit of the biosensor may have a filter to receive light of a specific band or filter out light outside of a specific band.The control unit of the biosensor can be an IC or an analog front-end (AFE), and can control a light emitting unit and a light receiving unit, process the received data, and transmit it to at least one processor (150) or store it in a memory (140). In addition, the biosensor can detect a target by emitting sound waves instead of light to the body. Alternatively, the biosensor can be a combination of emitting light and receiving the absorbed, scattered, or reflected light, emitting sound waves and receiving the reflected sound waves, or sensing an image. The biosensor can include a photoplethysmogram (PPG) sensor that detects pulse waves with light, and can measure heart rate (HR), heart rate variability (HRV), blood oxygen saturation (SpO2), and blood pressure. In addition, the biosensor can include a biomarker sensor that detects a specific substance or component in the body. Biomarkers are indicators that can indicate changes in the body, such as cells, blood vessels, proteins, DNA (deoxyribonucleic acid), RNA (ribonucleic acid), and metabolites, and can detect blood sugar, alcohol, AGE (advanced glycation end-product), and antioxidants. A temperature sensor is a sensor that measures the temperature of a living body or a part. Depending on the method, temperature sensors are classified into contact and non-contact types. The temperature value measured by the temperature sensor can be stored in the memory (140) or transmitted to the processor (150) to be used to estimate the skin temperature sensor, or to recognize the situation and estimate the body temperature.

[0070] Electrode sensors may include electrodes that detect biological characteristics through contact with the living body. Electrodes are interfaces for measuring electrical characteristics (voltage, current, impedance) through the living body, and can detect various physical characteristics by forming an equivalent circuit using the body as a medium. In the case of smartwatches, the biological status can be measured by detecting electrical signals generated from bodily activity through electrocardiograms (ECGs), electromyograms (EMGs), and electroencephalograms (EEGs). In the case of smartwatches, the INP (wrist) and INM (finger) electrodes can be used for ECG measurements to measure electrical signals generated from the heart. In addition, the RLD electrode can be used as a ground to align the potential reference of the biological signal, thereby further improving the accuracy of biological signal measurement. Body composition can be measured through body impedance analysis (BIA) measurements using the smartwatch's four electrodes. Body composition can include body fat and body water. The smartwatch's two electrodes can be used to measure skin electrodermal activity (EDA). EDA can include measurements related to skin conductance, galvanic skin response (GSR), electrodermal response (EDR), and psychogalvanic reflex (PRG). In this way, electrode sensors can measure various biomarkers and generate bio-related data based on sensor circuits that connect the electrodes to the body via an interface.

[0071] The display (130) can display a graphical user interface (GUI) of applications, functions, and services. The display (130) can have a touch panel superimposed or integrated into at least a portion or the entirety of the display (130), and can include touch, pressure sensing, and electrode sensing elements using transparent electrodes for biosensing. In addition, the display (140) can include elements such as a liquid crystal display (LCD), an organic light emitting display (OLED), and a micro LED.

[0072] The display (130) can provide guide information to guide the controlled device.

[0073] The memory (140) may store at least one instruction regarding the wearable device (100). In addition, the memory (140) may store an operating system (O / S) for driving the wearable device (100). In addition, the memory (140) may store various software programs or applications for operating the wearable device (100) according to one or more embodiments of the present disclosure. Specifically, the memory (140) may store various software modules for operating the wearable device (100) according to one or more embodiments of the present disclosure, and at least one processor (150) may execute various software modules stored in the memory (140) to control the operation of the wearable device (100). That is, the memory (140) is accessed by at least one processor (150), and data can be read / written / modified / deleted / updated by at least one processor (150).

[0074] In one or more embodiments, the memory (140) may store various data or programs for identifying the controlled device. For example, the memory (140) may store information about a user profile and may store correction values ​​corresponding to an external device (300).

[0075] The processor (150) can control the electronic device (100) according to at least one instruction stored in the memory (120).

[0076] In particular, the processor (150) may include one or more processors. Specifically, the one or more processors may include one or more of a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a many integrated core (MIC), a digital signal processor (DSP), a neural processing unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors may control one or any combination of other components of the electronic device and perform operations related to communication or data processing. The one or more processors may individually or collectively execute one or more programs or instructions stored in a memory. For example, the one or more processors may execute one or more instructions stored in a memory to perform a method according to one or more embodiments of the present disclosure. For example, the processor (110) may correspond to a plurality of processors that collectively perform a plurality of operations by dividing them among the processors.

[0077] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one processor or by a plurality of processors. That is, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-dedicated processor). For example, according to one or more embodiments of the present disclosure, an operation of identifying a control target device using a neural network model may be performed by a processor that performs parallel operations, such as a GPU or NPU, and an operation of calculating an angle may be performed by a general-purpose processor, such as a CPU.

[0078] One or more processors may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include internal processor memory, such as cache memory or on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure.

[0079] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0080] In embodiments of the present disclosure, the processor (150) may mean a system on chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0081] In particular, the processor (150) obtains intensity information about the intensity of the first signal transmitted by the external device (300). The processor (150) obtains intensity information about the intensity of the second signal transmitted by the external wearable device (200). The processor (150) receives intensity information about the third signal received by the external wearable device (200) from the external device (300) through the communication interface (110). Based on the intensity information about the first to third signals, the processor (150) obtains information about the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300). The processor (150) can identify whether the external device (300) is a control target device based on whether the angle is within a threshold value.

[0082] FIG. 3 is a diagram illustrating software modules included in a system according to one or more embodiments of the present disclosure. As illustrated in FIG. 3, a wearable device (100) may include a sensing data collection module (311), a gesture recognition module (312), a signal strength measurement module (313), an angle calculation module (314), a guide provision module (315), and an external device control module (316). An external wearable device (200) may include a sensing data collection module (321), a signal output module (322), a signal strength measurement module (323), and a guide provision module (324). An external device (30) may include a signal output module (331) and a control module (332). The modules illustrated in FIG. 3 may be implemented in software, but this is merely an example, and may also be implemented in a combination of software and hardware.

[0083] The sensing data collection module (311) can obtain sensing data related to a user's gesture (particularly, a hand gesture) using the sensor (120). In particular, the wearable device (100) can identify a pointing gesture or a predefined hand gesture, etc., based on the sensing data obtained through the sensing data collection module (311). Here, the sensing data can obtain acceleration (x, y, z axes) and gyroscope (angular velocity x, y, z axes) data from an IMU sensor composed of an acceleration sensor and a gyro sensor. At this time, the sensing data can be called by various terms such as a sensing value, sensing information, etc.

[0084] The gesture recognition module (312) can recognize a user's gesture based on the sensing data acquired through the sensing data collection module (311). Specifically, the gesture recognition module (312) can preprocess (e.g., filter, normalize, etc.) the sensing data acquired through the sensing data collection module (311) and extract feature information based on the preprocessed sensing data. Here, the extracted feature information may be at least one of basic feature information (e.g., basic statistical features such as mean, standard deviation, etc.), feature information in the time domain, and feature information in the frequency domain. In addition, the gesture recognition module (312) can recognize a gesture by inputting the extracted feature information into a learned model. In one or more embodiments, the gesture recognition module (312) can recognize a user's gesture based on sensing data received from an external wearable device (200).

[0085] The signal strength measurement module (313) can measure the strength of a signal received from one of the external wearable device (200) and the external device (300). At this time, the signal strength is RSSI (Received Signal Strength Indicator) information, which can be usefully used when estimating the distance between the wearable device (100) and other devices. Specifically, the signal strength measurement module (313) can measure the strength information of a first signal received from the external device (300) and measure the strength information of a second signal received from the external wearable device (200).

[0086] The angle calculation module (314) can obtain information about the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) based on the intensity information for the first to third signals. Here, the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) may be a virtual line rather than a line that actually exists between the two devices.

[0087] Specifically, the angle calculation module (314) can estimate the ratio of line segments of a triangle formed by the wearable device (100), the external wearable device (200), and the external device (300) based on the intensity information of the first to third signals. In addition, the angle calculation module (314) can obtain information on the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) based on the estimated ratio of line segments of the triangle. This will be described in more detail later with reference to the drawings.

[0088] Additionally, the angle calculation module (314) can identify the user's hand size based on the user profile and correct the signal intensity information according to the identified hand size.

[0089] The guide provision module (315) can provide various guide information. In one or more embodiments, the guide provision module (315) can provide guide information including information about the identified control target device. Alternatively, the guide provision module (315) can provide guide information indicating that the control target device has entered a control mode. Alternatively, the guide provision module (315) can provide guide information including information about a recognized gesture.

[0090] The guide provision module (315) may provide guide information through the display (130), but this is only one embodiment. It may provide an auditory message through a speaker and a tactile message through a haptic module.

[0091] The external device control module (316) can identify control information corresponding to the gesture recognized by the gesture recognition module (312). Specifically, the memory (140) can store mapping information that maps hand gestures and control information according to the type of the external device (300). The external device control module (316) can identify control information corresponding to the recognized hand gesture based on the mapping information corresponding to the identified external device.

[0092] The sensing data collection module (321), signal strength measurement module (323), and guide provision module (324) included in the external wearable device (200) perform the same functions as the sensing data collection module (311), signal strength measurement module (313), and guide provision module (315) included in the wearable device (100), so redundant descriptions are omitted.

[0093] The signal output module (322) can output a signal via a Bluetooth interface. In one or more embodiments, the signal output module (322) can transmit an advertising signal including identification and description information for the external wearable device (200). The advertising signal can include an advertising packet and information about the external wearable device (200). The advertising packet can include fields such as a device name, a media access control (MAC) address, a universally unique identifier (UUID) for available services, and other relevant metadata related to the external wearable device (200). The wearable device (100) can receive the signal output by the signal output module (322) and obtain signal strength information that can estimate the proximity or distance of the external wearable device (200) using information such as a received signal strength indicator (RSSI).

[0094] The signal output module (331) included in the external device (300) performs the same function as the signal output module (322) included in the external wearable device (200), so a duplicate description is omitted.

[0095] The control module (332) can control various functions of the external device (300). In one or more embodiments, the control module (332) can control functions of the external device (300) according to control information generated by the external device control module (316) of the wearable device (100). In another embodiment, the control module (332) can control various functions of the external device (300) according to user commands input through another device for controlling the external device (300) or an interface provided in the external device (300).

[0096] FIG. 4 is a flowchart illustrating a method for a wearable device to control an external device pointed at by a user, according to one or more embodiments of the present disclosure.

[0097] First, the wearable device (100) determines whether a pointing gesture has been detected (S410). At this time, the pointing gesture refers to a gesture in which a user wearing the wearable device (100) points to one of the devices in the home. In one or more embodiments, this may be a gesture in which a user wearing an external wearable device (200) extends his or her finger and points the finger toward the external device.

[0098] In one or more embodiments, the wearable device (100) may detect a pointing gesture using a sensing value through a sensor included in the wearable device (100). Here, the sensor for detecting the pointing gesture may include various sensors such as a motion sensor (e.g., an acceleration sensor, a gyro sensor, etc.), a PPG (Plethysmograph) sensor, etc.

[0099] In one or more embodiments, the wearable device (100) may receive a sensing value acquired through a sensor included in an external wearable device (200). Here, the external wearable device (200) may be configured as a wearable device worn on the finger of a user who wears the wearable device (100) on the wrist. The external wearable device (200) may be a smart ring. The wearable device (100) may receive a sensing value from the external wearable device (200) to detect a pointing gesture. Here, the external wearable device (200) may obtain timestamp information, which is information about the time at which the sensing value was detected, together with the sensing value. The external wearable device (200) may detect a pointing gesture through a sensing value included in a window of a preset size using the timestamp information.

[0100] The wearable device (100) can obtain intensity information of the first to third signals (S420). Here, the first signal can be transmitted (or broadcast) by an external device (300) and received by the wearable device (100), the second signal can be transmitted by an external wearable device (200) and received by the wearable device (100), and the third signal can be transmitted (or broadcast) by an external device (300) and received by the external wearable device (200). The intensity information of the first and second signals can be obtained by the wearable device (100), and the third signal can be obtained by the external wearable device (200) and transmitted to the wearable device (100).

[0101] Signal strength information is a value indicating the strength of a signal transmitted from a communication interface (e.g., a Bluetooth interface). Strength information primarily indicates signal power or signal quality, and can be measured in units such as dBm (decibel milliwatts) or RSSI (Received Signal Strength Indicator).

[0102] In particular, the signal strength received through the Bluetooth interface may be stronger as the distance gets closer and weaker as the distance gets farther away. In other words, the signal strength may be inversely proportional to the distance. Therefore, the wearable device (100) may obtain the ratio of the lengths of the triangle formed by the wearable device (100), the external wearable device (200), and the external device (300) based on the strength information of the first to third signals. The wearable device (100) may obtain information on the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) based on the ratio of the lengths of the triangle formed by the wearable device (100), the external wearable device (200), and the external device (300). This will be described in more detail later with reference to FIG. 6.

[0103] In one or more embodiments, the wearable device (100) may correct the intensity information of the first to third signals based on the user's profile information. Specifically, since each user has a different hand size, the wearable device (100) may estimate the user's hand size based on age information included in the user's profile information, and correct the intensity of the first to third signals based on the estimated hand size. This will be described in more detail later with reference to FIG. 7.

[0104] The wearable device (100) can identify a control target device (S430). Here, the control target device may be an external device pointed at by the user and intended to be controlled by the user. The term "control target device" may be replaced with terms such as target device, pointing device, receiving device, etc.

[0105] Specifically, the wearable device (100) can identify whether the external device (300) is a control target device based on whether the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) is less than or equal to a threshold value. At this time, the threshold value is the maximum angle that the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) can form when the wearable device (100), the external wearable device (200), and the external device (300) worn by the user are positioned in a straight line, and may be, for example, 1 degree. At this time, the threshold value may vary depending on the type of the external device (300).

[0106] When the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) is less than or equal to a critical angle, the wearable device (100) can identify the user as pointing at the external device (300) and thereby identify the external device (300) as a control target device.

[0107] In one or more embodiments, the wearable device (100) may acquire a correction value corresponding to the external device when initially setting a mode for controlling the external device using the wearable device (100). Then, when the external device (300) is identified, the wearable device (100) may correct a threshold value corresponding to the external device (300) based on the acquired correction value. This will be described in more detail later with reference to FIG. 15.

[0108] In one or more embodiments, when there are multiple external devices whose angles between the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) are less than or equal to a critical angle, the wearable device (100) may compare signal intensity information received from the multiple external devices whose angles are less than or equal to the critical angle. Then, the wearable device (100) may identify the external device with the largest signal intensity among the multiple external devices as the control target device. This will be described in more detail later with reference to FIG. 9. However, this is merely an example, and the wearable device (100) may identify the external device with the smallest angle among the multiple external devices as the control target device.

[0109] The wearable device (100) may enter a control mode for controlling the target device (S440). At this time, the control mode may be a mode for controlling the target device according to a user gesture detected through the wearable device (100) or an external wearable device (200). The control mode may be configured to interpret a user gesture detected through the wearable device (100) or an external wearable device (200). At this time, the control mode may be named by various terms such as a gesture control mode, a motion control mode, an external device control mode, etc. However, controlling the target device according to a user gesture during the control mode is only one embodiment, and the target device may be controlled by other input methods (e.g., user voice, etc.).

[0110] The wearable device (100) can display information about the identified control target device (S450). Specifically, the wearable device (100) can display information about the control target device based on identification information received from the external device (300). For example, the wearable device (100) can display identification information such as the type, product name, nickname, etc. of the control target device, as well as information about the current status of the control target device (e.g., operation mode, volume, channel, etc.). In one or more embodiments, the wearable device (100) can also display guide information indicating that the current mode is a control mode for controlling the control target device.

[0111] The wearable device (100) can identify whether a predefined hand gesture has been input (S460). At this time, the predefined hand gesture refers to a gesture for controlling an external device (300) using a hand, and information about the hand gesture may be pre-stored. For example, the predefined hand gesture may include various gestures such as a gesture of swiping a hand in an up / down / left / right direction, a gesture of tapping a hand, a gesture of rotating a finger, a gesture of flicking a finger, a gesture of knocking with a clenched fist, a gesture of rotating a hand with a clenched fist, etc.

[0112] In one or more embodiments, the wearable device (100) can identify whether a predefined hand gesture has been input based on a sensing value acquired through a sensor included in the wearable device (100). In addition, the wearable device (100) can identify whether a predefined hand gesture has been input by receiving a sensing value acquired through a sensor included in an external wearable device (200).

[0113] In one or more embodiments, the wearable device (100) may map and store predefined hand gestures and control commands. Here, the predefined gestures may be mapped to different functions depending on the type of the external device (300). For example, if the type of the external device (300) is a TV, a gesture pointing at the external device (300) and pointing a finger upward may be a control command to change the channel upward, and if the type of the external device (300) is an air conditioner, a gesture pointing at the external device (300) and pointing a finger upward may be a control command to increase the set temperature.

[0114] If a predefined hand gesture is identified as being input (S460-Y), the wearable device (100) can transmit a control command corresponding to the predefined hand gesture (S470). That is, the wearable device (100) can identify a control command corresponding to the predefined hand gesture using mapping information stored in the memory, and transmit the identified control command to the external device (300) which is the control target device.

[0115] In addition, the wearable device (100) can identify whether a gesture for terminating the control mode has been input (S480). Here, the gesture for terminating the control mode may be a predefined gesture, such as, for example, a gesture of clenching and unclenching a hand twice, but is not limited thereto.

[0116] If it is determined that a predefined hand gesture has not been input (S460-N), the wearable device (100) can identify whether the pointing has changed to another external device (S490). Here, the wearable device (100) can identify whether the pointing has changed to another external device by identifying whether the pointing direction of the hand or finger has changed due to the detection of a motion of a hand or finger exceeding a preset size.

[0117] In one or more embodiments, the wearable device (100) can identify whether the pointing has changed to another external device based on a sensing value acquired through a sensor included in the wearable device (100). In addition, the wearable device (100) can identify whether the pointing has changed to another external device by receiving a sensing value acquired through a sensor included in an external wearable device (200).

[0118] If it is identified that the pointing has changed to another external device (S490-Y), the wearable device (100) can perform operations S420 to S460 again to identify and control the other external device.

[0119] If it is identified that the pointing has not been changed to another external device (S490-N), it is possible to identify whether a gesture to exit the control mode has been input (S480).

[0120] Hereinafter, the present disclosure will be described in more detail with reference to the drawings.

[0121] FIG. 5 is a sequence diagram illustrating a method for a wearable device to detect a pointing gesture according to one or more embodiments of the present disclosure.

[0122] First, the wearable device (100) can obtain a first sensing value from a sensor (120) (S510). At this time, the sensor (120) is a sensor for detecting a user's gesture, and may be, in one or more embodiments, a motion sensor such as an acceleration sensor or a gyro sensor, but is not limited thereto.

[0123] An external wearable device (200) can obtain a second sensing value from a sensor (S520). The external wearable device (200) can also utilize a sensor to detect a user's gesture.

[0124] The external wearable device (200) can transmit the second sensing value to the wearable device (100) (S530). Here, the external wearable device (200) can transmit a signal including timestamp information, a sensing value acquired by an acceleration sensor, a sensing value acquired by a gyro sensor, and information acquired by a PPG sensor. For example, the external wearable device (200) can transmit a signal including the following information to the wearable device (100).

[0125] timestamp: 142351232,

[0126] acc_xyz: (0.12, 0.53, 0.05),

[0127] gyro_xyz: (0.62, 0.02, 0.06)

[0128] ppg: 1.2

[0129] The wearable device (100) can detect a pointing gesture based on the first and second sensing values ​​(S540). Here, the pointing gesture may be a gesture in which a user wearing the wearable device (100) points to one of the devices in the home.

[0130] In particular, the wearable device (100) can detect a pointing gesture based on the window t. That is, the wearable device (100) can detect a pointing gesture by extracting a portion of the acquired first and second sensing values ​​and analyzing the signal of the extracted portion.

[0131] FIG. 6 is a diagram illustrating a method for identifying an external device pointed at by a wearable device according to one or more embodiments of the present disclosure.

[0132] As described above in operation S430, the wearable device (100) can identify whether the external device (300) is a control target device based on whether the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) is less than or equal to a threshold value.

[0133] Specifically, as illustrated in FIG. 6, the wearable device (100), the external wearable device (200), and the external device (300) may form a triangle. At this time, the line segments of the triangle may include a line (S1) between the wearable device (100) and the external device (300), a line (S2) between the wearable device (100) and the external wearable device (200), and a line (S3) between the external wearable device (200) and the external device (300).

[0134] In particular, the wearable device (100) can obtain the ratio of the lengths of S1 to S3 based on the intensity information of the first to third signals. Here, the first signal may be a signal transmitted (or broadcast) by an external device (300) and received by the wearable device (100), the second signal may be a signal transmitted by an external wearable device (200) and received by the wearable device (100), and the third signal may be a signal transmitted by an external device (300) and received by the external wearable device (200).

[0135] The wearable device (100) can calculate the angle (θ) formed by S1 and S3 by the following mathematical expression 1 based on the length (or ratio of the lengths) of S1 to S3.

[0136]

[0137] Accordingly, when the angle (θ) formed by S1 and S3 is less than or equal to a threshold value, the wearable device (100) can identify the external device (300) as pointing at it and can identify the external device (300) as a control target device. At this time, the threshold value is an angle at which the user's wrist, the user's finger, and the external device (300) are considered to be in a straight line, and may be, for example, less than 1 degree.

[0138] The threshold value may be set to one value regardless of the external device, but this is only one example and may be set differently depending on the user's hand size or the type of external device.

[0139] Specifically, the hand sizes of users wearing the wearable device (100) and the external wearable device (200) may differ. For example, adults may have larger hands than children, and men may have larger hands than women. As illustrated in FIG. 7, if the hand size of the first user (710) is smaller than that of the second user (720), the length of S2 may differ. In particular, since S2 is a very short side compared to S1 and S3, an error may occur if it does not reflect the hand size.

[0140] To solve this problem, the wearable device (100) can correct the threshold value according to the size of the user's hand obtained based on the user's profile information.

[0141] In one or more embodiments, the wearable device (100) may obtain "Kim Samsung" as account information (810), as illustrated in FIG. 8. Furthermore, the wearable device (100) may obtain user profile information (820) corresponding to the obtained account information (810). At this time, the user profile information (820) may include information indicating that the user is in their 30s, that the device is a ring or a watch, and that the user is male. Furthermore, the wearable device (100) may obtain information (830) regarding a hand size corresponding to the user based on the user profile information (820). While the information regarding the hand size corresponding to the user may be obtained using a hand size knowledge graph of an external server, this is merely an example and may be obtained through other methods.

[0142] In addition, the wearable device (100) can correct the threshold value according to the user's hand size. Specifically, if the user is recognized as having large hands (e.g., an adult male, etc.), the wearable device (100) can correct the threshold value to a first value, and if the user is recognized as having small hands (e.g., a child or a female, etc.), the wearable device (100) can correct the threshold value to a second value smaller than the first value.

[0143] In the above-described embodiment, the threshold value is corrected according to hand size information, but this is only one embodiment, and the length of S2 (or the intensity of the second signal) can be corrected according to hand size information. That is, if the user is recognized as having large hands, the wearable device (100) can correct to increase the length of S2 (or the intensity of the second signal), and if the user is recognized as having small hands, the wearable device (100) can correct to decrease the length of S2 (or the intensity of the second signal).

[0144] In the above-described embodiment, the threshold value is corrected according to the hand size information, but this is only one embodiment, and the line (S2) between the wearable device (100) and the external wearable device (200) can retrieve a predetermined value according to the hand size. That is, when the user's hand size information is acquired, the wearable device (100) can identify S2 based on the acquired hand size information, and can identify the line (S1) between the wearable device (100) and the external device (300), and the line (S3) between the external wearable device (200) and the external device (300) based on the intensity information of the first and third signals. And, the wearable device (100) can obtain information about the angle formed by the line (S1) between the wearable device (100) and the external device (300) and the line (S3) between the external wearable device (200) and the external device (300) based on S1 to S3.

[0145] When there are multiple external devices in the area pointed by the user, the wearable device (100) can identify one of the multiple external devices as the control target device based on the first to third signals.

[0146] FIG. 9 is a flowchart illustrating a method for identifying an external device pointed at by a user among a plurality of external devices according to one or more embodiments of the present disclosure.

[0147] First, the wearable device (100) can obtain information on the intensity of the first to third signals (S910). Here, the first signal is a signal transmitted (or broadcast) by an external device (300) and received by the wearable device (100), the second signal is a signal transmitted by an external wearable device (200) and received by the wearable device (100), and the third signal is a signal transmitted (or broadcast) by an external device (300) and received by the external wearable device (200).

[0148] When multiple external devices exist, the wearable device (100) can obtain intensity information for a first signal corresponding to each of the multiple external devices, and can obtain intensity information for a second signal corresponding to each of the multiple external devices from the external wearable device (200).

[0149] The wearable device (100) can obtain information about the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) (S920). The wearable device (100) can obtain information about the angle corresponding to each of the plurality of external devices.

[0150] In one or more embodiments, as illustrated in FIG. 10, the wearable device (100) can obtain information about a first angle (θ1) formed by a line between the wearable device (100) and the first external device (300-1) and a line between the external wearable device (200) and the first external device (300-2), and information about a second angle (θ2) formed by a line between the wearable device (100) and the second external device (300-2) and a line between the external wearable device (200) and the second external device (300-2), in the same manner as described in FIG. 6.

[0151] In addition, the wearable device (100) can identify whether there is an external device whose angle is less than or equal to a threshold value (S930). That is, the wearable device (100) can identify whether there is an external device whose angle is less than or equal to a threshold value by identifying whether the first angle (θ1) and the second angle (θ2) are less than or equal to a threshold value.

[0152] If it is identified that there is an external device whose angle is less than the threshold value (S930-Y), the wearable device (100) can identify whether there are multiple external devices corresponding to angles less than the threshold value (S940). In one or more embodiments, the wearable device (100) can identify whether both the first angle (θ1) and the second angle (θ2) are less than the threshold value.

[0153] If it is identified that there are not multiple external devices corresponding to an angle below the threshold value (i.e., if it is identified that there is only one external device corresponding to an angle below one threshold value) (S940-N), the wearable device (100) may determine one external device as a control target device (S950). For example, if only the first angle among the first angle (θ1) and the second angle (θ2) is identified as being below the threshold value, the wearable device (100) may determine the first external device (300-1) corresponding to the first angle as the control target device.

[0154] If it is identified that there are multiple external devices corresponding to angles below the threshold value (S940-Y), the wearable device (100) can determine the device with the strongest signal strength among the multiple external devices as the control target device (S960). For example, if both the first angle (θ1) and the second angle (θ2) are identified as being below the threshold value, the wearable device (100) can compare the intensities of the signal received from the first external device (300-1) and the signal received from the second external device (300-1) and determine the first external device (300-1) with the strongest signal strength as the control target device.

[0155] In the above-described embodiment, it has been described that the wearable device (100) determines the external device with the strongest signal strength among the plurality of external devices as the control target device, but this is only one embodiment, and the wearable device (100) may determine the external device corresponding to the smallest angle as the control target device. For example, if both the first angle (θ1) and the second angle (θ2) are identified as being below a threshold value, but the first angle (θ1) is identified as being smaller than the second angle (θ2), the wearable device (100) may determine the first external device (300-1) corresponding to the first angle (θ1) as the control target device.

[0156] Once the control target device is determined, the wearable device (100) can provide guide information to guide the determined control target device. At this time, the guide information can include information about the external device determined as the control target device and an inquiry message inquiring whether to control the external device. For example, as illustrated in FIG. 11, the wearable device (100) can provide guide information (1100) that includes information about a TV, the external device determined as the control target device, and an inquiry message inquiring whether to control the TV.

[0157] FIG. 12 is a flowchart illustrating a control method for changing a control target device according to a change in a user's pointing direction, according to one or more embodiments of the present disclosure.

[0158] First, the wearable device (100) can identify whether a pointing change has been detected using sensing data (S1210). At this time, the sensing data may be acquired through the sensor (120) of the wearable device (100), but this is only one embodiment, and the sensing data may be acquired through the sensor of the external wearable device (200) and received from the external wearable device (200). At this time, the sensing data may be acquired by a motion sensor for detecting the user's gesture, but is not limited thereto, and may be data acquired from another sensor (e.g., an image sensor, etc.).

[0159] In particular, the wearable device (100) can identify whether there is a change in the detected user's gesture using sensing data. That is, the wearable device (100) can identify whether a pointing change has been detected by identifying whether the gesture of the user's hand or finger is a preset gesture. For example, the wearable device (100) can identify whether a pointing change has been detected by identifying whether the hand or finger has moved left-right or up-down while the finger wearing the external wearable device (200) is extended.

[0160] The wearable device (100) can identify whether an external device (300) exists with an angle less than or equal to a threshold value based on the changed pointing direction (S1220). That is, as described above in FIG. 6, the wearable device (100) can identify whether an external device exists with an angle less than or equal to a threshold value based on a signal received from an external device located in the changed pointing direction.

[0161] If it is identified that an external device (300) with an angle less than or equal to a threshold exists (S1220-Y), the wearable device (100) can determine the external device located in the changed direction as a control target device (S1230).

[0162] If it is identified that there is no external device (300) whose angle is less than the threshold value (S1220-Y), the wearable device (100) can perform a BLE scan operation (S1230). That is, the wearable device (100) can perform an operation of scanning another external device.

[0163] Even if a user wearing a wearable device (100) points at an external device (300), if the communication interface of the external device (300) is not activated, the operation of the present disclosure cannot be performed. Accordingly, the wearable device (100) can identify whether the communication interface of an external device in the home is activated and activate the communication interface of the external device in the home.

[0164] FIG. 13 is a flowchart illustrating a method for activating a communication interface of an external device according to one or more embodiments of the present disclosure.

[0165] First, the wearable device (100) can detect a pointing gesture (S1310). As described above, the wearable device (100) can detect a pointing gesture based on a sensing value acquired through a sensor (120) or a sensing value received from an external wearable device (200).

[0166] When a pointing gesture is detected (S1310-Y), the wearable device (100) can identify whether the communication interfaces of devices located in the home are activated using an external server (S1320). At this time, the external server is a server for managing and controlling the wearable device (100) and various devices in the home, and may be referred to by various terms such as a smart home server, a home IOT server, a cloud server, etc. Here, the external server can receive and store status information (e.g., power information, communication status information, operation information, etc.) of various devices in the home at a preset cycle.

[0167] Specifically, the wearable device (100) may request information about an external device located within the home from an external server. The information about the external device may include identification information of the external device, status information of the external device, etc. The wearable device (100) may identify whether the communication interface of the external device is activated based on the status information of the external device located within the home from the external server.

[0168] When the communication interface of the external device is identified as being activated (S1330-Y), the wearable device (100) can obtain intensity information for the first to third signals corresponding to the external device with the communication interface activated (S1340).

[0169] And, the wearable device (100) can identify the control target device based on the intensity information for the first to third signals (S1360).

[0170] If the communication interface of the external device is identified as not being activated (S1330-N), the wearable device (100) may transmit a command to activate the communication interfaces of all devices (S1350). Here, the wearable device (100) may transmit a command to activate the communication interface of the external device through an external server, but this is only one embodiment, and the wearable device (100) may directly transmit a command to activate the communication interface of the external device through some activated communication interfaces.

[0171] After the communication interface of the external device is activated, the wearable device (100) can identify the control target device based on the intensity information for the first to third signals (S1360).

[0172] FIG. 14A is a flowchart illustrating a method for activating a communication interface of an external device according to another embodiment of the present disclosure.

[0173] The wearable device (100) can detect a pointing gesture (S1410). As described above, the wearable device (100) can detect a pointing gesture based on a sensing value acquired through a sensor (120) or a sensing value received from an external wearable device (200).

[0174] When a pointing gesture is detected (S1410-Y), the wearable device (100) can identify an external device near the user based on the signal strength (S1420). Specifically, the wearable device (100) can identify an external device near the user based on the signal strength received from an external device existing in an area where the user is located in the home. As illustrated in FIG. 14B, the wearable device (100) can identify an area where the identified external device is located using a pre-stored map (1400). In addition, the wearable device (100) can identify the area where the identified external device is located as an area where the user is located. For example, when the signal received by the wearable device (100) is received from a first external device, the wearable device (100) can identify that the first external device is located in the living room based on the map (1400), and thus identify that the user is located in the living room. When signals are received from multiple external devices, the wearable device (100) can identify the area where the external device with the strongest signal strength is located as the area where the user is located.

[0175] The wearable device (100) can identify whether the communication interfaces of devices located within the area where the user is located are activated using an external server (S1430).

[0176] Specifically, the wearable device (100) may request information about an external device located within the area where the user is located from an external server. At this time, the information about the external device may include identification information of the external device, status information of the external device, etc. The wearable device (100) may identify whether the communication interface of the external device is activated based on the status information of the external device located within the area where the user is located from the external server.

[0177] If it is identified that the communication interface of an external device is activated within the area where the user is located (S1440-Y), the wearable device (100) can obtain intensity information on the first to third signals corresponding to the external device with the activated communication interface (S1450). Then, the wearable device (100) can identify the control target device based on the intensity information on the first to third signals (S1470).

[0178] If it is determined that the communication interface of an external device located within the area where the user is located is not activated (S1440-N), the wearable device (100) can transmit a command to activate the communication interface of the device located within the area where the user is located (S1460). After the communication interface of the external device is activated, the wearable device (100) can identify the control target device based on the intensity information for the first to third signals (S1470).

[0179] FIG. 15 is a flowchart illustrating a method for activating a communication interface of an external device according to another embodiment of the present disclosure.

[0180] The wearable device (100) can detect a pointing gesture (S1510).

[0181] When a pointing gesture is detected (S1410-Y), the wearable device (100) can identify whether an external device is present near the user based on the signal strength (S1520).

[0182] If it is determined that there is no external device near the user (S1520-N), the wearable device (100) can transmit a command to activate the communication interface of all devices (S1530). Then, the wearable device (100) can obtain intensity information on the first to third signals corresponding to the external devices whose communication interfaces are activated (S1540). Then, the wearable device (100) can identify the control target device based on the intensity information on the first to third signals (S1580).

[0183] When it is identified that an external device exists near the user (S1520-Y), the wearable device (100) can use an external server to identify whether the communication interfaces of the devices located within the area where the user is located are activated (S1550).

[0184] If it is identified that the communication interface of an external device is activated within the area where the user is located (S1560-Y), the wearable device (100) can obtain intensity information on the first to third signals corresponding to the external device with the activated communication interface (S1540). Then, the wearable device (100) can identify the control target device based on the intensity information on the first to third signals (S1580).

[0185] If it is determined that the communication interface of an external device located within the area where the user is located is not activated (S1560-N), the wearable device (100) can transmit a command to activate the communication interface of the device located within the area where the user is located (S1570). After the communication interface of the external device is activated, the wearable device (100) can obtain intensity information for the first to third signals (S1540) to identify the control target device (S1580).

[0186] FIG. 16 is a diagram illustrating an initial setting for a mode of controlling an external device using a wearable device according to one or more embodiments of the present disclosure.

[0187] When initially setting up a control mode for controlling an external device using a wearable device (100), a correction value of a threshold value can be obtained.

[0188] Specifically, as illustrated in FIG. 16, when initially setting up a control mode for controlling an external device, the first external device (300-1) may provide guide information requesting pointing to multiple areas (1601, 1603, 1605) of the first external device (300-1). At this time, the guide information may include guide indicators on the multiple areas (1601, 1603, 1605) of the display, and may include a voice message (1610) such as "I will register wearable pointing. Please point to 1, 2, 3."

[0189] When the wearable device (100) points to multiple areas (1601, 1603, 1605), the wearable device (100) can store information about the angles acquired at the time of pointing each of the multiple areas (1601, 1603, 1605). In addition, the wearable device (100) can acquire a correction value for a threshold value corresponding to the first external device (300-1) based on the information about the acquired angles.

[0190] Additionally, when initially setting up a control mode for controlling an external device, the second external device (300-2) may provide guide information requesting pointing to multiple areas (1611, 1613) of the second external device (300-2). At this time, the guide information may include guide indicators on the multiple areas (1611, 1613) of the display, and may include a voice message (1620) such as "I will register wearable pointing. Please point to 1, 2."

[0191] When the wearable device (100) points to multiple areas (1611, 1613), the wearable device (100) can store information about the angles acquired at the time of pointing each of the multiple areas (1611, 1613). In addition, the wearable device (100) can acquire a correction value for a threshold value corresponding to the second external device (300-2) based on the information about the acquired angles.

[0192] The correction value for the threshold value obtained in the manner described in Fig. 7 can be used to identify whether an external device is a controlled device.

[0193] When the wearable device (100) identifies an external device (300) as a control target device, it can enter a control mode for controlling the external device (300). Here, the external device (300) may be, but is not limited to, a TV, an air conditioner, an air purifier, a humidifier, a speaker, a microwave oven, a switch / dimmer, a ceiling light, a light, a dehumidifier, etc. In addition, when entering the control mode, the wearable device (100) can control the temperature, sound, brightness, etc. of the external device (300).

[0194] In one or more embodiments, control commands for controlling different functions depending on the external device may be obtained even with the same gesture. In one or more embodiments, if the external device (300) is an air conditioner, the wearable device (100) may change the temperature setting of the external device (300) based on a user gesture. In another example, if the external device (300) is a blind curtain, the wearable device (100) may change the height setting of the external device (300) based on a user gesture.

[0195] In one or more embodiments, when the external device (300) is a smart light, when a gesture pointing to the smart light and double-tapping is input, the wearable device (100) can transmit a control command to the smart light to turn the smart light on or off.

[0196] In one or more embodiments, when the external device (300) is an air conditioner, if a gesture of pointing at the air conditioner and making a fist is input, the wearable device (100) can transmit a control command to the air conditioner to turn the air conditioner on or off.

[0197] In one or more embodiments, when the external device (300) is a smart light, if a gesture of pointing at the smart light, tapping, and then rotating is input, the wearable device (100) may transmit a control command to the smart light to brighten or dim the brightness of the smart light. For example, if a gesture of rotating in a first direction (counterclockwise) is input, the wearable device (100) may transmit a control command to the smart light to brighten the brightness of the smart light. If a gesture of rotating in a second direction (clockwise) is input, the wearable device (100) may transmit a control command to the smart light to dim the brightness of the smart light.

[0198] In one or more embodiments, when the external device (300) is a blind, if a gesture of pointing at the blind and making a fist and then rotating is input, the wearable device (100) may transmit a control command to the blind for raising or lowering the blind. For example, if a gesture of making a fist and then rotating in a first direction (counterclockwise) is input, the wearable device (100) may transmit a control command to the blind for raising the blind. If a gesture of making a fist and then rotating in a second direction (clockwise) is input, the wearable device (100) may transmit a control command to the blind for lowering the blind.

[0199] In one or more embodiments, when the external device (300) is a TV, if a gesture of pointing at the TV and double-tapping is input, the wearable device (100) may transmit a control command to the TV to turn the TV on or off. In addition, if a gesture of pointing at the TV and tapping and then rotating in a first direction (counterclockwise) is input, the wearable device (100) may transmit a control command to the TV to increase the volume of the TV, and if a gesture of pointing at the TV and tapping and then rotating in a second direction (clockwise) is input, the wearable device (100) may transmit a control command to the TV to decrease the volume of the TV. In addition, if a gesture of pointing at the TV and tapping and then raising a hand is input, the wearable device (100) may transmit a control command to the TV to increase the channel of the TV, and if a gesture of pointing at the TV and tapping and then lowering a hand is input, the wearable device (100) may transmit a control command to the TV to decrease the channel of the TV.

[0200] However, the control commands corresponding to the gestures described above are only one example, and it is of course possible to obtain control commands corresponding to other gestures.

[0201] In the above-described embodiment, it has been described that the wearable device (100) identifies whether the external device (300) is a controlled device, but this is merely an example, and a separate user terminal (e.g., a smart phone, etc.) can identify whether the external device (300) is a controlled device. In one or more embodiments, the user terminal can obtain intensity information on the first to third signals from the wearable device (100) or the external wearable device (200). In addition, the user terminal can obtain information on the angle formed by the line between the wearable device (100) and the external device (300) and the line between the external wearable device (200) and the external device (300) based on the intensity information on the first to third signals. In addition, the user terminal can identify whether the external device (300) is a controlled device based on whether the angle is within a threshold value. In addition, it goes without saying that the user terminal can perform the operations of the wearable device (100) described in FIGS. 1 to 16.

[0202] A method according to one or more embodiments of the present disclosure may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0203] A method according to one or more embodiments of the present disclosure may be implemented as software including instructions stored on a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device capable of calling instructions stored from the storage medium and operating according to the called instructions, and may include an electronic device (e.g., a TV) according to the disclosed embodiments.

[0204] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0205] When the above instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0206] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In wearable devices, communication interface; Memory that stores instructions; and At least one processor configured to individually or collectively execute the instructions; The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to: Obtain intensity information about the intensity of the first signal transmitted by an external device, Obtain intensity information about the intensity of a second signal transmitted by an external wearable device, Receive intensity information about the intensity of a third signal received by the external wearable device from the external wearable device through the communication interface, Obtain information about the angle between the line between the wearable device and the external device and the line between the external wearable device and the external device based on the intensity information for the first signal, the second signal and the third signal, A wearable device that identifies whether the external device is a controlled device based on whether the angle is below a threshold value.

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: Obtain information about hand gestures of a user wearing the wearable device based on sensing values ​​detected by a motion sensor, wherein the motion sensor is included in at least one of the wearable device and the external wearable device, A wearable device that transmits a control command corresponding to information about the hand gesture to the external device through the communication interface.

3. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: Obtain user profile information including user's hand size information, A wearable device that corrects the threshold based on a correction value corresponding to the hand size of the user.

4. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: Based on the initial setting for the mode of controlling the external device using the wearable device, a correction value corresponding to the external device is obtained, A wearable device that, when the external device is identified, corrects the threshold value based on the acquired correction value.

5. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: Using an external server, identify whether the external communication interface of at least one device among multiple devices existing in the home is activated, A wearable device that transmits a request signal to activate the external communication interface of at least one device among the plurality of devices existing in the home to the external server through the communication interface when the external communication interface of at least one device among the plurality of devices existing in the home is identified as not being activated.

6. In paragraph 5, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: Obtain information about an area where a user wearing the wearable device is located based on information about a peripheral device included in a signal received through the communication interface, A wearable device that transmits a request signal for activating at least one external communication interface of at least one device located in the area among the plurality of devices existing in the home to the external server through the communication interface.

7. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: Receive a sensing value detected by a motion sensor of the external wearable device from the external wearable device through the communication interface, A wearable device that detects the pointing gesture of the user based on the received sensing value 8. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: Obtain intensity information about the intensity of each of the first signals transmitted from each of the plurality of external devices, Here, the plurality of external devices include the external devices, Based on the intensity information of each of the first signals, the second signal and the third signal, information about each angle formed by a line between the wearable device and each of the plurality of external devices and a line between the external wearable device and the external device is obtained, A wearable device that identifies the external device associated with the largest signal strength among the plurality of external devices as the controlled device when each of the above angles is identified as being below the threshold value.

9. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the wearable device to further: A wearable device that provides guide information including information about the identified external device and information about a mode for controlling the external device.

10. In paragraph 1, The above wearable device includes a device worn on the user's wrist, The above external wearable device is a wearable device including a device worn on a user's finger.

11. In a method for controlling a wearable device, An operation of obtaining intensity information about the intensity of a first signal transmitted by an external device; An operation of obtaining intensity information about the intensity of a second signal transmitted by an external wearable device; An operation of receiving intensity information about the intensity of a third signal received by the external wearable device from the external wearable device through a communication interface of the wearable device; An operation of obtaining information about an angle formed by a line between the wearable device and the external device and a line between the external wearable device and the external device based on intensity information about the first signal, the second signal, and the third signal; and A control method comprising: an operation of identifying whether the external device is a controlled device based on whether the angle is less than or equal to a threshold value; 12. In paragraph 11, The above control method is, An operation of obtaining information about a hand gesture of a user wearing the wearable device based on a sensing value detected by a motion sensor; and Here, the motion sensor is included in at least one of the wearable device and the external wearable device, A control method further comprising: an operation of transmitting a control command corresponding to information about the hand gesture to the external device through the communication interface.

13. In paragraph 11, The above control method is, An action to obtain user profile information including user hand size information; and A control method further comprising: an operation of correcting the threshold value based on a correction value corresponding to the hand size of the user.

14. In paragraph 11, An operation of obtaining a correction value corresponding to the external device based on an initial setting for a mode of controlling the external device using the wearable device; and A control method further comprising: an operation of correcting the threshold value based on the obtained correction value when the external device is identified; 15. In paragraph 11, The above control method is, An action of identifying whether an external communication interface of at least one device among multiple devices existing in a home is activated using an external server; A control method further comprising: an operation of transmitting a request signal for activating the external communication interface of at least one device among the plurality of devices existing in the home to the external server when the external communication interface of at least one device among the plurality of devices existing in the home is identified as not being activated;

Images