Electronic device and control method therefor
The electronic device integrates biometric data processing and context-aware control to enhance the adaptability and convenience of wearable devices in controlling peripheral devices.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-09-29
- Publication Date
- 2026-05-07
AI Technical Summary
Existing wearable electronic devices lack the capability to efficiently control peripheral devices based on user context information, limiting their adaptability and convenience in responding to user states.
An electronic device equipped with a communication circuit, processor, and memory, capable of obtaining biometric data from a wearable device, determining user interfaces, identifying external devices, and transmitting control signals to these devices based on user context information.
Enables adaptive control of peripheral devices through wearable devices, enhancing user convenience by responding to user states and improving device interaction.
Smart Images

Figure KR2025015323_07052026_PF_FP_ABST
Abstract
Description
Electronic device and control method thereof
[0001] One embodiment disclosed in this document relates to an electronic device and a method for controlling the same, and relates to a method for generating a control signal of the electronic device through a wearable device.
[0002] The widespread adoption of wearable electronic devices that can be worn directly on the body is becoming active. Since wearable electronic devices can be mounted on parts of the body, such as fingers, wrists, ankles, necks, waists, or heads, mobility and portability can be improved. Examples of such wearable electronic devices include ring-type wearable devices (e.g., smart rings), watch-type wearable devices (e.g., smart watches), and glasses-type wearable devices (e.g., smart glasses).
[0003] A ring-type wearable device is worn on a user's finger and can collect the user's health information (e.g., heart rate, blood pressure, body temperature), the user's location information, or movement information. The ring-type wearable device may be configured to output a light signal or a vibration signal through a light emitting diode (LED) indicator or an actuator.
[0004] A ring-type wearable device can be linked with a smartphone to transmit collected information and to transmit alarms obtained from the smartphone to the user.
[0005] External devices connected to a smartphone can be configured to be remotely controlled via the smartphone. For example, users can control devices via smartphone, including home appliances such as TVs, air conditioners, cooking appliances, washing machines, and lights, as well as means of transportation such as cars.
[0006] Meanwhile, based on collected user information, the user's current state can be identified, and user convenience can be provided by adaptively controlling devices around the user in response to the user's state.
[0007] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0008] An electronic device according to one embodiment of the present disclosure can generate a control signal for controlling peripheral devices based on user context information and enable control to be performed through a wearable device.
[0009] An electronic device according to one embodiment of the present disclosure may include a communication circuit, a server, one or more processors, and a memory configured to store instructions and operatively connected to the one or more processors. When the instructions are executed individually or collectively by the one or more processors, the electronic device may obtain biometric data of a user from a wearable device connected to the electronic device through the communication circuit, obtain context information of the user based on the biometric data or pre-stored activity data of the user, determine a first user interface for controlling an external device based on a type of user input specified from the wearable device, identify the external device located around the electronic device or the wearable device, determine a target device providing a first function from the external device based on the context information and the first user interface, receive a first guide notification indicating that user input for the first function can be responded to through the wearable device from the target device, and transmit a first user input generated from the wearable device in response to the guide notification to the target device.
[0010] A control method for an electronic device according to one embodiment of the present disclosure may include: acquiring biometric data of a user from a wearable device; acquiring context information of the user based on the biometric data or pre-stored activity data of the user; determining a first user interface for controlling an external device based on a type of user input specified from the wearable device; identifying the external device located in the vicinity of the electronic device or the wearable device; determining a target device that provides a first function from the external device based on the context information and the first user interface; receiving a first guide notification indicating that a user input for the first function can be responded to through the wearable device from the target device; and transmitting a first user input generated from the wearable device in response to the first guide notification to the target device.
[0011] However, the problems to be solved in this disclosure are not limited to those mentioned above, and may be determined in various ways without departing from the spirit and scope of this disclosure.
[0012] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0013] FIG. 2 schematically illustrates a system in which an electronic device, a wearable device, an external device, and a server interact, according to one embodiment of the present disclosure.
[0014] FIG. 3 is a block diagram illustrating a wearable device in terms of function according to one embodiment of the present disclosure.
[0015] FIG. 4 is a front view of a wearable device viewed from the front, according to one embodiment of the present disclosure.
[0016] FIG. 5 illustrates, in an exemplary manner, the operation process in which a control signal is generated through the operation of a wearable device according to one embodiment of the present disclosure.
[0017] FIG. 6 illustrates an operation flowchart for providing a method for an electronic device to identify a user's situation and control an external device to a wearable device based on the user's situation, according to one embodiment of the present disclosure.
[0018] FIG. 7 illustrates an operation flowchart for providing a method for an electronic device to identify a user's situation and control an external device to a wearable device based on the user's situation, according to one embodiment of the present disclosure.
[0019] FIG. 8 illustrates an operation flowchart for providing a method for an electronic device to identify a user's situation and control an external device to a wearable device based on the user's situation, according to one embodiment of the present disclosure.
[0020] FIGS. 9a and 9b are signaling diagrams for providing a method for an electronic device to determine the situation of a user and to control an external device as a wearable device based on the situation of the user, according to one embodiment of the present disclosure.
[0021] FIG. 10 schematically illustrates a mechanism according to one embodiment of the present disclosure in which an electronic device collects user data and generates context information based on said user data.
[0022] FIG. 11 schematically illustrates a scenario in which an electronic device controls an external device through a wearable device based on user context information according to one embodiment of the present disclosure.
[0023] FIG. 12 illustrates an exemplary user interface for controlling a target device through interaction between an electronic device and a wearable device according to the scenario of FIG. 11, in accordance with one embodiment of the present disclosure.
[0024] FIG. 13 schematically illustrates a scenario in which an electronic device controls an external device through a wearable device based on user context information according to one embodiment of the present disclosure.
[0025] FIG. 14 illustrates an exemplary user interface for controlling a target device through interaction between an electronic device and a wearable device according to the scenario of FIG. 13, in accordance with one embodiment of the present disclosure.
[0026] FIG. 15 schematically illustrates a scenario in which an electronic device controls an external device through a wearable device based on user context information according to one embodiment of the present disclosure.
[0027] FIG. 16 illustrates an exemplary user interface for controlling a target device through interaction between an electronic device and a wearable device according to the scenario of FIG. 15, in accordance with one embodiment of the present disclosure.
[0028] FIGS. 17 and 18 schematically illustrate a scenario in which a function provided by an electronic device is controlled via a wearable device according to one embodiment of the present disclosure.
[0029] FIG. 19 schematically illustrates a scenario in which a function provided by an electronic device is controlled through a wearable device according to one embodiment of the present disclosure.
[0030] FIG. 20 schematically illustrates a scenario in which a function provided by an electronic device is controlled through a wearable device according to one embodiment of the present disclosure.
[0031] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments.
[0032] In relation to the description of the drawings, similar reference numerals may be used for similar or related components.
[0033] The singular form of the noun corresponding to an item may include one or plural items, unless the relevant context clearly indicates otherwise.
[0034] In this document, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.
[0035] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another component and do not limit the components in other aspects (e.g., importance or order).
[0036] Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that the component may be connected to the other component directly (e.g., via a wire), wirelessly, or through a third component.
[0037] Terms such as “include” or “have” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in this document, and do not preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.
[0038] When it is said that a component is "connected," "combined," "supported," or "in contact" with another component, this includes not only cases where the components are directly connected, combined, supported, or in contact, but also cases where they are indirectly connected, combined, supported, or in contact through a third component.
[0039] When it is said that a component is located "on" another component, this includes not only cases where one component is in contact with the other, but also cases where another component exists between the two components.
[0040] The term “and / or” includes a combination of multiple related described components or any of the multiple related described components.
[0041] The operating principle and embodiments of the present invention will be described below with reference to the attached drawings.
[0042] FIG. 1 is a block diagram showing an electronic device (101) in a network environment (100) according to various embodiments.
[0043] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0044] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0045] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0046] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0047] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0048] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0049] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0050] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0051] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0052] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0053] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0054] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0055] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0056] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0057] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0058] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0059] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0060] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0061] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0062] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0063] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0064] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0065] Each of the external electronic devices (102, 104) may be of the same or different type as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. Upon receiving the request, one or more external electronic devices may perform at least part of the requested function or service, or additional functions or services related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For example, an external electronic device (102) renders content data executed in an application and transmits it to an electronic device (101), and the electronic device (101) that receives the data can output the content data to a display module. If the electronic device (101) detects user movement through an IMU sensor, etc., the processor of the electronic device (101) can correct the rendering data received from the external electronic device (102) based on the movement information and output it to the display module. Alternatively, the external electronic device (102) can transmit the movement information to request rendering so that the screen data is updated accordingly. Depending on various embodiments, the external electronic device (102) may be a device of various forms, such as a smartphone or a case device capable of storing and charging the electronic device (101).
[0066] FIG. 2 schematically illustrates a system in which an electronic device (210) (e.g., the electronic device (101) of FIG. 1), a wearable device (220) (e.g., the external electronic device (102) of FIG. 1), an external device (230), and a server (240) (e.g., the server (108) of FIG. 1) interact, according to one embodiment of the present disclosure.
[0067] All features, components, and / or arrangement relationships between components illustrated in FIG. 2 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 and FIG. 3 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 2.
[0068] Referring to FIG. 2, the electronic device (210), wearable device (220), external device (230), and server (240) can be interconnected.
[0069] According to one embodiment, the electronic device (210) may correspond to a user terminal such as a smartphone or a tablet PC. For example, the electronic device (210) may obtain information about the user from a sensor module (e.g., the sensor module (176) of FIG. 1) or obtain information about the user from a wearable device (220).
[0070] According to one embodiment, the electronic device (210) may generate context information (e.g., context information (1030) of FIG. 10) based on information about a user obtained from a sensor module (176) and / or information about a user obtained from a wearable device (220). For example, context information may be understood as customized information to be adaptively provided to the user's situation based on the user's information. Context information may also be referred to as "context information" or "situation information."
[0071] According to one embodiment, the electronic device (210) may obtain context information either on its own or through a server (240). For example, the electronic device (210) may generate the user's context information (1030) by performing machine learning through a neural network processing unit (e.g., an auxiliary processor (123) of FIG. 1) or by performing machine learning through a separate server (240)).
[0072] According to one embodiment, the electronic device (210) may be connected to a wearable device (220) and / or an external device (230). For example, the electronic device (210) may exchange information with the wearable device (220) and / or the external device (230) via a wireless communication method. For example, the electronic device (210) may receive information from the wearable device (220) and / or the external device (230) and transmit control signals to the wearable device (220) and / or the external device (230).
[0073] According to one embodiment, the wearable device (220) may include various types of devices that can be worn on a user's body. For example, the wearable device (220) may include a ring-type wearable device (e.g., a smart ring), a watch-type wearable device (e.g., a smart watch), or a head-wearing wearable device (e.g., an HMD or AR glasses). However, unless otherwise noted in this document, the wearable device (220) will be assumed to be a ring-type wearable device.
[0074] According to one embodiment, the wearable device (220) may be formed to be wearable on a user's finger. For example, the wearable device (220) may be worn on a user's finger to detect body information such as the user's pulse, electrocardiogram, and body temperature.
[0075] According to one embodiment, the wearable device (220) may project a light signal or generate a vibration signal. For example, the wearable device (220) may project a signal received from the electronic device (210) as a light signal or output it as a vibration signal, thereby notifying the user that a specific event has occurred.
[0076] According to one embodiment, the wearable device (220) can generate a control signal by being operated by a user. For example, the wearable device (220) can detect rotation or holding motions and generate different control signals corresponding to each motion based on said motions.
[0077] According to one embodiment, the external device (230) may be referred to as various devices capable of interacting with the electronic device (210) and / or the wearable device (220). For example, the external device (230) may include household appliances installed in the home (e.g., an air conditioner (230-1), a refrigerator (230-2), a TV (230-3), a smart light (230-4)), or a device capable of interacting with the electronic device (210) and / or the wearable device (220) (e.g., a car (230-5)). In addition to what is illustrated, the external device (230) may further include a cooking appliance, a dryer, and a garment care appliance.
[0078] According to one embodiment, the external device (230) may be a device in which the same user account as the user of the electronic device (210) and / or the wearable device (220) is registered, or a device in which access to the user account is permitted. For example, the user account of the external device (230) and the user account of the electronic device (210) and / or the wearable device (220) are the same, or even if the user account of the external device (230) and the user account of the electronic device (210) and / or the wearable device (220) are different, if access rights are granted by the user of the external device (230), it may correspond to the external device (230) of the present disclosure.
[0079] According to one embodiment, an external device (230) may acquire user information and, based on the user information, transmit information to an electronic device (210) suggesting whether to activate a function corresponding to the user's situation. For example, the external device (230) may acquire the user information from a server (240) and generate context information (1030) based on the user information.
[0080] According to one embodiment, the external device (230) may be controlled by an electronic device (210) and / or a wearable device (220). For example, the electronic device (210) may generate a control signal to control the external device (230) by user input and transmit the generated control signal to the external device (230). For example, the wearable device (220) may generate a control signal to control the external device (230) and transmit the generated control signal to the external device (230). For example, the wearable device (220) may generate a control signal to control the external device (230) and transmit the generated control signal to the external device (230) through the electronic device (210).
[0081] According to one embodiment, an external device (230) can perform a control operation based on a control signal received from an electronic device (210). For example, the external device (230) may be turned on or turned off by the control signal. For example, the external device (230) may activate a specific function by the control signal.
[0082] According to one embodiment, in a specific case, the electronic device (210) may function as an external device (230). For example, the specific case may refer to a case where the electronic device (210) (e.g., a smartphone or tablet PC) is a device that provides customized functions to a user based on context information (e.g., context information (1030) of FIG. 10). In this case, a control signal generated by the operation of the wearable device (220) can control a user interface according to the functions provided by the electronic device (210).
[0083] According to one embodiment, the server (240) may include one or more servers. For example, if the server (240) is implemented as a plurality, the servers (240) may provide different functions from each other.
[0084] According to one embodiment, when the server (240) is implemented as a plurality of units, the server (240) may include a cloud server for the electronic device (210) to collect information about the user (e.g., user data (1010) of FIG. 10).
[0085] According to one embodiment, when the server (240) is implemented as a plurality of servers, some of the plurality of servers (240) may provide an artificial intelligence model that is used by the electronic device (210) to generate context information based on information about the user.
[0086] According to one embodiment, when a plurality of servers (240) are implemented, the plurality of servers (240) may include servers that provide services for account information regarding an electronic device (210), a wearable device (220), and / or an external device (230). The servers may, for example, provide functions to authenticate one or more user accounts and to set or manage the rights of each of the user accounts. For example, the servers may distinguish between a main account that manages all settings for the external device (230) and a shared account that is provided with the set rights.
[0087] According to one embodiment, when a plurality of servers (240) are implemented, the plurality of servers (240) may include a server that controls a plurality of external devices (230) and transmits a control signal received from an electronic device (210) to the external devices (230). The server can establish a smart home system by, for example, performing control over a plurality of external devices (230) located within a home.
[0088] FIG. 3 is a block diagram illustrating a wearable device (e.g., the wearable device (220) of FIG. 2) according to one embodiment of the present disclosure in terms of function.
[0089] All features, components, and / or arrangement relationships between components illustrated in FIG. 3 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 2 and FIG. 4 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 3.
[0090] Referring to FIG. 3, the wearable device (220) may include a processor (311), a communication circuit (315), one or more sensors (321, 323, 331, 341, 343, 345), an actuator (351), an indicator (353), and a speaker (355).
[0091] According to one embodiment, one or more sensors (321, 323, 331, 341, 343, 345) may include a touch sensor (321), a light sensor (323), a biosensor (331), a gyroscope sensor (343), and a proximity sensor (345).
[0092] According to one embodiment, a touch sensor (321) and a light sensor (323) can detect operation on the wearable device (220). For example, the touch sensor (321) can detect a part of the user's body that is in contact with the outer surface of the ring-shaped wearable device (220) and generate a corresponding electrical signal. For example, the light sensor (323) can detect whether a part of the user's body is in close proximity when not in contact with the outer surface of the ring-shaped wearable device (220) and generate a corresponding electrical signal.
[0093] According to one embodiment, the touch sensor (321) may be implemented as a touch screen panel (TSP). For example, the touch sensor (321) may detect a touch signal for one or more points.
[0094] According to one embodiment, the touch sensor (321) can detect a part of a user's body that contacts the outer surface of the wearable device (220) and an operation that occurs as the part of the user's body moves, and generate a corresponding electrical signal. For example, the wearable device (220) can use the touch sensor (321) to detect a rotational operation that occurs when a part of the body moves in a predetermined direction while in contact with a predetermined point on the outer surface, or to detect a holding operation that occurs when a part of the body is in contact with a predetermined point on the outer surface for a predetermined period of time or longer.
[0095] According to one embodiment, the biosensor (331) can detect the user's biometric information and generate an electrical signal corresponding thereto. For example, the biosensor (331) can generate an electrical signal corresponding to the user's heart rate, the user's electrocardiogram, the user's blood oxygen concentration and / or the user's body temperature.
[0096] According to one embodiment, the biosensor (331) may include one or more sensors to detect each of the biometric information of the user listed above. For example, the biosensor (331) may include a heart rate sensor, an electrocardiogram sensor, a blood oxygen concentration sensor, and / or a temperature sensor.
[0097] According to one embodiment, the biosensor (331) can generate an electrical signal corresponding to the user's bio information and transmit the electrical signal to the processor (311).
[0098] According to one embodiment, the gyroscope sensor (341), the accelerometer sensor (343), and the proximity sensor (345) can detect information about the surrounding environment surrounding the wearable device (220) and / or information about the user and generate a corresponding electrical signal. For example, the gyroscope sensor (341), the accelerometer sensor (343), and the proximity sensor (345) can detect the wearing angle, position, and wearing direction of the wearable device (220) and generate a corresponding electrical signal.
[0099] Although not illustrated, one or more sensors (321, 323, 331, 341, 343, 345) may include at least one of an illumination sensor, a magnetic sensor, a gravity sensor (G-sensor), a motion sensor, an RGB sensor, an infrared sensor, a fingerprint sensor, an ultrasonic sensor, an environmental sensor (e.g., a barometer, a hygrometer, a thermometer, a radiation detection sensor, a heat detection sensor, a gas detection sensor), and a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). The wearable device (220) may combine and utilize information sensed from at least two of the sensors.
[0100] According to one embodiment, the actuator (351) may generate a tactile effect to notify the user that a specific event has occurred. For example, the tactile effect may include vibration. In this case, the actuator (351) may be implemented as a vibration module. For example, a specific event may occur when the electronic device (210) receives information. For example, a specific event may occur when the electronic device (210) detects a connection with an identified external device (e.g., the external device (230) of FIG. 2). For example, a specific event may occur when a control signal is generated by the operation of the wearable device (220).
[0101] According to one embodiment, the actuator (351) can generate vibrations with various vibration intensities and vibration periods. For example, the actuator (351) may be configured to output different vibrations by synthesizing them or to output different vibrations sequentially.
[0102] According to one embodiment, the actuator (351) may be configured to generate tactile effects in various ways in addition to effects through vibration. For example, the actuator (351) may generate tactile effects corresponding to operating an array of pins placed on the inner circumference of the wearable device (210). For example, the actuator (351) may be implemented as an electrode or an element that generates electrostatic force to generate tactile effects corresponding to stimulating the wearing area. For example, the actuator (351) may be implemented as an endothermic element or a heat-generating element to generate tactile effects corresponding to stimulating the wearing area with a cold or hot sensation.
[0103] According to one embodiment, the indicator (353) can generate a visual effect to notify the user that a specific event has occurred by using light generated from a light source. For example, the indicator (353) may be placed at a specific point on the wearable device (220) and configured to emit light of a single color or multiple colors. For example, the indicator (353) may stop emitting light in response to the user confirming the occurrence of the event.
[0104] According to one embodiment, the speaker (355) can produce an auditory effect using sound to notify the user that a specific event has occurred.
[0105] According to one embodiment, the communication circuit (315) may be configured to perform a connection with the wearable device (220) and the electronic device (210) and / or external device (230) and to transmit and receive data. The communication circuit (315) may include, for example, a short-range communication module and may communicate with the electronic device (210) and / or external device (230) by means of the short-range communication module.
[0106] According to one embodiment, the processor (311) may be configured to control the overall operation of the wearable device (220).
[0107] According to one embodiment, the memory (313) may be configured to store one or more programs for the operation of the processor (311) and may be configured to store data input / output to / from the wearable device (220).
[0108] According to one embodiment, the memory (313) may be implemented integrally with the processor (311) or as a separate configuration.
[0109] According to one embodiment, the processor (311) may be configured to acquire an electrical signal generated by one or more sensors (321, 323, 331, 341, 343, 345) and to transmit information corresponding to the electrical signal to an electronic device (210).
[0110] According to one embodiment, the processor (311) can receive information that a specific event has occurred from the electronic device (210).
[0111] According to one embodiment, the processor (311) may be configured to operate an actuator (351) or an indicator (353) in response to receiving information that a specific event has occurred from an electronic device (210).
[0112] According to one embodiment, the processor (311) can generate a control signal for controlling an external device (230) by touching the outer surface of the wearable device (220). The processor (311) can transmit the control signal to an electronic device (210) and / or an external device (230).
[0113] FIG. 4 is a front view of a wearable device (400) (e.g., the wearable device (220) of FIG. 2) according to one embodiment of the present disclosure.
[0114] FIG. 5 illustrates, in an exemplary manner, the operation process in which a control signal is generated through the operation of a wearable device (400) according to one embodiment of the present disclosure.
[0115] FIGS. 4 and FIGS. 5 can be understood as illustrating the configuration that is visible from the outside when the wearable device (400) is viewed from the front, and the wearable device (400) may include various configurations described in FIG. 3 in addition to those illustrated.
[0116] All features, components, and / or arrangement relationships between components illustrated in FIGS. 4 and 5 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIGS. 1 through 3 and FIGS. 6 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIGS. 4 and 5.
[0117] Referring to FIG. 4, the wearable device (400) may include a housing (410), a touch sensor (420) (e.g., the touch sensor (321) of FIG. 3), a first sensor (430), and a second sensor (440).
[0118] According to one embodiment, the housing (410) may form the overall appearance of the wearable device (400). The housing (410) may have a ring shape, for example. As an example, the housing (410) may be formed to increase in size or decrease in size in correspondence with the user's finger.
[0119] According to one embodiment, the housing (410) may include an inner surface and an outer surface. A user's finger may enter through an opening (450) formed by the inner surface of the housing (410).
[0120] According to one embodiment, the touch sensor (420) may be formed to cover a portion of the outer surface of the housing (410). For example, the touch sensor (420) may be formed to cover an area excluding a portion of the outer surface of the housing (410). For example, when a user wears the wearable device (400), the touch sensor (420) may be positioned to cover the outer surface excluding a portion of the lower side of the housing (410).
[0121] According to one embodiment, the touch sensor (420) can detect contact with a part of the user's body and generate a corresponding electrical signal. For example, the touch sensor (420) can detect contact with a user's finger and generate a corresponding electrical signal. Hereinafter, for convenience of explanation, the part of the user's body that comes into contact with the touch sensor (420) will be referred to as a "touching object."
[0122] According to one embodiment, the touch sensor (420) can detect contact at one or more points. For example, the touch sensor (420) can generate an electrical signal by distinguishing between cases where a touch object contacts one point and cases where it contacts two or more points respectively.
[0123] According to one embodiment, the touch sensor (420) can detect that a touch object moves while in contact with the touch sensor (420) and generate a corresponding electrical signal. For example, the touch sensor (420) can detect that a touch object moves to another point while maintaining contact with one point of the touch sensor (420) and generate a corresponding electrical signal.
[0124] According to one embodiment, the touch sensor (420) can detect the direction of movement of a contacted object and generate a corresponding electrical signal. For example, the touch sensor (420) can detect that the touch object is moving clockwise or counterclockwise and generate a corresponding electrical signal.
[0125] According to one embodiment, the first sensor (430) and the second sensor (440) may be positioned at a predetermined point on the inner surface of the housing (410). By positioning the first sensor (430) and the second sensor (440) on the inner surface of the housing (410), when the wearable device (400) is worn by a user, the wearable device (400) can maintain a state of constant contact with the finger of the user wearing it.
[0126] According to one embodiment, at least one of the first sensor (430) and the second sensor (440) may be implemented as a biosensor (e.g., biosensor (331) of FIG. 3). For example, the first sensor (430) and the second sensor (440) may be implemented as at least one of a heart rate sensor, an electrocardiogram sensor, a blood oxygen concentration sensor, and a temperature sensor.
[0127] According to one embodiment, the first sensor (430) and the second sensor (440) can generate electrical signals related to the biometric information of a user wearing the wearable device (400). The first sensor (430) and the second sensor (440) can detect the user's biometric information in real time or detect the user's biometric information at a predetermined interval and generate corresponding electrical signals. The wearable device (400) can transmit the user's biometric information detected using the first sensor (430) and the second sensor (440) to an electronic device (e.g., the electronic device (210) of FIG. 2).
[0128] Referring to FIG. 5, the wearable device (400) can generate a control signal in response to user operation in various ways. For example, the wearable device (400) can generate a control signal in response to detecting that a touch object moves on the touch sensor (420). FIG. 5 illustrates the operation of generating a control signal in response to detecting that a touch object moves in the order of (a), (b), and (c).
[0129] According to one embodiment, (a), (b), and (c) will be assumed to generate a control signal by operating the user’s right thumb (f1) and right index finger (f2) while the user is wearing the wearable device (400) on the user’s left index finger (f3) (e.g., state (a)). Hereinafter, for convenience of explanation, the user’s right thumb (f1) will be referred to as the “first touch object (f1)” and the user’s right index finger (f2) will be referred to as the “second touch object (f2)”.
[0130] According to one embodiment, in state (b), the first touch object (f1) and the second touch object (f2) can come into contact with the touch pad (420), and in state (c), the first touch object (f1) and the second touch object (f2) can rotate clockwise (to the right).
[0131] According to one embodiment, the wearable device (400) may generate a control signal when the first touch object (f1) and the second touch object (f2) rotate by more than a predetermined angle from the point of contact in state (b). For example, the wearable device (400) may repeatedly generate the control signal in correspondence with the magnitude of the rotation angle of the first touch object (f1) and the second touch object (f2), or may generate a control signal different from the control signal.
[0132] According to one embodiment, the wearable device (400) can generate a control signal as it rotates counterclockwise (to the left) while two different touch objects are in contact with the touch sensor (420).
[0133] Although not shown, the wearable device (400) can generate different control signals in response to various touch actions.
[0134] For example, the wearable device (400) can generate a control signal as two different touch objects come into contact with the touch sensor (420) for a predetermined time (e.g., 2 seconds).
[0135] For example, the wearable device (400) can generate a control signal as it detects that two different touch objects are pressed twice on the touch sensor (420). For example, the wearable device (400) may generate different control signals corresponding to the number of times two different touch objects are pressed on the touch sensor (420).
[0136] According to one embodiment, the wearable device (400) can generate a control signal as it detects rotation. For example, the wearable device (400) can be rotated by user operation. The wearable device (400) can detect the direction of rotation and / or the angle of rotation according to the rotation operation. For example, the wearable device (400) can obtain an electrical signal generated corresponding to the direction of rotation and / or the angle of rotation according to the rotation operation from a gyroscope sensor (e.g., gyroscope sensor (341) of FIG. 3) or an accelerometer sensor (e.g., accelerometer sensor (343) of FIG. 3). For example, the wearable device (400) can obtain the direction of rotation and / or the angle of rotation according to the rotation operation from a biosensor (e.g., biosensor (331) of FIG. 3).
[0137] According to one embodiment, examples of control signals generated by the wearable device (400) may include a control signal for determining a connection between the electronic device (210) and at least one of the external devices (230), and a control signal for activating a specific function provided by the connected device (to be referred to as the target device) among the external devices (230). In addition, examples of control signals generated by the wearable device (400) may include various types of control signals for interacting with the electronic device (210) and / or the external device (230).
[0138] FIG. 6 illustrates an operation flowchart for providing a method for an electronic device (e.g., the electronic device (210) of FIG. 2) to identify the user's situation and to control an external device (e.g., the external device (230) of FIG. 2) to a wearable device (e.g., the wearable device (220) of FIG. 2) based on the user's situation, according to one embodiment of the present disclosure.
[0139] FIG. 6 can be understood as an operation flowchart illustrated in terms of a network environment in which the electronic device (210), wearable device (220), external device (230), and server (e.g., the server (240) of FIG. 2) shown in FIG. 2 are organically combined.
[0140] All features, components, and / or arrangement relationships between components illustrated in FIG. 6 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 5 and FIG. 7 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 6.
[0141] Referring to FIG. 6, the control method may include a data collection step in step 610. In step 610, the electronic device (210) may collect user data (e.g., user data (1010) of FIG. 10).
[0142] According to one embodiment, the electronic device (210) can obtain user data (1010) from a sensor module included in the electronic device (210) (e.g., sensor module (176) of FIG. 1). For example, the electronic device (210) can obtain user physical activity data (e.g., physical activity data (1013) of FIG. 10), user location data (e.g., location data (1015) of FIG. 10), user app / web usage data (e.g., app / web usage data (1017) of FIG. 10), and user device usage data (e.g., device usage data (1019) of FIG. 10).
[0143] According to one embodiment, an electronic device (210) can obtain user data (1010) from a wearable device (220). For example, the electronic device (210) can receive user biometric data (1011), user activity data (1013), and / or user location data (1015) sensed by the wearable device (220). For example, the electronic device (210) can request the user data (1010) from the wearable device (220), and the wearable device (220) can transmit the user data (1010) in response to the request from the electronic device (210).
[0144] According to one embodiment, the control method may include a context information acquisition step in step 620. For example, the electronic device (210) may generate context information based on user data (1010) collected in step 610.
[0145] According to one embodiment, the electronic device (210) may utilize an auxiliary processor (e.g., auxiliary processor (123) of FIG. 1) included in a processor (e.g., processor (120) of FIG. 1). For example, the electronic device (210) may use an artificial intelligence model to generate context information (e.g., context information (1030) of FIG. 10) based on user data (1010). The context information (1030) may be referred to as personalized custom information generated based on information about a specific user and provided to said user.
[0146] According to one embodiment, context information (1030) may include profile information (e.g., profile information (1031) of FIG. 10), routine information (e.g., routine information (1033) of FIG. 10), and preference information (e.g., preference information (1035) of FIG. 10).
[0147] According to one embodiment, examples of profile information (1031) include the user's gender, the user's age, and the user's interests.
[0148] According to one embodiment, an example of routine information (1033) may include information about the location or movement path at a specific time based on the user's lifestyle pattern corresponding to the user's activity information and location information.
[0149] According to one embodiment, examples of preference information (1035) may include a device that the user runs at a specific time, an application that the user runs at a specific time, and a webpage that the user browses at a specific time, corresponding to the user's device usage environment and app / web usage environment.
[0150] According to one embodiment, the control method may include the step of identifying an external device in step 630. For example, the electronic device (210) may identify an external device (230) based on context information obtained in step 620. The external device (230) may be a device registered with the same account as the user account, or may be configured as a device to which access by the user account is permitted. The external device (230) may be provided as one or multiple devices.
[0151] According to one embodiment, the control method may include the step of determining a target device among the external devices (230) to provide a customized service to the user in step 640. For example, the electronic device (210) may determine a target device among the one or more external devices (230) to provide a customized function to the user based on context information (1030). For example, the target device may be provided as one or a plurality.
[0152] According to one embodiment, the electronic device (210) may provide information about the determined target device to the user. For example, the electronic device (210) may transmit a signal containing information about the target device to the wearable device (220) to provide customized functions to the user. For example, the wearable device (220) may receive the signal and notify the user of the information about the target device in various ways. For example, the wearable device (220) may operate an actuator (e.g., actuator (351) in FIG. 3) to output a vibration signal in response to the notification. For example, the wearable device (220) may operate an indicator (e.g., indicator (353) in FIG. 3) to emit a single color or multiple lights in response to the notification. For example, the wearable device (220) may operate a speaker (e.g., speaker (355) in FIG. 3) to output a voice in response to the notification.
[0153] According to one embodiment, the wearable device (220) may generate a control signal to activate a customized function provided by a target device among one or more external devices (230). For example, the wearable device (220) may generate a control signal to activate a customized function provided by a target device in response to detecting rotation of a contacted touch object.
[0154] According to one embodiment, the electronic device (210) can determine a selected device as a target device in response to a control signal received from a wearable device (220).
[0155] According to one embodiment, the control method may include the step of controlling a target device through a wearable device (220) in step 650. For example, the electronic device (210) may transmit information to the wearable device (220) indicating that the target device can be controlled through the operation of the wearable device (220). For example, the wearable device (220) may output the notification through an actuator (351), an indicator (353), and / or a speaker (355).
[0156] According to one embodiment, the electronic device (210) may notify the wearable device (220) that it can control the functions provided by the target device in response to the type of the target device. For example, the electronic device (210) may convey a notification to the wearable device (230) that it can control the temperature of an air conditioner (e.g., air conditioner (230-1) of FIG. 2). For example, the electronic device (210) may display the notification on a display (e.g., display module (160) of FIG. 1).
[0157] According to one embodiment, the wearable device (220) can generate a control signal for controlling a target device by user operation. For example, the wearable device (220) can generate a control signal by contact or movement of a touch object detected by a touch sensor (e.g., touch sensor (420) of FIG. 4).
[0158] According to one embodiment, an electronic device (210) can receive a control signal generated by a wearable device (220). The electronic device (210) can transmit the control signal to a target device. The target device can perform control in response to the control signal.
[0159] FIG. 7 illustrates an operation flowchart for providing a method for an electronic device (e.g., the electronic device (210) of FIG. 2) to identify the user's situation and to control an external device (e.g., the external device (230) of FIG. 2) to a wearable device (e.g., the wearable device (220) of FIG. 2) based on the user's situation, according to one embodiment of the present disclosure.
[0160] FIG. 7 can be understood as an operation flowchart illustrating the control operation from the perspective of the electronic device (210) in a network environment in which the electronic device (210), wearable device (220), external device (230), and server (e.g., server (240) of FIG. 2) shown in FIG. 2 are organically combined.
[0161] All features, components, and / or arrangement relationships between components illustrated in FIG. 7 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 6 and FIG. 8 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 7.
[0162] Referring to FIG. 7, the electronic device (210) can acquire the user's biometric data (e.g., biometric data (1011) of FIG. 10) and the user's activity data (e.g., activity data (1013) of FIG. 10) in operation 710.
[0163] According to one embodiment, the electronic device (210) may obtain the user's biometric data (1011) from a sensor module (e.g., the sensor module (176) of FIG. 1) or obtain the user's biometric data (1011) from a wearable device (220).
[0164] According to one embodiment, the biometric data (1011) may include the user's heart rate, the user's electrocardiogram, the user's body temperature, and the user's blood gas concentration (e.g., oxygen or carbon dioxide). For example, the biometric data (1011) may further include secondary data generated based on the user's heart rate, body temperature, blood pressure, and / or blood oxygen concentration. For example, the biometric data (1011) may further include the user's sleep quality, the user's body composition, and the user's stress index.
[0165] According to one embodiment, in operation 710, the electronic device (210) may further acquire, in addition to the user's biometric data (1011) and user's activity data (1013), the user's location data (e.g., location data (1015) of FIG. 10), the user's web / app usage data (e.g., web / app usage data (1017) of FIG. 10), and / or the user's device usage data (e.g., user's device usage data (1019) of FIG. 10).
[0166] According to one embodiment, an electronic device (210) can obtain user information of the electronic device (210) (e.g., user data (1010) of FIG. 10) from a server (e.g., server (108) of FIG. 1 or server (240) of FIG. 2). For example, the electronic device (210) can connect to the server (240) to collect various information included in the user data (1010).
[0167] According to one embodiment, the electronic device (210) can obtain context information based on biometric data (1011) and activity data (1015) in operation 720.
[0168] According to one embodiment, the electronic device (210) can acquire context information corresponding to the user's situation (e.g., context information (1030) of FIG. 10) based on acquired biometric data (1011) and activity data (1015).
[0169] According to one embodiment, an electronic device (210) can acquire context information (1030) based on machine learning through an artificial intelligence model. For example, the electronic device (210) can acquire context information (1030) using an internally implemented artificial intelligence model (e.g., on-device AI). For example, the electronic device (210) can acquire context information (1030) by performing calculations on its own using a processor (e.g., processor (120) of FIG. 1). For example, the electronic device (210) can acquire context information (1030) using an artificial intelligence model provided by a server (e.g., server (240) of FIG. 2).
[0170] According to one embodiment, the electronic device (210) can obtain context information (1030) based on various types of information included in user data (1010), in addition to biometric data (1011) and activity data (1015).
[0171] According to one embodiment, the electronic device (210) can determine, based on context information about the user, the electronic device (210) or an external device (230) located near the user can provide customized functions to the user. To this end, the electronic device (210) can manage one or more devices that are registered with a server (e.g., the server (240) of FIG. 2) or connected via communication based on the user's account.
[0172] For example, an electronic device (210) may receive information about an external device (230) located near the electronic device (210) or the user through a server (240). For example, information about the external device (230) may include the device type, provided functions, capability information, or operating status of the external device (230). Based on the received information about the external device (230) and context information about the user, the electronic device (210) may determine a customized function to be provided to the user.
[0173] For example, an electronic device (210) and / or a wearable device (220) can recognize that a user has returned home after engaging in outdoor activities based on the user's location information, body information (e.g., user's body temperature, heart rate, blood oxygen saturation), or user's activity information.
[0174] According to one embodiment, in operation 730, the electronic device (210) may determine a target device among the external devices (230) that provides a first function. The target device may be a device that can provide a customized service to a user based on context information (1030) when one or more external devices (230) are provided.
[0175] For example, the electronic device (210) may determine a target device that provides a customized function to the user based on the information obtained from the electronic device (210) and / or the wearable device (220). For example, based on the information, the electronic device (210) may provide a customized function that activates a cooling function through an air conditioner included in an external device (230) placed in the home to lower the user's body temperature. For example, based on the information, the electronic device (210) may provide a customized function that activates a dehumidification function through a dehumidifier included in an external device (230) placed in the home to lower the user's humidity. For example, based on the information, the electronic device (210) may provide a customized function that plays slow-tempo music through a speaker included in an external device (230) placed in the home to lower the user's heart rate.
[0176] For example, an electronic device (210) may receive information about an in-home external device (230) through a server (240) and determine one or more devices to provide customized functions to the user. For example, the electronic device (210) may determine one of the external devices (230) as an air conditioner, a dehumidifier, or a speaker, or determine one or more of the air conditioner, a dehumidifier, or a speaker as target devices. For example, the electronic device (210) may determine the device closest to the user among the multiple external devices (230) as the target device to provide customized functions. For example, the electronic device (210) may determine the target device that provides the most customized functions to the user among the multiple target devices.
[0177] According to one embodiment, the electronic device (210) can determine a user interface for controlling an external device (e.g., the external device (230) of FIG. 2) in operation 740.
[0178] According to one embodiment, a user interface may be temporarily created to control an external device (230). For example, the user interface may be created to determine whether the external device (230) is controlled by the wearable device (220) or to determine whether the external device (230) activates a custom function for the user.
[0179] In addition to what is described, the wearable device (220) may be implemented in various form factors depending on the type, and the method of wearing and / or purpose of use of the wearable device (220) may be determined in accordance with the method of implementation of the wearable device (220). For example, in accordance with the method of implementation of the wearable device (220), the wearable device (220) may include sensors for measuring user operation or biosignals of the user wearing the wearable device (220).
[0180] According to one embodiment, a user input method may be determined based on the type or sensing capability of the wearable device (220). For example, when the type of the wearable device (220) is implemented as a smart ring, a preset user input method or a possible user input method may include rotation input of the smart ring (e.g., whether it rotates, direction of rotation, amount of rotation and / or angle of rotation, etc.). For example, when the type of the wearable device (220) is implemented as a smart watch, a preset user input method or a usable input method may include touch input, gesture input, or voice command received by the wearable device (220).
[0181] For example, if the type of wearable device (220) is a smart ring, a user interface may be determined that provides an option for activation (or deactivation) to determine whether to activate a custom function for the user through rotation input (whether rotation input is made or rotation direction, etc.) corresponding to the user input method. For example, the user interface may include guiding the user to select whether to activate or deactivate (cancel) the custom function for the user by using the rotation input of the smart ring through the electronic device (210) or external device (230), or displaying options for activating or deactivating the custom function. During the output of the guide or options (e.g., display, voice guidance, etc.), user input through rotation input is received from the wearable device (220), and whether to activate the custom function for the user corresponding to the user input can be determined.
[0182] For example, if the type of the wearable device (220) is a touch smart ring, the electronic device (210) can determine a user interface for selecting whether to activate a function of the target device through a control signal generated by a touch gesture input and / or a rotation input to the wearable device (220). For example, the electronic device (210) can determine a user interface for activating a specific function among the functions of the target device in response to the length of the touch gesture, the rotation angle of the rotation input, and / or the rotation direction of the rotation input.
[0183] For example, if the type of wearable device (220) is a smart watch, the user interface may provide various options or allow multiple selections, rather than the user interface of a smart ring that allows selecting one of two options. For example, the user interface may be determined to display multiple user customization functions and enable one or more functions selected by the user among the user customization functions.
[0184] According to one embodiment, the user interface may include feedback on user input provided by the wearable device (220). For example, feedback may be provided to the wearable device (220) when a gesture input or rotation input of a touch object to the wearable device (220) is received through the user interface. For example, the feedback may be understood as a response to the reception of an input selecting to activate a function of an external device (230) according to the user interface.
[0185] According to one embodiment, in operation 750, the electronic device (210) may notify the user via the electronic device (210), the external device (230) (e.g., the target device), or the wearable device (220) that the user can select whether to activate a first function of the target device corresponding to a custom function for the user via the wearable device (220). For example, the electronic device (210) may recommend a first function via the display or voice guidance of the target device and provide a notification to the user that the function can be activated via user input to the wearable device (220). Additionally, the electronic device (210) may transmit an activation control signal of a sensor to the wearable device (220) for receiving user input from the wearable device (220), along with a notification that the target device can activate the first function via the wearable device. At this time, the electronic device may transmit a control signal to provide feedback to the wearable device (220) to guide user input regarding the notification. For example, the feedback that may be provided by the wearable device may include a vibration signal, a light signal, and / or a sound signal.
[0186] According to one embodiment, the electronic device (210) may transmit guide information to the target device so that a notification (or guide) can be provided at the target device. The target device may provide a notification based on the guide information transmitted from the electronic device (210). For example, the target device may provide a notification in a visual manner through a display or in an auditory manner through a speaker. For example, the notification may be provided through the electronic device (210) or through the target device. For example, the notification may be provided through both the electronic device (210) and the target device.
[0187] According to one embodiment, in operation 760, the electronic device (210) receives a first user input from a wearable device (220) and can transmit a control signal to the target device to enable an option corresponding to the first user input (e.g., whether to enable a custom function for the user) to be executed on the target device.
[0188] According to one embodiment, a wearable device (220) can sense data corresponding to a first user input for controlling a first function provided by a target device through a sensor, and transmit the sensed data to an electronic device (210). A control signal corresponding to the first function provided by the target device may be referred to as "first user input."
[0189] According to one embodiment, the electronic device (210) can verify the first user input based on the received sensing data. For example, the data sensed by the wearable device (220) may correspond to at least one of the rotation direction of the touch object, the rotation angle of the touch object, or the contact time of the touch object, and different first user inputs may be determined based on the sensed data. Additionally, the data sensed by the wearable device (220) may be a rotation input (e.g., whether rotation occurs, rotation direction, amount of rotation / angle, etc.) detected using a motion sensor (e.g., IMU sensor, accelerometer (343), gyroscope sensor (341), etc.) or at least one bio-sensor (331) included in the wearable device (220) in response to the user’s rotation input of holding and rotating the wearable device (220). Here, when a biosensor (331) is used in a wearable device (200), the electronic device (210) can detect a rotation input from the received sensing data by using measurement data according to the degree of rotation at a specific body position (e.g., a specific finger) where the wearable device (220) is worn.
[0190] According to one embodiment, the electronic device (210) can transmit a control signal for an option corresponding to the first user input (e.g., activation of a custom function for the user) to a target device. In response to receiving the control signal from the electronic device (210), the target device can control a custom function for the user corresponding to the control signal.
[0191] FIG. 8 illustrates an operation flowchart for providing a method for an electronic device (e.g., the electronic device (210) of FIG. 2) to identify the user's situation and to control an external device (e.g., the external device (230) of FIG. 2) to a wearable device (e.g., the wearable device (220) of FIG. 2) based on the user's situation, according to one embodiment of the present disclosure.
[0192] Compared to the operation flow illustrated in FIG. 7, the operation flow illustrated in FIG. 8 can be understood as additionally illustrating the operation of the target device providing a second function different from the first function, and the operation of controlling the target device with the wearable device (220) with respect to the second function. Therefore, descriptions of the operations illustrated in FIG. 8 that overlap with FIG. 7 will be omitted, and the differences will be explained in detail.
[0193] Some of the operations illustrated in FIGS. 7 and FIGS. 8 may be repeated, omitted, or changed in order as necessary for the implementation of the present disclosure.
[0194] All features, components, and / or arrangement relationships between components illustrated in FIG. 8 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 7 and FIG. 9a through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 3.
[0195] Referring to FIG. 8, in operation 810, the electronic device (210) can acquire the user's biometric data (1011) and the user's physical activity data (1013). Operation 810 may correspond in part or in whole to operation 710 of FIG. 7.
[0196] According to one embodiment, in operation 820, the electronic device (210) can obtain context information based on biometric data (1011) and activity data (1015). Operation 820 may correspond in part or in whole to operation 720 of FIG. 7.
[0197] According to one embodiment, in operation 830, the electronic device (210) may determine a target device among external devices (230) that provides a first function. Operation 830 may correspond in part or in whole to operation 730 of FIG. 7.
[0198] According to one embodiment, in operation 840, the electronic device (210) may determine a user interface for controlling an external device (230). Operation 840 may correspond in part or in whole to operation 740 of FIG. 7.
[0199] According to one embodiment, in operation 850, the electronic device (210) may receive that the wearable device (220) can respond to the first function provided by the target device. Operation 850 may correspond in part or in whole to operation 750 of FIG. 7.
[0200] According to one embodiment, the electronic device (210) may notify the user via the electronic device (210), an external device (230) (e.g., the target device), or the wearable device (220) that the user can select whether to activate a first function of the target device corresponding to a custom function for the user via the wearable device (220). For example, the electronic device (210) may recommend a first function via the display or voice guidance of the target device and provide a notification to the user that the function can be activated via user input to the wearable device (220). Additionally, the electronic device (210) may transmit an activation control signal of a sensor to the wearable device (220) for receiving user input from the wearable device (220), along with a notification that the target device can activate the first function via the wearable device. At this time, the electronic device may transmit a control signal to provide feedback to the wearable device (220) to guide user input regarding the notification. For example, feedback that may be provided by a wearable device may include vibration signals, optical signals, and / or sound signals.
[0201] According to one embodiment, the electronic device (210) can transmit guide information to the target device. The target device can provide a notification based on the guide information transmitted from the electronic device (210). For example, the target device may provide a notification in a visual manner through a display or in an auditory manner through a speaker. For example, the notification may be provided through the electronic device (210) or through the target device. For example, the notification may be provided through both the electronic device (210) and the target device.
[0202] According to one embodiment, in operation 860, the electronic device (210) can transmit a first user input generated by the wearable device (220) to a target device. Operation 860 may correspond to some or all of operation 760 of FIG. 7.
[0203] According to one embodiment, in operation 870, the electronic device (210) may receive that the wearable device (220) can respond to the second function provided by the target device.
[0204] According to one embodiment, the second function may be understood as a function provided by the target device that is different from the first function. For example, the second function may be a function provided subsequently by the target device after the first function has been provided. For example, the second function may be a function provided by the target device independently of the first function.
[0205] According to one embodiment, the second function may be a function provided by a target device different from the target device providing the first function. In this case, the target device providing the first function may be referred to as the "first target device," and the target device providing the second function may be referred to as the "second target device." If the target device providing the second function and the target device providing the first function are different, the electronic device (210) may determine a user interface for controlling the second target device.
[0206] For example, the electronic device (210) may request a response from the wearable device (220) regarding whether to perform control of the second target device. The wearable device (220) may generate a vibration signal, a light signal, or a sound signal in response to the request received from the electronic device (210). The wearable device (220) may generate a feedback signal through the operation of the wearable device (220) in response to the response. The electronic device (210) may receive the feedback signal from the wearable device (220).
[0207] According to one embodiment, in operation 880, the electronic device (210) receives a second user input from a wearable device (220) and can transmit a control signal to the target device to enable an option corresponding to the second user input (e.g., whether to enable a custom function for the user) to be executed on the target device.
[0208] According to one embodiment, a wearable device (220) can sense data corresponding to a second user input for controlling a second function provided by a target device through a sensor, and transmit the sensed data to an electronic device (210). A control signal corresponding to the second function provided by the target device may be referred to as a "second user input."
[0209] According to one embodiment, the electronic device (210) can verify the second user input. For example, the data sensed by the wearable device (220) may correspond to at least one of the rotation direction of the touch object, the rotation angle of the touch object, or the contact time of the touch object, and different types of second user inputs may be determined based on the sensed data. Additionally, the data sensed by the wearable device (220) may be a rotation input (e.g., whether rotation occurs, rotation direction, amount of rotation / angle, etc.) detected using a motion sensor (e.g., IMU sensor, accelerometer (343), gyroscope sensor (341), etc.) or at least one bio-sensor (331) included in the wearable device (220) in response to the user’s rotation input of holding and rotating the wearable device (220). Here, when a biosensor (331) is used in a wearable device (200), the electronic device (210) can detect a rotation input from the received sensing data by using measurement data according to the degree of rotation at a specific body position (e.g., a specific finger) where the wearable device (220) is worn.
[0210] According to one embodiment, the electronic device (210) may transmit a control signal for an option corresponding to the second user input (e.g., activation of a custom function for the user) to a target device. In response to receiving the control signal from the electronic device (210), the target device may control a custom function for the user corresponding to the control signal.
[0211] FIGS. 9a and 9b are signaling diagrams for providing a method for an electronic device (e.g., the electronic device (210) of FIG. 2) to determine the situation of a user and to control an external device (e.g., the external device (230) of FIG. 2) to a wearable device (e.g., the wearable device (220) of FIG. 2) based on the situation of a user, according to one embodiment of the present disclosure.
[0212] All features, components, and / or arrangement relationships between components illustrated in FIGS. 9a and 9b may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIGS. 1 through 8 and FIGS. 10 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIGS. 9a and 9b.
[0213] Referring to FIGS. 9a and 9b, the wearable device (220) can collect biometric data (e.g., biometric data (1011) of FIG. 10) and physical activity data (e.g., physical activity data (1013) of FIG. 10). For example, the wearable device (220) can collect biometric data (1011) and physical activity data (1013) for a user through a biometric sensor (e.g., biometric sensor (331) of FIG. 3).
[0214] According to one embodiment, in step 912, the wearable device (220) can transmit biometric data (1011) and physical activity data (1013) to the electronic device (210). For example, the wearable device (220) can transmit the user's location data (e.g., location data (1015) of FIG. 10) to the electronic device (210).
[0215] According to one embodiment, in step 921, the electronic device (210) can acquire biometric data (1011) and physical activity data (1013). For example, the electronic device (210) can receive the data from a wearable device (220) in steps 911 and 912. For example, the electronic device (210) can acquire the data by receiving it with a built-in sensor (e.g., sensor module (176) of FIG. 1) or by connecting to a server (e.g., server (108) of FIG. 1 or server (240) of FIG. 2).
[0216] According to one embodiment, in step 921, the electronic device (210) may acquire user data (e.g., user data (1010) of FIG. 10) necessary to provide a customized service to the user, in addition to biometric data (1011) and physical activity data (1013). For example, the user data (1010) may further include, in addition to biometric data (1011) and physical activity data (1013), the user's location data (1015), the user's web / app usage data (e.g., web / app usage data (1017) of FIG. 10), or the user's device usage data (e.g., device usage data (1019) of FIG. 10).
[0217] According to one embodiment, in step 922, the electronic device (210) can obtain context information (e.g., context information (1030) of FIG. 10). For example, the electronic device (210) can obtain context information to provide a service customized to the user's situation based on user data (1010).
[0218] For example, the electronic device (210) can generate the context information using on-device AI. For example, the electronic device (210) can generate the context information (1030) using an artificial intelligence model stored in a processor (e.g., the processor (120) of FIG. 1).
[0219] For example, an electronic device (210) can generate the context information (1030) by connecting to a server (240) where an artificial intelligence model is stored.
[0220] According to one embodiment, in step 923, the electronic device (210) can determine a target device (230a) among the external devices (230) that can provide a customized function to the user based on context information (1030). The target device (230a) may be provided as one or more of the plurality of external devices (230).
[0221] According to one embodiment, at step 924, the electronic device (210) may determine a first user interface for controlling an external device (230). For example, the electronic device (210) may determine a first user interface corresponding to the type of wearable device (220). For example, the electronic device (210) may determine a first user interface corresponding to the type of each wearable device (220), such that the wearable device (220) is implemented as a smart ring or as a smart watch.
[0222] According to one embodiment, the user interface may include feedback on user input provided by the wearable device (220). For example, when a gesture input or rotation input of a touch object to the wearable device (220) is received through the user interface, feedback may be provided to the wearable device (220).
[0223] According to one embodiment, at step 925, the electronic device (210) may transmit to the target device (230a) first guide information (e.g., a notification) that the target device (230a) may provide first guide information indicating that user input for a first function can be responded to via the wearable device (220) based on a first user interface. According to one embodiment, the electronic device (210) may notify the user via the electronic device (210), the external device (230) (e.g., the target device), or the wearable device (220) that the user can choose via the wearable device (220) whether to activate the first function of the target device corresponding to a custom function for the user. For example, the electronic device (210) may recommend the first function via the display or voice guidance of the target device and provide the user with a notification that the function can be activated via user input to the wearable device (220). Additionally, the electronic device (210) may transmit an activation control signal for a sensor to receive user input from the wearable device (220) in step 925-1, along with a notification that the target device can activate a first function through the wearable device (220). At this time, the electronic device may transmit a control signal to provide feedback to the wearable device (220) to guide user input regarding the notification. For example, the feedback that may be provided by the wearable device may include a vibration signal, a light signal, and / or a sound signal. Additionally, the transmission of the control signal may include a haptic provision instruction, and accordingly, a haptic signal may be output from the wearable device (220) (e.g., step 913).
[0224] According to one embodiment, the electronic device (210) can transmit guide information to the target device. The target device can provide a notification based on the guide information transmitted from the electronic device (210). For example, the target device may provide a notification in a visual manner through a display or in an auditory manner through a speaker. For example, the notification may be provided through the electronic device (210) or through the target device. For example, the notification may be provided through both the electronic device (210) and the target device.
[0225] According to one embodiment, in step 913, the wearable device (220) may output a haptic signal in response to a feedback request from the electronic device (210) received in step 925. The haptic signal may refer to a physical signal for the wearable device (220) to notify the user of a notification received from the electronic device (210). For example, the wearable device (220) may generate a vibration in response to the notification using an actuator (e.g., actuator (351) of FIG. 3). However, in step 915, the wearable device (230) is not limited to a haptic signal and may output a light signal in response to the notification using an indicator (e.g., indicator (353) of FIG. 3) or output a voice in response to the notification using a speaker (e.g., speaker (355) of FIG. 3).
[0226] According to one embodiment, in step 914, the wearable device (220) may receive (detect) a first user input through a sensor of the wearable device (220) and transmit the received (detected) first user input to the electronic device (210). For example, as a gesture input or rotation input of a touch object for the wearable device (220) is received, the wearable device (220) may transmit the received user input to the electronic device (210).
[0227] According to one embodiment, in step 918, the electronic device (210) can generate a control command signal in response to a first user input received from a wearable device (220).
[0228] According to one embodiment, the electronic device (210) may transmit the control signal to the target device (230a) to control the target device (230a) through the generated control signal, or the electronic device (210) may control the communication connection between the wearable device (220) and the target device (230a) so that the target device (230) can be directly controlled based on user input received from the wearable device (220).
[0229] According to one embodiment, in step 926, the electronic device (210) can transmit a control command signal to activate a first function to a target device (230a) based on user input received from a wearable device (220).
[0230] According to one embodiment, in step 931, the target device (230a) can enable the first function. For example, the target device (230a) can provide the first function. For example, the target device (230a) can provide the first function, which is a customized service optimized for the user based on the user's context information (1030).
[0231] For example, the first function may be a function in which an air conditioner (e.g., air conditioner (230-1) of FIG. 2) activates a cooling function based on biometric data (1011), such as the user's body temperature or heart rate, and the user's physical activity information (1013). In this regard, FIG. 11 and FIG. 12 will be described.
[0232] For example, the first function may be a function that identifies the user's stress index based on biometric data (1011) such as the user's blood pressure and heart rate, the user's web / app usage data (1017), and the user's device usage data (1019), and recommends content to be played on a television (e.g., TV (230-3) of FIG. 2) based on the user's stress index. This will be explained in FIG. 13 and FIG. 14.
[0233] According to one embodiment, at step 927, the electronic device (210) may transmit a feedback control signal to indicate that the wearable device (220) can respond to user input for a second function through the wearable device (220), and / or a control signal to activate a sensor of the wearable device (220) to receive user input through the wearable device (220). Additionally, at step 927-1, the electronic device (210) may transmit second guide information to the target device (230a) to provide a second guide indicating that the target device (230a) can respond to user input for a second function through the wearable device (220). Here, the second function may be a function provided subsequently by the target device after the first function has been provided. Additionally, the second function may be a function provided by the target device independently of the first function. Additionally, steps 927 and 927-1 may be performed optionally, without being limited to those described. For example, step 927 may be omitted and only step 927-1 may be performed.
[0234] According to one embodiment, in step 932, the target device (230a) may output a second guide information (e.g., a notification). For example, the target device (230a) may visually display the notification through a display included in the target device (230a), or may audibly output the guide notification through a speaker included in the target device (230a).
[0235] According to one embodiment, in step 915, the wearable device (220) may receive (detect) a second user input in response to second guide information (e.g., a notification). For example, the second user input may be received through a gesture input or a rotation input to the wearable device (220). For example, the wearable device (220) may receive (detect) a second user input corresponding to a gesture action of a touch object detected by a touch sensor (e.g., the touch sensor (420) of FIG. 4).
[0236] According to one embodiment, a different control signal may be generated in response to a user gesture input to the wearable device (220) as a second user input. For example, different control signals may be mapped to the wearable device (220) depending on the type of the user gesture. For example, a control signal generated when the outer surface of the wearable device (220) is rotated clockwise by a predetermined angle and a control signal generated when the outer surface of the wearable device (220) is rotated counterclockwise by a predetermined angle may be mapped to different signals.
[0237] According to one embodiment, in step 916, the wearable device (220) can transmit a second user input to the electronic device (220).
[0238] According to one embodiment, in step 928, the electronic device (210) can generate a control command signal in response to a second user input received from a wearable device (220).
[0239] According to one embodiment, the electronic device (210) may transmit the control signal to the target device (230a) to control the target device (230a) through the generated control signal, or the electronic device (210) may control the communication connection between the wearable device (220) and the target device (230a) so that the target device (230) can be directly controlled based on user input received from the wearable device (220).
[0240] According to one embodiment, the second guide information may be provided from at least one of a target device (230a), a wearable device (220), or an electronic device (210). For example, the electronic device (210) may output the second guide information through the display of the electronic device (210). For example, the electronic device (210) may transmit the second guide information to the target device (230) so that the second guide is output from the target device (230a). For example, the electronic device (210) may provide feedback (e.g., haptics) to indicate that user input can be received according to the second guide from the wearable device (220), and may transmit an activation control signal to the sensor of the wearable device (220) to enable user input.
[0241] According to one embodiment, in step 929, the electronic device (210) can transmit a control signal according to the second user input to the target device (230a).
[0242] According to one embodiment, in step 933, the target device (230a) can perform a control operation in response to a received control signal. That is, the target device (230a) can activate a second function or provide a second function in response to the reception of a control signal according to a second user input.
[0243] FIG. 10 schematically illustrates a mechanism according to one embodiment of the present disclosure in which an electronic device (e.g., the electronic device (210) of FIG. 2) collects user data (1010) and generates context information (1030) based on the user data (1010).
[0244] All features, components, and / or arrangement relationships between components illustrated in FIG. 10 may be included, either alone or in combination with, features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 9b and FIG. 11 through 20 may be included, either alone or in combination with, features, components, and arrangement relationships between components described in FIG. 10. For example, FIG. 10 may correspond to at least part of steps 610 and 620 of FIG. 6. For example, FIG. 10 may correspond to at least part of operations 710 and 720 of FIG. 7. For example, FIG. 10 may correspond to at least part of operations 810 and 820 of FIG. 8. For example, FIG. 10 may correspond to at least part of steps 911, 912, 921, and 922 of FIG. 9.
[0245] Referring to FIG. 10, the electronic device (210) can collect various information about the user and generate context information (1030) to provide customized services for each user based on the collected information.
[0246] According to one embodiment, the electronic device (210) can acquire user data (1010). The user data (1010) may include various types of information about the user of the electronic device (210). For example, the user data (1010) may include biometric data (1011), physical activity data (1013), location data (1015), app / web usage data (1017), and device usage data (1019).
[0247] According to one embodiment, the biometric data (1011) may include data related to the user's biometric information. For example, the biometric data (1011) may include data regarding the user's heart rate, the user's electrocardiogram, the user's body temperature, the user's blood pressure, the user's blood oxygen saturation, and the user's blood carbon dioxide saturation.
[0248] According to one embodiment, biometric data (1011) may be obtained by a wearable device (e.g., the wearable device (220) of FIG. 2) and / or an electronic device (210). For example, the wearable device (220) or the electronic device (210) may obtain primary biometric data, and the electronic device (210) may obtain secondary biometric data based on the primary biometric data.
[0249] For example, a wearable device (220) may acquire primary biometric data regarding a user's heart rate, electrocardiogram, body temperature, and blood oxygen saturation, and transmit said data to an electronic device (210). The electronic device (210) may generate secondary biometric data based on the primary biometric data received from the wearable device (220). For example, the electronic device (210) may generate secondary biometric data such as sleep quality, stress level, overall health status, or emotional state based on the primary biometric data. The user's biometric information (1011) may include primary biometric data and secondary biometric data.
[0250] According to one embodiment, physical activity data (1013) may be data indicating a user's physical activity measured by a wearable device (220) and / or an electronic device (210). For example, physical activity data (1013) may include data regarding a user's exercise time, amount of exercise, number of steps, or amount of calories burned, measured by a heart rate sensor, blood pressure sensor, gyroscope sensor (e.g., gyroscope sensor (341) of FIG. 3), and / or accelerometer sensor (343) included in the wearable device (220).
[0251] According to one embodiment, location data (1015) may be data indicating the user's current location measured by a wearable device (220) and / or an electronic device (210). For example, location data (1015) may be collected by the location of a wearable device (220) worn by the user or by the location of an electronic device (210) owned by the user. Location data (1015) may be obtained, for example, by a GPS sensor included in the wearable device (220) and / or the electronic device (210).
[0252] According to one embodiment, the app / web usage data (1017) may be data regarding the user's app usage history or web usage history. The electronic device (210) may analyze the user's patterns based on the data regarding the user's app usage history or web usage history. For example, the electronic device (210) may identify the user's interests or user routine information based on the app / web usage data (1017).
[0253] According to one embodiment, the device usage data (1019) may be data regarding the usage history of an external device (e.g., the external device (230) of FIG. 3) to which a user account is registered. For example, the device usage data (101) may include information regarding the frequency of use of the external device (230), the main usage time, and frequently used functions among the functions provided by the external device (230). For example, the electronic device (210) may identify the user's routine information based on the device usage data (1019).
[0254] According to one embodiment, an electronic device (210) can generate context information (1030) based on user data (1010). The context information (1030) can be understood as customized information to be adaptively provided to the user's situation based on the user's information. The context information may also be referred to as "context information" or "situation information."
[0255] According to one embodiment, the electronic device (210) can generate context information (1030) on its own using on-device AI. For example, the electronic device (210) can generate context information (1030) using an artificial intelligence model stored in a processor (e.g., the processor (120) of FIG. 1).
[0256] According to one embodiment, the electronic device (210) can generate context information (1030) using an artificial intelligence model stored in a server (e.g., the server (240) of FIG. 2).
[0257] According to one embodiment, context information (1030) may include user profile information (1031), user routine information (1033), and user preference information (1035).
[0258] According to one embodiment, examples of profile information (1031) include the user's gender, the user's age, and the user's areas of interest. As an example of profile information (1031), information about the user having a "male (or female) tendency" may be included. As an example of profile information (1031), information about the user having a "tendency in their 20s or 30s" may be included. As an example of profile information (1031), information about the user having "children (or not having children)" may be included. As an example of profile information (1031), information about the user having an "interest in sports" may be included.
[0259] According to one embodiment, an example of routine information (1033) may include information regarding the location or movement path at a specific time based on the user's lifestyle pattern, corresponding to the user's activity information and location information. An example of routine information (1033) may include information regarding the "user's wake-up time." An example of routine information (1033) may include information regarding the "user's commute time (or arrival time)" and the "user's commute location." An example of routine information (1033) may include information regarding "places frequently visited by the user." An example of routine information (1033) may include information regarding the "user's birthday or the birthday of the user's family."
[0260] According to one embodiment, examples of preference information (1035) may include a device that the user runs at a specific time, an application that the user runs at a specific time, and a webpage that the user browses at a specific time, corresponding to the user's device usage environment and app / web usage environment. As an example of preference information (1035), information regarding "an app or webpage that is mainly run at a specific time" may be included. As an example of preference information (1035), information regarding "a control device that is performed at a specific location" may be included.
[0261] According to one embodiment, the electronic device (210) can determine a customized service to be provided to the user based on context information (1030) generated from user data (1010). For example, the electronic device (210) can operate an air conditioner to regulate the indoor air temperature when the user arrives home after exercising at a specific time. For example, the electronic device (210) can suggest a video to the user to watch based on information regarding the user's mood or stress level. For example, the electronic device (210) can suggest controlling the indoor lighting to dim when the time to go to sleep is approaching based on the user's sleep pattern.
[0262] In FIG. 11 and below, the operation of an electronic device (210) determining a target device included in an external device based on the user's context information (1030) and activating the function provided by the target device through a wearable device (220) will be described from the perspective of a user interface.
[0263] FIG. 11 schematically illustrates a scenario in which an electronic device (210) (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure controls an external device (230) (e.g., the external device (230) of FIG. 2) through a wearable device (220) (e.g., the wearable device (220) of FIG. 2) based on user context information (e.g., the context information (1030) of FIG. 10).
[0264] All features, components, and / or arrangement relationships between components illustrated in FIG. 11 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 10 and FIG. 12 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 11.
[0265] Referring to FIG. 11, when a user arrives at home after engaging in physical activity (e.g., soccer), the electronic device (210) can generate context information (1030) based on user data (e.g., user data (1010) of FIG. 10).
[0266] For example, an electronic device (210) can obtain a pulse rate, body temperature, and blood oxygen saturation included in the user’s biometric data (e.g., biometric data (1011) of FIG. 10) and activity information included in physical activity data (e.g., physical activity data (1013) of FIG. 10), and based thereon, generate context information (1030) that instructs to lower the temperature of the indoor air.
[0267] According to one embodiment, the electronic device (210) may determine an air conditioner (230-1) (e.g., the air conditioner (230-1) of FIG. 2) among a plurality of external devices (230) located in the house as a target device (e.g., the target device (230a) of FIG. 9) in order to lower indoor air.
[0268] According to one embodiment, the electronic device (210) can transmit to the wearable device (220) whether to determine the air conditioner (230-1) as the target device (230a).
[0269] According to one embodiment, the wearable device (220) may output a haptic signal in response to a notification received from the electronic device (210). For example, the wearable device (220) may notify the user that it has received the notification by generating at least one or a combination of two or more of a vibration signal, a light signal, or a sound signal.
[0270] According to one embodiment, the wearable device (220) can generate a user interface for determining a target device (230a). For example, a user interface for determining a target device (230a) can be generated by a gesture input entered into the wearable device (220).
[0271] According to one embodiment, the electronic device (210) can transmit a guide notification to the wearable device (220) indicating that the wearable device (220) can respond to a function provided by the target device (230a) (e.g., the air conditioner (230-1) operates at a predetermined temperature).
[0272] According to one embodiment, the wearable device (220) can generate user input in response to the guide notification. For example, the wearable device (220) can generate differently mapped user input in response to a gesture input.
[0273] According to one embodiment, the electronic device (210) can generate a control signal for controlling a target device (230a) in response to user input received from a wearable device (220). For example, the electronic device (210) can generate a control signal from a mapping table corresponding to the type of user input generated from the wearable device (220) stored in a memory (e.g., memory (130) of FIG. 1).
[0274] According to one embodiment, the electronic device (210) can transmit a control signal to the target device (230a). The target device (230a) can perform control in response to the control signal received from the electronic device (210). For example, the air conditioner (230-1) can set a target temperature to control the indoor temperature in response to the control signal, and operate the compressor and fan according to the target temperature.
[0275] FIG. 12 illustrates an exemplary user interface for controlling a target device (e.g., target device (230a) of FIG. 9, air conditioner (230-1) of FIG. 10) through interaction between an electronic device (210) (e.g., electronic device (101) of FIG. 1) and a wearable device (220) (e.g., wearable device (220) of FIG. 2) according to an embodiment of the present disclosure and the scenario of FIG. 11.
[0276] All features, components, and / or arrangement relationships between components illustrated in FIG. 12 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 11 and FIG. 13 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 12.
[0277] Referring to FIG. 12, a user interface #1 (1210) according to the scenario of FIG. 11 may be displayed on the display (1201) of the electronic device (210) (e.g., the display module (160) of FIG. 1). User interface #1 (1210) may sequentially display user interface #1-1 (1211), user interface #1-2 (1213), user interface #1-3 (1215), user interface #1-4 (1217), and user interface #1-5 (1219) through interaction with the wearable device (220).
[0278] According to one embodiment, user interface #1-1 (1211) may display information indicating that an electronic device (210) and an air conditioner (e.g., air conditioner (230-1) of FIG. 11) are connected.
[0279] According to one embodiment, user interface #1-2 (1213) may display information including information indicating that the air conditioner (230-1) can be controlled with a smart ring (e.g., a wearable device (220)) and information indicating a response regarding whether to control the air conditioner (230-1) with the smart ring (220).
[0280] According to one embodiment, in response to user interface #1-2 (1213), the electronic device (210) may transmit a notification to the wearable device (220). The wearable device (220) may output a haptic signal in response to the notification received from the electronic device (210). For example, the wearable device (220) may generate a vibration (1221) in response to the notification. Although not illustrated, the wearable device (220) may also output a light signal or a voice signal in response to the notification.
[0281] According to one embodiment, the wearable device (220) can generate user input for transmitting feedback in response to user interface #1-2 (1213). For example, the smart ring (220) can generate user input by operating a touch object that is contacted by the touch sensor of the smart ring (220) (e.g., touch sensor (420) of FIG. 4) in a counterclockwise direction (1223) to control an air conditioner (230-1).
[0282] According to one embodiment, the wearable device (220) can transmit user input to the electronic device (210). The electronic device (210) can display user interface #1-3 (1215) on the display (1201) in response to user input received from the wearable device (220). For example, user interface #1-3 (1215) may display information indicating that the smart ring (220) and the air conditioner (230-1) are connected.
[0283] According to one embodiment, the electronic device (210) may display user interface #1-4 (1217) on a display (1201). User interface #1-4 (1217) may display information that the target temperature of the air conditioner (230) can be adjusted by rotating the smart ring (220).
[0284] According to one embodiment, in response to user interface #1-4 (1217), the electronic device (210) may transmit a notification to the wearable device (220). The wearable device (220) may output a haptic signal in response to the notification received from the electronic device (210). For example, the wearable device (220) may generate a vibration (1225) in response to the notification. Although not illustrated, the wearable device (220) may also output a light signal or a voice signal in response to the notification.
[0285] According to one embodiment, the wearable device (220) may generate user input for transmitting feedback in response to user interface #1-4 (1217). For example, the wearable device (220) may generate user input by operating a touch object that is contacted by a touch sensor of the smart ring (220) (e.g., touch sensor (420) of FIG. 4) in a counterclockwise or clockwise direction (1227) to control the target temperature of the air conditioner (230-1). For example, the smart ring (220) may generate user input including a control signal to raise the target temperature of the air conditioner (230-1) in response to counterclockwise operation, or a control signal to lower the target temperature of the air conditioner (230-1) in response to clockwise operation.
[0286] According to one embodiment, the electronic device (210) may receive user input generated from the smart ring (220). The electronic device (210) may display user interface #1-5 (1219) on the display (1201) in response to user input generated from the smart ring (220). User interface #1-5 (1219) may display information indicating the target temperature of the air conditioner (230-1) set by user input operated by the smart ring (220), or information indicating that the target temperature can be changed.
[0287] FIG. 13 schematically illustrates a scenario in which an electronic device (210) (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure controls an external device (230) (e.g., the external device (230) of FIG. 2) through a wearable device (220) (e.g., the wearable device (220) of FIG. 2) based on user context information (e.g., the context information (1030) of FIG. 10).
[0288] All features, components, and / or arrangement relationships between components illustrated in FIG. 13 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 12 and FIG. 14 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 13.
[0289] Referring to FIG. 13, when a user arrives at the home, the electronic device (210) can generate context information (1030) based on user data (e.g., user data (1010) of FIG. 10).
[0290] For example, an electronic device (210) may generate context information (1030) based on biometric data (1011), physical activity data (1013), and / or web / app usage data (1017) included in user data (1010). For example, the context information (1030) may include the user's current stress level or current mood (1310).
[0291] According to one embodiment, the electronic device (210) can provide the user with the function of playing recommended content (1320) on a TV (230-3) included in an external device (230) (e.g., the TV (230-3) of FIG. 2) in response to the user's current mood (1310) generated by context information (1030).
[0292] According to one embodiment, the recommended content (1320) may include entertainment content (1321), documentary content (1323), or educational content (1325). For example, the TV (230-3) may provide a function to play recommended content (1320) corresponding to the user's current mood (1310) generated by context information (1030).
[0293] According to one embodiment, the electronic device (210) can transmit to the wearable device (220) whether to determine whether the TV (230-3) is a target device (e.g., the target device (230a) of FIG. 9).
[0294] According to one embodiment, the wearable device (220) may output a haptic signal in response to a notification received from the electronic device (210). For example, the wearable device (220) may notify the user that it has received the notification by generating at least one or a combination of two or more of a vibration signal, a light signal, or a sound signal.
[0295] According to one embodiment, the wearable device (220) can generate a user interface for determining a target device (230a). For example, a user interface for determining a target device (230a) can be generated by a gesture input entered into the wearable device (220).
[0296] According to one embodiment, the electronic device (210) can send a guide notification to the wearable device (220) indicating that the wearable device (220) can respond to a function provided by the target device (230a) (e.g., the TV (230-3) playing recommended content (1320)).
[0297] According to one embodiment, the wearable device (220) can generate user input in response to the guide notification. For example, the wearable device (220) can generate differently mapped user input in response to a gesture input.
[0298] According to one embodiment, the electronic device (210) can generate a control signal for controlling a target device (230a) in response to user input received from a wearable device (220). For example, the electronic device (210) can generate a control signal from a mapping table corresponding to the type of user input generated from the wearable device (220) stored in a memory (e.g., memory (130) of FIG. 1).
[0299] According to one embodiment, the electronic device (210) can transmit a control signal to the target device (230a). The target device (230a) can perform control in response to the control signal received from the electronic device (210). For example, the TV (230-3) can play recommended content selected by the user or control the volume of the recommended content being played in response to the control signal.
[0300] FIG. 14 illustrates an exemplary user interface for controlling a target device (e.g., target device (230a) of FIG. 9, TV (230-3) of FIG. 13) through interaction between an electronic device (210) (e.g., electronic device (101) of FIG. 1) and a wearable device (220) (e.g., wearable device (220) of FIG. 2) according to an embodiment of the present disclosure and the scenario of FIG. 13.
[0301] All features, components, and / or arrangement relationships between components illustrated in FIG. 14 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 13 and FIG. 15 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 14.
[0302] Referring to FIG. 14, a user interface #2 (1410) according to the scenario of FIG. 13 may be displayed on the display (1401) of the electronic device (210) (e.g., the display module (160) of FIG. 1). User interface #2 (1410) may sequentially display user interface #2-1 (1411), user interface #2-2 (1413), user interface #2-3 (1415), user interface #2-4 (1417), and user interface #2-5 (1419) through interaction with the wearable device (220).
[0303] According to one embodiment, user interface #2-1 (1411) may display information indicating that an electronic device (210) and a TV (e.g., the TV (230-3) of FIG. 13) are connected. For example, user interface #2-1 (1411) may display information indicating that recommended content (e.g., recommended content (1330) of FIG. 13) can be provided based on the user's stress level (e.g., the user's current mood (1310) of FIG. 13). For example, the electronic device (210) may determine the TV (230-3) that provides recommended content (1330) based on the user's stress level as a target device (e.g., the target device (230a) of FIG. 9).
[0304] According to one embodiment, user interface #2-2 (1413) may display information indicating whether a function to be provided by the target device (230a) is activated in response to the current stress level, and information indicating that a response can be made via the smart ring (220) regarding the function to be activated.
[0305] According to one embodiment, the electronic device (210) may transmit a notification to the wearable device (220) in response to the user interface #2-2 (1413). The wearable device (220) may output a haptic signal in response to the notification received from the electronic device (210). For example, the wearable device (220) may generate a vibration (1221) in response to the notification. Although not illustrated, the wearable device (220) may also output a light signal or a voice signal in response to the notification.
[0306] According to one embodiment, the wearable device (220) may generate user input for transmitting feedback in response to user interface #2-2 (1413). For example, the smart ring (220) may select the entertainment content (1331) by input generated by rotating a touch object contacted by a touch sensor (e.g., touch sensor (420) in FIG. 4) included in the smart ring (220) counterclockwise to select the recommended content provided by the TV (230-3) (e.g., entertainment content (1331) in FIG. 13). For example, the smart ring (220) may reject the recommended content (1331) by input generated by rotating a touch object contacted by a touch sensor (e.g., touch sensor (420) in FIG. 4) included in the smart ring (220) clockwise to not select the recommended content provided by the TV (230-3) (e.g., entertainment content (1331) in FIG. 13). In the scenario of the present disclosure, it will be assumed that the smart ring (220) has been rotated clockwise (1423).
[0307] According to one embodiment, in response to user input transmitted from a wearable device (220), the electronic device (210) may display a user interface #2-3 (1415) on a display (1401). The user interface #2-3 (1415) may display information indicating that content recommended by the TV (230-3) is not selected.
[0308] According to one embodiment, the electronic device (210) may display a user interface #2-4 (1417) on a display (1401). For example, the user interface #2-4 (1417) may display information about the functions that the target device (230a) will provide next, and information about the ability to enable the functions to be provided to the wearable device (220). For example, the user interface #2-4 (1417) may display information about the content to be recommended on the TV (230-3) and information about the ability to select said information with the smart ring (230).
[0309] According to one embodiment, in response to user interface #2-4 (1417), the electronic device (210) may transmit a notification to the wearable device (220). The wearable device (220) may output a haptic signal in response to the notification received from the electronic device (210). For example, the wearable device (220) may generate a vibration (1425) in response to the notification. Although not illustrated, the wearable device (220) may also output a light signal or a voice signal in response to the notification.
[0310] According to one embodiment, the wearable device (220) may generate user input for transmitting feedback in response to user interface #2-4 (1417). For example, the wearable device (220) may generate user input by operating a touch object that is contacted by a touch sensor of the smart ring (220) (e.g., touch sensor (420) of FIG. 4) in a counterclockwise or clockwise direction (1427) to select content provided by the TV (230-3). For example, the smart ring (220) may generate user input including a control signal to select recommended content provided by the TV (230-3) in response to operation in a counterclockwise direction, or a control signal to reject recommended content provided by the TV (230-3) in response to operation in a clockwise direction. In the scenario of the present disclosure, it will be assumed that the smart ring (220) has been rotated counterclockwise (1427).
[0311] According to one embodiment, the electronic device (210) may receive user input generated from the smart ring (220). The electronic device (210) may display user interface #2-5 (1419) on the display (1401) in response to user input generated from the smart ring (220). User interface #2-5 (1419) may display information indicating that recommended content (e.g., travel content (1333)) has been selected by the smart ring (220), and information guiding that the volume of recommended content to be played by the smart ring (220) can be controlled.
[0312] FIG. 15 schematically illustrates a scenario in which a function provided by an external device (1510) (e.g., the external device (230) of FIG. 2) is controlled via a wearable device (220) according to one embodiment of the present disclosure.
[0313] All features, components, and / or arrangement relationships between components illustrated in FIG. 15 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 14 and FIG. 16 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 3.
[0314] Referring to FIG. 15, the electronic device (1510) can be understood as a device that provides a shooting function. For example, the electronic device (1510) may include a digital camera, a wearable camera (action camera), as well as a smartphone with a built-in camera (e.g., the electronic device (210) of FIG. 2).
[0315] According to one embodiment, an electronic device (1510) and a wearable device (220) may be connected. The wearable device (220) may be connected to the electronic device (1510) and generate a signal to control the function provided by the electronic device (1510).
[0316] According to one embodiment, when the electronic device (1510) activates the shooting function, an input signal (1520) for controlling the electronic device (1510) can be generated by operating the wearable device (220).
[0317] For example, a wearable device (220) can generate a first input signal by rotating two touch objects in a counterclockwise direction on a touch sensor (e.g., touch sensor (420) of FIG. 4).
[0318] For example, a wearable device (220) can generate a second input signal by rotating two touch objects in a clockwise direction on a touch sensor (e.g., touch sensor (420) of FIG. 4).
[0319] For example, a wearable device (220) can generate a third input signal by two touch objects contacting on a touch sensor (e.g., touch sensor (420) of FIG. 4) for a predetermined period of time or longer.
[0320] According to one embodiment, the electronic device (1510) may generate a control signal mapped to each of the first to third input signals in response to receiving first to third input signals (1520) generated by the wearable device (220). The electronic device (1510) may control a function being executed by the control signal.
[0321] For example, the electronic device (1510) can enlarge the object currently being photographed in response to the first input signal.
[0322] For example, the electronic device (1510) can reduce the object currently being photographed in response to the second input signal.
[0323] For example, the electronic device (1510) can photograph the object currently being photographed in response to the third input signal.
[0324] FIG. 16 illustrates an exemplary user interface for controlling an electronic device (1510) through interaction between an electronic device (210) (e.g., the electronic device (1510) of FIG. 15) and a wearable device (220) (e.g., the wearable device (220) of FIG. 2) according to an embodiment of the present disclosure, in accordance with the scenario of FIG. 15.
[0325] All features, components, and / or arrangement relationships between components illustrated in FIG. 16 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 15 and FIG. 17 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 16.
[0326] Referring to FIG. 16, a user interface #3 (1610) according to the scenario of FIG. 15 may be displayed on the display (1601) of the electronic device (210) (e.g., the display module (160) of FIG. 1). User interface #3 (1610) may sequentially display user interface #3-1 (1611), user interface #3-2 (1613), user interface #3-3 (1615), and user interface #3-4 (1617) through interaction with the wearable device (220).
[0327] According to one embodiment, user interface #3-1 (1611) may display information indicating that the electronic device (210) and the wearable device (220) are connected. User interface #3-1 (1611) may display information indicating that a currently running application (e.g., a camera app) can be controlled by the smart ring (e.g., the wearable device (220)), and information requesting user input to control said application.
[0328] According to one embodiment, the electronic device (210) can transmit a notification to the wearable device (220) in response to the user interface #3-1 (1611). The wearable device (220) can output a haptic signal in response to the notification received from the electronic device (210). For example, the wearable device (220) can generate a vibration (1621) in response to the notification. Although not illustrated, the wearable device (220) may also output a light signal or a voice signal in response to the notification.
[0329] According to one embodiment, the wearable device (220) may generate user input for transmitting feedback in response to user interface #3-1 (1611). For example, to control a camera application running on an electronic device (210) with the smart ring (220), a control signal may be generated for controlling the smart ring (220) and the electronic device (210). For example, the smart ring (220) may generate the control signal as an input generated by rotating (1623) a touch object contacted by a touch sensor (e.g., touch sensor (420) of FIG. 4) in a counterclockwise direction.
[0330] According to one embodiment, in response to user input transmitted from a wearable device (220), the electronic device (210) may display a user interface #3-2 (1613) on a display (1601). The user interface #3-2 (1613) may display information indicating that the smart ring (220) and the camera application are linked.
[0331] According to one embodiment, the electronic device (210) may display a user interface #3-3 (1615) on a display (1601). For example, the user interface #3-3 (1615) may display information that a specific function of a camera application can be activated by operating the smart ring (220).
[0332] According to one embodiment, in response to user interface #3-3 (1615), the electronic device (210) may transmit a notification to the wearable device (220). The wearable device (220) may output a haptic signal in response to the notification received from the electronic device (210). For example, the wearable device (220) may generate a vibration (1625) in response to the notification. Although not illustrated, the wearable device (220) may also output a light signal or a voice signal in response to the notification.
[0333] According to one embodiment, the wearable device (220) may generate user input for transmitting feedback in response to user interface #3-3 (1615). For example, the wearable device (220) may generate the first to third input signals (1520) described above in FIG. 15 to control functions for a camera application.
[0334] According to one embodiment, in response to inputting an operation (1627) to the wearable device (220), the wearable device (220) may generate first to third input signals. For example, the wearable device (220) may generate a first input signal to enlarge an object currently being photographed, generate a second input signal to reduce an object currently being photographed, or generate a third input signal to photograph an object currently being photographed.
[0335] According to one embodiment, the electronic device (210) can receive an input signal generated from the smart ring (220). The electronic device (210) can display a user interface #3-4 (1617) on the display (1601) in response to user input generated from the smart ring (220). The user interface #3-4 (1617) may display information regarding how the functions of the camera application are controlled by the first to third input signals.
[0336] FIGS. 17 and 18 schematically illustrate a scenario in which a function provided by an electronic device (e.g., the electronic device (210) of FIG. 2) is controlled via a wearable device (220) (e.g., the wearable device (220) of FIG. 2) according to one embodiment of the present disclosure.
[0337] FIGS. 17 and FIGS. 18 may be understood as illustrating that functions within an application displayed on the display (1701) of the electronic device (210) (e.g., the display module (160) of FIG. 1) can be controlled differently in correspondence with the position of the wearable device (220).
[0338] All features, components, and / or arrangement relationships between components illustrated in FIGS. 17 and 18 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIGS. 1 through 16 and FIGS. 19 through 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIGS. 17 and 18.
[0339] Referring to FIGS. 17 and 18, when the electronic device (210) is currently running a music application, an object controllable by a user within the application may be displayed on the display (1701). For example, in FIG. 17, an object (1730) for changing or pausing the currently playing music may be displayed on the display (1701), and in FIG. 18, an object (1830) for controlling the volume of the currently playing music may be displayed on the display (1701).
[0340] According to one embodiment, the electronic device (210) may provide a user interface for preferentially controlling an object adjacent to the wearable device (220).
[0341] For example, when the wearable device (220) in FIG. 17 is positioned at the bottom of the display (1701), the electronic device (210) may display an object (1730) for changing or pausing the currently playing music on the display (1701). For example, in response to the wearable device (220) being positioned at the bottom of the display (1701), the electronic device (210) may display object information (1720) such as "Please return the ring being worn to select a song" on the display (1701) or output it as voice information (1710).
[0342] For example, in FIG. 18, when the wearable device (220) is positioned to the right of the display (1701), the electronic device (210) can display an object (1730) for controlling the volume of the music currently being played on the display (1701). For example, in response to the wearable device (220) being positioned at the bottom of the display (1701), the electronic device (210) can display object information (1720) such as "Please turn the ring being worn to adjust the volume" on the display (1701) or output voice information (1810).
[0343] According to one embodiment, when the electronic device (210) outputs the notification in response to the location of the wearable device (220), the wearable device (220) may output a haptic signal in response to the notification. For example, the wearable device (220) may output a vibration signal in response to the notification. In addition, the wearable device (220) may output a light signal or a voice signal in response to the notification.
[0344] According to one embodiment, the wearable device (220) can generate an input signal for controlling functions within an application based on user operation input to the wearable device (220). The electronic device (210) can control functions within an application based on the input signal received from the wearable device (220).
[0345] FIG. 19 schematically illustrates a scenario in which a function provided by an electronic device (e.g., the electronic device (210) of FIG. 2) is controlled via a wearable device (220) (e.g., the wearable device (220) of FIG. 2) according to one embodiment of the present disclosure.
[0346] All features, components, and / or arrangement relationships between components illustrated in FIG. 19 may be included, either alone or in combination with, features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 18 and FIG. 20 may be included, either alone or in combination with, features, components, and arrangement relationships between components described in FIG. 19.
[0347] Referring to FIG. 19, when the electronic device (210) receives a voice call request signal, it can output a user interface according to the voice call request signal to a display (1901) (e.g., the display module (160) of FIG. 1).
[0348] According to one embodiment, upon approach of the wearable device (220), the electronic device (210) may display object information (1910) on the display (1901) regarding the possibility of accepting a voice call request signal by operating the wearable device (220). Additionally, information regarding call acceptance and call rejection by rotating the wearable device (220) may be displayed on the display (1901).
[0349] According to one embodiment, the wearable device (220) can generate an input signal by rotational operation and transmit the input signal to an electronic device (210). For example, the electronic device (210) can perform control corresponding to receiving a call or rejecting a call in response to the input signal generated by the wearable device (220).
[0350] FIG. 20 schematically illustrates a scenario in which a function provided by an external device (e.g., the external device (230) of FIG. 2) is controlled through a wearable device (220) according to one embodiment of the present disclosure.
[0351] All features, components, and / or arrangement relationships between components illustrated in FIG. 20 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in other figures of this specification. Likewise, all features, components, and / or arrangement relationships between components described in relation to FIG. 1 through 19 may be included, either alone or in combination with, the features, components, and arrangement relationships between components described in FIG. 20.
[0352] Referring to FIG. 20, the wearable device (220) may be configured to control various functions provided by an external device (230). For example, the wearable device (220) may generate control signals for various user interfaces provided by a vehicle (e.g., the car (230-5) of FIG. 3) which is the external device (230).
[0353] According to one embodiment, when the wearable device (220) is located inside a vehicle, the wearable device (220) and the vehicle (230-5) can be connected. For example, when the wearable device (220) is located inside a vehicle, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (210) of FIG. 2) may transmit a signal requesting whether to perform a connection to control the vehicle (230-5) to the wearable device (220).
[0354] According to one embodiment, the wearable device (220) can output a haptic signal in response to receiving a request signal from the electronic device (210), and the automobile (230-5) and the wearable device (220) can be connected to each other through the operation of the wearable device (220).
[0355] According to one embodiment, in response to the angle or position of the wearable device (220), the wearable device (220) can activate a plurality of functions provided by the vehicle (230-5) and generate a signal to control the activated functions.
[0356] According to one embodiment, an electronic device (210) and / or a vehicle (230-5) can detect the angle or position of a wearable device (220). To this end, the vehicle (230-5) may be equipped with a device for determining the angle or position of the wearable device (220). For example, the vehicle (230-5) may be equipped with a communication device capable of short-range communication with the wearable device (220) to detect the angle or position of the wearable device (220). For example, the vehicle (230-5) may detect the current position and angle of the wearable device (220) based on triangulation using a Bluetooth method or a Wi-Fi method.
[0357] According to one embodiment, the vehicle (230-5) can detect the position and angle of the wearable device (220) by information obtained from a sensor (e.g., gyroscope sensor (341), accelerometer sensor (343), or proximity sensor (345)) embedded in the wearable device (220).
[0358] According to one embodiment, the vehicle (230-5) can obtain the direction pointed by the finger wearing the wearable device (220) based on the current position and angle of the wearable device (220). For example, the vehicle (230-5) can identify the current position and angle of the wearable device (220) as pointing to the current navigation (2020).
[0359] According to one embodiment, the vehicle (230-5) can output information that it can perform control over the function provided by the object pointed to by the wearable device (220). For example, the vehicle (230-5) can output the information visually through a dashboard or through a speaker.
[0360] According to one embodiment, the wearable device (220) can generate user input for performing control over various objects included inside the vehicle (230-5). For example, the vehicle (230-5) can determine an object indicated by a finger wearing the wearable device (220), transmit information about the function provided by the determined object, and activate the function in response to an input signal generated by the operation of the wearable device (220).
[0361] For example, a car (230-5) can perform control to adjust the brightness of the interior light (2010) by receiving a control through the wearable device (220) and having a finger wearing the wearable device (220) point to the interior light (2010).
[0362] For example, a car (230-5) can perform control to adjust the volume of music displayed on the navigation (2020) by receiving operation through the wearable device (220) and having a finger wearing the wearable device (220) point to the navigation (2020).
[0363] For example, a car (230-5) can control the air conditioner (2030) to regulate the temperature inside the car by receiving a finger wearing a wearable device (220) pointing at the air conditioner (2030) and receiving a control through the wearable device (220).
[0364] For example, a car (230-5) can perform control to lock or open the door by receiving an operation through the wearable device (220) and having a finger wearing the wearable device (220) point to the door handle (2040).
[0365] For example, a car (230-5) can perform control to open or close a window by receiving an operation through the wearable device (220) and having a finger wearing the wearable device (220) point to a window button (2050).
[0366] An electronic device (101) according to one embodiment of the present disclosure (e.g., the electronic device (101) of FIG. 1) can identify an external device (e.g., the external device (230) of FIG. 2) that provides customized information to a user based on information received from a wearable device (e.g., the wearable device (220) of FIG. 2 or the wearable device (400) of FIG. 4), and can provide control over the external device (230) identified through the wearable device (220).
[0367] An electronic device (101; 200) according to one embodiment of the present disclosure can collect data about a user through a wearable device (220; 400) and generate context information to provide customized services to the user based on the data.
[0368] An electronic device (101; 200) according to one embodiment of the present disclosure can determine an external device that provides customized functions to the user based on context information.
[0369] An electronic device (101; 200) according to one embodiment of the present disclosure receives a notification that control of a function provided by an external device is possible through a wearable device (220; 400), and can notify the user of this in various ways.
[0370] An electronic device (101; 200) according to one embodiment of the present disclosure can increase user convenience by identifying the location of a wearable device (220; 400) and prioritizing the activation of functions available at a point close to the wearable device (220; 400).
[0371] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below.
[0372] An electronic device (101; 210) according to one embodiment of the present disclosure may include a communication circuit (190), a server (108; 240), one or more processors (120), and a memory (130) operatively connected to the one or more processors (120) and configured to store instructions. When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (102; 210) obtains a user's biometric data from a wearable device (220; 400) connected to the electronic device (101; 210) via the communication circuit (190), obtains the user's context information based on the biometric data or pre-stored activity data of the user, identifies the external device (230) located near the electronic device (101; 210) or the wearable device (220; 400), determines a first function to recommend to the user and a target device (230a) capable of providing the first function from the external device (230) based on the context information, determines a first user interface for controlling the target device based on the type of user input specified from the wearable device (220; 440), and provides user input for the first function based on the first user interface A first guide information can be transmitted to the target device (230a) to provide a first guide indicating that a response can be made through the wearable device (220; 400), and in response to the transmission of the first guide information, a first user input is received from the wearable device (220; 400), and in response to the reception of the first user input, control information instructing the activation of the first function corresponding to the first user input based on the first user interface can be transmitted to the target device (230a).
[0373] According to one embodiment, when the instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) determines a second user interface for activating the second function different from the first function at the target device (230a) based on the type of user input specified from the wearable device (220; 400), transmits second guide information to the target device (230a) to provide a second guide indicating that user input for the second function can be responded to through the wearable device (220; 400) based on the second user interface, receives the second user input from the wearable device (220; 400), and in response to the reception of the second user input, transmits control information to the target device (230a) instructing the activation of the second function corresponding to the second user input based on the second user interface. It is possible.
[0374] According to one embodiment, the second function may be generated in response to the first user input received after the transmission of the first guide information.
[0375] According to one embodiment, when the instructions are executed individually or collectively by one or more processors (120), the electronic device (101; 210) may transmit a control signal to the wearable device (220; 400) to provide feedback to the user in the wearable device (220; 400) in response to the first guide or the second guide. The control signal may be a signal output by the wearable device (220; 400) in the form of a haptic signal as feedback corresponding to the first guide or the second guide.
[0376] According to one embodiment, when the instructions are executed individually or collectively by one or more processors (120), the electronic device (101; 210) may transmit the first guide information or the second guide information to the target device (230a), and the first guide or the second guide may be output through the external device (230) based on the first guide information or the second guide information.
[0377] According to one embodiment, the instructions may, when executed individually or collectively by one or more processors (120), cause the electronic device (101; 210) to determine the first user interface or the second user interface, which allows the user to select whether to activate the first function or the second function of the target device through the touch gesture input or the rotation input of the wearable device (220; 440), if the wearable device (220; 440) is ring-shaped and the type of user input assigned to the wearable device (220; 440) is a touch gesture input or a rotation input for the wearable device (220; 440).
[0378] According to one embodiment, when the instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) may be able to identify the user input by the length or direction of the touch gesture input or by the rotation angle or rotation direction of the rotation input in response to at least one of the first user interface or the second user interface being determined.
[0379] According to one embodiment, the instructions may be configured such that when executed individually or collectively by one or more processors (120), the electronic device (101; 210) generates a specific control signal mapped to the memory corresponding to the operation type of the wearable device in response to the reception of the first user input or the second user input, and transmits the generated specific control signal to the target device (230a).
[0380] According to one embodiment, when the instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) may be configured such that the first user input or the second user input is generated by moving a part of the user's body in contact along the outer surface of the ring-shaped wearable device or by the rotation of the wearable device.
[0381] According to one embodiment, the instructions may be configured such that, when executed individually or collectively by one or more processors (120), the electronic device (101; 210) determines the first function provided by the target device (230a) among the external devices (230) by considering the first function or the second function provided by the external device (230).
[0382] According to one embodiment, when the instructions are executed individually or collectively by one or more processors (120), the electronic device (101; 210) obtains the context information from at least one of the electronic device, the wearable device, the first server, or the second server, and the first server stores or uses data generated from the electronic device (101; 210) and the wearable device (220; 400) based on an AI algorithm, and the second server stores or uses data generated from the external device (230).
[0383] According to one embodiment, the external device (230) may be a device connected to the electronic device (101; 210) through at least one of the first server or the second server, and connected by an authenticated account that allows a user to access it.
[0384] A control method for an electronic device (101; 210) according to one embodiment of the present disclosure comprises: acquiring biometric data of a user from a wearable device (220; 400); acquiring context information of the user based on the biometric data or pre-stored activity data of the user; identifying an external device (230) located around the electronic device (101; 210) and the wearable device (220; 400); determining, based on the context information, a first function to be recommended to the user and a target device (230a) capable of providing the first function from the external device (230); determining a first user interface for controlling the target device (230a) based on a type of user input specified from the wearable device (220; 400); and, based on the first user interface, providing a first guide to the target device (230a) indicating that user input for the first function can be responded to through the wearable device (220; 400). The method may include the operation of transmitting a first guide information to the target device (230a) to be provided by the device (230a), the operation of receiving a first user input from the wearable device (220; 400) in response to the transmission of the first guide information, and the operation of transmitting control information to the target device (230a) that instructs the activation of the first function corresponding to the first user input based on the first user interface in response to the reception of the first user input.
[0385] According to one embodiment, a control method for an electronic device (101; 210) may further include: determining a second user interface for activating a second function different from the first function in the target device (230a) based on a type of user input specified from the wearable device (220; 400); transmitting second guide information to the target device (230a) to provide a second guide indicating that the target device (230a) can respond to the user input for the second function based on the second user interface; receiving a second user input from the wearable device (220; 400); and transmitting control information to the target device (230a) in response to the reception of the second user input, indicating the activation of the second function corresponding to the second user input based on the second user interface.
[0386] According to one embodiment, a control method for an electronic device (101; 210) may further include an operation of transmitting a control signal to the wearable device (220; 400) to provide feedback to the user in the wearable device (220; 400) in response to the first guide or the second guide. The control signal may be a signal output in the form of a haptic signal by the wearable device (220; 400) as feedback corresponding to the first guide or the second guide.
[0387] According to one embodiment, a control method of an electronic device (101; 210) may further include the operation of transmitting the first guide information or the second guide information to the target device (230a), and the operation of causing the first guide or the second guide to be output by the external device (230) based on the first guide information or the second guide information.
[0388] According to one embodiment, a control method for an electronic device (101; 210) may further include an operation of preferentially activating a first function or a second function provided by a target device (230a) among the external devices (230) by considering the first function or the second function provided by the external device (230).
Claims
1. In an electronic device (101; 210), Communication circuit (190); Server(108; 240); One or more processors (120); and It includes a memory (130) that is operatively connected to one or more processors (120) and configured to store instructions, and When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (102; 210) causes, Acquiring user's biometric data from a wearable device (220; 400) connected to the electronic device (101; 210) through the communication circuit (190), and Based on the above biometric data or the previously stored activity data of the user, the context information of the user is obtained, and Identifying the external device (230) located around the electronic device (101; 210) or the wearable device (220; 400), and Based on the above context information, a first function to be recommended to the user and a target device (230a) capable of providing the first function from the external device (230) are determined, and A first user interface for controlling the target device is determined based on the type of user input specified from the wearable device (220; 440), and Transmitting first guide information to the target device (230a) to provide a first guide indicating that user input for the first function can be responded to through the wearable device (220; 400) based on the first user interface, and In response to the transmission of the first guide information, a first user input is received from the wearable device (220; 400), and An electronic device (101; 210) that, in response to the reception of the first user input, transmits control information to the target device (230a) instructing the activation of the first function corresponding to the first user input based on the first user interface.
2. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, Based on the type of user input specified from the wearable device (220; 400), a second user interface for activating the second function different from the first function in the target device (230a) is determined, and Second guide information is transmitted to the target device (230a) to provide a second guide indicating that user input for the second function can be responded to through the wearable device (220; 400) based on the second user interface, and Receiving a second user input from the above wearable device (220; 400), and An electronic device (101; 210) that, in response to the reception of the second user input, transmits control information to the target device (230a) instructing the activation of the second function corresponding to the second user input based on the second user interface.
3. In Paragraph 1 or 2, The second function is an electronic device (101; 210) that is generated in response to the first user input received after the transmission of the first guide information.
4. In any one of paragraphs 1 through 3, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, A control signal is transmitted to the wearable device (220; 400) to provide feedback to the user in the wearable device (220; 400) in response to the first guide or the second guide, and The above control signal is an electronic device (101; 210) which is a signal output in the form of a haptic signal by the wearable device (220; 400) as feedback corresponding to the first guide or the second guide.
5. In any one of paragraphs 1 through 4, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, An electronic device (101; 210) that transmits the first guide information or the second guide information to the target device (230a) and causes the first guide or the second guide to be output through the external device (230) based on the first guide information or the second guide information.
6. In any one of paragraphs 1 through 5, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, An electronic device (101; 210) that determines the first user interface or the second user interface, wherein the wearable device (220; 440) is ring-shaped and the type of user input assigned to the wearable device (220; 440) is a touch gesture input or a rotation input for the wearable device (220; 440), and allows selecting whether to activate the first function or the second function of the target device through the touch gesture input or the rotation input of the wearable device (220; 440).
7. In Paragraph 6, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, In response to at least one of the first user interface or the second user interface being determined, the user input is verified by the length or direction of the touch gesture input, or the user input is verified by the rotation angle or rotation direction of the rotation input. In response to the reception of the first user input or the second user input, a specific control signal mapped to the memory is generated corresponding to the operation type of the wearable device, and An electronic device (101; 210) that transmits the generated specific control signal to the target device (230a).
8. In Paragraph 7, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, The first user input or the second user input is an electronic device (101; 210) configured to be generated by a part of the user's body moving in contact with the outer surface of the ring-shaped wearable device or by the rotation of the wearable device.
9. In any one of paragraphs 1 through 8, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, An electronic device (101; 210) configured to determine the first function provided by the target device (230a) among the external devices (230) by considering the first function or the second function provided by the external device (230).
10. In any one of paragraphs 1 through 9, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (101; 210) causes, The above context information is obtained from at least one of the electronic device, the wearable device, the first server, or the second server, and The first server above stores or uses data generated from the electronic device (101; 210) and the wearable device (220; 400) based on an AI algorithm, and The second server above is an electronic device (101; 210) that stores or uses data generated from the external device (230).
11. A method for controlling an electronic device (101; 210), The operation of acquiring a user's biometric data from a wearable device (220; 400); An operation to obtain context information of the user based on the above biometric data or the user's pre-stored activity data; An operation to identify the external device (230) located around the electronic device (101; 210) and the wearable device (220; 400); Based on the above context information, an operation to determine a first function to be recommended to the user and a target device (230a) capable of providing the first function from the external device (230); An operation to determine a first user interface for controlling the target device (230a) based on the type of user input specified from the wearable device (220; 400); An operation of transmitting first guide information to the target device (230a) to provide a first guide indicating that user input for the first function can be responded to through the wearable device (220; 400) based on the first user interface; An operation of receiving a first user input from the wearable device (220; 400) in response to the transmission of the first guide information; and A method comprising the operation of transmitting control information to the target device (230a) that instructs the activation of the first function corresponding to the first user input based on the first user interface in response to the reception of the first user input.
12. In Paragraph 11, An operation to determine a second user interface for activating a second function different from the first function in the target device (230a) based on the type of user input specified from the wearable device (220; 400); The operation of transmitting second guide information to the target device (230a) so that the target device (230a) provides a second guide indicating that user input for the second function can be responded to through the wearable device (220; 400) based on the second user interface; The operation of receiving a second user input from the above-mentioned wearable device (220; 400); and An electronic device (101; 210) further comprising, in response to the reception of the second user input, an operation of transmitting control information to the target device (230a) that directs the activation of the second function corresponding to the second user input based on the second user interface.
13. In Paragraph 11 or 12, The method further includes an operation of transmitting a control signal to the wearable device (220; 400) to provide feedback to the user in the wearable device (220; 400) in response to the first guide or the second guide, The above control signal is a signal output in the form of a haptic signal by the wearable device (220; 400) as feedback corresponding to the first guide or the second guide.
14. In Paragraph 11 or 12, The operation of transmitting the first guide information or the second guide information to the target device (230a); and A method further comprising an operation to cause the first guide or the second guide to be output by the external device (230) based on the first guide information or the second guide information.
15. In any one of paragraphs 11 through 14, A method further comprising an operation of preferentially activating the first function or the second function provided by the target device (230a) among the external devices (230) in consideration of the first function or the second function provided by the external device (230).
Citation Information
Patent Citations
Apparatus and method for ring computing devices
JP2017513126A
Composition for controlling plant diseases comprising compound derived from Aspergillus montenegroi SFC20200425-M27 strain and method for preparing the same
KR1020230031688A
Composition for organic optoelectronic device and organic optoelectronic device and display device
KR1020250134429A
Plug connector
KR1020250178582A
System For Playing Music Combined With Heartbeat Sound And Method Thereof
KR102694303B1