Electronic device and method for controlling external electronic device by using same

An electronic device with AI-driven conversation analysis dynamically controls external devices based on call content, enabling efficient task execution and enhanced usability through gesture input.

WO2025264080A1PCT designated stage Publication Date: 2025-12-26SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2025/095306
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-09-23
Filing Date
2025-05-08
Publication Date
2025-12-26

AI Technical Summary

Technical Problem

Existing electronic devices lack the ability to dynamically adjust and control the functions of external devices based on real-time conversation analysis during a call, limiting user convenience and efficiency.

Method used

An electronic device equipped with an AI model analyzes conversation content in real-time, determines appropriate applications, and controls external devices like wearable devices to execute desired tasks based on user needs, using gesture detection for input.

Benefits of technology

Enhances user convenience by allowing tasks to be performed effortlessly during a call, improving usability and efficiency through dynamic application control and gesture-based interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025095306_26122025_PF_FP_ABST
    Figure KR2025095306_26122025_PF_FP_ABST
Patent Text Reader

Abstract

According to various embodiments, an electronic device may comprise: a communication module for connecting to an external electronic device; a processor including a processing circuit; and a memory storing instructions. When the instructions are executed by the processor, the electronic device may: activate an algorithm for analyzing a conversation when a call function is executed according to a user input; extract at least one keyword included in the conversation on the basis of the activated algorithm for a first time set while the call function is being executed; determine a first application on the basis of the at least one extracted keyword; in response to the operation of the external electronic device, transmit the determined first application and information related to the at least one keyword to the external electronic device; and in response to termination of the call function, store the information related to the at least one keyword on the basis of the first application. Various other embodiments may be possible.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device and method for controlling external electronic device using the same

[0001] Embodiments of the present disclosure relate to an electronic device and a method for controlling an external electronic device using the same.

[0002] With the recent development of digital technology, various types of electronic devices (user devices) capable of communication and personal information processing (e.g., mobile terminals, personal digital assistants (PDAs), electronic organizers, smartphones, tablets, wearable electronic devices, and / or personal computers (PCs)) are being released. As the functions provided by electronic devices are diversifying and electronic devices are widely used in daily life, the time spent using electronic devices is gradually increasing. Electronic devices may be operatively or functionally connected to external electronic devices (e.g., wearable electronic devices and / or wearable watches) and may control at least part of the functions of the external electronic devices. For example, electronic devices may provide functions desired by the user (e.g., application programs) through wearable electronic devices.

[0003] The external electronic device may include a wearable electronic device (e.g., a wearable watch and / or a watch-type electronic device) that can be attached to a part of the user's body (e.g., a wrist). The electronic device may be linked to the wearable electronic device and exchange data with the wearable electronic device in connection with the operation and execution of functions of the wearable electronic device. For example, the electronic device may perform a call function and process data related to the call content through the wearable electronic device.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] An electronic device can activate an artificial intelligence model (e.g., an AI model, an AI algorithm) during a phone call, and analyze the conversation based on the activated AI model. Based on the analysis results of the conversation, the electronic device can determine an application that suits the user's needs, and at least partially control an external electronic device (e.g., a wearable electronic device) operatively connected to the electronic device so that the determined application is executed through the external electronic device. Based on the analysis results of the conversation, the electronic device can provide the user with a function (e.g., a task) desired by the user. The electronic device can control the external electronic device (e.g., a wearable electronic device) so that the function desired by the user is executed.

[0006] An electronic device can analyze call content in real time and change the application to be executed based on the conversation topic. For example, the electronic device can analyze the conversation content in real time and determine a first application based on the analyzed conversation content. When the topic of the conversation changes, the electronic device can analyze the conversation content related to the changed topic and, based on the analyzed conversation content, determine a second application different from the first application. The electronic device can analyze the conversation content periodically or aperiodically while the call function is in progress and change and determine the task based on the analyzed results.

[0007] The electronic device can transmit information (e.g., task information) based on the analysis of the conversation content to an operatively connected external electronic device (e.g., a wearable electronic device), and can at least partially control the external electronic device so that the determined task is executed through the external electronic device.

[0008] In one embodiment, an electronic device can analyze call content in real time based on an AI algorithm (e.g., an AI model that analyzes conversation content) and determine a specific application (e.g., a task) based on the analysis results. During a call, the electronic device can run a desired application program and, based on the application, provide the user with a function to register schedules included in the call content.

[0009] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary skill in the technical field to which this document pertains from the description below.

[0010] According to one embodiment, an electronic device may include a communication module for connecting with an external electronic device, a processor including a processing circuit, and a memory for storing instructions. When the instructions are executed by the processor, when a call function is executed according to a user input, the electronic device may activate an algorithm for conversation analysis, extract at least one keyword included in a conversation based on the activated algorithm for a set first time period while the call function is being executed, determine a first application based on the extracted at least one keyword, transmit information related to the determined first application and the at least one keyword to the external electronic device in response to an operation of the external electronic device, and store information related to the at least one keyword based on the first application in response to termination of the call function.

[0011] According to one embodiment, an external electronic device may include a communication module for connecting with an electronic device, a display, a motion sensor for detecting a gesture, a processor including a processing circuit, and a memory for storing instructions. When the instructions are executed by the processor, the external electronic device may activate the display in response to detection of a set first gesture, obtain a first application determined by the electronic device and information related to the first application based on a conversation content according to a call function, and display a first image corresponding to the first application through the display based on the first application and the information related to the first application while the call function is running.

[0012] According to one embodiment, a method for controlling an external electronic device may include an operation of activating an algorithm for conversation analysis when a call function is executed according to a user input, an operation of extracting at least one keyword included in a conversation based on the activated algorithm during a set first time period while the call function is being executed, an operation of determining a first application based on the extracted at least one keyword, an operation of transmitting information related to the determined first application and the at least one keyword to the external electronic device (201) in response to an operation of the external electronic device (201), and an operation of storing information related to the at least one keyword based on the first application in response to termination of the call function.

[0013] According to one embodiment, a non-transitory computer-readable storage medium (or computer program product) storing one or more programs for performing a method for an electronic device to provide content through an external electronic device may be described. According to one embodiment, the one or more programs may include instructions that, when executed by a processor of the electronic device, perform an operation of activating an algorithm for conversation analysis when a call function is executed in response to a user input; an operation of extracting at least one keyword included in a conversation based on the activated algorithm for a set first time period while the call function is being executed; an operation of determining a first application based on the extracted at least one keyword; an operation of transmitting information related to the determined first application and the at least one keyword to the external electronic device (201) in response to an operation of the external electronic device (201); and an operation of storing information related to the at least one keyword based on the first application in response to termination of the call function.

[0014] According to one embodiment, an electronic device may activate an AI algorithm for analyzing conversation content during a phone call, and may analyze the call content in real time based on the activated AI algorithm. For example, the electronic device may extract at least one keyword based on words and expressions included in the call content, and may determine a specific application based on the extracted at least one keyword. For example, if the call content is determined to be related to a schedule, the electronic device may determine an application for registering the schedule (e.g., a calendar application and / or a schedule application). In another example, if the call content is determined to be related to a location, the electronic device may determine an application for finding the location (e.g., a map application and / or a navigation application).

[0015] According to one embodiment, an electronic device can detect a user's gesture using an operatively connected external electronic device (e.g., a wearable electronic device), and based on the detected gesture, perform a function related to the determined application. For example, in a situation where a calendar application is determined, if a first gesture is detected, the electronic device can execute the calendar application. If a second gesture is detected after the detection of the first gesture, the electronic device can register or change a schedule extracted from call content based on the executed calendar application. The electronic device can execute a specific function (e.g., a task) of the determined application in response to the detection of a gesture through the external electronic device while synchronized with the external electronic device.

[0016] According to one embodiment, an electronic device can execute an application determined based on the content of a call, and based on the executed application, update information according to the content of the call. The electronic device can select and execute an application desired by the user, and input and display information desired by the user (e.g., schedule information, location information, and / or alarm information). According to one embodiment, the electronic device can automatically execute a specific application according to the user's needs during a phone call, and register and store a schedule (e.g., a task) desired by the user in response to gesture detection by an external electronic device linked to the electronic device. This can enhance the usability of the electronic device and external electronic devices (e.g., a wearable electronic device). A user can perform a desired task by simply inputting a gesture with the other hand while making a phone call while holding the electronic device in one hand. This can enhance the user's convenience in performing specific tasks during a phone call.

[0017] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0018] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. The features and advantages described above will be clearly understood based on the attached drawings and the description of the drawings.

[0019] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment of the present disclosure.

[0020] FIG. 2 is a diagram illustrating an embodiment of checking information displayed on an external electronic device (e.g., a wearable electronic device) while making a call using an electronic device according to one embodiment of the present disclosure.

[0021] FIG. 3 is a block diagram of an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0022] FIG. 4 is a flowchart illustrating a method for controlling an external electronic device in an electronic device according to one embodiment of the present disclosure.

[0023] FIG. 5 is a diagram illustrating an embodiment in which data is transmitted between an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0024] FIG. 6A is an example diagram in which at least one keyword is extracted based on call content according to one embodiment of the present disclosure.

[0025] FIG. 6b is an exemplary diagram illustrating a process of determining a main application among applications installed on an electronic device based on extracted keywords according to one embodiment of the present disclosure.

[0026] FIG. 7 is an exemplary diagram illustrating a process of performing a set function for an application in response to detection of a set gesture according to one embodiment of the present disclosure.

[0027] FIG. 8 is an exemplary diagram illustrating an operation performed on an external electronic device when a set application according to one embodiment of the present disclosure is an application related to schedule registration.

[0028] FIG. 9 is an exemplary diagram illustrating an operation performed on an external electronic device when a set application according to one embodiment of the present disclosure is a map-related application.

[0029] FIG. 10 is an exemplary diagram illustrating an operation performed on an external electronic device when the set application according to one embodiment of the present disclosure is an application related to alarm setting.

[0030] FIG. 11 is an exemplary diagram illustrating a user interface including a first application set as a main application and a second application set as a sub-application when there are multiple determined applications according to one embodiment of the present disclosure.

[0031] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0032] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0033] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0034] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0035] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0036] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0037] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0038] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0039] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0040] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0041] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0042] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0043] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0045] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0046] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0047] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0048] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0049] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0050] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0051] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0052] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0053] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0054] FIG. 2 is a diagram illustrating an embodiment (200) of checking information displayed on an external electronic device (e.g., a wearable electronic device) while making a call using an electronic device according to one embodiment of the present disclosure.

[0055] The electronic device (101) of FIG. 2 may be at least partially similar to the electronic device (101) of FIG. 1, or may further include other embodiments of the electronic device (101). The external electronic device (201) of FIG. 2 (e.g., a wearable electronic device, a wearable watch, and / or a watch-type electronic device) may be at least partially similar to the other electronic devices (102, 104) of FIG. 1, or may further include other embodiments of the other electronic devices (102, 104). In one embodiment, the electronic device (101) and the external electronic device (201) may include at least some similar components to the electronic device (101) of FIG. 1.

[0056] According to one embodiment, the electronic device (101) may be operatively or functionally connected to an external electronic device (201) and may transmit and receive signals and data therebetween. For example, the electronic device (101) may transmit a command to at least partially control the external electronic device (201), and based on the command, may at least partially control the functions and operations of the external electronic device (201).

[0057] Referring to FIG. 2, there may be a situation (200) in which a user (202) checks the screen of an external electronic device (201) (e.g., a wearable electronic device, a wearable watch, and / or a watch-type electronic device) while making a phone call using an electronic device (101). For example, the electronic device (101) and the external electronic device (201) may be in a state of being linked to each other, and the electronic device (101) may transmit data related to the call content to the external electronic device (201). The external electronic device (201) may generate a user interface corresponding to the size and shape of a display (e.g., a display of the external electronic device (201)) based on the data transmitted from the electronic device (101), and may display the generated user interface through the display. For example, the external electronic device (201) can at least partially detect a gesture of the user (202) (e.g., a movement of moving the external electronic device (201) closer to the user's line of sight to check the screen of the external electronic device (201) worn on the wrist). In response to detecting the gesture, the external electronic device (201) can activate the display of the external electronic device (201) so that a set user interface is displayed. The external electronic device (201) can be utilized as an output device to provide data related to the call content to the user (202). The electronic device (101) can be operatively or functionally connected to the external electronic device (201).

[0058] According to one embodiment, the electronic device (101) can, while being operatively or functionally connected to the external electronic device (201), at least partially control components (e.g., motion sensors, displays, processors) or functions of the external electronic device (201). For example, the electronic device (101) can detect movement of a body (e.g., wrist, arm) on which the external electronic device (201) is worn, and, in response to the detected movement, can at least partially control functions and operations of the external electronic device (201).

[0059] According to one embodiment, the electronic device (101) may activate an artificial intelligence model (e.g., an AI (artificial intelligence) model, an AI algorithm) for analyzing conversation content during a phone call, and analyze the conversation content based on the activated artificial intelligence model. The electronic device (101) may determine a specific application that meets the needs of the user (202) based on the analyzed conversation content. For example, if words related to schedules (e.g., expressions related to time, appointment, meeting, day of the week, and / or period) are relatively frequently identified in the conversation content, the user (202) may be in a conversation related to schedules and may want to execute an application for registering schedules. The electronic device (101) may determine a first application that meets the needs of the user (202) based on the artificial intelligence model, and transmit data related to the first application to the external electronic device (201) so that the determined first application is executed on the external electronic device (201).

[0060] According to one embodiment, the external electronic device (201) may activate the display and display the screen of the first application (e.g., the first application determined in the electronic device (101)) in response to detecting a set gesture (e.g., a gesture of raising the wrist). Referring to FIG. 2, during a phone call, the user (202) may check the screen of the first application related to the conversation content through the external electronic device (201) and determine registration of a schedule determined based on the conversation content. For example, when the external electronic device (201) displays a user interface corresponding to the first application on the display, the external electronic device (201) may display a user interface including schedule information (e.g., a meeting time, a meeting location, a meeting date, and / or schedule information) included in the conversation content.

[0061] According to one embodiment, the electronic device (101) can analyze conversation content in real time and change the application to be executed based on the conversation topic (e.g., keyword information related to the conversation content). The electronic device (101) can analyze conversation content periodically or aperiodically while the call function is being performed, and change and determine the application based on the analyzed results.

[0062] According to one embodiment, during a phone call, an electronic device can automatically launch a specific application determined based on the conversation content, and register and store a user-desired schedule (e.g., a task) in response to gesture detection by an external electronic device linked to the electronic device. This can enhance the usability of the electronic device and external electronic devices (e.g., a wearable electronic device) during a phone call. A user can easily perform a desired task by simply inputting a gesture with the other hand while holding the electronic device in one hand during a phone call. This can enhance the user's convenience in performing specific tasks during a phone call.

[0063] FIG. 3 is a block diagram of an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0064] The electronic device (101) of FIG. 3 may be at least partially similar to the electronic device (101) of FIG. 1 or may further include other embodiments of the electronic device (101). In one embodiment, the electronic device (101) may include at least partially similar components to the electronic device (101) of FIG. 1.

[0065] The external electronic device (201) of FIG. 3 may be at least partially similar to the other electronic devices (102, 104) of FIG. 1, or may further include other embodiments of the other electronic devices (102, 104). In one embodiment, the other electronic devices (102, 104) may include at least some similar components to the electronic device (101) of FIG. 1. The external electronic device (201) may include a wearable electronic device that is at least partially wearable on a part of a user's body (e.g., a wrist), as illustrated in FIG. 2.

[0066] Referring to FIG. 3, the electronic device (101) may include a processor (120) (e.g., the processor (120) of FIG. 1), a memory (130) (e.g., the memory (130) of FIG. 1), and / or a communication module (190) (e.g., the communication module (190) of FIG. 1). The memory (130) of the electronic device (101) may store an artificial intelligence model (311) (e.g., an AI algorithm) and / or conversation analysis information (312). The processor (120) of the electronic device (101) may at least partially activate the artificial intelligence model (311) (e.g., an AI-related model, an AI algorithm) and analyze conversation content based on the activated artificial intelligence model (311).

[0067] According to one embodiment, the processor (120) of the electronic device (101) may execute a program (e.g., program (140) of FIG. 1) stored in the memory (130) to control at least one other component (e.g., hardware or software component) and perform various data processing or calculations. For example, the processor (120) may activate an AI-related model for analyzing conversation content (e.g., an AI program for analyzing conversation content during a phone call, an artificial intelligence model (311)) installed in the memory (130) and perform an analysis function on the conversation content. The processor (120) may analyze the conversation content in real time based on the artificial intelligence model (311) and determine a specific application based on the analysis of the conversation content. According to one embodiment, the processor (120) may be operatively, functionally, and / or electrically connected to the memory (130) and / or the communication module (190). According to one embodiment, the processor (120) may include at least one processor including a processing circuit.

[0068] According to one embodiment, the memory (130) of the electronic device (101) may store an artificial intelligence model (311) (e.g., an AI algorithm) for analyzing conversation content and conversation analysis information (312) related to keywords included in the conversation content. For example, the processor (120) may activate an AI algorithm corresponding to the artificial intelligence model (311) during a phone call, and extract at least one keyword included in the conversation content of the phone call using the AI ​​algorithm. The conversation analysis information (312) may store application information set based on a keyword group including at least one keyword. For example, a first application (e.g., a calendar application, a schedule application, and / or an application related to schedule registration) may be set as an application corresponding to a first keyword group (e.g., a set of information including at least one keyword related to schedule registration). Information related to the first application may include words related to schedules (e.g., time, appointment, meeting, day of the week, and / or expressions related to duration) and may be stored in the conversation analysis information (312). For another example, a second application (e.g., a map application, an application related to places and locations) that is of a different type from the first application may be set as an application (e.g., a route finding application) corresponding to a second keyword group (e.g., a set of information including at least one keyword related to places). Information related to the second application may include words related to places (e.g., place names, street names, building names, addresses, and / or expressions related to locations) and may be stored in the conversation analysis information (312). Each application may have its own keyword group set. According to one embodiment, the memory (130) may store instructions that the processor (120) (e.g., at least one processor) executes individually or collectively.

[0069] According to one embodiment, the processor (120) may analyze the conversation content based on the artificial intelligence model (311) during a phone call and determine a specific application based on the analysis result. For example, the processor (120) may extract at least one keyword based on words and expressions included in the conversation content and check the number and frequency of the extracted keywords. The processor (120) may analyze the conversation content by utilizing data stored in the electronic device (101) (e.g., contact information, application usage patterns during a call, and / or call duration). The processor (120) may check the number of keywords included in the conversation content based on a first keyword group set based on a first application. For example, the electronic device (101) may check keywords extracted during a first set time and determine a keyword group that includes the largest number of the checked keywords. If the determined keyword group is the first keyword group, the processor (120) may determine a first application corresponding to the first keyword group. For example, the processor (120) can analyze the conversation content to determine the context of the conversation (e.g., the relationship between the user and the other party, the conversation topic, and / or the ending suffix). Based on the determined context of the conversation, the processor (120) can derive a task desired by the user (e.g., registering a schedule, searching for the location of a specific place, searching for a route to a specific place). According to one embodiment, the electronic device (101) can share information related to the determined first application with the external electronic device (201), and at least partially control the external electronic device (201) so that the first application is executed on the external electronic device (201).For example, the electronic device (101) may transmit information related to the determined first application to the external electronic device (201) in response to detection of a first gesture (e.g., a gesture of raising a wrist) through the external electronic device (201).

[0070] According to one embodiment, the processor (120) may transmit information related to the determined first application to an external electronic device (201) that is operatively or functionally connected thereto through the communication module (190). The processor (120) may at least partially control the external electronic device (201) such that a screen (e.g., a user interface) of the first application is output through the display (260) of the external electronic device (201). According to one embodiment, the electronic device (101) may receive a signal (e.g., a signal according to gesture detection) transmitted from the external electronic device (201) through the communication module (190), and in response to receiving the signal, may at least partially control a function and operation of the external electronic device (201).

[0071] According to one embodiment, the processor (120) can confirm detection of a set gesture through the external electronic device (201) and, in response to the confirmation, at least partially control the external electronic device (201) so that a set task is performed. For example, in a situation where a user checks a screen (e.g., a user interface) of a first application through a display (260) of the external electronic device (201), the user can make a gesture to perform a specific task. The electronic device (101), in response to detection of the gesture through the external electronic device (201), can process the set task based on the gesture.

[0072] Referring to FIG. 3, the external electronic device (201) may include a processor (220), a memory (230), a display (260), a communication module (290), and / or a motion sensor (321). The external electronic device (201) may include at least some components similar to or identical to those of the electronic device (101). According to one embodiment, the external electronic device (201) may be communicatively connected to the electronic device (101), receive first application-related information transmitted from the electronic device (101), and display an execution screen of the first application through the display (260). According to one embodiment, the external electronic device (201) may be at least partially controlled so that a specific function (e.g., a function or task related to a main application) is performed under the control of the electronic device (101). According to one embodiment, the processor (220) of the external electronic device (201) may be operatively, functionally, and / or electrically connected to a memory (230), a display (260), a communication module (290), and / or a motion sensor (321).

[0073] According to one embodiment, the processor (220) may include at least one processor including a processing circuit. According to one embodiment, the memory (230) may store instructions that the processors (220) (e.g., at least one processor) individually or collectively execute.

[0074] According to one embodiment, the external electronic device (201) may include a wearable electronic device (e.g., a wearable watch) that can be worn on a part of the user's body (e.g., a wrist). For example, the external electronic device (201) may detect the user's movement (e.g., a first gesture of raising the wrist, a second gesture of rotating the wrist in a set direction, and / or a third gesture of lowering the raised wrist) based on a motion sensor (321). For example, the motion sensor (321) may include various types of sensors (e.g., an acceleration sensor, a gyro sensor, and / or a proximity sensor) for detecting movement, motion, direction, posture, and / or shaking of the external electronic device (201).

[0075] According to one embodiment, the processor (220) of the external electronic device (201) can receive information related to a first application and output an execution screen of the first application through the display (260). For example, the processor (220) can detect a set gesture based on a motion sensor (321) and perform a set function based on the detected gesture. The gesture can include multiple gestures, and each function corresponding to each gesture can be set differently.

[0076] For example, the first gesture may include a gesture in which the wrist of the user wearing the external electronic device (201) is raised from the lower part of the body (e.g., the thigh position) to the upper part of the body (e.g., the chest position). In response to detecting the first gesture, the processor (120) may activate the display (260) and switch it from an OFF state to an ON state. In the activated state of the display (260), the processor (120) may display an execution screen (e.g., a user interface) of the first application, and information selected based on the conversation analysis information (312) may be input within the execution screen of the first application.

[0077] For another example, the second gesture may include a gesture (e.g., the 2-1 gesture and / or the 2-2 gesture) in which the user's wrist is rotated in one of a first direction (e.g., clockwise) and / or a second direction (e.g., counterclockwise) while being held at the top of the body. The 2-1 gesture may include a gesture in which the wrist is twisted along the first direction (e.g., clockwise), and the 2-2 gesture may include a gesture in which the wrist is twisted along a second direction (e.g., counterclockwise) opposite to the first direction. According to one embodiment, when the execution screen of the first application in which the selected information is input is displayed, the processor (220) of the external electronic device (201) may store the selected information in response to detecting the 2-1 gesture. For example, in response to detecting the 2-1 gesture, the processor (220) may generate a schedule according to the first application, and register (e.g., update) the selected information (e.g., meeting information, date information, and / or detailed information related to the schedule) in relation to the schedule. According to one embodiment, while the execution screen of the first application in which the selected information is input is displayed, the processor (220) of the external electronic device (201) may remove the selected information in response to detecting the 2-2 gesture. For example, in response to detecting the 2-2 gesture, the processor (220) may cancel a schedule according to the first application, and delete information related to the schedule (e.g., meeting information, date information, and / or detailed information related to the schedule).

[0078] For another example, the third gesture may include a gesture in which a wrist positioned at the upper part of the body (e.g., at the chest position) is lowered to the lower part of the body (e.g., at the thigh position). In response to detecting the third gesture, the processor (120) may deactivate the display (260) and switch it from an ON state to an OFF state. For example, when the execution screen of the first application is displayed, the processor (220) may deactivate the display (260) and terminate the execution of the first application.

[0079] According to one embodiment, the external electronic device (201) can detect a user's movement (e.g., movement of a wrist on which the external electronic device (201) is worn) using a motion sensor (321), and perform a specific action and / or a specific function set in response to the detected movement. The external electronic device (201) can transmit information related to the detected movement to the electronic device (101) in response to a situation in which the user's movement is detected (e.g., detection of a first gesture, detection of a second gesture, and / or detection of a third gesture).

[0080] According to one embodiment, the electronic device (101) may activate an artificial intelligence model (311) (e.g., an AI algorithm) for analyzing conversation content during a phone call, and may analyze the conversation content in real time based on the activated artificial intelligence model (311). For example, the electronic device may extract at least one keyword (e.g., conversation analysis information (312)) set based on words and expressions included in the conversation content, and may determine a specific application based on the extracted at least one keyword according to the conversation content. For example, if the conversation content is determined to be related to a schedule / event, the electronic device may determine an application for registering the schedule (e.g., a calendar application and / or a schedule application). As another example, if the conversation content is determined to be related to a location, the electronic device may determine an application for finding the corresponding location (e.g., a map application and / or a navigation application).

[0081] According to one embodiment, the electronic device (101) can detect a set gesture using an operatively connected external electronic device (201) (e.g., a wearable electronic device), and based on the detected gesture, perform a function corresponding to the determined application. For example, in a situation where a calendar application is determined, if a first gesture (e.g., a movement of lifting the wrist on which the external electronic device (201) is worn from the lower part of the body to the upper part of the body) is detected, the external electronic device (201) can activate the display (260) and display the execution screen of the calendar application. If a second gesture is detected after the detection of the first gesture, the external electronic device (201) can register or change schedule information extracted from the conversation content based on the running calendar application. For example, the external electronic device (201) may register the schedule information in response to detecting a 2-1 gesture in which the user's wrist rotates along a first direction (e.g., clockwise). For another example, the external electronic device (201) may cancel (e.g., not register) the schedule information in response to detecting a 2-2 gesture in which the user's wrist rotates along a second direction (e.g., counterclockwise) that is different from the first direction. According to one embodiment, the electronic device (101) may, in a state synchronized with the external electronic device (201), execute or not execute a specific function corresponding to the external electronic device (201) in response to detecting a gesture toward the external electronic device (201).

[0082] According to one embodiment, during a phone call, the electronic device (101) can determine a specific application (e.g., an application related to registering a schedule) according to the user's needs (e.g., the context of the conversation, the conversation topic, and / or keyword information included in the conversation), and can efficiently perform a task desired by the user while executing the determined specific application. The electronic device (101) can conveniently register a schedule according to the user's needs in response to state detection of an operatively connected external electronic device (201) (e.g., a change in the state of the external electronic device (201) due to a gesture). According to one embodiment, during a phone call, the usability of the electronic device (101) and the external electronic device (201) can be improved. When a user makes a phone call while holding an electronic device (101) in one hand, the electronic device (101) can detect a gesture of the other hand on which an external electronic device (201) is worn, and perform a specific function (e.g., task, schedule registration, location search) according to the detected gesture, thereby improving the user's convenience. When the user makes a phone call, the electronic device (101) can detect a gesture through the external electronic device (201) without the user's manipulation of the external electronic device (201), and easily perform a task (e.g., a set function) desired by the user.

[0083] According to one embodiment, the electronic device (101) may include a communication module (190) for connecting with an external electronic device (201), a processor (120) including a processing circuit, and a memory (130) for storing instructions. The instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to, when a call function is executed in response to a user input, activate an algorithm for conversation analysis, extract at least one keyword included in a conversation based on the activated algorithm for a set first time period while the call function is being executed, determine a first application based on the extracted at least one keyword, transmit information related to the determined first application and the at least one keyword to the external electronic device (201) in response to an operation of the external electronic device (201), and store information related to the at least one keyword based on the first application in response to termination of the call function.

[0084] According to one embodiment, the algorithm is characterized by extracting and selecting set keywords included in the conversation based on an artificial intelligence-related model (e.g., an AI model).

[0085] According to one embodiment, the instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to check the number of keywords corresponding to each keyword based on the conversation content during the set first time period, determine the priority of each of the applications installed in the electronic device (101) based on the checked number, and determine the first application based on the determined priority.

[0086] According to one embodiment, the instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to determine a second application that is different from the first application and has a lower priority than the first application based on the determined priority, and to transmit the determined second application and information related to the second application to the external electronic device (201) in response to an operation of the external electronic device (201).

[0087] According to one embodiment, the instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to check a plurality of time intervals set based on the first time, determine the first application based on a first keyword extracted from a first interval among the plurality of time intervals, and, in response to an operation of the external electronic device (201) corresponding to the first interval, transmit information related to the determined first application and the first keyword to the external electronic device (201).

[0088] According to one embodiment, the instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to determine a second application different from the first application based on a second keyword extracted from a second period among the plurality of time periods, which is different from the first period, and to transmit information related to the determined second application and the second keyword to the external electronic device (201) in response to an operation of the external electronic device (201) corresponding to the second period.

[0089] According to one embodiment, the instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to generate a command for executing the determined first application in response to detection of a first gesture through the external electronic device (201), and to transmit the generated command to the external electronic device (201) so that the first application is executed on the external electronic device (201).

[0090] According to one embodiment, the instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to update information related to the first application in response to detection of a second gesture via the external electronic device (201).

[0091] According to one embodiment, the instructions, when executed by the processor (120), may be configured to cause the electronic device (101) to generate a command for terminating the determined first application in response to detection of a third gesture through the external electronic device (201), transmit the generated command to the external electronic device (201), and store information related to the first application in the memory (130).

[0092] According to one embodiment, an external electronic device (201) may include a communication module (290) for connecting with an electronic device (101), a display (260), a motion sensor (321) for detecting a gesture, a processor (220) including a processing circuit, and a memory (230) for storing instructions. When the instructions are executed by the processor (220), the external electronic device (201) may be configured to activate the display (260) in response to detection of a set first gesture, acquire a first application determined in the electronic device (101) based on a conversation content according to a call function and information related to the first application from the electronic device (101), and display a first image corresponding to the first application through the display (260) based on the first application and the information related to the first application while the call function is running.

[0093] According to one embodiment, when the instructions are executed by the processor (220), the external electronic device (201) may be configured to update the first application based on information related to the first application in response to detection of the set second gesture.

[0094] According to one embodiment, when the instructions are executed by the processor (220), the external electronic device (201) may be configured to deactivate the display (260) in response to detection of the configured third gesture.

[0095] FIG. 4 is a flowchart illustrating a method for controlling an external electronic device in an electronic device according to one embodiment of the present disclosure.

[0096] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0097] According to one embodiment, operations 401 to 409 may be understood as being performed by a processor (e.g., the processor 120 of FIG. 3, a processing circuit, at least one processor) of an electronic device (e.g., the electronic device (101) of FIG. 3). The electronic device of FIG. 4 may be at least partially similar to the electronic device (101) of FIG. 3, or may further include other embodiments of the electronic device (101). According to one embodiment, the external electronic device (e.g., the external electronic device (201) of FIG. 3) referred to in operations 401 to 409 may be understood as being performed by a processor (e.g., the processor 220 of FIG. 3) of the external electronic device (201). For example, the external electronic device (201) may include a wearable electronic device that is at least partially wearable on a body part (e.g., a wrist) of a user, as illustrated in FIG. 2.

[0098] According to one embodiment, the electronic device (101) can analyze the conversation content during a phone call to determine the context of the conversation (e.g., the topic of the conversation) and determine a task desired by the user (e.g., a specific function for a specific application) based on the context of the conversation. For example, if the user has a conversation related to a meeting (e.g., an appointment) with the other party, the electronic device (101) can determine a calendar application for registering a schedule. The electronic device (101) can transmit information related to the determined specific application to an external electronic device (201) linked with the electronic device (101), and, in response to an operation of the external electronic device (201) (e.g., gesture detection), process a task set based on the determined specific application. For example, the electronic device (101) can register and store a schedule related to a meeting based on the calendar application in response to a request signal (e.g., a response signal based on gesture detection) from the external electronic device (201).

[0099] According to one embodiment, while on a call using an electronic device (101), a user can use an external electronic device (201) worn on the wrist to check the execution of a specific application related to the conversation content and confirm that a schedule has been recorded based on the conversation content. The user can process a set task (e.g., registering a schedule, saving a schedule) in the specific application by inputting a set gesture using the wrist on which the external electronic device (201) is worn. The user can more conveniently perform schedule registration during a phone call, and the usability of the electronic device (101) and the external electronic device (201) can be improved. The user's convenience can be improved when processing a set task during a phone call.

[0100] In operation 401, the processor (120) may activate an algorithm for conversation analysis in response to the execution of a call. For example, when the call function is executed, the electronic device (101) may determine whether to activate an artificial intelligence model for conversation analysis (e.g., the artificial intelligence model (311) and AI algorithm of FIG. 3). If the artificial intelligence model (311) is activated, the electronic device (101) may analyze the conversation content according to the call in real time. For another example, if the artificial intelligence model (311) is inactive, the electronic device (101) may not analyze the conversation content. According to one embodiment, the processor (120) may analyze the conversation content to determine the context of the conversation (e.g., the relationship between the user and the other party, the conversation subject, and / or the final ending), and may derive a task corresponding to the context of the conversation.

[0101] In operation 403, the processor (120) may extract keywords (e.g., words and / or expressions) included in the conversation based on the activated algorithm. For example, if the conversation content is related to schedule registration (e.g., meeting, appointment), the processor (120) may check a first keyword group (e.g., set information including at least one keyword related to schedule registration) corresponding to a first application (e.g., calendar application, schedule application, and / or application related to schedule registration). During a phone call, the processor (120) may determine whether at least one keyword included in the first keyword group is included in the conversation content based on the conversation content. If the conversation content includes at least one keyword included in the first keyword group, the processor (120) may extract the corresponding keyword.

[0102] In operation 405, the processor (120) may determine a first application (e.g., a main application) based on the extracted keyword. For example, if the extracted keyword is included in a first keyword group, the processor (120) may identify a first application corresponding to the first keyword group and determine the first application as the main application. For another example, if the extracted keyword is included in multiple keyword groups, the processor (120) may identify the number of words for the extracted keyword for each keyword group. The processor (120) may select a keyword group having a relatively larger number of words (e.g., the number of words for the extracted keyword) among the first keyword group and the second keyword group, and determine the application corresponding to the selected keyword group as the main application.

[0103] According to one embodiment, the electronic device (101) may extract at least one word set as a keyword based on conversation content for a set first period of time, and may identify a keyword group containing a relatively large number of words for the extracted words. For example, a keyword group containing a relatively large number of extracted words may have a higher priority than a keyword group containing a relatively small number of extracted words. An application with the highest priority (e.g., first priority) may be determined as the main application. When there are multiple keyword groups, the electronic device (101) may determine a priority corresponding to each keyword group. An application with the first priority may be set as the main application, and an application with a second priority, which corresponds to a priority relatively lower than the first priority, may be set as a sub-application. For example, the main application may include an application in which the corresponding keyword was most frequently mentioned in the conversation content and which meets the needs of the user.

[0104] According to one embodiment, the electronic device (101) can analyze conversation content in real time and determine a first application based on the analyzed conversation content. When the electronic device (101) continuously analyzes the conversation content and determines that the conversation topic of the conversation content has changed, the electronic device (101) can change the determined first application to a second application that matches the changed conversation topic. For example, the electronic device (101) can check a plurality of time sections (e.g., a first section and / or a second section) set according to a set first time. The electronic device (101) can determine the first application based on a first keyword extracted from the first section among the plurality of time sections. As another example, the electronic device (101) can determine the second application based on a second keyword extracted from a second section, which is different from the first section, among the plurality of time sections. The electronic device (101) can set a first application as the main application based on the first section, and can set a second application based on the second section. The electronic device (101) can provide information related to the first application to an external electronic device (201) in the first section, and can provide information related to the second application to the external electronic device (201) in the second section.

[0105] In operation 407, the processor (120) may transmit the determined first application (e.g., the main application) and information related to the keyword (e.g., specific schedule information included in the conversation content) to an external electronic device (201) (e.g., a wearable electronic device). For example, the electronic device (101) is operatively connected to the external electronic device (201) and may exchange signals and data with the external electronic device (201). The electronic device (101) may at least partially control the operation and function of the external electronic device (201). For example, the processor (120) may detect a movement (e.g., a gesture, a set gesture, a gesture of lifting the external electronic device (201)) with respect to the external electronic device (201), and in response to the detected movement, may transmit the determined first application and information related to the keyword to the external electronic device (201). According to one embodiment, the external electronic device (201) may be worn on a part of the user's body (e.g., a wrist) and may detect a set gesture (e.g., raising the wrist, twisting the wrist, lowering the wrist, a set action) using a motion sensor (e.g., the motion sensor (321) of FIG. 3). For example, the external electronic device (201) may be configured to perform a specific function (e.g., a set function) in response to a specific gesture (e.g., a set gesture). In response to detecting a gesture of raising the wrist, the external electronic device (201) may transmit information related to the gesture to the electronic device (101). For example, upon receiving information related to the gesture, the electronic device (101) may provide the determined first application and information related to the keyword to the external electronic device (201). The processor (120) can transmit information related to the determined first application and the keyword to the external electronic device (201) in response to a gesture detection signal through the external electronic device (201).The external electronic device (201) may, in response to detecting a gesture, periodically or aperiodically transmit information related to the gesture to the electronic device (101). According to one embodiment, the processor (120) may, in response to an operation of the external electronic device (201) (e.g., a situation of detecting a gesture for the external electronic device (201), transmit information related to the determined first application and at least one keyword to the external electronic device (201).

[0106] In operation 409, the processor (120) may store the determined first application and information related to the keyword in a memory (e.g., the memory (130) of FIG. 3). For example, the processor (120) may store the determined first application and information related to the keyword in the memory (130) in response to the detection of a gesture by the external electronic device (201). Storing in the memory (130) may mean registering or recording the information in the first application. For example, the external electronic device (201) may, in response to the detection of a wrist-twisting gesture, transmit a response signal to the electronic device (101) notifying that the wrist-twisting gesture has been detected. The electronic device (101) may, in response to receiving the response signal, register information related to the keyword. The processor (120) can store information related to the determined first application and the keyword in the memory (130) in response to a request signal from an external electronic device (201).

[0107] According to one embodiment, the electronic device (101) may analyze the conversation between the user and the other party during a phone call, and determine a specific application as the main application based on the analyzed conversation. The electronic device (101) may analyze the conversation during a set first period of time and determine a keyword group that was mentioned relatively the most frequently during the first period of time. For example, if keywords related to registering a schedule (e.g., meeting time, meeting location, meeting date, and / or schedule information) are relatively most frequently identified, the application for registering the schedule may be determined as the main application. The electronic device (101) may analyze the conversation periodically or aperiodically and change the settings of the main application in real time. For example, among multiple time intervals, the first application may be determined as the main application based on keywords extracted in the first interval. After the first interval, the main application may be changed from the first application to the second application based on keywords extracted in the second interval. According to one embodiment, the electronic device (101) can check at least one keyword in real time during a phone call and determine a specific application as the main application.

[0108] According to one embodiment, the electronic device (101) may transmit information related to the main application and the extracted keyword to an external electronic device (201) operatively connected thereto so that the main application is executed on the external electronic device. For example, the external electronic device (201) may include a wearable watch worn on a part of the user's body (e.g., a wrist) and may include a motion sensor (e.g., a motion sensor (321) of FIG. 3) for detecting the user's movement even during a phone call. The external electronic device (201) may set task processing according to at least one gesture so that a specific function is performed in response to a specific gesture.

[0109] For example, the external electronic device (201) may be configured to activate a display (e.g., display (260) of FIG. 3) and display an execution screen of a first application (e.g., main application) in response to a first gesture of lifting the wrist on which the external electronic device (201) is worn from the lower part of the body to the upper part of the body. The user may raise the wrist to check the screen of the external electronic device (201) during a phone call, and check the execution screen of the main application through the automatically activated display (260). When the external electronic device (201) displays the execution screen of the first application, it may display information related to the first application (e.g., schedule details, specific schedule information) in a state in which it is input on the execution screen.

[0110] For example, the external electronic device (201) may be configured to register a schedule input on the execution screen of the first application in response to a second gesture of twisting the wrist. The user on a call may check the schedule displayed through the display (260) of the external electronic device (201) and decide whether to perform the second gesture of twisting the wrist. For example, if the input schedule information is accurate, the user may perform a second-first gesture of twisting the wrist in a first direction (e.g., clockwise). The external electronic device (201) may register and store the schedule based on the input schedule information in response to detecting the second-first gesture. For another example, if the input schedule information is incorrect, the user may perform a second-second gesture of twisting the wrist in a second direction (e.g., counterclockwise). The external electronic device (201) may cancel the registration of the schedule in response to detecting the second-second gesture. The above input schedule information can be deleted in response to detection of the above 2-2 gesture.

[0111] For example, the external electronic device (201) may be configured to deactivate the display (260) in response to a third gesture of lowering the wrist on which the external electronic device (201) is worn from the upper part of the body to the lower part of the body. A user may raise the wrist to check the schedule during a phone call, and then lower the wrist after the schedule is confirmed. The external electronic device (201) may turn off the display (260) and terminate the first application (e.g., the main application) in response to detecting the third gesture of lowering the wrist.

[0112] According to one embodiment, the external electronic device (201) may be configured to process a set task in response to detection of a set gesture. According to one embodiment, the external electronic device (201) may, in response to detection of the set gesture, transmit a request signal to the electronic device (101) requesting processing of the task performed by the electronic device (101) so that the task is processed. The external electronic device (201) may, in response to detection of the set gesture, transmit a signal related to detection of the gesture to the electronic device (101).

[0113] FIG. 5 is a diagram illustrating an embodiment in which data is transmitted between an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0114] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0115] According to one embodiment, operations 501 to 507 may be understood to be performed by a processor (e.g., the processor 120 of FIG. 3) of an electronic device (e.g., the electronic device (101) of FIG. 3). The electronic device of FIG. 5 may be at least partially similar to the electronic device (101) of FIG. 3, or may further include other embodiments of the electronic device (101). According to one embodiment, operations 511 and 513 may be understood to be performed by a processor (e.g., the processor 220 of FIG. 3) of an external electronic device (e.g., the external electronic device (201) of FIG. 3). For example, the external electronic device (201) may detect a movement (e.g., a gesture) of a body (e.g., a wrist) on which the external electronic device (201) is worn using a motion sensor (e.g., the motion sensor (321) of FIG. 3), and may perform a set task in response to the detected movement. According to one embodiment, the electronic device (101) and the external electronic device (201) may be in a state of communication connection with each other and may transmit and receive signals and data to each other. The electronic device (101) may at least partially control the external electronic device (201) so that a task set in the external electronic device (201) is performed.

[0116] According to one embodiment, the electronic device (101) may have an artificial intelligence model (503) for analyzing conversation content (e.g., the artificial intelligence model (311) of FIG. 3, an AI program for analyzing conversation content, an AI algorithm) installed in a memory (e.g., the memory (130) of FIG. 3). When making a phone call, the electronic device (101) may at least partially activate the artificial intelligence model (503) and, based on the activated artificial intelligence model (503), may periodically or aperiodically analyze the conversation content.

[0117] In operation 501, the electronic device (101) may execute a phone call function to obtain the content of a user's conversation with the other party. For example, the electronic device (101) may obtain a user's voice signal using a microphone included in an input module (e.g., the input module (150) of FIG. 1). In operation 502, the electronic device (101) may convert the voice signal (e.g., the content of the conversation) into text, and in operation 504, may analyze the converted text. Operations 502 and 504 may be performed based on an activated artificial intelligence model (503). In operation 504, the electronic device (101) may extract at least one keyword included in the conversation content based on the artificial intelligence model (503), and may determine a main application based on the at least one extracted keyword. For example, the main application may include an application that provides a specific function (e.g., a task) to the user based on the analysis of the conversation content. The main application may include applications installed on the electronic device (101) and the external electronic device (201). According to one embodiment, the application may set a keyword group including at least one keyword. For example, the electronic device (101) may set a first keyword group corresponding to a first application, and a second keyword group corresponding to a second application different from the first application. When analyzing the conversation content, the electronic device (101) may extract at least one keyword included in each keyword group and check the number of extracted keywords.

[0118] According to one embodiment, the artificial intelligence model (503) can extract at least one keyword based on the conversation content and determine the context of the conversation based on the extracted at least one keyword. For example, the artificial intelligence model (503) can determine the relationship between the user and the other party, the conversation topic, and / or the sentence endings based on the conversation content, and can understand the context of the conversation based on the determined information. The artificial intelligence model (503) can derive a task required by the user based on the context of the conversation. For example, the electronic device (101) can use the artificial intelligence model (503) to determine an application desired by the user as the main application based on the context of the conversation, and determine the actions and functions desired by the user as tasks based on the main application. For example, if the main application is an application related to registering a schedule, the determined task may include a schedule registration operation. For example, if the main application is an application related to finding a location, the determined task may include a route finding operation for a location. According to one embodiment, the electronic device (101) can understand the context of a conversation based on the activated artificial intelligence model (503) and determine a task (e.g., a task tailored to the user's needs) based on the context of the conversation. The electronic device (101) can determine an application for performing the determined task as the main application, and can determine a specific function of the main application as the task.

[0119] According to one embodiment, the electronic device (101) may determine the application with the largest number of extracted keywords as the main application based on analysis of the conversation content. For example, if a relatively large number of keywords included in the first keyword group are extracted from the conversation content, it may be determined that the conversation topic is related to the first keyword group. Based on the number of extracted keywords, the electronic device (101) may set an application that meets the user's needs as the main application. The application execution module (505) of the electronic device (101) may process tasks related to setting and executing the main application. For example, the application execution module (505) may be implemented as either a hardware component or a software component in the electronic device (101).

[0120] In operation 511, the external electronic device (201) can maintain a display (e.g., display (260) of FIG. 3) in a turned-off state (e.g., OFF). For example, the external electronic device (201) can be worn on a part of the user's body (e.g., wrist) and can detect a gesture according to the movement of the user's wrist. The external electronic device (201) can maintain the display (260) in a turned-off state when a set gesture is not detected. When the external electronic device (201) is worn on the left wrist and the user is holding the electronic device (101) in the right hand and making a phone call, if the set gesture for the left wrist is not detected, the external electronic device (201) can maintain the display (260) in a turned-off state.

[0121] In operation 521, the external electronic device (201) may detect a first gesture (e.g., wrist-up) in which the user lifts the wrist (e.g., the wrist on which the external electronic device (201) is worn). The first gesture may include a movement in which the user lifts the wrist from the lower part of the body to the upper part of the body. In response to detecting the first gesture, the external electronic device (201) may transmit a request signal to the electronic device (101) requesting information related to the main application in order to obtain the information. For example, the processor (e.g., the processor (220) of FIG. 3) of the external electronic device (201) may request the application execution module (505) for information related to the main application.

[0122] In operation 522, the electronic device (101) may provide information related to the main application to an external electronic device (201) in response to the request signal. The electronic device (101) may transmit information (e.g., data) according to the request signal to the external electronic device (201) using a communication method (e.g., BT (Bluetooth) communication) in which the electronic device (101) and the external electronic device (201) are connected to each other.

[0123] In operation 513, the external electronic device (201) may turn on the display (260) and display an execution screen (e.g., a user interface) of the main application in response to obtaining information related to the main application. When the execution screen is displayed, the external electronic device (201) may input corresponding information into an input field of the execution screen based on the obtained information (e.g., data). For example, if the main application is an application related to schedule registration, the execution screen may include a user interface for registering a schedule, and specific schedule information may be entered into an input field included in the execution screen.

[0124] In operation 523, the external electronic device (201) may detect a second gesture (e.g., a twist) of the user twisting the wrist (e.g., the wrist on which the external electronic device (201) is worn). The second gesture may include a movement of rotating the display (260) of the external electronic device (201) along a set direction while the display (260) is turned on. For example, the second gesture may include a 2-1 gesture of rotating the wrist along a first direction (e.g., clockwise) and a 2-2 gesture of rotating the wrist along a second direction (e.g., counterclockwise) opposite to the first direction. The 2-1 gesture may include a command for processing a task (e.g., registering a schedule, saving a schedule) based on the running screen being displayed, and the 2-2 gesture may include a command for canceling the task (e.g., unregistering a schedule, canceling a schedule). The external electronic device (201) may register a new schedule based on the execution screen in response to detecting the 2-1 gesture. The external electronic device (201) may cancel the schedule entered on the execution screen without registering the schedule in response to detecting the 2-2 gesture. The second gesture in operation 523 may include the 2-1 gesture for registering a new schedule. The external electronic device (201) may transmit information related to the second gesture (e.g., information indicating that the second gesture has been detected) to the electronic device (101) in response to detecting the second gesture.

[0125] In operation 507, the external electronic device (201) may, in response to detecting the second gesture, update data for registering a new schedule based on the main application. If the main application is an application related to registering schedules, a new schedule may be registered, and if the main application is an application related to route finding, a new route finding may be registered.

[0126] According to one embodiment, the electronic device (101) and the external electronic device (201) transmit and receive data in response to detection of a specific gesture, but the present invention is not limited thereto. The electronic device (101) and the external electronic device (201) are in a state of communication connection with each other and can transmit and receive data even before a specific gesture is detected. For example, the electronic device (101) can transmit information related to the determined main application to the external electronic device (201) in response to the main application being determined based on the application execution module (505). The external electronic device (201) can preload the main application based on the information related to the main application, and when the first gesture is detected in operation 521, the external electronic device (201) can display the execution screen of the main application in the preloaded state through the display (260).

[0127] Although not shown, the external electronic device (201) may detect a third gesture (e.g., wrist down) in which the user lowers their wrist (e.g., the wrist on which the external electronic device (201) is worn) from the upper part of the body to the lower part of the body. The third gesture may include a command to switch the display (260) of the external electronic device (201) from an ON state (e.g., an activated state) to an OFF state (e.g., a deactivated state). In response to detecting the third gesture, the external electronic device (201) may turn off the display (260) and terminate the main application.

[0128] FIG. 6a is an exemplary diagram illustrating a process in which at least one keyword is extracted based on call content according to one embodiment of the present disclosure. FIG. 6b is an exemplary diagram illustrating a process in which a main application is determined among applications installed on an electronic device based on the extracted keyword according to one embodiment of the present disclosure.

[0129] The electronic device (101) of FIGS. 6A and 6B may be at least partially similar to the electronic device (101) of FIG. 1, or may further include other embodiments of the electronic device (101). According to one embodiment, the electronic device (101) may include at least partially similar components to the electronic device (101) of FIG. 1. The embodiment in which keywords are extracted as shown in FIG. 6A and the embodiment in which a main application is determined based on the extracted keywords as shown in FIG. 6B may be performed by the electronic device (101).

[0130] Referring to FIG. 6A, the electronic device (101) can obtain conversation content (601) during a set first time period during a phone call. For example, the electronic device (101) can obtain conversation content (601) periodically or aperiodically during a phone call, and can analyze the obtained conversation content (601). In response to a call request (e.g., during a phone call), the electronic device (101) can activate an artificial intelligence model (e.g., the artificial intelligence model (311) of FIG. 3) for analyzing conversation content, and can analyze the conversation content (601) based on the artificial intelligence model (311). The artificial intelligence model (311) can extract at least one keyword (611-616) included in the conversation content (601). For example, the electronic device (101) can set a keyword group corresponding to each of the applications installed in the electronic device (101) and check at least one keyword included in the set keyword group. The electronic device (101) can extract at least one keyword (611-616) included in the conversation content based on the activated artificial intelligence model (311). Referring to FIG. 6A, the at least one keyword (611-616) can include “restaurant” (611) and “there” (612) related to location, “no” (613) having a negative meaning, “where” (614) and “Suwon Starfield” (615) related to location, and / or “want to go?” (616) having a positive meaning. Referring to FIG. 6A, “when” and “around 7 o’clock” related to time, “no” having a negative meaning, and / or “later” having a positive meaning can also be included in the at least one keyword.

[0131] According to one embodiment, the electronic device (101) can extract at least one keyword included in the conversation content (601) and determine a main application based on the context of the conversation. For example, the electronic device (101) can determine a group of keywords with the highest number of extracted keywords, and determine an application corresponding to the determined keyword group as the main application.

[0132] FIG. 6B illustrates coding-related data (651) in a situation where a main application is determined based on at least one extracted keyword. Referring to FIG. 6B, the electronic device (101) can determine a priority for each task for each application based on the extracted keyword, and can determine the main application and the sub-application according to the determined priority. For example, the electronic device (101) can check an application (e.g., "schedule" application (661), "map" application (671)), a keyword corresponding to the application (e.g., date and time (662), "Suwon Starfield" (672)), a type of task (e.g., "create" (663), "view" (673)), and / or a priority of the application (e.g., "0" (664), "1" (674)) based on the extracted keyword. Referring to FIG. 6B, the applications are illustrated as a "schedule" application (661) and a "map" application (671), but are not limited thereto. The number of applications, the types of tasks, and the number of tasks are not limited to a specific number. The priorities (e.g., "0" (664), "1" (674)) are relative values, meaning that the "schedule" application (661) has a relatively higher priority than the "map" application (671). The electronic device (101) may determine the "schedule" application (661) as the main application, and may determine the "map" application (671) as a sub-application.

[0133] FIG. 7 is an exemplary diagram illustrating a process of performing a set function for an application in response to detection of a set gesture according to one embodiment of the present disclosure.

[0134] The external electronic device (201) of FIG. 7 may be at least partially similar to the other electronic devices (102, 104) of FIG. 1, or may further include other embodiments of the other electronic devices (102, 104). In one embodiment, the other electronic devices (102, 104) may include at least some components similar to the electronic device (101) of FIG. 1. The external electronic device (201) may include a wearable electronic device that is at least partially wearable on a part of a user's body (e.g., a wrist).

[0135] Referring to FIG. 7, the movement of the external electronic device (201) may refer to the movement of the user's wrist. The external electronic device (201) may detect a set gesture (e.g., movement) using a motion sensor (e.g., motion sensor (321) of FIG. 3). Referring to FIG. 7, a first gesture (701) in which a user lifts a wrist from a lower body to an upper body (e.g., wrist up), a second gesture (703) in which a display (e.g., display (260) of FIG. 3) of an external electronic device (201) rotates in a first direction (e.g., clockwise) while facing upward, a second gesture (705) in which a display (260) of an external electronic device (201) rotates in a second direction (e.g., counterclockwise) opposite to the first direction while facing upward, and / or a third gesture (707) in which a user lowers a wrist from an upper body to a lower body (e.g., wrist down) are illustrated. In one embodiment, the set gestures are not limited to the four gestures of FIG. 7.

[0136] The external electronic device (201) may activate (ON) the display (260) in response to detecting the first gesture (701), execute a first application (e.g., a main application), and display an execution screen of the first application. For example, if the first application is a schedule-related application, the execution screen may include a user interface for performing a specific task of the first application (e.g., registering a schedule and / or saving a schedule). When the execution screen is displayed, input fields included in the user interface may be displayed with specific schedule information entered. According to one embodiment, the first gesture (701) may be configured so that the first task is performed by activating the display (260) and displaying an execution screen of the main application (e.g., a user interface according to a set function).

[0137] The external electronic device (201) may update the first application in response to detecting the second-first gesture (703). For example, if the first application is a schedule-related application, specific schedule information of the displayed user interface may be registered as a new schedule. In one embodiment, the second-first gesture (703) may be configured to perform a second task in which data described on the execution screen of the main application (e.g., a user interface according to a set function) is registered and stored.

[0138] The external electronic device (201) may, in response to detecting the 2-2 gesture (705), terminate the first application, which is the main application, and execute the second application, which is the sub-application, while displaying the execution screen of the second application. For example, if the second application is a location-related application (e.g., a “map” application), the external electronic device (201) may display a user interface including a travel path from the current location to the destination and a travel time according to the travel path. According to one embodiment, the 2-2 gesture (705) may be configured to perform a third task in which the main application is terminated and an execution screen of the sub-application (e.g., a user interface according to a set function) is displayed.

[0139] The external electronic device (201) may, in response to detecting the third gesture (707), deactivate (OFF) the display (260) and terminate the first application (e.g., the application being displayed through the display (260)). For example, if the first application is a schedule-related application, the external electronic device (201) may be configured to, in response to detecting the third gesture (707), perform a fourth task of terminating the execution of the first application without creating a new schedule by the first application.

[0140] According to one embodiment, the electronic device (101) may, in response to detection of a set gesture (e.g., a first gesture (701) to a fourth gesture (707)) in the external electronic device (201), at least partially control the external electronic device (201) so that a set task is performed based on the set gesture. For example, in response to detection of the set gesture, the external electronic device (201) may transmit information related to the gesture to the electronic device (101). The electronic device (101) may perform the set task based on the information related to the gesture transmitted from the external electronic device (201). The electronic device (101) may, in performing the set task, at least partially control the function and operation of the external electronic device (201).

[0141] FIG. 8 is an exemplary diagram illustrating operations performed on an external electronic device when the set application according to one embodiment of the present disclosure is an application related to schedule registration. FIG. 9 is an exemplary diagram illustrating operations performed on an external electronic device when the set application according to one embodiment of the present disclosure is an application related to maps. FIG. 10 is an exemplary diagram illustrating operations performed on an external electronic device when the set application according to one embodiment of the present disclosure is an application related to alarm setting.

[0142] The external electronic device (201) of FIGS. 8 to 10 may be at least partially similar to the other electronic devices (102, 104) of FIG. 1, or may further include other embodiments of the other electronic devices (102, 104). In one embodiment, the other electronic devices (102, 104) may include at least some components similar to the electronic device (101) of FIG. 1. The external electronic device (201) may include a wearable watch that is at least partially wearable on a part of a user's body (e.g., a wrist).

[0143] Referring to FIG. 8, the external electronic device (201) may perform a first task (810) by activating a display (e.g., a display (260) of FIG. 3) in response to detecting a first gesture (e.g., a first gesture (701) of FIG. 7), and displaying a first screen (801) corresponding to the execution screen of a main application (e.g., a “schedule” application) through the display (260). The first screen (801) may include specific schedule information depending on the analysis result of the conversation content. For example, if the date “May 2” is confirmed in the conversation content, the external electronic device (201) may display the first screen (801) showing schedule information for the date “May 2.” The external electronic device (201) may perform a second task (820) of registering an appointment schedule with a conversation partner (e.g., “Amy”) in response to detecting a second gesture (e.g., the 2-1 gesture (703) of FIG. 7). The second screen (802) may be a screen in which a meeting with “Amy” on the date “May 2” is newly registered as a schedule, based on the analysis result of the conversation content. The external electronic device (201) may perform a third task (830) of terminating the main application while deactivating the display (260) in response to detecting a third gesture (e.g., the 3rd gesture (707) of FIG. 7). The third screen (803) may be a screen in which the display (260) is turned off.

[0144] Referring to FIG. 9, the external electronic device (201) may perform a first task (910) in response to detecting a first gesture (e.g., the first gesture (701) of FIG. 7), activating a display (e.g., the display (260) of FIG. 3), and displaying a first screen (901) corresponding to the execution screen of a main application (e.g., a “map” application) through the display (260). The first screen (901) may display a specific destination based on the analysis result of the conversation content. For example, if information related to “place and location” is confirmed in the conversation content, the external electronic device (201) may display the first screen (901) showing the specific “place and location.” The external electronic device (201) may perform a second task (920) in response to detecting a second gesture (e.g., the 2-1 gesture (703) of FIG. 7), displaying a movement route to the destination. The second screen (902) may be a screen that displays a route to a destination based on the analysis results of the conversation content. The external electronic device (201) may perform a third task (930) that terminates the main application while deactivating the display (260) in response to detection of a third gesture (e.g., the third gesture (707) of FIG. 7). The third screen (903) may be a screen where the display (260) is turned off.

[0145] Referring to FIG. 10, the external electronic device (201) may perform a first task (1010) in response to detecting a first gesture (e.g., the first gesture (701) of FIG. 7), activating a display (e.g., the display (260) of FIG. 3), and displaying a first screen (1001) corresponding to the execution screen of a main application (e.g., an “alarm” application) through the display (260). The first screen (1001) may display a specific alarm time according to the analysis result of the conversation content. For example, if information related to “alarm setting” is confirmed in the conversation content, the external electronic device (201) may display the first screen (1001) showing a specific “alarm time.” The external electronic device (201) may, in response to detecting a second gesture (e.g., the 2-1 gesture (703) of FIG. 7), set a new alarm according to the “alarm time” and perform a second task (1020) to display the set alarm information. The second screen (1002) may be a screen that displays the result of setting the alarm based on the analysis result of the conversation content. The external electronic device (201) may, in response to detecting a third gesture (e.g., the 3rd gesture (707) of FIG. 7), perform a third task (1030) to terminate the main application while deactivating the display (260). The third screen (1003) may be a screen in which the display (260) is turned off.

[0146] FIG. 11 is an exemplary diagram illustrating a user interface including a first application set as a main application and a second application set as a sub-application when there are multiple determined applications according to one embodiment of the present disclosure.

[0147] The external electronic device (201) of FIG. 11 may be at least partially similar to the other electronic devices (102, 104) of FIG. 1, or may further include other embodiments of the other electronic devices (102, 104). In one embodiment, the other electronic devices (102, 104) may include at least some components similar to the electronic device (101) of FIG. 1. The external electronic device (201) may include a wearable watch that is at least partially wearable on a part of a user's body (e.g., a wrist).

[0148] FIG. 11 may be a user interface displayed through a display (260) of an external electronic device (201). The external electronic device (201) may be operatively connected to the electronic device (101) and may be operated at least partially under the control of the electronic device (101). During a phone call, the electronic device (101) may determine a main application (e.g., a “schedule” application) and a sub-application (e.g., a “map” application) based on the conversation content, and may transmit first information related to the main application and second information related to the sub-application to the external electronic device (201).

[0149] Referring to FIG. 11, an external electronic device (201) can display a first user interface (1110) corresponding to a main application (e.g., a “schedule” application) and a second user interface (1120) corresponding to a sub-application (e.g., a “map” application) through a display (260) based on the first information and the second information.

[0150] For example, the first user interface (1110) may include an execution screen of a "schedule" application, which includes first task information (1111) for registering a new schedule. For example, the second user interface (1120) may include an execution screen of a "map" application, which includes second task information (1121) for confirming a specific location. Referring to FIG. 11, a user may check a user interface displayed through a display (260) of an external electronic device (201) and select one application from among a main application and a sub-application. For example, the external electronic device (201) may be set to have a first gesture for selecting a main application and a second gesture for selecting a sub-application. In response to detecting the first gesture, the external electronic device (201) may perform a first task (e.g., registering a new schedule) corresponding to the main application. The external electronic device (201) can perform a second task corresponding to the sub-application (e.g., viewing the location of “Woopan Deungsim”) in response to detection of the second gesture.

[0151] According to one embodiment, the electronic device (101) can determine a main application based on the conversation content during a phone call, and perform a task related to the determined main application in response to a gesture detection by an external electronic device (201) operatively connected to the electronic device (101). The user can easily control the electronic device (101) and the external electronic device (201) during a phone call based on the movement of the hand on which the external electronic device (201) is worn, so that a task desired by the user is performed. The usability of the electronic device (101) and the external electronic device (201) can be improved. According to one embodiment, the electronic device (101) can provide the user with a task (e.g., registering a schedule, executing a location finding function) tailored to the user's needs based on the conversation content during a phone call, and determine whether to perform the task in response to a gesture detection by the external electronic device (201). The electronic device (101) can analyze conversation content in real time and change the main application according to changes in the conversation context. During a phone call, the electronic device (101) can continuously provide tasks desired by the user. According to one embodiment, when a user is on a phone call, the usability of the electronic device (101) and the external electronic device (201) can be improved.

[0152] A method for controlling an external electronic device (201) by an electronic device (101) according to one embodiment may include: when a call function is executed in response to a user input, activating an algorithm for conversation analysis; extracting at least one keyword included in a conversation based on the activated algorithm for a set first time period while the call function is being executed; determining a first application based on the extracted at least one keyword; transmitting information related to the determined first application and the at least one keyword to the external electronic device (201) in response to an operation (e.g., gesture detection) of the external electronic device (201); and storing information related to the at least one keyword based on the first application in response to termination of the call function.

[0153] According to one embodiment, the operation of determining the first application may include an operation of checking the number of keywords corresponding to each keyword based on the conversation content during the set first time period, an operation of determining the priority of each of the applications installed on the electronic device based on the checked number, and an operation of determining the first application based on the determined priority.

[0154] A method according to one embodiment may further include an operation of determining a second application that is different from the first application and has a lower priority than the first application based on the determined priority, and an operation of transmitting the determined second application and information related to the second application to the external electronic device (201) in response to an operation of the external electronic device (201).

[0155] According to one embodiment, the operation of transmitting to the external electronic device (201) may include an operation of checking a plurality of time intervals set based on the first time, an operation of determining the first application based on a first keyword extracted from a first interval among the plurality of time intervals, and an operation of transmitting information related to the determined first application and the first keyword to the external electronic device (201) in response to an operation of the external electronic device (201) corresponding to the first interval.

[0156] According to one embodiment, the method may further include an operation of determining a second application different from the first application based on a second keyword extracted from a second period among the plurality of time periods, which is different from the first period, and an operation of transmitting information related to the determined second application and the second keyword to the external electronic device (201) in response to an operation of the external electronic device (201) corresponding to the second period.

[0157] A method according to one embodiment may further include an operation of generating a command for executing the determined first application in response to detection of a first gesture through the external electronic device (201), and an operation of transmitting the generated command to the external electronic device (201) so that the first application is executed on the external electronic device (201).

[0158] The method according to one embodiment may further include an action of updating information related to the first application in response to detection of a second gesture via the external electronic device (201).

[0159] According to one embodiment, a non-transitory computer-readable storage medium (or, computer program product) storing one or more programs for performing a method for controlling an external electronic device (201) by an electronic device (101) may be described. According to one embodiment, the one or more programs may include instructions that, when executed by a processor (120) of the electronic device (101), perform an operation of activating an algorithm for conversation analysis when a call function is executed in response to a user input; an operation of extracting at least one keyword included in a conversation based on the activated algorithm for a set first time period while the call function is being executed; an operation of determining a first application based on the extracted at least one keyword; an operation of transmitting information related to the determined first application and the at least one keyword to the external electronic device (201) in response to an operation of the external electronic device (201); and an operation of storing information related to the at least one keyword based on the first application in response to termination of the call function.

[0160] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0161] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0162] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0163] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0164] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0165] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), A communication module (190) for connecting with an external electronic device (201); a processor (120) including a processing circuit; and A memory (130) for storing instructions; When the above instructions are executed by the processor (120), the electronic device (101) causes: When the call function is triggered based on the user's input, it activates the algorithm for conversation analysis, During the first set time while the above call function is running, at least one keyword included in the conversation is extracted based on the activated algorithm, Based on at least one keyword extracted above, determine the first application, In response to the operation of the external electronic device (201), transmit information related to the determined first application and the at least one keyword to the external electronic device (201), An electronic device, in response to termination of the call function, storing information related to the at least one keyword based on the first application.

2. In paragraph 1, An electronic device characterized in that the above algorithm extracts and selects set keywords included in the above conversation based on an artificial intelligence-related model (AI model).

3. In paragraph 1, When the above instructions are executed by the processor (120), the electronic device (101) causes: Based on the conversation content during the first hour set above, check the number of words corresponding to each of the at least one keyword, Based on the number of words confirmed above, the priority of each application installed in the electronic device (101) is determined, An electronic device that determines the first application based on the determined priority.

4. In paragraph 3, When the above instructions are executed by the processor (120), the electronic device (101) causes: Based on the above-determined priority, a second application is determined that is different from the first application and has a lower priority than the first application, An electronic device that transmits the determined second application and information related to the second application to the external electronic device (201) in response to the operation of the external electronic device (201).

5. In paragraph 1, When the above instructions are executed by the processor (120), the electronic device (101) causes: Check multiple time intervals set based on the above first time, Determine the first application based on the first keyword extracted from the first section among the plurality of time sections, An electronic device that, in response to an operation of the external electronic device (201) corresponding to the first section, transmits information related to the determined first application and the first keyword to the external electronic device (201).

6. In paragraph 5, When the above instructions are executed by the processor (120), the electronic device (101) causes: Based on a second keyword extracted from a second period among the plurality of time periods, which is different from the first period, a second application different from the first application is determined, An electronic device that, in response to an operation of the external electronic device (201) corresponding to the second section, transmits information related to the determined second application and the second keyword to the external electronic device (201).

7. In paragraph 1, When the above instructions are executed by the processor (120), the electronic device (101) causes: In response to detection of a first gesture through the external electronic device (201), a command is generated for execution of the determined first application, The generated command is transmitted to the external electronic device (201) so that the first application is executed on the external electronic device (201), An electronic device that updates information related to the first application in response to detection of a second gesture through the external electronic device (201).

8. In paragraph 7, When the above instructions are executed by the processor (120), the electronic device (101) causes: In response to detection of a third gesture through the external electronic device (201), a command is generated for terminating the determined first application, Transmit the generated command to the external electronic device (201), An electronic device that stores information related to the first application in the memory (130).

9. In the external electronic device (201), A communication module (290) for connecting with an electronic device (101); display (260); Motion sensor (321) for detecting gestures; a processor (220) including a processing circuit; and A memory (230) for storing instructions; When the above instructions are executed by the processor (220), the external electronic device (201) causes: In response to detection of the set first gesture, activate the display (260), Based on the conversation content according to the call function, the first application determined in the electronic device (101) and information related to the first application are acquired from the electronic device (101), An external electronic device that displays a first image corresponding to the first application through the display (260) based on the first application and information related to the first application while the call function is running.

10. In paragraph 9, When the above instructions are executed by the processor (220), the external electronic device (201) causes: In response to detection of the configured second gesture, updating the first application based on information related to the first application; An external electronic device that, in response to detection of a configured third gesture, deactivates the display (260).

11. In a method for controlling an external electronic device (201) by an electronic device (101), When the call function is triggered based on user input, an action is taken to activate an algorithm for conversation analysis; An operation of extracting at least one keyword included in a conversation based on the activated algorithm during a first set time while the above call function is running; An operation of determining a first application based on at least one keyword extracted above; In response to the operation of the external electronic device (201), an operation of transmitting information related to the determined first application and the at least one keyword to the external electronic device (201); and A method comprising: in response to termination of the call function, storing information related to the at least one keyword based on the first application; 12. In paragraph 11, The action of determining the above first application is: An operation of checking the number of corresponding keywords based on the conversation content during the first set time period; An operation of determining the priority of each of the applications installed on the electronic device based on the above-mentioned number; and A method comprising: an operation of determining the first application based on the determined priority; 13. In paragraph 12, An operation of determining a second application that is different from the first application and has a lower priority than the first application based on the determined priority; and A method further comprising: an operation of transmitting the determined second application and information related to the second application to the external electronic device (201) in response to an operation of the external electronic device (201); 14. In paragraph 11, The operation of transmitting to the above external electronic device (201) is as follows: An operation of checking multiple time intervals set based on the above first time; An operation of determining the first application based on a first keyword extracted from a first section among the plurality of time sections; and A method comprising: an operation of transmitting information related to the determined first application and the first keyword to the external electronic device (201) in response to an operation of the external electronic device (201) corresponding to the first section; 15. In paragraph 11, An action of generating a command for executing the determined first application in response to detection of a first gesture through the external electronic device (201); An operation of transmitting the generated command to the external electronic device (201) so that the first application is executed on the external electronic device (201); and A method further comprising: an operation of updating information related to the first application in response to detection of a second gesture through the external electronic device (201);

Citation Information

Patent Citations

  • System for providing user oriented recommendation service

    KR1020130033505A

  • Apparatus for providing service during call and method for using the apparatus

    KR1020150088532A

  • The wearble device and control method thereof

    KR1020160015693A

  • Mobile device and, the method thereof

    KR1020170046969A

  • Apparatus for providing animal-assisted therapy for dementia patient

    KR1020220152810A