Electronic device, method, and non-transitory storage medium for providing information related to call intent by using artificial intelligence model

Abstract

The present document relates to an electronic device, method, and non-transitory storage medium for providing information related to a call intent by using an artificial intelligence model. According to an embodiment, the electronic device may comprise: a display; a communication circuit; at least one processor including processing circuitry; and a memory storing instructions. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to: on the basis of receiving, from an external electronic device through the communication circuit, a request to connect a phone call, receive first information related to an intent of the phone call from the external electronic device; on the basis of identification information of a user of the external electronic device, acquire data related to user identification information of the external electronic device or the first information; on the basis of transmitting the first information and the data to an artificial intelligence model, identify second information related to the intent of the phone call acquired using the artificial intelligence model; and while receiving the request to connect the phone call, display, through the display, the second information on a first execution screen of an application for connecting the phone call. Various other embodiments are also possible.

Description

Electronic device, method, and non-transient storage medium for providing information related to call intent using an artificial intelligence model

[0001] The present disclosure relates to an electronic device, a method, and a non-transient storage medium for providing information related to a call intention using an artificial intelligence model.

[0002] Various services and additional functions provided through electronic devices, such as portable electronic devices like smartphones, are gradually increasing. To enhance the utility value of these devices and satisfy the needs of diverse users, telecommunications service providers or electronic device manufacturers are competitively developing devices to offer various functions and differentiate themselves from competitors. Consequently, the various functions provided through electronic devices are also becoming increasingly sophisticated.

[0003] Electronic devices can provide services (e.g., programs or applications) for users to make phone calls with another party. Recently, electronic devices have utilized artificial intelligence (AI) models to enable users to select a call partner and conduct a phone call through applications related to phone calls.

[0004] Meanwhile, the electronic device may utilize artificial intelligence models to provide various services. At least some of the various AI models for various services may be implemented as AI assistant models and / or generative AI models that provide conversational services. Depending on the implementation, the AI ​​models may operate in a form where multiple AI models are connected.

[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0006] The present document may provide an electronic device, a method, and a non-transient storage medium that, when performing a telephone call, use an artificial intelligence model to obtain first information related to a call intention based on context information of a user of a transmitting electronic device, and transmit the obtained first information related to a call intention to a receiving electronic device.

[0007] This document may provide an electronic device, a method, and a non-transient storage medium for providing a receiver with second information obtained using an artificial intelligence model based on first information and the receiver's context information at a receiving electronic device.

[0008] According to one embodiment of the present disclosure, an electronic device may include at least one processor comprising a display, a communication circuit, and a processing circuit, and a memory for storing instructions.

[0009] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to receive first information related to the intention of the telephone call from the external electronic device based on receiving a request to connect a telephone call from the external electronic device through the communication circuit.

[0010] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire user identification information of the external electronic device or data related to the first information based on user identification information of the external electronic device.

[0011] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to verify second information related to the intent of the telephone call obtained using the artificial intelligence model based on transmitting the first information and the data to the artificial intelligence model.

[0012] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display the second information on a first execution screen of an application for connecting the phone call through the display while receiving a request to connect the phone call.

[0013] According to one embodiment, a method of operation in an electronic device may include receiving first information related to the intention of the telephone call from an external electronic device based on receiving a request to connect a telephone call from an external electronic device through a communication circuit of the electronic device.

[0014] According to one embodiment, a method of operation in an electronic device may include an operation of obtaining user identification information of the external electronic device or data related to the first information based on user identification information of the external electronic device.

[0015] According to one embodiment, a method of operation in an electronic device may include an operation of verifying second information related to the intention of the telephone call obtained using the artificial intelligence model, based on transmitting the first information and the data to the artificial intelligence model.

[0016] According to one embodiment, a method of operation in an electronic device may include an operation of displaying the second information on a first execution screen of an application for connecting the phone call through a display of the electronic device while receiving a request to connect the phone call.

[0017] According to one embodiment, in a non-transient storage medium storing one or more programs, the one or more programs may include an operation in which, when executed by at least one processor of an electronic device, the electronic device receives first information related to the intention of the telephone call from the external electronic device based on receiving a request to connect a telephone call from the external electronic device through a communication circuit of the electronic device.

[0018] According to one embodiment, the one or more programs may include an operation in which, when executed by at least one processor of an electronic device, the electronic device acquires user identification information of the external electronic device or data related to the first information based on user identification information of the external electronic device.

[0019] According to one embodiment, the one or more programs may include an operation to verify second information related to the intention of the telephone call obtained using the artificial intelligence model, based on transmitting the first information and the data to the artificial intelligence model, when executed by at least one processor of the electronic device.

[0020] According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of displaying the second information on a first execution screen of an application for connecting the phone call through a display of the electronic device while receiving a request to connect the phone call.

[0021] According to one embodiment, the electronic device may include at least one processor including a display, a communication circuit, and a processing circuit, and a memory for storing instructions.

[0022] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device can identify the counterparty requesting the call connection based on confirming the request for a call connection of a telephone call.

[0023] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device can obtain identification information of the counterpart and data about the counterpart.

[0024] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device can obtain first information regarding the intention of the telephone call based on transmitting the identification information and the data to an artificial intelligence model.

[0025] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may transmit the first information to the external electronic device based on requesting the call connection of the telephone call to the external electronic device of the counterparty.

[0026] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be able to display second information related to the intention of the telephone call based on the first information through the display of the external electronic device while requesting a call connection of the telephone call.

[0027] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0028] FIG. 2 is a drawing showing an example of the configuration of a first electronic device according to one embodiment.

[0029] FIG. 3 is a drawing showing an example of the configuration of a second electronic device according to one embodiment.

[0030] FIG. 4 is a diagram illustrating an example of generating summary information about a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0031] FIGS. 5A, FIGS. 5B, and FIGS. 5C are drawings illustrating examples for providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0032] FIG. 6 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0033] FIGS. 7a and 7b are drawings illustrating an example of providing summary information on a call intention to a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0034] FIG. 8 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0035] FIG. 9 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0036] FIG. 10 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0037] FIG. 11 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0038] FIG. 12 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0039] FIG. 13 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0040] FIG. 14 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0041] FIG. 15 is a diagram illustrating an example of transmitting a message to a first electronic device indicating that a request for a telephone call connection is not accepted from a second electronic device according to one embodiment.

[0042] FIG. 16 is a diagram illustrating an example of an operation method for providing summary information on a call intention in a first electronic device according to one embodiment.

[0043] FIG. 17 is a diagram illustrating an example of an operation method for providing summary information on a call intention in a second electronic device according to one embodiment.

[0044] FIG. 18 is a diagram illustrating an example for providing summary information on a call intention in a first electronic device according to one embodiment.

[0045] FIG. 19 is a diagram illustrating an example for providing summary information on a call intention in a second electronic device according to one embodiment.

[0046] FIG. 20 is a diagram illustrating an example of user authentication for providing summary information on call intentions in a second electronic device according to one embodiment.

[0047] FIG. 21 is a diagram illustrating an example for providing summary information on a call intention in a second electronic device according to one embodiment.

[0048] FIG. 22 is a perspective view showing the structure of an electronic device according to one embodiment.

[0049] FIGS. 23a, FIGS. 23b and FIGS. 23c are perspective views showing the structure of an electronic device according to one embodiment.

[0050] FIG. 24 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device for telephone calls according to one embodiment.

[0051] FIG. 25 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device for telephone calls according to one embodiment.

[0052] FIG. 26 is a diagram illustrating an example of providing summary information on a call intention in a second electronic device for a telephone call according to one embodiment.

[0053] FIG. 27 is a block diagram illustrating a generative artificial intelligence system according to one embodiment.

[0054] FIG. 28 is a block diagram showing an artificial intelligence framework (AI framework) according to one embodiment.

[0055] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0056] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity. The term "user" as used in the embodiments of the present disclosure may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0057] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0058] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0059] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0060] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0061] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0062] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0063] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0064] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0065] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0066] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0067] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0068] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0069] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0070] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0071] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0072] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0073] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0074] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0075] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0076] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0077] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0078] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0079] FIG. 2 is a drawing showing an example of the configuration of a first electronic device according to one embodiment.

[0080] Referring to FIG. 2, a first electronic device (201) according to one embodiment (e.g., the electronic device (101) of FIG. 1) may be a transmitting device for making a phone call with an external electronic device (e.g., the electronic device (102 or 104) of FIG. 1 or the second electronic device (301) of FIG. 3). The first electronic device (201) according to one embodiment may include at least one processor (210), a memory (220), a display (230), a camera circuit (240), a communication circuit (250), a microphone circuit (260) including two or more microphones, and a speaker (270). Not limited thereto, the electronic device (201) may be implemented identically or similarly to the electronic device (101) of FIG. 1 and may further include other components of the electronic device (101) of FIG. 1. In addition, the electronic device (201) may be configured to include other components necessary for the method of operation of the present disclosure. An electronic device (201) according to one embodiment may be a device that provides a screen based on images of an external environment captured in real time, or a device that provides the external environment as is. For example, the electronic device (201) may be a smartphone or a device configured to be worn on a user's body (e.g., a head-mounted display (HMD) or a glasses-type AR glasses device). For example, the electronic device (201) may be configured to combine with an external electronic device, such as a mobile device, and may utilize components of the external electronic device (e.g., the electronic device (102 or 104) of FIG. 1) (e.g., a display module, a camera module, an audio output module, or other components). Not limited thereto, the electronic device (201) may be configured in various forms.

[0081] An electronic device (210) according to one embodiment may be configured in an on-device form including an artificial intelligence model (e.g., AI assistant). Not limited thereto, the electronic device (210) may be configured to use an artificial intelligence model included in a server (e.g., server (108) of FIG. 1).

[0082] Referring to FIG. 2, a processor (210) of an electronic device (201) according to one embodiment (e.g., processor (120) of FIG. 1) can learn in advance information related to application execution, history information related to user activity (e.g., activity topic, person or function information), or user input information obtained directly or indirectly from applications executed on the electronic device (201) (e.g., phone call, contact, SMS, calendar, navigation application, or various other applications) using an artificial intelligence model, and store it as related data in a designated database (e.g., related data database) of memory (220). For example, the related data may include information detected through a camera circuit (440) or at least one sensor.

[0083] According to one embodiment, the processor (210) can identify the call recipient (e.g., second user or recipient) to be called by a user (e.g., first user, call requester, or caller) based on the user inputting or selecting the call recipient (e.g., second user or recipient) to be called by phone through an application related to phone calls. For example, the processor (210) can select the call recipient from a list of pre-stored contacts (e.g., phone numbers) provided through an application related to phone calls. For example, the processor (210) can select a contact (e.g., phone number) provided on the screen of another running application (e.g., conversation message application, search application, shopping application, video playback application, navigation, or various other applications providing contacts) as the call recipient. For example, the processor (210) can identify a contact (e.g., phone number) entered through an application related to phone calls as the call recipient.

[0084] According to one embodiment, the processor (210) may display a screen (e.g., a first screen) for a phone call with a confirmed call recipient through a display (230). For example, the processor (210) may display an object on the first screen that allows the user to select whether to provide summary information when requesting a phone call with the call recipient. For example, when the processor (210) confirms the call recipient, it may automatically generate summary information using an artificial intelligence model, and when requesting a phone call with the call recipient, it may automatically transmit the generated summary information.

[0085] According to one embodiment, the processor (210) may obtain (e.g., detect or collect) information necessary to generate summary information. The processor (210) may obtain identification information of the caller (e.g., name, phone number, introduction message, or profile image) and / or pre-learned relationship data related to the caller from memory (220). The processor (210) may obtain relationship data by inferring call intent using an artificial intelligence model.

[0086] According to one embodiment, the processor (210) may transmit identification information of the caller and / or relationship data related to the caller to an artificial intelligence model. According to one embodiment, the artificial intelligence model may generate summary information (hereinafter referred to as the first summary information) regarding the caller's call intention, who is the call requester, based on the identification information of the caller and / or relationship data related to the caller.

[0087] According to one embodiment, the processor (210) can verify (e.g., receive or acquire) first summary information regarding a call intention generated by an artificial intelligence model. According to one embodiment, if relationship data related to the caller is not detected, the processor (210) can acquire the summary information generated by the artificial intelligence model as the first summary information using only the identification information of the caller. According to one embodiment, if relationship data related to the caller is not detected, the processor (210) provides a guidance message to directly input information (e.g., text or image) to be included in the summary information (e.g., displaying a guidance message on a first screen or outputting a guidance message through a speaker), and transmits the information directly entered by the caller to the artificial intelligence model as an input prompt along with the identification information, thereby acquiring the summary information generated from the artificial intelligence model based on the information directly entered by the caller and the identification information as the first summary information.

[0088] According to one embodiment, the processor (210) can display first summary information about the call intention on a first screen.

[0089] According to one embodiment, when the processor (210) receives a call request from a call recipient, it may request a connection of the phone call to an external electronic device (e.g., a second electronic device) which is the call recipient's electronic device. According to one embodiment, when the processor (210) requests a connection of the phone call, it may transmit first summary information to the external electronic device through a communication circuit (250).

[0090] According to one embodiment, the processor (210) may establish a call connection with an external electronic device and execute a phone call with the external electronic device based on identifying that a phone call has been accepted. According to one embodiment, when the phone call is terminated, the processor (210) may store data learned during the execution of the phone call and a first summary information as relationship data of the call recipient in memory. According to one embodiment, based on identifying that the phone call has been terminated, the processor (210) may add information about the execution of the call, including the identification information of the call recipient, the first summary information mapped to the identification information of the call recipient, and the call summary information, to a call record list (e.g., a recent call record list).

[0091] According to one embodiment, the processor (210) may receive a message regarding the rejection of a phone call from an external electronic device through the communication circuit based on identifying that the phone call has been rejected. Based on identifying that the phone call has been rejected, the processor (210) may add information regarding the rejection of a call to a call record list, including identification information of the caller, first summary information mapped to the identification information of the caller, and / or a message regarding the rejection of the received phone call.

[0092] According to one embodiment, the processor (210) may be a hardware component (function) or a software element (program) comprising at least one component provided in the electronic device (201), such as a hardware module or a software module (e.g., an application program). According to one embodiment, the processor (210) may include, for example, one or more combinations of hardware, software, or firmware. The processor (210) may be configured to omit at least some of the components or to include additional components for performing image processing operations in addition to the components.

[0093] According to one embodiment, the memory (220) (e.g., the memory (130) of FIG. 1) may store applications. For example, the memory (220) may store applications (functions or programs) related to phone calls, relational data learned using an artificial intelligence model, and a designated database (e.g., a relational data database). The memory (220) may store an artificial intelligence model (AI) model. The memory (220) may store images captured through at least one camera included in an external electronic device or camera circuit (240), audio information detected through two or more microphones, and information detected through at least one sensor. The memory (220) may store summary information generated using an artificial intelligence model (e.g., first summary information). The memory (220) may store information related to phone calls (e.g., a contact list, a list of recent call records, or caller identification information). The memory (220) may store information related to a call received from a second electronic device (e.g., call summary information or a message regarding a call rejection). The memory (220) may include a database that stores context information learned from an artificial intelligence model.

[0094] According to one embodiment, the memory (220) may store various data generated during the execution of the program (140), including a program used for functional operation (e.g., the program (140) of FIG. 1). For example, the memory (220) may include a program (140) area and a data area (not shown). The program (140) area may store related program information for operating the electronic device (201), such as an operating system (OS) (e.g., the operating system (142) of FIG. 1) that boots the electronic device (201). The data area (not shown) may store transmitted and / or received data and generated data according to various embodiments. Additionally, the memory (220) may be configured to include at least one storage medium among flash memory, hard disk, multimedia card micro type memory (e.g., secure digital (SD) or extreme digital (XD) memory), RAM, and ROM.

[0095] According to one embodiment, a display (230) (e.g., the display module (160) of FIG. 1) may display a screen for a phone call (e.g., a first screen) under the control of a processor (410). The display (230) may display summary information regarding a call intention (e.g., first summary information) generated by an artificial intelligence model on the screen for a phone call. When a phone call is rejected, the display (230) may display a message regarding the rejection of the call received from a second electronic device on the screen for a phone call. When a phone call is terminated, the display (230) may display a phone call summary information. The display (230) may display a screen (e.g., a second screen) related to a function (e.g., a program or application) necessary to obtain additional information for creating or editing the summary information. The display (230) may display a screen containing a contact list for selecting a call recipient through an application related to a phone call. When confirming a call recipient, the display (230) may display a screen of another application containing contacts.

[0096] According to one embodiment, the display (230) may be implemented in the form of a touch screen. When the display (230) is implemented in the form of a touch screen together with an input module, it can display various information generated according to the user's touch actions. According to one embodiment, the display (230) may be composed of at least one of an LCD (liquid crystal display), a TFT-LCD (thin film transistor LCD), an OLED (organic light emitting diodes), an LED, an AMOLED (active matrix organic LED), a flexible display, and a 3-dimensional display. Additionally, some of these displays may be configured to be transparent or light-transmitting so that the outside can be seen through them. This may be configured in the form of a transparent display including a TOLED (transparent OLED). According to one embodiment, in addition to the display (230), other display modules (e.g., an expansion display or a flexible display) may be further included.

[0097] According to one embodiment, the camera circuit (240) (e.g., the camera module (180) of FIG. 1) may include at least one camera and may capture images necessary for learning relational data. The camera circuit (240) may capture images (e.g., 2D images or 3D images) of the external environment so that the actual external environment is displayed through a display in a real space (e.g., virtual reality space, augmented reality space, or mixed reality space) or on a screen corresponding to the real space (e.g., to display a screen). The configuration and operation of at least one camera included in the camera circuit (240) may be the same or similar to the camera configuration of a wearable device such as AR glasses or a head-mounted device (HMD).

[0098] According to one embodiment, a communication circuit (250) (e.g., the communication module (190) of FIG. 1) may communicate with an external electronic device for phone calls (e.g., a second electronic device), a server (e.g., the server (108) of FIG. 1), or another electronic device for detecting user activity. For example, the communication circuit (250) may transmit a request for a phone call connection to an external electronic device for phone calls and transmit first summary information upon the connection request. The communication circuit (250) may transmit and receive messages for establishing a phone call connection with the external electronic device. When a phone call is rejected, the communication circuit (250) may receive a message regarding the rejection of the phone call from the external electronic device. According to one embodiment, the communication circuit (450) may include a cellular module, a Wi-Fi (wireless-fidelity) module, a Bluetooth module, or a near field communication (NFC) module.

[0099] According to one embodiment, a microphone circuit (260) (e.g., input module (150) of FIG. 1) includes at least one microphone and can receive sound (e.g., voice) information for learning relationship data through at least one microphone. According to one embodiment, the microphone circuit (260) can receive sound information of a user (e.g., caller) input through at least one microphone when a phone call is executed.

[0100] According to one embodiment, a speaker (270) (e.g., the sound output module (155) of FIG. 1) can output sound information corresponding to the generated first summary information. According to one embodiment, the speaker (270) can output sound information corresponding to a conversation message output from an artificial intelligence model (e.g., an AI assistant). According to one embodiment, the speaker (270) can output sound information corresponding to a guidance message related to a phone call. According to one embodiment, the speaker (270) can output sound information received from an external electronic device (e.g., a second electronic device) when a phone call is executed.

[0101] FIG. 3 is a drawing showing an example of the configuration of a second electronic device according to one embodiment.

[0102] Referring to FIG. 3, an electronic device (301) according to one embodiment (e.g., the electronic device (102 or 104) of FIG. 1) (hereinafter referred to as the second electronic device) may be an electronic device of a recipient for telephone communication with an external electronic device (e.g., the electronic device (102, 104) of FIG. 1 or the first electronic device (201) of FIG. 2). The second electronic device (301) according to one embodiment may include at least one processor (310), a memory (320), a display (330), a camera circuit (340), a communication circuit (350), a microphone circuit (360) including two or more microphones, and a speaker (370). Not limited thereto, the second electronic device (301) may further include other components. In addition, the second electronic device (301) may be configured to include other components necessary for the method of operation of the present disclosure.

[0103] A second electronic device (301) according to one embodiment may be a device that provides a screen based on images of an external environment captured in real time, or a device that provides the external environment as is. For example, the second electronic device (301) may be a smartphone or a device configured to be worn on a user's body (e.g., a head-mounted display (HMD) or an AR glasses device). For example, the second electronic device (301) may be configured to combine with an external electronic device such as a mobile device, and may utilize components of the external electronic device (e.g., the electronic device (101) of FIG. 1) (e.g., a display module, a camera module, an audio output module, or other components). Not limited thereto, the second electronic device (301) may be implemented in various forms.

[0104] Referring to FIG. 3, a processor (310) of a second electronic device (301) according to one embodiment may learn in advance information related to application execution, history information related to user activity (e.g., activity topic, person or function information), or information related to user input information obtained directly or indirectly from various applications (e.g., phone call, contact, SMS, calendar, navigation application, or other applications) executed on the second electronic device (301) using an artificial intelligence model, and store this information as context information (e.g., relationship data) in a designated database (e.g., context database) of memory (320). For example, the context information (e.g., relationship data) may include information detected through a camera circuit (440) or at least one sensor.

[0105] According to one embodiment, when the processor (310) receives a request to connect a telephone call from an external electronic device (hereinafter referred to as the first electronic device (201)) through a communication circuit, it may receive first information related to a call intention for a telephone call from the first electronic device (201).

[0106] According to one embodiment, the processor (310) can, upon receiving a request to connect a phone call, identify the caller's identification information (e.g., name, phone number, introduction message, or profile image) and, based on the caller's identification information and / or the received first information, obtain data related to the caller from context information stored in memory (220).

[0107] According to one embodiment, the processor (310) may transmit the caller's identification information and / or data related to the caller to an artificial intelligence model. According to one embodiment, the artificial intelligence model may generate information related to the recipient's call intention (hereinafter referred to as second information) based on the caller's identification information and / or data related to the caller. Here, the second electronic device (301) may be configured as an on-device containing the artificial intelligence model or configured to use the artificial intelligence model included in a server (e.g., server (108) of FIG. 1).

[0108] According to one embodiment, the processor (310) can verify (e.g., receive or acquire) second information related to a call intention generated by an artificial intelligence model. According to one embodiment, if relationship data related to the call requester is not detected, the processor (310) can acquire second information by the artificial intelligence model using only the received first information. According to one embodiment, if the processor (310) does not receive first summary information from the first electronic device (201), the processor (310) can acquire second information related to a call intention by the artificial intelligence model using only data related to the caller acquired based on the recipient's identification information.

[0109] According to one embodiment, the processor (310) may display an execution screen of an application for a call connection (hereinafter referred to as the first execution screen) through the display (330) based on receiving a request for a call connection from the first electronic device (201). According to one embodiment, the processor (310) may display second information on the first execution screen.

[0110] According to one embodiment, when the processor (310) receives a request to connect a phone call, it may display an object (e.g., a menu or a button) for verifying second information related to the call intention on a first execution screen. According to one embodiment, the processor (310) may display second information related to the call intention through a display (330) via user authentication. Here, the second information may include text, image, or sound (e.g., voice) information. For example, if the second information includes only text, an artificial intelligence model may generate image or sound information corresponding to the text, and the generated image may be displayed or the sound information may be output through a speaker (370).

[0111] According to one embodiment, the processor (310) may establish a call connection with the first electronic device (201) and execute a phone call with the first electronic device (201) based on identifying that a request for a phone call has been accepted. According to one embodiment, when the phone call is terminated, the processor (310) may store the data learned during the execution of the phone call and the first summary information as relationship data of the call requester in the memory (320). According to one embodiment, based on identifying that the phone call has been terminated, the processor (310) may add information regarding the execution of the phone call, including the identification information of the call requester, second information mapped to the identification information of the call requester, and information summarizing the content of the call, to a call record list (e.g., latest call record list).

[0112] According to one embodiment, the processor (310) may obtain situational information regarding the rejection of a phone call connection request based on identifying that a phone call connection request has been rejected, generate a message regarding the rejection of the call based on the obtained situational information, and transmit the generated message regarding the rejection of the call to the first electronic device (201) through the communication circuit (250). Here, the rejection of a phone call connection request may indicate that the recipient rejects the phone call connection request or that the response to the phone call connection request is delayed.

[0113] According to one embodiment, the processor (310) may add information about a missed call to a call record list (e.g., a recent call record list), including identification information of the caller, second summary information mapped to identification information of the caller, and an object representing the missed call, based on identifying that the phone call was rejected.

[0114] According to one embodiment, the processor (310) may be a hardware component (function) or a software element (program) comprising at least one component provided in the electronic device (301), such as a hardware module or a software module (e.g., an application program). According to one embodiment, the processor (310) may include, for example, one or more combinations of hardware, software, or firmware. The processor (310) may be configured to omit at least some of the components or to include additional components for performing image processing operations in addition to the components.

[0115] According to one embodiment, the memory (320) (e.g., the memory (130) of FIG. 1) may store applications. For example, the memory (320) may store applications (functions or programs) related to phone calls, relational data learned using an artificial intelligence model, and a designated database (e.g., a relational data database). The memory (320) may store an artificial intelligence model (AI) model. The memory (320) may store images captured through at least one camera included in an external electronic device or camera circuit (340), audio information detected through two or more microphones, and information detected through at least one sensor. The memory (320) may store summary information generated using an artificial intelligence model (e.g., first summary information). The memory (320) may store information related to phone calls (e.g., a contact list, a list of recent call records, or caller identification information). The memory (320) may store information related to a call received from a second electronic device (e.g., call summary information or a message regarding a call rejection). The memory (320) may include a database that stores context information learned from an artificial intelligence model.

[0116] According to one embodiment, the memory (320) may store various data generated during the execution of the program (140), including a program used for functional operation (e.g., the program (140) of FIG. 1). For example, the memory (320) may include a program (140) area and a data area (not shown). The program (140) area may store related program information for operating the electronic device (301), such as an operating system (OS) that boots the electronic device (301) (e.g., the operating system (142) of FIG. 1). The data area (not shown) may store transmitted and / or received data and generated data according to various embodiments. Additionally, the memory (320) may be configured to include at least one storage medium among flash memory, hard disk, multimedia card micro type memory (e.g., secure digital (SD) or extreme digital (XD) memory), RAM, and ROM.

[0117] According to one embodiment, the display (330) may display a screen for a phone call (e.g., a first screen) under the control of the processor (310). The display (330) may display summary information regarding a call intention (e.g., first summary information) generated by an artificial intelligence model on the screen for the phone call. When a phone call is rejected, the display (330) may display a message regarding the call rejection received from a second electronic device on the screen for the phone call. When a phone call is terminated, the display (330) may display a phone call summary information. The display (330) may display a screen (e.g., a second screen) related to a function (e.g., a program or application) necessary to obtain additional information for generating or editing the summary information. The display (330) may display a screen containing a contact list for selecting a call recipient through an application related to the phone call. When confirming a call recipient, the display (330) may display a screen of another application containing contacts.

[0118] According to one embodiment, the display (330) may be implemented in the form of a touch screen. When the display (330) is implemented in the form of a touch screen together with an input module, it can display various information generated according to the user's touch actions. According to one embodiment, the display (230) may be composed of at least one of an LCD (liquid crystal display), a TFT-LCD (thin film transistor LCD), an OLED (organic light emitting diodes), an LED, an AMOLED (active matrix organic LED), a flexible display, and a 3-dimensional display. Additionally, some of these displays may be configured to be transparent or light-transmitting so that the outside can be seen through them. This may be configured in the form of a transparent display including a TOLED (transparent OLED). According to one embodiment, in addition to the display (330), other display modules (e.g., an expansion display or a flexible display) may be further included.

[0119] According to one embodiment, the camera circuit (340) may include at least one camera and may capture images necessary for learning relational data. The camera circuit (340) may capture images (e.g., 2D images or 3D images) of the external environment so that the actual external environment is displayed through a display in a real space (e.g., virtual reality space, augmented reality space, or mixed reality space) or on a screen corresponding to the real space (e.g., to display a screen). The configuration and operation of at least one camera included in the camera circuit (340) may be the same or similar to the camera configuration of a wearable device such as AR glasses or a head-mounted device (HMD).

[0120] According to one embodiment, the communication circuit (350) may communicate with an external electronic device for phone calls (e.g., a first electronic device), a server (e.g., a server (108) of FIG. 1), or another electronic device for detecting user activity. For example, the communication circuit (350) may transmit a request for a phone call connection to an external electronic device for phone calls and transmit a first summary information upon the connection request. The communication circuit (350) may transmit and receive messages for establishing a phone call connection with the external electronic device. When a phone call is rejected, the communication circuit (350) may receive a message regarding the rejection of the phone call from the external electronic device. According to one embodiment, the communication circuit (350) may include a cellular module, a Wi-Fi (wireless-fidelity) module, a Bluetooth module, or a near field communication (NFC) module.

[0121] According to one embodiment, the microphone circuit (360) includes at least one microphone and can receive sound (e.g., voice) information for learning relationship data through at least one microphone. According to one embodiment, the microphone circuit (360) can receive sound information of a user (e.g., caller) input through at least one microphone when a phone call is executed.

[0122] According to one embodiment, the speaker (370) can output sound information corresponding to the generated first summary information. According to one embodiment, the speaker (370) can output sound information corresponding to a conversation message output from an artificial intelligence model (e.g., an AI assistant). According to one embodiment, the speaker (370) can output sound information corresponding to a guidance message related to a phone call. According to one embodiment, the speaker (370) can output sound information received from an external electronic device (e.g., a first electronic device) when a phone call is executed.

[0123] FIG. 4 is a diagram illustrating an example of generating summary information about a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0124] Referring to FIGS. 2, 3, and 4, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can identify the input or selected recipient based on the user (e.g., a caller or a call requester) inputting or selecting the recipient (e.g., a user or a call target) to perform a phone call through an application related to a phone call. Hereinafter, for convenience of explanation, the user of the first electronic device (210) will be referred to as the caller.

[0125] According to one embodiment, the first electronic device (201) checks the recipient's identification information (e.g., name, phone number, introduction message, or profile image) entered by the sender or stored in memory (220), and based on the recipient's identification information, can obtain data related to the recipient (e.g., relationship data) from context information stored in memory (220).

[0126] According to one embodiment, the first electronic device (201) can transmit the recipient's identification information and acquired data related to the recipient to the artificial intelligence model (410). The first electronic device (201) can set the recipient's identification information and data related to the recipient as an input prompt through the processor (210) or the artificial intelligence assistant model (e.g., preprocessing model) of the artificial intelligence model (410), and transmit the set input prompt to the generative artificial intelligence model (e.g., LLM (large language model), LVM (large vision model), or LMM (large multimodal model)) of the artificial intelligence model (410). The artificial intelligence model (410) can generate information related to the caller's call intention (e.g., summary information) (hereinafter referred to as the first information) based on the recipient's identification information and data related to the recipient. The artificial intelligence model (410) can further generate information related to the call based on information acquired through at least one sensor or camera in the current situation (e.g., detected sensing information).

[0127] According to one embodiment, the processor (210) can display an execution screen of an application for a phone call with a confirmed call recipient (hereinafter referred to as the first execution screen) through a display (230) (operation 401). For example, when requesting a phone call with a recipient, the processor (210) can display an object on the first execution screen that allows the processor to select whether to provide first information related to the call intention. For example, when the processor (210) confirms a recipient, it can automatically generate first information related to the call intention using an artificial intelligence model (410), and when requesting a phone call with a call recipient, it can automatically transmit the generated first information.

[0128] According to one embodiment, the first electronic device (201) displays first information generated by an artificial intelligence model (410) on a first execution screen and, when requesting a connection for a phone call to an external electronic device (hereinafter referred to as the second electronic device (301)), can transmit the first information to the second electronic device (301) through a communication circuit (250) (401 operation). For example, when the first electronic device (201) receives a request to edit the first information displayed on the first execution screen, it can modify the first information.

[0129] According to one embodiment, when the second electronic device (301) receives a request to connect a phone call from the first electronic device (201), it may receive first information related to a call intention for a phone call from the first electronic device (201) (403 operation).

[0130] According to one embodiment, the second electronic device (301) can identify the caller's identification information (e.g., name, phone number, introduction message, or profile image) based on receiving a request to connect a phone call, and can obtain data related to the caller (e.g., relationship data) from context information stored in memory (320) based on the caller's identification information and / or the received first information. The second electronic device (301) can further obtain information (e.g., detected sensing information) obtained through at least one sensor or camera in the current situation to obtain information related to the call intention.

[0131] According to one embodiment, the second electronic device (301) transmits the caller's identification information and data related to the caller to the artificial intelligence model (420) so that the artificial intelligence model (420) can verify information related to a call intention (hereinafter referred to as the second information) obtained (e.g., generated) based on the caller's identification information and / or data related to the caller. The second electronic device (301) may be configured in an on-device form including the artificial intelligence model (420) or configured to use an artificial intelligence model included in a server.

[0132] According to one embodiment, the second electronic device (301) can verify (e.g., receive or acquire) second information related to a call intention obtained from an artificial intelligence model (420) and display the second information on an execution screen of an application for a phone call (e.g., a first execution screen). The second electronic device (301) can output sound (e.g., voice) information corresponding to the second information through a speaker (370). Here, the second information may include text, image, or sound information. For example, if the second information includes only text, the artificial intelligence model (420) may generate image or sound information corresponding to the text, and the generated image may be displayed through a display (330) or the sound information may be output through a speaker (370).

[0133] According to one embodiment, the second electronic device (301) may transmit second information to the first electronic device (201) while requesting a phone call connection. While requesting a phone call connection, the first electronic device (201) may display second information related to the intent of the phone call based on the first information on a first execution screen through the display of the external electronic device. Not limited thereto, the second information may not be received or displayed depending on the settings.

[0134] According to one embodiment, the second electronic device (301) can obtain information (situation information) regarding the situation in which a request for a phone call connection is not accepted by using a camera or at least one sensor based on identifying that a request for a phone call connection is not accepted. The second electronic device (301) can generate a message (e.g., a message indicating that a request for a phone call connection is not accepted) based on the situation information obtained using an artificial intelligence model (420), and can transmit the generated message to the first electronic device (201) through a communication circuit (250) (405 operation).

[0135] According to one embodiment, the first electronic device (201) can display a message regarding a call rejection received from the second electronic device (301) on the first execution screen (407 operation).

[0136] According to one embodiment, the second electronic device (301) can establish a phone call connection with the first electronic device (201) and execute a phone call function with the first electronic device (201) based on identifying that a request for a phone call connection has been accepted.

[0137] FIGS. 5A, FIGS. 5B, and FIGS. 5C are drawings illustrating examples for providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0138] Referring to FIG. 5a, according to one embodiment, when a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) receives a phone call request from a caller, it can identify a topic (e.g., travel) for a phone call with a recipient (e.g., Kim) based on contextual information (e.g., application history information) related to various applications of the caller (e.g., Hong). For example, contextual information related to the execution (e.g., action) of various applications can be obtained by using images and text included in the execution screen of the application while constantly tracking by an artificial intelligence model (e.g., AI assistant) and stored in memory in advance.

[0139] According to one embodiment, the first electronic device (201) can use an artificial intelligence model (e.g., AI assistant) to identify context information of at least one application (e.g., calendar or navigation) (511, 512) related to a topic (travel), and obtain data (521, 522) related to a recipient (Kim) from the identified context information. For example, the first electronic device (201) can identify travel schedule information with the recipient (e.g., “November 3, 2024 Geoje trip with Kim Samsung”) (521) related to travel through the calendar (511) as data related to the recipient, and obtain travel route information (e.g., navigation image) (522) related to the recipient through the navigation (512).

[0140] According to one embodiment, the first electronic device (201) can obtain first information (501) related to a call intention (e.g., information summarizing a call intention to pick up before a trip to Geoje based on a route from Geoje trip + to the recipient's home) based on data (521, 522) related to the recipient and identification information of the recipient using an artificial intelligence model (410) (e.g., LMM (Large language model)). The first electronic device (201) can transmit the first information (501) to the second electronic device (301) upon a call connection request (e.g., a call event).

[0141] According to one embodiment, a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) may receive first information (501) from the first electronic device (201) upon a request for a phone call connection (e.g., a call event). The second electronic device (301) may identify the caller's identification information and the first information, and based on the caller's identification information and the first information, identify a topic (e.g., travel) according to the caller's intention to make a phone call, identify context information of at least one application (e.g., a calendar or app browser) (531, 532) related to the topic, and obtain data (541, 542) related to the caller (Hong) from the identified context information. For example, the first electronic device (201) can check travel schedule information with the recipient (e.g., “November 3, 2024, Geoje trip with Hong Gil-dong”) (541) in relation to travel through a calendar (531) as data related to the sender, and can obtain information searched through an app browser (532) (e.g., data from a search for how to get from the sender’s house to Geoje Island) (542) as data related to the sender.

[0142] According to one embodiment, the second electronic device (201) transmits the acquired data related to the caller and the received first information to an artificial intelligence model (420), and checks the second information (505) (e.g., "from Hong Gil-dong, it seems you called regarding a pick-up issue before traveling to Geoje") generated (e.g., acquired) by the artificial intelligence model (420), and can display the confirmed second information (505) on the execution screen of the phone call application (e.g., the first execution screen) through the display (330). The user of the second electronic device (201) (e.g., the recipient (Kim)) can more accurately confirm the caller's intention to call by considering both the context information related to the caller and the context information related to the recipient through the second information displayed on the first execution screen.

[0143] Referring to FIG. 5b, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can identify a topic (e.g., travel) based on context information (e.g., application history information) related to various applications of a sender (e.g., Hong).

[0144] According to one embodiment, the first electronic device (201) can use an artificial intelligence model (e.g., AI assistant) to identify contextual information of at least one application (e.g., calendar, navigation, web search, phone banking) related to a topic (travel), and obtain data related to the recipient (Kim) from the identified contextual information. For example, the first electronic device (201) can use an artificial intelligence model (e.g., AI assistant) to identify travel schedule information with the recipient (e.g., “November 28 travel (Geoje)”, “Pick-up at 8-9 o’clock”) related to travel through a calendar as data related to the recipient, identify travel route information (e.g., route to Kim Sam-seong’s house or route to Geoje) related to the recipient through navigation as data related to the recipient, identify accommodation information through a web search, and obtain travel cost information (e.g., “Accommodation cost settlement”) related to the recipient (Kim) as data related to the recipient (Kim).

[0145] According to one embodiment, the first electronic device (201) can check the first information (507) (e.g., “November 28 trip (Geoje), pickup at 8-9 o’clock, accommodation cost settlement”) obtained (e.g., generated) by the artificial intelligence model (410) based on data related to the recipient (Kim), and display the first information (507) on the first execution screen (510) through the display (330).

[0146] According to one embodiment, the first electronic device (201) can transmit the first information (507) to the second electronic device (301) upon a telephone call connection request (e.g., a call event).

[0147] According to one embodiment, a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) may receive first information (507) from the first electronic device (201) upon a phone call connection request (e.g., a call event). According to one embodiment, the second electronic device (301) may display a query (551) entered through interaction between the user and the artificial intelligence model (420) upon a phone call connection request (e.g., a call event) (e.g., user input information such as "What phone is this?" or touch input to an object representing the query) on the first execution screen (530).

[0148] According to one embodiment, the second electronic device (301) obtains data (503) related to the caller (e.g., 11 / 9 trip (Geoje), morning train ticket search, Geoje Island best 5 search) from context information pre-learned in the second electronic device (301), and based on the received first information (507) and the data related to the caller (503), obtains (e.g., generates) second information (553) related to the caller's call intention by an artificial intelligence model (420) as an answer to a query (551), and can display the second information (553) on the first execution screen (530). The data related to the caller (503) and the data related to the receiver may be data related to the movement paths of the caller and the receiver. At this time, if there is contradictory data among the data of the caller / receiver side, the artificial intelligence model (420) (e.g., AI assistant) may inform the user that reconfirmation is required regarding the confirmed topic.

[0149] Referring to FIG. 5c, according to one embodiment, a second electronic device (201) can display first information (561) received from the first electronic device (201) (e.g., “Sender summary information (Hong Gil-dong): Going on a trip with Kim Sam-seong on November 8, checked navigation route to Kim Sam-seong’s house”) and second information (562) generated by the artificial intelligence model (420) (e.g., “Recipient summary information (Kim Sam-seong): Going on a trip with Hong Gil-dong on November 8, searched the internet for how to get to Geojedo”) on the first execution screen (e.g., “Recipient summary information (Kim Sam-seong): Going on a trip with Hong Gil-dong on November 8”) for user interaction on the execution screen (e.g., second execution screen) (560). The second electronic device (201) can display these on the second execution screen (560). Here, the second execution screen (560) may be related to an action that explains the output of input to a specific AI model in an unvisualized background.

[0150] According to one embodiment, the second electronic device (201) can verify a query (e.g., “Infer Hong Gil-dong’s intention to call Kim Sam-seong based on the information above”) (563) entered by a user (e.g., recipient) based on first information and second information, display the verified query (563) on a second execution screen (560), generate an answer (564) to the entered query (563) using a generative artificial intelligence model (e.g., LLM or LMM) included in an artificial intelligence model (420) (e.g., AI assistant), and display the generated answer (564) (e.g., “Hong Gil-dong likely intended to contact Kim Sam-seong about a trip tomorrow. He likely called for details or final confirmation needed for the trip preparation. Also, since Hong Gil-dong has already confirmed the route to Kim Sam-seong’s house, he may have called to share or discuss this part.”) on the second execution screen (560). The second electronic device (201) can output sound (e.g., voice) information corresponding to the answer (564) through the speaker (370).

[0151] FIGS. 6, FIGS. 7a, and FIGS. 7b are drawings illustrating examples of providing summary information regarding a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0152] Referring to FIG. 6, according to one embodiment, a second electronic device (301) can use an artificial intelligence model (420) or a processor (e.g., the processor (310) of FIG. 3) to compare first information (601) received from a first electronic device (201) (e.g., “Sender summary information (Hong Gil-dong): Went on a trip with Kim Sam-seong on November 8, checked navigation route to Kim Sam-seong’s house”) and second information (602) generated by the artificial intelligence model (420) (e.g., “Recipient summary information (Kim Sam-seong): Went on a trip with Hong Gil-dong on November 8, searched the internet for how to get to Geojedo”) to determine whether there is a discrepancy between the two pieces of information. The second electronic device (301) can identify discrepancies (611) between the first information (601) and the second information (602) (e.g., discrepancies between November 8 and November 9).

[0153] According to one embodiment, while receiving a request to connect a phone call, the second electronic device (301) checks for third information (603) obtained (e.g., generated) by an artificial intelligence model (420) based on the discrepancy (611) between the first information (601) and the second information (602), and can display the third information (603) on the first execution screen (530) of the application related to the phone call through a display (330).

[0154] Referring to FIG. 7a, according to one embodiment, a second electronic device (301) can display first information (711) received from a first electronic device (201) (e.g., “Sender summary information (Hong Gil-dong): Went on a trip with Kim Sam-sung on November 8, checked navigation route to Kim Sam-sung’s house”) and second information (712) generated by the artificial intelligence model (420) (e.g., “Recipient summary information (Kim Sam-sung): Went on a trip with Hong Gil-dong on November 9, searched the internet for how to get to Geojedo”) on a first execution screen using a processor (e.g., processor (310) of FIG. 3) or an artificial intelligence model (420). The second electronic device (301) can display this on a second execution screen (710). According to one embodiment, the second electronic device (301) can compare the first information (711) and the second information (712) to check for any discrepancies between the two pieces of information. The second electronic device (301) can identify inconsistencies in information (731) between the first information (711) and the second information (712) (e.g., inconsistencies between November 8 and November 9) and can reflect graphic elements indicating the inconsistencies in the identified inconsistencies in information (731). Here, the second execution screen (710) may be involved in an action describing the output of input to a specific AI model in a non-visualized background.

[0155] According to one embodiment, the second electronic device (301) can verify a query (e.g., “Infer Hong Gil-dong’s intention to call Kim Sam-seong based on the information above”) (713) entered by a user (e.g., recipient) based on the first information and the second information, display the verified query (713) on the second execution screen (710), generate an answer (721) to the entered query (713) using a generative artificial intelligence model (e.g., LLM or LMM) included in the artificial intelligence model (420) (e.g., AI assistant), and display the generated answer (721) (e.g., “Hong Gil-dong likely intended to contact Kim Sam-seong about a trip tomorrow. He likely called for details or final confirmation needed for the trip preparation. Also, since Hong Gil-dong has already confirmed the route to Kim Sam-seong’s house, he may have called to share or discuss this part.”) on the second execution screen (710). The second electronic device (301) can output sound (e.g., voice) information corresponding to the answer (721) through the speaker (370).

[0156] Referring to FIG. 7b, according to one embodiment, a second electronic device (301) can check a query (713) entered by a user (e.g., a receiver) based on first information and second information, and check that there is inconsistent information (731) between the first information and the second information. Based on the discrepancy (731) between the first information and the second information of the second electronic device (301), a generative artificial intelligence model (e.g., LLM or LMM) included in the artificial intelligence model (420) (e.g., AI assistant) can be used to generate an answer (723) to a query (713), and the generated answer (723) (e.g., “There is a slight contradiction in the summarized information of the sender and the receiver. The sender, Hong Gil-dong, is planning a trip with Kim Sam-seong on November 8 and has confirmed the route to Kim Sam-seong’s house based on weekdays. On the other hand, the receiver, Kim Sam-seong, plans to go on a trip with Hong Gil-dong on November 9 and is searching the internet for a way to get to Geojedo using the weekend. The information regarding the dates and destinations does not match.”) can be displayed on the second execution screen (710). The second electronic device (301) can output sound (e.g., voice) information corresponding to the answer (723) through a speaker (370). According to one embodiment, the second electronic device (301) may reflect a graphic element (732) in part of the answer (723) to emphasize that there is a contradiction in information according to the inconsistent information (731) in the answer (723).

[0157] FIG. 8 is a diagram illustrating an example of providing summary information on a call intention in a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0158] Referring to FIG. 8, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can obtain data (811) related to the recipient (803) from context information stored in memory when it identifies that the recipient (803) has been selected or entered. For example, the first electronic device (201) can obtain data related to the recipient (803) (e.g., Schedule: City gas meter reading Mr. Kim Sam-seong, Date: November 4, 2024….) (803) through a calendar.

[0159] According to one embodiment, the first electronic device (201) can verify the first information (815) obtained by the artificial intelligence model (410) based on the identification information of the recipient (803) and the data (811) related to the recipient (803) obtained, and request a connection of a phone call to the second electronic device (301) of the recipient (803) (e.g., send a message for a call connection request). When requesting a connection of a phone call, the first electronic device (201) can display information (813) related to the call connection request on the first execution screen (810) of the phone call application. The first electronic device (201) can display the obtained first information (813) (e.g., “To Mr. Kim Sam-seong, City Gas Meter Reading, November 4, 2024, 9:00 AM…”) on the first execution screen (810).

[0160] According to one embodiment, the first electronic device (201) can transmit the first information (815) to the second electronic device (301) when requesting a connection for a telephone call.

[0161] According to one embodiment, when the second electronic device (301) receives a request to connect a phone call from the first electronic device (201), it can determine that the caller is unknown by identifying that the caller's (801) identification information (e.g., sam, 010-1234-****) is not stored in the contacts or that there is no phone call history. Based on the identification that the caller is unknown, the second electronic device (301) can determine that there is no data related to the caller. The second electronic device (301) can display the second information (831) obtained by confirming (e.g., inferring) the caller's (601) call intention based solely on the first information (815) by the artificial intelligence model (420) (e.g., “From 010-1234, city gas meter reading, seems to have called to see if it is possible on the morning of November 4.”) on the first execution screen (830) of an application related to a phone call running on the second electronic device (301).

[0162] FIG. 9 is a diagram illustrating an example of providing summary information regarding a call intention to a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0163] Referring to FIG. 9, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can check that there is no data related to the recipient in memory (220) when the caller (901) requests a phone call to an unknown contact recipient, a recipient not stored in contacts, or an unwanted recipient, and can check the first information (911) (e.g., "App event: None") obtained (e.g., generated) by an artificial intelligence model (artificial intelligence model (410) of FIG. 4) using only the recipient's identification information. According to one embodiment, the first electronic device (201) can display the first information (911) on a first execution screen (910) of an application related to the phone call. According to one embodiment, the first electronic device (201) transmits a request for a phone call connection to the recipient's second electronic device (301), and can display information (913) regarding the request for a phone call connection on the first execution screen (910) of an application related to the phone call through the display (230). When a request for a phone call connection is made to the second electronic device (301), the first information (911) can be transmitted to the second electronic device (301).

[0164] According to one embodiment, the second electronic device (301) receives a request to connect a phone call and can verify the caller's identification information. When the second electronic device (301) receives a request to connect a phone call, it can receive first information (911). According to one embodiment, the second electronic device (301) can verify that there is no associated data related to the caller in memory (320) by analyzing the first information (911) using an artificial intelligence model or processor (e.g., processor (310) of FIG. 3). According to one embodiment, since there is no associated data related to the caller, the second electronic device (301) can verify the second information (921) obtained (e.g., generated) by confirming (e.g., inferring) that there is a high probability that the call is a wrong number based only on the caller's identification information and the first information by an artificial intelligence model (e.g., artificial intelligence model (420) of FIG. 4). (e.g., “App events: No events. There is a high probability that the call is a wrong number.”) The second electronic device (301) can display the second information (921) on the first execution screen (920) of the application related to the phone call through the display (330).

[0165] FIG. 10 is a diagram illustrating an example of providing summary information on a call intention to a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0166] Referring to FIG. 10, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can execute an application related to a phone call based on receiving a phone call request from a caller, and display the execution screen of the application related to the phone call through a display (230).

[0167] According to one embodiment, the first electronic device (201) can identify a confirmed topic (e.g., travel) based on context information related to various applications of the caller (e.g., application history information) before requesting a connection for a phone call.

[0168] According to one embodiment, the first electronic device (201) can use an artificial intelligence model (e.g., AI assistant) to identify context information of at least one application (e.g., calendar) related to a topic (travel) and obtain data related to the recipient from the identified context information. For example, the first electronic device (201) can use an artificial intelligence model (e.g., AI assistant) to obtain travel schedule information with the recipient (e.g., “November 28 travel (delete)”, “parents’ return (add)”, and “12 / 1~business trip”) related to travel through the calendar as data (1011) related to the recipient.

[0169] According to one embodiment, the first electronic device (201) can check the first information (1011) (e.g., “November 28 trip (delete), parents’ return (add), 12 / 1~ business trip”) obtained (e.g., generated) by the artificial intelligence model (410) based on data related to the recipient, and check (e.g., infer) whether there are any changes related to the topic, and display the obtained (e.g., generated) first information (1012) on the first execution screen (1010) through the display (330). For example, if a trip on November 8 is planned and saved in the existing calendar, and a duplicate event occurs due to the occurrence of a new event (parents’ return) or the existing schedule is deleted, the artificial intelligence model (410) (e.g., AI assistant) can check that there is a change in the event and obtain information as the first information (1012) suggesting that the recipient discuss the changed event.

[0170] According to one embodiment, when a first electronic device (201) receives a request to connect a phone call (e.g., a call event) (1001) from a caller, it may transmit first information (1011) and / or first information (1012) obtained by an artificial intelligence model (410) to a second electronic device (301). According to one embodiment, the first electronic device (201) may display an object (e.g., an X button) in an area where the first information (1012) is displayed, which allows the caller to select whether to transmit the first information (1012) when a request to connect a phone call is made, in accordance with the intention of the artificial intelligence model (410). When the caller selects the object (e.g., an X button) or inputs a specified gesture (e.g., a swipe), the first electronic device (201) may be configured not to transmit the first information (1012) when a request to connect a phone call is made.

[0171] According to one embodiment, when a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) receives a request to connect a phone call (e.g., a call event), it may generate a notification for the phone call (e.g., a ring, vibration, or a voice guide) and receive first information (1012) from the first electronic device (201). According to one embodiment, when a request to connect a phone call (e.g., a call event) is received, the second electronic device (301) may display a first execution screen (1030) of an application related to the phone call, and may display second information (1021) (e.g., “This is a call regarding a change in travel schedule. I suggest an alternative date (11 / 8~12 / 1)”) generated by an artificial intelligence model (420) based on the received first information (1012) and data related to the caller obtained from memory (320) on the first execution screen (1030).

[0172] According to one embodiment, the second electronic device (301) may obtain additional information (1022) (e.g., “Calendar lookup…, impossible after November 18”) to be provided to a recipient through at least one application (e.g., calendar) related to a topic by an artificial intelligence model (420), and may display the obtained additional information (1022) on a first execution screen (1030). The second electronic device (301) may use the artificial intelligence model (420) to analyze the first information (1012) to determine whether it includes an additional query to the recipient (e.g., request information requesting a specific action from the recipient), and if it includes a query, may provide additional information (1022) (e.g., fourth information including response information to the query) as an answer to the query. For example, if the sender's intention is related to a reservation change, the artificial intelligence model (420) of the second electronic device (301) can provide a range of dates to be changed from the first electronic device (201) and provide information on alternative date suggestions within the provided date range.

[0173] According to one embodiment, the second electronic device (301) configures the second information (1021) and additional information (1022) as input prompts to obtain final (e.g., updated or changed) information (1023) by an artificial intelligence model (420), and can display the final information (1023) (e.g., “This is a call regarding a change in travel plans. The alternative schedule considering both of your schedules is November 9-17.”) on the first execution screen (1030). Through the final information (1023), the recipient can obtain the necessary information before the call without having to check the calendar one by one.

[0174] FIG. 11 is a diagram illustrating an example of providing summary information on a call intention to a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0175] Referring to FIG. 11, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can execute an application related to a phone call based on receiving a caller's request for a phone call, and display a first execution screen (1110) of the application related to a phone call through a display (230).

[0176] According to one embodiment, the first electronic device (201) can identify a confirmed topic (e.g., city gas meter reading) based on context information (e.g., application history information) related to the caller's various applications before requesting a connection for a phone call. For example, the first electronic device obtains a customer list through the AI ​​assistant model of the artificial intelligence model (410) and can identify the scheduled installation time from schedule information stored in memory that has pre-recorded the scheduled installation time through SMS history with the customer. The first electronic device obtains information about the current traffic situation through the AI ​​assistant model of the artificial intelligence model (410) to determine whether schedule adjustment is necessary, and if schedule adjustment is necessary, the information about the current traffic situation can be used as information to generate the first information (1112). For example, if the schedule is disrupted due to congested traffic, the installer can call the customer to reschedule the appointment time.

[0177] According to one embodiment, the first electronic device (201) can obtain first information (1112) (e.g., “Due to traffic conditions, it seems difficult to arrive on time. We need to discuss it”) by an artificial intelligence model (410) based on caller-related data (1111) obtained in relation to the topic and additionally obtained context information (e.g., current traffic conditions information) in relation to the topic before requesting a connection for a phone call, and can display the first information (1112) on a first execution screen (1010).

[0178] According to one embodiment, when a first electronic device (201) receives a request to connect a phone call (e.g., a call event) (1001) from a caller, it may transmit first information (1011) and / or first information (1112) obtained by an artificial intelligence model (410) to a second electronic device (301). According to one embodiment, the first electronic device (201) may display an object (e.g., an X button) in an area where the first information (1112) is displayed, which allows the caller to select whether to transmit the first information (1112) when a request to connect a phone call is made, in accordance with the intention of the artificial intelligence model (410). When the caller selects the object (e.g., an X button) or inputs a specified gesture (e.g., a swipe), the first electronic device (201) may be configured not to transmit the first information (1112) when a request to connect a phone call is made.

[0179] According to one embodiment, when a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) receives a request to connect a phone call (e.g., a call event), it may generate a notification for the phone call (e.g., a ring, vibration, or a voice guide) and receive first information (1112) from the first electronic device (201). According to one embodiment, when a request to connect a phone call (e.g., a call event) is received, the second electronic device (301) may display a first execution screen (1130) of an application related to the phone call, and may display second information (1121) generated by an artificial intelligence model (420) based on the received first information (1112) and data related to the caller obtained from memory (320) (e.g., “This is a call informing you that the installation time may be delayed. Available from 11 AM to 3 PM according to the caller’s schedule”) on the first execution screen (1130).

[0180] According to one embodiment, the second electronic device (301) may obtain additional information (1122) (e.g., “Check schedule…, 12 o’clock: lunch appointment with a friend, 5 o’clock: registered as exercise in routine”) to be provided to a recipient through at least one application (e.g., calendar) in relation to a topic by an artificial intelligence model (420), and may display the obtained additional information (1122) on a first execution screen (1030). The second electronic device (301) may use the artificial intelligence model (420) to analyze the first information (1112) to determine whether an additional query to the recipient is included, and if a query is included, may provide additional information (1122) as an answer to the query. For example, if the artificial intelligence model (420) of the second electronic device (301) identifies that the sender's intention is a situation where a discussion regarding schedule adjustment is needed, it can provide schedule information to be discussed that is to be changed from the first electronic device (201), and provide adjustable schedule information within the provided schedule information.

[0181] According to one embodiment, the second electronic device (301) can configure the second information (1121) and additional information (1122) as input prompts to obtain final (e.g., updated or changed) information (1123) by an artificial intelligence model (420), and display the final information (1023) (e.g., “This is a call regarding installation time. Considering the schedule, how about between 1 and 3 o’clock?”) on the first execution screen (1030). Through the final information (1023), the recipient can obtain the information necessary for scheduling before the call without having to check the calendar one by one.

[0182] FIG. 12 is a diagram illustrating an example of providing summary information on a call intention to a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0183] According to one embodiment, when a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) receives a request to connect a phone call from the first electronic device (201) of a caller (e.g., Moon), it may receive first information (e.g., summary information) indicating a call intention configured in various forms according to the caller's call intention. The first information may include at least one of text, image, or sound (e.g., voice) information. For example, when the second electronic device (301) identifies that the received first information includes text, image, and sound information, it may display an object (1233) indicating that the text (1231), image (1232), and sound information included in the first information are output on a first execution screen (1230) of an application related to the phone call, and may output sound information through a speaker (370).

[0184] FIG. 13 is a diagram illustrating an example of providing summary information on a call intention to a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0185] Referring to FIG. 13, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can obtain information about the user's current situation (e.g., situation information) using at least one sensor (e.g., the sensor module (176) of FIG. 1), a camera (e.g., the camera module (180) of FIG. 1 or the camera circuit (440) of FIG. 2) or a microphone (e.g., the input module (150) of FIG. 1 or the microphone circuit (460) of FIG. 2). For example, the first electronic device (201) can use an artificial intelligence model (artificial intelligence model (410) of FIG. 4) to identify a situation where a caller has had a contact accident with a parked car in a parking lot and is performing an internet search regarding how to handle the accident. Based on images captured by a camera or information entered by the user, it can obtain situational information such as the license plate number of the accident vehicle, the location of the accident, and information on vehicle damage, and can confirm that the phone number to be called is a new phone number that does not exist in the contacts. Here, the situational information may be data (1311) related to the recipient (user) of the new phone number (e.g., collision detection, collision sound detection (accident), contact accident alternative search). The first electronic device (201) can display the data (1311) related to the recipient on the first execution screen (1310) of the application related to the phone call.

[0186] According to one embodiment, the first electronic device (201) can obtain first information (1312) based on data (1311) related to the recipient (e.g., situation information) and identification information of the recipient by an artificial intelligence model (artificial intelligence model (410) of FIG. 4), and display the obtained first information (1312) on a first execution screen (1310) of an application related to a phone call.

[0187] According to one embodiment, when a first electronic device (201) receives a request to connect a phone call (e.g., a call event) (1001) from a caller, it may transmit first information (1011) and / or first information (1112) obtained by an artificial intelligence model (410) to a second electronic device (301). According to one embodiment, the first electronic device (201) may display an object (e.g., an X button) in an area where the first information (1112) is displayed, which allows the caller to select whether to transmit the first information (1112) when a request to connect a phone call is made, in accordance with the intention of the artificial intelligence model (410). When the caller selects the object (e.g., an X button) or inputs a specified gesture (e.g., a swipe), the first electronic device (201) may be configured not to transmit the first information (1112) when a request to connect a phone call is made.

[0188] According to one embodiment, when a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) receives a request to connect a phone call (e.g., a call event), it may generate a notification for the phone call (e.g., a ring, vibration, or a voice guide) and receive first information (1312) from the first electronic device (201). According to one embodiment, when a request to connect a phone call (e.g., a call event) is received, the second electronic device (301) may display a first execution screen (1330) of an application related to the phone call, and may display second information (1321) (e.g., “It seems like an urgent matter. Quickly…!”) generated by an artificial intelligence model (e.g., the artificial intelligence model (420) of FIG. 4) based on the received first information (1312) and data related to the caller obtained from memory (320) on the first execution screen (1330) of the application related to the phone call. The artificial intelligence model analyzes the first information (1312) to determine the context of the call intent, searches the recipient's schedule to obtain information about the recipient's schedule (e.g., additional information (1322)) (e.g., "Check schedule... 12 o'clock: lunch appointment"), and reviews the first information (1312), the second information (1321), and the additional information (1322) in combination to obtain final information (1323) (e.g., "It seems like a call about a collision. I have a lunch appointment, so I need to check the condition of the vehicle!") suggesting that the call may be related to a vehicle accident and that it may interfere with today's schedule, and displays the obtained final information (1323) on the first execution screen (1330). For example, if the second electronic device (301) selects a portion of the information included in the final information (1323), it may provide guidance information (1324) related to the selected portion (e.g., additional text or images for checking the condition of the vehicle, text or images related to a vehicle repair shop located near the appointment location, or a method of dealing with it).

[0189] FIG. 14 is a diagram illustrating an example of providing summary information on a call intention to a first electronic device and a second electronic device for a telephone call according to one embodiment.

[0190] Referring to FIG. 14, according to one embodiment, the first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can obtain information about the user's current situation (e.g., situation information (1401)) based on information detected using at least one sensor (e.g., the sensor module (176) of FIG. 1), a camera (e.g., the camera module (180) of FIG. 1 or the camera circuit (440) of FIG. 2) or a microphone (e.g., the input module (150) of FIG. 1 or the microphone circuit (460) of FIG. 2) or information detected using various applications. For example, the first electronic device (201) can use an artificial intelligence model (410) (the artificial intelligence model (410) of FIG. 4) to identify a situation where a vehicle accident has occurred based on acquired situational information, automatically recommend the most useful phone number in the current situation based on contextual information analyzed or inferred based on the acquired situational information (1401), and acquire information requesting a phone call to a contact identified as a guardian, such as first information (1421) (e.g., “Here is a list of contacts needed right now. AAA Direct Insurance 010-****-****) Auto Service 010-****-****) and display the acquired first information (1421) on the first execution screen (1410). Before providing the first information (1421), the artificial intelligence model may display a query (1411) regarding the current situation (e.g., “I think there was an external impact. Is this a vehicle accident?”) on the first execution screen (1410) or output it through a speaker (e.g., the speaker (270) of FIG. 2). It is possible.

[0191] According to one embodiment, the first electronic device (201) may request a connection to a phone call (e.g., a call event) to a receiving device of the selected phone number (e.g., a second electronic device (301)) when a caller selects one of the phone numbers provided in the first information (1421) displayed on the first execution screen (1410). The first electronic device (201) may transmit the first information to the second electronic device (301) when requesting a connection to a phone call (e.g., a call event).

[0192] According to one embodiment, the first electronic device (201) may generate additional information by an artificial intelligence model (410) based on acquired situation information (1401), additionally retrieved data from a contact list (e.g., guardian contact), a query regarding the current situation (1411), and the first information (1421). For example, the additional information may be a query or guidance message regarding whether to call the guardian. When the caller checks the additional information and enters a response message (e.g., a request message to call the guardian), the first electronic device (201) may automatically request a connection of the phone call to the guardian's electronic device (e.g., the second electronic device (301)), and upon the request for a connection of the phone call, transmit information related to the call intention. As the first electronic device (201) automatically transmits information related to the call intention upon an automatic connection request for such a phone call, it can be usefully utilized in situations where the user is unable to move due to an accident or is physically unable to move freely, and if the user is unable to answer, the AI ​​assistant can analyze the current situation and make a direct call to the target.

[0193] According to one embodiment, when a second electronic device (301) (e.g., a guardian's electronic device) receives a request to connect a phone call, it receives information related to the caller's call intention and can obtain information related to the caller's call intention (e.g., second information (1422)) based on data obtained from the received additional information and the recipient's context information by an artificial intelligence model (e.g., the artificial intelligence model (420) of FIG. 4). The second electronic device (301) can display the obtained second information (1431) (e.g., "I think something urgent has happened to my daughter. Please call her." and / or related images) on a first execution screen (1430) of an application related to the phone call.

[0194] FIG. 15 is a diagram illustrating an example of transmitting a message to a first electronic device indicating that a request for a telephone call connection is not accepted from a second electronic device according to one embodiment.

[0195] Referring to FIG. 15, according to one embodiment, a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) can, in the event that a call cannot be answered, use an artificial intelligence model (e.g., the artificial intelligence model (420) of FIG. 4) to infer the recipient's situation on their behalf and transmit information (e.g., a message about the recipient being unable to answer) to the first electronic device (201) indicating the situation in which the call cannot be answered (e.g., various situations in which a call fails, such as when a call connection request takes a long time, or when a call connection request is interrupted).

[0196] According to one embodiment, the second electronic device (301) can obtain current recipient situation information using an artificial intelligence model and verify (e.g., infer) the recipient's current situation based on the obtained situation information.

[0197] According to one embodiment, the second electronic device (301) can identify that there is currently no interaction for a certain period of time and that no sound is detected in the current space, and can confirm that the recipient is currently in a first situation (a) where they are temporarily away from their seat in another space (restroom, other room). The second electronic device (301) can obtain a message (or information) indicating the first situation (a) where the recipient is currently in a temporary away from their seat in another space (restroom, other room) by means of an artificial intelligence model (420), and can transmit the obtained message to the first electronic device (201). Based on the received message, the first electronic device (201) can display a guidance message (1511) (e.g., "It seems they are temporarily away from their seat.") obtained by the artificial intelligence model (410) on the first execution screen (1510).

[0198] According to one embodiment, the second electronic device (301) can use an artificial intelligence model (420) to determine that the recipient has rejected a request to connect a phone call or that the request to connect a phone call has ended in a second situation (b). The second electronic device (301) can obtain data (1521) related to the recipient's current situation (e.g., “Calendar: 2-4pm lecture”) by the artificial intelligence model (420), obtain a message (or information) indicating that the recipient is in the second situation (b) based on the obtained data (1521), and transmit the obtained message to the first electronic device (201). The first electronic device (201) can display a guidance message (1512) (e.g., “It seems I couldn’t answer the phone because I was in class”) obtained by the artificial intelligence model (410) based on the received message on the first execution screen (1510).

[0199] According to one embodiment, the second electronic device (301) can use an artificial intelligence model (420) to determine that the recipient is in a third situation (c) where they are conversing with another person. The second electronic device (301) can obtain a message (or information) indicating that the recipient is in the third situation (c) by the artificial intelligence model (420) and transmit the obtained message to the first electronic device (201). Based on the received message, the first electronic device (201) can display a guidance message (1513) (e.g., "It seems I cannot answer the phone because I am in a meeting.") obtained by the artificial intelligence model (410) on the first execution screen (1510).

[0200] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2) may implement a software module (e.g., the program (140) of FIG. 1) for providing information related to the call intention upon a request to connect a phone call. The memory of the electronic device (e.g., the memory (130) of FIG. 1 and / or the memory (320) of FIG. 3) may store instructions (e.g., instructions) to implement the software module. At least one processor (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2 and / or processor (310) of FIG. 3) can execute instructions stored in memory to implement a software module and can control hardware associated with the function of the software module (e.g., sensor module (176) of FIG. 1, camera module (180), communication module (190) of FIG. 1, communication circuit (250) of FIG. 2 and / or communication circuit (350) of FIG. 3, display module (160) of FIG. 1, display (230) of FIG. 2 and / or display (330) of FIG. 3).

[0201] A software module of an electronic device (101, 201, 301) according to one embodiment may be configured to include a kernel (or HAL), a framework (e.g., middleware (144) of FIG. 1), and an application (e.g., application (146) of FIG. 1). At least some of the software modules may be preloaded onto the electronic device (101, 201, 301) or downloadable from a server (e.g., server (108)).

[0202] According to one embodiment, the kernel may include, for example, a system resource manager or a device driver, but may be configured to include other modules, not limited thereto. The system resource manager may perform control, allocation, or reclamation of system resources. The device driver may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WIFI driver, an audio driver, or an IPC (inter-process communication) driver.

[0203] According to one embodiment, the framework may provide various functions to an application through an application programming interface (API) (not shown) to provide functions commonly required by the application or to enable the application to efficiently use limited system resources within the electronic device (101, 201, 301). The framework may include modules that form combinations of various functions of the components. The framework may provide modules specialized for each type of operating system to provide differentiated functions. The framework may dynamically delete some existing components or add new components.

[0204] According to one embodiment, the application may be configured to include an application (e.g., a module, a manager, or a program) for displaying an image of the external environment in real space. The application may include an application received from an external electronic device (e.g., a server (108) or an electronic device (102, 104)). According to one embodiment, the application may include a preloaded application or a third-party application downloadable from a server. The components of the software module and the names of the components according to the illustrated embodiments may vary depending on the type of operating system. According to one embodiment, at least a portion of the software module may be implemented as software, firmware, hardware, or a combination of at least two of these. At least a portion of the software module may be implemented (e.g., executed) by a processor (e.g., AP). At least a portion of the software module may include, for example, a module, a program, a routine, a set of instructions, or a process for performing at least one function.

[0205] As such, in one embodiment, the main components of an electronic device have been described through the electronic device (101, 201, 301) of FIGS. 1, 2, and 3. However, in various embodiments, the components illustrated in FIGS. 1, 2, and 3 are not all essential components, and the electronic device (101, 201, 301) may be implemented with more components than those illustrated, or with fewer components. Additionally, the positions of the main components of the electronic device (101, 201, 301) described above through FIGS. 1, 2, and 3 may be changed according to various embodiments.

[0206] According to one embodiment, an electronic device (e.g., electronic device (102, 104) of FIG. 1, electronic device (301) of FIG. 3) may include a display (e.g., display (330) of FIG. 3), a communication circuit (e.g., communication circuit (350) of FIG. 3), at least one processor including a processing circuit (e.g., processor (120) of FIG. 1, processor (310) of FIG. 3), and a memory for storing instructions (e.g., memory (320) of FIG. 3).

[0207] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to receive first information related to the intention of the telephone call from the external electronic device based on receiving a request to connect a telephone call from the external electronic device through the communication circuit.

[0208] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire user identification information of the external electronic device or data related to the first information based on user identification information of the external electronic device.

[0209] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to verify second information related to the intent of the telephone call obtained using the artificial intelligence model based on transmitting the first information and the data to the artificial intelligence model.

[0210] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display the second information on a first execution screen of an application for connecting the phone call through the display while receiving a request to connect the phone call.

[0211] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire situation information indicating that the connection request for the phone call has been rejected using at least one of the at least one sensor and camera of the electronic device based on identifying that the connection request for the phone call has been rejected, transmit a message indicating that the connection request for the phone call has not been accepted to the external electronic device through the communication circuit based on the situation information, and add information about the missed call, including the identification information of the user of the external electronic device, the second information mapped to the identification information, and an object indicating the missed call, to the call record list of the application.

[0212] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to execute the telephone call function between the external electronic device and the electronic device based on identifying that the request for connection of the telephone call has been accepted, and to store the call content obtained by the execution of the telephone call function and the second information in the memory as the data of the user of the external electronic device based on identifying that the telephone call has been terminated, and to add information about the call execution, including the identification information of the user of the external electronic device, the second information mapped to the identification information, and summary information summarizing the call content, to the call record list of the application.

[0213] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to obtain third information based on the inconsistency information using the artificial intelligence model based on identifying inconsistency information between the first information and the second information, and to display the third information on the first screen while receiving a request to connect the telephone call.

[0214] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to obtain fourth information including response information to the request information using the artificial intelligence model based on identifying that the first information includes request information requesting a specific action from the user of the electronic device, and to display the second information and the fourth information on the first screen through the display.

[0215] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire at least one of image or sound information (e.g., voice) generated based on the second information using the artificial intelligence model, and to display the generated image as at least part of the second information through the display or output the sound information as at least part of the second information through the speaker (370) of the electronic device.

[0216] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire the second information based on the first information without the data, based on identifying that the data related to the user of the external electronic device is not detected.

[0217] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display information indicating a wrong number as at least part of the second information, based on identifying that the data related to the user of the external electronic device is not detected when the first information is not received from the external electronic device.

[0218] According to one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (201) of FIG. 2)) may include a display (e.g., display module (160) of FIG. 1, display (230) of FIG. 2), a communication circuit (e.g., communication module (190) of FIG. 1, communication circuit (250) of FIG. 2), at least one processor including a processing circuit (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2), and a memory for storing instructions (e.g., memory (130) of FIG. 1, memory (220) of FIG. 2).

[0219] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device can identify the counterparty requesting the call connection based on confirming the request for a call connection of a telephone call.

[0220] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device can obtain identification information of the counterpart and data about the counterpart.

[0221] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device can obtain first information regarding the intention of the telephone call based on transmitting the identification information and the data to an artificial intelligence model.

[0222] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may transmit the first information to the external electronic device based on requesting the call connection of the telephone call to the external electronic device of the counterparty.

[0223] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be able to display second information related to the intention of the telephone call based on the first information through the display of the external electronic device while requesting a call connection of the telephone call.

[0224] Hereinafter, a method for providing information related to the caller's call intention upon a request to connect a telephone call between a first electronic device and a second electronic device according to one embodiment will be described in detail with reference to the drawings.

[0225] FIG. 16 is a diagram illustrating an example of an operation method for providing summary information regarding a call intention in a first electronic device according to one embodiment. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0226] Referring to FIG. 16, an electronic device according to one embodiment (e.g., the electronic device of FIG. 1 (101), the electronic device of FIG. 2 (201)) (hereinafter referred to as the first electronic device) can, in operation 1601, execute an application related to a phone call and display an execution screen of the application related to a phone call (hereinafter referred to as the first execution screen) when it receives a request for a phone call from a user (e.g., a caller or a person requesting a call). The first electronic device can identify a recipient selected from a contact list provided by the application related to a phone call or a recipient based on user input (e.g., a user or a call target (opponent)).

[0227] In operation 1603, the first electronic device can obtain identification information of the recipient and data related to the recipient.

[0228] In operation 1605, the first electronic device may obtain first information related to the caller's call intent obtained by the artificial intelligence model based on transmitting the recipient's identification information and data related to the recipient to the artificial intelligence model. The first electronic device may display the first information on a first execution screen. The first electronic device may edit the first information displayed on the first execution screen or update the first information by adding additional information (e.g., the caller's situation information or request information requesting a specific action by the recipient) to the first information.

[0229] In operation 1607, the first electronic device may transmit the first information to the external electronic device based on requesting a call connection for a telephone call to the recipient's external electronic device (e.g., the second electronic device (301) of FIG. 3).

[0230] In operation 1609, while the first electronic device requests a call connection for a phone call, it may display second information related to the intent of the phone call based on first information on the first execution screen through the display of the external electronic device. The external electronic device may obtain second information generated by the artificial intelligence model of the external electronic device (e.g., the artificial intelligence model (420) of FIG. 4) based on the first information and data related to the caller and context information of the receiver obtained from the external electronic device, and may transmit the second information to the first electronic device while requesting a call connection for a phone call. The first electronic device may provide the received second information. If the first electronic device does not receive the second information from the second electronic device, while requesting a call connection for a phone call, it may output only the first information or, depending on the user's settings, not output the first information and automatically transmit it to the external electronic device.

[0231] According to one embodiment, a first electronic device may execute a telephone call function between the first electronic device and the second electronic device based on identifying that a request for a telephone call connection has been accepted by the second electronic device. Subsequently, based on identifying that the telephone call has ended, the first electronic device may store the call content, first information and / or second information obtained by executing the telephone call function as context information in a memory (e.g., memory (320) of FIG. 3). According to one embodiment, the first electronic device may add information about the call execution, including user identification information of the second electronic device, first information and / or second information mapped to the identification information, and summary information summarizing the call content, to a call record list of an application related to the telephone call.

[0232] A first electronic device according to one embodiment may receive a message indicating that a request to connect a phone call has not been accepted (e.g., a message regarding the recipient being unable to answer) from a second electronic device based on identifying that a request to connect a phone call has not been accepted by the second electronic device, and may output the received message (e.g., displaying it on a first execution screen or outputting it through a speaker). The first electronic device may add information about a missed call, including user identification information of the second electronic device, first information and / or second information mapped to the identification information, and an object representing the missed call, to a call record list of an application related to the phone call.

[0233] FIG. 17 is a diagram illustrating an example of an operation method for providing summary information regarding a call intention in a second electronic device according to one embodiment. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0234] Referring to FIG. 17, an electronic device according to one embodiment (e.g., the electronic device (102, 104) of FIG. 1 or the second electronic device (301) of FIG. 2) (hereinafter referred to as the second electronic device) may receive first information related to the intention of a telephone call from the first electronic device based on receiving a request to connect a telephone call from an external electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) (hereinafter referred to as the first electronic device) through a communication circuit in operation 1701.

[0235] In operation 1703, the second electronic device can obtain data related to the user identification information of the external electronic device or the first information based on the user identification information of the external electronic device.

[0236] In operation 1705, the second electronic device can verify second information related to the intent of a telephone call obtained using the artificial intelligence model based on transmitting the first information and data to the artificial intelligence model (e.g., the artificial intelligence model (420) of FIG. 4).

[0237] In operation 1707, while the second electronic device receives a request to connect a phone call, it may display second information on the first execution screen of an application for connecting a phone call through the display of the electronic device (e.g., the display (350) of FIG. 3).

[0238] In operation 1709, the second electronic device may check whether the request for a phone call connection is accepted by the recipient after requesting a phone call connection. If the request for a phone call connection is accepted, operation 1711 is performed, and if not, 1713 is performed.

[0239] In operation 1711, the second electronic device can execute a phone call function between the first electronic device and the second electronic device based on identifying that a request for a phone call connection has been accepted. Subsequently, the second electronic device can store the call content and second information obtained by executing the phone call function as data related to the caller in memory (e.g., memory (320) of FIG. 3) based on identifying that the phone call has ended. According to one embodiment, the second electronic device can add information about the call execution, including user identification information of the first electronic device, second information mapped to the identification information, and summary information summarizing the call content, to a call record list of an application related to the phone call.

[0240] In operation 1713, the second electronic device may transmit a message indicating that the request to connect a phone call was not accepted (e.g., a message regarding the recipient being unable to answer) to the first electronic device based on identifying that the request to connect a phone call was not accepted. According to one embodiment, the second electronic device may acquire situation information indicating that the request to connect a phone call was not accepted (e.g., rejected) using at least one of at least one sensor and at least one camera, and may transmit a message regarding the recipient being unable to answer to the first electronic device through a communication circuit based on the situation information. The second electronic device may add information about a missed call, including user identification information of the first electronic device, second information mapped to the identification information, and an object indicating a missed call, to a call record list of an application related to the phone call.

[0241] FIG. 18 is a diagram illustrating an example for providing summary information on a call intention in a first electronic device according to one embodiment.

[0242] Referring to FIG. 18 and FIG. 5a, according to one embodiment, a first electronic device (201) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) can receive a caller’s command (e.g., “Bixby, call Kim about the trip”) to be transmitted to an AI assistant model (e.g., Bixby) of an artificial intelligence model (e.g., the artificial intelligence model (410) of FIG. 4) in operation 1801.

[0243] In operation 1803, the first electronic device can analyze the received command using an AI assistant model (e.g., Bixby) of an artificial intelligence model (e.g., the artificial intelligence model (410) of FIG. 4) to check analysis result information (e.g., related person, related topic, target function) related to the requested phone call.

[0244] In operation 1805, the first electronic device can identify the recipient based on analysis result information by using an AI assistant model (e.g., Bixby) of an artificial intelligence model (e.g., the artificial intelligence model (410) of FIG. 4).

[0245] In operation 1807, the first electronic device can obtain data related to the recipient from context information stored in memory (e.g., memory (220) in FIG. 2) based on analysis result information by using an AI assistant model (e.g., Bixby) of an artificial intelligence model (e.g., artificial intelligence model (410) in FIG. 4). For example, the first electronic device can identify the relevant person as 'Kim', the topic as 'travel', and the target function as 'call' in the analysis result information. For example, the first electronic device can obtain data related to the recipient (e.g., travel to Geoje with Kim on November 3 and preparations for the Geoje trip) from context information obtained through at least one relevant application.

[0246] In operation 1089, the first electronic device can use an AI assistant model (e.g., Bixby) of an artificial intelligence model (e.g., the artificial intelligence model (410) of FIG. 4) to generate an input prompt to be passed as input to a generative artificial intelligence model (e.g., LMM or LLM) of the artificial intelligence model based on the recipient's identification information and data related to the recipient.

[0247] In operation 1811, the first electronic device can infer the caller's call intention using a generative artificial intelligence model of an artificial intelligence model (e.g., the artificial intelligence model (410) of FIG. 4) and generate information related to the caller's call intention (e.g., first information).

[0248] In operation 1813, the first electronic device can display the input command and generated first information (e.g., “Travel plan note Kim pickup, there is a restaurant reservation, I searched for and saved Geoje E Grill restaurant in the browser! I need to discuss the pickup with Kim”) on the first execution screen of the application related to the phone call.

[0249] In operation 1815, the first electronic device may receive user feedback regarding the first information it has generated. The operation of receiving user feedback is an optional function, and operation 1815 and subsequent operations (operations 1817 to 1821) may not be performed depending on the user's settings. The first electronic device may interact with an artificial intelligence model based on the first information. For example, the first electronic device may identify a command spoken by a caller (e.g., “Make a call including that content (enable intent transmission)” or “Make a call” or “Make a call without feedback according to the device’s privacy security settings”) and execute the entered command.

[0250] In operation 1817, the first electronic device can check whether the personal information security setting is enabled. If the result of the check is that the personal information security setting is enabled, it can set 1819, and if not, it can perform 1821.

[0251] In operation 1819, if the first electronic device is not configured to have a function to transmit personal information, or if the caller does not provide feedback with a clear intention to transmit a call intention containing personal information, upon request to connect a phone call, the first information regarding a call intention not containing personal information may be transmitted to the second electronic device.

[0252] In operation 1821, the first electronic device may transmit first information regarding a call intention containing personal information to the second electronic device upon a request to connect a telephone call.

[0253] According to one embodiment, the first electronic device may transmit first information related to a call intention to the second electronic device, which is the counterparty device, through a network of a designated communication method or a designated cloud or server. According to one embodiment, if mutually agreed-upon AI models (e.g., AI assistants) are supported in each electronic device, a predefined communication technology may be utilized to enable the transmission and reception of data between the agreed-upon AI models (e.g., AI assistants).

[0254] FIG. 19 is a diagram illustrating an example for providing summary information on a call intention in a second electronic device according to one embodiment.

[0255] Referring to FIG. 19, a second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) can receive first information from the first electronic device (e.g., the caller's electronic device) upon a phone call connection request (e.g., a call event) using an artificial intelligence model (e.g., the AI ​​assistant of the artificial intelligence model (420) of FIG. 4) and display the first information on a first execution screen of an application related to the phone call. The second electronic device can display an object (1910) on the first execution screen to determine whether to check information related to the topic in relation to the first information. If the user selects the object (1910), the second electronic device can perform actions following 1903 or automatically perform actions following 1903. For example, the artificial intelligence model of the second electronic device (301) can display the first information as is or display information inferring the call intention based solely on the first information.

[0256] In operation 1903, the second electronic device (301) can identify the caller's identification information and the first information, and based on the caller's identification information and the first information, identify a relevant topic (e.g., travel) according to the caller's intention of the phone call.

[0257] In operation 1905, the second electronic device (301) can use an artificial intelligence model to identify context information of at least one application (e.g., calendar or app browser) in relation to a topic in context information stored in memory, and obtain data related to the sender (Hong) and / or topic in the identified context information.

[0258] In operation 1907, the second electronic device (301) can acquire (generate) second information by an artificial intelligence model based on data related to the first information and / or the sender (Hong) and / or the subject.

[0259] In operation 1909, the second electronic device (301) can display the acquired second information (e.g., “I have plans to travel to Geoje with Hong on November 3. My calendar has a conflicting schedule for attending a technical seminar on November 3. I need to discuss the schedule with Hong”) on the execution screen of an application related to a phone call.

[0260] FIG. 20 is a diagram showing an example of user authentication for providing summary information on a call intention in a second electronic device according to one embodiment, and FIG. 21 is a diagram showing an example of providing summary information on a call intention in a second electronic device according to one embodiment.

[0261] Referring to FIG. 20, the second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) can, in operation 2001, use an artificial intelligence model (e.g., the AI ​​assistant of the artificial intelligence model (420) of FIG. 4) to receive first information from the first electronic device (e.g., the caller's electronic device) when a phone call connection request (e.g., a call event) is made, and can display an object (2010) and a guidance message (e.g., "Would you like to confirm the call intention?") on the first execution screen of an application related to the phone call before displaying the first information.

[0262] In operation 2003, the second electronic device (301) can perform user authentication. In operation 2005, if user authentication is successful, the second electronic device (301) can display the received first information on the first execution screen. The second electronic device can display an object (1910) on the first execution screen to determine whether to check information related to the topic in relation to the first information. If the user selects the object (1910), the second electronic device can perform operations after operation 1903 or automatically perform operations after operation 1903. For example, the artificial intelligence model of the second electronic device (301) can display the first information as is or display information inferring the call intent based solely on the first information (e.g., “Hong is interested in visiting the Geoje H Grill restaurant on his trip to Geoje on November 3rd and wants to discuss picking up Kim”).

[0263] In operation 2007, the second electronic device (301) can identify key keywords that need to be discussed when it selects part of the first information or information inferred from the call intent displayed on the first execution screen, and can provide (e.g., support) at least one related application link to obtain data obtained through at least one related application. For example, if the user selects the keyword 'Geoje H Grill Restaurant', a browser app may be launched and display results in which the selected keyword is automatically searched.

[0264] Referring to FIG. 21, the second electronic device (301) (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) can analyze the first information using an artificial intelligence model (e.g., the AI ​​assistant of the artificial intelligence model (420) of FIG. 4) in operation 2101, and if it identifies that the first information includes personal information and a discussion item regarding the call intention, it can infer additional information (2111) regarding the discussion item based on context information stored in memory, and display the additional information (2111) (e.g., “During the trip to Geoje with Hong on November 3, there is a technical seminar scheduled on the calendar until 1:00 on the same day, so I think pickup will be possible after 1:00. I searched for H Grill restaurant in the browser.” and related images or link information) on the first execution screen (2110). For example, regarding the pickup schedule and restaurant, which are items requiring discussion transmitted by the sender, an answer inference or additional information can be generated and provided using an application on the user's device.

[0265] FIG. 22 is a perspective view showing the structure of an electronic device according to one embodiment.

[0266] Referring to FIG. 22, an electronic device (2200) according to one embodiment may be an electronic device (101) of FIG. 1, an electronic device (102 or 104) communicating with the electronic device (101) of FIG. 1, or a device capable of providing services related to virtual reality technology that provides a virtual environment similar to the electronic device (101) of FIG. 1. Virtual reality (VR) technology, which is a technology that provides a virtual environment, may be developed into augmented reality (AR), mixed reality (MR), and / or extended reality (XR) that encompasses these.

[0267] The electronic device (2200) may be a device configured to be worn on a user's body, as illustrated in FIG. 22 (e.g., a head-mounted display (HMD) or a glasses-type AR glasses device). For example, the electronic device (2200) may be configured to combine with an external electronic device, such as a mobile device, and may utilize components of the external electronic device (e.g., a display module, a camera module, an audio output module, or other components). Not limited thereto, the electronic device (2200) may be implemented in various forms that can be worn on a user's body.

[0268] According to one embodiment, the electronic device (2200) may configure a real space (e.g., virtual reality space, augmented reality space, or mixed reality space) that displays a real space corresponding to an actual external environment captured in the surrounding environment where the user is located (e.g., augmented reality image) or a virtual image provided (e.g., 2D or 3D image), and may control a display module (160) to display at least one virtual object corresponding to the user and / or at least one virtual object corresponding to an object for user interaction in the real space.

[0269] An electronic device (2201) according to one embodiment (e.g., the electronic device (101) of FIG. 1) may include a processor (120), memory (130), display module (160), sensor module (176), camera module (180), charging module (e.g., battery (189) of FIG. 1) and communication module (190) as shown in FIG. 1. The electronic device (2200) may further include an acoustic output device (155), an input module (150) as shown in FIG. 1, or other components as shown in FIG. 1. In addition, the electronic device (2200) may be configured to include other components necessary to provide virtual reality functions, augmented reality functions, or mixed reality functions (e.g., services or methods).

[0270] According to one embodiment, the processor (120) is electrically connected to other components and can control other components. The processor (120) can perform various data processing or operations in accordance with the execution of various functions (e.g., operations, services, or programs) provided by the electronic device (2200). The processor (120) can perform various data processing or operations to display at least one virtual object related to real objects included in an image captured in real space and / or a virtual object corresponding to a user (e.g., an avatar) in a virtual reality space. The processor (120) can perform various data processing or operations to express user interaction or movement of the virtual object displayed in the virtual reality space.

[0271] Again, with reference to FIG. 22, an electronic device (2200) according to one embodiment will be described. As described above, the electronic device (2200) is not limited to a glasses-type (e.g., AR glasses) augmented reality device, and can be implemented as various devices capable of providing immersive content (e.g., content based on XR technology) to the user's eyes (e.g., AR head-mounted display type, 2D / 3D head-mounted display device or VR head-mounted display device).

[0272] According to one embodiment, a camera module of an electronic device (2200) (e.g., camera module (180) or camera circuit of FIG. 1) may capture still images and / or video. According to one embodiment, the camera module may be placed within a lens frame and around a first display (2251) and a second display (2252). According to one embodiment, the camera module may include one or more first cameras (2211-1, 2211-2), one or more second cameras (2212-1, 2212-2), and one or more third cameras (2213). According to one embodiment, images acquired through one or more first cameras (2211-1, 2211-2) may be used for detecting hand gestures by a user, tracking the user's head, and / or spatial recognition. One or more first cameras (2211-1, 2211-2) may be GS (global shutter) cameras or RS (rolling shutter) cameras. One or more first cameras (2211-1, 2211-2) can perform simultaneous localization and mapping (SLAM) operations through depth imaging. One or more first cameras (2211-1, 2211-2) can perform spatial recognition and / or motion recognition for 3DoF (depth of field) and / or 6DoF. According to one embodiment, the first cameras (2211-1, 2211-2) can periodically or non-periodically transmit information (e.g., trajectory information) related to the user's eyes (e.g., left eye and right eye) or the trajectory of the gaze (e.g., eye tracking) to a processor (e.g., processor (120) of FIG. 1).The first camera (2211-1, 2211-2) can be used to position the center of a virtual image projected onto an electronic device (2200) (e.g., AR glasses) according to the direction in which the user's pupil gazes, and a GS camera can be primarily used to detect the pupil and track rapid pupil movements. The first camera (2211-1, 2211-2) can be configured for the left eye and the right eye, respectively, and the first camera (2211-1, 2211-2) configured for the left eye and the right eye, respectively, may have the same performance and specifications.

[0273] According to one embodiment, the electronic device (2200) may use another camera (e.g., a third camera (2213)) for hand detection and tracking and user gesture recognition. According to one embodiment, at least one of the first camera (2211-1, 2211-2) to the third camera (2213) may be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module may include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0274] According to one embodiment, images acquired through one or more second cameras (2212-1, 2212-2) may be used to detect and track the user's pupils. One or more second cameras (2212-1, 2212-2) may be GS cameras. One or more second cameras (2212-1, 2212-2) may correspond to the left eye and the right eye, respectively, and the performance of one or more second cameras (2212-1, 2212-2) may be substantially identical. One or more third cameras (2213) may be cameras with relatively high resolution. One or more third cameras (2213) may perform auto-focusing (AF) and optical image stabilization (OIS) functions. One or more third cameras (2213) may be GS (global shutter) cameras or RS (rolling shutter) cameras. One or more third cameras (2213) may be color cameras.

[0275] According to one embodiment, the electronic device (2200) may include one or more light-emitting elements (2214-1, 2214-2). The light-emitting elements (2214-1, 2214-2) are different from the light source described below, which irradiates light onto a screen output area of ​​a display. According to one embodiment, the light-emitting elements (2214-1, 2214-2) may irradiate light to facilitate pupil detection in detecting and tracking a user's pupil through one or more second cameras (2212-1, 2212-2). According to one embodiment, the light-emitting elements (2214-1, 2214-2) may each include an LED. According to one embodiment, the light-emitting elements (2214-1, 2214-2) may irradiate light in the infrared region. According to various embodiments, a light-emitting element (2214-1, 2214-2) may be attached around the frame of an augmented reality device (2200). According to one embodiment, the light-emitting element (2214-1, 2214-2) may be located around one or more first cameras (2211-1, 2211-2) and may assist gesture detection, head tracking, and spatial recognition by one or more first cameras (2211-1, 2211-2) when the augmented reality device (2200) is used in a dark environment. According to one embodiment, the light-emitting element (2214-1, 2214-2) may be located around one or more third cameras (2213) and may assist image acquisition by one or more third cameras (2213) when the augmented reality device (2200) is used in a dark environment.

[0276] According to one embodiment, the electronic device (2200) may include a battery (2235-1, 2235-2) (e.g., battery (189) of FIG. 1). The battery (2235-1, 2235-2) may store power to operate the remaining components of the augmented reality device (2200).

[0277] According to one embodiment, a display module of an electronic device (2200) (e.g., a display module (160) of FIG. 1) may include a first display (2251), a second display (2252), one or more input optical members (2253-1, 2253-2), one or more transparent members (2290-1, 2290-2), and one or more screen display portions (2254-1, 2254-2). According to one embodiment, the first display (2251) and the second display (2252) may be light output modules and may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED). According to one embodiment, if the first display (2251) and the second display (2252) are composed of a liquid crystal display device, a digital mirror display device, or a silicon liquid crystal display device, the augmented reality device (2200) may include a light source that irradiates light onto a screen output area of ​​the display. According to one embodiment, if the first display (2251) and the second display (2252) can generate light themselves, for example, if they are composed of an organic light-emitting diode or a micro LED, the augmented reality device (2200) may provide a user with a good quality virtual image (e.g., an image of a virtual reality space) without including a separate light source.

[0278] According to one embodiment, one or more transparent members (2290-1, 2290-2) included in the electronic device (2200) may be positioned to face the user's eyes (e.g., left and right eyes) when the user wears the augmented reality device (2200). The one or more transparent members (2290-1, 2290-2) may include at least one of a glass plate, a plastic plate, or a polymer. When the user wears the augmented reality device (e.g., the electronic device (2200)), the user can view the external environment through the one or more transparent members (2290-1, 2290-2).

[0279] According to one embodiment, one or more input optical members (2253-1, 2253-2) included in the electronic device (2200) can guide light generated from a first display (2251) and a second display (2252) to the user's eye. An image based on the light generated from the first display (2251) and the second display (2252) is formed on one or more screen display portions (2254-1, 2254-2) on one or more transparent members (2290-1, 2290-2), and the user can see the image formed on the one or more screen display portions (2254-1, 2254-2).

[0280] According to one embodiment, the electronic device (2200) may include one or more optical waveguides (not shown). The optical waveguides may transmit light generated from the first display (2251) and the second display (2252) to the user's eye. The electronic device (2200) may include one optical waveguide each corresponding to the left eye and the right eye. According to one embodiment, the optical waveguides may include at least one of glass, plastic, or polymer. The optical waveguides may include a nano-pattern formed on an inner or outer surface, for example, a polygonal or curved grating structure. The optical waveguides may include a free-form prism, in which case the optical waveguides may provide incident light to the user through a reflective mirror. According to one embodiment, the optical waveguide includes at least one of a diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or a reflective element (e.g., a reflective mirror), and can guide display light emitted from a light source to the user's eye using at least one diffractive element or reflective element included in the optical waveguide. According to one embodiment, the diffractive element may include an input / output optical member. According to one embodiment, the reflective element may include a member that causes total internal reflection (TIR) ​​(e.g., a total internal reflection optical element or a total internal reflection waveguide). For example, total internal reflection is a method of guiding light, which may mean creating an angle of incidence such that light (e.g., a virtual image) input through an input grating area is 100% reflected from one surface (e.g., a specific surface) of the waveguide and is transmitted 100% to an output grating area.

[0281] In one embodiment, light emitted from a display (e.g., a first display (2251) and a second display (2252)) may have its light path guided to a waveguide through an input optical member (e.g., an optical waveguide). Light traveling inside the waveguide may be guided toward the user's eye through an output optical member. A screen display may be determined based on the light emitted toward the eye.

[0282] According to one embodiment, the electronic device (2200) may include one or more voice input devices (2262-1, 2262-2, 2262-3) and one or more voice output devices (2263-1, 2263-2).

[0283] According to one embodiment, the electronic device (2200) may include a first PCB (2270-1) and a second PCB (2270-2). The first PCB (2270-1) and the second PCB (2270-2) may transmit electrical signals to components included in the electronic device (2200), such as a first camera (2211-1, 2211-2), a second camera (2212-1, 2212-2), a third camera (2213), a display (2251, 2252), an audio module (e.g., the audio module (170) of FIG. 1), and a sensor module (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the first PCB (2270-1) and the second PCB (2270-2) may be flexible printed circuit boards (FPCB). According to one embodiment, the first PCB (2270-1) and the second PCB (2270-2) may each include a first substrate, a second substrate, and an interposer disposed between the first substrate and the second substrate.

[0284] FIG. 23a is a perspective view showing the structure of an electronic device according to one embodiment.

[0285] Referring to FIG. 23a, an electronic device (2300) according to one embodiment (e.g., the electronic device (101) of FIG. 1 or the electronic device (2200) of FIG. 2) may be a wearable device such as a head-mounted device (HMD) that can be worn on a user's head to provide an image (e.g., a virtual reality space image) in front of the eyes. The configuration of the electronic device (2300) of FIG. 23 may be all or partly the same as the configuration of the electronic device (2200) of FIG. 2.

[0286] According to one embodiment, the electronic device (2300) may include a housing (2310, 2320, 2330) that can form an exterior and provide a space in which components of the electronic device (2300) can be placed.

[0287] According to one embodiment, the electronic device (2300) may include a first housing (2310) that can surround at least a portion of the user's head. According to one embodiment, the first housing (2310) may include a first surface (2300a) facing the outside of the electronic device (2300) (e.g., in the +X direction).

[0288] According to one embodiment, the first housing (2310) may surround at least a portion of the internal space (I). For example, the first housing (2310) may include a second surface (2300b) facing the internal space (I) of the electronic device (2300) and a third surface (2300c) opposite to the second surface (2300b). According to one embodiment, the first housing (2310) may be combined with a third housing (2330) to form a closed curve shape surrounding the internal space (I).

[0289] According to one embodiment, the first housing (2310) may accommodate at least some of the components of the electronic device (2300). For example, a light output module, a circuit board, and a speaker module may be placed within the first housing (2310).

[0290] According to one embodiment, one display member (2340) corresponding to the left and right eyes of the electronic device (2300) may be included. The display member (2340) may be disposed in a first housing (2310). The configuration of the display member (2340) of FIG. 23 may be all or partly the same as the configuration of the screen display portion (2254-1, 2254-2) of FIG. 2.

[0291] According to one embodiment, the electronic device (2300) may include a second housing (2320) that can be placed on the face of a user. According to one embodiment, the second housing (2320) may include a fourth surface (2300d) that can face at least partially the face of a user. According to one embodiment, the fourth surface (2300d) may be a surface facing the internal space (I) of the electronic device (2300) (e.g., -X direction). According to one embodiment, the second housing (2320) may be combined with the first housing (2310).

[0292] According to one embodiment, the electronic device (2300) may include a third housing (2330) that can be seated on the back of a user's head. According to one embodiment, the third housing (2330) may be combined with the first housing (2310). According to one embodiment, the third housing (2330) may accommodate at least some of the components of the electronic device (2300). For example, a battery (e.g., the battery (2235-1, 2235-2) of FIG. 2) may be placed within the third housing (330).

[0293] In order to enhance the user's overall user experience, usage environment, and usability of a head-mounted wearable electronic device (2300), it may be necessary for the sensations felt and experienced by the user in VR (virtual reality), AR (augmented reality), and MR (mixed reality) spaces to be as similar as possible to the sensations of the real world.

[0294] FIGS. 23b and FIGS. 23c are perspective views showing the structure of an electronic device according to one embodiment.

[0295] Referring to FIG. 23b and FIG. 23c, in one embodiment, camera modules (2311, 2312, 2313, 2314, 2315, 2316) and / or a depth sensor (2317) for acquiring information related to the surrounding environment of an electronic device (2300) (e.g., a wearable device) may be disposed on a first surface (2310) of the housing.

[0296] In one embodiment, camera modules (2311, 2312) can acquire images related to the surrounding environment of a wearable electronic device.

[0297] In one embodiment, camera modules (2313, 2314, 2315, 2316) can acquire images while the electronic device (2300) is worn by a user. The camera modules (2313, 2314, 2315, 2316) can be used for hand detection, tracking, and user gesture (e.g., hand movements) recognition. The camera modules (2313, 2314, 2315, 2316) can be used for 3DoF, 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. In one embodiment, camera modules (2311, 2312) may be used for hand detection and tracking and user gestures.

[0298] In one embodiment, the depth sensor (2317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for determining the distance to an object, such as time of flight (TOF). In place of or additionally to the depth sensor (2317), camera modules (2313, 2314, 2315, 2316) may determine the distance to an object.

[0299] According to one embodiment, a face recognition camera module (2325, 2326) (e.g., FT (Face Tracking) camera) and / or a display (2321) (and / or a lens) may be disposed on the second surface (2320) of the housing.

[0300] In one embodiment, a face recognition camera module (2325, 2326) adjacent to the display may be used to recognize the user's face or to recognize and / or track both of the user's eyes. In one embodiment, the lens may serve to adjust the focus so that the screen output to the display (2321) can be seen by the user's eyes, and may be composed of, for example, a Fresnel lens, a Pancake lens, or a multi-channel lens.

[0301] In one embodiment, the display (2321) (and / or lens) may be disposed on a second surface (2320) of the wearable electronic device (2300). In one embodiment, the wearable electronic device (2300) may not include camera modules (2315, 2316) among a plurality of camera modules (2313, 2314, 2315, 2316). Although not illustrated in FIG. 23b and FIG. 23c, the electronic device (2300) may further include at least one of the configurations illustrated in FIG. 2.

[0302] As described above, according to one embodiment, the electronic device (2300) may have a form factor for being worn on a user's head. The electronic device (2300) may further include a strap and / or a wearing member for being secured on a part of the user's body. The electronic device (2300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0303] Hereinafter, the electronic device described in this disclosure may be an electronic device that a user can wear on their body (e.g., head), such as a head-mounted display (HMD) device, augmented reality (AR) glasses, and / or a VST device, as described with reference to FIGS. 22, 23a through 23c. Herein, the electronic device may be referred to as a wearable electronic device. The interpretation described in this disclosure may be referred to as “translation” and may be replaced by other terms having the meaning of transferring a language other than the user’s language into the user’s language. The subject of interpretation described in this disclosure may be a person who speaks a language different from the user or a device that outputs a different language. The interpretation described in this disclosure may mean transferring audio information, including the voice of a person who speaks a different language or sound output from a device that outputs a different language, into the form of audio or text in the language used by the user. In this disclosure, the audio information may include sign language as the other language of the subject of interpretation.

[0304] FIGS. 24 and 25 are drawings illustrating an example of providing summary information on a call intention in a first electronic device for telephone calls according to one embodiment.

[0305] Referring to FIGS. 24 and 25, a first electronic device (2220 or 2230) according to one embodiment (e.g., the electronic device (101) of FIG. 1 or the electronic device (2200) of FIG. 22, the electronic device (2300) of FIGS. 23a to 23c) can, in operation 2511, detect a specific event (2410) (e.g., a vehicle accident) occurring in an external environment through at least one sensor, camera or display, and acquire a scene of an image of the situation detection and the specific event (2410). In operation 2512, the first electronic device (2220 or 2230) can analyze the scene using an artificial intelligence model (410).

[0306] In operation 2513, according to one embodiment, a first electronic device (2220 or 2230) can infer the current situation based on the scene analysis results of a specific event (240) using an artificial intelligence model (410) and obtain data related to the current situation. The first electronic device (2220 or 2230) can obtain first information (e.g., “I think there was a car accident in the parking lot, can I help you?”) based on the obtained related data using the artificial intelligence model (410), and display the obtained first information on a first execution screen of an application related to a phone call. For example, the first electronic device (2220 or 2230) can use an artificial intelligence model (410) (artificial intelligence model (410) of FIG. 4) to identify a situation where a caller has had a contact accident with a parked car in a parking lot and is performing an internet search regarding the accident response, and can obtain situational information such as the license plate number of the accident vehicle, the location of the accident, and vehicle damage information based on images captured by a camera or information entered by the user, and can confirm that the phone number to be called is a new phone number that does not exist in the contacts. Here, the situational information may be data related to the recipient (user) of the new phone number (e.g., collision detection, collision sound detection (accident), contact accident alternative search). The first electronic device (2220 or 2230) can display the data related to the recipient on the first execution screen of an application related to the phone call.

[0307] In operation 2514, the first electronic device (2220 or 2230) may display a query and / or response obtained through interaction between the artificial intelligence model (410) and the user on the first execution screen. For example, when the user inputs a response, the input response (e.g., “Yeah, it’s my first accident and I don’t know what to do…”) may be displayed on the first execution screen via a display (2251, 2252, 2340, or 2321). Subsequently, when a response is output from the artificial intelligence model, the output response (e.g., “First, check the vehicle damage and get the other party’s contact information. (After checking the other party’s vehicle) send a summary of the current situation to the other party’s number and make a call?”) may be displayed. Here, an object for checking summary information may be displayed on the first execution screen.

[0308] In operation 2515, the first electronic device (2220 or 2230) acquires data related to a receiver based on an analyzed scene, and in operation 2516, can generate information related to a call intention (summary information) based on an analyzed scene. Here, the information related to a call intention may include at least one of image, text, or sound (e.g., voice) information.

[0309] In operation 2517, the first electronic device (2220 or 2230) can receive a user's selection input or response to an object (e.g., “Yes, do that”).

[0310] In operation 2518, the first electronic device (2220 or 2230) may transmit information (2501) (e.g., first information) related to the generated call intention based on the user’s selection input or response to the object (e.g., “Yes, do that”) to the receiver’s external electronic device (e.g., second electronic device).

[0311] In operation 2519, the first electronic device (2220 or 2230) may display information related to the call intention on the first execution screen through a display (2251, 2252, 2340 or 2321).

[0312] FIG. 26 is a diagram illustrating an example of providing summary information on a call intention in a second electronic device for a telephone call according to one embodiment.

[0313] Referring to FIG. 26, a second electronic device (301) according to one embodiment (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (301) of FIG. 3) may, upon receiving a request to connect a phone call (e.g., a call event), generate a notification for the phone call (e.g., a ring, vibration, or a voice guide) and receive first information (e.g., information related to the call intention obtained through scene analysis of FIG. 25 (2501)) from the first electronic device (2220 or 2230). According to one embodiment, the second electronic device (301) may display a first execution screen (2610) of an application related to the phone call upon receiving a request to connect a phone call (e.g., a call event) and generate first information (2611) (e.g., “It seems to be a call related to a contact accident that occurred in a parking lot.”) by an artificial intelligence model (e.g., the artificial intelligence model (420) of FIG. 4) based on the received first information. Here, the second information (2611) may be information generated based solely on the received first information. Here, the first execution screen may display an object (2601) for checking whether to check information related to the call intention, and if the user selects the object (2601), information related to the call intention (e.g., third information) may be provided based further on additional information.

[0314] According to one embodiment, the second electronic device (301) can generate additional information (2613) (e.g., “This is a call regarding a vehicle accident (damage to the car side door)” and an image) based on the received first information and data related to the caller obtained from the memory (320). According to one embodiment, the second electronic device (301) can use an artificial intelligence model to display third information (2620) related to the call intent (e.g., “There was a vehicle contact accident in the parking lot, and it seems that the tire side of Mr. Kim’s car door is damaged. Additionally, you need to file a claim for property damage with the insurance company. AA Fire: xxx-xxxx-xxxx, counterparty information: Hong, vehicle number: 24버1234, I think I need to change my plans to go to a barbecue restaurant tonight.”) on the first execution screen (2610) of the application related to the phone call. For example, the second electronic device (301) analyzes events related to the call intent summary and the current situation of the recipient, checks a list requiring additional user action, and can confirm that due to a vehicle accident, the user needs to change their schedule to go to a barbecue restaurant that evening and needs to visit a tire / repair shop for vehicle repair. The second electronic device (301) can display third information including additional information such as the license plate number of the offending vehicle, the black box, and the phone number of the insurance company subscribed to by the recipient, for the purpose of reporting the vehicle accident. The second electronic device (301) can identify key keywords requiring discussion and provide link information to related applications.

[0315] FIG. 27 is a block diagram showing a generative artificial intelligence system according to one embodiment.

[0316] Referring to FIG. 27, a generative artificial intelligence system (2700) according to one embodiment may include a user interface (e.g., a user query / response interface (2710)), a knowledge repository (2720), an application / service module (2730), an artificial intelligence (AI) framework (2740), and a generative AI model (2760). The components may be operated on one or more of an electronic device (101), an external electronic device (102 or 104), or a server (108). For example, the user query / response interface (2710) and the artificial intelligence (AI) framework (2740) can be operated on the electronic device (101), and the knowledge repository (2720) and the generative artificial intelligence model (2760) can be operated on the server (108).

[0317] In a generative artificial intelligence system (2700) according to one embodiment, a user query / response interface (2710) (e.g., input module (150) of FIG. 1, microphone circuit (260) of FIG. 2 or microphone circuit (360) of FIG. 3, and / or display module (160) of FIG. 1, display (230) of FIG. 2 or display (330) of FIG. 3) may receive user input (e.g., user query). User input may be received in the form of text, image, voice (e.g., natural language), video, menu selection, or a combination thereof. Additionally, the user query / response interface (2710) may include various context information (e.g., running application or user location) related to the generative artificial intelligence system (200) at the time the user input is received, in addition to or instead of the user input. The user query / response interface (2710) may provide the user input or the context information to the artificial intelligence (AI) framework (2740) and provide the result of processing thereon to the user, for example, through the artificial intelligence (AI) framework (2740). According to one embodiment, in addition to user input, the electronic device may provide context information obtained using information included on the screen to the artificial intelligence (AI) framework (2740). The context information may include various additional information at the time of user input. For example, the additional information may include information about the application currently being used by the user or the user's location information. Furthermore, user input may be in a mixed form of the natural language, images, sounds, and context information described above. Additionally, user input may be in a non-natural language form, such as selecting a menu. The user query / response interface (2710) may output the result of the generative artificial intelligence system to the user.The output can be in the form of natural language or specific content, and can also be provided in the form of actions requested by the user. The user query / response interface (2710) can output the results of the generative artificial intelligence system to the user. The output can be in the form of natural language or specific content, and can also be provided in the form of actions requested by the user.

[0318] An artificial intelligence framework (2740) (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2, or processor (320) of FIG. 3) can receive input from a user and coordinate and control each component necessary to perform the user's intent based on the user's query. The artificial intelligence framework (2740) may include a prompt design component (2741), an API / Plug-in management component (2742), and an output modification component (or, may also be named a refiner component) (2743).

[0319] User input received from the user query / response interface (2710) can be transmitted to a prompt design component (2741) (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2, or processor (310) of FIG. 3). The prompt design component (2741) can be used to generate prompts suitable for inputting user input into a large language model (LM), a large vision model (LVM), or a large multimodal model (LMM). The prompt design component (2741) may be an artificial intelligence component that uses machine learning algorithms or neural networks to develop better prompts over time. The prompt design component (2741) can generate prompts by accessing a knowledge component containing user preference data, a prompt library, and prompt examples based on user input, and can transmit the generated prompts to the LLM, LVM, or LMM.

[0320] An API / Plug-in management component (2742) (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2, or processor (310) of FIG. 3) can perform the role of communicating with external information when there is a request for additional information when user input is passed as input to a generative model (e.g., artificial intelligence model (410) of FIG. 4, artificial intelligence model (420), or cloud artificial intelligence (AI) model). The API / Plug-in management component (2742) establishes a channel to communicate with the outside of the artificial intelligence framework (2740) via an API, and through the established channel, it can access various data sources (e.g., knowledge store (2720)) (e.g., memory (130) of FIG. 1, memory (220) of FIG. 2, or memory (320) of FIG. 3). Additionally, the API / plugin management component (2742) may request the application / service component (2730) (e.g., processor (120) of FIG. 1, processor (210) of FIG. 2, or processor (310) of FIG. 3) via the API when the application or service needs to perform an action that ultimately performs user input rather than an intermediate result. Information obtained from the outside may be used to generate a prompt in the prompt design component (2741) along with user input, or it may be passed as input to a generative artificial intelligence model (2760) (e.g., artificial intelligence model (410) of FIG. 4, artificial intelligence model (420), or cloud artificial intelligence model).

[0321] An output modification component (2743) (e.g., the processor (120) of FIG. 1 or the processor (210) of FIG. 2) can finely tune the output of a generative artificial intelligence model (2760) (e.g., the artificial intelligence model (410), the artificial intelligence model (420) of FIG. 4 or the cloud artificial intelligence model). For example, the output modification component (2743) can determine the degree of correlation, degree of bias (e.g., political or social bias), or degree of harmfulness (e.g., sexual or profanity) of the difference between the response obtained through the generative artificial intelligence model (2760) and the user input. Additionally or generally, the output modification component (2743) may request that additional AI processing be performed on the obtained response, or provide the user with a hint to avoid unwanted output. For example, additional prompts can be generated through the Prompt Design Module and the response can be obtained again through the generative artificial intelligence model (2760).

[0322] A generative AI model (2760) (e.g., the AI ​​model (410), the AI ​​model (420) of FIG. 4, or the cloud AI model) may generally refer to an artificial intelligence neural network that generates new forms of data based on user input information. The generative AI model (2760) may include a model that generates images and / or a model that generates language. Models that generate images include, for example, a generative adversarial network (GAN) and a variational auto encoder (VAE), and may include diffusion-based generative models that use VAE and transformer structures. Language generation models may include, for example, a large language model (LLM), a large multimodal model (LMM), a large vision model (LVM), or a large action model (LAM). A LAM can automatically generate actions for an environment (e.g., a robot, a car, an electronic device (101), or a program (140)). In addition, for at least some AI models (e.g., LLM), there may be LoRA (low-rank adaptation) adapters fine-tuned for specific tasks or specific situations, for example.

[0323] In one embodiment, the artificial intelligence framework (2740) and / or generative artificial intelligence model (2760) may be included within an artificial intelligence module (e.g., including a processing circuit) within the electronic device. For example, the artificial intelligence module may be operatively coupled with at least one processor of the electronic device (e.g., at least one processor (120) of FIG. 1, the processor (210) of FIG. 2, or the processor (310) of FIG. 3). For example, the artificial intelligence module may be operatively coupled with a sensor hub of the electronic device for one or more sensors within the electronic device.

[0324] FIG. 28 is a block diagram showing an artificial intelligence framework (AI framework) according to one embodiment. FIG. 28 illustrates an artificial intelligence framework (AI framework) (2740) having on-device artificial intelligence (On-device AI) processing capabilities according to one embodiment.

[0325] Referring to FIG. 28, an artificial intelligence framework (AI framework) (2740) may generate and learn a response to said user input using resources within the electronic device, instead of sending user input received through a user interface (e.g., user query / response interface (2710) of FIG. 27) operating on the same device (e.g., electronic device (101)) to a generative artificial intelligence model (e.g., generative artificial intelligence model (2760) of FIG. 27) operating on an external device (e.g., server (108)). The artificial intelligence framework (AI framework) (2740) may include a cross-application action module (2810), a personal data managing module (2830), an on-device AI model (2850), and an orchestration module (2870).

[0326] According to one embodiment, the cross-application module (2810) determines one or more additional applications required for the operation of an executed application (e.g., an assistant app) and may connect or suggest operations between the app and at least one additional application, or between a plurality of additional applications. For example, the cross-application module (2810) may execute one or more additional applications to be used to respond to a user request through the assistant app sequentially or at least partially, simultaneously. Additionally, the cross-application module (2810) may communicate with the additional applications so that the result of the execution of one additional application (e.g., content) can be shared with other additional applications.

[0327] According to one embodiment, a personal data managing module (2830) may provide personal information (e.g., schedule, contact, or message information) about a user of the application (e.g., assistant app) or the additional application running on the device (e.g., electronic device 101) or other related individuals (e.g., family or friends) to another module of the artificial intelligence framework (AI framework) (2820) or a related module (e.g., Generative AI Model 230) operating on another device.

[0328] According to one embodiment, an on-device artificial intelligence model (2850) may include at least one model among one or more AI models (e.g., GAN, VAE, LLM, LMM, LVM, or LAM) operated on an external device (e.g., server (108)) or a corresponding lightweight AI model. Additionally, for said model or said lightweight model, there may be, for example, a LoRA adaptor.

[0329] According to one embodiment, an orchestration module (2870) may select one or more AI models to be used to obtain a response to user input (e.g., user query). For example, the orchestration module (2870) may select one or more AI models from an on-device artificial intelligence model (2850), an AI model operating on an external device (e.g., server (108)) (e.g., Generative AI Model (230)), or a third AI model (not shown) operating on another external device. If multiple AI models are selected, the orchestration module (2870) may communicate with the selected models or devices so that the operation between the selected AI models and the processing of the results thereof can be coordinated between the relevant models or devices.

[0330] According to one embodiment, two or more modules of a generative AI system (200) (e.g., a cross-application module (2810) and an orchestration module (2870)) may be implemented as a single module to maintain the same functionality. Various variations are possible.

[0331] According to one embodiment, a method of operation in an electronic device (e.g., electronic device (102, 104) of FIG. 1, electronic device (301) of FIG. 3) may include receiving first information related to the intention of the telephone call from an external electronic device (e.g., electronic device (101) of FIG. 1, electronic device (201) of FIG. 2) based on receiving a request to connect a telephone call from an external electronic device through a communication circuit of the electronic device (e.g., communication circuit (350) of FIG. 3).

[0332] According to one embodiment, a method of operation in an electronic device may include an operation of obtaining user identification information of the external electronic device or data related to the first information based on user identification information of the external electronic device.

[0333] According to one embodiment, a method of operation in an electronic device may include an operation of confirming second information related to the intention of the telephone call obtained using the artificial intelligence model, based on transmitting the first information and the data to the artificial intelligence model (e.g., the artificial intelligence model (420) of FIG. 4).

[0334] According to one embodiment, a method of operation in an electronic device may include, while receiving a request to connect the telephone call, displaying the second information on a first execution screen of an application for connecting the telephone call through a display of the electronic device (e.g., a display (330) of FIG. 3).

[0335] According to one embodiment, the method may further include: acquiring situation information indicating a situation in which the connection request for the phone call is not accepted using at least one of at least one sensor and at least one camera of the electronic device based on identifying that the connection request for the phone call is rejected; transmitting a message indicating that the connection request for the phone call is not accepted to the external electronic device through the communication circuit based on the situation information; and adding information about a missed call to the call record list of the application, the information including the identification information of the user of the external electronic device, the second information mapped to the identification information, and an object indicating a missed call.

[0336] According to one embodiment, the method may further include: acquiring situation information indicating a situation in which the connection request for the phone call is not accepted using at least one of at least one sensor and at least one camera of the electronic device based on identifying that the connection request for the phone call is rejected; transmitting a message indicating that the connection request for the phone call is not accepted to the external electronic device through the communication circuit based on the situation information; and adding information about a missed call to the call record list of the application, the information including the identification information of the user of the external electronic device, the second information mapped to the identification information, and an object indicating a missed call.

[0337] According to one embodiment, the method may further include: an operation to execute the telephone call function between the external electronic device and the electronic device based on identifying that a connection request for the telephone call has been accepted; an operation to store the call content obtained by the execution of the telephone call function and the second information as the data of the user of the external electronic device in the memory based on identifying that the telephone call has been terminated; and an operation to add information regarding the execution of the call, including identification information of the user of the external electronic device, the second information mapped to the identification information, and summary information summarizing the call content, to the call record list of the application.

[0338] According to one embodiment, the method may include, based on identifying information that is inconsistent between the first information and the second information, using the artificial intelligence model to obtain third information based on said inconsistent information, and displaying said third information on the first execution screen while receiving a connection request for said telephone call.

[0339] According to one embodiment, the method may further include, based on identifying that the first information includes request information requesting a specific action from a user of the electronic device, obtaining fourth information including response information to the request information using the artificial intelligence model, and displaying the second information and the fourth information on the first execution screen through the display.

[0340] According to one embodiment, the method may further include the operation of acquiring at least one of image or sound information (e.g., voice) generated based on the second information using the artificial intelligence model, and displaying the generated image as at least part of the second information through the display or outputting the sound information as at least part of the second information through the speaker (370) of the electronic device.

[0341] According to one embodiment, the operation of verifying the second information may include the operation of obtaining the second information based on the first information without the data, based on identifying that the data related to the user of the external electronic device is not detected.

[0342] According to one embodiment, the method may further include an operation of displaying information indicating that it is a wrong number as at least part of the second information, based on identifying that the data related to the user of the external electronic device is not detected when the first information is not received from the external electronic device.

[0343] According to one embodiment, in a non-transient storage medium storing one or more programs, the one or more programs may include instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform the following operations: receiving first information related to the intention of the phone call from an external electronic device (101, 201) based on receiving a request for a phone call connection from the external electronic device through the communication circuit (350) of the electronic device; obtaining data related to the user identification information of the external electronic device or the first information based on the user identification information of the external electronic device; verifying second information related to the intention of the phone call obtained using the artificial intelligence model based on transmitting the first information and the data to the artificial intelligence model (420); and displaying the second information on a first execution screen of an application for connecting the phone call through the display (330) of the electronic device while receiving the request for a phone call connection.

[0344] This document utilizes an artificial intelligence model to infer the caller's intent to make a call and conveys it to the recipient, and the recipient can provide information related to the caller's intent to enable the recipient to accurately verify the caller's intent. In cases where both the sender and the recipient have context history learned in advance through artificial intelligence models, this document may provide context information provided by both the sending and receiving artificial intelligence models to the user (recipient) to resolve the issue where the context information provided by the sending and receiving artificial intelligence models may differ. In addition, various effects that can be identified directly or indirectly through this document may be provided. The effects obtainable from this disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this disclosure belongs from the description below.

[0345] Furthermore, the embodiments disclosed in this document are presented for the purpose of explaining and understanding the disclosed technical content and are not intended to limit the scope of the technology described in this document. Accordingly, the scope of this document should be interpreted to include all modifications or various other embodiments based on the technical concept of this document.

[0346] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0347] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0348] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0349] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0350] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0351] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (102, 104, 301), Display (330); Communication circuit (350); At least one processor (310) including a processing circuit; and It includes a memory (320) for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on receiving a request to connect a telephone call from an external electronic device (101, 201) through the communication circuit, receiving first information related to the intention of the telephone call from the external electronic device, and Based on the user identification information of the external electronic device, data related to the user identification information of the external electronic device or the first information is obtained, and Based on transmitting the above first information and the above data to the artificial intelligence model (420), the second information related to the intention of the above telephone call obtained using the artificial intelligence model is verified, and An electronic device that causes the second information to be displayed on a first execution screen of an application for connecting the phone call through the display while receiving a request to connect the phone call.

2. In paragraph 1, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on identifying that the connection request for the above phone call has been rejected, at least one of at least one sensor and camera of the electronic device is used to obtain situation information indicating that the connection request for the above phone call has not been accepted, and An electronic device that transmits a message to an external electronic device through the communication circuit indicating that a connection request for the telephone call is not accepted, based on the above situation information.

3. In claim 1 or 2, when the instructions are executed individually or collectively by the at least one processor, the electronic device: An electronic device that causes information about a missed call to be added to a call log list of the application, the information including the identification information of the user of the external electronic device, the second information mapped to the identification information, and an object representing the missed call.

4. In claim 1 or 3, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on identifying that the connection request for the above telephone call has been accepted, the telephone call function between the external electronic device and the electronic device is executed, and Based on identifying that the above telephone call has ended, the call content and the second information obtained by the execution of the above telephone call function are stored in the memory as the data of the user of the external electronic device, and An electronic device that causes information about a call execution, including user identification information of the external electronic device, the second information mapped to the identification information, and summary information summarizing the call content, to be added to the call record list of the application.

5. In any one of claims 1 to 4, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on identifying information that is inconsistent between the first information and the second information, using the artificial intelligence model, third information is obtained based on the inconsistent information, and An electronic device that causes the third information to be displayed on the first execution screen while receiving a connection request for the above telephone call.

6. In any one of claims 1 to 5, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on identifying that the first information includes request information requesting a specific action from the user of the electronic device, the artificial intelligence model is used to obtain fourth information including response information to the request information, and An electronic device that causes the second information and the fourth information to be displayed on the first execution screen through the above display.

7. In any one of claims 1 through 6, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Using the artificial intelligence model above, at least one of the image or sound information generated based on the second information is obtained, and An electronic device that causes the generated image to be displayed as at least part of the second information through the display or the sound information to be output as at least part of the second information through the speaker (370) of the electronic device.

8. In any one of claims 1 through 7, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on identifying that the data related to the user of the external electronic device is not detected, the second information is obtained based on the first information without the data, and An electronic device that causes information indicating a wrong number to be displayed as at least part of the second information, based on identifying that the data related to the user of the external electronic device is not detected when the first information is not received from the external electronic device.

9. A method of operation in an electronic device (102, 104, 301), An operation of receiving first information related to the intention of the telephone call from the external electronic device based on receiving a request to connect a telephone call from the external electronic device (101, 201) through the communication circuit (350) of the electronic device; An operation to acquire user identification information of the external electronic device or data related to the first information based on user identification information of the external electronic device; An operation to verify second information related to the intention of the telephone call obtained using the artificial intelligence model based on transmitting the first information and the data to the artificial intelligence model (420); and A method comprising the operation of displaying the second information on a first execution screen of an application for connecting the phone call through the display (330) of the electronic device while receiving a request to connect the phone call.

10. In paragraph 9, the above method is, Based on identifying that the connection request for the above-mentioned phone call has been rejected, the operation of obtaining situation information indicating a situation in which the connection request for the above-mentioned phone call is not accepted using at least one of at least one sensor and at least one camera of the above-mentioned electronic device; The operation of transmitting a message to the external electronic device through the communication circuit indicating that the request for connection of the telephone call is not accepted based on the above situation information; and A method further comprising the operation of adding information about a missed call to a call record list of the application, the information including the identification information of the user of the external electronic device, the second information mapped to the identification information, and an object representing the missed call.

11. In paragraph 9 or 10, the above method is, An operation to execute the telephone call function between the external electronic device and the electronic device based on identifying that the connection request for the above telephone call has been accepted; Based on identifying that the above telephone call has ended, the operation of storing the call content obtained by the execution of the above telephone call function and the second information in the memory as the data of the user of the above external electronic device; and A method further comprising the action of adding information about a call execution, including user identification information of the external electronic device, the second information mapped to the identification information, and summary information summarizing the call content, to the call record list of the application.

12. In any one of paragraphs 9 to 11, the above method is, An operation of obtaining third information based on the inconsistency information using the artificial intelligence model based on identifying inconsistency information between the first information and the second information; and An operation of displaying the third information on the first execution screen while receiving a connection request for the above telephone call; An operation of obtaining fourth information including response information to the request information using the artificial intelligence model based on identifying that the first information includes request information requesting a specific action from the user of the electronic device; and A method further comprising the operation of displaying the second information and the fourth information on the first execution screen through the display.

13. In any one of paragraphs 9 through 12, the above method is, Using the artificial intelligence model above, at least one of the image or sound information generated based on the second information is obtained, and A method further comprising the operation of displaying the generated image as at least part of the second information through the display or outputting the sound information as at least part of the second information through the speaker (370) of the electronic device.

14. In any one of paragraphs 9 through 13, the operation of verifying the second information is, Based on identifying that the data related to the user of the external electronic device is not detected, the method includes the operation of obtaining the second information based on the first information without the data, and The above method is, A method further comprising the operation of displaying information indicating a wrong number as at least part of the second information, based on identifying that the data related to the user of the external electronic device is not detected when the first information is not received from the external electronic device.

15. In a non-transient storage medium storing one or more programs, the one or more programs, when executed by at least one processor of an electronic device, cause the electronic device: An operation of receiving first information related to the intention of the telephone call from the external electronic device based on receiving a request to connect a telephone call from the external electronic device (101, 201) through the communication circuit (350) of the electronic device; An operation to acquire user identification information of the external electronic device or data related to the first information based on user identification information of the external electronic device; An operation to verify second information related to the intention of the telephone call obtained using the artificial intelligence model based on transmitting the first information and the data to the artificial intelligence model (420); and A non-transient storage medium comprising commands to execute the operation of displaying the second information on a first execution screen of an application for connecting the phone call through the display (330) of the electronic device while receiving a request for connection of the phone call.

Images