Electronic device, method, and non-transitory computer-readable recording medium for generating summary information through conversation analysis

Abstract

Disclosed is an electronic device. The electronic device of the present disclosure may comprise: a communication circuit; a display; at least one processor including a processing circuit; and a memory for storing instructions. The electronic device makes it possible to: acquire conversation content with a caller identification number, which is not stored in the memory, on the basis of connection of a call received from the caller identification number; identify, on the basis of the conversation content, a relationship level corresponding to the caller identification number in order to determine whether to register the caller identification number in a contacts application; determine, on the basis of the identified relationship level, a summary setting such that at least one of the type of information included in summary information about the conversation content or the amount of the summary information is differentially acquired; acquire the summary information about the conversation content on the basis of the determined summary setting; and store the summary information in order to provide the summary information via the display on the basis of reception of a subsequent call from the caller identification number.

Description

Electronic device, method, and non-transitory computer-readable recording medium for generating summary information through conversation analysis

[0001] Embodiments of the present disclosure relate to an electronic device, a method, and a non-transitory computer-readable recording medium for generating summary information through conversation analysis.

[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.

[0003] Generative AI models can generate data or content corresponding to input and provide the generated content. As the development of deep learning models used as generative AI models advances, the quality of the data or content they provide is also improving. The types of generation tasks provided by generative AI models (e.g., large multimodal model (LMM), large language model (LLM), large vision model (LVM)) may include, for example, text generation, image generation, code generation, speech generation, and / or video generation.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] According to one embodiment, an electronic device may include at least one processor including communication circuitry, a display, processing circuitry, and a memory storing instructions.

[0006] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain conversation content with a caller identification number that is not stored in the memory based on a call being connected from the caller identification number.

[0007] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the conversation content, a relationship level corresponding to the caller identification number to determine whether to register the caller identification number in a contact application.

[0008] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine a summary setting such that at least one of a type of information included in summary information of the conversation and an amount of the summary information is differentially obtained based on the identified relationship level.

[0009] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain summary information about the conversation content based on the determined summary settings.

[0010] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to store the summary information for providing the summary information via the display based on a subsequent call reception from the caller identification number.

[0011] According to one embodiment, a method of controlling an electronic device may include obtaining conversation content with a caller identification number based on a call being connected from a caller identification number that is not stored in a memory of the electronic device.

[0012] According to one embodiment, a method of controlling an electronic device may include an operation of checking a relationship level corresponding to the caller identification number based on the conversation content to determine whether to register the caller identification number in a contact application.

[0013] According to one embodiment, a control method of an electronic device may include an operation of determining a summary setting so that at least one of a type of information included in summary information of conversation content and an amount of the summary information is differentially obtained based on the identified relationship level.

[0014] According to one embodiment, a method for controlling an electronic device may include an operation of obtaining summary information about the conversation content based on the determined summary settings.

[0015] According to one embodiment, a method of controlling an electronic device may include storing the summary information to provide the summary information through a display of the electronic device based on a subsequent call reception from the caller identification number.

[0016] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions that cause an electronic device to obtain conversation content with a caller identification number that is not stored in a memory of the electronic device based on a call being connected from the caller identification number.

[0017] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine, based on the conversation content, a relationship level corresponding to the caller identification number to determine whether to register the caller identification number in a contact application.

[0018] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine a summary setting such that at least one of a type of information included in summary information of the conversation and an amount of the summary information is differentially obtained based on the identified relationship level.

[0019] According to one embodiment, the one or more programs may include instructions that cause the electronic device to obtain summary information about the conversation content based on the determined summary settings.

[0020] In one embodiment, the one or more programs may include instructions that cause the electronic device to store the summary information for providing the summary information via a display of the electronic device based on subsequent call receipts from the caller identification number.

[0021] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0022] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0023] FIG. 2 is a flowchart illustrating an operation of differentially obtaining summary information according to a relationship level with a sender determined based on the content of a conversation with the sender, in an electronic device according to one embodiment.

[0024] FIG. 3 is a diagram illustrating an operation of an electronic device according to one embodiment of the present invention for storing a caller identification number in a contact application based on a relationship level with the caller being at the first level.

[0025] FIG. 4 is a diagram illustrating an operation of an electronic device according to one embodiment when a subsequent call is received from a caller identification number whose relationship level is the first level.

[0026] FIG. 5 is a diagram illustrating an operation of displaying different user interfaces depending on a relationship level when a subsequent call is received in an electronic device according to an embodiment.

[0027] FIGS. 6A and 6B are diagrams illustrating an operation of an electronic device according to one embodiment of the present invention to edit keywords based on user input and to modify summary information based on the edited keywords.

[0028] FIG. 7A is a diagram illustrating an operation of obtaining a profile image stored in a contact application when the relationship level is the first level in an electronic device according to one embodiment.

[0029] FIG. 7b is a diagram illustrating an operation of obtaining a profile image stored in a contact application when the relationship level is the first level in an electronic device according to an embodiment.

[0030] FIG. 8 is a diagram for explaining an operation of storing summary information as a memo of a sender identification number based on the relationship level with the sender being a second level in an electronic device according to one embodiment.

[0031] FIG. 9A is a diagram illustrating an operation of providing additional information of summary information stored as a memo in an electronic device according to one embodiment.

[0032] FIG. 9b is a diagram illustrating an operation of an electronic device according to one embodiment when a subsequent call is received from a caller identification number whose relationship level is a second level.

[0033] FIG. 10 is a diagram for explaining an operation of storing summary information and negative content as a memo of a sender identification number based on the relationship level with the sender being the third level in an electronic device according to one embodiment.

[0034] FIG. 11 is a diagram illustrating an operation of an electronic device according to one embodiment when a subsequent call is received from a caller identification number whose relationship level is a third level.

[0035] FIG. 12 is a diagram illustrating an operation of providing summary information through a cover display when an electronic device including a cover display according to one embodiment receives a subsequent call.

[0036] FIG. 13 is a diagram illustrating an operation of providing a list of recommended answers based on summary information in one area of ​​a display when a foldable electronic device according to one embodiment receives a subsequent call.

[0037] FIG. 14 is a diagram illustrating an operation of providing summary information when an HMD (head mounted display) device receives a subsequent call according to one embodiment.

[0038] FIG. 15 is a diagram illustrating an operation of displaying a background screen generated based on summary information when an electronic device according to one embodiment receives a subsequent call.

[0039] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0040] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0041] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0042] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0043] The number of processors (120) may be one or more. For example, the processor (120) may have a multi-core processor structure such as a dual core, quad core, or hexa core.

[0044] The processor (120) can control the operations of the electronic device (101) by executing instructions stored in the memory (130). For example, the processor (120) can correspond to a plurality of processors that collectively perform a plurality of operations by dividing them among the processors.

[0045] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0046] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0047] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0048] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0049] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0050] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0051] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0052] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0053] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0054] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0055] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0056] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0057] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0058] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0059] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0060] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0061] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0062] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0063] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0064] FIG. 2 is a flowchart illustrating an operation of differentially obtaining summary information according to a relationship level with a sender determined based on the content of a conversation with the sender, in an electronic device according to one embodiment.

[0065] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0066] According to one embodiment, operations 210 to 260 may be understood to be performed in a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1).

[0067] Referring to FIG. 2, in operation 210, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may obtain the conversation content with the caller identification number based on the connection of a call received from a caller identification number that is not stored in the memory of the electronic device (e.g., the memory (130) of FIG. 1).

[0068] In one embodiment, the caller identification number may include at least one of a communication identification code, a telephone number, or a user identification code.

[0069] In one embodiment, the electronic device may record a conversation during a call (or a connected call). In one embodiment, the recording function may be initiated by the user's selection or may be initiated automatically when the call begins, depending on the user's settings.

[0070] In one embodiment, the conversation may include at least one of a conversation via a phone call (e.g., a voice call or a text call) or a conversation via a text message.

[0071] In one embodiment, in operation 220, the electronic device may determine, based on the conversation content, a relationship level corresponding to the caller identification number to determine whether to register the caller identification number in the contact application.

[0072] In one embodiment, the electronic device may analyze the conversation using an artificial intelligence model.

[0073] In one embodiment, the AI ​​model may include a large language model (LLM). In one embodiment, the AI ​​model may be stored in the memory of the electronic device or in an external server (e.g., server (108) of FIG. 1).

[0074] LLM refers to a language model based on an artificial neural network that has learned a large amount of text data through pre-training. LLMs can contain significantly more parameters (e.g., over 10 billion) than conventional language models. LLMs can utilize a transformer artificial neural network structure based on the attention mechanism.

[0075] The attention mechanism is a technology that helps artificial intelligence models focus (attention) on important parts of input data. The attention mechanism can be used to predict output data by predicting the degree to which a portion of time-series input data (e.g., input data such as voice or video, or input data of a neural network layer) contributes to the intermediate or final output of the neural network. Recurrent neural networks (RNNs), which sequentially process each element of a sequence, exhibit poor prediction performance when there is information dependency between long time-series distances. However, the attention mechanism can consider information dependency between long time-series distances by controlling the degree of weight concentration (attention) within the overall (or partial) context of the input data.

[0076] A Transformer can be structured as an encoder-decoder. The encoder processes input data and outputs compressed information (e.g., a contextual representation), while the decoder processes the compressed information and outputs token-based data. Each encoder and decoder can include an independent attention network, or a cross-attention network connecting the encoder and decoder.

[0077] For example, LLM training may involve pre-training and / or fine-tuning. Pre-training involves training the LLM to acquire general linguistic knowledge using large amounts of text data. For example, this may involve self-supervised learning, where the LLM predicts the next word based on the previous word sequence in the text string. Fine-tuning involves training the LLM to be suitable for a specific domain (e.g., chatbot, translation, summarization, Q&A) or task. The LLM may undergo additional supervised learning (or adaptive learning) based on the pre-trained model using a dataset tailored to the domain's purpose. The LLM can perform tasks with text inputs containing natural language, called prompts.

[0078] For example, fine-tuning can be omitted during LLM learning. The user can control the prompts provided to the LLM to enhance its performance on the desired task. Similar to in-context learning or zero-shot / few-shot learning, prompts can be supplemented with examples of the task and / or guidance for performing the task. Publicly available LLMs include BERT (Bidirectional Encoder Representations from Transformer) and GPT (generative pre-trained transformer).

[0079] In addition to text, LLM can also receive additional inputs, including visual information (including video). The visual information can be converted into text through separate preprocessing (e.g., image recognition, scene recognition) and included in the prompt to generate a response. Another example is a video encoder that converts the input image into text-aligned image embeddings. Using the text embeddings corresponding to the input text, a separately trained model (e.g., a large multimodal model) can generate a response.

[0080] The term "LLM" can refer to the language neural network model itself, but it can also refer to the model of an LLM-based application (e.g., chatbot, translation, summarization, text classification, sentence generation). For example, an LLM-based chatbot like ChatGPT or an LLM-based translator can also be referred to as "LLM."

[0081] "LLM" may also include an inference engine utilizing the LLM neural network model. For example, "inputting an input prompt to the LLM" may mean "inputting the input prompt to an inference engine based on the LLM." For example, "the output of the LLM for the input prompt" may mean the output information of the last neural network layer of the LLM (or output information modified through further processing) obtained when the input prompt is input to the LLM-based inference engine.

[0082] According to one embodiment, the electronic device can analyze the conversation by converting a spoken voice into text using automatic speech recognition (ASR), generating an LLM prompt including the converted text, and inputting the generated LLM prompt into the LLM.

[0083] In one embodiment, the electronic device can extract keywords contained in a conversation using an artificial intelligence model. In one embodiment, the electronic device can analyze the conversation by extracting keywords.

[0084] According to one embodiment, the electronic device may display summary information with highlighted keywords on the display during or after a call connection. According to one embodiment, the electronic device may receive user input to delete at least one of the keywords or add a new keyword. According to one embodiment, the electronic device may modify the summary information based on keywords edited based on user input. According to one embodiment, the operation of editing keywords based on user input will be described in more detail with reference to FIGS. 6A and 6B below.

[0085] In one embodiment, the electronic device may analyze the conversation conducted during a call connection to determine the relationship level with the caller (or the conversation partner). In one embodiment, if the caller ID is not stored, the relationship level may be related to the importance of the relationship with the caller (e.g., high / medium / low), the type of conversation (e.g., information exchange, small talk, advertising, interview), and the topic of the conversation (e.g., education, economic activities, travel, personal matters).

[0086] According to one embodiment, the electronic device may perform caller name determination and emotion recognition of the user of the electronic device based on the analyzed conversation content.

[0087] For example, an electronic device can determine the caller's name based on the content of a call or message. The caller's name may include at least one of a title by which the user addresses the caller (e.g., Kim Samsung, Park, Gil-dong's mother), the caller's position or occupation (e.g., plumber, lawyer Kim, Samsung Electronics service center), the caller's relationship (e.g., second cousin, company boss), or the topic of the conversation (e.g., math academy interview, political party survey, washing machine repair). According to one embodiment, the caller's name may include at least one of a word, a combination of words (e.g., Groton + Seohee + teacher, Samsung + refrigerator + moving), or a sentence modifier / descriptive expression (e.g., rib restaurant visited on May 1, preparing for honeymoon).

[0088] In one embodiment, the sender name may be determined based on a pattern of sender names pre-stored in the contact application. For example, the electronic device may infer a pattern from pre-stored sender names through natural language analysis and generate a sender name by inputting the pattern. In one embodiment, when generating a sender name using LLM, the electronic device may add pre-stored sender names as examples to a prompt and include a guide in the prompt to enable generation based on similar name patterns, thereby generating sender names with similar patterns.

[0089] In one embodiment, the electronic device may determine the caller's name using natural language processing techniques, such as keyword extraction or summarization, from input text (e.g., call content or message content). For example, when determining the caller's name using natural language processing techniques, the processing may be rule-based or statistical, or may utilize LLM.

[0090] In one embodiment, an electronic device can predict the emotional state of a user (or recipient) of the electronic device by analyzing the voice input and conversation content during a call. In one embodiment, the emotional information may include not only the user's emotions (e.g., happiness, sadness, anger, fear, excitement), but also the user's attitude expressed in the conversation (e.g., positive, negative, skeptical, emphasized).

[0091] In one embodiment, an electronic device may recognize a user's emotions using an artificial neural network. For example, the artificial neural network may be trained using voice feature information (e.g., spectral information, pitch, volume, intonation) or conversational text converted through ASR and labeled emotional information as training data.

[0092] In one embodiment, the electronic device can determine the level of relationship with the caller (or caller ID) based on at least one of the following: summary information about the conversation, the caller's name, or the caller's emotion. For example, the electronic device can determine whether the caller has a negative or positive emotion based on the tone and pitch of the voice in a previous call, and determine the level of relationship with the caller based on the emotion.

[0093] In one embodiment, the electronic device may determine the relationship level as Level 1 based on the analyzed conversation content, whether the caller's identification number indicates a possibility of continued contact, whether the conversation involves a personal conversation, or whether there is a favorable impression based on perceived emotions. In one embodiment, the electronic device may determine the relationship level with the caller as Level 1 if the relationship with the caller is an important relationship.

[0094] According to one embodiment, the electronic device may determine the relationship level as the first level based on whether keywords are included in content of other applications more than a set number of times. For example, the electronic device may determine the relationship level with the sender as the first level if a keyword that appears repeatedly in a conversation with the sender (e.g., a voice call or message) is also frequently detected in content of other applications (e.g., screenshots in the gallery, tags, keywords in notes, messages). According to one embodiment, the electronic device may set the importance level of sentences related to the keyword to high and include them in the summary information.

[0095] In one embodiment, the electronic device may determine the relationship level as a second level based on the analyzed conversation content, whether the caller ID number is not included in the continuation of contact or a personal conversation, or whether the likeability is not confirmed based on the perceived emotion.

[0096] In one embodiment, the electronic device may determine the relationship level as a third level based on the analyzed conversation content, whether the content includes advertising, whether a negative reaction is identified based on perceived emotions, or whether the call ends without a response.

[0097] In one embodiment, in operation 230, the electronic device may determine a summary setting such that at least one of a type of information included in the summary information of the conversation and an amount of the summary information is differentially acquired based on the identified relationship level.

[0098] According to one embodiment, the storage items obtained as summary information according to the relationship level may be as shown in [Table 1] below.

[0099] Relationship Level Level 1 (High Importance) Level 2 (Medium Importance) Level 3 (Low Importance) Storage Information Contact Storage Information: - Caller Name - Conversation Summary 1: Summary Down - Conversation Summary 2: Summary Medium - Conversation Summary 3: Summary Up Call Log Storage Information: - Call Time / Time Contact Storage X Call Log Storage Information: - Caller Name - Conversation Summary 1: Summary Down - Conversation Summary 2: Summary Medium - Call Time / Time Contact Storage X Call Log Storage Information: - Caller Name - Conversation Summary 1: Summary Down - Conversation Summary 2: Summary Down - Call Time / Time

[0100] Referring to [Table 1], there may be multiple conversation summaries. For example, there may be a conversation summary 1 that summarizes the most important topic in one sentence (e.g., conversation summary 1 (513, 523) in FIG. 5), and a conversation summary 2 that consists of 1 to 3 sentences containing more specific details than conversation summary 1 (e.g., conversation summary 2 (514, 524) in FIG. 5). For example, if the relationship level is level 1, conversation summary 3 that contains detailed conversation content with a longer length than conversation summaries 1 and 2 may be included. Conversation summary 3 is a long summary that is not displayed on the call reception or call history screen, and conversation history can be organized by various criteria (e.g., by time zone or conversation topic). Conversation summaries 1, 2, and 3 can each be summarized with different summary settings (e.g., summary high, medium, and low), and for example, when summarizing is performed using LLM, the summary settings can each be implemented with different LLM prompt templates. According to one embodiment, the electronic device can summarize the conversation with the caller identification number based on the determined relationship level. For example, the summary settings can be changed based on the relationship level. According to one embodiment, the summary settings can include at least one of a summary length, a summary type, or a summary template.

[0101] In one embodiment, LLM can be used for conversation summarization. The summary settings can be controlled by modifying the prompts input to the LLM. For example, conversations with first-level callers can have longer summaries, while conversations with second- or third-level callers can have shorter summaries. For example, an electronic device can set a longer summary for important conversation types, such as interviews, and a shorter summary for conversation types, such as small talk.

[0102] In one embodiment, when summarizing a conversation, emotional information recognized during the conversation may be used, or emotional information may be included in the summary information.

[0103] According to one embodiment, the summary settings according to the relationship level may be as shown in [Table 2] below.

[0104] Level 1 Level 2 / 3 [system] You are an assistant who summarizes the conversation between two people. You must **never** create content that is not in the conversation. [user] Step 1. Classify the conversation below by topic Step 2. Create a title for each topic and summarize the details within { ...} sentences Step 3. List the summarized content in order of importance Step 4. Create a title that can express the entire conversation in one sentence Step 5. Output the result according to the given format ** Result format ** Title: Topic 1: - Summary content - Summary content Topic 2: - Summary content - Summary content ** Summary target ** : ... : ... : ... : ...[assistant][system]You are an assistant who summarizes the conversation between two people. You should **never** create content that is not in the conversation. You should understand the relationship between the two people and the content of the conversation and summarize only the key points briefly. It should be summarized based on the information provided by [user]. Please summarize the conversation below in { ...} sentences. **Summary Target** : ... : ... : ... : ...[assistant]

[0105] According to one embodiment, the electronic device may determine a summary setting to obtain summary information including at least one of a noun, modifier, tone, nuance, or conversational habit included in the conversation of the sender corresponding to the sender identification number in the conversation, based on the relationship level being determined as the first level. For example, the electronic device may perform a summary including all modifiers, tone, nuance, and speaking habits that make up the sentence centered on the noun spoken by the sender in the conversation with the sender at the first level. According to one embodiment, the electronic device may perform a summary including the sender's intention, nuance, and emotion inferred from the voice while deleting meaningless information such as filler words or repeated information. According to one embodiment, the electronic device may perform a summary by giving slightly more weight to specific keywords to which the user (or recipient) responded. According to one embodiment, the electronic device may determine the maximum number of characters of summary information based on N% or less of the information and voice delivered by the sender, but may increase the maximum number of characters of the summary information if it is determined that the user frequently responds and has high interest. According to one embodiment, the electronic device may determine the summary setting to obtain summary information including nouns, excluding modifiers, tone, nuance, and conversation habits included in the conversation of the sender corresponding to the sender identification number among the conversation contents, based on the relationship level being determined to be the second level. For example, the electronic device may perform the summary by simplifying the conversation contents with the sender at the second or third level based on core information such as nouns that the sender is trying to convey, and removing emotional modifiers or unnecessary modifiers as much as possible.

[0106] In one embodiment, in operation 240, the electronic device may obtain summary information about the conversation content based on the determined summary settings. For example, the summary information may include summary text.

[0107] In one embodiment, the electronic device may perform a summary of the conversation during or after the call is completed.

[0108] In one embodiment, the electronic device can reflect the user's emotions in the conversation content for each conversation unit and perform a summary based on the user's emotions. In one embodiment, the summary information may include emotional information.

[0109] In one embodiment, in operation 250, the electronic device may store summary information to provide summary information via a display of the electronic device (e.g., display module (160) of FIG. 1) based on subsequent call reception from the caller identification number. In one embodiment, the electronic device may store the summary information as a conversation history for the caller identification number.

[0110] In one embodiment, the conversation history may include at least one of summary information (e.g., summary text), sender name, relationship level, related schedule, or related notes.

[0111] In one embodiment, the summary information may be provided to the user via contacts or call history for verification. In one embodiment, the summary information may be provided when a subsequent call is received from the caller ID number.

[0112] In one embodiment, the conversation history may include contact information and call log information. In one embodiment, the contact information may be a collection of contact information separately stored by the user. For example, the contact information may include at least one of the following: caller name, phone number, email address, group information, work information, address, relationship information, website address, memo, or calendar information.

[0113] In one embodiment, call log information may include call history with caller identification numbers, regardless of whether contact information is stored. For example, call log information may include at least one of the caller's phone number, caller name, most recent call time and duration, or whether the call was received or received. In one embodiment, at least some information (e.g., summary information) included in the call log information may be automatically deleted after a specified period of time.

[0114] According to one embodiment, the electronic device may display an execution screen for registering a caller identification number in a contact application based on the termination of a connected call after the relationship level is determined to be the first level. According to one embodiment, the electronic device may automatically input at least some of the multiple items included in the execution screen based on at least one of the caller name or summary information. According to one embodiment, the operation for storing caller identification information in the contact application will be described in more detail with reference to FIG. 3 below.

[0115] In one embodiment, when an electronic device receives a subsequent call from the same caller ID number, it may display summary information on a waiting screen before connecting the call. In one embodiment, the summary information may include multiple call content summaries. In one embodiment, the summary information may be a summary of all of the call content.

[0116] In one embodiment, when a call is received, a relationship level determined based on previous conversations corresponding to the caller ID may be identified. In one embodiment, the electronic device may provide a different user interface (UI) on the waiting screen before connecting the call based on the relationship level. For example, a higher relationship level (e.g., Level 1) may provide more summary information than a lower relationship level (e.g., Level 2).

[0117] According to one embodiment, when the relationship level is the first level, the UI displayed when a subsequent call is received will be described below with reference to FIG. 4.

[0118] According to one embodiment, an operation of providing information about a caller identification number with a different UI depending on the relationship level when receiving a subsequent call is described below with reference to FIG. 5.

[0119] According to one embodiment, when a connected call is terminated after the relationship level is determined to be Level 2, the electronic device may store at least one of the caller's name or summary information as a memo corresponding to the caller's identification number without registering the caller's identification number in the contact application. According to one embodiment, the operation of storing summary information in the call log when the relationship level is Level 2 will be described below with reference to FIG. 8.

[0120] According to one embodiment, an operation of providing summary information as a memo of call history information when the relationship level is the second level will be described below with reference to FIG. 9a.

[0121] According to one embodiment, the user interface displayed when receiving a subsequent call from a second level caller identification number is described below with reference to FIG. 9b.

[0122] In one embodiment, the electronic device may store a memo corresponding to the caller identification number, including at least one of the caller name or summary information, along with negative content, without registering the caller identification number in a contact application, based on the connection being terminated after the relationship level is determined to be the third level.

[0123] In one embodiment, the electronic device may provide an intuitive visual display that reflects color information corresponding to the emotion of the sender.

[0124] According to one embodiment, the operation of storing summary information in a call record when the relationship level is the third level is described below with reference to FIG. 10.

[0125] According to one embodiment, the user interface displayed when receiving a follow-up call from a third level caller identification number is described below with reference to FIG. 11.

[0126] In one embodiment, the electronic device may adjust the relationship level of a caller ID based on the user's response to subsequent calls from the caller ID. For example, if the subsequent call is rejected or the conversation of the subsequent call includes a negative response more than a preset number of times, the electronic device may lower the relationship level of the caller ID. For example, if the electronic device receives a preset number of user inputs rejecting subsequent calls from a caller ID of a third level, the electronic device may adjust the relationship level of the caller ID to a fourth level, automatically rejecting subsequent calls.

[0127] In one embodiment, if the conversation content of a subsequent call includes a set number of positive responses, the electronic device may increase the relationship level for the caller ID. For example, if a set number of user inputs connecting a subsequent call from a third-level caller ID are received, the electronic device may adjust the relationship level of the caller ID to a second level, with negative responses removed.

[0128] According to one embodiment, summary information may be provided upon receiving a subsequent call even if the electronic device includes a cover display, is a foldable device, or is a head-mounted display (HMD) device. According to one embodiment, the summary information provision operation according to the form factor of the electronic device will be described below with reference to FIGS. 12, 13, and 14.

[0129] According to one embodiment, the electronic device can generate and display a background screen of a call application based on summary information. According to one embodiment, the operation of generating a background screen of a call application based on summary information will be described below with reference to FIG. 15.

[0130] In this way, the AI ​​model selects and provides minimal information about frequently contacted callers, even if they aren't related enough to be saved in your contacts. Information about unsaved caller ID numbers can be easily stored in your contacts application. Furthermore, by providing key information during subsequent calls, it facilitates smoother conversations with callers.

[0131] FIG. 3 is a diagram illustrating an operation of an electronic device according to one embodiment of the present invention for storing a caller identification number in a contact application based on a relationship level with the caller being at the first level.

[0132] Referring to FIG. 3, an electronic device (e.g., electronic device (101) of FIG. 1 or processor (120) of FIG. 1) can determine a relationship level with a caller based on at least one of conversation content or emotion obtained during a call connection with a caller identification number that is not stored in a memory (e.g., memory (130) of FIG. 1).

[0133] According to one embodiment, the electronic device may display caller-related information via the call application's execution screen (310) for a specified period of time (e.g., n seconds) during or after a call ends. For example, the caller-related information may include a caller identification number (311), a caller name (312), or conversation summary information (313).

[0134] In one embodiment, in operation 320, the electronic device may determine whether it can determine a relationship with the sender.

[0135] According to one embodiment, when the relationship level with the sender is determined to be the first level in importance (operation 320 - Yes), the electronic device may display sender-related information for a specified period of time and then display an execution screen (330) of a contact application for storing sender identification information.

[0136] According to one embodiment, the execution screen (330) of the contact application may include multiple items. According to one embodiment, the electronic device may input at least some of the multiple items based on conversation content analysis. For example, the electronic device may input the sender name item (331), group information (332), schedule information (333), or memo (334) based on conversation content analysis. According to one embodiment, conversation summary information may be input in memo (334).

[0137] According to one embodiment, the electronic device may store the entered contact information in a memory (e.g., memory (130) of FIG. 1) upon receiving user input for storage after inputting and displaying some of the surrender of the contact application (330).

[0138] In one embodiment, if it is determined that the relationship level with the sender cannot be determined (Operation 320 - No), in operation 340, the electronic device may display a message requesting the user to confirm the relationship with the sender. In one embodiment, if the relationship level with the sender cannot be determined, operation 340 may be omitted, and the summary information may not be stored.

[0139] In this way, by analyzing the conversation with the sender and automatically entering some items in the contact application, the user can reduce the hassle of having to enter them manually.

[0140] FIG. 4 is a diagram illustrating an operation of an electronic device according to one embodiment when a subsequent call is received from a caller identification number whose relationship level is the first level.

[0141] Referring to FIG. 4, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may, based on the relationship level with the caller identification number being determined in the first step, automatically input and store some items of the execution screen (410) of the contact application through conversation content analysis, and when a subsequent call with the caller identification number is received, the stored summary information may be displayed through the call connection waiting screen (420). According to one embodiment, the summary information may include keywords that are highly relevant at the time of call reception (e.g., time or date) or related to content requiring a user's response, and the keywords may be highlighted.

[0142] According to one embodiment, the call connection waiting screen (420) may include a send message button (421) for rejecting a call via a message, a button (422) for receiving a text call, and a button (423) for receiving a voice call.

[0143] In one embodiment, when a user input selecting a send message button (421) is received, the electronic device may display a call connection waiting screen (430) containing a plurality of messages (431). In one embodiment, the plurality of messages (431) may include messages automatically generated by considering an expected conversation flow based on at least one of previous conversation content, summary information, or emotions.

[0144] According to one embodiment, when a user input is received selecting a button (422) to receive a text call, the electronic device may display a text call screen (440). According to one embodiment, the text call screen (440) may include recommended replies (441) generated based on at least one of the previous conversation content, summary information, or emotions. According to one embodiment, the electronic device may generate the next recommended replies based on the progress of the conversation.

[0145] According to one embodiment, when a user input is received for selecting a button (423) to receive a voice call, the electronic device may display a voice call connection screen (450). According to one embodiment, the voice call connection screen (450) may display summary information (451) of the conversation during the voice call connection. According to one embodiment, when a user's confirmation or search for related information is required, the electronic device may search for related information using an artificial intelligence model and provide a summary, and when the provided summary is selected, the electronic device may display an execution screen of an application including the original information.

[0146] FIG. 5 is a diagram illustrating an operation of displaying different user interfaces depending on a relationship level when a subsequent call is received in an electronic device according to an embodiment.

[0147] Referring to FIG. 5, an electronic device (e.g., electronic device (101) of FIG. 1 or processor (120) of FIG. 1) may display a different user interface template of a call waiting screen depending on the relationship level.

[0148] In one embodiment, when a subsequent call is received from a caller identification number whose relationship level is Level 1, the electronic device may display a call waiting screen (510) of the first template. For example, the first template may include a caller name (511), a caller identification number (512), and previous conversation summary information (513, 514) stored in a contact application. In one embodiment, the previous conversation summary information (513, 514) may include a conversation summary 1 (513) that summarizes the most important topic in one sentence, and a conversation summary 2 (514) that consists of 1 to 3 sentences that include more specific details than the conversation summary 1 (513).

[0149] In one embodiment, when a follow-up call is received from a caller identification number with a relationship level of Level 2, the electronic device may display a call waiting screen (520) of a second template. For example, the second template may include a caller identification number (521), a caller name (522) stored in a call log, and previous conversation summary information (523, 524). In one embodiment, the previous conversation summary information (523, 524) may include a conversation summary 1 (523) that summarizes the most important topic in one sentence, and a conversation summary 2 (524) that consists of 1 to 3 sentences that include more specific details than conversation summary 1 (523).

[0150] According to one embodiment, the conversation summary information (513, 514) of the first template and the conversation summary information (523, 524) of the second template may differ in the type and length of the summary information.

[0151] According to one embodiment, the conversation summary information (513, 514) of the first template is stored in the contact application even if the call history is deleted, but the conversation summary information (523, 524) of the second template may be deleted when the call history is deleted.

[0152] FIGS. 6A and 6B are diagrams illustrating an operation of an electronic device according to one embodiment of the present invention to edit keywords based on user input and to modify summary information based on the edited keywords.

[0153] Referring to FIGS. 6A and 6B, when an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) receives a call from a caller identification number that is not stored in a memory (e.g., the memory (130) of FIG. 1), the electronic device may display a call reception standby screen (610) including the caller identification number.

[0154] According to one embodiment, when a user input for selecting a button (611) for call connection is received, the electronic device may display a call connection screen (620). According to one embodiment, the electronic device may analyze the conversation content using an artificial intelligence model (e.g., LLM) and display a plurality of keywords (621) included in the conversation content on the call connection screen (620).

[0155] According to one embodiment, the electronic device may display a call connection screen (620) including a plurality of keywords (621) for a specified period of time and then display a call connection screen (630) including summary information (631) of the conversation content obtained through an artificial intelligence model. According to one embodiment, the plurality of keywords included in the summary information (631) may be highlighted.

[0156] In one embodiment, when a user input (641) is received that touches summary information about a conversation with a sender, the electronic device may set a high weighting for the conversation content during the touch. In one embodiment, the electronic device may minimize summaries of conversation content with high weighting and extract keywords contained therein as important keywords.

[0157] In one embodiment, when a user input (651) is received to select a highlighted keyword during a call connection with a caller or after the call connection is terminated, the electronic device may de-highlight the selected keyword and exclude the selected keyword from the summary information.

[0158] According to one embodiment, the electronic device may provide summary information (661) reflecting added keywords and deleting excluded keywords based on user input through a call termination screen (660).

[0159] FIG. 7A is a diagram illustrating an operation of obtaining a profile image stored in a contact application when the relationship level is the first level in an electronic device according to one embodiment.

[0160] Referring to FIG. 7A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may perform an image search for a caller's name through a browser application (710) using an artificial intelligence model. According to one embodiment, the electronic device may input a representative image among the searched images as a profile image (721) of the execution screen (720) of the contact application.

[0161] FIG. 7b is a diagram illustrating an operation of obtaining a profile image stored in a contact application when the relationship level is the first level in an electronic device according to an embodiment.

[0162] Referring to FIG. 7B, when a user input for selecting a profile image (721) is received, the electronic device may display a screen (730) for changing the profile image. According to one embodiment, the screen (730) for changing the profile image may include an image list (731).

[0163] In one embodiment, the image list (731) may include images corresponding to the sender's name generated through an artificial intelligence model, images searched by the artificial intelligence model, or images with a high degree of relevance within a photo album application. In one embodiment, when the electronic device receives a user input selecting an AI (artificial intelligence) image button included in the screen (730) for changing the profile image, the electronic device may generate and search for more images and include them in the image list (731).

[0164] FIG. 8 is a diagram for explaining an operation of storing summary information as a memo of a sender identification number based on the relationship level with the sender being a second level in an electronic device according to one embodiment.

[0165] Referring to FIG. 8, an electronic device (e.g., electronic device (101) of FIG. 1 or processor (120) of FIG. 1) can determine a relationship level with a caller based on at least one of conversation content or emotion obtained during a call connection with a caller identification number that is not stored in a memory (e.g., memory (130) of FIG. 1).

[0166] According to one embodiment, the electronic device may display caller-related information via the call application's execution screen (810) during a call or for a specified period of time after the call ends. For example, the caller-related information may include a caller identification number, caller name, or conversation summary information.

[0167] In one embodiment, in operation 820, the electronic device may determine whether it can determine a relationship with the caller. In one embodiment, if the electronic device frequently contacts the caller, or does not save the caller in a contact application, but still wants to check the caller upon receiving a call, or if there is a context for the conversation, the electronic device may determine the relationship level with the caller to be Level 2. For example, if regular contact is expected based on keywords such as "delivery," "water purifier," or "regular maintenance," or if the user is favorable toward the caller based on the conversation, the electronic device may determine the relationship level with the caller to be Level 2.

[0168] In one embodiment, if the relationship level with the caller is determined to be the second level of importance, the electronic device may display caller-related information for a specified period of time and then store caller identification information (831, 832) in the call log (830). For example, the electronic device may store the caller name (831) and summary information (832) in the call log (830).

[0169] In one embodiment, the caller name (831) and summary information (832) stored in the call record (830) may be deleted together when the call record (830) is deleted.

[0170] According to one embodiment, the electronic device can search for an image for the caller's name (831) through an artificial intelligence model and automatically generate a representative image as a profile image (840) included in the call record (830).

[0171] FIG. 9A is a diagram illustrating an operation of providing additional information of summary information stored as a memo in an electronic device according to one embodiment.

[0172] Referring to FIG. 9A, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display summary information (832) on a corresponding call record among multiple call records for a caller identification number. According to one embodiment, the summary information (832) may include key content from the conversation.

[0173] In one embodiment, when a user input for selecting summary information (832) is received, the electronic device may further display details (910) related to the summary information (832). In one embodiment, the details (910) may include at least one of conversation summary 1 of [Table 1] (e.g., conversation summary 1 (513, 523) of FIG. 5) or conversation summary 2 (e.g., conversation summary 2 (514, 524) of FIG. 5).

[0174] FIG. 9b is a diagram illustrating an operation of an electronic device according to one embodiment when a subsequent call is received from a caller identification number whose relationship level is a second level.

[0175] Referring to FIG. 9B, based on the relationship level with the caller identification number being determined in the second step, if caller-related information is stored in the call history through conversation content analysis, when a subsequent call with the caller identification number is received, the stored summary information may be displayed via the call connection waiting screen (920). According to one embodiment, the summary information may include keywords that are highly relevant to the time of call reception (e.g., time or date) or related to content requiring the user's response, and such keywords may be highlighted.

[0176] According to one embodiment, the call connection waiting screen (920) may include a send message button (921) for rejecting a call via a message, a button (922) for receiving a text call, and a button (923) for receiving a voice call.

[0177] In one embodiment, upon receiving a user input selecting the Send Message button (921), the electronic device may display a call connection waiting screen (930) containing a plurality of messages (931). In one embodiment, the plurality of messages (931) may include automatically generated messages considering an expected conversation flow based on at least one of previous conversation content, summary information, or emotions.

[0178] According to one embodiment, when a user input is received for selecting a button (922) to receive a text call, the electronic device may display a text call screen (940). According to one embodiment, the text call may include a function of converting a voice received from the caller into text through ASR (Automatic Speech Recognition) and displaying it, and converting a text input by the user into voice through TTS (Text to Speech) and delivering it to the caller. According to one embodiment, the text call screen (940) may include recommended replies (941) generated based on at least one of previous conversation content, summary information, or emotion. According to one embodiment, the electronic device may generate next recommended replies based on the progress of the conversation. According to one embodiment, when the user selects one of the recommended replies, the selected recommended reply may be converted into voice through TTS and delivered to the caller.

[0179] According to one embodiment, when a user input is received for selecting a button (923) to receive a voice call, the electronic device may display a voice call connection screen (950). According to one embodiment, the voice call connection screen (950) may display summary information (951) of the conversation during the voice call connection. According to one embodiment, when a user's confirmation or search for related information is required, the electronic device may search for related information using an artificial intelligence model and provide a summary, and when the provided summary is selected, the electronic device may display an execution screen of an application including the original information.

[0180] In one embodiment, in the case of receiving a subsequent call with a second level caller identification number, the operation is similar to that of receiving a subsequent call with a first level caller identification number as illustrated in FIG. 4, but if the call record is deleted or the user maintains the account and changes the electronic device to another electronic device, the conversation content and summary information related to the call record may be deleted.

[0181] FIG. 10 is a diagram for explaining an operation of storing summary information and negative content as a memo of a sender identification number based on the relationship level with the sender being the third level in an electronic device according to one embodiment.

[0182] Referring to FIG. 10, an electronic device (e.g., electronic device (101) of FIG. 1 or processor (120) of FIG. 1) can determine a relationship level with a caller based on at least one of conversation content or emotion obtained during a call connection with a caller identification number that is not stored in a memory (e.g., memory (130) of FIG. 1).

[0183] According to one embodiment, the electronic device may display caller-related information via the call application's execution screen (1010) during a call or for a specified period of time after the call ends. For example, the caller-related information may include a caller identification number, caller name (1011), or conversation summary information (1012).

[0184] In one embodiment, in operation 1020, the electronic device may determine whether it can determine the relationship with the caller. In one embodiment, if the user responds negatively, or feedback corresponding to the response (e.g., ending without response), or a negative voice style is detected, the electronic device may determine the relationship level with the caller as Level 3.

[0185] In one embodiment, if the relationship level with the caller is determined to be a third level of importance, the electronic device may display caller-related information for a specified period of time and then store information (1031) related to caller identification information in the call log (1030). For example, the electronic device may store the caller's name and summary information in the call log (1030). In one embodiment, the summary information may include minimal information.

[0186] In one embodiment, the caller name and summary information stored in the call log (1030) may be deleted together when the call log (1030) is deleted.

[0187] According to one embodiment, the electronic device may automatically generate a profile image (1040) that includes only the color and caller name text corresponding to the negative group to intuitively represent that the caller identification number is included in the negative group.

[0188] FIG. 11 is a diagram illustrating an operation of an electronic device according to one embodiment when a subsequent call is received from a caller identification number whose relationship level is a third level.

[0189] Referring to FIG. 11, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may, based on the determination of the relationship level with the caller identification number in the third step, analyze the conversation content and, if caller-related information is stored in the call record, when a subsequent call with the caller identification number is received, the caller name (1111) and the stored summary information (1112) may be displayed through a call connection waiting screen (1110). According to one embodiment, the summary information (1112) includes minimum information, and keywords included in the summary information (1112) may be highlighted.

[0190] According to one embodiment, the electronic device may automatically display a text call screen (1120) if no user input for call connection is received while displaying the call connection waiting screen (1110) for a specified period of time.

[0191] According to one embodiment, the text call screen (1120) may include a button (1121) for ending the call, a button (1122) for switching to a voice call, and recommended replies (1123) generated based on at least one of the previous conversation content, summary information, or emotions. According to one embodiment, the electronic device may generate the next recommended replies based on the progress of the conversation.

[0192] In one embodiment, when a follow-up call of a caller identification number of a third level is received, if the button (1121) for ending the call via the text call screen (1120) is selected a set number of times, the electronic device may adjust the relationship level of the caller identification number to a fourth level to automatically reject (e.g., reject with a message or reject the call) when a follow-up call is received.

[0193] In one embodiment, when a subsequent call with a third level caller identification number is received, if the button (1122) for switching to a voice call via the text call screen (1120) is selected a set number of times or a positive response or voice style of the user is confirmed, the electronic device may adjust the relationship level of the caller identification number to the second level.

[0194] FIG. 12 is a diagram illustrating an operation of providing summary information through a cover display when an electronic device including a cover display receives a subsequent call according to an embodiment. For example, the electronic device including a cover display may be a foldable electronic device including a first housing and a second housing rotatably connected to the first housing, and disposed within the first housing and the second housing. The cover display may be a display visible when the electronic device is fully folded.

[0195] Referring to FIG. 12, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display summary information and recommendation information as minimal information through a small display, such as a cover display or a watch. For example, the minimal summary information displayed may include minimal summary information stored in a call history, rather than summary information stored in a contact application.

[0196] For example, a call waiting screen (1210) displayed through a cover display may include a caller name (1211) and summary information (1212). According to an embodiment, when a user input for call connection is received through the call waiting screen (1210), the electronic device may display a call connection screen (1220). According to an embodiment, the call connection screen (1220) may include a caller name (1211) and summary information (1222) including minimum information. The summary information (1222) including minimum information may include key summary information.

[0197] FIG. 13 is a diagram illustrating an operation of providing a list of recommended answers based on summary information in one area of ​​a display when a foldable electronic device receives a subsequent call according to an embodiment. For example, the foldable electronic device may include a first housing and a second housing rotatably connected to the first housing, and may include an electronic device capable of folding / unfolding displays disposed in the first housing and the second housing.

[0198] Referring to FIG. 13, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) may include a flexible display (e.g., a display module (160) of FIG. 1) including a left region (1310) and a right region (1320) based on a hinge that rotatably connects a first housing and a second housing.

[0199] According to one embodiment, the electronic device may display call control-related buttons in the left area (1310). According to one embodiment, the electronic device may display summary information (1311) of a previous call and a list of recommended answers (1312) generated in relation to the summary information (1311) in the right area (1320).

[0200] FIG. 14 is a drawing for explaining an operation of providing summary information when a head mounted display (HMD) device, which is mounted on a user's head and can display various images or text information to implement virtual reality or augmented reality according to one embodiment, receives a follow-up call.

[0201] Referring to FIG. 14, when an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) is displaying a virtual screen (1410) through a display (e.g., the display module (160) of FIG. 1) and a call is received, the electronic device may display a call waiting screen (1411) as a pop-up screen. According to one embodiment, the electronic device may display summary information (1412) related to the caller identification number for which the call was received as a pop-up screen together with the call waiting screen (1411) or within the call waiting screen (1411). According to one embodiment, the electronic device may also display a list of recommended answers together with the summary information (1412).

[0202] FIG. 15 is a diagram illustrating an operation of displaying a background screen generated based on summary information when an electronic device according to one embodiment receives a subsequent call.

[0203] Referring to FIG. 15, an electronic device (e.g., electronic device (101) of FIG. 1 or processor (120) of FIG. 1) may display a call connection screen (1510) when a subsequent call is received from a caller identification number and a user input for call connection is received.

[0204] In one embodiment, the call connection screen (1510) may include a background screen (1511) generated based on summary information stored in relation to the caller identification number. In one embodiment, the background screen (1511) may be generated based on the content of a previous conversation with the caller. For example, if a swimming-related conversation was previously conducted with the caller, when a subsequent call is received from the caller identification number and a user input for call connection is received, the electronic device may generate a swimming-related background screen (1511) and display the call connection screen (1510) including the generated background screen (1511).

[0205] According to one embodiment, in FIG. 15, a background screen (1511) generated based on summary information is displayed on a call connection screen (1510), but this is not limited thereto, and a background screen (1511) generated based on summary information may also be displayed on a call waiting screen.

[0206] According to one embodiment, an electronic device may include at least one processor including communication circuitry, a display, processing circuitry, and a memory storing instructions.

[0207] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain conversation content with a caller identification number that is not stored in the memory based on a call being connected from the caller identification number.

[0208] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the conversation content, a relationship level corresponding to the caller identification number to determine whether to register the caller identification number in a contact application.

[0209] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine a summary setting such that at least one of a type of information included in summary information of the conversation and an amount of the summary information is differentially obtained based on the identified relationship level.

[0210] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain summary information about the conversation content based on the determined summary settings.

[0211] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to store the summary information for providing the summary information via the display based on a subsequent call reception from the caller identification number.

[0212] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to perform caller name determination and emotion recognition of a user of the electronic device based on the conversation content.

[0213] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine the relationship level based on at least one of the summary information, the sender name, or the emotion.

[0214] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine the relationship level as a first level based on the content of the conversation, whether the caller identification number includes a possibility of continuation of contact or a personal conversation, or whether there is affection based on the perceived emotion.

[0215] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display an execution screen for registering the caller identification number in the contact application based on the connection being terminated after the relationship level is determined to be the first level.

[0216] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to automatically input at least some of a plurality of items included in the execution screen based on at least one of the sender name or the summary information.

[0217] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to analyze the conversation content by extracting keywords included in the conversation content through an artificial intelligence model.

[0218] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine the relationship level as the first level based on the keywords being included in content of other applications a set number of times or more.

[0219] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain the summary information, including at least one of a noun, a modifier, a tone, a nuance, or a conversational habit, included in the conversation of the sender corresponding to the caller identification number among the conversational contents, based on the relationship level being determined as the first level.

[0220] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine the relationship level as a second level based on the conversation content, whether the caller identification number is likely to be in contact or whether a personal conversation is not included, or whether a liking is not confirmed based on the recognized emotion.

[0221] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to store at least one of the caller name or the summary information as a memo corresponding to the caller identification number without registering the caller identification number in the contact application, based on the connection being terminated after the relationship level is determined to be the second level.

[0222] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain the summary information, including nouns, excluding modifiers, tone, nuances, and conversational habits included in the conversation of the sender corresponding to the caller identification number among the conversation contents, based on the relationship level being determined as the second level.

[0223] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine the relationship level as a third level based on whether the conversation content includes advertisement content, whether a negative reaction is identified based on the recognized emotion, or whether the call ends without a response.

[0224] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to store, without registering the caller identification number in the contact application, at least one of the caller name or the summary information along with negative content as a memo corresponding to the caller identification number based on the connection being terminated after the relationship level is determined to be the third level.

[0225] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to adjust the relationship level of the caller identification number to a fourth level that automatically rejects a subsequent call based on a set number of user inputs rejecting a subsequent call from the caller identification number of the third level being received.

[0226] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to adjust the relationship level of the caller identification number to a second level with the negative content deleted based on a set number of user inputs connecting a subsequent call from the caller identification number of the third level being received.

[0227] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to extract keywords included in the conversation content through the artificial intelligence model.

[0228] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the summary information with the keywords highlighted on the display.

[0229] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a user input to delete at least one of the keywords or to add a new keyword.

[0230] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to modify the summary information based on keywords edited based on the user input.

[0231] According to one embodiment, a method of controlling an electronic device may include obtaining conversation content with a caller identification number based on a call being connected from a caller identification number that is not stored in a memory of the electronic device.

[0232] According to one embodiment, a method of controlling an electronic device may include an operation of checking a relationship level corresponding to the caller identification number based on the conversation content to determine whether to register the caller identification number in a contact application.

[0233] According to one embodiment, a control method of an electronic device may include an operation of determining a summary setting so that at least one of a type of information included in summary information of conversation content and an amount of the summary information is differentially obtained based on the identified relationship level.

[0234] According to one embodiment, a method for controlling an electronic device may include an operation of obtaining summary information about the conversation content based on the determined summary settings.

[0235] According to one embodiment, a method of controlling an electronic device may include storing the summary information to provide the summary information through a display of the electronic device based on a subsequent call reception from the caller identification number.

[0236] In one embodiment, the operation of confirming the relationship level may include determining the sender name and recognizing the emotions of the user of the electronic device based on the conversation content.

[0237] According to one embodiment, the operation of determining the relationship level may determine the relationship level based on at least one of the summary information, the sender name, or the emotion.

[0238] In one embodiment, the operation of checking the relationship level may determine the relationship level as the first level based on the content of the conversation, whether the caller identification number is likely to continue contact or includes a personal conversation, or whether there is affection based on the recognized emotion.

[0239] According to one embodiment, a control method of an electronic device may further include an action of displaying an execution screen for registering the caller identification number in the contact application based on the connection call being terminated after the relationship level is determined to be the first level.

[0240] According to one embodiment, the control method of the electronic device may further include an operation of automatically inputting at least some items among a plurality of items included in the execution screen based on at least one of the sender name or the summary information.

[0241] According to one embodiment, the method may further include an operation of analyzing the conversation content by extracting keywords included in the conversation content through an artificial intelligence model.

[0242] According to one embodiment, the operation of checking the relationship level may determine the relationship level as the first level based on the keywords being included in the content of other applications a set number of times or more.

[0243] According to one embodiment, the operation of determining the summary setting may determine the summary setting to obtain summary information including at least one of a noun, modifier, tone, nuance, or conversation habit included in the conversation content of the sender corresponding to the sender identification number among the conversation content, based on the relationship level being determined as the first level.

[0244] In one embodiment, the operation of checking the relationship level may determine the relationship level as a second level based on the content of the conversation, whether the caller identification number is likely to be in continuity of contact or whether a personal conversation is not included, or whether the perceived emotion is not confirmed to be favorable.

[0245] According to one embodiment, a control method of an electronic device may further include an operation of storing at least one of the caller name or the summary information as a memo corresponding to the caller identification number without registering the caller identification number in the contact application, based on the connection call being terminated after the relationship level is determined to be the second level.

[0246] According to one embodiment, the operation of determining the summary setting may determine the summary setting to obtain summary information including nouns, excluding modifiers, tone, nuances, and conversation habits included in the conversation content of the sender corresponding to the sender identification number among the conversation content, based on the relationship level being determined as the second level.

[0247] In one embodiment, the action of determining the relationship level may determine the relationship level as a third level based on whether the conversation content includes advertising content, whether a negative reaction is confirmed based on the recognized emotion, or whether the call ends without a response.

[0248] According to one embodiment, a control method of an electronic device may further include an operation of storing the caller identification number as a memo corresponding to the caller identification number, without registering the caller identification number in the contact application, along with negative content, at least one of the caller name or the summary information, based on the connection being terminated after the relationship level is determined to be the third level.

[0249] According to one embodiment, the method may further include an operation of extracting keywords included in the conversation content through an artificial intelligence model.

[0250] According to one embodiment, the control method of the electronic device may further include an action of displaying the summary information with the keywords highlighted on the display.

[0251] According to one embodiment, the method of controlling an electronic device may further include receiving a user input for deleting at least one of the keywords or adding a new keyword.

[0252] According to one embodiment, the control method of the electronic device may further include an operation of modifying the summary information based on keywords edited based on the user input.

[0253] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions that cause an electronic device to obtain conversation content with a caller identification number that is not stored in a memory of the electronic device based on a call being connected from the caller identification number.

[0254] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine, based on the conversation content, a relationship level corresponding to the caller identification number to determine whether to register the caller identification number in a contact application.

[0255] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine a summary setting such that at least one of a type of information included in summary information of the conversation and an amount of the summary information is differentially obtained based on the identified relationship level.

[0256] According to one embodiment, the one or more programs may include instructions that cause the electronic device to obtain summary information about the conversation content based on the determined summary settings.

[0257] In one embodiment, the one or more programs may include instructions that cause the electronic device to store the summary information for providing the summary information via a display of the electronic device based on subsequent call receipts from the caller identification number.

[0258] According to one embodiment, the one or more programs may include instructions that cause the electronic device to determine the name of the caller and recognize the emotion of the user of the electronic device based on the conversation content.

[0259] In one embodiment, the one or more programs may include instructions that cause the electronic device to determine the relationship level based on at least one of the summary information, the sender name, or the emotion.

[0260] In one embodiment, the one or more programs may include instructions that cause the electronic device to determine the relationship level as a first level based on the content of the conversation, whether the caller ID number is likely to be in contact or includes a personal conversation, or whether there is affection based on the perceived emotion.

[0261] According to one embodiment, the one or more programs may include instructions that cause the electronic device to display an execution screen for registering the caller identification number in the contact application based on the connection being terminated after the relationship level is determined to be the first level.

[0262] According to one embodiment, the one or more programs may include instructions that cause the electronic device to automatically input at least some of the plurality of items included in the execution screen based on at least one of the sender name or the summary information.

[0263] According to one embodiment, the one or more programs may include instructions that cause the electronic device to analyze the conversation content by extracting keywords included in the conversation content through an artificial intelligence model.

[0264] In one embodiment, the one or more programs may include instructions that cause the electronic device to determine the relationship level as the first level based on the keywords being included in content of other applications a set number of times or more.

[0265] According to one embodiment, the one or more programs may include instructions that cause the electronic device to obtain the summary information, including at least one of a noun, modifier, tone, nuance, or conversational habit included in the conversation of the sender corresponding to the caller identification number among the conversation contents, based on the relationship level being determined as the first level.

[0266] In one embodiment, the one or more programs may include instructions that cause the electronic device to determine the relationship level as a second level based on the conversation content, whether the caller identification number is likely to be in contact, whether a personal conversation is not included, or whether a liking is not confirmed based on the perceived emotion.

[0267] According to one embodiment, the one or more programs may include instructions that cause the electronic device to store at least one of the caller name or the summary information as a memo corresponding to the caller identification number without registering the caller identification number in the contact application, based on the connection being terminated after the relationship level is determined to be the second level.

[0268] According to one embodiment, the one or more programs may include instructions that cause the electronic device to obtain the summary information, including nouns, excluding modifiers, tone, nuances, and conversational habits, contained in the conversation of the sender corresponding to the caller identification number among the conversation contents, based on the relationship level being determined as the second level.

[0269] In one embodiment, the one or more programs may include instructions that cause the electronic device to determine the relationship level as a third level based on the content of the conversation, whether the conversation includes advertising content, whether a negative reaction is identified based on the perceived emotion, or whether the call ends without a response.

[0270] In one embodiment, the one or more programs may include instructions that cause the electronic device to, based on the connection being terminated after the relationship level is determined to be the third level, store the caller identification number as a memo corresponding to the caller identification number, without registering the caller identification number in the contact application, along with at least one of the caller name or the summary information, along with negative content.

[0271] In one embodiment, the one or more programs may include instructions that cause the electronic device to adjust the relationship level of the caller identification number to a fourth level that automatically rejects subsequent calls based on a set number of user inputs rejecting subsequent calls from the caller identification number of the third level being received.

[0272] In one embodiment, the one or more programs may include instructions that cause the electronic device to adjust the relationship level of the caller identification number to a second level with the negative content deleted based on a set number of user inputs connecting a subsequent call from the caller identification number of the third level being received.

[0273] According to one embodiment, the one or more programs may include instructions that cause the electronic device to extract keywords included in the conversation content through the artificial intelligence model.

[0274] In one embodiment, the one or more programs may include instructions that cause the electronic device to display the summary information with the keywords highlighted on the display.

[0275] In one embodiment, the one or more programs may include instructions that cause the electronic device to receive user input to delete at least one of the keywords or to add a new keyword.

[0276] In one embodiment, the one or more programs may include instructions that cause the electronic device to modify the summary information based on keywords edited based on the user input.

[0277] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0278] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0279] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0280] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0281] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0282] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, communication circuit; display; At least one processor comprising a processing circuit; and memory for storing instructions; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Obtaining conversation content with a caller identification number based on a call being connected from a caller identification number not stored in the above memory, In order to determine whether to register the caller identification number in the contact application, the relationship level corresponding to the caller identification number is checked based on the conversation content, Based on the above-determined relationship level, a summary setting is determined so that at least one of the type of information included in the summary information of the conversation content and the amount of the summary information is differentially obtained, Obtain summary information about the conversation based on the summary settings determined above, An electronic device that stores said summary information to provide said summary information through said display based on subsequent call reception from said caller identification number.

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the above conversation content, determine the caller's name and perform emotion recognition of the user of the electronic device, An electronic device that determines the relationship level based on at least one of the summary information, the sender name, or the emotion.

3. In paragraph 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the above conversation content, the relationship level is determined as the first level based on the possibility of continued contact with the caller identification number or the inclusion of a personal conversation, or the presence of liking based on the above recognized emotion. After the above relationship level is determined to be the first level and the connected call is terminated, an execution screen for registering the caller identification number in the contact application is displayed, An electronic device that automatically inputs at least some of a plurality of items included in the execution screen based on at least one of the sender name or the summary information.

4. In paragraph 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: The above conversation content is analyzed by extracting keywords included in the above conversation content through an artificial intelligence model, An electronic device that determines the relationship level as the first level based on the number of times the above keywords are included in the contents of other applications.

5. In paragraph 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that obtains summary information including at least one of a noun, modifier, tone, nuance, or conversational habit included in the conversation of the sender corresponding to the caller identification number among the conversation contents, based on the relationship level being determined as the first level.

6. In paragraph 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the above conversation content, the relationship level is determined as the second level based on the possibility of continuation of contact with the caller identification number or the absence of personal conversation, or the lack of confirmation of liking based on the above recognized emotion. An electronic device that, based on the connection call being terminated after the relationship level is determined to be the second level, stores at least one of the caller name or the summary information as a memo corresponding to the caller identification number without registering the caller identification number in the contact application.

7. In paragraph 6, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that obtains summary information including nouns, excluding modifiers, tone, nuances, and conversation habits contained in the conversation of the sender corresponding to the caller identification number among the conversation contents, based on the relationship level being determined as the second level.

8. In paragraph 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the above conversation content, if the content of the advertisement is included, if a negative reaction is confirmed based on the above recognized emotion, or if the call ends without a response, the relationship level is determined to be the third level. An electronic device that, based on the connection call being terminated after the relationship level is determined to be the third level, stores the caller identification number as a memo corresponding to the caller identification number, without registering the caller identification number in the contact application, along with at least one of the caller name or the summary information, along with negative content.

9. In paragraph 8, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on a set number of user inputs rejecting subsequent calls from the caller identification number of the third level, the relationship level of the caller identification number is adjusted to a fourth level that automatically rejects subsequent calls. An electronic device that adjusts the relationship level of the caller identification number to a second level from which the negative content is deleted based on a set number of user inputs connecting subsequent calls from the caller identification number of the third level.

10. In paragraph 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Extract keywords included in the conversation through the above artificial intelligence model, The above summary information with the above keywords highlighted is displayed on the above display, Receiving user input to delete at least one of the above keywords or add a new keyword, An electronic device that modifies the summary information based on keywords edited based on the user input.

11. In a method for controlling an electronic device, An operation of obtaining conversation content with a caller identification number based on a call being connected from a caller identification number that is not stored in the memory of the electronic device; An action of checking the relationship level corresponding to the caller identification number based on the conversation content to determine whether to register the caller identification number in the contact application; An operation of determining a summary setting so that at least one of the type of information included in the summary information of the conversation content and the amount of the summary information is differentially obtained based on the confirmed relationship level; An operation of obtaining summary information about the conversation content based on the summary settings determined above; and A control method of an electronic device, comprising: storing the summary information to provide the summary information through a display of the electronic device based on a subsequent call reception from the caller identification number; 12. In paragraph 11, The action to check the above relationship level is: Based on the above conversation content, determine the caller's name and perform emotion recognition of the user of the electronic device, A control method of an electronic device, wherein the relationship level is determined based on at least one of the summary information, the sender name, or the emotion.

13. In paragraph 12, The action to check the above relationship level is: Based on the above conversation content, the relationship level is determined as the first level based on the possibility of continued contact with the caller identification number or the inclusion of a personal conversation, or the presence of liking based on the above recognized emotion. The above method, An operation of displaying an execution screen for registering the caller identification number in the contact application based on the connection call being terminated after the relationship level is determined to be the first level; and A control method of an electronic device further comprising: an operation of automatically entering at least some items among a plurality of items included in the execution screen based on at least one of the sender name or the summary information.

14. In paragraph 13, Further comprising an action of analyzing the conversation content by extracting keywords included in the conversation content through an artificial intelligence model; The action to check the above relationship level is: A control method of an electronic device, wherein the relationship level is determined as the first level based on the fact that the above keywords are included in the contents of other applications a set number of times or more.

15. A non-transitory computer-readable recording medium storing one or more programs, wherein the one or more programs are: Obtaining conversation content with a caller identification number based on a call being connected from a caller identification number that is not stored in the memory of the electronic device; In order to determine whether to register the caller identification number in the contact application, the relationship level corresponding to the caller identification number is checked based on the conversation content, Based on the above-determined relationship level, a summary setting is determined so that at least one of the type of information included in the summary information of the conversation content and the amount of the summary information is differentially obtained, Obtain summary information about the conversation based on the summary settings determined above, A recording medium comprising instructions for storing the summary information to provide the summary information through a display of the electronic device based on subsequent call reception from the caller identification number.

Images