Electronic device and method for processing external connection information included in message in electronic device

Abstract

An electronic device according to one embodiment may comprise: a communication circuit; a display; an audio output circuit; at least one processor; and a memory for storing instructions. The instructions, when executed individually or collectively by the at least one processor, instruct the electronic device to: in response to identifying reception of a first message including external connection information, acquire first summary information related to first content that can be provided through the external connection information; identify at least one message including a first text related to the first content among messages stored in the memory of the electronic device and received from an external electronic device of an external user who transmitted the first message; generate, using a first artificial intelligence model and on the basis of the first summary information related to the first content and the first text, a second message including the first summary information and a second text related to the first text; and output, through the audio output circuit, audio data representing the first summary information and the second text related to the first text. Other embodiments may be included.

Description

Method for processing external connection information included in a message in an electronic device and an electronic device

[0001] The present disclosure relates to an electronic device and a method for processing external connection information included in a message in the electronic device.

[0002] The electronic device can display the contents of the received message through a display or output it as audio data.

[0003] If the settings of the function for outputting the content of a message as audio data based on the user input of the electronic device are checked, the content of the received message can be output as audio data.

[0004] An electronic device according to one embodiment may include a communication circuit, a display, an audio output circuit, at least one processor, and a memory for storing instructions. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may obtain first summary information related to a first content that can be provided through the external connection information upon confirming the reception of a first message containing external connection information. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may confirm at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may generate a second message containing a second text related to the first summary information and the first text based on the first summary information and the first text using a first artificial intelligence model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may output audio data representing the first summary information and the second text related to the first text through the audio output circuit.

[0005] A method for processing external connection information included in a message in an electronic device according to one embodiment may include, upon confirming the reception of a first message containing external connection information, an operation of obtaining first summary information related to a first content that can be provided through said external connection information. The method according to one embodiment may include an operation of confirming at least one message containing a first text related to said first content among messages received from an external electronic device of an external user who transmitted the first message stored in the memory of the electronic device. The method according to one embodiment may include an operation of generating a second message containing a second text related to said first summary information and said first text based on said first summary information and said first text using a first artificial intelligence model. The method according to one embodiment may include an operation of outputting audio data representing said first summary information and said second text related to said first text through an audio output circuit.

[0006] In a non-volatile storage medium storing instructions according to one embodiment, the instructions are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation may include, upon confirming the reception of a first message containing external connection information, an operation of obtaining first summary information related to a first content that can be provided through the external connection information. The at least one operation according to one embodiment may include an operation of confirming at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device. The at least one operation according to one embodiment may include an operation of generating a second message containing a second text related to the first summary information and the first text based on the first summary information and the first text using a first artificial intelligence model. The at least one operation according to one embodiment may include an operation of outputting audio data representing the first summary information and the second text related to the first text through the audio output circuit.

[0007] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0008] FIG. 2a is a block diagram of an electronic device according to one embodiment.

[0009] FIG. 2b is a block diagram illustrating the configuration of a processor and an AI model according to one embodiment.

[0010] FIG. 2c is a block diagram illustrating the configuration of a message processing unit according to one embodiment.

[0011] FIG. 3 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0012] FIG. 4 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0013] FIG. 5 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0014] FIG. 6 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0015] FIG. 7a is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0016] FIG. 7b is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0017] FIG. 8 is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0018] FIG. 9 is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0019] FIG. 10 is a drawing for explaining a generative artificial intelligence system according to one embodiment.

[0020] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to one embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through the server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0021] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0022] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0023] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0024] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0025] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0026] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0027] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0028] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0029] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0030] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0031] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0032] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0033] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0034] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0035] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0036] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0037] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0038] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0039] According to one embodiment, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0040] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0041] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0042] FIG. 2a is a block diagram of an electronic device according to one embodiment, FIG. 2b is a block diagram for explaining the configuration of a processor and an AI model according to one embodiment, and FIG. 2c is a block diagram for explaining the configuration of a message processing unit according to one embodiment.

[0043] Referring to FIGS. 2a and 2b, according to one embodiment, the electronic device (201) may include a processor (220), memory (230), display (260), audio output circuit (255), and communication circuit (290).

[0044] According to one embodiment, the processor (220) can perform overall control operations of the electronic device (201). According to one embodiment, the processor (220) can execute software (e.g., the program (140) of FIG. 1) to control at least one other component (e.g., a hardware or software component) of the electronic device (201) connected to the processor (220), and can perform data processing or operations based on instructions. According to one embodiment, the instructions may include instructions composed of machine language that can be processed by the electronic device (201) or the processor (220). For example, the instructions may include instructions corresponding to operation instructions used in the program.

[0045] According to one embodiment, when the processor (220) confirms the reception of a first message containing external connection information, it can confirm first summary information related to a first content that can be provided through the external connection information.

[0046] According to one embodiment, the external connection information may include URL address information.

[0047] According to one embodiment, the processor (220) checks the meta tag information included in the external connection information and can check the first content that can be provided through the external connection information based on the meta tag information included in the external connection information.

[0048] According to one embodiment, the processor (220) may use the information itself contained in the meta tag information (e.g., "OG:XXX") contained in the header information of the external connection information (e.g., URL) as summary information, rather than generating summary information using an AI model according to the Open Graph protocol defined in the HTML standard.

[0049] According to one embodiment, the processor (220) can identify an HTML source listed as "OG:XXX" according to the Open Graph protocol defined in the HTML standard as meta tag information included in the header information of external connection information (e.g., URL), and identify the HTML source listed as "OG:XXX" as a first content that can be provided through the external connection information.

[0050] According to one embodiment, when the processor (220) checks tag information (e.g., "OG: TITLE") in which at least part of the meta tag information included in the header information of the external connection information (e.g., URL) is represented as a title, the title of the external connection information included in the header information of the external connection information (e.g., URL) is identified as a first content that can be provided through the external connection information, and the first text representing the title of the external connection information is identified as first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0051] According to one embodiment, the processor (220) checks for tag information (e.g., "OG:IMAGE") that represents at least a portion of the meta tag information included in the header information of the external connection information (e.g., URL) as an image, and identifies the image to be displayed when connected to the external connection information included in the header information of the external connection information (e.g., URL) as a first content that can be provided through the external connection information, downloads the image identified as the first content, generates a second text (e.g., caption information) that interprets the downloaded image using a first AI model (231a), and identifies the second text that interprets the image as a first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0052] According to one embodiment, the first AI model (231a) is a generative AI model trained for image interpretation, and may include a Large Multi Modal Model (LMM), and may be an on-device model (231) or an external AI model (281).

[0053] According to one embodiment, the on-device AI model (231) may be configured in various ways, such as including a first AI model (231a), a second AI model (231b), and a third AI model (231c), each, or including at least one AI model among the first AI model (231a), the second AI model (231b), and the third AI model (231c), or including at least one of the first AI model (231a), the second AI model (231b), and the third AI model (231c) as one identical AI model, or including the first AI model (231a), the second AI model (231b), and the third AI model (231c) as one identical AI model.

[0054] According to one embodiment, when the processor (220) checks tag information (e.g., "OG: DESCRIPTION") which represents at least a portion of the meta tag information included in the header information of the external connection information (e.g., URL) as a description, it can identify the brief description of the external connection information included in the header information of the external connection information (e.g., URL) as a first content that can be provided through the external connection information, and identify a third text representing the brief description of the external connection information as a first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0055] According to one embodiment, the processor (220) can identify, for example, "OG:IMAGE", "OG:TITLE", and "OG:DESCIPTION" as the first summary information associated with the first content based on the summary level condition of the first summary information associated with the first content.

[0056] According to one embodiment, if the summary level condition of the first summary information related to the first content is set based on the brief information, the processor (220) may identify one of the first text representing the title of the external connection information in sequence, the second text representing an image to be displayed when connected to the external connection information, and the third text representing a brief description of the external connection information as the first summary information related to the first content.

[0057] According to one embodiment, if the summary level condition of the first summary information related to the first content is set based on detailed information, the processor (220) may identify one of the following as the first summary information related to the first content: a third text representing a brief description of external connection information, a second text interpreting an image to be displayed when connected to external connection information, and a first text representing the title of external connection information.

[0058] According to one embodiment, if the processor (220) cannot identify an HTML source that is listed as "OG:XXX" according to the Open Graph protocol defined in the HTML standard as meta tag information included in the header information of external connection information (e.g., URL), it can use the second AI model (231b) to identify first summary information related to the first content that can be provided through the external connection information.

[0059] According to one embodiment, the processor (220) can check the first summary information related to the first content that can be provided through the external connection information using the second AI model (231b) without checking the HTML source that is listed as "OG:XXX" according to the Open Graph protocol defined in the HTML standard as meta tag information included in the header information of the external connection information (e.g., URL).

[0060] According to one embodiment, the processor (220) may request first summary information related to the first content that can be provided through external connection information to the second AI model (231b).

[0061] According to one embodiment, the processor (220) identifies text included in a web page corresponding to external connection information as first content that can be provided through external connection information by using the second AI model (231b), and if it identifies a fourth text that summarizes text included in a web page corresponding to external connection information by using the second AI model (231b), it can identify the fourth text that summarizes text included in a web page corresponding to external connection information as first summary information related to the first content that can be provided through external connection information.

[0062] According to one embodiment, the processor (220) can use the second AI model (231b) to identify an image included in a web page corresponding to external connection information as first content that can be provided through external connection information, download the image included in the web page corresponding to external connection information, and use the first AI model (231a) to identify a fifth text that interprets the downloaded image as first summary information related to the first content that can be provided through external connection information.

[0063] According to one embodiment, the second AI model (231b) is a generative AI model trained to generate summary information related to the first content that can be provided through external connection information, and may include a Large Multi Modal Model (LMM), and may be an on-device model or an external AI model (281).

[0064] According to one embodiment, the processor (220) can identify at least one message including a sixth text related to a first content that can be provided through external connection information among messages received from an external electronic device of an external user that transmitted a first message stored in memory (230).

[0065] According to one embodiment, the processor (220) can identify at least one message containing a sixth text related to the first content among messages received from an external electronic device of an external user that transmitted a first message stored in memory (2301), based on first summary information related to the first content that can be provided through external connection information (e.g., first text indicating the title of the external connection information, second text interpreting an image to be displayed when connected to the external connection information, and third text indicating a brief description of the external connection information) (e.g., fourth text summarizing text included in a web page corresponding to the external connection information, and fifth text interpreting an image included in a web page corresponding to the external connection information).

[0066] For example, if the first content that can be provided through external connection information is related to "shopping," the processor (220) can check at least one message containing a sixth text related to "shopping" among the messages received from an external electronic device of an external user that transmitted the first message stored in memory (2301).

[0067] According to one embodiment, the processor (220) can identify the text included in the first message as the sixth text associated with the first content.

[0068] According to one embodiment, the processor (220) can identify the text included in at least one message received within a specified time after receiving the first message among the messages received from an external electronic device of an external user that transmitted the first message stored in memory (2301) as the sixth text related to the first content.

[0069] According to one embodiment, the processor (220) can verify at least one message including a sixth text related to the first content that can be provided through external connection information among the messages received as the external user's account information as well as the external electronic device of the external user that transmitted the first message stored in memory (230).

[0070] According to one embodiment, the processor (220) can use the third AI model (231c) to generate a second message including first summary information related to first content that can be provided through external connection information and a seventh text related to a sixth text included in at least one message.

[0071] According to one embodiment, the processor (220) may use a third AI model (231c) to generate a second message comprising a seventh text that combines one of a first text representing the title of external connection information, a second text interpreting an image to be displayed when connected to external connection information, and a third text representing a brief description of external connection information, with a sixth text included in at least one message.

[0072] According to one embodiment, the processor (220) can generate a second message by using a third AI model (231c) and synthesizing one of a fourth text summarizing text included in a web page corresponding to external connection information and a fifth text interpreting an image included in a web page corresponding to external connection information, and a sixth text included in at least one message.

[0073] According to one embodiment, the third AI model (231c) is a generative AI model trained to generate a second message for audio data output, and may include a Large Multi Modal Model (LMM), and may be an on-device model or an external AI model (281).

[0074] According to one embodiment, when the processor (220) confirms the generation of a second message comprising a first summary information related to a first content that can be provided through external connection information and a seventh text that is synthesized from a sixth text included in at least one message, it can output audio data representing the seventh text of the second message through an audio output circuit (255).

[0075] According to one embodiment, if the processor (220) fails to identify at least one message containing a sixth text related to a first content that can be provided through external connection information among the messages received from an external electronic device of an external user that transmitted a first message stored in memory (230), the processor (220) may use a third AI model (231c) to generate a second message containing one of the following: a first text indicating the title of the external connection information identified as the first summary information related to the first content, a second text interpreting an image to be displayed when connected to the external connection information, or a third text indicating a brief description of the external connection information.

[0076] According to one embodiment, if the processor (220) fails to identify at least one message containing a sixth text related to a first content that can be provided via external connection information among the messages received from an external electronic device of an external user that transmitted a first message stored in memory (230), the processor (220) may use a third AI model (231c) to generate a second message containing one of the following: a fourth text summarizing text included in a web page corresponding to external connection information identified as first summary information related to the first content, or a fifth text interpreting an image included in a web page corresponding to external connection information.

[0077] According to one embodiment, the processor (220) may generate a second message including one of the following: a first text indicating the title of the external connection information identified by the first summary information related to the first content, a second text interpreting an image to be displayed when connected to the external connection information, or a third text indicating a brief description of the external connection information, by using a third AI model (231c), regardless of at least one message including a sixth text related to the first content that can be provided through external connection information among the messages received from an external electronic device of an external user that transmitted a first message stored in memory (230).

[0078] According to one embodiment, the processor (220) may generate a second message including one of a fourth text summarizing text included in a web page corresponding to external connection information identified as first summary information related to the first content, or a fifth text interpreting an image included in a web page corresponding to external connection information, using a third AI model (231c), regardless of at least one message including a sixth text related to the first content that can be provided through external connection information among messages received from an external electronic device of an external user that transmitted a first message stored in memory (230).

[0079] According to one embodiment, the processor (220) can convert text included in the second message (e.g., one of the first text, second text, third text, fourth text and fifth text and seventh text identified by the first summary information related to the first content) into audio data using a Text to Speech (TTS) function.

[0080] According to one embodiment, the processor (220) outputs the text included in the second message (e.g., one of the first text, second text, third text, fourth text, fifth text, and seventh text identified by the first summary information related to the first content) as audio data through the audio output circuit (255), and then, upon confirming a first gesture requesting the regeneration of the second message based on the input of a user of the electronic device, can confirm the second summary information related to the first content that can be provided through external connection information.

[0081] According to one embodiment, the processor (220) can generate a third message comprising a second summary information related to the first content and a sixth text included in at least one message, and output audio data representing the eighth text of the third message through an audio output circuit (255).

[0082] According to one embodiment, the processor (220) may generate a third message including one of a first text representing the title of external connection information that can be identified as second summary information related to the first content, a second text interpreting an image to be displayed when connected to the external connection information, a third text representing a brief description of the external connection information, a fourth text summarizing text included in a web page corresponding to the external connection information, and a fifth text interpreting an image included in a web page corresponding to the external connection information, and may output audio data representing the text included in the third message.

[0083] According to one embodiment, the processor (220) outputs audio data representing text included in the second message (e.g., one of the first text, second text, third text, fourth text, fifth text, and seventh text identified by the first summary information related to the first content) through an audio output circuit (255), and then outputs a voice guidance asking whether the user wants to regenerate the second message regarding the content of the second message that newly created the first message including external connection information, and can confirm a first gesture requesting the regeneration of the second message based on the user's input in response to the voice guidance.

[0084] According to one embodiment, the processor (220) can output audio data representing text included in the second message (e.g., one of the first text, second text, third text, fourth text, fifth text, and seventh text identified by the first summary information related to the first content) through the audio output circuit (255), and then confirm a first gesture requesting the regeneration of the second message based on user input without voice guidance output.

[0085] According to one embodiment, the first gesture requesting the regeneration of the second message may include, if the electronic device is a wearable electronic device that can be worn on a part of a user, a head movement of the user wearing the wearable electronic device (e.g., nodding), a hand gesture that can be verified through the wearable electronic device, voice input and / or a designated input, etc.

[0086] According to one embodiment, the processor (220) can determine whether the request is for the creation of a third message containing more brief information than the text of the second message, or for the creation of a third message containing more detailed information than the text of the second message, based on a first gesture requesting the regeneration of the second message.

[0087] For example, the processor (220) can determine, when the electronic device is a wearable electronic device, that if the movement of the head of the user wearing the wearable electronic device is in the left-right direction, it is a request for the creation of a third message containing detailed information, and if the movement of the head of the user wearing the wearable electronic device is in the up-down direction, it is a request for the creation of a third message containing brief information.

[0088] According to one embodiment, when the processor (220) confirms a request for the creation of a third message containing more detailed information than the text of the second message based on a first gesture requesting the regeneration of the second message, it can confirm a second summary information related to the first content that can be provided through external connection information containing detailed information of the first summary information related to the first content.

[0089] According to one embodiment, the processor (220) can identify, if the first summary information related to the first content is a first text representing the title of the external connection information, a second text interpreting an image to be displayed when connected to the external connection information or a third text representing a brief description of the external connection information as the second summary information related to the first content.

[0090] According to one embodiment, if the first summary information related to the first content is a fourth text that summarizes text included in a web page corresponding to external connection information, the processor (220) compares the fourth text that summarizes text included in a web page corresponding to external connection information with the fifth text that interprets an image included in a web page corresponding to external connection information, and confirms that the fifth text that interprets an image included in a web page corresponding to external connection information is more detailed information than the fourth text that summarizes text included in a web page corresponding to external connection information, the processor (220) can identify the fifth text that interprets an image included in a web page corresponding to external connection information as the second summary information related to the first content.

[0091] According to one embodiment, if the first summary information related to the first content is a fourth text that summarizes the text included in the web page corresponding to the external connection information, the processor (220) compares the fourth text that summarizes the text included in the web page corresponding to the external connection information with the fifth text that interprets the image included in the web page corresponding to the external connection information, and confirms that the fifth text that interprets the image included in the web page corresponding to the external connection information is not more detailed information than the fourth text that summarizes the text included in the web page corresponding to the external connection information, then uses the second AI model (231b) to identify an eighth text that summarizes the text included in the web page corresponding to the external connection information in more detail than the fourth text, and identifies the eighth text that summarizes the text included in the web page corresponding to the external connection information in more detail than the fourth text as the second summary information related to the first content.

[0092] According to one embodiment, when the processor (220) confirms a request for the creation of a third message containing summary information rather than text of the second message based on a first gesture requesting the regeneration of the second message, it can confirm a second summary information related to the first content that can be provided through external connection information containing summary information of the first summary information related to the first content.

[0093] According to one embodiment, the processor (220) can identify the first text representing the title of the external connection information or the second text representing the image to be displayed when the first summary information related to the first content is connected to the external connection information as the second summary information related to the first content, when the first summary information related to the first content is a third text representing a brief description of the external connection information.

[0094] According to one embodiment, if the first summary information related to the first content is a fourth text that summarizes text included in a web page corresponding to external connection information, the processor (220) compares the fourth text that summarizes text included in a web page corresponding to external connection information with the fifth text that interprets an image included in a web page corresponding to external connection information, and confirms that the fifth text that interprets an image included in a web page corresponding to external connection information is more concise than the fourth text that summarizes text included in a web page corresponding to external connection information, then the processor can identify the fifth text that interprets an image included in a web page corresponding to external connection information as the second summary information related to the first content.

[0095] According to one embodiment, if the first summary information related to the first content is a fourth text that summarizes the text included in the web page corresponding to the external connection information, the processor (220) compares the fourth text that summarizes the text included in the web page corresponding to the external connection information with the fifth text that interprets the image included in the web page corresponding to the external connection information, and confirms that the fifth text that interprets the image included in the web page corresponding to the external connection information is not more concise than the fourth text that summarizes the text included in the web page corresponding to the external connection information, then uses the second AI model (231b) to identify a ninth text that summarizes the text included in the web page corresponding to the external connection information more concisely than the fourth text, and identifies the ninth text that summarizes the text included in the web page corresponding to the external connection information more concisely than the fourth text as the second summary information related to the first content.

[0096] According to one embodiment, when the processor (220) confirms the reception of a first message containing external connection information, it can check whether the conditions for generating a second message that can be output as audio data are met.

[0097] According to one embodiment, when the processor (220) confirms the reception of a first message containing external connection information, if it confirms that the electronic device (201) is connected to an external electronic device for audio output, it confirms that the conditions for generating a second message that can be output as audio data are satisfied, generates a second message, converts the text included in the second message into audio data using a Text to Speech (TTS) function, and transmits the converted audio data to the external electronic device through a communication circuit (290) for outputting the converted audio data through the external electronic device.

[0098] For example, the processor (220) can determine that the conditions for generating a second message are satisfied when the electronic device (201) is connected to the earbuds or vehicle, generate a second message, convert the text of the second message into audio data, and transmit the converted audio data to the earbuds or vehicle through the communication circuit (290) for outputting the converted audio data through the speaker of the earbuds or vehicle.

[0099] According to one embodiment, when the electronic device (201) is a wearable electronic device that can be worn on a part of a user's body, the processor (220) can determine whether the wearable electronic device is worn by the user by confirming the reception of a first message containing external connection information.

[0100] According to one embodiment, the processor (220) can determine that the conditions for generating a second message are satisfied when checking the settings for audio data output for a message while the wearable electronic device is worn by a user, and can generate a second message.

[0101] According to one embodiment, the processor (220) can determine that the conditions for generating a second message are satisfied when it determines that the user is not looking at the display of the wearable electronic device using the camera of the wearable electronic device while the wearable electronic device is being worn by the user, and can generate a second message.

[0102] For example, if it is confirmed that a user wearing a wearable electronic device has their eyes closed using a camera of the wearable electronic device (e.g., an eye-tracking camera), it is confirmed that the conditions for generating a second message are satisfied, and a second message can be generated.

[0103] According to one embodiment, when the processor (220) confirms the reception of a first message containing external connection information, if it confirms that a message-related application is not running or that a message-related application is running in the background on the display (260), it confirms that the conditions for creating a second message are satisfied and can create a second message.

[0104] According to one embodiment, when the processor (220) confirms the reception of a first message containing external connection information, it displays a first indicator in a part area of ​​the display (260) indicating the reception of the first message containing external connection information, and when it confirms the input of a second gesture (e.g., a long touch or a double touch, etc.) by a user requesting the creation of a second message to the first indicator, it confirms that the conditions for creating a second message are satisfied and can create a second message.

[0105] According to one embodiment, when the processor (220) confirms the reception of a first message containing external connection information, if the conditions for generating a second message that can be output as audio data are not satisfied, the first message can be displayed through the display (260).

[0106] A memory (230) according to one embodiment may be implemented substantially identically or similarly to the memory (130) of FIG. 1.

[0107] According to one embodiment, an on-device AI model (231) may be stored in the memory (230), and the on-device AI model (231) may be configured in various ways, such as including a first AI model (231a), a second AI model (231b), and a third AI model (231c), or including at least one AI model among the first AI model (231a), the second AI model (231b), and the third AI model (231c), or including at least one of the first AI model (231a), the second AI model (231b), and the third AI model (231c) as one identical AI model, or including the first AI model (231a), the second AI model (231b), and the third AI model (231c) as one identical AI model.

[0108] At least some of the on-device AI models (231) according to one embodiment can be operated as external AI models.

[0109] According to one embodiment, the on-device AI model (231) performs processing of sensitive information such as personal information, and the external AI model can perform processing of information excluding sensitive information such as personal information.

[0110] An on-device AI model (231) according to one embodiment is an artificial intelligence model implemented in an electronic device (201) and can provide various functions without a network.

[0111] According to one embodiment, a plurality of artificial intelligence models may be stored in the memory (230).

[0112] According to one embodiment, each of the plurality of AI models may be a model trained based on a specified type of learning algorithm, and may be an AI model implemented to receive various types of data (or content) as input, perform calculations, and output (or obtain) result data.

[0113] According to one embodiment, a plurality of AI models may include generative AI models.

[0114] A generative AI model according to one embodiment can generate and output new content (e.g., text, images, and / or computer code, etc.) based on learned content in response to an input prompt. For example, in an electronic device (601), learning is performed to output specific types of result data as output data using data of specified types based on a machine learning algorithm or a deep learning algorithm, thereby generating multiple AI models (e.g., machine learning models and deep learning models) that are stored in the electronic device (201), or AI models learned from an external electronic device (e.g., an external server) can be transmitted to and stored in the electronic device (201). For example, the electronic device (201) can output input data (input data) as output data of a model learned through artificial intelligence of specified types based on a machine learning algorithm or a deep learning algorithm. Machine learning algorithms include supervised learning algorithms such as linear regression and logistic regression, unsupervised learning algorithms such as clustering, visualization and dimensionality reduction, and association rule learning, and reinforcement learning algorithms, and deep learning algorithms may include Artificial Neural Networks (ANN), Deep Neural Networks (DNN), and Convolutional Neural Networks (CNN), and may further include various learning algorithms not limited to those described.The trained AI model includes at least one operation (e.g., a convolution layer or a pooling layer) for processing input data, and can be implemented to output result data by performing operations on the input data based on at least one operation.

[0115] According to one embodiment, an application that can be connected to an external AI model (281) may be stored in the memory (230).

[0116] According to one embodiment, the external AI model (281) may each include a first AI model (231a), a second AI model (231b), and a third AI model (231c), or include at least one AI model among the first AI model (231a), the second AI model (231b), and the third AI model (231c), or include the first AI model (231a), the second AI model (231b), and the third AI model (231c) as one identical AI model.

[0117] A display (260) according to one embodiment may be implemented substantially identically or similarly to the display (160) of FIG. 1.

[0118] In one embodiment, the display (260) may display a first message containing external connection information if it does not satisfy the conditions for generating a second message that can be output as audio data.

[0119] An audio output circuit (255) according to one embodiment may be implemented substantially identically or similarly to the acoustic output module (155) of FIG. 1.

[0120] An audio output circuit (255) according to one embodiment can output audio data corresponding to the text of the second message.

[0121] A communication circuit (290) according to one embodiment can form a communication connection with an external electronic device (e.g., another electronic device, or a server) using various types of communication methods and transmit and / or receive data. As described above, the communication methods may include a communication method that establishes a direct communication connection such as Bluetooth and Wi-Fi Direct, a communication method using an access point (AP) (e.g., Wi-Fi communication), or a communication method using cellular communication using a base station (e.g., 3G, 4G / LTE, 5G). Since the communication circuit (290) can be implemented as described above in the communication module (190) in FIG. 1, a redundant description is omitted.

[0122] According to one embodiment, the processor (220) may include a message processing unit (250) for generating a second message from a first message including external connection information, or the electronic device (201) may separately include a message processing unit (250).

[0123] Referring to FIG. 2c, according to one embodiment, the message processing unit (250) can perform the same function as the processor (220) that generates a first message containing external connection information into a second message.

[0124] According to one embodiment, the message processing unit (250) may include a message analysis unit (251), an external connection information processing unit (253), and a message synthesis unit (255).

[0125] According to one embodiment, the message analysis unit (251) confirms the reception of a message, and if the received message is confirmed to be a first message containing external connection information, it can transmit the external connection information included in the first message to the external connection information processing unit (253).

[0126] According to one embodiment, when the message analysis unit (251) confirms the inclusion of external connection information and text in the first message, it can transmit the external connection information included in the first message to the external connection information processing unit (253) and transmit the text included in the first message to the message synthesis unit (255).

[0127] According to one embodiment, when the external connection information processing unit (253) receives external connection information from the message analysis unit (251), it can identify first summary information related to the first content that can be provided through the external connection information using meta tag information included in the header of the external connection information or the second AI model (231b), and transmit the first summary information related to the first content that can be provided through the external connection information to the message synthesis unit (255).

[0128] According to one embodiment, when the message synthesis unit (255) receives first summary information related to the first content that can be provided through external connection information from the external connection information processing unit (253), it can identify at least one message containing a sixth text related to the first content among the messages received from the external electronic device of the external user that transmitted the first message stored in the memory (230).

[0129] According to one embodiment, the message synthesis unit (255) can generate a second message including a seventh text synthesized from a first summary information related to the first content and a sixth text included in at least one message using a third AI model (231c).

[0130] FIG. 3 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0131] Referring to FIG. 3, according to one embodiment, when a wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) confirms the reception of a first message (311) containing text (311a) (e.g., CHECK THIS! THIS IS AMAZING!!) and external connection information (311b) (e.g., WWW.samsung.com), and when the wearable electronic device (301) is worn by a user and the settings for audio data output for the message are confirmed, the wearable electronic device (301) uses a second AI model (e.g., the second AI model (231b) of FIG. 2b) to identify the text included in the web page corresponding to the external connection information (311b) (e.g., https:www.samsung.com) as the first content that can be provided through the external connection information, and the external connection information (311b) ( A fourth text (e.g., "Samsung announced a new cell phone"), which summarizes the text included on a web page corresponding to (e.g., https: / / www.samsung.com), can be identified as the first summary information related to the first content.

[0132] According to one embodiment, a wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can identify the text (311a) (e.g., CHECK THIS! THIS IS amazing!!) included in the first message (311) as the sixth text associated with the first content.

[0133] According to one embodiment, a wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can generate a second message (313) including a seventh text (313a) that synthesizes the first summary information and the first text based on the first summary information and the first text related to the first content, using a third AI model (e.g., the third AI model (231c) of FIG. 2b).

[0134] According to one embodiment, a wearable electronic device (301) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can convert the seventh text (313a) of the second message (313) into audio data using a Text to Speech (TTS) function and output the converted audio data through an audio output circuit of the electronic device (e.g., the audio output circuit (255) of FIG. 2a).

[0135] FIG. 4 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0136] Referring to FIG. 4, according to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can, upon confirming the reception of a first message containing external connection information, check tag information (e.g., “OG: TITLE”) which represents at least a part of the meta tag information included in the header information of the external connection information as a title, check the title of the external connection information included in the header information of the external connection information as a first content that can be provided through the external connection information, and check the first text representing the title of the external connection information as a first summary information related to the first content that can be provided through the external connection information.

[0137] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can verify a sixth text related to the first content included in at least one message among the messages received from an external electronic device of an external user that transmitted a first message stored in the memory of the electronic device (e.g., the memory (230) of FIG. 2a).

[0138] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to FIG. 2b) can generate a second message (411) including a seventh text that synthesizes the first text and the sixth text based on a first text representing the title of external connection information, which is first summary information related to the first content, and a sixth text related to the first content, using a third AI model (e.g., the third AI model (231c) of FIG. 2b).

[0139] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) converts the seventh text of the second message (411) into audio data using a Text to Speech (TTS) function, and after outputting the converted audio data through the audio output circuit of the electronic device (e.g., the audio output circuit (255) of FIG. 2a), if a first gesture requesting the regeneration of the second message based on the input of the user of the electronic device is confirmed, a second summary information related to the first content that can be provided through external connection information can be confirmed.

[0140] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can confirm a request for the creation of a third message containing more detailed information than the text of the second message based on a first gesture requesting the regeneration of the second message, and can confirm a second summary information related to the first content that can be provided through external connection information containing detailed information of the first summary information related to the first content.

[0141] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to FIG. 2b) can identify tag information (e.g., "OG: DESCRIPTION")_ which describes at least a portion of the meta tag information included in the header information of the external connection information, identify a first content that can be provided through the external connection information as a brief description of the external connection information included in the header information of the external connection information, and identify a third text that describes a brief description of the external connection information as a second summary information related to the first content that can be provided through the external connection information.

[0142] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to FIG. 2b) can generate a third message (413) comprising an eighth text that synthesizes the third text and the sixth text based on a third text representing a brief description of external connection information, which is second summary information related to the first content, and a sixth text related to the first content, using a third AI model (e.g., the third AI model (231c) of FIG. 2b).

[0143] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can convert the eighth text of the third message (413) into audio data using a Text to Speech (TTS) function and output the converted audio data through an audio output circuit of the electronic device (e.g., the audio output circuit (255) of FIG. 2a).

[0144] FIG. 5 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0145] Referring to FIG. 5, according to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can distinguish between the text (511a) and the external connection information (511b) included in the first message (511) when it confirms the reception of the first message (511) containing text (511a) and external connection information (511b)) (https: / www.samsung.com / sec / offer / samsung-week / ).

[0146] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can identify tag information (e.g., "OG: DESCRIPTION") that describes at least a portion of the meta tag information included in the header information of the external connection information.

[0147] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) is included in the header information of external connection information <meta property="og:description" content="삼성전자의 두 번째 인공지능(AI) 스마트폰이자 새 폴더블폰 시리즈가 프랑스 파리에서 공개된다. 삼성전자가 최초로 내놓는 갤럭시 링도 같은 날 첫 선을 보인다. 갤럭시 워치·버즈 등 신제품도 함께 소개될 예정이다..."> Identify as the first content available through external connection information, and identify "Samsung Electronics' second artificial intelligence (AI) smartphone and new foldable phone series will be unveiled in Paris, France. Samsung Electronics' first Galaxy Ring will also be introduced on the same day. New products such as the Galaxy Watch and Buds are also scheduled to be introduced..." as the third text representing a brief description of the external connection information, and obtain the third text as the first summary information related to the first content available through external connection information.

[0148] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can identify the text (511a) included in the first message (511) as the sixth text associated with the first content.

[0149] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to FIG. 2b) can identify the text (511a) ("Samsung Electronics is unveiling a new product!!") included in the first message (511) as the sixth text associated with the first content.

[0150] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can identify a sixth text (513) related to the first content included in at least one message among the messages received from an external electronic device of an external user that transmitted a first message stored in the memory of the electronic device (e.g., the memory (230) of FIG. 2a).

[0151] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can generate a second message (515) including a third text (e.g., the third AI model (231c) of FIG. 2b) which is a composite of a third text representing a brief description of external connection information, which is a first summary information related to the first content, a text (511a) included in the first message (511), and a sixth text (513) related to the first content included in at least one message ("Samsung Electronics' second artificial intelligence (AI) smartphone and new foldable phone series will be unveiled in Paris, France. Samsung Electronics' first Galaxy Ring will also be unveiled on the same day. New products such as the Galaxy Watch and Buds are also scheduled to be introduced.").

[0152] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can convert the seventh text of the second message (515) into audio data using a Text to Speech (TTS) function and output the converted audio data through an audio output circuit of the electronic device (e.g., the audio output circuit (255) of FIG. 2a).

[0153] FIG. 6 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment.

[0154] Referring to FIG. 6, according to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may, upon receiving a first message (611) containing external connection information (611a), identify tag information (e.g., "OG: DESCRIPTION") which describes at least a portion of the meta tag information included in the header information of the external connection information (611a), identify a brief description of the external connection information included in the header information of the external connection information as first content that can be provided through the external connection information, and identify a third text representing a brief description of the external connection information as first summary information related to the first content that can be provided through the external connection information (611a).

[0155] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can identify the text (613a) included in the message (613) received within the specified time as the sixth text related to the first content when it receives a message (613) containing text (613a) within the specified time after receiving a first message (611).

[0156] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can identify a sixth text (615) related to the first content included in at least one message among the messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device (e.g., the memory (230) of FIG. 2a).

[0157] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to FIG. 2b) can generate a second message (617) comprising a third text (e.g., the third AI model (231c) of FIG. 2b) which is a brief description of external connection information, which is a first summary information related to the first content, a text (613a) included in the message (613), and a seventh text that is synthesized from a sixth text (615) related to the first content.

[0158] According to one embodiment, an electronic device (201) (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can convert the seventh text of the second message (617) into audio data using a Text to Speech (TTS) function and output the converted audio data through an audio output circuit of the electronic device (e.g., the audio output circuit (255) of FIG. 2a).

[0159] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may include a communication circuit (190 of FIG. 1; 290 of FIG. 2a), a display (160 of FIG. 1; 260 of FIG. 2a), an audio output circuit (155 of FIG. 1; 255 of FIG. 2), at least one processor (120 of FIG. 1; 220 of FIG. 2a to 2b); and a memory for storing instructions (130 of FIG. 1; 230 of FIG. 2a). When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may obtain first summary information related to a first content that can be provided through the external connection information upon confirming the reception of a first message including external connection information. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can identify at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can generate a second message containing a second text related to the first summary information and the first text based on the first summary information and the first text using a first artificial intelligence model. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can output audio data representing the second text related to the first summary information and the first text through the audio output circuit.

[0160] When the commands according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can identify the first content based on meta tag information included in the external connection information. When the commands according to one embodiment are executed individually or collectively by the at least one processor, if the electronic device identifies the first content as a third text, it can generate the second message by synthesizing the first text and the third text using the first artificial intelligence model. When the commands according to one embodiment are executed individually or collectively by the at least one processor, if the electronic device identifies the first content as an image, it can identify a fourth text summarizing the image using the second artificial intelligence model, and generate the second message by synthesizing the first text and the fourth text using the first artificial intelligence model.

[0161] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may use the third artificial intelligence model to identify the first content as a fifth text summarizing the text included in the web page corresponding to the external connection information, and use the first artificial intelligence model to generate the second message by synthesizing the first text and the fifth text. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may use the third artificial intelligence model to identify the first content as an image included in the web page corresponding to the external connection information, and use the second artificial intelligence model to identify the sixth text summarizing the image, and use the first artificial intelligence model to generate the second message by synthesizing the first text and the sixth text.

[0162] According to one embodiment, when the above commands are executed individually or collectively by the at least one processor, the electronic device may generate a third message including second summary information related to the first content available through the external connection information and a seventh text related to the first text, after the electronic device outputs the second message as audio data through the audio output circuit and confirms a first gesture requesting the regeneration of the second message based on user input of the electronic device. According to one embodiment, when the above commands are executed individually or collectively by the at least one processor, the electronic device may output audio data representing the seventh text through the audio output circuit. According to one embodiment, the second summary information related to the first content may include brief information of the first summary information or detailed information of the first summary information.

[0163] The first text associated with the first content according to one embodiment may include text included in the first message.

[0164] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can identify as the first text the text included in at least one message received within a specified time after receiving the first message among the messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device can generate a second message including the first summary information and a second text related to the text included in the at least one message received within the specified time, using the first artificial intelligence model.

[0165] When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may generate the second message when it confirms the reception of the first message and confirms that the electronic device is connected to an external electronic device for outputting audio data. When the instructions according to one embodiment are executed individually or collectively by the at least one processor, the electronic device may transmit audio data corresponding to the text of the second message to the external electronic device through the communication circuit.

[0166] If the electronic device according to one embodiment is a wearable electronic device configured to be worn by a part of a user, the commands according to one embodiment, when executed individually or collectively by the at least one processor, allow the electronic device to check whether the wearable electronic device is in a state of being worn by the user upon confirming the reception of the first message. When the commands according to one embodiment, when executed individually or collectively by the at least one processor, allow the electronic device to generate the second message upon confirming the setting of audio data output for the message while the wearable electronic device is in a state of being worn by the user. When the commands according to one embodiment, when executed individually or collectively by the at least one processor, allow the electronic device to output the second text of the second message as audio data through the audio output circuit.

[0167] If the electronic device according to one embodiment is a wearable electronic device configured to be worn by a part of a user, the commands according to one embodiment, when executed individually or collectively by the at least one processor, allow the electronic device to check whether the wearable electronic device is being worn by the user upon confirming the reception of the first message. When the commands according to one embodiment, when executed individually or collectively by the at least one processor, allow the electronic device to generate the second message upon confirming, using the camera of the wearable electronic device, that the user is not looking at the display of the wearable electronic device while the wearable electronic device is being worn by the user. When the commands according to one embodiment, when executed individually or collectively by the at least one processor, allow the electronic device to output the text of the second message as audio data through the audio output circuit.

[0168] FIG. 7a is a flowchart illustrating an operation for processing external connection information included in a message in an electronic device according to one embodiment. The operations for processing external connection information included in a message may include operations 701 through 709. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.

[0169] In operation 701, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can confirm the reception of a first message containing external connection information.

[0170] According to one embodiment, the external connection information may include URL address information.

[0171] In operation 703, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can obtain first summary information related to the first content that can be provided through external connection information.

[0172] According to one embodiment, the electronic device checks meta tag information included in external connection information and can check a first content that can be provided through external connection information based on the meta tag information included in external connection information.

[0173] According to one embodiment, the electronic device checks an HTML source described as "OG:XXX" according to the Open Graph protocol defined in the HTML standard as meta tag information included in the header information of external connection information (e.g., URL), and can identify the HTML source described as "OG:XXX" as a first content that can be provided through the external connection information.

[0174] According to one embodiment, when an electronic device checks tag information (e.g., "OG: TITLE") in which at least a portion of the meta tag information included in the header information of external connection information (e.g., URL) is represented as a title, it can identify the title of the external connection information included in the header information of the external connection information (e.g., URL) as a first content that can be provided through the external connection information, and identify a first text representing the title of the external connection information as a first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0175] According to one embodiment, when an electronic device checks tag information (e.g., "OG:IMAGE") that represents at least a portion of the meta tag information included in the header information of external connection information (e.g., URL) as an image, it identifies the image to be displayed when connected to the external connection information included in the header information of external connection information (e.g., URL) as a first content that can be provided through the external connection information, downloads the image identified as the first content, generates a second text (e.g., caption information) that interprets the downloaded image using a first AI model (e.g., the first AI model (231a) of FIG. 2b), and identifies the second text that interprets the image as a first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0176] According to one embodiment, when an electronic device checks tag information (e.g., "OG: DESCRIPTION") that describes at least a portion of the meta tag information included in the header information of external connection information (e.g., URL), it can identify a brief description of the external connection information included in the header information of the external connection information (e.g., URL) as first content that can be provided through the external connection information, and can identify a third text representing a brief description of the external connection information as first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0177] According to one embodiment, when an electronic device checks, for example, "OG:IMAGE", "OG: TITLE", and "OG: DESCRIPTION" as meta tag information included in the header information of external connection information (e.g., URL), it can identify, for example, "OG:IMAGE", "OG: TITLE", and "OG: DESCRIPTION" as the first summary information associated with the first content based on the summary level condition of the first summary information associated with the first content.

[0178] According to one embodiment, if the summary level condition of the first summary information related to the first content is set based on the brief information, the electronic device may identify one of the following as the first summary information related to the first content: a first text representing the title of the external connection information in sequence, a second text interpreting an image to be displayed when connected to the external connection information, and a third text representing a brief description of the external connection information.

[0179] According to one embodiment, if the summary level condition of the first summary information related to the first content is set based on detailed information, the electronic device may identify one of the following as the first summary information related to the first content: a third text representing a brief description of external connection information, a second text interpreting an image to be displayed when connected to external connection information, and a first text representing the title of external connection information in sequence.

[0180] According to one embodiment, if the electronic device fails to identify an HTML source that is listed as "OG:XXX" according to the Open Graph protocol defined in the HTML standard as meta tag information included in the header information of external connection information (e.g., URL), it can identify first summary information related to the first content that can be provided through the external connection information using the second AI model (231b).

[0181] According to one embodiment, the electronic device can check first summary information related to first content that can be provided through external connection information using a second AI model (231b), regardless of whether "OG:XXX" is included in the header information of external connection information (e.g., URL) according to the Open Graph protocol defined in the HTML standard.

[0182] According to one embodiment, the electronic device may request first summary information related to first content that can be provided through external connection information to a second AI model (e.g., the second AI model (231b) of FIG. 2b).

[0183] According to one embodiment, the electronic device can identify text included in a web page corresponding to external connection information as first content that can be provided through external connection information by using a second AI model, and if it identifies a fourth text that summarizes the text included in the web page corresponding to external connection information by using a second AI model (231b), it can identify the fourth text that summarizes the text included in the web page corresponding to external connection information as first summary information related to the first content that can be provided through external connection information.

[0184] According to one embodiment, the electronic device can identify an image included in a web page corresponding to external connection information as first content that can be provided through external connection information by using a second AI model (231b), download the image included in the web page corresponding to external connection information, and identify a fifth text that interprets the downloaded image using a first AI model (e.g., the first AI model (231a) of FIG. 2b) as first summary information related to the first content that can be provided through external connection information.

[0185] In operation 705, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can identify at least one message containing a sixth text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device.

[0186] According to one embodiment, the electronic device can identify at least one message containing a sixth text related to the first content among messages received from an external electronic device of an external user that transmitted a first message stored in the memory of the electronic device (e.g., memory (2301) of FIG. 2a), based on first summary information related to the first content that can be provided through external connection information (e.g., first text indicating the title of the external connection information, second text interpreting an image to be displayed when connected to the external connection information, and third text indicating a brief description of the external connection information) (e.g., fourth text summarizing text included in a web page corresponding to the external connection information, and fifth text interpreting an image included in a web page corresponding to the external connection information).

[0187] According to one embodiment, the electronic device can identify the text included in the first message as the sixth text associated with the first content.

[0188] According to one embodiment, the electronic device can identify the text included in at least one message received within a specified time after receiving the first message among the messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device as the sixth text related to the first content.

[0189] In operation 707, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may generate a second message including first summary information related to the first content and seventh text related to the sixth text.

[0190] According to one embodiment, the electronic device may generate a second message comprising a synthesized sixth text included in at least one message and one of a first text representing the title of external connection information, a second text representing an image to be displayed when connected to external connection information, and a third text representing a brief description of external connection information, using a third AI model (e.g., the third AI model of FIG. 2b (231c)).

[0191] According to one embodiment, the electronic device may generate a second message comprising a seventh text that synthesizes a sixth text included in at least one message, and one of a fourth text that summarizes text included in a web page corresponding to external connection information and a fifth text that interprets an image included in a web page corresponding to external connection information, using a third AI model.

[0192] In operation 709, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may output audio data representing the seventh text of the second message.

[0193] According to one embodiment, the electronic device can convert the seventh text of the second message into audio data using a Text-to-Speech (TTS) function.

[0194] According to one embodiment, the electronic device can output the seventh text of the second message as audio data through an audio output circuit (e.g., the audio output circuit (255) of FIG. 2a).

[0195] FIG. 7b is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. The operation of processing external connection information included in a message may include operations 711 through 717. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.

[0196] In operation 711, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can confirm the reception of a first message containing external connection information.

[0197] According to one embodiment, the external connection information may include URL address information.

[0198] In operation 713, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can obtain first summary information related to the first content that can be provided through external connection information.

[0199] According to one embodiment, the electronic device checks meta tag information included in external connection information and can check a first content that can be provided through external connection information based on the meta tag information included in external connection information.

[0200] According to one embodiment, the electronic device checks an HTML source described as "OG:XXX" according to the Open Graph protocol defined in the HTML standard as meta tag information included in the header information of external connection information (e.g., URL), and can identify the HTML source described as "OG:XXX" as a first content that can be provided through the external connection information.

[0201] According to one embodiment, when an electronic device checks tag information (e.g., "OG: TITLE") in which at least a portion of the meta tag information included in the header information of external connection information (e.g., URL) is represented as a title, it can identify the title of the external connection information included in the header information of the external connection information (e.g., URL) as a first content that can be provided through the external connection information, and identify a first text representing the title of the external connection information as a first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0202] According to one embodiment, when an electronic device checks tag information (e.g., "OG:IMAGE") that represents at least a portion of the meta tag information included in the header information of external connection information (e.g., URL) as an image, it identifies the image to be displayed when connected to the external connection information included in the header information of external connection information (e.g., URL) as a first content that can be provided through the external connection information, downloads the image identified as the first content, generates a second text (e.g., caption information) that interprets the downloaded image using a first AI model (e.g., the first AI model (231a) of FIG. 2b), and identifies the second text that interprets the image as a first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0203] According to one embodiment, when an electronic device checks tag information (e.g., "OG: DESCRIPTION") that describes at least a portion of the meta tag information included in the header information of external connection information (e.g., URL), it can identify a brief description of the external connection information included in the header information of the external connection information (e.g., URL) as first content that can be provided through the external connection information, and can identify a third text representing a brief description of the external connection information as first summary information related to the first content that can be provided through the external connection information (e.g., URL).

[0204] According to one embodiment, when an electronic device checks, for example, "OG:IMAGE", "OG: TITLE", and "OG: DESCRIPTION" as meta tag information included in the header information of external connection information (e.g., URL), it can identify, for example, "OG:IMAGE", "OG: TITLE", and "OG: DESCRIPTION" as the first summary information associated with the first content based on the summary level condition of the first summary information associated with the first content.

[0205] According to one embodiment, if the summary level condition of the first summary information related to the first content is set based on the brief information, the electronic device may identify one of the following as the first summary information related to the first content: a first text representing the title of the external connection information in sequence, a second text interpreting an image to be displayed when connected to the external connection information, and a third text representing a brief description of the external connection information.

[0206] According to one embodiment, if the summary level condition of the first summary information related to the first content is set based on detailed information, the electronic device may identify one of the following as the first summary information related to the first content: a third text representing a brief description of external connection information, a second text interpreting an image to be displayed when connected to external connection information, and a first text representing the title of external connection information in sequence.

[0207] According to one embodiment, if the electronic device fails to identify an HTML source that is listed as "OG:XXX" according to the Open Graph protocol defined in the HTML standard as meta tag information included in the header information of external connection information (e.g., URL), it can identify first summary information related to the first content that can be provided through the external connection information using the second AI model (231b).

[0208] According to one embodiment, the electronic device can check first summary information related to first content that can be provided through external connection information using a second AI model (231b), regardless of whether "OG:XXX" is included in the header information of external connection information (e.g., URL) according to the Open Graph protocol defined in the HTML standard.

[0209] According to one embodiment, the electronic device may request first summary information related to first content that can be provided through external connection information to a second AI model (e.g., the second AI model (231b) of FIG. 2b).

[0210] According to one embodiment, the electronic device can identify text included in a web page corresponding to external connection information as first content that can be provided through external connection information by using a second AI model, and if it identifies a fourth text that summarizes the text included in the web page corresponding to external connection information by using a second AI model (231b), it can identify the fourth text that summarizes the text included in the web page corresponding to external connection information as first summary information related to the first content that can be provided through external connection information.

[0211] According to one embodiment, the electronic device can identify an image included in a web page corresponding to external connection information as first content that can be provided through external connection information by using a second AI model (231b), download the image included in the web page corresponding to external connection information, and identify a fifth text that interprets the downloaded image using a first AI model (e.g., the first AI model (231a) of FIG. 2b) as first summary information related to the first content that can be provided through external connection information.

[0212] In operation 715, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may generate a second message containing text identified as first summary information related to the first content.

[0213] According to one embodiment, the electronic device may generate a second message comprising one of a first text representing the title of external connection information identified by first summary information related to a first contact, a second text interpreting an image to be displayed when connected to the external connection information, and a third text representing a brief description of the external connection information.

[0214] According to one embodiment, the electronic device may download a fourth text summarizing text included in a web page corresponding to external connection information identified by a first summary information related to a first contact, and generate a second message including one of a fifth text that interprets an image included in the web page corresponding to the external connection information using a first AI model (e.g., the first AI model (231a) of FIG. 2b).

[0215] In operation 717, the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may output audio data representing the text of the second message.

[0216] According to one embodiment, the electronic device can convert text included in the second message (e.g., one of the first text, second text, third text, fourth text, and fifth text) into audio data using a Text to Speech (TTS) function.

[0217] According to one embodiment, the electronic device can output text included in the second message (e.g., one of the first text, second text, third text, fourth text and fifth text) as audio data through an audio output circuit (e.g., audio output circuit (255) of FIG. 2a).

[0218] FIG. 8 is a flowchart illustrating an operation for processing external connection information included in a message in an electronic device according to one embodiment. The operations for processing external connection information included in a message may include operations 801 to 813. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.

[0219] In operation 801, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can confirm the reception of a first message containing external connection information.

[0220] According to one embodiment, the external connection information may include URL address information.

[0221] In operation 803, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may generate a second message for outputting audio data corresponding to the first message.

[0222] According to one embodiment, the electronic device can generate a second message comprising first summary information related to a first content that can be provided through external connection information and a seventh text related to a sixth text included in at least one message.

[0223] According to one embodiment, the electronic device may generate a second message comprising a synthesized sixth text and one of a first text representing the title of external connection information (e.g., "OG: TITLE"), an image to be displayed when connected to external connection information (e.g., "OG: IMAGE"), and a third text representing a brief description of external connection information (e.g., "OG: DESCRIPTION"), and a seventh text comprising at least one text included in a message.

[0224] According to one embodiment, the electronic device may generate a second message comprising a seventh text that synthesizes a sixth text included in at least one message, and one of a fourth text that summarizes text included in a web page corresponding to external connection information and a fifth text that interprets an image included in a web page corresponding to external connection information, using a third AI model.

[0225] According to one embodiment, the electronic device can identify at least one message containing a sixth text related to the first content among messages received from an external electronic device of an external user that transmitted a first message stored in the memory of the electronic device (e.g., memory (2301) of FIG. 2a), based on first summary information related to the first content that can be provided through external connection information (e.g., first text indicating the title of the external connection information, second text interpreting an image to be displayed when connected to the external connection information, and third text indicating a brief description of the external connection information) (e.g., fourth text summarizing text included in a web page corresponding to the external connection information, and fifth text interpreting an image included in a web page corresponding to the external connection information).

[0226] According to one embodiment, the electronic device can identify the text included in the first message as the sixth text associated with the first content.

[0227] According to one embodiment, the electronic device can identify the text included in at least one message received within a specified time after receiving the first message among the messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device as the sixth text related to the first content.

[0228] According to one embodiment, the electronic device can generate a second message containing text identified as first summary information related to a first content that can be provided through external connection information.

[0229] According to one embodiment, the electronic device may generate a second message comprising one of a first text representing the title of external connection information identified by first summary information related to a first contact, a second text interpreting an image to be displayed when connected to the external connection information, and a third text representing a brief description of the external connection information.

[0230] According to one embodiment, the electronic device may generate a second message comprising one of a fourth text summarizing text included in a web page corresponding to external connection information identified by a first summary information related to a first contact, and a fifth text interpreting an image included in a web page corresponding to external connection information using a first AI model (e.g., the first AI model (231a) of FIG. 2b).

[0231] In operation 805, the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may output audio data representing the text of the second message.

[0232] According to one embodiment, the electronic device can convert the text of the second message into audio data using a Text-to-Speech (TTS) function.

[0233] According to one embodiment, the electronic device can output the text of the second message as audio data through an audio output circuit (e.g., the audio output circuit (255) of FIG. 2a).

[0234] According to one embodiment, the electronic device can convert the text of a second message (e.g., one of the first text, second text, third text, fourth text, fifth text, and seventh text identified by the first summary information related to the first content) into audio data using a Text to Speech (TTS) function.

[0235] According to one embodiment, the electronic device can output the text of the second message (e.g., one of the first text, second text, third text, fourth text, fifth text, and seventh text identified by the first summary information related to the first content) as audio data through an audio output circuit (e.g., the audio output circuit (255) of FIG. 2a).

[0236] In operation 807, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can detect a first gesture requesting the regeneration of a second message.

[0237] According to one embodiment, the electronic device can output the text of the second message as audio data through the audio output circuit of the electronic device (e.g., the audio output circuit (255) of FIG. 2a) and then confirm a first gesture requesting the regeneration of the second message based on the input of the user of the electronic device.

[0238] According to one embodiment, the electronic device outputs the text of a second message as audio data through the audio output circuit of the electronic device, and then outputs a voice guidance asking whether the user wants to regenerate the second message regarding the content of the second message that newly generated a first message including external connection information, and can confirm a first gesture requesting the regeneration of the second message based on the user's input in response to the voice guidance.

[0239] According to one embodiment, the electronic device can detect a first gesture requesting the regeneration of the second message based on user input without outputting audio data representing the text of the second message through the audio output circuit of the electronic device.

[0240] According to one embodiment, the first gesture requesting the regeneration of the second message may include, if the electronic device is a wearable electronic device that can be worn on a part of a user, a head movement of the user wearing the wearable electronic device (e.g., nodding), a hand gesture that can be verified through the wearable electronic device, voice input and / or a designated input, etc.

[0241] According to one embodiment, the electronic device can determine whether, based on a first gesture requesting the regeneration of a second message, it requests the creation of a third message containing information that is more brief than the text of the second message or the creation of a third message containing information that is more detailed than the text of the second message.

[0242] In operation 809, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can check second summary information related to the first content that can be provided through external connection information.

[0243] According to one embodiment, when an electronic device confirms a request for the creation of a third message containing more detailed information than the text of a second message based on a first gesture requesting the regeneration of a second message, it can confirm a second summary information related to the first content containing detailed information of the first summary information related to the first content.

[0244] According to one embodiment, if the first summary information related to the first content is a first text representing the title of the external connection information, the electronic device may identify a second text interpreting an image to be displayed when connected to the external connection information or a third text representing a brief description of the external connection information as the second summary information related to the first content.

[0245] According to one embodiment, if the first summary information related to the first content is a fourth text summarizing text included in a web page corresponding to external connection information, the electronic device compares the fourth text summarizing text included in the web page corresponding to external connection information with a fifth text interpreting an image included in the web page corresponding to external connection information, and confirms that the fifth text interpreting an image included in the web page corresponding to external connection information is more detailed information than the fourth text summarizing text corresponding to the web page of external connection information, then the fifth text interpreting an image included in the web page of external connection information can be identified as the second summary information related to the first content.

[0246] According to one embodiment, if the first summary information related to the first content is a fourth text that summarizes text included in a web page corresponding to external connection information, the electronic device compares the fourth text that summarizes text included in a web page corresponding to external connection information with a fifth text that interprets an image included in a web page corresponding to external connection information, and confirms that the fifth text that interprets an image included in a web page corresponding to external connection information is not more detailed information than the fourth text that summarizes text included in a web page corresponding to external connection information, then uses a second AI model (e.g., the AI ​​model (231b) of FIG. 2b) to identify an eighth text that summarizes text included in a web page corresponding to external connection information in more detail than the fourth text, and identifies the eighth text that summarizes text included in a web page corresponding to external connection information in more detail than the fourth text as the second summary information related to the first content.

[0247] According to one embodiment, when an electronic device confirms a request for the creation of a third message containing summary information rather than text of a second message based on a first gesture requesting the regeneration of a second message, it can confirm a second summary information related to the first content that can be provided through external connection information containing summary information of the first summary information related to the first content.

[0248] According to one embodiment, if the first summary information related to the first content is a third text representing a brief description of the external connection information, the electronic device may identify the first text representing the title of the external connection information or the second text interpreting the image to be displayed when the first summary information related to the first content is connected to the external connection information as the second summary information related to the first content.

[0249] According to one embodiment, if the first summary information related to the first content is a fourth text that summarizes text included in a web page corresponding to external connection information, the electronic device compares the fourth text that summarizes text included in a web page corresponding to external connection information with a fifth text that interprets an image included in a web page corresponding to external connection information, and confirms that the fifth text that interprets an image included in a web page corresponding to external connection information is more concise information than the fourth text that summarizes text included in a web page corresponding to external connection information, then the fifth text that interprets an image included in a web page corresponding to external connection information can be identified as the second summary information related to the first content.

[0250] According to one embodiment, if the first summary information related to the first content is a fourth text that summarizes text included in a web page corresponding to external connection information, the electronic device compares the fourth text that summarizes text included in a web page corresponding to external connection information with a fifth text that interprets an image included in a web page corresponding to external connection information, and confirms that the fifth text that interprets an image included in a web page corresponding to external connection information is not more concise than the fourth text that summarizes text included in a web page corresponding to external connection information, then uses a second AI model (e.g., the second AI model (231b) of FIG. 2b) to identify a ninth text that summarizes text included in a web page corresponding to external connection information more concisely than the fourth text, and identifies the ninth text that summarizes text included in a web page corresponding to external connection information more concisely than the fourth text as the second summary information related to the first content.

[0251] In operation 811, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may generate a third message that regenerates the second message.

[0252] According to one embodiment, the electronic device may use a third AI model (e.g., the third AI model of FIG. 2b (231c)) to generate a third message comprising a ninth text that synthesizes second summary information related to the first content and a sixth text related to the first content included in at least one message.

[0253] In operation 813, the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may output audio data representing the text of the third message.

[0254] According to one embodiment, the electronic device can convert the text of a third message into audio data using a Text-to-Speech (TTS) function.

[0255] According to one embodiment, the electronic device can output the text of the third message as audio data through an audio output circuit (e.g., the audio output circuit (255) of FIG. 2a).

[0256] According to one embodiment, the electronic device can generate a third message including one of a first text, a second text, a third text, a fourth text, a fifth text, an eighth text, and a ninth text that can be identified as second summary information related to the first content, and output audio data representing the text included in the third message.

[0257] According to one embodiment, the electronic device can convert the text of a third message (e.g., one of the first text, second text, third text, fourth text, fifth text, eighth text, and ninth text that can be identified as second summary information related to the first content) into audio data using a Text to Speech (TTS) function.

[0258] According to one embodiment, the electronic device can output the text of a third message (e.g., one of the first text, second text, third text, fourth text, fifth text, eighth text and ninth text that can be identified as second summary information related to the first content) as audio data through an audio output circuit (e.g., audio output circuit (255) of FIG. 2a).

[0259] FIG. 9 is a flowchart illustrating an operation for processing external connection information included in a message in an electronic device according to one embodiment. The operations for processing external connection information included in a message may include operations 901 through 909. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, at least two operations may be performed in parallel, or other operations may be added.

[0260] In operation 901, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can confirm the reception of a first message containing external connection information.

[0261] According to one embodiment, the external connection information may include URL address information.

[0262] In operation 903, the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) can check whether the conditions for generating a second message that can be output as audio data are met.

[0263] According to one embodiment, when an electronic device confirms the reception of a first message containing external connection information, if it confirms that the electronic device is connected to an external electronic device for audio output, it can confirm that the conditions for generating a second message that can be output as audio data are satisfied.

[0264] According to one embodiment, when the electronic device is a wearable electronic device that can be worn on a part of a user's body, when the wearable electronic device is worn by a user, if the setting of the audio data output for a message is checked, it can be confirmed that the conditions for generating a second message are satisfied.

[0265] According to one embodiment, when the electronic device is a wearable electronic device that can be worn on a part of a user's body, if it is confirmed using the camera of the wearable electronic device that the user is not looking at the display of the wearable electronic device, it can be confirmed that the conditions for generating the second message are satisfied.

[0266] According to one embodiment, if the electronic device confirms that a message-related application is not running or that a message-related application is running in the background on the display of the electronic device (e.g., the display (260) of FIG. 2a), it can be confirmed that the conditions for generating a second message are satisfied.

[0267] According to one embodiment, the electronic device displays a first indicator indicating the reception of a first message containing external connection information in a part area of ​​the electronic device's display, and when the input of a second gesture (e.g., a long touch or a double touch) by a user requesting the creation of a second message to the first indicator is confirmed, it can be confirmed that the conditions for creating a second message are satisfied.

[0268] According to one embodiment, the electronic device may use a third AI model (e.g., the third AI model of FIG. 2b (231c)) to generate a second message comprising a seventh text that synthesizes first summary information related to content and a sixth text related to first content included in at least one message.

[0269] According to one embodiment, the electronic device can generate a second message containing text identified as first summary information related to a first content that can be provided through external connection information.

[0270] In operation 903, if the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) confirms that the condition for generating a second message that can be output as audio data is satisfied, in operation 905, the second message for outputting audio data corresponding to the first message can be generated.

[0271] In operation 907, the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may output audio data representing the text of the second message.

[0272] According to one embodiment, the electronic device can convert the text of the second message into audio data using a Text-to-Speech (TTS) function.

[0273] According to one embodiment, the electronic device can output the text of the second message as audio data through an audio output circuit (e.g., the audio output circuit (255) of FIG. 2a).

[0274] According to one embodiment, the electronic device can convert the text of a second message (e.g., one of the first text, second text, third text, fourth text, fifth text, and seventh text identified by the first summary information of the first content) into audio data using a Text to Speech (TTS) function.

[0275] According to one embodiment, the electronic device can output the text of the second message (e.g., the text of the first text, the second text, the third text, the fourth text, the fifth text, and the seventh text identified by the first summary information of the first content) as audio data through an audio output circuit (e.g., the audio output circuit (255) of FIG. 2a).

[0276] In operation 903, when the electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a and 2b) confirms that the condition for generating a second message that can be output as audio data is satisfied, in operation 909, the first message can be displayed through the display of the electronic device (e.g., the display (260) of FIG. 2a).

[0277] FIG. 10 is a drawing for explaining a generative artificial intelligence system according to one embodiment.

[0278] According to one embodiment, a user query / response interface (1010) may receive user input. User input may be in the form of natural language, images, and / or videos, but there are no limitations. Additionally, context information may be transmitted along with the user input. Context information may include various additional information at the time of user input. For example, additional information may include information about the application currently being used by the user or the user's location information. Additionally, user input may be in a mixed form of the aforementioned natural language, images, sounds, and context information. Furthermore, user input may be in a non-natural language form, such as selecting a menu. The user query / response interface (1010) may output results from a generative artificial intelligence system to the user. The output may be in the form of natural language or specific content, and may also be provided in the form of actions requested by the user. The user query / response interface (1010) may output results from a generative artificial intelligence system to the user. The output can be in the form of natural language or specific content, and it may also be provided in the form of actions requested by the user.

[0279] The AI ​​framework (1040) can receive user input and coordinate and control each component necessary to perform the user's intent based on the user's query.

[0280] User input received from the user query / response interface (1010) can be transmitted to a prompt design component (1041). The prompt design component (1041) can be used to generate prompts suitable for inputting user input into a large language model (LLM) or a large multimodal model (LMM). The prompt design component (1041) may be an AI component that uses machine learning algorithms or neural networks to develop better prompts over time. The prompt design component (1041) can generate prompts by accessing a knowledge component containing user preference data, a prompt library, and prompt examples based on user input, and can transmit the generated prompts to the LLM or LMM.

[0281] The API / Plug-in management component (1042) can perform the role of communicating with external information when there is a request for additional information when user input is passed as input to a generative model. The API / Plug-in management component (1042) establishes a channel to communicate with the outside of the AI ​​Interface via the API, and through the established channel, it can enable access to various data sources (e.g., knowledge repository (1020)). Additionally, if the API / Plug-in management component (1042) needs to perform an action that executes the user input as a final step rather than an intermediate result in an application or service, it can request that action from the application / service component (1030) via the API. The information obtained from the outside can be used to generate a prompt in the prompt design component (1041) along with the user input, or it can be passed as input to the generative model.

[0282] The output modification component (or refiner component) (1043) can fine-tune the output of the generative model. For example, the output modification component (1043) can verify whether the content generated through the LLM and / or LMM is irrelevant, contains biased content, or contains harmful content. Additionally, the output modification component (1043) can determine the extent to which the output matches the user's desired result and, if additional processing is required, proceed with that process. Furthermore, the output modification component (1043) can configure and provide hints to the user to avoid unwanted output.

[0283] A generative AI model (1060) generally refers to an artificial intelligence neural network that generates new forms of data based on user input information. A generative AI model (1060) may include a model that generates images and / or a model that generates language. Models that generate images include, but are not limited to, GANs (generative adversarial networks) and VAEs (variational auto encoders), and examples include Diffusion-based generative models that use VAEs and Transformer structures. Models that generate language are models trained to output the most statistically appropriate output value based on input values, and examples include models such as CHAT-GPT 3 and CHAT-GPT 4. There are also LMMs (large multimodal models) that can recognize various forms of data input, such as text, images, and voice, and generate new data corresponding to them.

[0284] A method for processing external connection information included in a message in an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (201) of FIG. 2a to 2b) may include, upon confirming the reception of a first message containing external connection information, an operation of obtaining first summary information related to a first content that can be provided through said external connection information. The method according to one embodiment may include an operation of confirming at least one message containing a first text related to said first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of said electronic device. The method according to one embodiment may include an operation of generating a second message containing a second text related to said first summary information and said first text based on said first summary information and said first text using a first artificial intelligence model. The method according to one embodiment may include an operation of outputting audio data representing said second text related to said first summary information and said first text through said audio output circuit.

[0285] The method according to one embodiment may include an operation of verifying the first content based on meta tag information included in the external connection information. The method according to one embodiment may include an operation of generating the second message by synthesizing the first text and the third text using the first artificial intelligence model when the first content is verified as a third text. The method according to one embodiment may include an operation of verifying the fourth text summarizing the image using the second artificial intelligence model when the first content is verified as an image, and generating the second message by synthesizing the first text and the fourth text using the first artificial intelligence model.

[0286] The method according to one embodiment may include an operation of using a third artificial intelligence model to identify the first content as a fifth text summarizing text included in a web page corresponding to the external connection information, and using a first artificial intelligence model to generate the second message by synthesizing the first text and the fifth text. The method according to one embodiment may include an operation of using a third artificial intelligence model to identify the first content as an image included in a web page corresponding to the external connection information, and using a second artificial intelligence model to identify the sixth text summarizing the image, and using a first artificial intelligence model to generate the second message by synthesizing the first text and the sixth text.

[0287] The method according to one embodiment may include an operation of generating a third message including second summary information related to first content available through external connection information and seventh text related to first text, after outputting the second message as audio data through the audio output circuit and confirming a first gesture requesting the regeneration of the second message based on user input of the electronic device. The method according to one embodiment may include an operation of outputting audio data representing the seventh text through the audio output circuit. In the method according to one embodiment, the second summary information related to the first content may include brief information of the first summary information or detailed information of the first summary information.

[0288] In the method according to one embodiment, the first text associated with the first content may include text included in the first message.

[0289] The method according to one embodiment may include an operation of identifying as a first text the text included in at least one message received within a specified time after receiving the first message among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device. The method according to one embodiment may include an operation of generating a second message including the first summary information and a second text related to the text included in the at least one message received within the specified time using the first artificial intelligence model.

[0290] The method according to one embodiment may include an operation of generating the second message when confirming the reception of the first message and confirming that the electronic device is connected to an external electronic device for outputting audio data. The method according to one embodiment may include an operation of transmitting audio data corresponding to the text of the second message to the external electronic device through the communication circuit.

[0291] The method according to one embodiment may include an operation of checking whether the wearable electronic device is being worn by a user when the reception of the first message is confirmed, when the electronic device is a wearable electronic device configured to be worn by a part of a user. The method according to one embodiment may include an operation of generating the second message when the setting of audio data output for the message is confirmed while the wearable electronic device is being worn by the user. The method according to one embodiment may include an operation of outputting the second text of the second message as audio data through the audio output circuit.

[0292] The method according to one embodiment may include an operation of checking whether the wearable electronic device is being worn by a user when the reception of the first message is confirmed, when the electronic device is a wearable electronic device configured to be worn by a part of a user. The method according to one embodiment may include an operation of generating the second message when it is confirmed using the camera of the wearable electronic device that the user is not looking at the display of the wearable electronic device while the wearable electronic device is being worn by the user. The method according to one embodiment may include an operation of outputting the text of the second message as audio data through the audio output circuit.

[0293] The electronic device according to one embodiment disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of this document is not limited to the aforementioned devices.

[0294] One embodiment of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationally,” it means that said component may be connected to said other component directly (e.g., wired), wirelessly, or through a third component.

[0295] The term "module" as used in an embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0296] One embodiment of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101) or electronic device (301)). For example, a processor (e.g., processor (520)) of the machine (e.g., electronic device (301)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0297] According to one embodiment, the method according to one embodiment disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0298] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101 of FIG. 1; 201 of FIG. 2a to 2b), Communication circuit (190 in FIG. 1; 290 in FIG. 2a); Display (160 in FIG. 1; 260 in FIG. 2a); Audio output circuit (155 in FIG. 1; 255 in FIG. 2); At least one processor (120 of FIG. 1; 220 of FIG. 2a to 2b); and It includes a memory for storing instructions (130 in FIG. 1; 230 in FIG. 2a), and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Upon confirming the reception of a first message containing external connection information, first summary information related to a first content that can be provided through the external connection information is obtained, and Identifying at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device, and Using a first artificial intelligence model, a second message is generated including a second text related to the first summary information and the first text based on the first summary information related to the first content and the first text, and An electronic device configured to output audio data representing the first summary information and the second text associated with the first text through the above audio output circuit.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the meta tag information included in the above external connection information, the above first content is verified, and When the above-mentioned first content is identified as the third text, the above-mentioned second message is generated by synthesizing the above-mentioned first text and the above-mentioned third text using the above-mentioned first artificial intelligence model, and An electronic device configured to verify a fourth text summarizing the image using a second artificial intelligence model when the first content is verified as an image, and to generate a second message by synthesizing the first text and the fourth text using the first artificial intelligence model.

3. In any one of paragraphs 1 to 2, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When the first content is identified as a fifth text summarizing the text included in the web page corresponding to the external connection information using the third artificial intelligence model, the second message is generated by synthesizing the first text and the fifth text using the first artificial intelligence model, and An electronic device configured to use a third artificial intelligence model to identify the first content as an image included in a web page corresponding to the external connection information, and using a second artificial intelligence model to identify a sixth text summarizing the image, and then using a first artificial intelligence model to generate the second message by synthesizing the first text and the sixth text.

4. In any one of paragraphs 1 to 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, After outputting the second message as audio data through the audio output circuit, if a first gesture requesting the regeneration of the second message based on user input of the electronic device is confirmed, a third message is generated including second summary information related to the first content available through the external connection information and seventh text related to the first text. Audio data representing the seventh text is output through the above audio output circuit, and The second summary information related to the first content above is an electronic device including brief information of the first summary information or detailed information of the first summary information, 5. In any one of paragraphs 1 through 4, The first text related to the first content is an electronic device including text included in the first message, 6. In any one of paragraphs 1 through 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Identifying as the first text the text included in at least one message received within a specified time after receiving the first message among the messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device, and An electronic device configured to generate a second message including the first summary information and the second text related to the text included in the at least one message received within the specified time using the first artificial intelligence model.

7. In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When confirming the reception of the first message, if it is confirmed that the electronic device is connected to an external electronic device for outputting audio data, the second message is generated, and An electronic device configured to transmit audio data corresponding to the text of the second message to the external electronic device through the communication circuit.

8. In any one of paragraphs 1 through 7, If the above electronic device is a wearable electronic device configured to be worn by a part of a user, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Upon confirming the receipt of the first message, check whether the wearable electronic device is worn by a user, and When the above-mentioned wearable electronic device is worn by the user, if the setting for audio data output for a message is checked, the second message is generated, and An electronic device configured to output the second text of the second message as audio data through the above audio output circuit.

9. In any one of paragraphs 1 through 8, If the above electronic device is a wearable electronic device configured to be worn by a part of a user, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Upon confirming the receipt of the first message, check whether the wearable electronic device is worn by a user, and When the wearable electronic device is worn by the user, if it is confirmed using the camera of the wearable electronic device that the user is not looking at the display of the wearable electronic device, the second message is generated, and An electronic device configured to output the text of the second message as audio data through the above audio output circuit.

10. A method for processing external connection information included in a message in an electronic device, An operation of obtaining first summary information related to a first content that can be provided through said external connection information upon confirming the reception of a first message including external connection information; An operation of confirming at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device; The operation of generating a second message including a second text related to the first summary information and the first text based on the first summary information and the first text using a first artificial intelligence model; and A method comprising the operation of outputting audio data representing the first summary information and the second text related to the first text through the above audio output circuit.

11. In Paragraph 10, An operation to verify the first content based on meta tag information included in the external connection information; When the above-mentioned first content is identified as the third text, the operation of generating the above-mentioned second message by synthesizing the above-mentioned first text and the above-mentioned third text using the above-mentioned first artificial intelligence model; and A method further comprising the operation of verifying the first content as an image, verifying a fourth text summarizing the image using a second artificial intelligence model, and generating the second message by synthesizing the first text and the fourth text using the first artificial intelligence model.

12. In any one of paragraphs 10 to 11, When the first content is identified as a fifth text summarizing the text included in the web page corresponding to the external connection information using the third artificial intelligence model, the operation of generating the second message by synthesizing the first text and the fifth text using the first artificial intelligence model; and A method further comprising the operation of using a third artificial intelligence model to identify the first content as an image included in a web page corresponding to the external connection information, using a second artificial intelligence model to identify a sixth text summarizing the image, and using the first artificial intelligence model to generate the second message by synthesizing the first text and the sixth text.

13. In any one of paragraphs 10 to 12, After outputting the second message as audio data through the audio output circuit, if a first gesture requesting the regeneration of the second message based on user input of the electronic device is confirmed, an operation to generate a third message including second summary information related to the first content available through the external connection information and seventh text related to the first text; and It further includes the operation of outputting audio data representing the seventh text through the above audio output circuit, and A method comprising: second summary information related to the first content, including brief information of the first summary information or detailed information of the first summary information.

14. In any one of paragraphs 10 through 13, The first text related to the first content above includes a method comprising text included in the first message, 15. In a non-volatile storage medium storing instructions, the instructions are configured to cause the wearable electronic device to perform at least one operation when executed by the wearable electronic device, wherein the at least one operation is, An operation of obtaining first summary information related to a first content that can be provided through said external connection information upon confirming the reception of a first message including external connection information; An operation of confirming at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device; The operation of generating a second message including first summary information and second text related to the first text based on first summary information related to the first content and first text using a first artificial intelligence model; and A storage medium comprising the operation of outputting audio data representing the first summary information and the second text related to the first text through the above audio output circuit.

Images