Electronic device and method for content transmission using artificial intelligence model in electronic device

Abstract

An electronic device according to one embodiment comprises: a communication circuit; a memory; and a processor operatively connected to the communication circuit and the memory, wherein the memory may be configured to transmit instructions that, when executed by the processor, instruct the electronic device to: identify an external electronic device to which first content is to be transmitted; acquire a prompt for generating second content associated with the first content and supported by the external electronic device on the basis of content analysis information of the first content and device characteristic information of the external electronic device; acquire the second content corresponding to the prompt by using an artificial intelligence (AI) model; and transmit the first content and the second content to the external electronic device through the communication circuit or transmit the second content to the external electronic device through the communication circuit.

Description

Electronic devices and methods for transmitting content using artificial intelligence models in electronic devices

[0001] Various embodiments of the present invention relate to an electronic device and a method of transmitting content in an electronic device.

[0002] Thanks to remarkable advancements in information and communication technology and semiconductor technology, the proliferation and use of various electronic devices is rapidly increasing. Electronic devices are being developed to enable users to carry and communicate with one another. An electronic device can refer to any device that performs a specific function based on its embedded software, such as a mobile communication terminal, tablet PC, audio / video device, desktop / laptop computer, or in-car navigation system.

[0003] Electronic devices may include functionality that enables content sharing with external electronic devices. Content may be any type of information or content, such as text, code, voice, sound, images, or video, digitally created, processed, and distributed for use over wired or wireless telecommunications networks, and may take on various formats. Electronic devices may share content by transmitting it to other electronic devices upon a user's request to share the content.

[0004] An electronic device can check whether an external electronic device supports a content format and share the content with the external electronic device that supports the content format. If the electronic device transmits content to an external electronic device that does not support the content format, the external electronic device may not be able to use the content even if it receives the content because it does not support the content format.

[0005] According to one embodiment, when transmitting (or sharing) content (e.g., first content) to an external electronic device, additional content (e.g., second content) supported by the external electronic device is generated in association with the content, and the content and the additional content are transmitted to the external electronic device, or the additional content is transmitted so that the external electronic device can use the additional content even when the content to be shared is not available on the external electronic device. A method for transmitting content using an artificial intelligence model in the electronic device may be provided.

[0006] An electronic device according to one embodiment of the present disclosure may include a communication circuit, a memory, and a processor operatively connected to the communication circuit and the memory. The memory according to one embodiment may store instructions that, when executed by the processor, are configured to cause the electronic device to identify an external electronic device to which first content will be transmitted. The instructions, when executed by the processor, may be configured to cause the electronic device to obtain a prompt for generating second content associated with the first content and supported by the external electronic device based on content analysis information of the first content and device characteristic information of the external electronic device. The instructions, when executed by the processor, may be configured to cause the electronic device to obtain the second content corresponding to the prompt using an AI model. The instructions, when executed by the processor, may be configured to cause the electronic device to transmit the first content and the second content to the external electronic device via the communication circuit or to transmit the second content to the external electronic device via the communication circuit.

[0007] A method for transmitting content using an artificial intelligence model of an electronic device according to an embodiment of the present disclosure may include an operation of identifying an external electronic device to which first content will be transmitted. The method according to an embodiment may include an operation of obtaining a prompt for generating second content that is associated with the first content and supported by the external electronic device based on content analysis information of the first content and device characteristic information of the external electronic device. The method according to an embodiment may include an operation of obtaining the second content corresponding to the prompt using an AI model. The method according to an embodiment may include an operation of transmitting the first content and the second content to the external electronic device through a communication circuit (190, 290) of the electronic device or transmitting the second content to the external electronic device through the communication circuit.

[0008] According to one embodiment of the present disclosure, a non-volatile storage medium storing commands may be configured to cause an electronic device to perform at least one operation when the commands are executed, wherein the at least one operation may include an operation of identifying an external electronic device to which first content is to be transmitted. According to one embodiment, the at least one operation may include an operation of obtaining a prompt for generating second content supported by the external electronic device and associated with the first content based on content analysis information of the first content and device characteristic information of the external electronic device. According to one embodiment, the at least one operation may include an operation of obtaining the second content corresponding to the prompt using an AI model. According to one embodiment, the at least one operation may include an operation of transmitting the first content and the second content to the external electronic device through a communication circuit (190, 290) of the electronic device or transmitting the second content to the external electronic device through the communication circuit.

[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0010] Figure 2 is a schematic block diagram of an electronic device according to one embodiment.

[0011] Figure 3 is a diagram showing the configuration of a processor according to one embodiment.

[0012] FIG. 4 is a schematic diagram illustrating a prompt generation operation using a first AI model according to one embodiment.

[0013] FIG. 5 is a schematic diagram illustrating a second content generation operation using a second AI model according to one embodiment.

[0014] FIG. 6 is a flowchart illustrating a content transmission method using an AI model in an electronic device according to one embodiment.

[0015] FIG. 7 is a flowchart illustrating an operation of generating and transmitting second content after determining an external electronic device to which first content will be transmitted among at least one recommended external electronic device in an electronic device according to one embodiment.

[0016] FIG. 8 is a flowchart illustrating an operation of transmitting second content to an external electronic device determined to transmit first content after generating second content for at least one recommended external electronic device in an electronic device according to one embodiment.

[0017] FIG. 9 is a diagram illustrating an example of additional content generated for at least one external electronic device when an image sharing request is made in an electronic device according to one embodiment.

[0018] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to an embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) and the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to an embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0019] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0020] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0021] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0022] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0023] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0024] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0025] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0026] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0027] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0028] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0029] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0030] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0031] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0032] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0033] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0034] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0035] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0036] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0037] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0038] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0039] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0040] In the detailed description below, reference numerals in the drawings may be used interchangeably or omitted for components that can be easily understood through the preceding embodiments, and their detailed descriptions may also be omitted. An electronic device according to an embodiment disclosed in this document may be implemented by selectively combining components of different embodiments, and components of one embodiment may be replaced by components of another embodiment. For example, it should be noted that the present invention is not limited to specific drawings or embodiments.

[0041] Figure 2 is a schematic block diagram of an electronic device according to one embodiment.

[0042] Referring to FIG. 2, an electronic device (201) according to an embodiment (e.g., the electronic device (101) of FIG. 1) may include a processor (220), a memory (230), a display (260), and / or a communication circuit (290). The electronic device (201) according to an embodiment is not limited thereto and may further include various components or may be configured by excluding some of the components. The electronic device (201) according to an embodiment may further include all or part of the electronic device (101) illustrated in FIG. 1.

[0043] A processor (220) according to an embodiment (e.g., the processor (120) of FIG. 1) may include a central processing unit (CPU) or an application processor (AP), and may include a hardware structure specialized for processing an artificial intelligence (AI) model. The processor (220) according to an embodiment may perform an overall control operation of the electronic device (201), and may control the electronic device (201) to perform a content transmission operation using an AI model to an external electronic device (202). The AI ​​model according to an embodiment may include a generative AI model. For example, the generative AI model may be an AI model that can generate new content by utilizing content such as text, images, videos, and / or audio, or can be an AI model that can learn patterns of content and generate new content as an inference result. According to one embodiment, a processor (220) may utilize an AI model stored in a memory (230) or may utilize an AI model of an external server (e.g., server (108) of FIG. 1) through communication with the external server. According to one embodiment, an electronic device (201) may utilize one or more AI models when transmitting content to an external electronic device (202).

[0044] According to one embodiment, a processor (220) may identify a content (e.g., first content, hereinafter also referred to as “first content”) transmission request event. According to one embodiment, the first content may include text, an image (or image data), a video (or video data), and / or audio (or audio data). For example, the processor (220) may identify a transmission request event of a photo (or image) selected by a user from among photos (or images) in a gallery (or photo album) application.

[0045] According to an embodiment, a processor (220) may analyze the first content based on a first content transmission request event to obtain content analysis information and obtain device characteristic information of each external electronic device connected to the electronic device (201). The external electronic device according to an embodiment may include a mobile device (e.g., a smart phone), a refrigerator, an oven, an induction, an air conditioner, a washing machine, a TV (television), a VR (virtual reality) device, an IOT (internet of things) device, or other electronic devices that can be connected to and operate with the electronic device (201).

[0046] According to an embodiment, the processor (220) may analyze the first content to obtain the type of the first content (e.g., text, image, video, or audio) and content analysis information according to the type of the first content. According to an embodiment, the processor (220) may obtain text analysis information (e.g., context information) when the first content is text, may obtain image analysis information when the first content is an image, may obtain video analysis information when the first content is video, and may obtain audio analysis information when the first content is audio. According to an embodiment, the processor (220) may obtain device characteristic information including the device type, device ID, technical description (specification) of the device, functions supported by the device, or device characteristics of other external electronic devices for each of the external electronic devices connected to the electronic device (201).

[0047] According to an embodiment, a processor (220) may identify (or determine or confirm) an external electronic device (202) to which the first content is to be transmitted. According to an embodiment, the processor (220) may determine (or identify or confirm) at least one external electronic device (or at least one recommended external electronic device) recommended to receive the first content among the external electronic devices by using content analysis information of the first content, device characteristic information of each of the external electronic devices connected to the electronic device (201), locations of each of the electronic device (201) and the external electronic devices (or information related to distance, location, or other locations between the electronic device (201) and the external electronic devices) and / or situation information (time or operation status of each of the electronic device (201) and the external electronic devices or other specified situation information), and may identify (or determine or confirm) an external electronic device (202) to which the first content is to be transmitted based on a user input among the at least one external electronic device. According to an embodiment, a processor (220) may display at least one external electronic device on a display (260) and determine (or select) an external electronic device (202) to transmit first content based on a user input. According to an embodiment, the processor (220) may obtain (or generate) second content corresponding to a prompt for the external electronic device (202) using a second AI model based on the determination of the external electronic device (202) to transmit the first content. According to an embodiment, the processor (220) may obtain a prompt for generating second content that is associated with the first content and supported by the external electronic device based on content analysis information of the first content and device characteristic information of the external electronic device to transmit the first content.According to an embodiment, a processor (220) may use an AI model (e.g., a first AI model or a prompt generation AI model, hereinafter also referred to as “first AI model”) or a specified rule (or condition) to determine an external electronic device to transmit first content and to generate a prompt. According to an embodiment, a prompt may include natural language or a function (or command) that may be input to an AI model (e.g., a second AI model or a content generation AI model, hereinafter referred to as “second AI model”) to generate second content that is associated with the first content and supported by the external electronic device. According to an embodiment, the first AI model and the second AI model may be implemented as a single AI model.

[0048] According to an embodiment, the processor (220) may obtain second content corresponding to a prompt using a second AI model. According to an embodiment, the processor (220) may input a prompt obtained in association with the first content into the second AI model and obtain second content generated by a result of the prompt processing by the second AI model. According to an embodiment, the second content may include text associated with the first content, an image associated with the first content, a video associated with the first content, a URL (uniform resource locator) associated with the first content, an external electronic device setting value associated with the first content, and / or an external electronic device control value associated with the first content. According to an embodiment, the processor (220) may transmit the first content and the second content to the external electronic device (202) or transmit the second content to the external electronic device (202). According to one embodiment, the processor (220) can transmit the first content and the second content to the external electronic device (202) via the communication circuit (290) if the external electronic device (202) can support the first content, and can transmit the second content to the external electronic device (202) via the communication circuit (290) if the external electronic device (202) cannot support the first content.

[0049] According to an embodiment, the processor (220) may generate at least one prompt associated with each of the at least one recommended external electronic device when determining at least one recommended external electronic device. According to an embodiment, when the processor (220) uses a first AI model to determine at least one recommended external electronic device and generate at least one prompt, the processor (220) may input content analysis information of the first content and device characteristic information of each of the external electronic devices into the first AI model. According to an embodiment, the processor (220) may further input the location of each of the electronic device (201) and the external electronic devices (or information related to the distance, location, or other location between the electronic device (201) and the external electronic device) and / or situation information (time or the operation status of each of the electronic device (201) and the external electronic device or other specified situation information) into the first AI model to determine at least one recommended external electronic device and generate at least one prompt.

[0050] According to an embodiment, the processor (220) may determine (or determine or identify) whether each of the external electronic devices can support the first content and whether each of the external electronic devices can generate the second content to be received through the first AI model, obtain (or generate or determine) at least one recommended external electronic device (e.g., a list of recommended external electronic devices) among the external electronic devices based on the determination result, and generate at least one prompt associated with each of the at least one recommended external electronic device. According to an embodiment, the processor (220) may generate a first prompt for the first external electronic device and a second prompt for the second external electronic device when the first external electronic device and the second external electronic device are recommended. According to an embodiment, the processor (220) may input content analysis information of the first content, device characteristic information of the first external electronic device, and location and situation information of each of the electronic device (201) and the first external electronic device into the first AI model to generate the first prompt for the first external electronic device. According to one embodiment, a processor may input content analysis information of a first content, device characteristic information for a second external electronic device, and location and situation information of each of the electronic device (201) and the second external electronic device into a first AI model to generate a second prompt for the second external electronic device.

[0051] Table 1 below may indicate whether support for first content obtained from the first AI model is possible and a prompt based on input of content analysis information and device characteristic information of an external electronic device to the first AI model according to one embodiment.

[0052] Content Analysis Information Device Characteristics Output of the First AI Model (whether the first content can be supported and prompt) Content Type Analysis Information Device Type Functions Supported by the Device Image Spaghetti Photo Refrigerator Display Function - Support for display of spaghetti photo - Prompt to generate secondary content supported by the refrigerator that is related to the spaghetti photo (e.g. "Please create content containing additional information for cooking spaghetti. Please make sure that the additional content is in the form of a video or text that can be displayed on the display. Each content must include a recipe and cooking order for a spaghetti dish when created.") Image Chicken Photo Oven LED display function, oven function - Display of chicken photo is not supported - Prompt to generate secondary content supported by the oven while being associated with the chicken photo (e.g., "Generate oven setting values ​​when cooking chicken in the oven") Image Portrait Group Photo Smartphone Display function, image editing function, image transfer function - Display of portrait group photo is supported - Prompt to generate secondary content supported by the smartphone while being associated with the portrait group photo (e.g., "Crop only the family-related people in the portrait group photo and generate a new photo", "Generate a photo by extracting only the area where I can see in the portrait group photo and send the generated photo to my mother", "Add a description about the friend in the area where the friend can see in the portrait group photo", or "Add a description to the area containing excessive action or funny scenes in the portrait group photo") Image Clothes Photo Washing Machine Washing Function - Display of clothes photo is not supported - Prompt to generate secondary content supported by the washing machine while being associated with the clothes photo (e.g., "Analyze the clothes photo to provide information about the clothes" "Identify and generate washing machine setting values ​​according to the material of the clothes" Image Food Photo VR Device VR content playback function - Supports display of food photos - Prompts to generate secondary content supported by VR devices that are associated with food photos (e.g., "Analyze the food photo to identify information about the food and generate virtual reality content to cook the food in the photo") Audio Music TV Home theater function - Supports music output - Prompts to generate secondary content supported by TVs that are associated with music (e.g., "Turn on the TV's home theater function and output music through the home theater").

[0053] Referring to Table 1 above, when the first content is a picture of spaghetti and the external electronic device is a refrigerator, the processor (220) according to one embodiment converts the analysis information of the spaghetti image into low-dimensional first vectors, and converts refrigerator device characteristic information including a device type corresponding to the refrigerator, a device ID, a technical description (specification) of the device, a function supported by the device, or text representing other device characteristics of the refrigerator into low-dimensional second vectors, and processes data (e.g., {0.1, 0.2, -0.4, 0.3, -0.6, ...}) combining the first vectors and the second vectors through post-processing to generate natural language that can be an input of the second AI model (e.g., "Please generate content containing additional information for cooking spaghetti. The additional content must be in the form of a video or text that can be displayed on a display. Each content must include a recipe and cooking order for cooking spaghetti."), or a function (or command) (e.g., {"Category: Cooking", The processor (220) according to an embodiment may generate a prompt including {"Additional content: Spaghetti cooking method video, Spaghetti cooking recipe", "Device characteristics: Refrigerator, Display, Device technical description,..."}. The processor (220) according to an embodiment may generate a prompt in a similar manner to the spaghetti picture even when the first content is a picture of chicken, a picture of a group of people, a picture of clothes, or music and the first external device is an oven, a smart phone (or mobile electronic device), a washing machine, or a TV. The processor (220) according to an embodiment may generate second content for at least one recommended external electronic device using at least one prompt for each of at least one recommended external electronic device.According to one embodiment, the second content may include text associated with the first content, an image associated with the first content, a video associated with the first content, a uniform resource locator (URL) associated with the first content, an external electronic device setting associated with the first content, and / or an external electronic device control value associated with the first content. According to one embodiment, the processor (220) may display at least one recommended external electronic device on the display (260) and determine (or select) an external electronic device (202) to which the first content will be transmitted based on a user input.

[0054] According to one embodiment, the processor (220) may identify second content of the determined external electronic device (202) among additional content for at least one recommended external electronic device based on the determination of the external electronic device (202) to which the first content is to be transmitted.

[0055] According to an embodiment, the processor (220) may transmit the first content and the second content to the external electronic device (202) through the communication circuit (290), or transmit the second content to the external electronic device (202) through the communication circuit (290). According to an embodiment, the processor (220) may transmit the first content and the second content to the external electronic device (202) through the communication circuit (290) when the external electronic device (202) can support the first content, and may transmit the second content to the external electronic device (202) through the communication circuit (290) when the external electronic device (202) cannot support the first content. According to an embodiment, the electronic device (201) may display a screen related to changing the external electronic device setting value on the display (260) when transmitting the second content when the second content includes the external electronic device setting value related to the first content. According to one embodiment, the electronic device (201) may display a screen associated with control of an external electronic device (202) on the display (260) when transmitting the second content if the second content includes an external electronic device control value associated with the first content.

[0056] An external electronic device (202) according to an embodiment can receive first content and second content from an electronic device (201). When the first content and the second content are received from the electronic device (201), the external electronic device (202) according to an embodiment can output (or play, execute, or display) the first content while simultaneously outputting or playing, executing, displaying, or applying the second content. When only the second content is received from the electronic device (201), the external electronic device (202) according to an embodiment can output or play, execute, display, or apply the second content.

[0057] According to an embodiment, an external electronic device (202) may display text, an image, or a video when second content including text, an image, or a video associated with first content is received. According to an embodiment, an external electronic device (202) may execute a URL (uniform resource locator) associated with the first content when second content including a URL associated with the first content is received. According to an embodiment, an external electronic device (202) may change a setting value of the external electronic device (202) to the received setting value when second content including an external electronic device setting value associated with the first content is received. According to an embodiment, an external electronic device (202) may be controlled based on the received control value when second content including an external electronic device control value associated with the first content is received.

[0058] A memory (230) according to an embodiment (e.g., memory (130) of FIG. 1) may store various data used by at least one component (e.g., processor (220), communication circuit (290), and / or display (260)) of an electronic device (201). The data may include, for example, software (e.g., software module or program (140)) and input data or output data for commands related thereto. A memory (230) according to an embodiment may store AI models (e.g., first AI model and second AI model), and may store various data generated during program execution, including a program (e.g., software module or program (140) of FIG. 1) used for a content transmission operation using an AI model. A memory (230) according to an embodiment may store commands (or instructions) that cause the processor (220) to perform a content transmission operation (or method) using an AI model of the present disclosure.

[0059] According to one embodiment, a display (260) (e.g., display (160) of FIG. 1) may display various information based on the control of the processor (220). According to one embodiment, the display (260) may display a screen related to performing a content transmission operation (or method) using an AI model. According to one embodiment, the display (260) may be implemented in the form of a touch screen. When the display (260) is implemented together with an input module in the form of a touch screen, it may display various information generated according to a user's touch operation.

[0060] A communication circuit (290) according to an embodiment (e.g., a communication module (190) of FIG. 1) may include a wired communication module (e.g., a USB communication module) and / or a wireless communication module (e.g., a cellular module, a Wi-Fi (wireless-fidelity) module, a Bluetooth module, or a NFC (near field communication) module). The communication module (290) according to an embodiment may communicate with an external electronic device (202) (e.g., the electronic device (102) of FIG. 1 or the electronic device (104) of FIG. 1). The communication circuit (290) according to an embodiment may transmit first content and second content to the external electronic device (202) or transmit the second content to the external electronic device (202) based on the control of the processor (220).

[0061] According to one embodiment, the electronic device (201) is not limited to the configuration illustrated in FIG. 2 and may further include various components. According to one embodiment, the electronic device (201) further includes an input module (e.g., the input module (150) of FIG. 1) and / or an audio output module (e.g., the audio output module (155) of FIG. 1) and may receive various inputs related to performing a content transmission operation (or method) using an AI model through the input module and may output sounds related to performing a content transmission operation (or method) using an AI model through the audio output module.

[0062] In one embodiment, the main components of the electronic device have been described through the electronic device (201) of FIG. 2. However, in various embodiments, not all of the components illustrated through FIG. 2 are essential components, and the connection relationship of the main components of the electronic device (201) described above through FIG. 2 may be changed according to various embodiments.

[0063] An electronic device according to an embodiment (e.g., an electronic device (101) of FIG. 1 or an electronic device (201) of FIG. 2) may include a communication circuit (e.g., a communication module (190) of FIG. 1 or a communication circuit (290) of FIG. 2), a memory (e.g., a memory (130) of FIG. 1 or a memory (230) of FIG. 2), and a processor (e.g., a processor (120) of FIG. 1 or a processor (220) of FIG. 2) operatively connected to the communication circuit and the memory. The memory according to an embodiment may store instructions that, when executed by the processor, cause the electronic device to identify an external electronic device (e.g., an external electronic device (102) of FIG. 1 or an external electronic device (202) of FIG. 2) to transmit first content. The instructions according to an embodiment, when executed by the processor, cause the electronic device to analyze content analysis information of the first content and the external electronic device. The instructions may be configured to obtain a prompt for generating second content supported by the external electronic device and associated with the first content based on device characteristic information of the device. In one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to obtain the second content corresponding to the prompt using an artificial intelligence (AI) model. In one embodiment, the instructions, when executed by the processor, may be configured to cause the electronic device to transmit the first content and the second content to the external electronic device through the communication circuit or to transmit the second content to the external electronic device through the communication circuit.

[0064] The instructions according to one embodiment may further be configured to cause the electronic device, when executed by the processor, to determine one of the external electronic devices communicatively connected to the electronic device through the communication circuit as the external electronic device to which the first content will be transmitted.

[0065] According to one embodiment, an electronic device further includes a display, and the instructions, when executed by the processor, may be configured to cause the electronic device to display, on the display, at least one external electronic device recommended based on the first content analysis information and device characteristic information of each of the external electronic devices among the external electronic devices. According to one embodiment, the instructions may further be configured to cause the electronic device to determine, based on a user input, the external electronic device among the at least one external electronic device to which the first content will be transmitted.

[0066] The instructions according to one embodiment may be further configured to cause the electronic device, when executed by the processor, to identify whether the external electronic device can support the first content. The instructions according to one embodiment may be further configured to cause the electronic device, when executed by the processor, to transmit the first content and the second content to the external electronic device via the communication circuit if the external electronic device can support the first content. The instructions according to one embodiment may be further configured to cause the electronic device to transmit the second content to the external electronic device via the communication circuit if the external electronic device cannot support the first content.

[0067] In one embodiment, the instructions, when executed by the processor, may further be configured to cause the electronic device to obtain content analysis information including first vectors for an image corresponding to the first content. In one embodiment, the instructions, when executed by the processor, may further be configured to cause the electronic device to obtain device characteristic information including second vectors for text corresponding to device characteristics of the external electronic device. In one embodiment, the instructions, when executed by the processor, may further be configured to cause the electronic device to obtain the prompt by combining the first vectors and the second vectors.

[0068] The prompt according to one embodiment may include natural language, a function, or a command.

[0069] According to one embodiment, the first content may include an image, a video, and / or an audio.

[0070] According to one embodiment, the second content may include text associated with the first content, an image associated with the first content, a video associated with the first content, a uniform resource locator (URL) associated with the first content, an external electronic device setting value associated with the first content, and / or an external electronic device control value associated with the first content.

[0071] According to one embodiment, the external electronic device may be a mobile device (e.g., a smart phone), a refrigerator, an oven, an induction, an air conditioner, a washing machine, a TV (television), a VR (virtual reality) device, or an IOT (internet of things) device.

[0072] FIG. 3 is a diagram illustrating a configuration of a processor according to an embodiment. Referring to FIG. 3, a processor (220) according to an embodiment may include components (e.g., ~ units) that process at least one function or operation. In FIG. 3, a term such as '~ unit' means a unit that processes at least one function or operation, which may be implemented by hardware, software, or a combination of hardware and software. In an embodiment, other '~ units' may be replaced with terms such as '~ circuit', '~ module', or '~ device', for example.

[0073] A processor (220) according to one embodiment may include a device connection management unit (310) and a content management unit (320).

[0074] A device connection management unit (310) according to an embodiment can manage external electronic devices connected to an electronic device (201). The device connection management unit (310) according to an embodiment can include a device list generation unit (312), a device characteristic analysis unit (314), and a content transmission unit (316). The device list generation unit (312) according to an embodiment can generate a list of external electronic devices connected to the electronic device (201). The device characteristic analysis unit (312) according to an embodiment can obtain device characteristic information by analyzing device characteristics including a device type, a device ID, a technical description (specification) of the device, a function supported by the device, or other device characteristics for each of the external electronic devices connected to the electronic device (201). According to one embodiment, a content transmission unit (316) may use a first AI model to determine (or determine or identify) whether each of the external electronic devices is capable of receiving first content and whether each of the external electronic devices is capable of generating second content to be received, obtain (or generate or determine) at least one recommended external electronic device (e.g., a list of recommended external electronic devices) among the external electronic devices based on the determination result, and generate at least one prompt associated with each of the at least one recommended external electronic device.

[0075] According to an embodiment, a content management unit (320) may analyze first content that is a target of a transmission request or generate second content that is associated with the first content and supported by an external electronic device (202). According to an embodiment, the content management unit (320) may include a content analysis unit (322) and a content generation unit (324). According to an embodiment, the content analysis unit (322) may analyze the first content that is a target of a transmission request. According to an embodiment, the content generation unit (324) may generate second content that is associated with the first content and supported by an external electronic device (202) using a second AI model.

[0076] FIG. 4 is a schematic diagram illustrating a prompt generation operation using a first AI model according to one embodiment.

[0077] Referring to FIG. 4, a processor (e.g., processor (120) of FIG. 1 or processor (220) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (202) of FIG. 2) according to an embodiment may input first content analysis information and device characteristics of an external electronic device into a first AI model (400) to perform low-dimensionalization (410), vectorization (420), and post-processing (430), and obtain a prompt generated as a result.

[0078] According to an embodiment, the processor (220) may convert the first content analysis information into low-dimensional first vectors through low-dimensionalization (410) when first content analysis information and device characteristics of an external electronic device are input into a first AI model (400), and may convert the device characteristics of the external electronic device into low-dimensional second vectors. According to an embodiment, the processor (220) may perform vectorization (420) to obtain vectors (e.g., {0.1, 0.2, -0.4, 0.3, -0.6, ...}) that combine the first vectors and the second vectors. According to an embodiment, the processor (220) may perform post-processing (430) to generate a prompt including a natural language or a function (or command) that can be an input of the second AI model using the vectors. In one embodiment, the processor (220) converts analysis information of the spaghetti image into low-dimensional first vector data through low-dimensionalization (410), if the first content is a spaghetti image and the external electronic device is a refrigerator, and converts refrigerator device characteristic information including a type of device corresponding to the refrigerator, a device ID, a technical description (specification) of the device, a function supported by the device, or text representing other device characteristics of the refrigerator into low-dimensional second vector data, and performs vectorization (420) to obtain data (e.g., {0.1, 0.2, -0.4, 0.3, -0.6, ...}) that combines the first vector data and the second vector data, and performs post-processing (430) to generate natural language (e.g., "Please generate content containing additional information for cooking spaghetti. Please make the additional content in the form of a video or text that can be displayed on a display. Each content must include a recipe and cooking order for cooking spaghetti.") or a function (or command) (e.g. {"Category:Cooking", "Additional Content:How to Cook Spaghetti Video, Spaghetti Recipe", "Device Features:Refrigerator, Display, Device Technical Description,...You can create a prompt that includes "}").

[0079] FIG. 5 is a schematic diagram illustrating a second content generation operation using a second AI model according to one embodiment.

[0080] Referring to FIG. 5, a processor (e.g., processor (120) of FIG. 1 or processor (220) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (202) of FIG. 2) according to an embodiment may input a prompt obtained using first content (or first content analysis information) and a first AI model (400) into a second AI model (500) to obtain second content generated as a result. In addition to the first content (or first content analysis information) and the prompt, the processor (220) according to an embodiment may also input external electronic device characteristic information to obtain second content generated as a result.

[0081] In one embodiment, the processor (220) may generate a spaghetti cooking recipe video or text that can be displayed on a display as the second content using the second AI model (500) when the first content is a picture of spaghetti and the prompt obtained using the first AI model (400) includes natural language (e.g., “Please generate content containing additional information for cooking spaghetti. The additional content should be in the form of a video or text that can be displayed on a display. Each content must include a recipe for cooking spaghetti and the cooking order.”) or a function (or command) (e.g., {“Category: Cooking”, “Additional content: Spaghetti cooking method video, spaghetti cooking recipe”, “Device characteristics: Refrigerator, display, device technical description, …”}).

[0082] FIG. 6 is a flowchart illustrating a content transmission method using an AI model in an electronic device according to one embodiment.

[0083] Referring to FIG. 6, a processor (e.g., processor (120) of FIG. 1 or processor (220) of FIG. 2, hereinafter, processor (220) of FIG. 2 will be described as an example) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (201) of FIG. 2) according to one embodiment may perform at least one operation from operations 610 to 640.

[0084] In operation 610, the processor (220) according to an embodiment may identify an external electronic device (202) to which the first content is to be transmitted. The processor (220) according to an embodiment may determine (or identify or confirm) at least one recommended external electronic device recommended to receive the first content among the external electronic devices by using content analysis information of the first content, device characteristic information of each of the external electronic devices connected to the electronic device (201), location of each of the electronic device (201) and the external electronic devices (or information related to distance, location, or other location between the electronic device (201) and the external electronic device) and / or situation information (time or operation status of each of the electronic device (201) and the external electronic device or other specified situation information), and may identify (or determine or confirm) an external electronic device (202) to which the first content is to be transmitted based on a user input among the at least one recommended external electronic device.

[0085] In operation 620, the processor (220) according to one embodiment may obtain (or generate) a prompt associated with the first content based on content analysis information of the first content and device characteristic information of the external electronic device (202). The processor (220) according to one embodiment may use a first AI model or a specified rule (or condition) to determine the external electronic device (202) to which the first content will be transmitted and to generate the prompt. In one embodiment, the processor (220) converts analysis information of the spaghetti image into low-dimensional first vector data when the first content is a picture of spaghetti and the external electronic device is a refrigerator, and converts refrigerator device characteristic information including a type of device corresponding to the refrigerator, a device ID, a technical description (specification) of the device, a function supported by the device, or text representing other device characteristics of the refrigerator into low-dimensional second vector data, and processes data combining the first vector data and the second vector data (e.g., {0.1, 0.2, -0.4, 0.3, -0.6, ...}) through post-processing to generate natural language that can be an input of the second AI model (e.g., "Please generate content containing additional information for cooking spaghetti. The additional content must be in the form of a video or text that can be displayed on a display. Each content must include a recipe and cooking order for cooking spaghetti."), or a function (or command) (e.g., You can create a prompt that includes {"Category:Cooking", "Additional Content:How to Cook Spaghetti Video, Spaghetti Recipe", "Appliance Features:Refrigerator, Display, Applicant Technical Description,..."}

[0086] In operation 630, the processor (220) according to an embodiment may obtain second content corresponding to the prompt using the second AI model. The processor (220) according to an embodiment may input the prompt obtained in association with the first content into the second AI model and obtain second content generated based on the result of the prompt processing by the second AI model. The second content according to an embodiment may include text associated with the first content, an image associated with the first content, a video associated with the first content, a URL (uniform resource locator) associated with the first content, an external electronic device setting value associated with the first content, and / or an external electronic device control value associated with the first content.

[0087] In operation 640, the processor (220) according to an embodiment may transmit the first content and the second content to the external electronic device (202) or transmit the second content to the external electronic device (202). The processor (220) according to an embodiment may transmit the first content and the second content to the external electronic device (202) through the communication circuit (290) if the external electronic device (202) can support the first content, and may transmit the second content to the external electronic device (202) through the communication circuit (290) if the external electronic device (202) cannot support the first content. The external electronic device (202) according to an embodiment may receive the first content and the second content or receive the second content from the electronic device (201). According to an embodiment, an external electronic device (202) may output (or play, execute, or display) the first content while simultaneously outputting or playing, executing, displaying, or applying the second content when first content and second content are received from the electronic device (201). According to an embodiment, an external electronic device (202) may output or play, execute, display, or apply the second content when second content is received from the electronic device (201).

[0088] According to an embodiment, a method for transmitting content using an artificial intelligence model in an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) may include an operation of identifying an external electronic device (102, 202) to which first content will be transmitted. According to an embodiment, the method may include an operation of obtaining a prompt for generating second content that is associated with the first content and supported by the external electronic device based on content analysis information of the first content and device characteristic information of the external electronic device. According to an embodiment, the method may include an operation of obtaining the second content corresponding to the prompt using the artificial intelligence model. According to an embodiment, the method may include an operation of transmitting the first content and the second content to the external electronic device through a communication circuit (190, 290) of the electronic device or transmitting the second content to the external electronic device through the communication circuit.

[0089] The method according to one embodiment may further include an operation of determining one of the external electronic devices communicatively connected to the electronic device through the communication circuit as the external electronic device to which the first content is to be transmitted.

[0090] According to one embodiment, the method may further include an operation of displaying, on a display of the electronic device, at least one external electronic device recommended based on the first content analysis information and device characteristic information of each of the external electronic devices among the external electronic devices. According to one embodiment, the method may further include an operation of determining, based on a user input, an external electronic device among the at least one external electronic device to which the first content will be transmitted.

[0091] The method according to one embodiment may include an operation of identifying whether the external electronic device is capable of supporting the first content. The method according to one embodiment may further include an operation of transmitting the first content and the second content to the external electronic device via the communication circuit if the external electronic device is capable of supporting the first content, or transmitting the second content to the external electronic device via the communication circuit if the external electronic device is not capable of supporting the first content.

[0092] According to one embodiment, the method may include an operation of obtaining content analysis information including first vectors for an image corresponding to the first content. According to one embodiment, the method may include an operation of obtaining device characteristic information including second vectors for text corresponding to device characteristics of the external electronic device. According to one embodiment, the method may further include an operation of obtaining the prompt by combining the first vectors and the second vectors.

[0093] In the method according to one embodiment, the prompt may include natural language, a function, or a command. In the method according to one embodiment, the first content may include an image, a video, and / or audio. In the method according to one embodiment, the second content may include text associated with the first content, an image associated with the first content, a video associated with the first content, a uniform resource locator (URL) associated with the first content, an external electronic device setting value associated with the first content, and / or an external electronic device control value associated with the first content. In the method according to one embodiment, the external electronic device may be a smartphone, a refrigerator, an oven, an induction cooker, an air conditioner, a washing machine, a TV (television), a VR (virtual reality) device, or an IOT (internet of things) device.

[0094] FIG. 7 is a flowchart illustrating an operation of generating and transmitting second content after determining an external electronic device to which first content will be transmitted among at least one recommended external electronic device in an electronic device according to one embodiment.

[0095] Referring to FIG. 7, a processor (e.g., processor (120) of FIG. 1 or processor (220) of FIG. 2, hereinafter, processor (220) of FIG. 2 will be described as an example) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (201) of FIG. 2) according to one embodiment may perform at least one operation from operations 710 to 790.

[0096] In operation 710, the processor (220) according to one embodiment may identify the occurrence of a transmission request event for first content. The first content according to one embodiment may include text, an image (or image data), a video (or video data), and / or audio (or audio data). For example, the processor (220) may identify a transmission request event for a photo (or image) selected by a user from among photos (or images) in a gallery (or photo album) application.

[0097] In operation 720, a processor (220) according to an embodiment may analyze the first content based on the occurrence of a first content transmission request event to obtain content analysis information and obtain device characteristic information of each of the external electronic devices connected to the electronic device (201).

[0098] In operation 730, the processor (220) according to an embodiment may generate a list of at least one recommended external electronic device. The processor (220) according to an embodiment may determine at least one recommended external electronic device recommended to receive the first content among the external electronic devices by using content analysis information of the first content, device characteristic information of each of the external electronic devices connected to the electronic device (201), and locations of each of the electronic device (201) and the external electronic devices (or information related to distance, location, or other location between the electronic device (201) and the external electronic device) and / or situation information (time or operation status of each of the electronic device (201) and the external electronic device or other specified situation information), and may generate a list of at least one recommended external electronic device determined. According to one embodiment, the processor (220) can determine (or determine or identify) whether each of the external electronic devices can support the first content and whether each of the external electronic devices can generate the second content to be transmitted, and determine at least one recommended external electronic device among the external electronic devices based on the determination result.

[0099] In operation 740, the processor (220) according to an embodiment may generate at least one prompt associated with each of at least one recommended external electronic device. The processor (220) according to an embodiment may use a first AI model or a specified rule (or condition) to determine at least one recommended external electronic device and generate at least one prompt based on content analysis information of the first content and device characteristic information of each of the external electronic devices connected to the electronic device (201). The prompt according to an embodiment may include a natural language or a function (or command) that may be input to a second AI model for generating second content supported by the external electronic device while being associated with the first content. Operations 720 to 730 according to an embodiment may be performed using the first AI model.

[0100] In operation 750, the processor (220) according to one embodiment may identify whether the generation of at least one recommended external electronic device list and at least one prompt was successful. The processor (220) according to one embodiment may terminate if the generation of at least one recommended external electronic device list and at least one prompt was not successful.

[0101] In operation 760, the processor (220) according to one embodiment may provide (e.g., display on the display (260)) at least one recommended external electronic device list if the generation of at least one recommended external electronic device list is successful.

[0102] In operation 770, the processor (220) according to one embodiment may determine (or select) an external electronic device (202) to receive first content based on user input.

[0103] In operation 780, the processor (220) according to one embodiment may obtain (or generate) second content corresponding to a prompt for the external electronic device (202) using the second AI model based on the determination of the external electronic device (202) to receive the first content. In one embodiment, the processor (220) may input the prompt for the external electronic device (202) among at least one prompt generated in operation 740 based on the determination of the external electronic device (202) to receive the first content into the second AI model and obtain second content generated based on the result of the prompt processing by the second AI model. According to one embodiment, the second content may include text associated with the first content, an image associated with the first content, a video associated with the first content, a uniform resource locator (URL) associated with the first content, an external electronic device setting associated with the first content, and / or an external electronic device control value associated with the first content.

[0104] In operation 790, the processor (220) according to one embodiment may transmit the first content and the second content to the external electronic device (202) through the communication circuit (290) or transmit the second content to the external electronic device (202) through the communication circuit (290). The processor (220) according to one embodiment may transmit the first content and the second content to the external electronic device (202) through the communication circuit (290) when the external electronic device (202) can support the first content, and may transmit the second content to the external electronic device (202) through the communication circuit (290) when the external electronic device (202) cannot support the first content.

[0105] FIG. 8 is a flowchart illustrating an operation of transmitting second content to an external electronic device that has been determined to transmit first content after generating second content for at least one recommended external electronic device in an electronic device according to one embodiment.

[0106] Referring to FIG. 8, a processor (e.g., processor (120) of FIG. 1 or processor (220) of FIG. 2, hereinafter, processor (220) of FIG. 2 will be described as an example) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (201) of FIG. 2) according to one embodiment may perform at least one operation from operations 810 to 890.

[0107] In operation 810, the processor (220) according to an embodiment may identify the occurrence of a transmission request event for first content. The first content according to an embodiment may include text, an image (or image data), a video (or video data), and / or audio (or audio data). For example, the processor (220) may identify a transmission request event for a photo (or image) selected by a user from among photos (or images) in a gallery (or photo album) application.

[0108] In operation 820, a processor (220) according to an embodiment may analyze the first content based on the occurrence of a first content transmission request event to obtain content analysis information and obtain device characteristic information of each of the external electronic devices connected to the electronic device (201).

[0109] In operation 830, the processor (220) according to an embodiment may generate a list of at least one recommended external electronic device. The processor (220) according to an embodiment may determine at least one recommended external electronic device recommended to receive the first content among the external electronic devices by using content analysis information of the first content, device characteristic information of each of the external electronic devices connected to the electronic device (201), and locations of each of the electronic device (201) and the external electronic devices (or information related to distance, location, or other location between the electronic device (201) and the external electronic device) and / or situation information (time or operation status of each of the electronic device (201) and the external electronic device or other specified situation information), and may generate a list of at least one recommended external electronic device determined. According to one embodiment, the processor (220) can determine (or determine or identify) whether each of the external electronic devices can support the first content and whether each of the external electronic devices can generate the second content to be transmitted, and determine at least one recommended external electronic device among the external electronic devices based on the determination result.

[0110] In operation 840, the processor (220) according to an embodiment may generate at least one prompt associated with each of at least one recommended external electronic device. The processor (220) according to an embodiment may use a first AI model or a specified rule (or condition) to determine at least one recommended external electronic device and generate at least one prompt based on content analysis information of the first content and device characteristic information of each of the external electronic devices connected to the electronic device (201). The prompt according to an embodiment may include a natural language or a function (or command) that may be input to a second AI model for generating second content supported by the external electronic device while being associated with the first content. Operations 820 to 840 according to an embodiment may be performed using the first AI model.

[0111] In operation 850, the processor (220) according to one embodiment may generate second content for at least one recommended external electronic device using at least one prompt for each of the at least one recommended external electronic device. Operation 850 according to one embodiment may be performed using a second AI model.

[0112] In operation 860, the processor (220) according to one embodiment may identify whether the generation of at least one recommended external electronic device list and the generation of second content for at least one recommended external electronic device were successful. The processor (220) according to one embodiment may terminate the process if the generation of at least one recommended external electronic device list and the generation of second content for at least one recommended external electronic device were not successful.

[0113] In operation 870, the processor (220) according to one embodiment may provide (e.g., display on the display (260)) at least one recommended external electronic device list when the generation of at least one recommended external electronic device list and the generation of second content for at least one recommended external electronic device are successful.

[0114] In operation 880, the processor (220) according to one embodiment may determine (or select) an external electronic device (202) to receive the first content. The processor (220) according to one embodiment may determine (or select) an external electronic device (202) to receive the first content based on a user input.

[0115] In operation 890, the processor (220) according to one embodiment may identify second content for the external electronic device (202) among the second contents for each of at least one recommended external electronic device generated in operation 850 based on the determination of the external electronic device (202) to receive the first content, and transmit the first content and the second content to the external electronic device (202) through the communication circuit (290), or transmit the second content to the external electronic device (202) through the communication circuit (290).

[0116] FIG. 9 is a diagram illustrating an example of additional content generated for at least one external electronic device when an image sharing request is made in an electronic device according to one embodiment.

[0117] Referring to FIG. 9, an electronic device (e.g., a smart phone) (901) (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) (or a processor of the electronic device (901) (e.g., the processor (120) of FIG. 1 or the processor (220) of FIG. 2)) according to an embodiment of the present invention can identify the occurrence of a transmission request event of an image (910) based on selection of a share icon (920) for a photo (image) (910) of a gallery (or photo album) application.

[0118] According to an embodiment, an electronic device (901) may identify analysis information of an image (910) and external electronic devices connected to the electronic device (901) based on the occurrence of a transmission request event of the image (910). External electronic devices that can be connected to the electronic device (901) according to an embodiment may include, for example, a mobile device (e.g., a smart phone), a refrigerator, an oven, an induction cooker, an air conditioner, a washing machine, a TV (television), a VR (virtual reality) device, or an IOT (internet of things) device, and other external electronic devices may also be connected to the electronic device (901). According to an embodiment, one or more external electronic devices may be connected to the electronic device (901). FIG. 9 illustrates an example in which multiple external electronic devices are connected.

[0119] In one embodiment, the electronic device (901) may determine (or identify or confirm) at least one recommended external electronic device recommended to receive first content among the external electronic devices by using device characteristic information of each external electronic device connected to the electronic device (901) and the location of each of the electronic device (201) and the external electronic devices (or information related to the distance, location, or other location between the electronic device (201) and each of the external electronic devices) and / or situation information (time or the operation status of each of the electronic device (201) and the external electronic devices or other specified situation information). In FIG. 9, a smartphone (902), a refrigerator (904), an oven (906), and a VR device (908) are described as examples in which the recommended external electronic devices are determined. Other external electronic devices or other external electronic devices may also be determined as recommended external electronic devices.

[0120] In one embodiment, the electronic device (901) may generate at least one prompt associated with each of at least one recommended external electronic device (902, 904, 906, 908), and may generate at least one additional content (e.g., second content) for each of the at least one recommended external electronic device using the at least one prompt for each of the at least one recommended external electronic device (902, 904, 906, 908).

[0121] In one embodiment, the electronic device (901) may generate a prompt for a smart phone (902) to generate second content (e.g., “Describe the image”) that is associated with the image (901) and supported by the smart phone (902), and may use the prompt to generate second content (e.g., an image description message) (912) for the smart phone (902). In one embodiment, the electronic device (901) may generate a prompt for generating secondary content (e.g., "Please generate content containing additional information for cooking the image, in the form of a video or text that can be displayed on a display, and each content generated must include a recipe or cooking order for the dish in the image") for the refrigerator (902) in association with the image (901), and may use the prompt to generate secondary content (e.g., a cooking recipe video (or text) for the image) (914) for the refrigerator (904). In one embodiment, the electronic device (901) may generate a prompt for an oven (906) to generate a second content supported by the oven (906) associated with the image (901) (e.g., "Generate oven settings for cooking the ingredients in the image in the oven"), and may use the prompt to generate second content (e.g., oven settings for cooking the ingredients in the image) (916) for the oven (906). In one embodiment, the electronic device (901) may generate a prompt for a VR device (908) to generate a second content supported by the VR device (908) associated with the image (901) (e.g., "Generate virtual reality content containing additional information about cooking the ingredients in the image"), and may use the prompt to generate second content (e.g., virtual reality content about cooking the ingredients in the image) (918) for the VR device (908).

[0122] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0123] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0124] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0125] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0126] In one embodiment, a non-volatile storage medium storing commands, wherein the commands are configured to cause the electronic device to perform at least one operation when executed by the electronic device, wherein the at least one operation may include: identifying an external electronic device to which first content is to be transmitted; obtaining a prompt for generating second content supported by the external electronic device and associated with the first content based on content analysis information of the first content and device characteristic information of the external electronic device; obtaining the second content corresponding to the prompt using an AI (artificial intelligence) model; and transmitting the first content and the second content to the external electronic device through a communication circuit (190, 290) of the electronic device or transmitting the second content to the external electronic device through the communication circuit.

[0127] According to one embodiment, the method according to the various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0128] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101, 201), Communication circuit (190, 290); Memory (130, 240) for storing commands; and At least one processor (120, 220) operatively connected to the above communication circuit and the above memory, The above instructions, when collectively or individually executed by the at least one processor, cause the electronic device to: Identifying an external electronic device (102, 202) to transmit the first content, Obtain a prompt for generating second content associated with the first content and supported by the external electronic device based on content analysis information of the first content and device characteristic information of the external electronic device; Obtain the second content corresponding to the above prompt using an AI (artificial intelligence) model, An electronic device that transmits the first content and the second content to the external electronic device through the communication circuit or transmits the second content to the external electronic device through the communication circuit.

2. In paragraph 1, The above instructions, when collectively or individually executed by the at least one processor, cause the electronic device to: An electronic device that determines one of external electronic devices communicatively connected to the electronic device through the communication circuit as the external electronic device to which the first content will be transmitted.

3. In paragraph 1 or 2, Including more displays, The above instructions, when collectively or individually executed by the at least one processor, cause the electronic device to: Displaying at least one external electronic device recommended based on the first content analysis information and device characteristic information of each of the external electronic devices on the display, An electronic device that determines which of said at least one external electronic device to transmit said first content to based on a user input.

4. In any one of paragraphs 1 to 3, The above instructions, when collectively or individually executed by the at least one processor, cause the electronic device to: Identifying whether the external electronic device is capable of supporting the first content, If the external electronic device can support the first content, the first content and the second content are transmitted to the external electronic device through the communication circuit, An electronic device that transmits the second content to the external electronic device through the communication circuit when the external electronic device cannot support the first content.

5. In any one of paragraphs 1 to 4, The above instructions, when collectively or individually executed by the at least one processor, cause the electronic device to: Obtaining the content analysis information including the first vectors for the image corresponding to the first content, Obtaining the device characteristic information including second vectors for text corresponding to the device characteristic of the external electronic device, An electronic device for obtaining the prompt by combining the first vectors and the second vectors.

6. In any one of paragraphs 1 to 5, The above prompts may include natural language, functions, or commands, The first content is an electronic device including images, videos, and / or audio.

7. In any one of paragraphs 1 to 6, The second content includes text associated with the first content, an image associated with the first content, a video associated with the first content, a uniform resource locator (URL) associated with the first content, an external electronic device setting associated with the first content, and / or an external electronic device control value associated with the first content. The above external electronic device is an electronic device including a smart phone, a refrigerator, an oven, an induction, an air conditioner, a washing machine, a TV (television), a VR (virtual reality) device, or an IOT (internet of things) device.

8. A method for transmitting content using an artificial intelligence model in an electronic device (101, 201), An action for identifying an external electronic device (102, 202) to transmit first content; An operation of obtaining a prompt for generating second content associated with the first content and supported by the external electronic device based on content analysis information of the first content and device characteristic information of the external electronic device; An operation of obtaining the second content corresponding to the prompt using the artificial intelligence model; and A method comprising an operation of transmitting the first content and the second content to the external electronic device through a communication circuit (190, 290) of the electronic device or transmitting the second content to the external electronic device through the communication circuit.

9. In paragraph 8, A method further comprising the action of determining one of the external electronic devices communicatively connected to the electronic device through the communication circuit as the external electronic device to which the first content will be transmitted.

10. In clause 8 or 9, An operation of displaying at least one external electronic device recommended based on the first content analysis information and device characteristic information of each of the external electronic devices on the display of the electronic device; and A method further comprising the action of determining an external electronic device to which the first content is to be transmitted based on a user input from among the at least one external electronic device.

11. In any one of paragraphs 8 to 10, An action of identifying whether the external electronic device is capable of supporting the first content; A method further comprising: transmitting the first content and the second content to the external electronic device via the communication circuit if the external electronic device can support the first content, or transmitting the second content to the external electronic device via the communication circuit if the external electronic device cannot support the first content.

12. In any one of paragraphs 8 to 11, An operation of obtaining content analysis information including first vectors for an image corresponding to the first content; An operation of obtaining device characteristic information including second vectors for text corresponding to device characteristics of the external electronic device; and A method further comprising an action of obtaining the prompt by combining the first vectors and the second vectors.

13. In any one of paragraphs 8 to 12, The above prompts may include natural language, functions, or commands, A method wherein the first content comprises an image, a video, and / or an audio.

14. In any one of paragraphs 8 to 13, The second content includes text associated with the first content, an image associated with the first content, a video associated with the first content, a uniform resource locator (URL) associated with the first content, an external electronic device setting associated with the first content, and / or an external electronic device control value associated with the first content. A method wherein the external electronic device includes a smart phone, a refrigerator, an oven, an induction, an air conditioner, a washing machine, a television, a VR (virtual reality) device, or an IOT (internet of things) device.

15. In a non-transitory storage medium storing commands, the commands are set to cause the electronic device to perform at least one operation when executed by the electronic device, the at least one operation being: An action for identifying an external electronic device (102, 202) to transmit first content; An operation of obtaining a prompt for generating second content associated with the first content and supported by the external electronic device based on content analysis information of the first content and device characteristic information of the external electronic device; An action of obtaining the second content corresponding to the prompt using an AI (artificial intelligence) model; and A storage medium including an operation of transmitting the first content and the second content to the external electronic device through a communication circuit (190, 290) of the electronic device or transmitting the second content to the external electronic device through the communication circuit.

Images