Electronic device and method for sharing content, and non-transitory computer-readable recording medium

Abstract

An electronic device is disclosed. The electronic device can: receive a user input for sharing information included in content; on the basis of receiving the user input, display, on a display, a visual object representing a plurality of applications; after displaying the visual object, receive another user input for selecting an application that is to share the information from among the plurality of applications; and, on the basis of receiving the another user input, generate, on the basis of information on the application and the information included in the content, data to be displayed on the display through the application.

Description

Electronic device, method, and non-transitory computer-readable recording medium for sharing content

[0001] The descriptions below relate to electronic devices, methods, and non-transitory computer-readable recording media for sharing content.

[0002] Artificial intelligence is a technology for simulating the neural activity of humans (or living things), such as perception and / or inference, and can be implemented by hardware, software, or a combination of these designed to perform computations for simulating neural activity.

[0003] An electronic device is disclosed. The electronic device may include a display, at least one processor including a processing circuit; and a memory storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a user input for sharing information included in content. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a visual object representing a plurality of applications through the display based on receiving the user input. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive another user input for selecting an application among the plurality of applications with which to share the information after displaying the visual object. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to generate data to be displayed on the display through the application based on information about the application and information contained in the content, based on receiving the other user input.

[0004] A method is disclosed. The method may be performed by an electronic device including a display. The method may include receiving a user input for sharing information included in content. The method may include displaying a visual object representing a plurality of applications through the display based on the user input received. The method may include receiving another user input for selecting an application among the plurality of applications with which to share the information, after displaying the visual object. The method may include generating data to be displayed on the display through the application based on information about the application and information included in the content, based on the receiving of the other user input.

[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a display, may cause the electronic device to receive a user input for sharing information included in content. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a visual object representing a plurality of applications through the display based on receiving the user input. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive another user input for selecting an application among the plurality of applications with which to share the information after displaying the visual object. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to generate data to be displayed on the display through the application based on information about the application and information contained in the content, based on receiving the other user input.

[0006] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0007] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0008] FIG. 3A illustrates an example of content according to one embodiment.

[0009] FIG. 3b illustrates an example of a user interface (UI) for an electronic device to share content, according to one embodiment.

[0010] FIG. 3c illustrates an example of a UI including visual objects representing applications with which content is to be shared, according to one embodiment.

[0011] FIG. 3D illustrates an example of a UI for an electronic device to identify additional content, according to one embodiment.

[0012] FIG. 4A illustrates an example of a layout of an application in which content is to be shared by an electronic device, according to one embodiment.

[0013] FIG. 4b illustrates an example of a screen of an application in which content is shared, according to an embodiment of the present invention.

[0014] FIG. 4c illustrates an example of a layout of an application in which content is to be shared, according to an embodiment of the present invention.

[0015] FIG. 4D illustrates an example of a screen of an application in which content is shared, according to an embodiment of the present invention.

[0016] FIG. 5 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0017] Figure 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0018] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0019] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0020] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0021] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0022] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0023] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0024] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0025] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0026] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0027] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0028] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0029] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0030] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0031] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0032] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0033] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0034] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0035] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0036] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0037] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0038] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, a loss coverage (e.g., 664 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for realizing URLLC.

[0039] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0040] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0041] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0042] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0043] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0044] The electronic device (101) of FIG. 2 can be described with reference to the electronic device (101) of FIG. 1.

[0045] In one embodiment, referring to FIG. 2, the electronic device (101) may include a processor (120), a memory (130), a display (260), a camera (280), and a communication circuit (290). In one embodiment, the processor (120) of FIG. 2 may correspond to the processor (120) of FIG. 1. In one embodiment, the memory (130) of FIG. 2 may correspond to the memory (130) of FIG. 1. In one embodiment, the display (260) of FIG. 2 may correspond to the display module (160) of FIG. 1. In one embodiment, the camera (280) of FIG. 2 may correspond to the camera module (180) of FIG. 1. In one embodiment, the communication circuit (290) of FIG. 2 may correspond to the communication module (190) of FIG. 1.

[0046] In one embodiment, the memory (130) may include a content analysis module (211), a prompt generation module (213), an input data generation module (214), a generative artificial intelligence (GEN AI) model (215), a data management module (217), and / or a database (219). In one embodiment, the content analysis module (211), the prompt generation module (213), the input data generation module (214), the GEN AI model (215), and / or the data management module (217) may include at least one instruction. In one embodiment, when at least one instruction included in the content analysis module (211), the prompt generation module (213), the input data generation module (214), the GEN AI model (215), and / or the data management module (217) is performed by the processor (120), the electronic device (101) may perform at least one operation defined by the content analysis module (211), the prompt generation module (213), the input data generation module (214), the GEN AI model (215), and / or the data management module (217).

[0047] In one embodiment, the processor (120) may analyze content through the content analysis module (211). In one embodiment, the processor (120) may analyze content through the content analysis module (211) based on the fulfillment of a condition that triggers content analysis. In one embodiment, the processor (120) may determine that the condition that triggers content analysis is fulfilled based on receiving a user input requesting content sharing. In one embodiment, the processor (120) may determine that the condition that triggers content analysis is fulfilled based on receiving a user input requesting the generation of data to be shared based on the content. In one embodiment, the processor (120) may determine that the condition that triggers content analysis is fulfilled based on receiving a user input that selects an application to which content-based data will be delivered. In one embodiment, the content may include images, text, and / or videos viewable through the application. In one embodiment, the content may be a document, document, file, web page, memo, post, blog, comment (e.g., comment on a social service), feed, thread, reply, ledger, and / or account recorded through the application.

[0048] For example, the processor (120) can identify the validity of the content based on analyzing the content through the content analysis module (211). For example, the content analysis module (211) can identify whether the content includes processed information (e.g., false information and / or information generated through an artificial intelligence (AI) model). For example, if the content is a receipt, the processor (120) can identify whether the information included in the receipt (e.g., card authorization number, product list) is normal information or processed information through the content analysis module (211).

[0049] For example, the processor (120) may identify the context of the content based on analyzing the content through the content analysis module (211). For example, the context of the content may indicate the time (or season, year), person, place, and / or situation (or atmosphere) described by the content.

[0050] For example, the processor (120) may extract (or identify) at least one object from the content based on analyzing the content through the content analysis module (211). For example, the processor (120) may identify the context of each object of the content through the content analysis module (211). In one embodiment, the context of the object may include the type, size, location, and / or relationship with other objects of each object of the content. In one embodiment, the context of the object may indicate the type of the object (e.g., person, thing, animal, plant, building, symbol, number, word, and / or sentence).

[0051] In one embodiment, the content analysis module (211) may be an artificial intelligence (AI) model that processes images (or vision), an AI model that processes language, or a combination thereof. For example, the content analysis module (211) may extract meaning from content (e.g., images, videos, and / or text) and output the extracted meaning as text. For example, the content analysis module (211) may be an AI model such as a vision transformer or a ResNet model. However, the present invention is not limited thereto. The content analysis module (211) may be a character recognizer (e.g., optical character recognition (OCR)) that may extract text from content (e.g., images, videos, and / or text).

[0052] In one embodiment, the processor (120) may perform image processing on content through the content analysis module (211) to improve the quality of the content (e.g., up-scale) when the quality of the content (e.g., image resolution) is low. In one embodiment, the content analysis module (211) may perform analysis on content with improved quality.

[0053] In one embodiment, the processor (120) may identify information about a selected application based on a user input received via the input data generation module (214) for selecting an application to which content-based data will be transmitted (or shared). In one embodiment, the processor (120) may obtain information about the selected application from the selected application. For example, the processor (120) may receive information about the application from the selected application by requesting the information about the application from the selected application. For example, the application information may indicate characteristics of the application (e.g., layout (or position and / or size of views), number of input fields (or views), types of input fields (e.g., image input fields (or image views), and / or text input fields (or text views), and / or identification information of input fields (e.g., identification information of views)). In one embodiment, a view may be an area within a screen into which content (e.g., text and / or images) can be input. For example, the application information may include types of applications (e.g., household account book, social media, and / or memos).

[0054] In one embodiment, the processor (120) may generate a prompt for generating data (hereinafter, shared data) to be shared (or input) to an application based on content through the prompt generation module (213). In one embodiment, the processor (120) may generate a prompt for generating shared data based on the analysis result of the content analysis module (211) on the content through the prompt generation module (213). For example, the processor (120) may generate a prompt for generating shared data based on the context of each object of the content through the prompt generation module (213). For example, the processor (120) may generate a prompt for generating shared data based on the type, size, location, and / or relationship with other objects of each object of the content through the prompt generation module (213). For example, the processor (120) may generate a prompt for generating shared data based on the type of object (e.g., person, object, animal, plant, building, symbol, number, word, and / or sentence) through the prompt generation module (213).

[0055] In one embodiment, the processor (120) may select a reference prompt corresponding to the type of application from among a plurality of reference prompts through the prompt generation module (213). In one embodiment, the processor (120) may generate a prompt for generating shared data by replacing words included in the selected reference prompt with words representing the analysis results of the content analysis module (211) on the content. For example, the reference prompt may be a prompt set for a household account application. For example, the reference prompt may include text fields that can describe the characteristics of the application (e.g., the number of views, the positions of the views, the sizes of the views, the types of content that can be input into the views, and / or the storage locations of the content to be input into the views). For example, the reference prompt may include text fields that can describe the characteristics of the data to be generated (e.g., the tone of the text to be input (e.g., formal, informal), the presence or absence of additional data). For example, a criteria prompt may include text fields that can describe the characteristics of the additional data, if any, if any, such as the type of additional data, where the additional data is stored, and where in the view the additional data will be entered.

[0056] For example, the processor (120) can create a prompt for generating shared data by entering words representing analysis results of content of the content analysis module (211) into fields that can define the characteristics of the application included in the selected criteria prompt.

[0057] In one embodiment, the prompt may be a set of at least one word. In one embodiment, the prompt may be a set of at least one word to guide the generation of shared data based on content. For example, the prompt may include one or more words indicating characteristics (e.g., size, color, shape, format (e.g., whether it contains an image, whether it contains text), and / or characteristics (e.g., location, size) of an object (e.g., an image or text)) and / or types (e.g., document, paper, file, web page, note, post, blog, comment (e.g., a comment on a social service), feed, thread, reply, ledger, and / or account) of the shared data to be generated.

[0058] For example, a prompt may be a set of words (and / or keywords) that can be extracted from content (or at least one object within the content). For example, the words (and / or keywords) may be words that describe a state or property of the content (or at least one object within the content). For example, the words (and / or keywords) may be words that describe a location, relationship, movement, or action of at least one object.

[0059] For example, a prompt may include one or more words that indicate information about the application to which the shared data is to be transmitted. For example, a prompt may include one or more words that indicate characteristics of the application (e.g., layout, number of input fields, types of input fields (e.g., image input fields, and / or text input fields), and / or types (e.g., household account book, social media, and / or notes).

[0060] For example, the prompt may be a word describing data (e.g., data in a database (219) and / or a cloud server (e.g., server (108) of FIG. 1)) that the GEN AI model (215) will reference when generating shared data.

[0061] For example, the prompt may be a word describing data (e.g., personal information (e.g., personal details, and / or body-related information (e.g., facial images)) to be excluded when the GEN AI model (215) generates shared data.

[0062] In one embodiment, the prompt generation module (213) may be an AI model (e.g., a stable diffusion model) for performing a task (e.g., captioning) of extracting at least one word (or at least one sentence) for generating shared data from the analysis result of the content.

[0063] In one embodiment, the GEN AI model (215) may include an AI model including at least one parameter associated with a neural network having a structure based on an encoder and / or decoder, such as a transformer. In one embodiment, the GEN AI model (215) may include a bi-directional model based on learning for an encoder (e.g., bidirectional encoder representations from transformers (BERT)) or an auto-encoding model (e.g., a diffusion model). In one embodiment, the GEN AI model (215) may include an auto-regressor model based on learning for a decoder (e.g., a generative pre-trained transformer (GPT)). In one embodiment, the GEN AI model (215) may include a sequence-to-sequence model (e.g., stable diffusion, DALL-E 2) based on learning for an encoder and / or decoder. In one embodiment, the GEN AI model (215) may include a large language model (LLM) for processing natural language based on massive parameters. In one embodiment, the GEN AI model (215) may be a vision-language model (e.g., a contrastive language-image pre-training model, CLIP) for processing images and text, but is not limited thereto. The GEN AI model (215) may include at least one parameter for driving a neural network such as a convolutional neural network (CNN), a recurrent neural network (RNN), a feedforward neural network (FNN), and / or a long short-term memory (LSTM).

[0064] In one embodiment, the GEN AI model (215) may be an on-device model stored in the memory (130) and executable via the processor (120), but is not limited thereto. The GEN AI model (215) may be a cloud computing-based model stored in an external server (e.g., server (108) of FIG. 1), executable via the processor of the server (103), and the execution result provided to the electronic device (101).

[0065] In one embodiment, the processor (120) may generate shared data based on user input via the GEN AI model (215). For example, the processor (120) may generate shared data through a prompt based on user input via the GEN AI model (215).

[0066] In one embodiment, the processor (120) may generate shared data based on a prompt indicating an analysis result of content of the content analysis module (211) through the GEN AI model (215). For example, the processor (120) may generate shared data based on a prompt indicating the context of each object of the content through the GEN AI model (215).

[0067] In one embodiment, the processor (120) may generate shared data based on a prompt indicating information about an application to which the shared data will be transferred, via the GEN AI model (215). For example, the processor (120) may generate shared data to be entered into each of input fields included in the layout of the application to which the shared data will be transferred, via the GEN AI model (215). For example, the processor (120) may generate shared data including content corresponding to the type of application to which the shared data will be transferred (e.g., household account book, social media, and / or memo).

[0068] In one embodiment, the processor (120) may generate shared data for recording information for managing expenditure details based on the fact that the application to which the shared data is to be transmitted is a receipt-based household account book application, through the GEN AI model (215).

[0069] In one embodiment, the processor (120) may, through the GEN AI model (215), generate shared data for recording a review including content, an image of the purchased product, and / or comments about the purchased product, based on the application to which the shared data is to be delivered being a social media application for reviews (or posts).

[0070] In one embodiment, the processor (120) may generate, through the GEN AI model (215), shared data for recording a blog (or feed) (or thread) that includes at least one comment of more content than a social media application for review, based on the application to which the shared data is to be delivered being a social media application for writing a blog.

[0071] In one embodiment, the processor (120) may generate shared data using data in the database (219) based on a prompt through the GEN AI model (215). For example, the processor (120) may generate shared data based on data requested for reference through the prompt among data stored in the database (219) through the GEN AI model (215). For example, the processor (120) may process data requested for reference through the prompt into data that can be input to the GEN AI model (215) through the input data generation module (214). For example, the processor (120) may generate shared data through the GEN AI model (215) based on data processed through the input data generation module (214). For example, the input data generation module (214) can process data for which a reference is requested through a prompt into data in a format defined by a specified model (e.g., contrastive language-image pre-training (CLIP) and / or vector database).

[0072] In one embodiment, the processor (120) may, through the GEN AI model (215), generate shared data that does not include data to be excluded (e.g., personal information (e.g., personal details, and / or body-related information (e.g., facial images)) based on a prompt.

[0073] In one embodiment, the GEN AI model (215) can be retrained (or fine-tuned) (or retrieval augmented generation (RAG)) (or retrieval augmented fine-tuning (RAFT)) based on user feedback on the shared data. In one embodiment, the user feedback can be negative feedback on the shared data (e.g., to modify or delete). In one embodiment, the user feedback can be positive feedback on the shared data (e.g., to record (or post) (or save) the shared data entered into the layout through the selected application without modification, or to tag the shared data). In one embodiment, the GEN AI model (215) can be retrained to generate modified data based on user feedback on the shared data. In one embodiment, the modified data can be data modified from the shared data according to user input.

[0074] In one embodiment, the processor (120) may manage a database (219) that stores user data of the electronic device (101) through a data management module (217). In one embodiment, the processor (120) may manage data (e.g., photos, videos, documents, files, and / or application data) stored in the database (219) through the data management module (217).

[0075] In one embodiment, the processor (120) may store shared data generated through the GEN AI model (215) in a database (219) through the data management module (217).

[0076] In one embodiment, the processor (120) may identify (or determine) additional content to be used to generate shared data through the data management module (217). In one embodiment, the processor (120) may identify (or determine) additional content to be used to generate shared data through the data management module (217) based on analysis results of the content and / or information of the application.

[0077] For example, the processor (120) may identify additional content to be used to generate shared data through the data management module (217). For example, the processor (120) may identify additional content associated with the content through the data management module (217). For example, the processor (120) may identify additional content associated with the content through the data management module (217) based on information from the application.

[0078] For example, if the application is a household account book application, the processor (120) may identify a receipt with the same expenditure date as the expenditure date recorded in the content as additional content through the data management module (217). For example, if the application is a social media application, the processor (120) may identify an image (e.g., a photograph of the product) and / or text (e.g., a user's comment about the product) representing a product recorded in the content as additional content through the data management module (217).

[0079] In one embodiment, the processor (120) may transmit additional content to be used for generating shared data to the prompt generation module (213) through the data management module (217). In one embodiment, the processor (120) may generate a prompt based on the additional content through the prompt generation module (213). The data management module (217) may be a module that manages data from which the GEN AI model (215) searches for additional information required to generate shared data. For example, the processor (120) may search for additional content to be used for generating shared data through the data management module (217). In one embodiment, the processor (120) may process the additional content searched through the prompt generation module (213) into data that can be input to the GEN AI model (215) through the input data generation module (214). For example, the processor (120) may generate shared data through the GEN AI model (215) based on data processed through the input data generation module (214). For example, the input data generation module (214) may process additional content into data in a format defined by a specified model (e.g., CLIP and / or vector database).

[0080] In one embodiment, the database (219) may be a local database of the electronic device (101) stored in the memory (130) of the electronic device (101), but is not limited thereto. For example, the database (219) may be a remote database (or a cloud database) stored externally (e.g., on a server (108)) accessible through the communication module (190) of the electronic device (101).

[0081] In one embodiment, the database (219) may store structured and / or unstructured data. In one embodiment, the database (219) may be a vector database that stores vector embeddings for the data.

[0082] As described above, the electronic device (101) can generate shared data containing different content depending on the type (or layout) of the application with which the content will be shared. Accordingly, users can more conveniently and quickly create content-related records (e.g., household account bookkeeping, review writing) using the shared data generated based on application information.

[0083] Hereinafter, with reference to FIGS. 3A to 3D, an operation of determining information to be used by the electronic device (101) to generate shared data is described.

[0084] FIG. 3A illustrates an example of content according to an embodiment. FIG. 3B illustrates an example of a user interface (UI) for an electronic device to share content according to an embodiment. FIG. 3C illustrates an example of a UI including visual objects representing applications with which content will be shared according to an embodiment. FIG. 3D illustrates an example of a UI for an electronic device to identify additional content according to an embodiment.

[0085] FIGS. 3A to 3D may be described with reference to FIG. 2. In FIGS. 3A to 3D, content (311) is illustrated as a receipt, but this is merely an example. Content (311) may be other types of images, videos, and / or text other than a receipt.

[0086] In one embodiment, referring to FIG. 3A, a processor (e.g., 120 of FIG. 2) may display a screen (310) including content (311) and / or a control area (315) via a display (e.g., 260 of FIG. 2). In one embodiment, the content (311) may include images, text, and / or videos viewable via an application (e.g., a gallery application, a social media application, a memo application, and / or a household account application). For example, the control area (315) may include at least one thumbnail, and / or at least one visual object for at least one function (e.g., favorite, edit, information, share, or delete). For example, the control area (315) may include a visual object (319) for sharing.

[0087] In one embodiment, the processor (120) may receive a user input (317) for the content (311) being displayed. In one embodiment, the user input (317) may be an input directed to the content (311). In one embodiment, the user input (317) may be an input (e.g., a press input, a long-press input, a drag input) directed to an object (e.g., text, and / or an image (or a person, an object, and / or an animal within the image)) within the content (311). In one embodiment, the user input (317) may be an input (e.g., a press input, a long-press input, a drag input) that causes the display of a menu related to an object within the content (311). However, the present invention is not limited thereto. For example, the user input (317) may be obtained using voice. For example, the processor (120) may identify a voice that includes a specific command from the user (e.g., "Select the breakfast buffet from the receipt") as a user input (317).

[0088] In one embodiment, the processor (120) can identify an object within the content (311) directed to the user input (317). In one embodiment, the processor (120) can identify, through the content analysis module (211), at least one object within the content (311) directed to the user input (317). For example, the processor (120) can identify, through the content analysis module (211), text indicating the name of a store (e.g., AAA Restaurant), the name of a product (e.g., BBB Breakfast Buffet), the type, the price (e.g., 49,000), and / or the consumption date (e.g., 2024-08-22) within the content (311).

[0089] In one embodiment, referring to FIG. 3B, the processor (120) may, based on receiving a user input (317), display a screen (330) in which a menu (331) representing at least one function related to an object selected by the user input (317) is at least partially overlapped (or displayed) on the content (311). The menu (331) may include a visual object representing at least one function (e.g., copy, translate, select all, share, and / or add to note) that the electronic device (101) can provide in relation to an object within the content (311) to which the user input (317) is directed.

[0090] In one embodiment, the processor (120) may receive a user input (335) requesting sharing of the content (311) being displayed while the menu (331) is displayed over the content (311). In one embodiment, the processor (120) may receive a user input (335) requesting sharing of an object within the content (311) toward which the user input (317) is directed. However, the present invention is not limited thereto. In one embodiment, the processor (120) may receive a user input selecting a visual object (319) for sharing of the content (311) while the screen (310) of FIG. 3A is displayed.

[0091] In one embodiment, the processor (120) may analyze content through the content analysis module (211) based on a user input (335) requesting sharing of content (311) (or a user input selecting a visual object (319) for sharing of content (311). In one embodiment, the processor (120) may generate a prompt for generating shared data to be input to an application based on the analysis result of the content through the prompt generation module (213).

[0092] In one embodiment, referring to FIG. 3C, the processor (120) may, based on receiving a user input (335), display a screen (350) in which a menu (351) including at least one icon of one or more applications is superimposed (or displayed) on at least a portion of the content (311). However, the present invention is not limited thereto. In one embodiment, while the screen (310) of FIG. 3A is displayed, the processor (120) may, based on a user input of selecting a visual object (319) for sharing, display a screen (350) in which a menu (351) including at least one icon of one or more applications is superimposed (or displayed) on at least a portion of the content (311). According to an embodiment, based on the user input (335), the content to be shared may be related to an object in the content (311) toward which the user input (317) is directed. For example, if the content (311) is a receipt, the processor (120) may recognize a portion of the text of the receipt corresponding to the user input (317) as an object. Based on the user input selecting a visual object (319) for sharing, the shared content may be related to the entire content (311). However, the present invention is not limited thereto. Based on the user input (335), the shared content may be related to an object in the content (311) to which the user input (317) is directed and the entire content (311). For example, based on the user input (335), the shared content may be related to at least one other object included in the content (311) in addition to the object in the content (311) to which the user input (317) is directed.

[0093] In one embodiment, the processor (120) may receive user input (353 or 355) selecting at least one application with which shared data based on the content (311) will be shared while displaying a menu (351) over the content (311).

[0094] In one embodiment, the processor (120) may identify application information based on a user input (353 or 355) that selects an application with which shared data will be shared. For example, the processor (120) may receive application information from the application by requesting the application selected based on the user input (353 or 355) to provide application information. For example, the application information may indicate characteristics of the application (e.g., layout, number of input fields, types of input fields (e.g., image input fields and / or text input fields), and / or types (e.g., household account book, social media, and / or memo). In one embodiment, the processor (120) may, through the prompt generation module (213), generate a prompt for generating shared data to be input to the application based on the application information. Hereinafter, the characteristics of the application may be described with reference to FIGS. 4A and 4C below.

[0095] In one embodiment, referring to FIG. 3D, the processor (120) may display a screen (370) requesting the user to select additional content based on receiving a user input (353 or 355) for selecting an application with which data based on content (311) will be shared. In one embodiment, the processor (120) may identify additional content (371, 373) based on the user input among contents (311, 371, 373, 375, 377, 379, 381) on the screen (370). However, the present invention is not limited thereto. For example, the processor (120) may identify additional content corresponding to content (311) without user intervention (or without user input). For example, the processor (120) may identify additional content as corresponding to content (311) based on whether the acquisition time and / or acquisition location of the additional content corresponds to the acquisition time and / or acquisition location of content (311). For example, the processor (120) may identify additional content (371, 373) photographed at the same location as content (311) as additional content corresponding to content (311). For example, the processor (120) may identify additional content (371, 373) photographed within a specified distance from the location where content (311) was acquired as additional content corresponding to content (311). For example, the processor (120) may identify additional content (379) of the same type (e.g., a receipt) photographed on the same date as the content (311) as additional content corresponding to the content (311). For example, the processor (120) may identify additional content (379) of the same type (e.g., a receipt) photographed within a specified time from the time the content (311) was acquired as additional content corresponding to the content (311).

[0096] In one embodiment, the processor (120) may analyze additional content (371, 373) through the content analysis module (211) based on a user input selecting additional content (371, 373). In one embodiment, the processor (120) may generate a prompt for generating shared data to be input into the application based on the analysis result of the additional content (371, 373) through the prompt generation module (213).

[0097] Hereinafter, with reference to FIGS. 4a to 4d, an operation of the electronic device (101) to generate shared data is described.

[0098] FIG. 4A illustrates an example of a layout of an application in which content is to be shared, according to an embodiment of the present invention. FIG. 4B illustrates an example of a screen of an application in which content is to be shared, according to an embodiment of the present invention.

[0099] FIGS. 4A and 4B may be described with reference to FIGS. 2 to 3D. FIGS. 4A and 4B may represent an operation in which an electronic device (101) generates shared data according to a user input (353) selecting a household account application.

[0100] In one embodiment, the processor (120) can identify information of the selected application (e.g., characteristics (e.g., layout, number of input fields, types of input fields (e.g., image input fields, and / or text input fields), and / or types (e.g., household account book, social media, and / or memo)).

[0101] For example, the processor (120) may identify information of the household account application based on a sequence of user inputs (317, 353) for sharing content (311) to the household account application. For example, the processor (120) may receive information of the household account application from the household account application by requesting information of a social media application from the household account application. For example, the information of the household account application may indicate characteristics of the application (e.g., layout, number of input fields, types of input fields (e.g., image input fields, and / or text input fields).

[0102] For example, referring to FIG. 4A, the processor (120) may identify a layout (410) of a screen for recording expenditure details within a household account book application. For example, the processor (120) may identify the number and / or positions of input fields (411) for recording expenditure dates within the layout (410). For example, the processor (120) may identify the number and / or positions of input fields (412, 415) for recording types of expenditure items within the layout (410). For example, the processor (120) may identify the number and / or positions of input fields (413, 416) for recording expenditure locations within the layout (410). For example, the processor (120) may identify the number and / or positions of input fields (414, 417) for recording expenditure items within the layout (410).

[0103] For example, the processor (120) may identify additional content associated with the content (311) based on a user input (355) selecting a household account application. For example, the processor (120) may identify additional content associated with the content (311) based on information about the application. For example, the processor (120) may identify additional content that may be recorded together with the content (311) in an expenditure record recorded through the household account application. For example, the processor (120) may identify additional content (379) having the same expenditure date (2024-08-22) as the expenditure date of the content (311). For example, the processor (120) may identify content (377) associated with the additional content (379). For example, the processor (120) may extract information (e.g., “grand piano”) in the content (379) for another receipt having the same expenditure date (2024-08-22) as the expenditure date of the content (311), and identify another content (377) (e.g., a picture of a grand piano) that includes a visual object corresponding to the extracted information (e.g., “grand piano”).

[0104] For example, the processor (120) may generate shared data input into the account book application based on information of the content (311), information of the account book application, and / or information of additional content (377, 379). For example, the processor (120) may generate a prompt indicating information of the content (311), information of the account book application, and / or information of the additional content (377, 379) through the prompt generation module (213). For example, the processor (120) may generate shared data based on information of the content (311), information of the account book application, and / or information of the additional content (377, 379) based on inputting a prompt to the GEN AI model (215).

[0105] In one embodiment, the processor (120) may transmit the generated shared data to the account book application. For example, the processor (120) may transmit a command to the account book application that causes the account book application to include at least one portion of the generated shared data in a designated location.

[0106] In one embodiment, the processor (120) may display a screen (420) containing expenditure details for which shared data has been entered through a household account book application. For example, the processor (120) may display a screen (420) in which an expenditure date is recorded at a location (421) corresponding to an input field (411) through the household account book application.

[0107] For example, the processor (120) may display a screen (420) in which the type of expenditure item (e.g., food and / or industrial products) is recorded at a location (422, 425) corresponding to the input field (412, 415) through a household account book application.

[0108] For example, the processor (120) may display a screen (420) in which an expenditure location (e.g., AAA restaurant and / or CCC piano) is recorded at a location (423, 426) corresponding to an input field (413, 416) through a household account application.

[0109] For example, the processor (120) may display a screen (420) with an expense item (e.g., BBB breakfast buffet and / or grand piano) recorded in a location (424, 427) corresponding to an input field (414, 417) through a household account application.

[0110] In one embodiment, the processor (120) may retrain the GEN AI model (215) based on user feedback regarding the screen (420) into which shared data is entered. In one embodiment, the user feedback may include modifications to data entered in the input fields (411 to 427). For example, modification of data entered into input fields (411 to 427) may include modification and / or deletion of a product item (e.g., modification and / or deletion of data entered into locations (425, 426, 427) corresponding to input fields (415, 416, 417). In one embodiment, the processor (120) may retrain the GEN AI model (215) to generate modified data based on user feedback on the shared data. In one embodiment, the modified data may be data modified from the shared data according to user input. The layout illustrated through FIG. 4A is merely an example, and embodiments are not limited to the layout illustrated through FIG. 4A. For example, depending on the embodiment, the layout for the number, location, and / or size of areas in which content can be recorded may be changed depending on the situation.

[0111] FIG. 4C illustrates an example of a layout of an application in which content is to be shared, according to an embodiment of the present invention. FIG. 4D illustrates an example of a screen of an application in which content is to be shared, according to an embodiment of the present invention.

[0112] FIGS. 4C and 4D may be described with reference to FIGS. 2 to 3D. FIGS. 4C and 4D may represent an operation in which an electronic device (101) generates shared data according to a user input (353) of selecting a household account book application.

[0113] In one embodiment, the processor (120) can identify information of the selected application (e.g., characteristics (e.g., layout, number of input fields, types of input fields (e.g., image input fields, and / or text input fields), and / or types (e.g., household account book, social media, and / or memo)).

[0114] For example, the processor (120) may identify information of a social media application based on a sequence of user inputs (317, 355) for sharing content (311) to the social media application. For example, the processor (120) may obtain information of the social media application from the social media application. For example, the processor (120) may receive information of the social media application from the social media application by requesting information of the social media application from the social media application. For example, the information of the social media application may indicate characteristics of the application (e.g., layout (or position and / or size of views), number of input fields (or views), types of input fields (e.g., image input fields (or image views), and / or text input fields (or text views), and / or identification information of input fields (e.g., identification information of views)). In one embodiment, a view may be an area within a screen into which content (e.g., text and / or images) can be input.

[0115] In one embodiment, the processor (120) may identify the location and / or size of views based on information about the application. In one embodiment, the processor (120) may identify the type of content that can be input into the views based on information about the application.

[0116] Depending on the embodiment, the layout may be identified differently depending on the type of application. For example, the processor (120) may identify a layout depending on the type of application. For example, if the type of application is a blog, the processor (120) may identify a layout of a body structure defined for a blog. For example, if the type of application is social media, the processor (120) may identify a layout of a structure including a title, photo, and / or text defined for social media.

[0117] For example, referring to FIG. 4C, the processor (120) may identify a layout (430) of a screen for recording a post within a social media application. For example, the processor (120) may identify the number and / or positions of input fields (431) for recording the title of the post within the layout (430). For example, the processor (120) may identify the number and / or positions of input fields (433) for recording the content of the post within the layout (430).

[0118] For example, the processor (120) may identify additional content associated with the content (311) based on user input (353) of selecting a social media application. For example, the processor (120) may identify additional content associated with the content (311) based on information of the application. For example, the processor (120) may identify additional content that may be recorded together with the content (311) in a post recorded through the social media application. For example, the processor (120) may identify additional content (371, 373) that has the same context (e.g., time (or season, year), person, place, and / or situation (or mood) depicted by the content (311)) as the content (311).

[0119] For example, the processor (120) may generate shared data input into the social media application based on information of the content (311), information of the social media application, and / or information of additional content (371, 373). For example, the information of the application may indicate the characteristics of the application (e.g., layout (or position and / or size of views), number of input fields (or views), types of input fields (e.g., image input fields (or image views), and / or text input fields (or text views), and / or identification information of input fields (e.g., identification information of views)) and / or types (e.g., household account book, social media, and / or memo). For example, the processor (120) may generate a prompt indicating information of the content (311), information of the social media application, and / or information of the additional content (371, 373) through the prompt generation module (213). For example, the processor (120) may generate at least one shared data based on information of the content (311), information of the social media application, and / or information of the additional content (371, 373) based on inputting a prompt to the GEN AI model (215). In one embodiment, the processor (120) may be capable of generating multimedia for shared data, such as shared data consisting of text or shared data generated by artificial intelligence. This may be generated based on the properties, type, characteristics, etc. of the target application.

[0120] In one embodiment, the processor (120) may transmit the generated shared data to a social media application. For example, the processor (120) may transmit a command to the social media application that causes the social media application to include at least one portion of the generated shared data in a designated location. In one embodiment, the processor (120) may transmit a command to the social media application that causes the social media application to include each of a plurality of portions included in the shared data in different locations. For example, each of the plurality of portions included in the shared data may be generated by the GEN AI model (215) from different content (or different additional content). For example, each of the plurality of portions included in the shared data may be generated from different photos and / or different texts.

[0121] In one embodiment, the processor (120) may display a screen (440) including a post with shared data entered through a social media application. For example, the processor (120) may display a screen (440) in which a spending date is recorded at a location (441) corresponding to an input field (431) through the social media application.

[0122] For example, the processor (120) may display a screen (440) with a title of a post (e.g., “AAA restaurant usage post”) written at a location (441) corresponding to an input field (431) through a social media application.

[0123] For example, the processor (120) may display a screen (440) in which the content of a post is recorded at a location (443) corresponding to the input field (433) through a social media application. In one embodiment, the content of the post may include contents (311, 371, and / or 373). In one embodiment, the content of the post may include sentences (451, 453, 455, 457) describing the contents (311, 371, and / or 373). In one embodiment, the sentence (451) may be a sentence generated based on the context of the content (371). For example, the sentence (451) may indicate a time (or season, year), a person, a place, and / or a situation (or atmosphere) described by the content (371). Similarly, sentence (453) may be generated based on the context of content (373), and sentence (455) may be generated based on the context of content (311). For example, sentence (457) may be generated based on the context of contents (311, 371, 373) and / or additional content other than contents (311, 371, 373) (e.g., user's comments recorded on an external server (108), user's positive or negative reactions related to AAA restaurant).

[0124] In one embodiment, the processor (120) may retrain the GEN AI model (215) based on user feedback regarding a screen (440) into which shared data is input. In one embodiment, the user feedback may include modifications to contents (311, 371, and / or 373) and / or sentences (451, 453, 455, 457). For example, modifications to contents (311, 371, and / or 373) may include resizing, repositioning, and / or deleting contents (311, 371, and / or 373). For example, modifications to sentences (451, 453, 455, 457) may include changing the font, changing the font size, changing the text effect, deleting, adding, and / or modifying the sentences (451, 453, 455, 457). In one embodiment, the user's feedback may include stopping the upload of a review (or feed) that includes the shared data. In one embodiment, the processor (120) may retrain the GEN AI model (215) to generate modified data based on the user's feedback on the shared data. In one embodiment, the modified data may be data modified from the shared data based on user input.

[0125] FIG. 5 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0126] Figure 5 can be explained with reference to Figures 2 to 4d.

[0127] Referring to FIG. 5, in operation 510, the electronic device (101) may identify an input for sharing content (e.g., 311 of FIG. 3A). In one embodiment, the electronic device (101) may identify an input for sharing content (311) while displaying the content (311) through a display (e.g., 260 of FIG. 2). For example, the input for sharing content may be a user input (e.g., 335 of FIG. 3B) for selecting sharing from a menu (331) representing at least one function related to the content (311) and / or an object. For example, the input for sharing content may be a user input for selecting a visual object (e.g., 319 of FIG. 3A) for sharing the content (311).

[0128] In operation 520, the electronic device (101) may identify an application for sharing content (311). In one embodiment, the electronic device (101) may identify an application for sharing content (311) based on a user input to a menu (e.g., 351 of FIG. 3C) that includes at least one icon of one or more applications displayed in response to an input for sharing content.

[0129] In operation 530, the electronic device (101) can identify information of an application. The electronic device (101) can identify information of an application for sharing content (311) through an input data generation module (e.g., 214 of FIG. 2). For example, the electronic device (101) can receive information of an application for sharing content (311) from an application for sharing content (311) by requesting information of the application from the application for sharing content (311). For example, the information of the application can indicate characteristics of the application (e.g., layout, number of input fields, types of input fields (e.g., image input fields and / or text input fields), and / or types (e.g., household account book, social media, and / or memo).

[0130] In operation 540, the electronic device (101) may generate a prompt based on information of the content (311) and / or the application. For example, the electronic device (101) may generate a prompt based on information of the content (311) and / or the application through a prompt generation module (e.g., 213 of FIG. 2).

[0131] In one embodiment, the electronic device (101) may generate a prompt based on the analysis result of the content (311) through the content analysis module (211). In one embodiment, the analysis result of the content (311) may represent the context of the content (311) and / or each object within the content (311). In one embodiment, the context of an object may include the type, size, location, and / or relationship with other objects of each object of the content. In one embodiment, the context of an object may represent the type of the object (e.g., person, thing, animal, plant, building, symbol, number, word, and / or sentence). The context of the content (311) may include the time (or season, year), person, place, and / or situation (or mood) described by the content.

[0132] In one embodiment, the electronic device (101) may, through the prompt generation module (213), generate a prompt for generating shared data to be input into the application based on information about the application. For example, the information about the application may include characteristics of the application (e.g., layout, number of input fields, types of input fields (e.g., image input fields, and / or text input fields), and / or types (e.g., household account book, social media, and / or memo).

[0133] In one embodiment, the electronic device (101) may select a reference prompt corresponding to the type of application from among a plurality of reference prompts through the prompt generation module (213). In one embodiment, the electronic device (101) may generate a prompt for generating shared data by replacing words included in the selected reference prompt with words representing the analysis results of the content analysis module (211) on the content. For example, the reference prompt may be a prompt set for a household account application. For example, the reference prompt may include text fields that can describe the characteristics of the application (e.g., the number of views, the positions of the views, the sizes of the views, the types of content that can be input into the views, and / or the storage locations of the content to be input into the views). For example, the reference prompt may include text fields that can describe the characteristics of the data to be generated (e.g., the tone of the text to be input (e.g., formal, informal), the presence or absence of additional data).

[0134] For example, the electronic device (101) can generate a prompt for generating shared data by entering words representing analysis results of content of the content analysis module (211) into fields that can define the characteristics of the application included in the selected criteria prompt.

[0135] In one embodiment, the electronic device (101) may generate a prompt indicating analysis results of the content (311) and / or information of the application.

[0136] In operation 550, the electronic device (101) may generate data to be shared with the application (hereinafter, shared data) based on the prompt. For example, the electronic device (101) may generate shared data based on the prompt through a GEN AI model (e.g., 215 of FIG. 2). For example, the electronic device (101) may generate shared data based on inputting a prompt to the GEN AI model (215).

[0137] According to an embodiment, the electronic device (101) may transmit shared data generated through the GEN AI model (215) to a selected application. For example, the electronic device (101) may execute a command causing the selected application to input at least one portion of the shared data into a corresponding input field of the selected application.

[0138] According to an embodiment, the electronic device (101) may identify user feedback on shared data entered into the layout of the selected application. For example, the electronic device (101) may retrain (or fine-tune) (or retrieval augmented generation (RAG)) (or retrieval augmented fine-tuning (RAFT)) the GEN AI model (215) based on the user feedback. In one embodiment, the user feedback may be a modification to the shared data. In one embodiment, the user feedback may be recording (or posting) (or saving) the shared data entered into the layout through the selected application without modifying the shared data.

[0139] Figure 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0140] FIG. 6 may be described with reference to FIGS. 2 to 4d. In one embodiment, operations 510, 520, and 550 of FIG. 6 may correspond to operations 510, 520, and 550 of FIG. 5.

[0141] Referring to FIG. 6, in operation 510, an input for sharing content (e.g., 311 of FIG. 3A) may be identified. In operation 520, the electronic device (101) may identify an application for sharing content (311).

[0142] In operation 610, the electronic device (101) can analyze content (311). For example, the electronic device (101) can analyze content (311) through a content analysis module (e.g., 211 of FIG. 2).

[0143] In one embodiment, the electronic device (101) may identify the context of the content (311) based on analyzing the content (311) through the content analysis module (211). For example, the context of the content (311) may include the time (or season, year), person, place, and / or situation (or mood) described by the content (311). For example, the context of the content (311) may indicate content associated with the content (311). For example, the context of the content (311) may indicate content associated with the content (311) based on information of an application. For example, the electronic device (101) may identify other content having the same and / or similar context as the context of the content (311) as content that can be recorded together with the content (311). For example, the electronic device (101) can identify content (e.g., 377 in FIG. 3D) that has a context (e.g., an image representing an object corresponding to the expenditure details) corresponding to the context (e.g., expenditure details) of the content (311) recorded through a household account book application, as related content that can be recorded together with the content (311). For example, the electronic device (101) can identify content (e.g., 379 in FIG. 3D) that has the same context (e.g., expenditure date) as the context (e.g., expenditure date (2024-08-22)) of the content (311), as related content that can be recorded together with the content (311). For example, the electronic device (101) can identify content that can be recorded together with the content (311) in a post recorded through a social media application. For example, the electronic device (101) can identify additional content (e.g., 371, 373 of FIG. 3d) that has the same context (e.g., time (or season, year), person, place, and / or situation (or mood) described by the content (311)) as the content (311).For example, if the content (311) is a receipt, the electronic device (101) can identify the store, food, or order included in the receipt as context. For example, the electronic device (101) can identify at least one photo (371, 375) that includes the context included in the receipt as additional content. For example, if the content (379) is a receipt for purchasing a grand piano, the electronic device (101) can identify at least one photo (377) that includes the content of a grand piano and the context of a grand piano as additional content.

[0144] In one embodiment, the electronic device (101) may extract (or identify) at least one object from the content (311) based on analyzing the content (311) through the content analysis module (211). For example, the electronic device (101) may identify the context of each object of the content (311) based on analyzing the content (311) through the content analysis module (211). In one embodiment, the context of an object may include the type, size, location, and / or relationship with other objects of each object of the content. In one embodiment, the context of an object may include the type of the object (e.g., person, thing, animal, plant, building, symbol, number, word, and / or sentence).

[0145] In operation 620, the electronic device (101) may determine, through the content analysis module (211), whether there is content associated with the content (311). In one embodiment, the content associated with the content (311) may be content selected on a screen (e.g., 370 of FIG. 3D ) that requests the user to select additional content. However, the present invention is not limited thereto. For example, the content associated with the content (311) may be content having the same acquisition time and / or acquisition location as the content (311). For example, the content associated with the content (311) may be content including the same object as the content (311). For example, the content associated with the content (311) may be content including an object corresponding to an object included in the content (311). For example, if the type of object (e.g., image or text) is different from the type of object included in the content (311), but is referred to by the same name (e.g., one is an image of a person, the other is the person's name), the content having that object may be content associated with the content (311).

[0146] For example, the electronic device (101) can determine, through the content analysis module (211), whether there is content related to the content (311) based on information about the application. For example, if the application is a household account book application, the electronic device (101) can determine whether there is a receipt with the same expenditure date as the expenditure date recorded in the content. For example, if the application is a social media application, the electronic device (101) can determine whether there is an image (e.g., an image taken of the product) and / or text (e.g., a user's comment about the product) representing the product recorded in the content.

[0147] In operation 620, based on determining that content associated with content (311) exists, the electronic device (101) may perform operation 630. In operation 620, based on determining that content associated with content (311) does not exist, the electronic device (101) may perform operation 640.

[0148] In operation 630, the electronic device (101) may generate a prompt based on information about the content, associated content, and / or application through the prompt generation module (213).

[0149] In one embodiment, the information of the content may represent the context of the content (311) and / or each object within the content (311). In one embodiment, the information of the associated content may represent a location stored within a database (e.g., 219 of FIG. 2). In one embodiment, the information of the associated content may represent the context of the associated content and / or each object within the associated content. In one embodiment, if the application is a household account application, the associated content may be additional content (379). In one embodiment, if the application is a social media application, the associated content may be additional content (371, 373).

[0150] For example, information about an application may include characteristics of the application (e.g., layout, number of input fields, types of input fields (e.g., image input fields, and / or text input fields), and / or types (e.g., household account book, social media, and / or notes).

[0151] In operation 640, the electronic device (101) may generate a prompt based on information of the content and / or application through the prompt generation module (213). For example, the electronic device (101) may generate a prompt based on information of the content and / or application other than information of the associated content. For example, the electronic device (101) may generate a prompt based on information of the content and / or application without information of the associated content. For example, the electronic device (101) may generate a prompt by inputting words representing analysis results of the content (311) of the content analysis module (211) into fields that can define characteristics of the application included in the reference prompt. In operation 550, the electronic device (101) may generate data to be shared with the application (hereinafter, shared data) based on the prompt. For example, the electronic device (101) can generate shared data based on inputting a prompt to the GEN AI model (e.g., 215 of FIG. 2).

[0152] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0153] FIG. 7 may be described with reference to FIGS. 2 to 4d. In one embodiment, operation 550 of FIG. 7 may correspond to operation 550 of FIG. 5. In one embodiment, operation 610 of FIG. 7 may correspond to operation 610 of FIG. 6.

[0154] Referring to FIG. 7, in operation 610, the electronic device (101) may analyze content (e.g., 311 of FIG. 3A). For example, the electronic device (101) may analyze content (311) through a content analysis module (e.g., 211 of FIG. 2). For example, the electronic device (101) may identify the validity of the content based on the analysis of the content through the content analysis module (211). For example, the electronic device (101) may identify whether the content includes processed information (e.g., false information and / or information generated through an AI (artificial intelligence) model) through the content analysis module (211). For example, if the content is a receipt, the electronic device (101) can identify, through the content analysis module (211), whether the information included in the receipt (e.g., card authorization number, product list) is normal information or processed information.

[0155] In one embodiment, the content analysis module (211) may be an artificial intelligence (AI) model that processes images (or vision), an AI model that processes language, or a combination thereof. For example, the content analysis module (211) may be an AI model such as a vision transformer or a ResNet model, but is not limited thereto. The content analysis module (211) may be a character recognizer (e.g., optical character recognition (OCR)) capable of extracting text from content (e.g., images, videos, and / or text).

[0156] For example, the electronic device (101) may extract meaning from content (e.g., images, videos, and / or text) through the content analysis module (211) and output the extracted meaning as text. In one embodiment, the electronic device (101) may perform image processing on the content through the content analysis module (211) to improve the quality of the content (e.g., up-scale) when the quality of the content (e.g., the resolution of the video) is low. In one embodiment, the electronic device (101) may perform analysis on content with improved quality through the content analysis module (211).

[0157] In operation 710, the electronic device (101) may display a UI for additional content. In one embodiment, the electronic device (101) may display a screen (e.g., 370 of FIG. 3d) requesting the user to select additional content based on receiving a user input (e.g., 353 or 355 of FIG. 3c) for selecting an application with which data based on the content (311) will be shared. In one embodiment, the electronic device (101) may identify additional content (371, 373) among contents on the screen (370) (e.g., 311, 371, 373, 375, 377, 379, 381 of FIG. 3d) based on the user input. However, the present invention is not limited thereto. For example, the electronic device (101) can identify additional content corresponding to the content (311) without user intervention (or user input). For example, the electronic device (101) can identify additional content as corresponding to the content (311) based on whether the acquisition time and / or acquisition location of the additional content corresponds to the acquisition time and / or acquisition location of the content (311). For example, the electronic device (101) can identify additional content (371, 373) taken at the same location as the content (311) as additional content corresponding to the content (311). For example, the electronic device (101) can identify additional content (379) of the same type (e.g., a receipt) taken on the same date as the content (311) as additional content corresponding to the content (311).

[0158] In operation 720, the electronic device (101) may analyze additional content. For example, the electronic device (101) may analyze additional content through a content analysis module (e.g., 211 of FIG. 2).

[0159] In one embodiment, the electronic device (101) may identify the context of the additional content based on analyzing the additional content through the content analysis module (211). For example, the context of the additional content may include the time (or season, year), person, place, and / or situation (or mood) described by the additional content.

[0160] In one embodiment, the electronic device (101) may extract (or identify) at least one object from the additional content based on analyzing the additional content through the content analysis module (211). For example, the electronic device (101) may identify the context of each object of the additional content based on analyzing the additional content through the content analysis module (211). In one embodiment, the context of the object may include the type, size, location, and / or relationship with other objects of each object of the content. In one embodiment, the context of the object may include the type of the object (e.g., person, thing, animal, plant, building, symbol, number, word, and / or sentence).

[0161] In operation 730, the electronic device (101) may generate a prompt based on information about content, additional content, and / or application through a prompt generation module (e.g., 213 of FIG. 2). In one embodiment, the information about the content may indicate the context of the content (311) and / or each object within the content (311). In one embodiment, the information about the associated content may indicate a location stored within a database (e.g., 219 of FIG. 2). In one embodiment, the information about the associated content may indicate the context of the associated content and / or each object within the associated content.

[0162] For example, information about an application may include characteristics of the application (e.g., layout, number of input fields, types of input fields (e.g., image input fields, and / or text input fields), and / or types (e.g., household account book, social media, and / or notes).

[0163] In operation 550, the electronic device (101) may generate data to be shared with the application (hereinafter, shared data) based on the prompt. For example, the electronic device (101) may generate shared data based on inputting the prompt to the GEN AI model (e.g., 215 of FIG. 2).

[0164] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0165] FIG. 8 may be described with reference to FIGS. 2 to 4d. In one embodiment, operation 550 of FIG. 8 may correspond to operation 550 of FIG. 5. In one embodiment, operation 610 of FIG. 8 may correspond to operation 610 of FIG. 6.

[0166] Referring to FIG. 8, in operation 610, the electronic device (101) can analyze content (e.g., 311 of FIG. 3A). For example, the electronic device (101) can analyze content (311) through a content analysis module (e.g., 211 of FIG. 2).

[0167] In operation 810, the electronic device (101) can identify personal information within content (311). The electronic device (101) can identify personal information based on analyzing the content (311) via the content analysis module (211). In one embodiment, the personal information may include personal information and / or body-related information (e.g., a facial image), but is not limited thereto. For example, the personal information may include social security information and / or financial information.

[0168] In operation 820, the electronic device (101) may determine, through the content analysis module (211), whether personal information needs to be removed. In one embodiment, the electronic device (101) may determine whether personal information needs to be removed based on a policy regarding personal information. In one embodiment, the electronic device (101) may determine whether personal information needs to be removed based on a response to a UI that inquires whether personal information needs to be removed.

[0169] In operation 820, based on the determination that removal of personal information is necessary, the electronic device (101) may perform operation 830. In operation 820, based on the determination that removal of personal information is not necessary, the electronic device (101) may perform operation 840.

[0170] In operation 830, the electronic device (101) may generate a prompt based on information from content and / or applications from which personal information has been removed, via a prompt generation module (e.g., 213 of FIG. 2 ). In one embodiment, removing personal information may include converting content from which personal information has been redacted, but is not limited thereto. The electronic device (101) may generate a prompt to request generation of shared data based on information from content and / or applications after removing personal information.

[0171] In operation 840, the electronic device (101) may generate a prompt based on information about content and / or applications containing personal information via the prompt generation module (213). However, this is not limited thereto. The electronic device (101) may generate a prompt to request generation of shared data based on information about content and / or applications without mentioning personal information (or without guidance on processing personal information).

[0172] In operation 550, the electronic device (101) may generate data to be shared with the application (hereinafter, shared data) based on the prompt. For example, the electronic device (101) may generate shared data based on inputting the prompt to the GEN AI model (215).

[0173] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.

[0174] As described above, the electronic device (101) may include a display (260), at least one electronic device (101) including a processing circuit; and a memory (130) storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a user input (335) for sharing information included in content (311). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display a visual object (351) representing a plurality of applications through the display (260) based on receiving the user input (335). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive another user input (353, 355) to select an application among the plurality of applications with which to share the information after displaying the visual object (351). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate data to be displayed on the display (260) through the application based on information about the application and the information included in the content (311) based on receiving the another user input (353, 355).

[0175] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain, as information about the application, a layout (410, 430) in which the data is input from the application based on receiving the other user input (353, 355). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate the data based on the layout (410, 430). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display, through the display (260), a screen (420, 440) in which the data is input into the layout (410, 430) through the application.

[0176] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify an image related to the content (311) among the images stored in the memory (130) based on the inclusion of an area for an image in the layout (410, 430). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate the data including the identified image.

[0177] The above layout (410, 430) may include a first area for an image and a second area for text. The content (311) may be an image acquired through the camera (280). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate at least one sentence describing the image acquired through the camera (280). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to transmit the data including the image and the at least one sentence to the application such that the image acquired through the camera (280) is input into the first area and the at least one sentence is input into the second area.

[0178] The above instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to execute a command that causes the application to input portions of the generated data into areas included in the layout (410, 430).

[0179] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate the data including information related to prices and products identified in the content (311), based on the information of the application indicating a function of recording expenditure details. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate the data including information related to the product identified in the content (311) and an image related to the product, based on the information of the application indicating a function of recording reviews. The image related to the product may be an image including an object related to the product among the images in the memory (130).

[0180] The above instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate data based on inputting the information about the application and the information contained in the content (311) into a generative artificial intelligence (GEN AI) model (215).

[0181] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify an input for modifying the data on a screen (420, 440) of the application into which the data has been input. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to tune the GEN AI model (215) based on the identification of the input for modifying the data, such that the GEN AI model (215) generates the modified data according to the input.

[0182] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display a user interface (UI) (370) that induces selection of other content to be used in generating the data, based on receiving the other user input (353, 355). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to, after displaying the UI (370), generate data to be displayed on the display (260) through the application, based on information of the selected at least one other content, based on receiving an input for selecting at least one other content among a plurality of contents (371, 373, 375, 377, 379, 381) within the UI (370).

[0183] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify the plurality of contents (371, 373, 375, 377, 379, 381) associated with the content (311) based on analyzing the content (311). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display the identified plurality of contents (371, 373, 375, 377, 379, 381) within the UI (370).

[0184] As described above, the method may be performed by an electronic device (101) including a display (260). The method may include an operation of receiving a user input (335) for sharing information included in content (311). The method may include an operation of displaying a visual object (351) representing a plurality of applications through the display (260) based on receiving the user input (335). The method may include an operation of receiving another user input (353, 355) for selecting an application among the plurality of applications with which to share the information, after displaying the visual object (351). The method may include an operation of generating data to be displayed on the display (260) through the application based on information about the application and the information included in the content (311) based on receiving the another user input (353, 355).

[0185] The method may include an operation of acquiring a layout (410, 430) in which the data is input from the application as information about the application, based on receiving the other user input (353, 355). The method may include an operation of generating the data based on the layout (410, 430). The method may include an operation of displaying a screen (420, 440) in which the data is input into the layout (410, 430) through the application, through the display (260).

[0186] The method may include an operation of identifying an image related to the content (311) among the images stored in the memory (130) based on the inclusion of an area for an image in the layout (410, 430). The method may include an operation of generating the data including the identified image.

[0187] The above layout (410, 430) may include a first area for an image and a second area for text. The content (311) may be an image acquired through a camera (280) of the electronic device (101). The method may include an operation of generating at least one sentence describing the image acquired through the camera (280). The method may include an operation of transmitting the data including the image and the at least one sentence to the application so that the image acquired through the camera (280) is input into the first area and the at least one sentence is input into the second area.

[0188] The method may include an action of executing a command that causes the application to input portions of the generated data into areas included in the layout (410, 430).

[0189] The method may include an operation of generating data including information related to prices and products identified in the content (311), based on the information of the application indicating a function of recording expenditure details. The method may include an operation of generating data including information related to the product identified in the content (311) and an image related to the product, based on the information of the application indicating a function of recording reviews. The image related to the product may be an image including an object related to the product among the images in the memory (130).

[0190] The above method may include an operation of generating data based on inputting the information about the application and the information included in the content (311) into a generative artificial intelligence (GEN AI) model (215).

[0191] The method may include an operation of identifying an input for modifying the data on a screen (420, 440) of the application into which the data has been input. The method may include an operation of tuning the GEN AI model (215) so that the GEN AI model (215) generates the modified data according to the input, based on the input for modifying the data being identified.

[0192] The method may include an operation of displaying a user interface (UI) (370) that induces selection of other content to be used for generating the data based on receiving the other user input (353, 355). The method may include an operation of, after displaying the UI (370), generating data to be displayed on the display (260) through the application based on information of the at least one selected content based on receiving an input for selecting at least one other content among a plurality of contents (371, 373, 375, 377, 379, 381) within the UI (370).

[0193] The method may include an operation of identifying a plurality of contents (371, 373, 375, 377, 379, 381) associated with the content (311) based on analyzing the content (311). The method may include an operation of displaying the identified plurality of contents (371, 373, 375, 377, 379, 381) within the UI (370).

[0194] As described above, a non-transitory computer readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by at least one processor (120) of an electronic device (101) including a display (260), can cause the electronic device (101) to receive a user input (335) for sharing information included in content (311). The instructions, when individually or collectively executed by the at least one processor (120), can cause the electronic device (101) to display a visual object (351) representing a plurality of applications through the display (260) based on receiving the user input (335). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive another user input (353, 355) to select an application among the plurality of applications with which to share the information after displaying the visual object (351). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to generate data to be displayed on the display (260) through the application based on information about the application and the information included in the content (311) based on receiving the another user input (353, 355).

[0195] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.

[0196] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0197] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0198] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0199] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0200] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0201] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), Display (260), At least one processor (120) comprising a processing circuit; and A memory (130) storing instructions and including one or more storage media, wherein the instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Receiving user input (335) to share information contained in content (311), Based on receiving the above user input (335), a visual object (351) representing multiple applications is displayed through the display (260), After displaying the above visual object (351), another user input (353, 355) is received to select an application among the plurality of applications with which to share the information, Based on receiving the other user input (353, 355), causing the application to generate data to be displayed on the display (260) based on the information about the application and the information contained in the content (311). Electronic devices.

2. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on receiving the above other user input (353, 355), the layout (410, 430) in which the data is input in the application is obtained as information about the application, Based on the above layout (410, 430), the above data is generated, Causing the screen (420, 440) in which the data is input to the layout (410, 430) through the application to be displayed through the display (260). Electronic devices.

3. In claim 2, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on the fact that the above layout (410, 430) includes an area for an image, an image related to the content (311) is identified among the images stored in the memory (130), causing said data to be generated including said identified image, Electronic devices.

4. In claim 2, including a camera (280), The above layout (410, 430) includes a first area for an image and a second area for text, The above content (311) is an image acquired through the camera (280), The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Generate at least one sentence describing the image acquired through the camera (280), Causing the application to transmit the data including the image and the at least one sentence, such that the image acquired through the camera (280) is input into the first area and the at least one sentence is input into the second area. Electronic devices.

5. In claim 2, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Causing the application to execute a command so that parts of the generated data are input into areas included in the above layout (410, 430). Electronic devices.

6. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on the above information of the above application indicating the function of recording expenditure details, the above data including information related to the price and product identified in the above content (311) is generated, Based on the above information of the above application indicating the function of recording a review, the data including the information related to the product identified in the content (311) and the image related to the product is generated, and the image related to the product is an image including an object related to the product among the images in the memory (130). Electronic devices.

7. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Causing data to be generated based on inputting the information about the application and the information contained in the content (311) into the generative artificial intelligence (GEN AI) model (215). Electronic devices.

8. In claim 7, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: In the screen (420, 440) of the application where the above data is entered, identify the input for modifying the above data, Based on the input for modifying the data being identified, the GEN AI model (215) causes the GEN AI model (215) to tune the GEN AI model (215) to generate the modified data according to the input. Electronic devices.

9. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on receiving the other user input (353, 355) above, display a UI (user interface) (370) that guides selection of other content to be used for generating the data, After displaying the UI (370), based on receiving an input for selecting at least one other content among a plurality of contents (371, 373, 375, 377, 379, 381) within the UI (370), causing the application to generate data to be displayed on the display (260) based further on information of the selected at least one other content. Electronic devices.

10. In claim 9, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on analyzing the above content (311), the plurality of contents (371, 373, 375, 377, 379, 381) associated with the above content (311) are identified, Causing the above identified plurality of contents (371, 373, 375, 377, 379, 381) to be displayed within the UI (370), Electronic devices.

11. In a method of an electronic device (101) including a display (260), An action to receive user input (335) to share information contained in content (311), An operation of displaying a visual object (351) representing multiple applications through the display (260) based on receiving the user input (335). After displaying the above visual object (351), an operation of receiving another user input (353, 355) for selecting an application among the plurality of applications with which to share the information, and Based on receiving the other user input (353, 355), an operation of generating data to be displayed on the display (260) through the application based on the information about the application and the information included in the content (311) method.

12. In claim 11, An operation of obtaining a layout (410, 430) in which the data is input into the application as information about the application based on receiving the other user input (353, 355). An operation of generating the data based on the above layout (410, 430), and An operation of displaying a screen (420, 440) in which the data is input to the layout (410, 430) through the application through the display (260) method.

13. In claim 12, An operation of identifying an image related to the content (311) among the images stored in the memory (130) based on the inclusion of an area for an image in the above layout (410, 430), and An operation comprising generating said data including said identified image. method.

14. In claim 12, The above layout (410, 430) includes a first area for an image and a second area for text, The above content (311) is an image acquired through the camera (280) of the electronic device (101), The above method, An operation of generating at least one sentence describing the image acquired through the camera (280), and An operation of transmitting the data including the image and the at least one sentence to the application so that the image acquired through the camera (280) is input into the first area and the at least one sentence is input into the second area. method.

15. In claim 12, An operation that includes executing a command that causes the application to input portions of the generated data into areas included in the above layout (410, 430). method.

Images