Electronic device using artificial intelligence model and operating method of electronic device

Abstract

The present disclosure provides an electronic device using an AI model. The electronic device may: generate at least one prompt on the basis of a first user input, first personalized information associated with use of the electronic device, and second personalized information associated with use of an external electronic device; acquire, by using a generative AI model, first content associated with the first personalized information and second content associated with the second personalized information on the basis of the at least one prompt; and display the first content and the second content via the display.

Description

Electronic devices and methods of operating electronic devices using artificial intelligence models

[0001] The present disclosure relates to an electronic device using an artificial intelligence model and a method of operating the electronic device.

[0002] For user history-based services, the goal is to identify the user's areas of interest and provide customized content tailored to those areas. For example, various recommendation services based on a user's usage experience on an electronic device can be provided as a user history-based service.

[0003] However, user history-based services may provide users with recommendations for content they don't want. For example, if a user uses both a personal electronic device and another electronic device shared with the family, children's content, which is often viewed on the other device, may be recommended on the electronic device. Alternatively, if an individual uses multiple electronic devices for both work and personal purposes, personal leisure content may be recommended on the work device. Therefore, when providing user history-based services, it is necessary to consider ways to provide users with content they desire.

[0004] The above information may be provided as background information to aid in understanding this document. None of the above is claimed to be prior art related to this document or can be used to determine prior art.

[0005] According to one embodiment, an electronic device may be provided. The electronic device may include a display; communication circuitry; at least one processor including a processing circuit; and a memory including at least one storage medium storing instructions, wherein the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to perform at least one operation. The at least one operation may include generating at least one prompt based on a first user input, first personalized information associated with use of the electronic device, and second personalized information associated with use of an external electronic device. The at least one operation may include obtaining first content associated with the first personalized information and second content associated with the second personalized information based on the at least one prompt using a generative AI model. The at least one operation may include displaying the first content and the second content through the display.

[0006] According to one embodiment, a method of operating an electronic device may be provided. The method of operating an electronic device may include at least one operation. The at least one operation may include generating at least one prompt based on a first user input, first personalized information associated with use of the electronic device, and second personalized information associated with use of an external electronic device. The at least one operation may include obtaining first content associated with the first personalized information and second content associated with the second personalized information based on the at least one prompt using a generative AI model. The at least one operation may include displaying the first content and the second content through the display.

[0007] According to one embodiment, a storage medium storing at least one computer-readable instruction may be provided. The at least one instruction, when executed by at least a portion of at least one processor of an electronic device, may cause the electronic device to perform at least one operation. The at least one operation may include generating at least one prompt based on a first user input, first personalized information associated with use of the electronic device, and second personalized information associated with use of an external electronic device. The at least one operation may include obtaining first content associated with the first personalized information and second content associated with the second personalized information based on the at least one prompt using a generative AI model. The at least one operation may include displaying the first content and the second content through the display.

[0008] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.

[0010] FIG. 2 is a diagram illustrating a generative artificial intelligence system according to one embodiment of the present disclosure.

[0011] FIG. 3 illustrates an exemplary configuration of an electronic device for personalized information management according to one embodiment of the present disclosure.

[0012] FIGS. 4A and 4B are diagrams illustrating personalized information stored in an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0013] FIG. 5 is a diagram for explaining an operation of an electronic device receiving personalized information of an external electronic device from an external electronic device according to one embodiment of the present disclosure.

[0014] FIG. 6 is a diagram for explaining an operation of an electronic device controlling personalized information according to one embodiment of the present disclosure.

[0015] FIG. 7 is a flowchart illustrating an operation of an electronic device providing first content and second content using first personalized information and second personalized information according to one embodiment of the present disclosure.

[0016] FIGS. 8A, 8B, and 8C illustrate examples of first content and second content generated based on first personalized information and second personalized information, according to one embodiment of the present disclosure.

[0017] FIGS. 9A and 9B illustrate examples of first content and second content generated based on first personalized information and second personalized information, according to one embodiment of the present disclosure.

[0018] FIG. 10 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.

[0019] FIG. 11 illustrates examples of first personalized information, second personalized information, and third personalized information according to one embodiment of the present disclosure.

[0020] FIG. 12 illustrates an example of third content generated by third personalized information according to one embodiment of the present disclosure.

[0021] FIG. 13 is a flowchart illustrating an operation of an electronic device identifying similarity between first personalized information and second personalized information according to one embodiment of the present disclosure.

[0022] FIG. 14 is a signal flow diagram illustrating a procedure for an electronic device to manage personalized information according to one embodiment of the present disclosure.

[0023] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0024] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.

[0025] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0026] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0027] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0028] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0029] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0030] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0031] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0032] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0033] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0034] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0035] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0036] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0037] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0038] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0039] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0040] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0041] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a communication module (192) (e.g., a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0042] The communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The communication module (192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The communication module (192) may support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0043] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0044] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0045] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface).

[0046] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0047] FIG. 2 is a diagram illustrating a generative artificial intelligence system according to one embodiment of the present disclosure.

[0048] According to one embodiment, a user query / response interface (110b) may receive input (e.g., user input or data acquired or generated by an electronic device (e.g., electronic device (101) of FIG. 1). The data acquired or generated by the electronic device may include, for example, image or video data generated using a processor (e.g., processor (120) of FIG. 1), values ​​transmitted via a sensor (e.g., sensor module (176) of FIG. 1) or sensor hub (e.g., external illuminance, angle of the electronic device, temperature of the display (e.g., display module (160) of FIG. 1) or electronic device, display size or expansion / reduction information, captured images of an image sensor). The user input may be in the form of natural language, touch coordinates or stylus coordinates acquired through a touch panel or digitizer included in the display, images, and / or videos, but is not limited thereto. In addition, context information may also be transmitted when transmitting the user input. The context information may include various additional information at the time of user input. It can include information. For example, the additional information can include information about the application the user is currently using or the user's location information. In addition, the user input can be in a mixed form of natural language, images, sounds, and context information as described above. In addition, the user input can also be in a non-natural language form, such as selecting a menu. The user query / response interface (110b) can output the results of the generative artificial intelligence system and / or the results of analyzing the input to the user. The output can be in the form of natural language or a specific content, and can also be provided in the form of an action requested by the user. The user query / response interface (110b) can output the results of the generative artificial intelligence system to the user. The output can be in the form of natural language or a specific content, and can also be provided in the form of an action requested by the user.

[0049] The AI ​​framework (140b) can receive user input and coordinate and control each component necessary to perform the user's intention based on the user's query.

[0050] User input received from the user query / response interface (110b) can be transmitted to a prompt design component (141b). The prompt design component (141b) can be used to generate prompts suitable for inputting user input into a large language model (LLM) or a large multimodal model (LMM). The prompt design component (141b) can be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design component (141b) can access a knowledge component including user preference data, a prompt library, and prompt examples based on the user input to generate prompts and transmit the generated prompts to the LLM or LMM.

[0051] The API / Plug-in management component (142b) can communicate with external information when there is a request for additional information when passing user input as input to the generative model. The API / Plug-in management component (142b) can establish a channel for communicating with the outside of the AI ​​Interface through the API, and can enable access to various data sources (e.g., knowledge storage (120b)) through the established channel. In addition, the API / Plug-in management component (142b) can request the application / service component (130b) through the API for an action that ultimately performs the user input, rather than an intermediate result, when the action needs to be performed in the application or service. Information obtained from the outside can be used to generate a prompt in the prompt design component (141b) together with the user input, or can be passed as input to the generative model.

[0052] The output modification component (also called a refiner component) (143b) can fine-tune the output from the generative model. For example, the output modification component (143b) can verify whether the content generated through the LLM and / or LMM is irrelevant, biased, or harmful. In addition, the output modification component (143b) can determine to what extent it matches the result desired by the user and, if necessary, perform additional processing. The output modification component (143b) can additionally configure and provide the user with hints to avoid unwanted output.

[0053] A generative AI model (160b) can generally refer to an artificial intelligence neural network that creates new types of data based on user input information. A generative AI model (160b) can include an image-generating model and / or a language-generating model. Representative models for generating images include a generative adversarial network (GAN) and a variational autoencoder (VAE), and examples include a VAE and a Diffusion-based generative model that uses a Transformer structure. A language-generating model is a model trained to statistically output the most appropriate output based on input values, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. In addition, there are also LMMs (large multimodal models) that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them.

[0054] FIG. 3 illustrates an exemplary configuration of an electronic device for personalized information management according to one embodiment of the present disclosure.

[0055] Referring to FIG. 3, an electronic device (300) (e.g., the electronic device (101) of FIG. 1) may include a user input analysis module (310), a personalized information management module (320), a prompt generation module (330), an artificial intelligence model (340), and / or an information display module (350). Depending on the embodiment, some components may be omitted, and additional components may be further included in the electronic device (300).

[0056] According to one embodiment, the user input analysis module (310) may receive a user input (301) and perform analysis on the user input (301). For example, the user input analysis module (310) may analyze a query, command, or input for utilizing an artificial intelligence (AI) model. For example, the user input analysis module (310) may determine the intent of the user input (301). For example, the user input analysis module (310) may analyze the input command to distinguish the user or the user's purpose.

[0057] According to one embodiment, the user input analysis module (310) may perform analysis on the user input (301) and transmit the obtained analysis data to the personalized information management module (320) and / or the prompt generation module (330).

[0058] According to one embodiment, the user input analysis module (310) may be configured to perform all or part of the functions of, for example, the user query / response interface (110b) of FIG. 2. For example, the user input analysis module (310) may include, be included in, or correspond to the user query / response interface (110b) of FIG. 2.

[0059] According to one embodiment, the personalized information management module (320) can manage personalized information of at least one user.

[0060] According to one embodiment, personalized information may include at least one piece of information (e.g., information related to preferences, behavioral patterns, or interests) associated with an individual that is used to provide personalized services (or customized services). For example, personalized information may include at least one piece of information associated with the use or history of an electronic device (300) and / or at least one piece of information associated with the use or history of an external electronic device (e.g., the electronic device (102, 104) of FIG. 1). For example, personalized information may include, but is not limited to, at least one piece of information related to the user's use or usage history on the electronic device (300) or an external electronic device, such as the user's personally identifiable information (e.g., name), the user's contact information (e.g., phone number, email address, home address), the user's online activity information (e.g., internet history, search history, social media activity history), the user's preference information (e.g., shopping preferences, animal preferences, design preferences, work preferences), the user's interest information (e.g., hobbies, leisure activities, subscribed services, communities participated in), the user's consumer behavior information (e.g., purchase history, product reviews and ratings), the user's occupational information (e.g., occupation, position and title, workplace evaluation and performance record, resume and cover letter information), application information used by the user, and / or the user's education information (e.g., academic background, awards).

[0061] According to one embodiment, the electronic device (300) may collect (or obtain) personalized information about the user based on data related to the user's use or usage history through the electronic device (300). For example, if a user uses an application related to conversation (e.g., a call application or a messenger application) through the electronic device (300), the electronic device (300) may analyze the content of the conversation exchanged through the application to collect (or obtain) personalized information about the user. For example, if the user uses an AI model (340) (e.g., a generative AI model (160b) of FIG. 2) through the electronic device (300), the electronic device (300) may analyze the content of a query (e.g., a query on a topic such as "24-year summer vacation plans" or "preparing a daughter's birthday party") or input (e.g., various types of input for a generation request) provided to the AI ​​model (340), to collect personalized information about the user.

[0062] According to one embodiment, the personalized information management module (320) may classify, analyze, and / or store personalized information based on specified conditions. For example, the personalized information management module (320) may classify and store personalized information based on specified classification criteria (e.g., by specific category, domain, task, device, user, or application). The personalized information management module (320) may classify and store personalized information as, for example, personalized information by category, personalized information by domain, personalized information by task, personalized information by device, and / or personalized information by user, or personalized information by application, but is not limited thereto. Domains may include, but are not limited to, search domains, internet domains, and / or gallery domains, for example.

[0063] In one embodiment, the electronic device (300) can provide personalized services using personalized information. For example, if a user's liking for cats is stored as personalized information, and a request is made to the AI ​​model (340) to "draw a picture of me with an animal," the electronic device (300) can output an image of the user and a cat using the AI ​​model (340).

[0064] According to one embodiment, the personalized information management module (320) may maintain (or store) personalized information data for a specified period of time. The personalized information management module (320) may delete the personalized information data after the specified period of time has elapsed, or modify or delete the personalized information data at the user's request.

[0065] According to one embodiment, the personalized information management module (320) may include a personalized information storage (321) and / or a personalized information control module (322).

[0066] According to one embodiment, the personalized information management module (320) may store at least one piece of personalized information in the personalized information storage (321). For example, the personalized information management module (320) may store first personalized information (361) associated with the use of the electronic device (300), second personalized information (362) associated with the use of an external electronic device, and / or third personalized information (363) generated based on the first personalized information (361) and the second personalized information (362), in the personalized information storage (321). In this way, the personalized information storage (321) may store not only personalized information of the electronic device (300), but also personalized information of other electronic devices.

[0067] According to one embodiment, the first personalized information (361) may include at least one piece of information related to the use or usage history of a user of the electronic device (e.g., the first user (401) of FIGS. 4A and 4B) of the electronic device. For example, the first personalized information (361) may include personalized information by category, personalized information by domain, personalized information by task, and / or personalized information by application for the user of the electronic device.

[0068] According to one embodiment, the second personalized information (362) may include at least one piece of information associated with the use or usage history of a first user (e.g., the first user (401) of FIGS. 4A and 4B) or a second user (e.g., the second user (402) of FIG. 4B) on an external electronic device. For example, the second personalized information (362) may include category-specific personalized information, domain-specific personalized information, task-specific personalized information, and / or application-specific personalized information for the first user or the second user.

[0069] According to one embodiment, the user associated with the first personalized information (361) and the user associated with the second personalized information (362) may be the same user or different users.

[0070] According to one embodiment, the personalized information management module (320) may directly or indirectly receive personalized information (e.g., second personalized information (362)) associated with the use of the external electronic device from at least one external electronic device. For example, the personalized information management module (320) may directly receive the second personalized information (362) from the external electronic device via a direct communication connection. For example, the personalized information management module (320) may indirectly receive the second personalized information (362) from the external electronic device via a server. For example, the personalized information management module (320) may indirectly receive the second personalized information (362) about the user of the corresponding account from the external electronic device via a server based on account information.

[0071] According to one embodiment, the personalized information control module (322) can create or delete personalized information. For example, the personalized information control module (322) can create third personalized information (363) based on the first personalized information (361) and the second personalized information (362) based on the satisfaction of a specified condition (e.g., a condition for integrated management of personalized information). For example, the personalized information control module (322) can manage the first personalized information (361) and the second personalized information (362) separately, or delete the second personalized information (362), which is personalized information of another electronic device, based on the satisfaction of a specified condition (e.g., a condition for separate management of personalized information). After the second personalized information (362) is deleted, the electronic device (300) may not use the second personalized information (362) and / or other personalized information of an external electronic device corresponding to the second personalized information (362).

[0072] According to one embodiment, the prompt generation module (330) may generate at least one prompt based on input data and transmit the generated prompt to the AI ​​model (340). The input data of the prompt generation module (330) may include user input (301), at least one piece of personalized information obtained from the personalized information management module (320), and / or other related information.

[0073] In one embodiment, the prompt generation module (330) may supplement or complement the user input (301) using at least one piece of personalized information. For example, the prompt generation module (330) may use the personalized information to add content not included in the user input (301).

[0074] According to one embodiment, the prompt generation module (330) may perform all or part of the functions of the prompt design component (144b) of FIG. 2. For example, the prompt generation module (330) may be included in the prompt design component (144b) of FIG. 2, may include the prompt design component (144b), or may correspond to the prompt design component (144b).

[0075] In one embodiment, the AI ​​model (340) can obtain an output (or a product, or a result) for a prompt received (or input) through the prompt generation module (330). For example, the AI ​​model (340) can generate an output based on the input prompt one or more times. For example, the AI ​​model (340) can generate additional output based on user feedback on the generated output. In one example, the electronic device (300) can generate a first output based on a first prompt using the AI ​​model (340) and provide the generated first output and / or first information asking the user whether he / she wants the additional output. When a user input requesting the additional output is received, the electronic device (300) can generate a second output based on a second prompt using the AI ​​model (340) and provide the generated second output and / or second information asking the user whether he / she wants to integrate the first output and the second output. When a user input requesting integration of the first output and the second output is received, the electronic device (300) may provide a third output that integrates the first output and the second output. The first output, the first information, the second output, the second information, and / or the third output may be displayed, for example, through the information display module (350).

[0076] According to one embodiment, the AI ​​model (340) can transmit the generated output (or additional output) to the information display module (350).

[0077] In one embodiment, the AI ​​model (340) may perform all or part of the functions of the generative AI model (160b) of FIG. 2. For example, the AI ​​model (340) may be included in the generative AI model (160b) of FIG. 2, may include the generative AI model (160b), or may correspond to the generative AI model (160b).

[0078] According to one embodiment, the information display module (350) may display the output (or additional output) transmitted from the AI ​​model (340) through a display (e.g., the display module (160) of FIG. 1). According to one embodiment, the electronic device (300) may provide the output (or additional output) generated by the AI ​​model (340) to the user in another manner (e.g., auditorily and / or tactilely) through at least one other information providing module (e.g., a speaker, a sensor), together with or separately from visually providing the output (or additional output) generated by the AI ​​model (340) through the information display module (350).

[0079] In the following embodiment, the first personalized information (361) is personalized information of the electronic device, the second personalized information (362) is personalized information of an external electronic device of the electronic device, and the third personalized information (363) is personalized information generated based on the first personalized information (361) and the second personalized information (362).

[0080] FIGS. 4A and 4B are diagrams illustrating personalized information stored in an electronic device and an external electronic device according to one embodiment of the present disclosure.

[0081] In the embodiments of FIGS. 4A and 4B, for convenience of explanation, the external electronic device (300b) is described as a single electronic device, but this is not limiting. For example, there may be multiple external electronic devices (300b) capable of communicating with the electronic device (300a).

[0082] According to one embodiment, personalized information may be generated or managed differently according to various conditions, for example, by category, by domain, by task, by device, by user, by application, or by situation.

[0083] Referring to FIGS. 4a and 4b, an electronic device (300a) (e.g., the electronic device (101) of FIG. 1 or the electronic device (300) of FIG. 3) may include a personalized information storage (321a), a personalized information control module (322a), and / or an AI model (340a). An external electronic device (300b) (e.g., the electronic devices (102, 104) of FIG. 1 or the electronic device (300) of FIG. 3) may include a personalized information storage (321b), a personalized information control module (322b), and / or an AI model (340b). Descriptions of the personalized information storages (321a, 321b), the personalized information control modules (322a, 322b), and the AI ​​model (340b) may refer to the descriptions of the personalized information storage (321), the personalized information control module (322), and the AI ​​model (340) of FIG. 3. Therefore, any duplicate explanations are omitted.

[0084] In the embodiment of FIG. 4a, it is illustrated that multiple electronic devices manage personalized information of the same user (401).

[0085] As illustrated in FIG. 4a, the electronic device (300a) may store first personalized information (361) associated with the use of the electronic device (300a) in the personalized information storage (321a). The first personalized information (361) associated with the use of the electronic device (300a) may include, for example, at least one piece of information associated with the use or usage history of the first user (401) on the electronic device (300a).

[0086] According to one embodiment, the external electronic device (300b) may store second personalized information (362) associated with the use of the external electronic device (300b) in the personalized information storage (321b). The second personalized information (362) associated with the use of the external electronic device (300b) may include, for example, at least one piece of information associated with the use or usage history of the first user (401) on the external electronic device (300b).

[0087] According to one embodiment, the first personalized information (361) may include at least one second piece of information that is different from at least one piece of first information included in the second personalized information (362). This is because, even if each piece of personalized information is personalized information for the same user, the purposes of use of each electronic device used by the user may be different. For example, the electronic device (300a) may be used by the first user (401) for a first purpose (e.g., personal use), and the external electronic device (300b) may be used by the first user (401) for a second purpose (e.g., work use) that is different from the first purpose. Therefore, when each electronic device is used, the characteristics of the user, such as interests, preferences, tastes, behavior patterns, and search patterns, that are exposed may be different from each other. As a result, personalized information collected by the same user through the use of each electronic device may be different from each other. Therefore, even if personalized information is for the same user, it is necessary to manage it in an integrated or separate manner as necessary.

[0088] In the embodiment of FIG. 4b, it is illustrated that one electronic device manages personalized information of each of multiple users (401, 402) or multiple personalized information of one user.

[0089] As illustrated in FIG. 4b, the electronic device (300a) may store first personalized information (361) associated with the use of the electronic device (300a) in the personalized information storage (321a). The first personalized information (361) associated with the use of the electronic device (300a) may include, for example, at least one piece of information associated with the use or usage history of the first user (401) on the first electronic device (300a).

[0090] According to one embodiment, the external electronic device (300b) may store second personalized information (362) and fourth personalized information (364) associated with the use of the external electronic device (300b) in the personalized information storage (321b). The second personalized information (362) associated with the use of the external electronic device (300b) may include, for example, at least one piece of information associated with the use or usage history of the first user (401) or the second user (402) on the external electronic device (300b). The fourth personalized information (364) associated with the use of the external electronic device (300b) may include, for example, at least one piece of information associated with the use or usage history of the first user (401) or the second user (402) on the external electronic device (300b). According to one embodiment, the user associated with the second personalized information (362) or the fourth personalized information (364) may be the same or a different user than the user associated with the first personalized information (361).

[0091] According to one embodiment, if the second personalized information (362) and the fourth personalized information (364) are personalized information associated with different users, the second personalized information (362) and the fourth personalized information (364) may include personalized information for each user. For example, the second personalized information (362) may include personalized information for the first user (401), and the third personalized information (363) may include personalized information for the second user (402). The number of personalized information pieces stored in the personalized information storage (321b) may correspond to the number of users using the external electronic device (300b), for example. For example, if the third user also uses the external electronic device (300b), the third personalized information may be further stored in the personalized information storage (321b).

[0092] According to one embodiment, if the second personalized information (362) and the fourth personalized information (364) are personalized information associated with the same user (e.g., the first user (401)), the second personalized information (362) and the fourth personalized information (364) may include different personalized information according to classification criteria. For example, the second personalized information (362) may include personalized information associated with the use of the first application by the first user (401) on the external electronic device (300b), and the third personalized information (363) may include personalized information associated with the use of the second application by the first user (401) on the external electronic device (300b) that is different from the first application. In other words, personalized information for each application for the same user may be included in the personalized information storage (321b). For example, the second personalized information (362) may include personalized information associated with a first taste (e.g., public taste) of the first user (401) in the external electronic device (300b), and the third personalized information (363) may include personalized information associated with a second taste (e.g., private taste) that is different from the first taste of the first user (401) in the external electronic device (300b). In other words, personalized information for each taste of the same user may be stored in the personalized information storage (321b). The number of personalized information stored in the personalized information storage (321b) may be based on, for example, the number of classification criteria and / or the number of personalized information classified according to each classification criterion. For example, for the same user, if personalized information is classified according to a first classification criterion (e.g., classification by application) in which the number of classified personalized information is 2 and a second classification criterion (e.g., classification by taste) in which the number of classified personalized information is 3, 6 personalized information can be stored in the personalized information storage (321b).

[0093] In one embodiment, the external electronic device (300b) may be an electronic device shared by multiple users. For example, the external electronic device (300b) may be a computer or tablet computer shared by a family.

[0094] According to one embodiment, when an external electronic device (300b) is used by multiple users (401, 402), the external electronic device (300b) may manage personalized information for each user based on account information, but is not limited thereto. For example, when the external electronic device (300b) is used by multiple users (401, 402) without distinction between users (e.g., using the same user ID), the external electronic device (300b) may not manage personalized information for each user, but may manage only one personalized information, or may manage multiple personalized information separately based on specified classification criteria (e.g., by category, by domain, by application).

[0095] FIG. 5 is a diagram for explaining an operation of an electronic device receiving personalized information of an external electronic device from an external electronic device according to one embodiment of the present disclosure.

[0096] In the embodiment of FIG. 5, for convenience of explanation, an example is given in which an external electronic device (e.g., electronic device (102) or electronic device (104) of FIG. 1A) that performs communication with an electronic device (e.g., electronic device (101) of FIG. 1) is one electronic device, but the present invention is not limited thereto. For example, there may be a plurality of external electronic devices that perform communication with the electronic device (101).

[0097] In the embodiment of FIG. 5, for convenience of explanation, the electronic device (101) receives two pieces of personalized information, second personalized information (362) and fourth personalized information (364), from an external electronic device (102, 104), as an example, but is not limited thereto. For example, the electronic device (101) may receive one of the second personalized information (362) and the fourth personalized information (364) from the external electronic device (102, 104) or another external electronic device, or may further receive at least one additional piece of personalized information (e.g., fifth personalized information).

[0098] According to one embodiment, the electronic device (101) can exchange personalized information with an external electronic device (102, 104) using a personalized information management module (e.g., the personalized information management module (320) of FIG. 3).

[0099] Referring to FIG. 5, an external electronic device (102, 104) (e.g., the external electronic device (300b) of FIGS. 4a, 4b) can transmit (501) at least one piece of personalized information associated with the use of the external electronic device (102, 104) to an electronic device (101) (e.g., the electronic device (300a) of FIGS. 4a, 4b), and the electronic device (101) can receive at least one piece of personalized information transmitted (501) from the external electronic device (102, 104). For example, the electronic device (101) can receive second personalized information (362) and / or fourth personalized information (364) from the external electronic device (102, 104).

[0100] According to one embodiment, the electronic device (101) may store at least one piece of personalized information received from an external electronic device (102, 104). For example, the electronic device (101) may store the second personalized information (362) and / or the fourth personalized information (364) received from the external electronic device (102, 104) in a personalized information storage (e.g., the personalized information storage (321) of FIG. 3).

[0101] FIG. 6 is a diagram for explaining an operation of an electronic device controlling personalized information according to one embodiment of the present disclosure.

[0102] Referring to FIG. 6, an electronic device (101) (e.g., electronic device (300a) of FIGS. 4a and 4b) can create or delete personalized information using a personalized information control module (e.g., personalized information control module (322) of FIG. 3).

[0103] According to one embodiment, the electronic device (101) may generate personalized information based on the satisfaction of a specified condition. For example, the electronic device (101) may generate (601) third personalized information (363) based on the first personalized information (361) and the second personalized information (362) based on the identification that integrated management of personalized information is necessary. For example, the electronic device (101) may generate (601) third personalized information (363) based on the first personalized information (361) and the second personalized information (362) based on the identification that similarity exists between the first personalized information (361) and the second personalized information (362). For example, the electronic device (101) may generate (601) third personalized information (363) based on the first personalized information (361) and the second personalized information (362) based on the identification of a user input requesting the generation of third personalized information (363). The electronic device (101) may transmit (602) the generated third personalized information (363) to an external electronic device (102, 104), and the external electronic device (102, 104) may store the received third personalized information (363). An example of the first personalized information (361), the second personalized information (362), and the third personalized information (363) is described below with reference to FIG. 11.

[0104] According to one embodiment, the electronic device (101) may delete personalized information from the electronic device (101) based on a specified condition being satisfied. For example, the electronic device (101) may delete the fourth personalized information (364) based on a determination that integrated management of other personalized information (e.g., the first personalized information (361)) and the fourth personalized information (364) is not necessary. For example, the electronic device (101) may delete the fourth personalized information (364) of an external electronic device (102, 104) (e.g., the external electronic device (300b) of FIGS. 4A and 4B) based on a determination that no similarity exists between the other personalized information (e.g., the first personalized information (361)) and the fourth personalized information (364). This is because, if there is no similarity between other personalized information (e.g., first personalized information (361)) and the corresponding personalized information (e.g., fourth personalized information (364)), or if integrated management is not required, providing content based on the fourth personalized information (364) to the user is not particularly helpful in providing personalized services. For example, the electronic device (101) may delete the fourth personalized information (364) based on the identification of a user input requesting deletion of the fourth personalized information (364).

[0105] According to one embodiment, the electronic device (101) may execute an operation for managing personalized information (e.g., creating, deleting, or transmitting personalized information) and / or an operation for generating content based on personalized information when a specified execution condition is satisfied. The specified execution condition may be satisfied, for example, when the electronic device (101) and an external electronic device (102, 104) are connected to each other through communication, when a characteristic time is satisfied, and / or when a condition set by a user is satisfied.

[0106] Hereinafter, the first content is described as content associated with the first personalized information (361) of the electronic device, and the second content is described as content associated with the second personalized information (362) of an electronic device external to the electronic device.

[0107] FIG. 7 is a flowchart illustrating an operation of an electronic device providing first content and second content using first personalized information and second personalized information according to one embodiment of the present disclosure.

[0108] Referring to FIG. 7, in operation 710, an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (300) of FIG. 3 or the electronic device (300a) of FIGS. 4a, 4b) may generate at least one prompt based on a first user input, first personalized information associated with use of the electronic device (e.g., personalized information (361) of FIGS. 3 to 6) and / or second personalized information associated with use of an external electronic device (e.g., the electronic device (102, 104) of FIG. 1, the electronic device (300) of FIG. 3 or the external electronic device (300b) of FIGS. 4a, 4b)).

[0109] According to one embodiment, the electronic device may obtain a first user input (e.g., user input (301) of FIG. 3). The first user input may be an input used to generate content based on personalized information.

[0110] According to one embodiment, the electronic device can receive a first user input through various input methods. The various input methods may include, but are not limited to, physical input (e.g., touch input, keyboard input) and voice input. For example, the electronic device can obtain a query through voice input with an AI model (e.g., the AI ​​model (340) of FIG. 3) as the first user input. For example, the electronic device can obtain a generation request or command for the AI ​​model through keyboard input as the first user input.

[0111] According to one embodiment, the electronic device may analyze acquired user input using a user input analysis module (e.g., the user input analysis module (310) of FIG. 3). For example, the electronic device may analyze attributes of the user input, such as meaning, intent, and nuance, to identify information such as the user or the user's purpose.

[0112] According to one embodiment, the electronic device can analyze acquired user input using an AI model (e.g., AI model (340) of FIG. 3).

[0113] In one embodiment, even if user input is for the same purpose, the commands included in the user input may vary from user to user. For example, even if the user input is for creating a cafe menu using oranges, the user input may include commands that vary from user to user, such as "Make a menu with oranges in it" or "I'm trying to sell a menu using oranges at a cozy cafe, so please create a cute image." Therefore, it is necessary to appropriately supplement or complement user input using personalized information to suit the user's purpose.

[0114] According to one embodiment, the electronic device may obtain, based on a first user input, first personalized information associated with the use of the electronic device (e.g., first personalized information (361) of FIGS. 3 to 6) and / or second personalized information associated with the use of an external electronic device (e.g., second personalized information (362) of FIGS. 3 to 6) of FIGS. 3 to 6). For example, when the electronic device stores a plurality of personalized information classified in various ways according to classification criteria, the electronic device may select at least one piece of personalized information from among the plurality of pieces of personalized information as personalized information to be used to generate a prompt, based on a query, command, or request corresponding to the first user input.

[0115] According to one embodiment, as illustrated in FIG. 4a, the first personalized information (361) and the second personalized information (362) may be user information of the same user (401), but are not limited thereto.

[0116] According to one embodiment, when an external electronic device is used in common by multiple users (401, 402), as illustrated in FIG. 4b, the user of the first personalized information (361) and the user of the second personalized information (362) may be different users, but are not limited thereto.

[0117] According to one embodiment, the electronic device may receive at least one piece of personalized information, including second personalized information, from an external electronic device. For example, as illustrated in FIG. 5 , the electronic device may receive second personalized information (362) and / or fourth personalized information (e.g., fourth personalized information (364) of FIGS. 3 , 4b , 5 , and 6 ) from the external electronic device.

[0118] According to one embodiment, an electronic device may receive at least one piece of personalized information, including second personalized information, from an external electronic device based on identifying that a first user input has been obtained. For example, when the electronic device identifies that the first user input has been obtained and identifies that a communication connection with the external electronic device has been established, the electronic device may transmit a request to the external electronic device to receive at least one piece of personalized information of the external electronic device, and the external electronic device may transmit at least one piece of personalized information to the electronic device in response to the request. The request may include, for example, data of the first user input, and the at least one piece of personalized information transmitted from the external electronic device in response to the request may be at least one piece of personalized information associated with the first user input.

[0119] According to one embodiment, the electronic device may receive at least one piece of personalized information including second personalized information from an external electronic device periodically or when communicating with the external electronic device.

[0120] According to one embodiment, the electronic device may transmit first personalized information to an external electronic device or receive second personalized information from the external electronic device when an application that copies data is used.

[0121] According to one embodiment, the electronic device may generate at least one prompt based on at least one of a first user input, first personalized information, or second personalized information. For example, the electronic device may generate a first prompt based on the first user input and the first personalized information, and may generate a second prompt based on the first user input and the second personalized information. For example, the electronic device may generate one prompt based on the first user input, the first personalized information, and the second personalized information. According to one embodiment, the electronic device may generate at least one prompt using a user input and at least one piece of personalized information through a prompt generation module (e.g., the prompt generation module (330) of FIG. 3 ). The prompt generation module may generate at least one prompt based on at least one piece of personalized information.

[0122] Table 1 below illustrates prompts generated using user input, first personalized information, and second personalized information.

[0123] User Input Create a cafe menu image using Orange. Reflecting the first personalized information. Prompt 1. Create a simple image that includes a short text and an actual image that can promote drinks and bakery using Orange. Reflecting the second personalized information. Prompt 2. Create an image that includes a fun picture and text that can promote cool drinks using Orange. Reflecting the first and second personalized information. Prompt 2. Create an image that includes a simple image and simple text that can promote a cafe menu using Orange.

[0124] Referring to Table 1, the user input may include a command or request such as "Create an image of a cafe menu using oranges." A first prompt generated based on the user input and first personalized information (e.g., personalized information related to the user's first preference or first taste associated with the use of an electronic device) may include a command such as "Create a simple image that includes short text and an actual image that can promote drinks and bakeries using oranges." A second prompt generated based on the user input and second personalized information (e.g., personalized information related to the user's second preference or second taste associated with the use of an external electronic device) may include a command such as "Create an image that includes a fun picture and text that can promote refreshing drinks using oranges." A third prompt generated based on the user input, the first personalized information, and the second personalized information may include a command such as "Create an image that includes a simple image and simple text that can promote a cafe menu using oranges." In this way, even if the same user input is received, different prompts may be generated depending on the personalized information used. These different prompts can result in different output results from the AI ​​model for the same user input.

[0125] In one embodiment, the electronic device may further utilize user information of the electronic device to generate at least one prompt. For example, the electronic device may further utilize user information of the electronic device, along with a first user input, first personalized information, and / or second personalized information, to generate at least one prompt.

[0126] According to one embodiment, an electronic device may identify whether the electronic device is in communication connection with an external electronic device while receiving a user input. If the electronic device is identified as not being in communication connection with the external electronic device, the electronic device may generate at least one prompt using the user input and / or first personalized information of the electronic device. If the electronic device is identified as being in communication connection with the external electronic device, the electronic device may generate at least one prompt using second personalized information received from the external electronic device while in communication connection with the external electronic device, together with the user input and / or first personalized information.

[0127] In one embodiment, the act of generating a second prompt based on user input and second personalized information may be used to determine whether there is a similarity between the first personalized information and the second personalized information. For example, the second content generated based on the second prompt may include a query (or query information) used to determine whether there is a similarity between the first personalized information and the second personalized information.

[0128] In one embodiment, the electronic device may generate at least one prompt using third personalized information (e.g., third personalized information (363) of FIGS. 3, 5, and 6). For example, the electronic device may generate at least one prompt using the third personalized information, either together with the first user input, the first personalized information, and / or the second personalized information, or separately.

[0129] According to one embodiment, the electronic device may generate at least one prompt using environmental information (e.g., information surrounding or inside the electronic device, application information, sensing information, information obtained from external electronic device(s). For example, the electronic device may generate at least one prompt using environmental information, either together with or separately from the first user input, the first personalized information, the second personalized information, and / or the third personalized information.

[0130] According to one embodiment, personalized information used for generating a prompt may be managed through a personalized information management module (e.g., personalized information management module (320) of FIG. 3).

[0131] In operation 720, the electronic device may obtain first content associated with first personalized information and / or second content associated with second personalized information using a generative AI model based on at least one prompt. For example, the electronic device may obtain first content for the first prompt using the generative AI model, and may obtain second content for the second prompt using the generative AI model. For example, the electronic device may obtain first content and second content for one prompt using the generative AI model.

[0132] In operation 730, the electronic device may display first content and / or second content through the display.

[0133] In one embodiment, the electronic device may display first content first, and then display second content while the first content is being displayed, but vice versa.

[0134] According to one embodiment, the electronic device can display first content and second content simultaneously.

[0135] In the embodiment of FIG. 7 described above, although the input used to generate at least one prompt is described as a first user input input by the user, the present invention is not limited thereto. For example, even without user input, a generation request or command for an AI model that is automatically generated when a specified condition is satisfied may be used as the input used to generate at least one prompt. In one example, when anniversary information is stored in a certain application, the electronic device may obtain a first input including a request or command to generate anniversary-related output corresponding to the anniversary information at a first time (e.g., near the anniversary), and may automatically generate the anniversary-related output through the AI ​​model based on the first input.

[0136] FIGS. 8A, 8B, and 8C illustrate examples of first content and second content generated based on first personalized information and second personalized information, according to one embodiment of the present disclosure.

[0137] Referring to FIG. 8A, the first personalized information (e.g., the first personalized information (361) of FIGS. 3 to 6) may include at least one first information associated with the use or usage history of the electronic device (101). The at least one first information may include, but is not limited to, information about a first work style, which is a work style of a first work (810a) worked on by a first user (e.g., the first user (401) of FIG. 4B) on the electronic device (101) (e.g., simple style document work information, image work information, taste information) and / or information about a first search record searched by the first user on the electronic device (101) (e.g., adult shoe search).

[0138] According to one embodiment, the second personalized information (e.g., the second personalized information (362) of FIGS. 3 to 6) may include at least one second information associated with the use or usage history of the external electronic device (102, 104). The at least one second information may include, but is not limited to, information about a second work style (e.g., information about cute style document work information, image work information, and / or taste information) of a second work (820a) worked on by a first user (e.g., the first user (401) of FIG. 4A or 4B) or a second user different from the first user (e.g., the second user (402) of FIG. 4B)) on the external electronic device (102, 104) and / or information about a second search record searched by the first user or the second user on the external electronic device (102, 104) (e.g., search for children's shoes).

[0139] Referring to FIG. 8b, the first screen (801b) may include a user input (810b) for a creation request (or command) (e.g., "Create a menu using oranges"). The second screen (802b) may include a user input (810b), first content (820b) associated with first personalized information (361), and / or second content (830b) associated with second personalized information (362).

[0140] In one embodiment, the electronic device may generate a first prompt based on user input (810b) and first personalized information (361), and generate first content (820b) for the first prompt using a generative AI model. The first prompt generated based on user input (810b) and first personalized information (361) may be, for example, the first prompt reflecting the first personalized information as exemplified in Table 1.

[0141] In one embodiment, the electronic device may generate a second prompt based on user input (810b) and second personalized information (362), and generate second content (830b) for the second prompt using a generative AI model. The second prompt generated based on user input (810b) and second personalized information (362) may be, for example, the second prompt reflecting the second personalized information as exemplified in Table 1.

[0142] In one embodiment, the first content (820b) may include a first image (821b) and / or a first text (822b). The first image (821b) may include, for example, an image generated in a simple style based on information about the first work style included in the first personalized information (361), and the first text (822b) may include a description of the first image (821b).

[0143] In one embodiment, the second content (830b) may include a second image (831b) and a second text (832b). The second image (831b) may include, for example, an image generated in a cute style based on information about a second work style included in the second personalized information (362), and the second text (832b) may include a description of the second image (831b).

[0144] According to one embodiment, the second screen (802b) may further include a third text (840b) including a first query to determine whether there is a similarity (or, association) between the first personalized information (361) and the second personalized information (362), or a second query (e.g., “Which style of the two images do you prefer?”) to determine whether there is a similarity (or, association) between the first personalized information (361) and the second personalized information (362) and to determine whether there is a preferred or desired content among the first content (820b) associated with the first personalized information (361) or the second content (830b) associated with the second personalized information (362). The second query may be used to determine whether there is a similarity (or, association) between the first personalized information (361) and the second personalized information (362).

[0145] In one embodiment, the third text (840b) may be included in the second content (830b). For example, the electronic device (101) may generate the second content (830b) including the third text (840b) by adding a first command for generating a first query (or query information) to determine whether there is a similarity (or association) between the first personalized information (361) and the second personalized information (362) to a prompt generated based on a user input and the second personalized information, or a second command for generating a second query to select a content desired or preferred by the user among the first content (820c) associated with the first personalized information (361) or the second content (830c) associated with the second personalized information (362).

[0146] Referring to FIG. 8c, the first screen (801c) may include a user input (810c) for a generation request (e.g., "Recommend me a Nike shoe"). The second screen (802c) may include the user input (810c), first content (820c) associated with first personalized information (361), and / or second content (830c) associated with second personalized information (362).

[0147] According to one embodiment, the electronic device may generate a first prompt based on user input (810c) and first personalized information (361), and generate first content (820c) for the first prompt using a generative AI model. The first prompt generated based on the user input (810c) and first personalized information (361) may be, for example, the first prompt reflecting the first personalized information as exemplified in Table 2 below.

[0148] In one embodiment, the electronic device may generate a second prompt based on user input (810c) and second personalized information (362), and generate second content (830c) for the second prompt using a generative AI model. The second prompt generated based on user input (810c) and second personalized information (362) may be, for example, the second prompt reflecting second personalized information as exemplified in Table 2 below.

[0149] User input: Recommend Nike shoes. Reflection of first personalized information. Prompt 1. Generate text recommending adult shoes among Nike shoes. Reflection of second personalized information. Prompt 2. Generate text recommending children's shoes among Nike shoes.

[0150] In one embodiment, the first content (820c) may include a first text (821c). The first text (821c) may include, for example, a search result for adult shoes based on the first personalized information (361) including a search history for adult shoes.

[0151] In one embodiment, the second content (830c) may include a second text (821c). The second text (831b) may include, for example, a search result for children's shoes based on second personalized information (362) including a search history for children's shoes.

[0152] According to one embodiment, the second screen (802c) may further include a third text (840c) including a first query (e.g., “Do you like the recommended shoes?”) to determine whether there is a similarity (or, association) between the first personalized information (361) and the second personalized information (362) or a second query to select a content desired or preferred by the user among the first content (820c) associated with the first personalized information (361) or the second content (830c) associated with the second personalized information (362). The second query may be used to determine whether there is a similarity (or, association) between the first personalized information (361) and the second personalized information (362).

[0153] In one embodiment, the third text (840c) may be included in the second content (830c). For example, the electronic device may generate the second content (830c) including the third text (840c) by adding a first command to generate a first query (or query information) to determine whether there is a similarity (or association) between the first personalized information (361) and the second personalized information (362) based on a prompt generated based on a user input and the second personalized information, or a second command to generate a second query to select a content desired or preferred by the user among the first content (820c) associated with the first personalized information (361) or the second content (830c) associated with the second personalized information (362).

[0154] FIGS. 9A and 9B illustrate examples of first content and second content generated based on first personalized information and second personalized information, according to one embodiment of the present disclosure.

[0155] Referring to FIG. 9a, the first personalized information (e.g., the first personalized information (361) of FIGS. 3 to 6) may include at least one first piece of information related to the use or usage history of the electronic device (101). The at least one first piece of information may include, for example, information on a first search record (e.g., a cafe-related search (901a)) searched by a first user (e.g., the first user (401) of FIG. 4b) on the electronic device (101), but is not limited thereto.

[0156] According to one embodiment, the second personalized information (e.g., the second personalized information (362) of FIGS. 3 to 6) may include at least one second information associated with a usage history associated with a first domain (e.g., a search domain) of the external electronic device (102, 104). The at least one second information may include, but is not limited to, information about a second search history (e.g., a cafe-related search (902a)) searched by the first user or a second user different from the first user (e.g., the second user (402) of FIG. 4b) on the external electronic device (102, 104).

[0157] According to one embodiment, the fourth personalized information (e.g., the fourth personalized information (362) of FIGS. 3, 4b, and 5) may include at least one fourth information associated with a usage history associated with a second domain (e.g., a food order domain) of the external electronic device (102, 104). The at least one fourth information may include, but is not limited to, information about an order record (e.g., a tteokbokki order (903a)) placed by the first user or the second user on the external electronic device (102, 104).

[0158] Referring to FIG. 9b, the first screen (901b) includes a user input (910b) for a creation request (e.g., a request for creating an itinerary (e.g., “Create a 2-day, 1-night trip to Gunsan”). The second screen (902b) includes the user input (910b), first content (920b) associated with first personalized information (361), and / or second content (930b) associated with second personalized information (362).

[0159] According to one embodiment, the electronic device may generate a first prompt based on user input (910b) and first personalized information (361) (e.g., search history information), and generate first content (920b) for the first prompt using a generative AI model. The first prompt generated based on the user input (910b) and first personalized information (361) may be, for example, the first prompt reflecting the first personalized information as exemplified in Table 3 below.

[0160] In one embodiment, the electronic device may generate a second prompt based on user input (910b) and second personalized information (362) (e.g., purchase history information), and generate second content (930b) for the second prompt using a generative AI model. The second prompt generated based on user input (910b) and second personalized information (362) may be, for example, the second prompt reflecting the second personalized information as exemplified in Table 3 below.

[0161] User input: Create a 2-day, 1-night Gunsan itinerary. 1st personalized information reflection. 1st prompt. Create text for a 2-day, 1-night Gunsan itinerary that includes a visit to a famous Gunsan cafe. 2nd personalized information reflection. 2nd prompt. Create text and images for a 2-day, 1-night Gunsan itinerary that includes information about a famous tteokbokki restaurant in Gunsan.

[0162] According to one embodiment, the first content (920b) may include text about a travel itinerary generated based on first personalized information (361) including search history information and / or preference information (e.g., cafe search and / or preference information). The search history information and / or preference information may be generated based on, for example, a search history and / or search count of a user of the electronic device. For example, if a user searches for a cafe through a web application of the electronic device or searches for a cafe a specified number of times or more through a specific application such as a social network service (SNS) application, the electronic device may obtain first personalized information (361) including the cafe search history and / or cafe preference information.

[0163] According to one embodiment, the second content (930b) may include text and images for recommendations for restaurants in a travel destination, generated based on second personalized information (362) including purchase history information and / or preference information (e.g., tteokbokki purchase and / or preference information). The purchase history information and / or preference information may be generated, for example, based on a purchase record and / or number of purchases made by a user of an electronic device through a web page. For example, if a user purchases tteokbokki through a web application of the electronic device or purchases tteokbokki a specified number of times or more through a specific application, such as an e-commerce application, the electronic device may obtain second personalized information (362) including the tteokbokki purchase history and / or tteokbokki preference information.

[0164] FIG. 10 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.

[0165] Referring to FIG. 10, in operation 1010, an electronic device (e.g., an electronic device (101) of FIG. 1 or an electronic device (300) of FIG. 3 or an electronic device (300a) of FIGS. 4a, 4b) may generate at least one prompt based on a first user input, first personalized information associated with use of the electronic device (e.g., first personalized information (361) of FIGS. 3 to 6) and / or second personalized information associated with use of an external electronic device (e.g., second personalized information (362) of FIGS. 3 to 6)). A description of operation 1010 may refer to the description of operation 710. Therefore, any duplicate description will be omitted.

[0166] In operation 1020, the electronic device may obtain first content associated with first personalized information and / or second content associated with second personalized information using a generative AI model based on at least one prompt. A description of operation 1020 may refer to the description of operation 720. Therefore, any duplicate description will be omitted.

[0167] In operation 1030, the electronic device may display first content and / or second content via a display. The description of operation 1030 may refer to the description of operation 730. Therefore, any duplicate description will be omitted.

[0168] In operation 1040, the electronic device may identify whether integrated management of personalized information is required. For example, the electronic device may identify whether integrated management of personalized information is required by identifying whether there is a similarity (or association) between the first personalized information and the second personalized information. If it is determined that integrated management of personalized information is required (e.g., if it is determined that there is a similarity (or association) between the first personalized information and the second personalized information), the electronic device may proceed to operation 1050. For example, the electronic device may identify whether integrated management of personalized information is required based on a user request. If it is determined that integrated management of personalized information is required (e.g., if a user request is received between requests for integrated management of the first personalized information and the second personalized information), the electronic device may proceed to operation 1050. If it is identified that integrated management of personalized information is not required (e.g., if a user request requesting integrated management of the first personalized information and the second personalized information is not received), the process may proceed to operation 1050.

[0169] In one embodiment, the similarity or relevance of the first personalized information and the second personalized information may mean that the first personalized information and the second personalized information are similar or relevant enough to be used together or integratedly managed to create content desired by the user.

[0170] According to one embodiment, the electronic device may display query information (e.g., a query included in the third text (840b) of FIG. 8B or the third text (840c) of FIG. 8C) for selecting content desired or preferred by a user among first content (e.g., the first content (820b) of FIG. 8B or the first content (820c) of FIG. 8C) associated with first personalized information or second content (e.g., the second content (830b) of FIG. 8B or the second content (830c) of FIG. 8C) associated with second personalized information to identify similarity (or association) through a display, obtain a second user input for the query information, and identify whether a similarity (or association) exists based on the second user input. The query information may be included in the second content, for example, but is not limited thereto. For example, the electronic device may display query information for selecting content preferred by the user among first content generated based on first personalized information or second content generated based on second personalized information.

[0171] For example, if a user input indicating a preference for first content is received, or a user input indicating a dislike for second content is received, the electronic device may determine that the first personalized information and the second personalized information are not similar (or related). Similarly, if the second content generated based on the second personalized information, which is personalized information of another electronic device, corresponds to content that the user does not prefer, the electronic device may determine that the second personalized information is not similar (or related) to the first personalized information, which is personalized information of the electronic device. If the first personalized information and the second personalized information are not similar, the second personalized information does not need to be used together with the first personalized information to generate content desired by the user, and the first personalized information and the second personalized information do not need to be managed in an integrated manner.

[0172] For example, when a user input indicating a preference for second content is received, the electronic device may determine that the first personalized information and the second personalized information are similar (or related). Similarly, when the second content generated based on the second personalized information, which is personalized information of another electronic device, corresponds to the content preferred by the user, the electronic device may determine that the second personalized information is similar (or related) to the first personalized information, which is personalized information of the electronic device. When the first personalized information and the second personalized information are similar, the second personalized information can be used together with the first personalized information to generate content desired by the user, and the first personalized information and the second personalized information need to be managed in an integrated manner. In one embodiment, the electronic device may identify whether integrated management of personalized information is necessary (e.g., whether there is similarity (or relatedness) in the personalized information) based on a second user input regarding query information acquired while the second content is displayed.

[0173] According to one embodiment, if the electronic device is in communication with an external electronic device, is in communication with the external electronic device and is using a continuity service, is connected to the same AP, or is within a specified distance, the electronic device may identify that there is a need for integrated management of personalized information (e.g., identify that first personalized information and second personalized information have similarity (or, correlation)) and may use the first personalized information and second personalized information together (e.g., integrated management). For example, the electronic device may identify that there is a need for integrated management of personalized information (e.g., similarity (or, correlation) of personalized information) and may integrate and manage the personalized information based on account information, usage history such as searches on each electronic device, usage location, and / or time information.

[0174] In operation 1050, the electronic device may generate third personalized information based on the first personalized information and the second personalized information. If the third personalized information is generated, the electronic device may delete the first personalized information and the second personalized information. In this way, if there is a need for integrated management of personalized information between the electronic device and an external electronic device (e.g., if there is a similarity (or association) between the personalized information), the electronic device may integrate two pieces of personalized information that have similarity (or association) and manage them as a single piece of personalized information.

[0175] In operation 1060, the electronic device may manage the first personalized information and the second personalized information separately, or delete the second personalized information. In this way, if there is no need for integrated management of the personalized information of the electronic device and the external electronic device (e.g., if there is no similarity (or association) between the personalized information), the electronic device may manage the two pieces of personalized information separately, or delete the second personalized information of the external electronic device, which has no similarity (or association) with the first personalized information of the electronic device, from its electronic device. The second personalized information thus deleted may no longer be used by the electronic device to generate content.

[0176] According to one embodiment, the server receives first personalized information associated with the use of an electronic device and second personalized information associated with the use of an external electronic device, and manages the first personalized information and the second personalized information in an integrated manner (e.g., generating first usage information) or separately manages the first personalized information and the second personalized information (e.g., generating second usage information) according to specified conditions. Upon a user request, the server may generate a result using an AI model (e.g., AI model (340) of FIG. 3) based on the first usage information or the second usage information. When personalized information is managed on the server, various security methods, such as information encryption, may be utilized to protect personal information.

[0177] FIG. 11 illustrates examples of first personalized information, second personalized information, and third personalized information according to one embodiment of the present disclosure.

[0178] FIG. 12 illustrates an example of third content generated by third personalized information according to one embodiment of the present disclosure.

[0179] Referring to FIG. 12, the third personalized information (e.g., the third personalized information (363) of FIG. 3 or FIG. 6) may have characteristics intermediate to the first personalized information (361) and the second personalized information (362) or integrated characteristics of the first personalized information (361) and the second personalized information (362). For example, if the first personalized information (361) includes preference information (1110) that prefers real images and the second personalized information (362) includes preference information (1120) that prefers simple images, the third personalized information (363) generated based on the first personalized information (361) and the second personalized information (362) may include preference information (1130) that prefers images that are simple and close to real images to a certain level or higher.

[0180] According to one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (300) of FIG. 3 or electronic device (300a) of FIGS. 4a, 4b) may indirectly receive third personalized information (363) from an external electronic device (e.g., electronic device (102, 104) of FIG. 1, electronic device (300) of FIG. 3 or electronic device (300b) of FIGS. 4a, 4b)) via an external server. According to one embodiment, the electronic device may indirectly receive second personalized information (e.g., second personalized information (362) of FIGS. 3 to 6) and / or fourth personalized information (e.g., fourth personalized information (364) of FIGS. 3, 4b, and 5) through an external server, or may directly receive second personalized information (362) and / or fourth personalized information (364) from an external electronic device, and generate third personalized information (363) using the first personalized information (361), the second personalized information (362), and / or the fourth personalized information (364).

[0181] According to one embodiment, the electronic device may manage at least one piece of personalized information (e.g., first personalized information (361), second personalized information (362), and / or fourth personalized information (364)) used to generate third personalized information and the third personalized information (363) together, or, after the third personalized information is generated, may delete at least one piece of personalized information (e.g., second personalized information (362) and / or fourth personalized information (364)) of another electronic device used to generate the third personalized information (363) from the electronic device.

[0182] Referring to FIG. 12, the first screen (1201) may include a user input (1210) for a creation request (or command) (e.g., "Create an image using oranges"). The user input (1210) may be, for example, the same as the user input (810b) of FIG. 8B and the user input (810c) of FIG. 8C. The second screen (1202) may include a user input (1219) and third content (1220) associated with third personalized information (363) generated by the AI ​​model.

[0183] According to one embodiment, the electronic device may generate a third prompt based on user input (1210) and / or third personalized information (363), and generate third content (1220) for the third prompt using an AI model (e.g., the AI ​​model (340) of FIG. 3 ). The third prompt generated based on the user input (1210) and the third personalized information (363) may be, for example, the third prompt reflecting the third personalized information as exemplified in Table 4 below.

[0184] Create a cafe menu image using user input orange. Reflect the third personalized information. Create a simple but realistic style image that can promote the cafe menu using orange. Create text that includes a description of the image.

[0185] According to one embodiment, the third content (1220) may include a third image and / or a third text. The third image may include, for example, an image generated in a simple but realistic style based on information about a work style included in the third personalized information (363), and the third text may include a description of the third image. In this way, the third content (1220) generated based on the user input and the third personalized information (363) may provide different content from the first content generated based on the same user input and the first personalized information (361) (e.g., the first content (820b) of FIG. 8b or the first content (820c) of FIG. 8c) and the second content generated based on the same user input and the second personalized information (362) (e.g., the second content (830b) of FIG. 8b or the second content (830c) of FIG. 8c).

[0186] According to one embodiment, the electronic device may manage the newly generated third personalized information (363) at a different level from other personalized information (e.g., the first personalized information and / or the second personalized information). For example, the electronic device may transmit the third personalized information (363) to at least one external electronic device connected to the electronic device so that the third personalized information (363) can be used by the at least one external electronic device.

[0187] FIG. 13 is a flowchart illustrating an operation of an electronic device identifying similarity between first personalized information and second personalized information according to one embodiment of the present disclosure.

[0188] The embodiment of FIG. 13 may be, for example, an example of operation 1040 of FIG. 12.

[0189] Referring to FIG. 13, in operation 1310, an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (300) of FIG. 3 or electronic device (300a) of FIGS. 4a, 4b) may provide query information to identify whether integrated management of personalized information is required. For example, the electronic device may display query information for identifying similarity (or correlation) between first personalized information (e.g., first personalized information (361) of FIGS. 3 to 6) and second personalized information (e.g., second personalized information (362) of FIGS. 3 to 6) through a display, or query information (e.g., a query included in the third text (840b) of FIG. 8b or the third text (840c) of FIG. 8c) for selecting content desired or preferred by the user among first content associated with the first personalized information (e.g., first content (820b) of FIG. 8b or first content (820c) of FIG. 8c) or second content associated with the second personalized information (e.g., second content (830b) of FIG. 8b or second content (830c) of FIG. 8c). In one embodiment, the similarity or relevance of the first personalized information and the second personalized information may mean that the first personalized information and the second personalized information are similar or relevant enough to be used together or integratedly managed to create content desired by the user.

[0190] At operation 1320, the electronic device may obtain a second user input for query information.

[0191] At operation 1330, the electronic device may identify whether integrated management of personalized information is required based on a second user input.

[0192] According to one embodiment, when the electronic device receives a second user input selecting the first content (or indicating a preference for the first content), or when the electronic device receives a second user input indicating a dislike for the second content, the electronic device may determine that the first personalized information and the second personalized information are not similar (or related). In this way, when the second content generated based on the second personalized information, which is personalized information of another electronic device, corresponds to content that the user does not prefer, the electronic device may determine that the second personalized information is not similar (or related) to the first personalized information, which is personalized information of the electronic device. When the first personalized information and the second personalized information are not similar (or related), the second personalized information can be used together with the first personalized information to generate content desired by the user, and there is no need for the first personalized information and the second personalized information to be managed in an integrated manner.

[0193] According to one embodiment, when a second user input is received to select second content (or to indicate a preference for second content), the electronic device may determine that the first personalized information and the second personalized information are similar (or related). In this way, when the second content generated based on the second personalized information, which is personalized information of another electronic device, corresponds to content preferred by the user, the electronic device may determine that the second personalized information is similar (or related) to the first personalized information, which is personalized information of the electronic device. When the first personalized information and the second personalized information are similar (or related), the second personalized information can be used together with the first personalized information to generate content desired by the user, and the first personalized information and the second personalized information need to be managed in an integrated manner.

[0194] According to one embodiment, the electronic device can identify whether integrated management of personalized information is necessary (e.g., whether there is similarity (or association) of personalized information) based on second user input regarding query information obtained while second content is displayed.

[0195] According to one embodiment, when the electronic device is in communication with an external electronic device, is in communication with the external electronic device and is using a continuity service, is connected to the same AP, or is within a specified distance, the electronic device may identify that integrated management of personalized information is required (e.g., that first personalized information and second personalized information have similarity (or, association)) and may use (e.g., integrated management) the first personalized information and second personalized information together. For example, the electronic device may determine similarity (or association) and manage personalized information based on account information, usage history such as searches on each electronic device, usage location, and / or time information.

[0196] FIG. 14 is a signal flow diagram illustrating a procedure for an electronic device to manage personalized information according to one embodiment of the present disclosure.

[0197] Referring to FIG. 14, in operation 1410, an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (300) of FIG. 3 or the electronic device (300a) of FIGS. 4a, 4b) may obtain a first user input (e.g., the user input (810b) of FIG. 8b or the user input (810c) of FIG. 8c). The description of operation 1410 may refer to the description of operation 710 of FIG. 7, for example.

[0198] In operation 1411, the electronic device may transmit a request including data of a first user input to an external electronic device (e.g., the electronic device (102, 104) of FIG. 1 or the electronic device (300) of FIG. 3 or the external electronic device (300b) of FIGS. 4a, 4b).

[0199] In operation 1420a, the electronic device may generate a first prompt based on a first user input and first personalized information (e.g., the first personalized information (361) of FIGS. 3 to 6). In operation 1430a, the electronic device may obtain first content (e.g., the first content (820b) of FIG. 8b or the first content (820c) of FIG. 8c) for the first prompt using a generative AI model. The description of operations 1420a and 1430b may refer to, for example, the description of operations 710 and 720 of FIG. 7. Therefore, any duplicate description will be omitted.

[0200] In operation 1420b, the external electronic device may generate a second prompt based on the first user input and second personalized information (e.g., the second personalized information (362) of FIGS. 3 to 6). In operation 1430b, the external electronic device may obtain second content (e.g., the second content (830b) of FIG. 8b or the second content (830c) of FIG. 8c) for the second prompt using a generative AI model. The descriptions of operations 1420b and 1430b may correspond to the same operations as operations 1420a and 1430b, except that the operations are performed by the external electronic device rather than the electronic device, i.e., there is a difference in the subject of the operations. Therefore, duplicate descriptions are omitted.

[0201] In operation 1441, the external electronic device may transmit a response including data of the second content to the electronic device.

[0202] In operation 1450, the electronic device may display first content and second content. In operation 1460, the electronic device may determine whether integrated management of personalized information is required. For example, the electronic device may determine whether integrated management of personalized information is required by determining whether there is a similarity (or correlation) between the first personalized information and the second personalized information. The description of operation 1460 may refer to the description of operation 1050 of FIG. 10 and operations 1310 to 1330 of FIG. 13.

[0203] In operation 1470, if it is determined that integrated management of personalized information is necessary, the electronic device may receive second personalized information from an external electronic device and generate third personalized information (e.g., third personalized information (363) of FIG. 3, 5, or 6) based on the first personalized information and the second personalized information. According to one embodiment, in order to receive the second personalized information from the external electronic device, the electronic device may transmit a request message requesting the second personalized information to the external electronic device. In operation 1480, if it is determined that integrated management of personalized information is not necessary, the electronic device may refrain from receiving the second personalized information from the external electronic device. For example, the electronic device may not transmit a request message requesting the second personalized information to the external electronic device.

[0204] As described above, in the embodiment of FIG. 14, unlike the previous embodiment, when the external electronic device establishes a communication connection with the electronic device, the external electronic device does not transmit the second personalized information to the electronic device, but, upon request of the electronic device, acquires the second prompt and second content by itself using the second personalized information, and transmits data of the acquired second content to the electronic device. Thereafter, when it is identified that integrated management of personalized information is necessary, the external electronic device may transmit the second personalized information to the electronic device, for example, upon request of the electronic device, and the electronic device may generate third personalized information using the received second personalized information and the stored first personalized information.

[0205] According to one embodiment of the present disclosure, an electronic device includes a display, a communication circuit, at least one processor including a processing circuit, and a memory including at least one storage medium storing instructions, wherein the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to perform at least one operation.

[0206] According to one embodiment, the electronic device may generate at least one prompt based on a first user input, first personalized information associated with use of the electronic device, and second personalized information associated with use of an external electronic device, obtain first content associated with the first personalized information and second content associated with the second personalized information based on the at least one prompt using a generative artificial intelligence (AI) model, and display the first content and the second content through the display.

[0207] According to one embodiment, the electronic device can identify whether integrated management of the first personalized information and the second personalized information is required, and based on identifying that integrated management is required, generate third personalized information based on the first personalized information and the second personalized information.

[0208] According to one embodiment, the electronic device may separately manage the first personalized information and the second personalized information, or delete the second personalized information, based on identifying that the integrated management is not necessary.

[0209] According to one embodiment, the electronic device may display query information for selecting content preferred by a user of the electronic device among the first content or the second content through the display, obtain a second user input for the query information, and identify that the integrated management is necessary in response to the second user input being a user input for selecting the second content, and identify that the integrated management is not necessary in response to the second user input being a user input for selecting the first content or a user input indicating not to prefer the second content.

[0210] In one embodiment, the query information is included in the second content, and the second user input can be received while the second content including the query information is displayed.

[0211] According to one embodiment, the electronic device may generate a first prompt based on the first user input and the first personalized information, and may generate a second prompt based on the first user input and the second personalized information. The second prompt may include a command for generating the query information.

[0212] In one embodiment, the electronic device may generate a third prompt based on the first user input, the first personalized information, and the second personalized information. The third prompt may include a command for generating the query information.

[0213] According to one embodiment, in response to generating the third personalized information, the electronic device may transmit the generated third personalized information to the external electronic device.

[0214] According to one embodiment, the electronic device can receive at least one piece of personalized information including the second personalized information from the external electronic device connected to the electronic device based on identifying that the first user input has been obtained.

[0215] According to one embodiment, the at least one piece of personalized information may include: the second personalized information and the fourth personalized information, wherein the second personalized information may include personalized information associated with a first application used by the first user on the external electronic device, and the fourth personalized information may include personalized information associated with a second application used by the first user on the external electronic device.

[0216] In one embodiment, the user of the first personalized information may be different from the user of the second personalized information.

[0217] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0218] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0219] One embodiment of the present document may be implemented as software (e.g., a program (140) of FIG. 1) including one or more instructions stored in a storage medium (e.g., an internal memory (136) of FIG. 1 or an external memory (138) of FIG. 1) readable by a machine (e.g., an electronic device (101) of FIG. 1). For example, a processor (e.g., a processor (120) of FIG. 1) of the machine (e.g., an electronic device (101) of FIG. 1) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0220] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0221] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; communication circuit; At least one processor comprising a processing circuit; and A memory comprising at least one storage medium storing instructions, said instructions, when individually or collectively executed by said at least one processor, causing said electronic device to: Generate at least one prompt based on a first user input, first personalized information associated with use of the electronic device, and second personalized information associated with use of the external electronic device; Obtaining first content associated with the first personalized information and second content associated with the second personalized information based on the at least one prompt using a generative AI (artificial intelligence) model, An electronic device that causes the first content and the second content to be displayed through the display.

2. In the first paragraph, when the instructions are individually or collectively executed by the at least one processor, the electronic device: Identify whether integrated management of the first personalized information and the second personalized information is required, Based on identifying that the above integrated management is required, third personalized information is generated based on the first personalized information and the second personalized information, An electronic device that causes the first personalized information and the second personalized information to be managed separately or the second personalized information to be deleted based on identifying that the above integrated management is not necessary.

3. In the second paragraph, an electronic device in which whether the integrated management is necessary is identified based on the similarity between the first personalized information and the second personalized information.

4. In paragraph 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Displaying query information for selecting content preferred by a user of the electronic device among the first content or the second content through the display; Obtaining a second user input for the above query information, In response to the second user input being a user input for selecting the second content, identifying that the integrated management is required, An electronic device that causes the integrated management to be identified as not required in response to the second user input being a user input selecting the first content or a user input indicating a dislike for the second content.

5. An electronic device according to claim 4, wherein the query information is included in the second content, and the second user input is received while the second content including the query information is displayed.

6. In the fourth paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Generate a first prompt based on the first user input and the first personalized information, Causing a second prompt to be generated based on the first user input and the second personalized information; An electronic device wherein the second prompt includes a command for generating the query information.

7. In the fourth paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causes a third prompt to be generated based on the first user input, the first personalized information, and the second personalized information; An electronic device wherein the third prompt comprises a command for generating the query information.

8. In any one of paragraphs 2 to 6, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that, in response to generating the third personalized information, causes the generated third personalized information to be transmitted to the external electronic device.

9. In any one of paragraphs 1 to 6, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes the electronic device to receive at least one piece of personalized information including the second personalized information from the external electronic device connected to the electronic device based on identifying that the first user input has been obtained.

10. In paragraph 9, the at least one piece of personalized information is: Including the second personalized information and the fourth personalized information, An electronic device, wherein the second personalized information includes personalized information associated with a first application used by the first user on the external electronic device, and the fourth personalized information includes personalized information associated with a second application used by the first user on the external electronic device.

11. An electronic device according to claim 1, wherein the user of the first personalized information is different from the user of the second personalized information.

12. In the method of operating an electronic device, An action to generate at least one prompt based on a first user input, first personalized information associated with use of the electronic device, and second personalized information associated with use of the external electronic device; An operation of obtaining first content associated with the first personalized information and second content associated with the second personalized information based on the at least one prompt using a generative AI (artificial intelligence) model; and A method comprising an action of displaying the first content and the second content through a display.

13. In paragraph 12, the method: An action for identifying whether integrated management of the first personalized information and the second personalized information is required; An operation of generating third personalized information based on the first personalized information and the second personalized information based on identifying that the above integrated management is necessary; and A method comprising an operation of separately managing the first personalized information and the second personalized information, or deleting the second personalized information, based on identifying that the integrated management is not necessary.

14. In the 13th paragraph, a method in which whether the integrated management is necessary is identified based on the similarity between the first personalized information and the second personalized information.

15. In paragraph 13, the method: An action of displaying query information for selecting content preferred by a user of the electronic device among the first content or the second content through the display; An action of obtaining a second user input for the above query information; An operation for identifying that the integrated management is required in response to the second user input being a user input for selecting the second content; and A method comprising: identifying that the integrated management is not required in response to the second user input being a user input selecting the first content or a user input indicating a dislike for the second content.

Images