Electronic device for editing content by using generative artificial intelligence model and operation method thereof

Abstract

According to an embodiment, an electronic device may comprise a display, at least one processor, and a memory for storing instructions. According to an embodiment, the instructions may, when executed by the at least one processor, cause the electronic device to, on the basis of identifying a command for editing first content displayed on the display, identify objects included in the first content. According to an embodiment, the instructions may, when executed by the at least one processor, cause the electronic device to, on the basis of attributes of the objects, identify functions for editing a corresponding object among the objects. According to an embodiment, the instructions may, when executed by the at least one processor, cause the electronic device to display, on the first content, a plurality of icons for editing the objects, wherein the shape of each of the plurality of icons is determined on the basis of an attribute of the corresponding object and the functions for editing the corresponding object. According to an embodiment, the instructions may, when executed by the at least one processor, cause the electronic device to, on the basis of a first user input for selecting a first icon from among the plurality of icons, display a first menu for editing a first object corresponding to the first icon, wherein the first menu includes sub-icons indicating functions for editing the first object on the basis of an attribute of the first object. According to an embodiment, the instructions may, when executed by the at least one processor, cause the electronic device to, when a first sub-icon is selected from among the sub-icons, identify a second user input for a control user interface (UI) provided by the first sub-icon. According to an embodiment, the instructions may, when executed by the at least one processor, cause the electronic device to, in response to the second user input, display second content in which the first object included in the first content has been changed on the basis of a function corresponding to the first sub-icon.

Description

Electronic device for editing content using a generative artificial intelligence model and method of operation thereof

[0001] The present disclosure relates to an electronic device for editing content using a generative artificial intelligence model and a method of operating the same.

[0002] Thanks to remarkable advancements in information and communication technology and semiconductor technology, the proliferation and use of various electronic devices is rapidly increasing. Electronic devices are being developed to enable users to carry and communicate with one another. An electronic device can refer to any device that performs a specific function based on its embedded software, such as a mobile communication terminal, tablet PC, wearable electronic device, audio / video device, desktop / laptop computer, or in-vehicle navigation system.

[0003] Electronic devices can utilize artificial intelligence (AI) models to provide services for specific purposes. For example, AI models are being utilized in diverse fields such as content streaming, translation, photo editing, finance, new drug development, law, and the military. At least some of the various AI models for specific services can be implemented as generative AI models. Depending on the implementation, the AI ​​models can operate in a form where multiple AI models are linked together.

[0004] According to one embodiment, an electronic device may include a display, at least one processor, and a memory storing instructions. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify objects included in first content displayed on the display based on a confirmation of a command to edit the first content. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify functions for editing a corresponding object among the objects based on properties of the objects. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display a plurality of icons for editing the objects on the first content, wherein a shape of each of the plurality of icons may be determined based on properties of the corresponding object and the functions for editing the corresponding object. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display a first menu for editing a first object corresponding to a first icon based on a first user input for selecting a first icon from among the plurality of icons, wherein the first menu may include sub-icons representing functions for editing the first object based on properties of the first object. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to confirm a second user input with respect to a control UI (user interface) provided by the first sub-icon when a first sub-icon from among the sub-icons is selected.According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to, in response to the second user input, display second content in which the first object included in the first content is changed based on a function corresponding to the first sub-icon.

[0005] According to one embodiment, a method of operating an electronic device may include an operation of confirming objects included in a first content based on a command for editing the first content displayed on a display included in the electronic device. According to one embodiment, the method of operating the electronic device may include an operation of confirming functions for editing a corresponding object among the objects based on properties of the objects. According to one embodiment, the method of operating the electronic device may include an operation of displaying a plurality of icons for editing the objects on the first content, wherein a shape of each of the plurality of icons may be determined based on a property of the corresponding object and the functions for editing the corresponding object. According to one embodiment, the method of operating the electronic device may include an operation of displaying a first menu for editing a first object corresponding to the first icon based on a first user input for selecting a first icon among the plurality of icons, wherein the first menu may include sub-icons representing functions for editing the first object based on properties of the first object. According to one embodiment, the method of operating the electronic device may include an operation of confirming a second user input for a control UI (user interface) provided by the first sub-icon when a first sub-icon among the sub-icons is selected. According to one embodiment, the method of operating the electronic device may include an operation of displaying second content in which the first object included in the first content is changed based on a function corresponding to the first sub-icon, in response to the second user input.

[0006] According to one embodiment, a non-transitory recording medium storing computer-readable instructions, wherein the instructions, when collectively or individually executed by at least one processor, cause an electronic device to, based on a command to edit a first content displayed on a display included in the electronic device, identify objects included in the first content, identify functions for editing a corresponding object among the objects based on properties of the objects, and display a plurality of icons for editing the objects on the first content, wherein a shape of each of the plurality of icons is determined based on a property of the corresponding object and the functions for editing the corresponding object, and display a first menu for editing a first object corresponding to the first icon based on a first user input for selecting a first icon among the plurality of icons, wherein the first menu includes sub-icons representing functions for editing the first object based on a property of the first object, and when a first sub-icon among the sub-icons is selected, a control UI (user interface) provided by the first sub-icon The second user input for the first sub-icon can be verified, and in response to the second user input, the first object included in the first content can be caused to display the changed second content based on a function corresponding to the first sub-icon.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.

[0008] Figure 2 is a schematic block diagram of an electronic device according to one embodiment.

[0009] FIG. 3A is a flowchart illustrating a method for an electronic device to edit a first object included in a first content, according to one embodiment.

[0010] FIG. 3b is a diagram illustrating a method for an electronic device to edit a first object included in a first content according to one embodiment.

[0011] FIG. 4A is a flowchart illustrating a method for an electronic device to edit a first object included in a first content, according to one embodiment.

[0012] FIG. 4B is a diagram illustrating a method for an electronic device to edit a first object included in a first content according to one embodiment.

[0013] FIG. 5 is a flowchart illustrating a method for an electronic device to display icons for editing first content according to one embodiment.

[0014] FIG. 6A is a flowchart illustrating a method for an electronic device to edit a specific object included in a first content, according to one embodiment.

[0015] FIG. 6B is a diagram illustrating a method for an electronic device to edit a specific object included in a first content according to one embodiment.

[0016] FIG. 6C is a diagram illustrating a prompt for an electronic device to edit a specific object included in a first content, according to one embodiment.

[0017] FIG. 7 is a diagram illustrating a method for an electronic device to display icons over enlarged first content according to one embodiment.

[0018] FIG. 8 is a diagram illustrating a method for an electronic device to edit a specific object included in a first content according to one embodiment.

[0019] FIGS. 9A, 9B, and 9C are drawings illustrating a method for an electronic device to obtain a prompt for editing a first object by adjusting a slide bar according to various embodiments.

[0020] FIGS. 10A, 10B, 10C, and 10D are drawings illustrating a method for an electronic device to obtain a prompt for editing at least one object included in a first content, according to various embodiments.

[0021] FIGS. 11a, 11b, and 11c are drawings illustrating a method for an electronic device to edit first content according to various embodiments.

[0022] FIG. 12 is a diagram illustrating a method for an electronic device to edit a phonetic element included in a first content according to one embodiment.

[0023] Fig. 13 is a diagram for explaining a generative artificial intelligence system according to one embodiment.

[0024] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.

[0025] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0026] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0027] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0028] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0029] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0030] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0031] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0032] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0033] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0034] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0035] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0036] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0037] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0038] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0039] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0040] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0041] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0042] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0043] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0044] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0045] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0046] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0047] Figure 2 is a schematic block diagram of an electronic device according to one embodiment.

[0048] Referring to FIG. 2, according to one embodiment, an electronic device (201) may include a processor (220), a memory (230), a display (260), and a communication circuit (290). For example, the electronic device (201) may be implemented in the same or similar manner as the electronic device (101) of FIG. 1.

[0049] According to one embodiment, the processor (220) may control the overall operation of the electronic device (201). For example, the processor (220) may be implemented in a manner identical to or similar to the processor (120) of FIG. 1. The processor (220) according to one embodiment may execute software (e.g., the program (140) of FIG. 1) to control at least one other component (e.g., a hardware or software component) of the electronic device (201) connected to the processor (220), and may perform data processing or calculations based on the instructions. The instructions according to one embodiment may include instructions configured in a machine language that can be processed by the electronic device (201) or the processor (220). For example, the instructions may include instructions corresponding to operation instructions used in the program.

[0050] Meanwhile, although FIG. 2 illustrates that the electronic device (201) includes one processor (220), this is merely exemplary and the technical concept of the present invention may not be limited thereto. For example, the electronic device (201) may include at least one processor. For example, the processor (220) may be implemented as at least one processor.

[0051] According to one embodiment, the memory (230) (e.g., the memory (130) of FIG. 1) may store at least one command (or instruction) that causes at least one operation of the electronic device (201). The at least one instruction, when executed by the processor (220), may cause the electronic device (201) to perform a corresponding operation.

[0052] According to one embodiment, the memory (230) may store content. For example, the content may include text, voice, images, and / or video. For example, the first content may include text, voice, images, and / or video on a specific topic based on a user (e.g., the first user) assigned to the first electronic device (201) or device information of the first electronic device (201).

[0053] According to one embodiment, the processor (220) may modify, change, edit, or generate content stored in the memory (230) using a generative AI model. For example, the generative AI model may be stored in the memory (230). Alternatively, the generative AI model may be stored in an external electronic device (e.g., a server). For example, the processor (220) may use the generative AI model to generate or obtain content based on a prompt. For example, the prompt may include a command (e.g., text) for newly generating content or for modifying, changing, or editing at least one element or at least one object included in the content. For example, the prompt may include a command in the form of text that the generative AI model can recognize.

[0054] In one embodiment, when the generative AI model is stored in an external electronic device (e.g., a server), the processor (220) may transmit a prompt to the external electronic device via a communication circuit (290) (e.g., the communication module (190) of FIG. 1). In addition, the processor (220) may obtain content based on the prompt from the external electronic device via the communication circuit (290).

[0055] For convenience of explanation, the following description will focus on a method for an electronic device (201) to obtain content based on a prompt when a generative AI model is stored in memory (230). However, the technical concept of the present invention is not limited thereto, and the electronic device (201) may obtain content based on a prompt through an external electronic device (e.g., a server) using a method identical to or similar to this.

[0056] In one embodiment, the first content may be content to be edited. For example, the first content may include content generated using a generative AI model.

[0057] According to one embodiment, the second content may be content in which at least one object (or element) included in the first content is changed, transformed, or edited based on a prompt obtained using icons and sub-icons corresponding to at least one object (or element) included in the first content. For example, at least a portion of the second content may be different from the first content. For example, the second content may be content in which at least one of brightness, size, ratio, position, direction, shape, type, color, or number of at least one object (or element) included in the first content is changed based on the prompt using a generative AI model.

[0058] According to one embodiment, the processor (220) may analyze or process first content displayed on the display (260) (e.g., the display module (160) of FIG. 1) based on confirmation of a command to edit content. For example, the processor (220) may analyze (or recognize) the type of content, the size of the content, or an object (or element) included in the content. In addition, the processor (220) may:

[0059] The processor (220) can identify objects included in the first content based on the analysis results (or recognition results). For example, the objects may be objects with properties that can be edited or changed. For example, the objects included in the first content may include objects (e.g., objects, buildings, mountains, the sea, clouds), living things (e.g., people, animals), backgrounds, text, visual elements (e.g., images, pictures, hand drawings, or handwriting), and non-visual elements (e.g., voices or sounds). For example, the processor (220) can identify a command to edit the content based on identifying a user input (e.g., a tap input) for a specific object (e.g., an object requesting content editing) displayed on the display (260).

[0060] According to one embodiment, the processor (220) may display a plurality of icons for editing objects included in the first content on the first content. For example, the processor (220) may display a specified number of icons on the first content. For example, the specified number (e.g., 5) may be set by the user or automatically determined based on the size of the first content. The plurality of icons may be displayed so as to be visually distinct from the first content. For example, the processor (220) may identify the properties and editable functions of the corresponding objects based on the results of analyzing the objects. The processor (220) may obtain a plurality of icons based on the properties and editable functions of the identified objects. For example, the shape and / or display position of each of the plurality of icons may be determined based on the analysis results (or recognition results) of the corresponding object among the objects. For example, when the object is a "sea," the corresponding icon may be in the shape of a "sea." Additionally, a "sea"-shaped icon may be displayed on (or near) the "sea" contained in the first content. For example, if the object is a "bird," the corresponding icon may be shaped like a "bird." Additionally, a "sea"-shaped icon may be displayed on (or near) the "bird" contained in the first content.

[0061] According to one embodiment, the processor (220) may verify a first user input (e.g., a tap input) for selecting a first icon from among a plurality of icons. The processor (220) may display a first menu for editing a first object based on the first user input. For example, the first menu may include sub-icons representing functions for editing the first object based on an analysis result (or a recognition result) of the first object. For example, some of the sub-icons (e.g., sub-icons representing functions based on properties of the first object) may be configured in a shape similar to the first icon. Alternatively, other some of the sub-icons (e.g., sub-icons representing default functions unrelated to properties of the first object) may be configured regardless of the shape of the first icon.

[0062] According to one embodiment, the processor (220) may set parameters to be applied to a prompt based on a control method provided by each sub-icon (e.g., a slide bar adjustment method, a tap input method for a moving location, a voice or text input method). For example, the processor (220) may display a control UI provided by each sub-icon. The processor (220) may determine parameters to be applied to a prompt based on a user input to the control UI. For example, the parameters may include a value indicating the degree to which a corresponding object changes according to the user input. The processor (220) may generate a prompt based on the corresponding value corresponding to the user input.

[0063] According to one embodiment, the processor (220) may verify a second user input (e.g., a tap input or a drag input) for a control UI provided by a first sub-icon among the sub-icons. Based on the second user input, the processor (220) may obtain a first prompt including a first text that causes a first object to be changed based on a function corresponding to the first sub-icon. For example, the first text may include information (e.g., a parameter value corresponding to the second user input) on how much at least one of brightness, size, ratio, position, direction, shape, type, color, or number of the first object is changed based on the function corresponding to the first sub-icon.

[0064] According to one embodiment, the processor (220) may obtain second content in which the first object included in the first content is changed based on the first prompt, using a generative AI model. The processor (220) may display the second content on the display (260). For example, the processor (220) may change the first content to the second content in real time in response to a second user input for a control UI provided by a specific sub-icon. For example, if it is confirmed that a slide bar provided in a sub-icon is adjusted by the second user input, the processor (220) may reflect the degree to which the slide bar is adjusted in real time (e.g., change the first content to the second content in real time).

[0065] According to one embodiment, the first content may be content obtained based on a second prompt using a generative AI model. The processor (220) may use a first text obtained based on a second user input to a control UI provided by a specific sub-icon and a second text included in the second prompt to obtain the first prompt for generating the second content. For example, the second prompt may be obtained based on adding the first text to the second text previously included in the second prompt for generating the first content.

[0066] Previously, when editing content using generative AI models, there were difficulties in obtaining the prompts required to be input into the model. For example, there were difficulties in obtaining prompts for selecting at least one object (or element) within the content to be edited and for editing the selected object to the desired degree.

[0067] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface, even without the user directly writing a prompt. The electronic device (201) can provide an environment in which the user can intuitively edit a specific object (or element) of the content to be edited by providing an icon displayed on the content to be edited and a sub-icon of the icon.

[0068] At least some of the operations of the electronic device (201) described below may be performed by the processor (220). However, for convenience of explanation, the operations below will be described as being performed by the electronic device (201).

[0069] FIG. 3A is a flowchart illustrating a method for an electronic device to edit a first object included in a first content, according to one embodiment.

[0070] Referring to FIG. 3A, according to one embodiment, in operation 301, an electronic device (e.g., the electronic device (201) of FIG. 2) may identify objects included in the first content based on confirming a command to edit the first content (e.g., the first content displayed on the display (260)). For example, the objects included in the first content may include objects (e.g., the sun, the moon, a river, a cloud, the sea, a tree, grass, a building), a person, an animal (e.g., a bird, a dog, a cat), or a background.

[0071] According to one embodiment, in operation 303, properties of objects included in the first content may be checked, and functions for editing a corresponding object among the objects may be checked based on the checked properties. For example, the functions may include functions for changing at least one of brightness, size, ratio, position, direction, shape, type, color, or number of the corresponding object. For example, if the corresponding object is a “sun,” the functions may include a function for adjusting the brightness of the sun, a function for adjusting the color of the sun (e.g., yellow, red, or dark), and a function for adjusting the position of the sun. For example, if the corresponding object is a “cloud,” the functions may include a function for adjusting the amount of clouds, a function for changing the type of clouds, a function for changing the shape of clouds, a function for adjusting the degree (or ratio) of cloud density, and a function for adjusting the position of clouds.

[0072] According to an embodiment, in operation 305, the electronic device (201) may display a plurality of icons for editing objects included in the first content on the first content. Each of the plurality of icons may be determined based on the properties of the corresponding object and / or the functions for editing the corresponding object. For example, the shape and / or display position of each of the plurality of icons may be determined based on the analysis result of the corresponding object among the objects included in the first content. For example, if the object is a cloud, the icon corresponding to the cloud may be in the shape of a cloud. Additionally, the icon (e.g., a cloud-shaped icon) may be displayed on (or near) the cloud in the first content. For example, the electronic device (201) may select a plurality of objects (a specified number) according to a specified priority and display a plurality of icons for the selected objects. For example, when the first content is generated through a generative AI model, the specified priority may designate objects corresponding to keywords included in a corresponding prompt as having a high priority. For example, if the prompt of the first content is "Show me a bird's eye view of the newly built model house located to the right of Exit 3 of Apgujeong Station," the electronic device (201) may designate objects corresponding to "model house" and "Exit 3 of Apgujeong Station" as having the highest priority. Alternatively, an object that occupies a large portion of the screen in the first content (e.g., an image) may have a high priority. Alternatively, the electronic device may learn the user's tastes or preferences by considering the user's previous operation history, and determine the priorities by reflecting the learned tastes or preferences. For example, the electronic device (201) may determine an object corresponding to a keyword included in the prompt as the first priority, an object that occupies a large portion of the first content as the second priority, and an object that matches the user's tastes or preferences as the third priority. However, this is exemplary, and various methods of determining priorities may be applied.

[0073] According to one embodiment, in operation 307, the electronic device (201) may display a first menu including sub-icons representing functions for editing a first object corresponding to the first icon based on a first user input (e.g., a tap input) for selecting a first icon from among a plurality of icons. For example, the first menu may include sub-icons representing functions for editing the first object based on properties of the first object. For example, the sub-icons may include sub-icons based on properties of the first object (e.g., shape, type, size, and / or proportion in the first content) and default sub-icons unrelated to the properties of the first object. For example, if the first object is a “bird,” the sub-icon based on the properties of the first object may be set to an icon in the shape of a “bird.” Additionally, the sub-icon based on the properties of the first object may provide a function for changing the type of “bird” or adjusting the number of “birds.” The default sub-icon may include the ability to adjust the size or proportions of the first object, delete the object, and / or add text to be entered into the prompt using text input or voice recognition.

[0074] According to one embodiment, the electronic device (201) may determine parameter values ​​of each of the sub-icons included in the first menu corresponding to each icon (e.g., the first icon). For example, the sub-icons may represent functions for editing the first object, and the function provided by each sub-icon (e.g., the editing function of the first object) may be assigned a parameter value for changing (or editing) the first object (e.g., the type of change to the first object).

[0075] According to one embodiment, in operation 309, when a first sub-icon among the sub-icons included in the first menu is selected, the electronic device (201) can confirm a second user input for a control user interface (UI) provided by the first sub-icon. For example, the control UI can be implemented as at least one of a slide bar, an object that can designate a specific location, or a UI that can select a specific object.

[0076] According to one embodiment, in operation 311, the electronic device (201) may obtain a first prompt including a first text to change the first object based on a function corresponding to the first sub-icon in response to a second user input. For example, the electronic device (201) may obtain a first prompt including a first text to change at least one of brightness, size, ratio, position, direction, shape, type, color, or number of the first object based on the second user input. For example, the electronic device (201) may check a corresponding parameter value (e.g., type of change and degree of change) based on a degree (e.g., movement distance, area designation, or position designation) to which a second user input (e.g., tap input or drag input) for a control UI provided by the first sub-icon has been input. The electronic device (201) may determine the first text based on the checked parameter value. For example, if the location of the first object is determined to be a specific location by a second user input, the electronic device (201) may add information (e.g., text) indicating the specific location and information (e.g., text) commanding the first object to move to the specific location to the first prompt.

[0077] According to one embodiment, in operation 313, the electronic device (201) may obtain second content in which a first object included in the first content is changed based on a first prompt using a generative AI model. In addition, the electronic device (201) may display the second content on the display (260). Depending on the implementation, the electronic device (201) may continuously change the first content to the second content. For example, the electronic device (201) may continuously change the first content to the second content in response to the second user input being continuously input.

[0078] In FIG. 3b below, a method for an electronic device (201) to obtain or generate second content by editing first content will be specifically described.

[0079] Meanwhile, the prompts illustrated in the drawings described below may not be displayed on the display (260). For example, the prompts are illustrated for convenience of explanation and may not be displayed. However, depending on the implementation, the prompts may be displayed on the display (260).

[0080] FIG. 3b is a diagram illustrating a method for an electronic device to edit a first object included in a first content according to one embodiment.

[0081] Referring to FIG. 3b, according to one embodiment, an electronic device (e.g., electronic device (201) of FIG. 2) may display first content (320) on a display (e.g., display (260) of FIG. 2).

[0082] According to one embodiment, when a command to edit the first content (320) is confirmed, the electronic device (201) may display a plurality of icons (340, 342, 344, 346) on the first content (320). For example, the electronic device (201) may analyze the first content (320) to confirm objects included in the first content (320) and properties of the objects. The plurality of icons (340, 342, 344, 346) may be set or displayed in a shape related to the type and / or property of the corresponding object. For example, the plurality of icons (340, 342, 344, 346) may be set in a shape (e.g., a sun shape, a cloud shape, or a building shape) representing the object (e.g., a sun shape, a cloud shape, or a building shape) on the corresponding object. Additionally, some icons (346) may be set to a predetermined shape based on the properties of the corresponding object. For example, the electronic device (201) may confirm a command to edit the first content (320) based on confirming a user input (e.g., a tap input) for a specific object (e.g., an object requesting content editing) displayed on the display (260) (or on the first content (320)). For example, a plurality of icons (340, 342, 344) may be generated based on the results of analyzing the first content (320). For example, the electronic device (201) may analyze the first content (320) using a specific algorithm or AI model.

[0083] According to one embodiment, the electronic device (201) may display a first menu (350) including sub-icons (351, 352, 353, 354, 355, 356, 357) corresponding to the first icon (340) based on a first user input (e.g., a tap input) that selects a first icon (340) (e.g., a sun icon). For example, the sub-icons (351, 352, 353, 354, 355, 356, 357) may each represent a function for adjusting the amount (or brightness) of sunlight (351), a function for adjusting the color of sunlight (352), a function for adjusting the position of the sun (353), a function for adjusting the ratio of the sun (354), a function for entering a command to be added to the prompt by voice (355), a function for entering a command to be added to the prompt by text (356), and a function for entering a command to be added to the prompt by handwriting (357).

[0084] According to one embodiment, the electronic device (201) may adjust the amount (or brightness) of sunlight included in the first content (320) based on a second user input (e.g., a tap input or a drag input) to the first sub-icon (351). For example, the electronic device (201) may display a control menu (e.g., a slide bar) (360) for adjusting the amount (or brightness) of sunlight, and adjust the brightness of the sun based on the second user input to the control menu (360). For example, the electronic device (201) may generate a prompt (380) for adjusting the amount of sunlight included in the first content (320) based on the second user input to the slide bar (360) provided by the first sub-icon (351). For example, a parameter value for adjusting the amount of sunlight may be specified in the slide bar (360). The electronic device (201) may determine a corresponding parameter value based on the distance or position adjusted by the slide bar (360) by the second user input, and generate a prompt (380) including text indicating the determined parameter value. For example, the prompt (380) may include text indicating that the brightness of the sun should be increased by 30% based on the second user input to the slide bar (360).

[0085] According to one embodiment, the electronic device (201) may obtain and display second content (320) in which the brightness of a first object (e.g., a sun) included in the first content (320) is adjusted based on a prompt (380) using a generative AI model.

[0086] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface, even without the user directly writing a prompt. The electronic device (201) can provide an environment in which the user can intuitively and easily edit a specific object (or element) of the content to be edited by providing an icon displayed on the content to be edited and a sub-icon of the icon.

[0087] FIG. 4A is a flowchart illustrating a method for an electronic device to edit a first object included in a first content, according to one embodiment.

[0088] Referring to FIG. 4A, according to one embodiment, in operation 401, an electronic device (e.g., electronic device (201) of FIG. 2) may generate a prompt for generating content using a generative AI model. In operation 403, the electronic device (201) may generate first content based on the prompt.

[0089] According to one embodiment, in operation 405, the electronic device (201) may, based on confirming a command to edit the first content, confirm the properties of objects included in the first content and the editable functions for each object. For example, the electronic device (201) may analyze the first content, identify or extract objects included in the first content, and confirm the properties (e.g., type, changeable properties) of the objects. For example, the electronic device (201) may, based on the result of analyzing the first content, confirm the properties (e.g., location, size, type, changeable properties) of objects (e.g., the sun, clouds, buildings) included in the first content. In addition, the electronic device (201) may confirm functions for editing the corresponding object based on the confirmed properties. For example, when the object is the sun, the electronic device (201) may confirm the brightness and / or color of the sun. For example, the electronic device (201) can identify functions for changing or editing the brightness and / or color of the sun. When the object is a cloud, the electronic device (201) can identify the type of cloud, the amount of cloud, and / or the color of the cloud. For example, the electronic device (201) can identify functions for changing or editing the type, amount, and color of the cloud.

[0090] According to one embodiment, in operation 407, the electronic device (201) may acquire a plurality of icons having shapes (e.g., a sun shape, a cloud shape, and / or a building shape) based on the recognition results (or analysis results) of objects, and display the plurality of icons on the corresponding objects.

[0091] According to one embodiment, in operation 409, the electronic device (201) may display icons corresponding to objects based on properties and editing functions of the objects. In addition, the electronic device (201) may determine parameter values ​​of each of the sub-icons included in the first menu corresponding to each icon (e.g., the first icon). For example, the sub-icons may represent functions for editing the first object determined based on properties of the first object, and the function provided by each sub-icon (e.g., the editing function of the first object) may be set with parameter values ​​for changing (or editing) the first object.

[0092] According to one embodiment, in operation 411, the electronic device (201) may obtain a first text reflecting the corresponding parameter based on a second user input to the control UI provided by the first sub-icon. For example, the first text may include text that causes the first object to be changed (or edited) based on the corresponding parameter value.

[0093] In one embodiment, in operation 413, the electronic device (201) may obtain a first prompt based on the first text and the second text included in the prompt used to generate the first content. For example, the electronic device (201) may generate or obtain the first prompt based on what the first text and the second text add. For example, the first prompt may be a prompt for changing (or editing) a first object included in the first content.

[0094] In FIG. 4b below, a method for an electronic device (201) to obtain or generate second content by editing first content will be specifically described.

[0095] FIG. 4B is a diagram illustrating a method for an electronic device to edit a first object included in a first content according to one embodiment.

[0096] Referring to FIG. 4b, compared to FIG. 3b, the first content (320) may be content generated based on a prompt (470) using a generative AI model.

[0097] According to one embodiment, an electronic device (e.g., electronic device (201) of FIG. 2) may display first content (320) on a display (e.g., display (260) of FIG. 2). When a command to edit the first content (320) is confirmed, the electronic device (201) may display a plurality of icons (340, 342, 344, 346) over the first content (320).

[0098] According to one embodiment, as described in FIG. 3B, the electronic device (201) may obtain a prompt (480) by performing a function provided by a first sub-icon (351) of a first icon (340) among a plurality of icons (340, 342, 344, 346). At this time, the electronic device (201) may obtain the first prompt (480) based on a first text (475) included in a prompt (470) used to generate the first content (320) and a second text (485) based on a user input for a slide bar (360). For example, the electronic device (201) may obtain the first prompt (480) including the first text (475) and the second text (485). For example, the electronic device (201) may include or add text to the first prompt (480) that changes only the portion indicated by the second text (485) while maintaining the image indicated by the first text (475).

[0099] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface, even without the user directly writing a prompt. The electronic device (201) can provide an environment in which the user can intuitively and easily edit a specific object (or element) of the content to be edited by providing an icon displayed on the content to be edited and a sub-icon of the icon.

[0100] FIG. 5 is a flowchart illustrating a method for an electronic device to display icons for editing first content according to one embodiment.

[0101] Referring to FIG. 5, according to one embodiment, in operation 501, an electronic device (e.g., electronic device (201) of FIG. 2) may analyze the first content when a command to edit the first content (320) is confirmed.

[0102] According to an embodiment, in operation 503, the electronic device (201) may identify the prompt used to generate the first content. For example, if the first content was generated using a generative AI model, the electronic device (201) may identify the corresponding prompt. Alternatively, if the first content was not generated using a generative AI model, the electronic device (201) may not identify the corresponding prompt. In this case, the electronic device (201) may analyze the first content using a specified algorithm or AI model and obtain text representing the first content based on the analysis result.

[0103] In one embodiment, when the prompt used to generate the first content is identified (example of 503), in operation 505, the electronic device (201) may identify words indicating a location, place, time, and / or a specific object in the text included in the prompt.

[0104] According to an embodiment, in operation 507, the electronic device (201) may display first icons including icons corresponding to the words. For example, the electronic device (201) may include a specified number or a smaller number of first icons. In this case, icons corresponding to the words may be displayed preferentially. If the number of icons corresponding to the words exceeds the specified number, the electronic device (201) may determine the priority by considering the proportion of the first content and / or the user's editing history, and may display the specified number of icons with higher priorities.

[0105] According to one embodiment, if the prompt used to generate the first content is not confirmed (No of 503), in operation 509, the electronic device (201) can determine the priority of objects included in the first content by considering at least one of the weight of the objects in the first content (e.g., the size of the area occupied by the object in the first content) or the user's editing history.

[0106] According to one embodiment, the electronic device (201) may display a specified number of first icons based on priorities. For example, if the number of icons exceeds the specified number, the electronic device (201) may display the specified number of icons with higher priorities. If the number of icons is less than the specified number, the electronic device (201) may display all identified icons.

[0107] According to the above-described method, the electronic device (201) can provide the user with object editing convenience by displaying icons corresponding to objects with high priority among editable objects included in the first content.

[0108] FIG. 6A is a flowchart illustrating a method for an electronic device to edit a specific object included in a first content, according to one embodiment.

[0109] Referring to FIG. 6A, according to an embodiment, in operation 601, an electronic device (e.g., the electronic device 201 of FIG. 2) may, after a plurality of icons for editing a first content are displayed on a display (e.g., the display 260 of FIG. 2), identify a second object related to a first area included in the first content based on a third user input (e.g., a long press input) that selects a first area of ​​the first content in addition to areas corresponding to the plurality of icons. The electronic device (201) may identify an attribute of the second object. For example, when a specific area is selected without selecting any icon by the user input, the electronic device (201) may perform an operation to edit a second object located in a specific area (or located around a specific area).

[0110] According to one embodiment, in operation 603, the electronic device (201) may identify functions for editing the second object based on properties of the second object.

[0111] According to one embodiment, in operation 605, the electronic device (201) may display a second menu including sub-icons representing functions for editing the second object. For example, the second menu may include sub-icons representing functions for editing the second object. For example, each sub-icon may have a shape and function determined based on properties of the second object. For example, the sub-icons may include sub-icons representing functions based on properties of the second object (e.g., location, size, shape, or type) and sub-icons representing functions unrelated to properties of the second object.

[0112] According to one embodiment, in operation 607, the electronic device (201) may, when a second sub-icon is selected from among the sub-icons for editing the second object, confirm a fourth user input for the control UI provided by the second sub-icon.

[0113] According to one embodiment, in operation 609, the electronic device (201) may, in response to a fourth user input (e.g., a tap input), obtain a third prompt including third text that allows the second object to be changed based on a function corresponding to the second sub-icon. For example, the electronic device (201) may, based on the fourth user input, obtain or generate a third text that allows the second object to be changed based on a function corresponding to the second sub-icon, including at least one of brightness, size, ratio, position, direction, shape, type, color, or number. The electronic device (201) may obtain a third prompt including the third text.

[0114] According to one embodiment, in operation 611, the electronic device (201) may obtain third content in which a second object included in the first content is changed based on a third prompt using a generative AI model. In addition, the electronic device (201) may display the third content on the display (260). Depending on the implementation, the electronic device (201) may continuously change the first content to the third content. For example, the electronic device (201) may continuously change the first content to the third content in response to the third user input being continuously input.

[0115] In the following Figures 6b and 6c, a method for an electronic device (201) to obtain or generate third content by editing first content will be specifically described.

[0116] FIG. 6B is a diagram illustrating a method for an electronic device to edit a specific object included in a first content, according to an embodiment. FIG. 6C is a diagram illustrating a prompt for an electronic device to edit a specific object included in a first content, according to an embodiment.

[0117] Referring to FIG. 6B, according to one embodiment, an electronic device (e.g., electronic device (201) of FIG. 2) may display first content (320) on a display (e.g., display (260) of FIG. 2). According to one embodiment, when a command to edit the first content (320) is confirmed, the electronic device (201) may display a plurality of icons (340, 342, 344, 346) on the first content (320).

[0118] According to one embodiment, the electronic device (201) may identify a third user input (e.g., a long press input) that selects a first area (620) of the first content (320) other than the plurality of icons (340, 342, 344, 346). Based on the third user input, the electronic device (201) may identify a second object (640) (e.g., a subway gate) related to the first area (620) (e.g., at least a portion of which is included in the first area (620). The electronic device (201) may analyze the second object (640) and identify attributes (e.g., type, size, location, and / or color) of the second object (640) based on the analysis result.

[0119] According to one embodiment, the electronic device (201) may display a second menu (650) for editing a second object (640). For example, the second menu (650) may include sub-icons (651, 652, 653, 654, 655, 656, and 657) representing functions for editing the second object (640). For example, the sub-icons may be determined based on the analysis results of the second object (640).

[0120] According to one embodiment, the electronic device (201) may obtain a prompt including text to change at least one of brightness, size, ratio, position, direction, shape, type, color, or number of a second object based on a fourth user input (e.g., a tap input) for a second sub-icon among the sub-icons (651, 652, 653, 654, 655, 656, and 657).

[0121] According to one embodiment, referring to (a) of FIG. 6c, if the second sub-icon is a character change icon (654), the electronic device (201) may obtain a prompt (670) including text for changing characters (e.g., subway exit name) included in the second object to characters input by the second user input. Referring to (b) of FIG. 6c, if the second sub-icon is a size change icon (652), the electronic device (201) may obtain a prompt (680) including text for changing the second object (640) to a size specified by the second user input. Referring to (c) of FIG. 6c, if the second sub-icon is a location change icon (651), the electronic device (201) may obtain a prompt (690) including text for changing the location of the second object (640) to a location specified by the second user input.

[0122] According to one embodiment, the electronic device (201) may obtain and display modified third content based on a prompt (670, 680, or 690) corresponding to the second object included in the first content (320) using a generative AI model.

[0123] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface, even without the user directly writing a prompt. The electronic device (201) can provide an environment in which the user can intuitively and easily edit a specific object (or element) of the content to be edited by providing an icon displayed on the content to be edited and a sub-icon of the icon.

[0124] FIG. 7 is a diagram illustrating a method for an electronic device to display icons over enlarged first content according to one embodiment.

[0125] Referring to FIG. 7, according to one embodiment, an electronic device (e.g., electronic device (201) of FIG. 2) may display first content (320) on a display (e.g., display (260) of FIG. 2). According to one embodiment, when a command to edit the first content (320) is confirmed, the electronic device (201) may display a plurality of icons (340, 342, 344, 346) on the first content (320).

[0126] According to one embodiment, the electronic device (201) may enlarge the first content by a user input and display the enlarged first content (730 or 740). For example, the electronic device (201) may display the enlarged content (730) of the first content based on a first area of ​​the first content (320). At this time, the electronic device (201) may identify objects included in the enlarged content (730) and display icons (732, 734, 736) corresponding to the identified objects. For example, the electronic device (201) may display the enlarged content (740) of the first content based on a second area different from the first area of ​​the first content (320). At this time, the electronic device (201) can check the objects included in the enlarged content (740) and display icons (742, 744) corresponding to the checked objects.

[0127] In another embodiment, according to one embodiment, the electronic device (201) may reduce the first content according to a user input and display the reduced first content. The electronic device (201) may also identify objects included in the reduced first content and display icons corresponding to the identified objects.

[0128] According to the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface when enlarging or reducing the content.

[0129] FIG. 8 is a diagram illustrating a method for an electronic device to edit a specific object included in a first content according to one embodiment.

[0130] Referring to FIG. 8, according to an embodiment, an electronic device (e.g., the electronic device (201) of FIG. 2) may display first content (320) on a display (e.g., the display (260) of FIG. 2). When a command to edit the first content (320) is confirmed, the electronic device (201) may display a plurality of icons (340, 342, 344, 346) on the first content (320). The plurality of icons (340, 342, 344, 346) may be set to a shape (e.g., a sun shape, a cloud shape, or a building shape) representing a corresponding object (e.g., a sun, a cloud, or a building) on ​​a corresponding object among objects included in the first content (320).

[0131] According to one embodiment, the electronic device (201) may display a first menu (350) including sub-icons (351, 352, 353, 354, 355, 356, 357) corresponding to the first icon (340) based on a first user input (e.g., a tap input) that selects the first icon (340) (e.g., a sun icon). For example, the sub-icons (351, 352, 353, 354, 355, 356, 357) may each represent a function for adjusting the amount (or brightness) of sunlight, a function for adjusting the color of sunlight, a function for adjusting the position of the sun, a function for adjusting the ratio of the sun, a function for entering a command to be added to a prompt by voice, a function for entering a command to be added to a prompt by text, and a function for entering a command to be added to a prompt by handwriting.

[0132] According to one embodiment, the electronic device (201) may perform a function of inputting text to be added to a prompt based on a second user input (e.g., a tap input) for a control UI provided by a first sub-icon (356). The electronic device (201) may display information (840) about the corresponding text based on the user's text input. In response to the user input for the information (840), the electronic device (201) may display an image (850) representing the corresponding text as a preview function. In response to the user input for the image (850), the electronic device (201) may provide a prompt (870) reflecting the corresponding text to a generative AI model to obtain and display the second content (830). For example, the electronic device (201) may obtain the second content based on a prompt including the corresponding text even if the user's text input is not related to the first object.

[0133] Meanwhile, according to one embodiment, the electronic device (201) may perform an operation of editing the corresponding object (e.g., a cloud) based on a first user input (e.g., a tap input) selecting a second icon (342) (e.g., a cloud icon). Specific operations for this will be described in FIGS. 9a, 9b, and 9c below.

[0134] FIGS. 9A, 9B, and 9C are drawings illustrating a method for an electronic device to obtain a prompt for editing a first object by adjusting a slide bar according to various embodiments.

[0135] Referring to FIGS. 9a, 9b, and 9c, according to one embodiment, an electronic device (e.g., the electronic device 201 of FIG. 2 ) may display a menu (910, 920, or 930) for editing an object (e.g., a cloud) included in a first content. The electronic device (201) may display the menu (910, 920, or 930) for editing the object in response to a first user input selecting an icon (e.g., the icon (342) of FIG. 3b ) representing the object (e.g., a cloud). The electronic device (201) may obtain a prompt (950, 960, or 970) for changing the object based on a second user input for a control UI provided by one of the sub-icons included in the menu (910, 920, or 930).

[0136] Referring to FIG. 9A, according to an embodiment, the electronic device (201) may verify a second user input for a slide bar provided by a function (e.g., a function for adjusting the amount of clouds) indicated by a first sub-icon (911). The electronic device (201) may verify a parameter value (e.g., increase the amount of clouds by 8 times) indicated by the second user input, and obtain a first prompt (950) including text (e.g., change the amount of clouds to 8 times more than the current amount) based on the verified parameter value. For example, the electronic device (201) may obtain the first prompt (950) by adding text based on the verified parameter value to a second prompt (940) indicating the first content (e.g., a prompt used to generate the first content).

[0137] Referring to FIG. 9A, according to an embodiment, the electronic device (201) may verify a second user input for a slide bar provided by a function (e.g., a function of changing a cloud into a specific type of cloud) indicated by a second sub-icon (921). The electronic device (201) may verify a parameter value (e.g., changing a cloud into a specific type) indicated by the second user input, and obtain a first prompt (960) including text (e.g., changing a cloud into a cumulus cloud) based on the verified parameter value. For example, the electronic device (201) may obtain the first prompt (960) by adding text based on the verified parameter value to a second prompt (940) indicating a first content (e.g., a prompt used to generate the first content).

[0138] Referring to FIG. 9C , according to an embodiment, the electronic device (201) may verify a second user input for a slide bar provided by a function (e.g., a function of adjusting the amount of precipitation in clouds) indicated by a first sub-icon (931). The electronic device (201) may verify a parameter value (e.g., adjusting the amount of precipitation to a specific amount) indicated by the second user input, and obtain a first prompt (970) including text based on the verified parameter value (e.g., changing the amount of precipitation to 250 mm per hour). For example, the electronic device (201) may obtain the first prompt (970) by adding text based on the verified parameter value to a second prompt (940) indicating the first content (e.g., a prompt used to generate the first content).

[0139] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface, even without the user directly writing a prompt. The electronic device (201) can provide an environment in which the user can intuitively and easily edit a specific object (or element) of the content to be edited by providing an icon displayed on the content to be edited and a sub-icon of the icon.

[0140] FIGS. 10A, 10B, 10C, and 10D are drawings illustrating a method for an electronic device to obtain a prompt for editing at least one object included in a first content, according to various embodiments.

[0141] Referring to FIGS. 10a, 10b, 10c, and 10d, according to one embodiment, an electronic device (e.g., electronic device (201) of FIG. 2) may display a menu (1010, 1020, 1030, or 1040) for editing an object (e.g., a seagull) included in a first content (1015, 1025, 1035, or 1045). The electronic device (201) may display the menu (1010, 1020, 1030, or 1040) for editing the object (e.g., a seagull) displayed on the first content (1015, 1025, 1035, or 1045) in response to a first user input selecting an icon representing the object (e.g., a seagull). The electronic device (201) may obtain a prompt (1060, 1070, 1080, or 1090) to change the object based on a second user input to a control UI provided by any one of the sub-icons included in the menu (1010, 1020, 1030, or 1040).

[0142] Referring to FIG. 10A, according to an embodiment, the electronic device (201) may identify a second user input (e.g., a tap input or a drag input) for a slide bar provided by a function (e.g., a function of adjusting the number of seagulls) indicated by a first sub-icon (1011). The electronic device (201) may identify a parameter value (e.g., add 32 seagulls) indicated by the second user input, and obtain a first prompt (1060) including text (e.g., add 32 more birds) based on the identified parameter value. For example, the electronic device (201) may obtain the first prompt (1060) by adding text based on the identified parameter value to a second prompt (1050) indicating the first content (e.g., a prompt used to generate the first content). The electronic device (201) can obtain and display second content (1016) in which the number of seagulls included in the first content (1015) is changed (e.g., 32 more seagulls are added) based on the first prompt (1060) using a generative AI model.

[0143] Referring to FIG. 10B, according to an embodiment, the electronic device (201) may confirm a second user input (e.g., a drag input designating an area) for a function (e.g., a function of intensively placing seagulls on a specific area) indicated by a second sub-icon (1021). The electronic device (201) may confirm parameter values ​​(e.g., position values ​​indicating a corresponding area (or path)) indicated by the second user input, and obtain a first prompt (1070) including text (e.g., intensively placing seagulls on a path of a drag input (or pen drawing input)) based on the confirmed parameter values. For example, the electronic device (201) may obtain the first prompt (1070) by adding text based on the confirmed parameter values ​​to a second prompt (1050) indicating first content (e.g., a prompt used to generate the first content). The electronic device (201) can obtain and display second content (1026) in which the arrangement of seagulls included in the first content (1025) is changed based on the first prompt (1060) (e.g., seagulls are concentrated on the path of the drag input) using a generative AI model.

[0144] Referring to FIG. 10C, according to an embodiment, the electronic device (201) may confirm a second user input (e.g., a tap input) for a function (e.g., a function of changing the position of a specific seagull) indicated by a third sub-icon (1031). The electronic device (201) may confirm a parameter value (e.g., a position value indicating a specific position) indicated by the second user input, and obtain a first prompt (1080) including text (e.g., moving the position of the selected seagull to a specific position) based on the confirmed parameter value. For example, the electronic device (201) may obtain the first prompt (1080) by adding text based on the confirmed parameter value to a second prompt (1050) indicating the first content (e.g., a prompt used to generate the first content). The electronic device (201) can obtain and display second content (1036) in which the position of the selected seagull included in the first content (1035) is changed based on the first prompt (1060) using a generative AI model.

[0145] Referring to FIG. 10D , according to an embodiment, the electronic device (201) may confirm a second user input (e.g., a tap input or a drag input) for a slide bar provided by a function (e.g., a function of changing the type of bird) indicated by the fourth sub-icon (1041). The electronic device (201) may confirm a parameter value indicated by the second user input (e.g., changing the type of bird to an owl) and obtain a first prompt (1090) including text based on the confirmed parameter value (e.g., changing a seagull to an owl). For example, the electronic device (201) may obtain the first prompt (1090) by adding text based on the confirmed parameter value to a second prompt (1050) indicating the first content (e.g., a prompt used to generate the first content). The electronic device (201) can obtain and display second content in which seagulls included in the first content are changed into owls based on the first prompt (1060) using a generative AI model.

[0146] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface even without the user directly writing a prompt.

[0147] FIGS. 11a, 11b, and 11c are drawings illustrating a method for an electronic device to edit first content according to various embodiments.

[0148] Referring to FIGS. 11A and 11B , according to an embodiment, an electronic device (e.g., the electronic device 201 of FIG. 2 ) may display a first screen (1110) including a drawing (1115) according to a user input. When a user input (e.g., a tap input) for an object (1117) included in the first screen (1110) is confirmed, the electronic device (201) may convert (or change) the drawing (1115) into a cat image using a generative AI model. For example, the object (1117) may be an object requesting conversion of a drawing image into an actual image. The electronic device (201) may display a second screen (1120) including a cat image.

[0149] Referring to FIG. 11A, according to one embodiment, when a command to edit a cat image is confirmed, the electronic device (201) may analyze the cat image. The electronic device (201) may identify an object (1125) (e.g., a cat ribbon) that can be changed in the cat image, and display an icon (1130) (e.g., a palette icon) over the object (1125). When the electronic device (201) confirms a first user input (e.g., a tap input) for the icon (1130), the electronic device (201) may display a third screen (1130) including a menu (1135) including sub-icons (e.g., sub-icons representing multiple colors) over the cat image. When any one of the sub-icons is selected, the electronic device (201) may change the color of the object (1125) to a color corresponding to the sub-icon using a generative AI model. The electronic device (201) may display a fourth screen (1140) including an object (1145) whose color has been changed to a color corresponding to a sub-icon of the object (1125). Depending on the implementation, as the color of the object (1145) changes, an icon (1150) (e.g., a palette icon) for changing the color of another element (e.g., background) may be displayed on the other element (e.g., background). Thereafter, based on a user's selection, the electronic device (201) may further perform an operation of changing the color of the other element (e.g., background).

[0150] Referring to FIG. 11B, according to one embodiment, the electronic device (201) may change a specific object of content using a stylus pen. When a command to edit a cat image is confirmed, the electronic device (201) may analyze the cat image. The electronic device (201) may identify an object (1126) (e.g., a cat) that can be changed in the cat image, and display an icon (1127) (e.g., a palette icon) over the object (1126). When the electronic device (201) confirms a first user input (e.g., a tap input by a stylus pen) for the icon (1127), the electronic device (201) may display a third screen (1130) including a menu (1136) including sub-icons (e.g., sub-icons representing multiple colors) over the cat. The electronic device (201) may display a slide bar that changes the color of the corresponding object (1126) using a generative AI model when any one of the sub-icons is selected. The electronic device (201) may select the corresponding color based on a user input (e.g., input using a stylus pen) to the slide bar. The electronic device (201) may display a fourth screen (1150) that includes an object (1146) in which the color of the corresponding object (1126) has been changed to the selected color.

[0151] Referring to FIG. 11C, according to one embodiment, the fourth screen (1140) may include an object (1150) for inputting a drawing on an included image. For example, the electronic device (201) may input a drawing (e.g., a heart-shaped drawing) on ​​the fourth screen (1140) based on a user input of selecting an object (1160) included in the fourth screen (1140). For example, in response to the input of the drawing (e.g., a heart-shaped drawing), the electronic device (201) may display a fifth screen (1160) on which the drawing (e.g., a heart-shaped drawing) is displayed on an object (1146) (e.g., a cat ribbon).

[0152] According to one embodiment, the electronic device (201) may analyze a drawing (e.g., a heart-shaped drawing) and an object (1146). Based on the analysis result, the electronic device (201) may identify a function for editing the drawing (e.g., a heart-shaped drawing) and the object (1146). Based on the identified function, the electronic device (201) may display a sixth screen (1170) that further displays editing objects (1171, 1172, 1173).

[0153] According to one embodiment, the electronic device (201) may obtain or generate a prompt based on at least one selected edit object (e.g., 1171 and 1172) among the edit objects (1171, 1172, and 1173). For example, the edit objects (1171, 1172, and 1173) may include information (e.g., text, image) that causes the object (1146) to be edited. For example, each edit object (1171, 1172, or 1173) may include text indicating “heart pattern,” “light green,” or “stripes.” For example, the electronic device (201) may obtain or generate a prompt that causes the object (1146) to be transformed into “heart pattern” and “light green” based on the at least one selected edit object (e.g., 1171 and 1172).

[0154] According to one embodiment, the electronic device (201) may display an object (1180) for image reproduction on the fourth screen (1140) based on displaying editing objects (1171, 1172, 1173). The electronic device (201) may provide a prompt obtained based on a user input for the object (1180) for image reproduction to the generative AI model. Depending on the implementation, the prompt may be obtained or generated when a user input for the object (1180) for image reproduction is confirmed.

[0155] According to one embodiment, the electronic device (201) may obtain a regenerated image (e.g., an image of a transformed cat ribbon object) using a generative AI model. For example, the electronic device (201) may obtain a modified object (1195) based on a prompt that generated the shape or pattern of the object (1146). The electronic device (201) may display a seventh screen (1190) including the object (1195).

[0156] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of the content to be edited using a generative AI model through a user interface that supports various input means even if the user does not directly write a prompt.

[0157] FIG. 12 is a diagram illustrating a method for an electronic device to edit a phonetic element included in a first content according to one embodiment.

[0158] Referring to FIG. 12, according to an embodiment, an electronic device (e.g., the electronic device 201 of FIG. 2) may analyze the content (1201) when a command to edit the content (1201) is confirmed. For example, the content (1201) may be a still image or a video. The electronic device (201) may confirm the properties (e.g., type, location, color) of objects included in the content (1201). Based on the confirmed properties, the electronic device (201) may confirm whether the objects include elements that can be changed audibly in addition to visual elements. For example, if the object is confirmed as a person, the electronic device (201) may confirm or determine that the voice of the object can be changed. Alternatively, if the object is confirmed as a background, the electronic device (201) may confirm or determine that sound can be applied to the object.

[0159] According to one embodiment, the electronic device (201) may display icons (1210, 1220, 1230, and 1240) for editing voice or sound on objects included in the content (1201). The positions and shapes of the corresponding icons (1210, 1220, 1230, and 1240) may be determined based on the analysis results of the corresponding objects. For example, when a user input for selecting any one of the corresponding icons (1210, 1220, 1230, and 1240) is confirmed, the electronic device (201) may perform an operation of changing or adding the voice or sound of the corresponding object using a generative AI model. For example, when a user input for the first icon (1210) is confirmed, the electronic device (201) may perform an operation of changing the voice of the corresponding object (e.g., a person) using a generative AI model. Alternatively, the electronic device (201) may perform an action of adding sound to a corresponding element (e.g., background) using a generative AI model when a user input for the third icon (1230) is confirmed. In this regard, the method of generating a prompt or the method of changing or adding a voice or sound may be performed in the same or similar manner as the methods described in FIGS. 2 through 11b.

[0160] Through the above-described method, the electronic device (201) can provide a method for simply editing at least one object (or element) of various types of content using a generative AI model, even without the user directly writing a prompt.

[0161] Meanwhile, the shapes, types, and / or functions of the icons and sub-icons of this specification are exemplary, and the technical concept of the present invention may not be limited thereto. For example, the electronic device (201) of the present invention may provide icons and sub-icons of various shapes, types, and / or functions in addition to the icons and sub-icons described above.

[0162] The artificial intelligence system described below can be applied identically or similarly to the generative AI model described above.

[0163] Fig. 13 is a diagram for explaining a generative artificial intelligence system according to one embodiment.

[0164] According to one embodiment, a user query / response interface (1310) may receive a user's input. The user's input may be in the form of natural language, images, and / or videos, but is not limited thereto. Furthermore, context information may also be transmitted when the user's input is transmitted. The context information may include various additional information at the time of the user's input. For example, the additional information may include information about the application currently being used by the user or information about the user's location. Furthermore, the user's input may be in a form that combines the aforementioned natural language, images, sounds, and context information. Furthermore, the user's input may also be in a non-natural language form, such as selecting a menu. The user query / response interface (1310) may output the results of a generative artificial intelligence system to the user. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user. The user query / response interface (1310) may output the results of a generative artificial intelligence system to the user. The output can be in natural language form, in the form of specific content, or in the form of actions requested by the user.

[0165] The AI ​​framework (1340) can receive user input and coordinate and control each component necessary to perform the user's intention based on the user's query.

[0166] User input received from the user query / response interface (1310) can be transmitted to a prompt design component (1341). The prompt design component (1341) can be used to generate prompts suitable for inputting user input into a large language model (LLM) or a large multimodal model (LMM). The prompt design component (1341) can be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design component (1341) can access a knowledge component including user preference data, a prompt library, and prompt examples based on the user input to generate prompts, and transmit the generated prompts to the LLM or LMM.

[0167] The API / Plug-in management component (1342) can communicate with external information when there is a request for additional information when passing user input as input to the generative model. The API / Plug-in management component (1342) can establish a channel for communicating with the outside of the AI ​​Interface through the API, and can enable access to various data sources (e.g., knowledge storage (1320)) through the established channel. In addition, the API / Plug-in management component (1342) can request the application / service component (1330) through the API for an action that ultimately performs the user input, rather than an intermediate result, when the application or service needs to perform the action. Information obtained from the outside can be used to generate a prompt in the prompt design component (1341) together with the user input, or can be passed as an input to the generative model.

[0168] The output modification component (also called a refiner component) (1343) can fine-tune the output from the generative model. For example, the output modification component (1343) can verify that the content generated through the LLM and / or LMM is not irrelevant, does not contain biased content, or does not contain harmful content. In addition, the output modification component (1343) can determine to what extent it matches the result desired by the user and, if additional processing is necessary, can proceed with the process. The output modification component (1343) can additionally configure and provide the user with hints to avoid unwanted output.

[0169] A generative AI model (1360) can generally refer to an artificial intelligence neural network that creates new types of data based on user input information. The generative AI model (1360) can include an image-generating model and / or a language-generating model. Representative models for generating images include a generative adversarial network (GAN) and a variational auto encoder (VAE), and examples include a VAE and a Diffusion-based generative model that uses a Transformer structure. A language-generating model is a model trained to statistically output the most appropriate output based on input values, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. In addition, there are also LMMs (large multimodal models) that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them.

[0170] According to one embodiment, an electronic device may include a display, at least one processor, and a memory storing instructions. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify objects included in first content displayed on the display based on a confirmation of a command to edit the first content. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify functions for editing a corresponding object among the objects based on properties of the objects. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display a plurality of icons for editing the objects on the first content, wherein a shape of each of the plurality of icons may be determined based on properties of the corresponding object and the functions for editing the corresponding object. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display a first menu for editing a first object corresponding to a first icon based on a first user input for selecting a first icon from among the plurality of icons, wherein the first menu may include sub-icons representing functions for editing the first object based on properties of the first object. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to confirm a second user input with respect to a control UI (user interface) provided by the first sub-icon when a first sub-icon from among the sub-icons is selected.According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to, in response to the second user input, display second content in which the first object included in the first content is changed based on a function corresponding to the first sub-icon.

[0171] In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to obtain a first prompt including a first text that causes the first object to be changed based on the function corresponding to the first sub-icon. In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display, using a generative AI model, the second content in which the first object included in the first content is changed based on the first prompt.

[0172] According to one embodiment, when the first content is obtained based on the second prompt through the generative AI model, the first prompt may be obtained based on the first text and the second text included in the second prompt.

[0173] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify at least one word representing a location, a place, a time, or a specific object among the second text included in the second prompt. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display the plurality of icons, including at least one icon corresponding to the at least one object, based on identifying at least one object corresponding to the at least one word included in the first content.

[0174] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to determine priorities of objects included in the first content by considering at least one of a proportion of the first content or an editing history of the user. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display a specified number of the plurality of icons based on the priorities.

[0175] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify a second object related to the first area included in the first content based on a third user input selecting a first area of ​​the first content other than areas corresponding to the plurality of icons. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify functions for editing the second object based on properties of the second object. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display a second menu for editing the second object, wherein the second menu may include sub-icons representing functions for editing the second object based on properties of the second object. In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to, when a second sub-icon is selected from among the sub-icons for editing the second object, confirm a fourth user input for a control UI (user interface) provided by the second sub-icon. In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to, in response to the fourth user input, obtain a third prompt including third text that causes the second object to be changed based on a function corresponding to the second sub-icon. In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to, using the generative AI model, display third content in which the second object included in the first content is changed based on the third prompt.

[0176] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to determine a parameter value indicating a type of change in the first object and a degree to which the first object is changed, based on at least one of an input direction, a movement distance, or a movement position of the second user input with respect to a slide bar provided by the first sub-icon. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to obtain the first text based on the parameter value.

[0177] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to analyze the first content using an artificial intelligence model based on the confirmation of the command to edit the content. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to identify objects included in the first content based on the analysis result.

[0178] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to obtain text or voice corresponding to the second user input when a text input icon or voice input icon included in the first menu is selected. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to obtain the first text based on the text or the voice.

[0179] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to, when the first content is enlarged based on an area of ​​the first content, identify at least one object included in the enlarged first content. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display at least one icon for editing the at least one object on the enlarged first content.

[0180] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to check the properties of each of the objects included in the first content. According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to display an icon for editing the voice or sound of a specific object among the objects on the first content based on the properties.

[0181] According to one embodiment, a method of operating an electronic device may include an operation of confirming objects included in a first content based on a command for editing the first content displayed on a display included in the electronic device. According to one embodiment, the method of operating the electronic device may include an operation of confirming functions for editing a corresponding object among the objects based on properties of the objects. According to one embodiment, the method of operating the electronic device may include an operation of displaying a plurality of icons for editing the objects on the first content, wherein a shape of each of the plurality of icons may be determined based on a property of the corresponding object and the functions for editing the corresponding object. According to one embodiment, the method of operating the electronic device may include an operation of displaying a first menu for editing a first object corresponding to the first icon based on a first user input for selecting a first icon among the plurality of icons, wherein the first menu may include sub-icons representing functions for editing the first object based on properties of the first object. According to one embodiment, the method of operating the electronic device may include an operation of confirming a second user input for a control UI (user interface) provided by the first sub-icon when a first sub-icon among the sub-icons is selected. According to one embodiment, the method of operating the electronic device may include an operation of displaying second content in which the first object included in the first content is changed based on a function corresponding to the first sub-icon, in response to the second user input.

[0182] According to one embodiment, the method of operating the electronic device may include an operation of obtaining a first prompt including a first text that causes the first object to be changed based on the function corresponding to the first sub-icon. According to one embodiment, the method of operating the electronic device may include an operation of displaying the second content in which the first object included in the first content is changed based on the first prompt, using a generative AI model.

[0183] According to one embodiment, when the first content is obtained based on the second prompt through the generative AI model, the first prompt may be obtained based on the first text and the second text included in the second prompt.

[0184] According to one embodiment, the operation of displaying the plurality of icons may include an operation of identifying at least one word representing a location, a place, a time, or a specific object among the second text included in the second prompt. According to one embodiment, the operation of displaying the plurality of icons may include an operation of displaying the plurality of icons including at least one icon corresponding to at least one object based on identifying at least one object corresponding to the at least one word included in the first content.

[0185] According to one embodiment, the operation of displaying the plurality of icons may include an operation of determining the priority of objects included in the first content by considering at least one of the proportion of the objects in the first content or the user's editing history. According to one embodiment, the operation of displaying the plurality of icons may display a specified number of the plurality of icons based on the priority.

[0186] According to one embodiment, the operating method of the electronic device may further include an operation of confirming a second object related to the first area included in the first content based on a third user input of selecting a first area of ​​the first content in addition to areas corresponding to the plurality of icons. According to one embodiment, the operating method of the electronic device may further include an operation of confirming functions for editing the second object based on properties of the second object. According to one embodiment, the operating method of the electronic device may further include an operation of displaying a second menu for editing the second object, wherein the second menu may include sub-icons representing functions for editing the second object based on properties of the second object. According to one embodiment, the operating method of the electronic device may further include an operation of confirming a fourth user input for a control UI (user interface) provided by a second sub-icon when a second sub-icon among the sub-icons for editing the second object is selected. According to one embodiment, the method of operating the electronic device may further include an operation of obtaining, in response to the fourth user input, a third prompt including third text that causes the second object to be changed based on a function corresponding to the second sub-icon. According to one embodiment, the method of operating the electronic device may further include an operation of using the generative AI model to display third content in which the second object included in the first content is changed based on the third prompt.

[0187] In one embodiment, the operation of obtaining the first prompt may include an operation of checking a parameter value indicating a type of change in the first object and a degree to which the first object is changed, based on at least one of an input direction, a movement distance, or a movement position of the second user input for a slide bar provided by the first sub-icon. In one embodiment, the operation of obtaining the first prompt may include an operation of obtaining the first text based on the parameter value.

[0188] In one embodiment, the action of obtaining the first prompt may include an action of obtaining text or voice corresponding to the second user input when a text input icon or voice input icon included in the first menu is selected. In one embodiment, the action of obtaining the first prompt may include an action of obtaining the first text based on the text or voice.

[0189] According to one embodiment, the method of operating the electronic device may further include an operation of confirming at least one object included in the enlarged first content when the first content is enlarged based on an area of ​​the first content. According to one embodiment, the method of operating the electronic device may further include an operation of displaying at least one icon for editing the at least one object on the enlarged first content.

[0190] According to one embodiment, the method of operating the electronic device may further include an operation of checking the properties of each of the objects included in the first content. According to one embodiment, the method of operating the electronic device may further include an operation of displaying an icon for editing the voice or sound of a specific object among the objects on the first content based on the properties.

[0191] According to one embodiment, in a non-transitory recording medium (130, 230) storing computer-readable instructions, the instructions, when collectively or individually executed by at least one processor, cause an electronic device (201) to, based on a command to edit a first content displayed on a display (260) included in the electronic device, identify objects included in the first content, identify functions for editing a corresponding object among the objects based on properties of the objects, and display a plurality of icons for editing the objects on the first content, wherein a shape of each of the plurality of icons is determined based on a property of the corresponding object and the functions for editing the corresponding object, and display a first menu for editing a first object corresponding to the first icon based on a first user input for selecting a first icon among the plurality of icons, wherein the first menu includes sub-icons representing functions for editing the first object based on properties of the first object, and among the sub-icons, When the first sub-icon is selected, a second user input for a control UI (user interface) provided by the first sub-icon is confirmed, and in response to the second user input, the first object included in the first content can be caused to display the changed second content based on a function corresponding to the first sub-icon.

[0192] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0193] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0194] Various embodiments of the present document may be implemented as software (e.g., a program) including one or more instructions stored in a storage medium (e.g., built-in memory or external memory) readable by a machine (e.g., an electronic device). For example, a processor (e.g., a processor) of the machine (e.g., an electronic device) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.

[0195] According to one embodiment, the method according to various embodiments of the present disclosure may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0196] According to embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In the electronic device (201), display (260); At least one processor (220); and A memory (230) for storing instructions, wherein the instructions, when executed by the at least one processor, cause the electronic device to: Based on confirming a command to edit the first content displayed on the above display, objects included in the first content are confirmed, Based on the properties of the above objects, check the functions for editing the corresponding object among the above objects, A plurality of icons for editing the objects are displayed on the first content, wherein the shape of each of the plurality of icons is determined based on the properties of the corresponding object and the functions for editing the corresponding object, Based on a first user input selecting a first icon from among the plurality of icons, a first menu for editing a first object corresponding to the first icon is displayed, wherein the first menu includes sub-icons representing functions for editing the first object based on properties of the first object, When the first sub-icon among the above sub-icons is selected, a second user input for the control UI (user interface) provided by the first sub-icon is confirmed, An electronic device that, in response to the second user input, displays second content in which the first object included in the first content is changed based on a function corresponding to the first sub-icon.

2. In the first paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: Obtain a first prompt including a first text that causes the first object to be changed based on the function corresponding to the first sub-icon; An electronic device that uses a generative AI model to display the second content in which the first object included in the first content is changed based on the first prompt.

3. In any one of paragraphs 1 and 2, An electronic device wherein the first content is obtained based on a second prompt through the generative AI model, and the first prompt is obtained based on the first text and the second text included in the second prompt.

4. In any one of paragraphs 1 to 3, the instructions, when executed by the at least one processor, cause the electronic device to: Identify at least one word among the second text included in the second prompt that indicates a location, place, time, or specific object, An electronic device that displays a plurality of icons including at least one icon corresponding to the at least one object based on identifying at least one object corresponding to the at least one word included in the first content.

5. In any one of paragraphs 1 to 4, the instructions, when executed by the at least one processor, cause the electronic device to: By considering at least one of the proportion in the first content or the user's editing history, the priority of the objects included in the first content is determined, An electronic device that displays a specified number of said plurality of icons based on the above priorities.

6. In any one of paragraphs 1 to 5, the instructions, when executed by the at least one processor, cause the electronic device to: Based on a third user input selecting a first area of ​​the first content other than areas corresponding to the plurality of icons, a second object related to the first area included in the first content is identified, Based on the properties of the second object, functions for editing the second object are identified, Displaying a second menu for editing the second object, wherein the second menu includes sub-icons representing functions for editing the second object based on properties of the second object, When a second sub-icon among the sub-icons for editing the second object is selected, a fourth user input for the control UI (user interface) provided by the second sub-icon is confirmed, In response to the fourth user input, obtain a third prompt including a third text that causes the second object to be changed based on a function corresponding to the second sub-icon; An electronic device that uses the generative AI model to display third content that has been changed based on the third prompt by the second object included in the first content.

7. In any one of paragraphs 1 to 6, the instructions, when executed by the at least one processor, cause the electronic device to: Based on at least one of the input direction, movement distance, or movement position of the second user input for the slide bar provided by the first sub-icon, a parameter value indicating the type of change of the first object and the degree to which the first object is changed is checked, An electronic device that obtains the first text based on the above parameter values.

8. In any one of paragraphs 1 to 7, the instructions, when executed by the at least one processor, cause the electronic device to: Based on the confirmation of the command to edit the first content, the first content is analyzed using an artificial intelligence model, An electronic device that identifies the objects included in the first content based on the analysis results.

9. In any one of paragraphs 1 to 8, the instructions, when executed by the at least one processor, cause the electronic device to: When a text input icon or voice input icon included in the first menu is selected, text or voice corresponding to the second user input is obtained, An electronic device that obtains the first text based on the text or the voice.

10. In any one of paragraphs 1 to 9, the instructions, when executed by the at least one processor, cause the electronic device to: When the first content is enlarged based on an area of ​​the first content, at least one object included in the enlarged first content is confirmed, An electronic device that displays at least one icon for editing at least one object on the enlarged first content.

11. In any one of paragraphs 1 to 10, the instructions, when executed by the at least one processor, cause the electronic device to: Check the properties of each of the objects included in the first content, An electronic device that displays an icon for editing the voice or sound of a specific object among the objects on the first content based on the above properties.

12. In the operating method of the electronic device (201), An operation of confirming objects included in the first content based on confirming a command to edit the first content displayed on a display (260) included in the electronic device; An action to check functions for editing a corresponding object among the objects based on the properties of the objects; An action of displaying a plurality of icons for editing the objects on the first content, wherein the shape of each of the plurality of icons is determined based on the properties of the corresponding object and the functions for editing the corresponding object; An action of displaying a first menu for editing a first object corresponding to the first icon based on a first user input selecting a first icon from among the plurality of icons, wherein the first menu includes sub-icons representing functions for editing the first object based on properties of the first object; When a first sub-icon among the above sub-icons is selected, an operation of confirming a second user input for a control UI (user interface) provided by the first sub-icon; and A method of operating an electronic device, comprising: in response to the second user input, displaying second content in which the first object included in the first content is changed based on a function corresponding to the first sub-icon.

13. In the 12th paragraph, the action of displaying the second content is: An operation of obtaining a first prompt including a first text that causes the first object to be changed based on the function corresponding to the first sub-icon; and A method of operating an electronic device, comprising: using a generative AI model, the first object included in the first content displays second content that has been changed based on the first prompt.

14. In any one of paragraphs 12 to 13, An operating method of an electronic device, wherein the first content is obtained based on a second prompt through the generative AI model, and the first prompt is obtained based on the first text and the second text included in the second prompt.

15. In a non-transitory recording medium (230) storing computer-readable instructions, when the instructions are collectively or individually executed by at least one processor, the electronic device (201) Based on confirming a command to edit the first content displayed on the display (260) included in the electronic device, objects included in the first content are confirmed, Based on the properties of the above objects, check the functions for editing the corresponding object among the above objects, A plurality of icons for editing the objects are displayed on the first content, wherein the shape of each of the plurality of icons is determined based on the properties of the corresponding object and the functions for editing the corresponding object, Based on a first user input selecting a first icon from among the plurality of icons, a first menu for editing a first object corresponding to the first icon is displayed, wherein the first menu includes sub-icons representing functions for editing the first object based on properties of the first object, When the first sub-icon among the above sub-icons is selected, a second user input for the control UI (user interface) provided by the first sub-icon is confirmed, and A recording medium that displays second content in which the first object included in the first content is transformed based on a function corresponding to the first sub-icon in response to the second user input.

Images