Electronic device, content display method therefor, and recording medium therefor

Abstract

An electronic device according to one embodiment may comprise: a touch screen display; a processor; and a memory for storing instructions that can be executed by the processor, wherein the instructions enable the electronic device to: check, from among pieces of content stored in the memory, first artificial intelligence (AI) content in which content is partially generated on the basis of AI; display the first AI content in a first area of the touch screen display on the basis of a request for the display of the first AI content; display thumbnails corresponding to the pieces of content in a second area of the touch screen display; and display an AI indicator for indicating that a partially generated AI object is included in at least one first thumbnail corresponding to the first AI content from among the thumbnails in the second area.

Description

Electronic device and method for displaying contents thereof, and recording medium thereof

[0001] Various embodiments of the present invention relate to an electronic device, a method for displaying content thereof, and a recording medium thereof.

[0002] Artificial intelligence (AI) technology is rapidly developing. In particular, generative AI is rapidly growing alongside this advancement. Generative AI refers to AI technology that utilizes machine learning and deep learning to generate similar content based on existing content, such as text, audio, and / or images. For example, generative AI can generate new content based on previously learned data, and can also be applied to actions such as improving image quality or editing videos.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0004] Meanwhile, AI content (e.g., images, videos) generated based on generative AI may produce results partially generated by AI, rather than entirely. For example, at least partially generated AI content may include data that includes both original data and AI-generated portions.

[0005] Electronic devices are displaying (e.g., embedding) AI watermarks within portions of AI content (e.g., partial AI content) to indicate that the content is AI-generated, at least in part. However, while AI watermarks can only help users identify which content is AI-generated by comparing it to other content, it can be difficult to determine which portions of the AI ​​content were generated or edited by AI.

[0006] Various embodiments propose a method, device and recording medium for displaying partial AI content through thumbnail images (e.g., film strip, thumbnail list) corresponding to the content when displaying AI content generated based on generative AI (e.g., generative AI) on a display (or touchscreen display).

[0007] The problem to be solved in this disclosure is not limited to the problem mentioned above, and may be expanded in various ways without departing from the spirit and scope of this disclosure.

[0008] An electronic device according to one embodiment may include a touchscreen display. The electronic device according to one embodiment may include a processor. The electronic device according to one embodiment may include a memory that stores instructions executable by the processor. The instructions according to one embodiment may cause the electronic device to receive a user input for displaying at least one AI content including at least one AI object through the touchscreen display. The instructions according to one embodiment may cause the electronic device to display the at least one AI content on a first area of ​​the touchscreen display and to display thumbnail images corresponding to the at least one AI content on a second area of ​​the touchscreen display based on the user input. The instructions according to one embodiment may cause the electronic device to display an indicator indicating the at least one AI object on at least one thumbnail image. The at least one AI content according to one embodiment may be characterized in that it is stored in the memory.

[0009] A method for displaying content on an electronic device according to one embodiment may include receiving a user input for displaying at least one AI content including at least one AI object through a touchscreen display. The method according to one embodiment may include displaying the at least one AI content on a first area of ​​the touchscreen display and displaying thumbnail images corresponding to the at least one AI content on a second area of ​​the touchscreen display based on the user input. The method according to one embodiment may include displaying an indicator indicating the at least one AI object on at least one thumbnail image.

[0010] A non-transitory computer-readable medium storing instructions according to one embodiment may include instructions that, when executed by a processor of an electronic device, cause the electronic device to perform an operation of receiving a user input for displaying at least one AI content including at least one AI object through a touchscreen display. The computer-readable medium according to one embodiment may include instructions that, based on the user input, cause the electronic device to display the at least one AI content on a first area of ​​the touchscreen display and to display thumbnail images corresponding to the at least one AI content on a second area of ​​the touchscreen display. The computer-readable medium according to one embodiment may include instructions that cause the electronic device to display an indicator representing the at least one AI object on at least one thumbnail image.

[0011] An electronic device according to one embodiment may include a computer-readable recording medium having recorded thereon a program for implementing a method of displaying AI-based content.

[0012] Electronic devices, methods, and recording media according to various embodiments can improve user convenience by allowing users to easily check where AI objects created / edited through AI exist in the content through thumbnails (e.g., thumbnail list, film strip) provided for content exploration when displaying AI content on a display (or touchscreen display) based on generative AI (e.g., generative AI).

[0013] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0014] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0015] FIG. 1A is a block diagram of an electronic device within a network environment, according to one embodiment.

[0016] FIG. 1b illustrates a generative artificial intelligence (AI) system according to one embodiment.

[0017] FIG. 2 illustrates a method for displaying AI content on an electronic device according to one embodiment.

[0018] FIGS. 3A and 3B illustrate examples of display screens displaying AI content of an electronic device according to one embodiment.

[0019] FIGS. 4A and 4B illustrate examples of display screens displaying AI content of an electronic device according to one embodiment.

[0020] FIG. 5 illustrates examples of display screens displaying AI image content of an electronic device according to one embodiment.

[0021] FIG. 6 illustrates examples of display screens displaying AI image content of an electronic device according to one embodiment.

[0022] FIG. 7 illustrates examples of display screens displaying AI image content of an electronic device according to one embodiment.

[0023] FIGS. 8A and 8B illustrate examples of display screens displaying AI content of a foldable electronic device according to one embodiment.

[0024] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0025] FIG. 1A is a block diagram of an electronic device within a network environment, according to one embodiment.

[0026] Referring to FIG. 1A, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0027] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0028] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0029] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0030] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0031] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0032] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0033] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0034] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0035] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0036] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0037] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0038] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0039] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0040] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0041] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0042] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0043] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0044] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0045] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0046] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0047] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0048] An electronic device (101) according to one embodiment may support a generative artificial intelligence (AI) / on-device AI) function (or AI service). The generative AI function may refer to a technology that generates new content based on previously learned data and can generate a new form of AI content by utilizing given input data or information. Here, AI content may refer to content (e.g., images, videos, audio, or text) that is entirely generated (or reconstructed / edited) or partially generated (or reconstructed / edited) based on generative AI.

[0049] An electronic device (101) according to one embodiment may support a generative AI function (or AI service) in conjunction with a server (108). At least one of the electronic device (101) or the server (108) according to one embodiment may include the configuration of the generative AI system illustrated in FIG. 1B.

[0050] For example, FIG. 1B illustrates the configuration of a generative AI system according to one embodiment. As illustrated in FIG. 1B, the generative AI system may include a user interface (1010), an AI framework (1020), a generative AI model (1030), an application and service component (1040), and a database component (1050).

[0051] A user interface (e.g., a user query / response interface) (1010) according to one embodiment may receive a user query. The user query input may be in the form of natural language, images, and videos. The user interface (1010) may transmit not only data regarding the user query input but also context information to the AI ​​framework (1020). The context information may include various additional information at the time of user input. In addition, the user query input may be in a form that mixes the above-described natural language, images, sounds, and context information. In addition, the user query input may be in a non-natural language form that does not generate natural language, such as a menu selection (e.g., a creation request or a modification request). The user interface (1010) may output the results of a generative artificial intelligence system to the user. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user.

[0052] An AI framework (1020) according to one embodiment can receive a user query input and coordinate and control each component necessary to perform the user's intention based on the user's query input. The AI ​​framework (1020) can include a prompt design component (1021), an application and plug-in management component (APIs / Plugins Management component) (1023), and an output modification component (1025).

[0053] A user query or action entered in a user interface (1010) according to one embodiment may be transmitted to a prompt design component (1021). The prompt design component (1021) may be used to generate prompts suitable for input into a large language model (LLM) or a large multimodal model (LMM). The prompt design component (1021) may be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design component (1021) may access a database component (1050) (e.g., a knowledge component) containing user preference data, a prompt library, and prompt examples to generate prompts and pass them to the large language model (LLM) or the large multimodal model (LMM).

[0054] According to one embodiment, the application and plugin management component (1023) may communicate with external information when a request for additional information is made when passing user input as input to a generative model. The application and plugin management component (1023) establishes a channel for communicating with the outside of the application and service component (1040) (e.g., AI Interface) through an application programming interface (API), thereby enabling access to various data sources. In addition, the application and plugin management component (1023) may request an action through the API to ultimately perform a user query, rather than an intermediate result, if the action needs to be performed by the application or service. Information obtained from the outside may be passed as input to the generative model along with the user input.

[0055] An output modification component (1025) according to one embodiment can fine-tune the output of a generative model. For example, the output modification component (1025) can verify that content generated through a language model (LLM) or a large-scale multi-modal model (LMM) is not irrelevant, does not contain biased content, or does not contain harmful content. In addition, the output modification component (1025) can determine to what extent the content matches the user's desired result and can perform additional processing if necessary. Additionally, the output modification component (1025) can configure and provide hints to the user to avoid undesired output.

[0056] A generative AI model (1030) according to one embodiment generally refers to an artificial intelligence neural network that creates new types of data based on user input information. Models that generate images may typically include a generative adversarial network (GAN) and a variational autoencoder (VAE). For example, the generative AI model may be a diffusion-based generative model that uses a VAE and a transformer structure. In addition, a language generating model may refer to a model that has been trained to statistically output the most appropriate output based on input values. Among generative AI models (1030), models that generate language may be, for example, models such as CHAT-GPT 3 and CHAT-GPT 4. As another example, large multimodal models (LMMs) may be models that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them.

[0057] An electronic device (101) according to one embodiment may generate AI content or AI objects using a part of the AI ​​system of FIG. 1B and store the AI ​​content or AI objects generated based on the generative AI in a memory (130). An electronic device (101) according to one embodiment may request AI-based generation (e.g., image reconstruction) from a server (108), receive AI content generated based on the generative AI of the server (108) from the server (108), and store the AI ​​content in a memory (130).

[0058] According to one embodiment, the memory (130) may store instructions executable by the processor (120) or the electronic device (101). Such instructions may include arithmetic and logical operations, data movement, or control commands such as input / output that may be processed by the processor (120).

[0059] According to one embodiment, the processor (120) may be operatively, functionally, and / or electrically connected to a display module (160) (e.g., a touchscreen display) and / or a memory (130). The processor (120) may be configured to perform operations or data processing related to control and / or communication of each component of the electronic device (101), and may be formed of one or more processors. The operations and data processing functions that the processor (120) may implement on the electronic device (201) are not limited, but in various embodiments of the present disclosure, various operations for displaying AI content may be processed.

[0060] An electronic device (101) according to one embodiment may include a touchscreen display (e.g., a display module (160), a processor (120), and a memory (120) storing instructions executable by the processor (120). According to one embodiment, the instructions may cause the electronic device (101) or the processor (120) to receive a user input for displaying at least one AI content including at least one AI (artificial intelligence) object through the touchscreen display. According to one embodiment, the instructions may cause the electronic device (101) or the processor (120) to display the at least one AI content on a first area of ​​the touchscreen display based on the user input. According to one embodiment, the instructions may cause the electronic device (101) or the processor (120) to display thumbnail images corresponding to the at least one AI content on a second area of ​​the touchscreen display. According to one embodiment, the The instructions may cause the electronic device (101) or the processor (120) to display an indicator representing the at least one AI object on at least one thumbnail image. In one embodiment, the at least one AI content may be stored in the memory.

[0061] The instructions according to one embodiment cause the electronic device (101) or the processor (120) to generate the indicator corresponding to the at least one AI object based on at least a portion of metadata associated with the at least one AI content, wherein the indicator may include at least one of a graphic object, a graphic effect, an outline, a highlight, text, an icon, or an image.

[0062] The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to display the indicator at a location associated with a thumbnail image or at least one AI object included in the at least one AI content.

[0063] According to one embodiment, the at least one AI content corresponds to video content, and the instructions may cause the electronic device (101) or the processor (120) to receive a second user input related to the thumbnail image through the touchscreen display. According to one embodiment, the instructions may cause the electronic device (101) or the processor (120) to display a plurality of frame thumbnail images including a plurality of frames of the at least one AI content in the second area through the touchscreen display in response to the second user input. According to one embodiment, the instructions may cause the electronic device (101) or the processor (120) to display the indicator on at least some of the plurality of frame thumbnail images.

[0064] The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to display the indicator in a first frame thumbnail image including the at least one AI object, wherein the first frame thumbnail image is included in the plurality of frame thumbnail images.

[0065] The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to display a play bar indicating a play position of at least one AI content on the plurality of thumbnail images through the touchscreen display, and to display the indicator at a position related to the play bar.

[0066] The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to display a graphic object related to AI display settings on the touchscreen display. The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to receive a second user input for the graphic object through the touchscreen display. According to one embodiment, the instructions may include causing the electronic device (101) or the processor (120) to display the indicator based on at least a portion of the second user input.

[0067] The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to receive a third user input through the touchscreen display for displaying at least a portion of metadata information related to the at least one AI content. The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to display at least a portion of the metadata at a location adjacent to the thumbnail image in response to the third user input.

[0068] At least a portion of the metadata according to one embodiment may include at least one of information about an AI engine that generates the at least one AI object, a location of the at least one AI within the at least one AI content, or a text prompt to generate the at least one AI object.

[0069] The instructions according to one embodiment may cause the electronic device (101) or the processor (120) to display a second indicator different from the indicator representing the at least one AI content when the entire portion of the at least one AI content corresponds to the AI ​​content.

[0070] According to one embodiment, the electronic device further includes a sensor for detecting a folding state, and the instructions may cause the electronic device (101) or the processor (120) to display a part of the at least one AI content in the first area and display the thumbnail image in the second area through the touchscreen display based on the determination by the sensor that at least a part of the electronic device is in a folded state. According to one embodiment, the instructions may cause the electronic device (101) or the processor (120) to display additional information between the part of the at least one AI content and the thumbnail image through the touchscreen display.

[0071] According to one embodiment, the additional information may include at least one of a portion of metadata associated with the at least one AI content and a thumbnail image including other indicators for the at least one AI content.

[0072] An electronic device (101) according to one embodiment includes a touchscreen display, a processor, and a memory storing instructions executable by the processor, wherein the instructions cause the electronic device to identify first AI content, in which the content is partially generated based on AI (artificial intelligence), among contents stored in the memory, and, based on a request for displaying the first AI content, display the first AI content in a first area of ​​the touchscreen display, and display thumbnails corresponding to the contents in a second area of ​​the touchscreen display, wherein at least one first thumbnail corresponding to the first AI content among the thumbnails in the second area displays an AI indicator indicating that a partially generated AI object is included.

[0073] In the description of the electronic device (101) according to the embodiments of the present invention disclosed below, the same reference numbers are given to components that are substantially the same as the configuration disclosed in FIG. 1 described above, and redundant descriptions of their functions may be omitted.

[0074] According to one embodiment, each of the embodiments described with reference to FIGS. 2 to 8b can operate independently as one embodiment.

[0075] According to one embodiment, at least two of the embodiments described with reference to FIGS. 2 to 8b may be combined and operated.

[0076] In one embodiment, when at least two embodiments are combined and operated, at least some of the components and / or at least some of the operations included in each embodiment may be omitted.

[0077] FIG. 2 illustrates a method for displaying AI content on an electronic device according to one embodiment.

[0078] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0079] Referring to FIG. 2, the processor (120) of the electronic device (101) according to one embodiment may detect a display request input of first content in operation 210.

[0080] For example, the electronic device (101) may detect an input (e.g., a request input for displaying the first content) for selecting the first content (e.g., a first image or a first video) from among the contents (e.g., images, videos) stored in the memory (130) or an external electronic device (e.g., a server) based on a user request using a gallery (or photo album) application to display the first content on the touchscreen display. For example, the request input for displaying the first content may be an input for calling up a user interface (UI) screen that displays the first content in a first area and displays thumbnails (or thumbnail images, a thumbnail list, a film strip, hereinafter referred to as thumbnails) in a second area different from the first area (e.g., a lower area of ​​the first area).

[0081] In operation 220, the processor (120) can check whether the contents stored in the memory (130) include AI contents that are generated in whole or in part (at least partly) based on AI (artificial intelligence).

[0082] For example, if information indicating an object created using AI is included in the metadata of the content, the processor (120) can identify the content as AI content.

[0083] In operation 230, the processor (120) may check metadata of an AI object stored in relation to the identified AI content if the AI ​​content is included (e.g., yes in operation 220).

[0084] According to one embodiment, the processor (120) may separately manage or store metadata of the AI ​​object (e.g., object name, object location information, generation type AI request prompt information, timestamp) (e.g., second metadata) that is distinct from metadata of the content (e.g., creation time, creation location, resolution, file size, file path) (e.g., first metadata) in the case of AI content.

[0085] For example, metadata of AI objects can store information separately for each object, as in the example in [Table 1] below.

[0086] [Correction pursuant to Rule 91 of the Rules 20.02.2025]

[0087] For example, in [Table 1], the object name (e.g., # object) refers to object information generated by AI, and the object information may include at least one of the name, shape, size, and / or appearance of the object. The prompt information (e.g., # prompt) refers to request prompt information that causes an object to be generated based on generative AI, and may include at least one of a text prompt, a voice prompt, and an image prompt used when generating AI content. The location information (e.g., # location) may refer to location information indicating where the AI ​​object is displayed within content including the AI ​​object. The time stamp (e.g., # time stamp) may include at least one of the time at which the frame in which the AI ​​object is displayed or the number order of the frames.

[0088] In operation 240, the processor (120) can detect (or confirm) the location of an AI object within the AI ​​content.

[0089] According to one embodiment, the processor (120) can check the metadata of the AI ​​object to detect (or confirm) the location where the AI ​​object is displayed within the AI ​​content.

[0090] In one embodiment, operations 220, 230 and 240 may be performed in real time on the electronic device, or may be performed prior to operation 210.

[0091] In operation 250, the processor (120) displays first content in a first area (e.g., main area, content display area) of the touchscreen display based on a content display request when AI content is included, and displays thumbnails corresponding to the contents in a second area (e.g., thumbnail list area, flip strip area, search area) of the touchscreen display, and may display an AI indicator indicating that at least one first thumbnail among the thumbnails identified as AI content includes a partially generated AI object (hereinafter, partial AI object).

[0092] According to one embodiment, when extracting a thumbnail of content including AI content, the processor (120) may preferentially select (or screen) a thumbnail for a frame including an AI object and display it in a second area (e.g., a thumbnail list area, a flip strip area, a search area).

[0093] According to one embodiment, the processor (120) may generate an AI indicator (or indicators) based on information (e.g., object type, object location, time, etc.) identified through metadata of the AI ​​object. The AI ​​indicator may include at least one of a graphic object (e.g., a visual cue), a graphic effect (e.g., a shading effect), an outline (e.g., a dotted line or a solid line), a highlight, text, an icon, and / or an image.

[0094] According to one embodiment, the processor (120) can identify an AI object based on information (e.g., object type, object location, time, etc.) confirmed through metadata of the AI ​​object, and can determine where the identified AI object is located within the content, a thumbnail corresponding to the content, or frames constituting the content (e.g., video content).

[0095] According to one embodiment, the processor (120) may display an AI indicator on the content, as well as a thumbnail corresponding to the content, depending on the settings.

[0096] According to one embodiment, when the content is video content, the processor (120) may display an AI indicator for each frame or frame thumbnail image in a situation where thumbnails (or frame thumbnail images, a thumbnail list, or a film strip) are displayed by expanding them in units of frames in the second area.

[0097] According to one embodiment, the processor (120) may display AI information about AI objects that are partially created within the content, as well as objects that are deleted or changed within the content.

[0098] According to one embodiment, when the first content is a video, the processor (120) may display a playback object indicating that the first content is a video content and a playback bar indicating a playback position in the second area.

[0099] In operation 260, if AI content is not included (e.g., no in operation 220), the processor (120) may display first content in a first area (e.g., main area, content display area) of the touchscreen display based on a content display request, and display thumbnails corresponding to the contents in a second area (e.g., thumbnail list area, film strip area, search area) of the touchscreen display.

[0100] FIGS. 3A and 3B illustrate examples of display screens displaying AI content of an electronic device according to one embodiment.

[0101] Referring to FIGS. 3A and 3B , an electronic device (101) according to one embodiment may display one content on a first area (310) of a touchscreen display (e.g., a display module of FIG. 1 ), and display thumbnails (or thumbnail images, a thumbnail list, a film strip) corresponding to the content on a second area (315) (e.g., a thumbnail list area, a film strip area, a search area) provided for content (e.g., an image / video) navigation, and may support a function of displaying an AI indicator indicating that a thumbnail (or thumbnail image) corresponding to content including an AI object generated in whole or in part by AI includes an AI object.

[0102] In the examples of FIGS. 3A and 3B, the first region and the second region are shown as separate regions, but this is not limited to the first region, and the second region may be included in at least a portion of the first region.

[0103] According to one embodiment, the electronic device (101) may display at least one AI indicator on a thumbnail corresponding to AI content including an AI object or may display multiple AI indicators by overlapping them, in a situation where a thumbnail corresponding to image content is displayed, a thumbnail corresponding to video content is displayed in a reduced version, or an AI indicator is displayed in a reduced version (e.g., a situation where there are multiple AI indicators or not all AI indicators can be displayed on a thumbnail).

[0104] below, <301> <302> <303> <304> and <305> In the example, the first content (320) is described as an example of a video, but the embodiments described in FIGS. 3a and 3b can also be applied to a case where the first content (320) is an image.

[0105] for example, <301> It may be a user interface (UI) screen that displays first content (320) (e.g., an image of a first video) in a first area (310) and displays thumbnails (or thumbnail images, a filmstrip, a thumbnail list) in a second area (315). <302> Is <301> This is an expanded drawing of the box portion shown in , and may be an example in which the AI ​​indicator is expressed in the form of an icon. For example, the first content (320) may be content in which a first AI object (321) (e.g., cat object) and a second AI object (322) (e.g., tissue case object) are partially generated based on AI among the objects (e.g., cat, card, tissue case, refrigerator, box) included in the first content (320).

[0106] <302> In the example, since there are multiple AI indicators (340) generated corresponding to the AI ​​object, there may be a situation where AI indicators (340) in the form of icons are displayed while overlapping each other. For example, when the processor (120) displays the first thumbnail (330) corresponding to the first content (320) in the second area (315), the processor (120) may display AI indicators (340) in the form of icons while overlapping each other in at least a portion of the first thumbnail (330). Since the AI ​​content corresponds to video content, the first thumbnail (330) may display a playback object (350) and a playback bar (355), and a playback time information object (360) related to the first content (320) may be displayed on the UI screen.

[0107] The user can recognize / recognize that the content corresponding to the first thumbnail (330) is AI content through the AI ​​indicator (340) in the form of an icon displayed through the second area.

[0108] According to one embodiment, the processor (120) may display an expanded version of the first thumbnail (330) corresponding to the video content in the second area (315), as illustrated in FIG. 4A, based on detecting an input for selecting the first thumbnail (330) displayed in the second area (315). The expanded version of the thumbnail (or frame-by-frame film strip, frame thumbnail images) will be described in detail with reference to FIGS. 4A and 4B.

[0109] An electronic device (101) according to various embodiments may support a function of displaying AI indicators in various forms depending on the size of thumbnails displayed in a thumbnail list (or film strip) and the type and number of generated AI objects.

[0110] <303> An example may be an AI indicator displayed on the first thumbnail (330) in the form of a visual object (e.g., visual que) (341). <304> If there are multiple AI indicators in the form of icons displayed on the first thumbnail (330), <302> Unlike the above, this may be an example in which the icon AI indicators (342) are displayed in multiple locations so as not to overlap. <305> An example may be one in which the AI ​​indicator displayed on the first thumbnail (330) is displayed in the form of an AI watermark (343) (or an AI text graphic, an image including an AI graphic).

[0111] FIGS. 4A and 4B illustrate examples of display screens displaying AI content of an electronic device according to one embodiment.

[0112] Referring to FIGS. 4A and 4B, according to one embodiment, the electronic device (101) may display AI indicators at AI object locations generated based on AI for each thumbnail or each frame when displaying a thumbnail as an expanded version or displaying video content on a frame-by-frame basis.

[0113] for example, <401> It may be a UI (user interface) screen that displays first content (420) (e.g., a still image or a playback image of a video) in a first area (310) and displays frames (430) of the first content in a second area (415). <402> Is <401> This is an expanded drawing of the box portion shown in , and may be an example in which AI indicators are expressed in the form of icons and AI indicators are displayed for each frame unit. For example, the first content (420) may be content in which a first AI object (421) (e.g., cat object), a second AI object (422) (e.g., tissue case), or a third AI object (423) (e.g., refrigerator) is partially generated based on AI among the objects (e.g., desk, cat, card, tissue case, refrigerator, snack case) included in the first content (420).

[0114] The electronic device (101) may expand and display frames or frame thumbnail images (e.g., first frame (431), second frame (432), third frame (433), fourth frame (434), fifth frame (435), sixth frame (436)) corresponding to the first content (420) in the second area (415) in response to an input of selecting a first thumbnail (e.g., 330 of FIG. 3A) corresponding to the image from the thumbnail list (or filmstrip).

[0115] for example, <401> The first content (420) shown in the example may be a screen where the fourth frame (434) is being played, and a playback time information object (460) may be displayed.

[0116] <402> As illustrated, AI objects may vary on a frame-by-frame basis. For example, when the second frame (442) is being played, if a book object (not shown) as well as a refrigerator object (423) included in the first content (420) is generated by AI, AI indicators of a book icon (441) and an appliance icon (442) may be displayed on the second frame (442). In the case of the fourth frame (434), if a box object (not shown) in the first content (420) of the fourth frame (434) is generated by AI, an AI indicator of a box icon (443) may be displayed on a portion where the box object in the fourth frame (434) is displayed. In the case of the fifth frame (435), if the toilet case object (422) and the cat object (421) in the first content (420) of the fifth frame (435) are generated by AI, the AI ​​indicators of the case icon (444) and the cat icon (445) may be displayed at the locations where the toilet case object (422) and the cat object (421) in the fifth frame (435) are displayed.

[0117] Users can distinguish (e.g., recognize, acknowledge) which objects within the content are AI objects on a frame-by-frame basis, as AI indicators are displayed overlaid on or adjacent to AI objects on a frame-by-frame basis.

[0118] An electronic device (101) according to one embodiment may support a function of identifying AI objects and displaying an outline surrounding at least a portion of the AI ​​objects for each frame when AI objects are included in each frame displayed in the second area (415). For example, <403> This may be an example of a situation in which the second area (41) is expanded and displayed in units of frames in response to AI video content. For example, the AI ​​video may include a first frame (450), a second frame (451), a third frame (452), a fourth frame (453), a fifth frame (454), and a sixth frame (455). In this case, the first frame (450) may be a part where the first object (460) is generated by AI, the second frame (451) may be a part where the second object (461) is generated by AI, and the third frame (452) may be a part where the third object (462) is generated by AI. The fourth frame (453) may be a part where the fourth object (463) is generated by AI, and the fifth frame (454) may be a part where the fifth object (464) is generated by AI. The sixth frame (455) may be a frame in which there is no object generated by AI.

[0119] FIG. 5 illustrates examples of display screens displaying AI image content of an electronic device according to one embodiment.

[0120] Referring to FIG. 5, an electronic device (101) according to one embodiment may support an AI indicator display function and a display deactivation function. For example, the electronic device (101) may provide a setting item (not shown) related to the display of an AI indicator on a touchscreen display. A user may set whether to display or deactivate the AI ​​indicator through the setting item.

[0121] An electronic device (101) according to one embodiment may support a function of not only displaying an AI indicator within thumbnails (or thumbnail images, a thumbnail list, a filmstrip), but also displaying an AI indicator indicating that the content is a partially generated AI object, or displaying an AI indicator (or graphic effect) indicating that the content is the entire AI content.

[0122] According to one embodiment, the electronic device (101) may display AI content (e.g., a first image (510)) and thumbnails for navigation (or thumbnail images, a thumbnail list, a filmstrip) on a touchscreen display (e.g., a display module of FIG. 1)) based on a content display request input. <501> The first UI screen (or UI screen) may be a situation in which the AI ​​indicator is set to be disabled. For example, the first UI screen may be a situation in which a first thumbnail (530) is selected by a user from among thumbnails, and a first image (510) corresponding to the first thumbnail (530) is displayed on the display. At this time, a visual effect (e.g., a dotted border (535)) may be displayed on the first thumbnail (530) selected by the user to distinguish it from other thumbnails. The user may change (or switch) the content (e.g., an image) displayed on the touchscreen display by dragging the thumbnails left and right or selecting another thumbnail.

[0123] According to one embodiment, the electronic device (101) can control the size of the first thumbnail (530) including the AI ​​object to be displayed larger than other thumbnails that do not include the AI ​​object.

[0124] When the user changes the AI ​​indicator display setting through the settings item, the electronic device (101) <502> As illustrated, the electronic device (101) may switch to a second UI screen displaying an AI indicator. For example, the electronic device (101) may determine that the sun object (520) and the heart object (521) in the first image (510) are objects / areas partially generated based on AI based on the metadata of the AI ​​object, and may display AI indicators such as displaying a shading effect (560) on the sun object (521) included in the first image (510) or displaying a dotted line (561) along the outline of the heart object (520). <502> In , AI indicators are shown with outlines and shading effects, <502> It is not limited to the visual effects shown in .

[0125] <502> As illustrated, a first AI mark (550) indicating that the image contains a partially generated object within the first image may be displayed on the second UI screen, or a first type of AI mark (550) may also be displayed on at least a portion of the lower part outside the area displaying the first image. The AI ​​mark (550) may be displayed in only one of the two areas depending on the settings.

[0126] According to one embodiment, the electronic device (101) may provide different visual effects of thumbnails for navigation so that partially AI-generated images and entire images are visually distinct from AI-generated images. For example, the electronic device (101) <502> As illustrated, a first thumbnail (530) corresponding to a first image (510) may be a partially generated image, and a second thumbnail (531) corresponding to a second image (511) may be a fully generated image. The electronic device (101) may display a first type of AI pointer object (540) in the case of the first thumbnail (530) corresponding to the partially generated first image (510), and may display a second type of AI pointer object (545) in the case of the second thumbnail (531).

[0127] Although not shown in the drawing, the electronic device (101) may also display an AI indicator on at least a portion of the first thumbnail (530) (e.g., a partially generated AI object (e.g., a sea object, a heart object)) instead of the first type of AI pointer object (540) depending on the settings.

[0128] According to one embodiment, when a user selects an AI indicator area or an AI object area (e.g., a sun object (520), a heart object (521)) displayed on a first image (510) or detects a hovering input over an AI object, the electronic device (101) may display related AI information (e.g., metadata of the AI ​​object or text or an image indicating that it is an AI object) for the selected AI object in a pop-up form.

[0129] <503> The second image (511) may be a third UI screen in which a user selects a second thumbnail (531) from a thumbnail list (e.g., a film strip) and a second image (511) corresponding to the second thumbnail (531) is displayed. The second image (511) is an image generated entirely by AI, and a border portion of the entire image may be highlighted (570) to indicate that the entire image is AI. The electronic device (101) may display a second type AI mark (555) indicating that the entire image is generated entirely based on AI on at least a portion of the second image (511), or may display the second type AI mark (555) on at least a portion of the lower portion outside the area displaying the second image (511). The electronic device (101) may display a second type AI pointer object (545) indicating that the entire image is generated entirely based on AI on the second thumbnail (531) selected on the third UI screen. At this time, the second thumbnail (531) selected by the user may be displayed with a visual effect (e.g., a solid line border (536)) to distinguish it from other thumbnails.

[0130] FIG. 6 illustrates examples of display screens displaying AI image content of an electronic device according to one embodiment.

[0131] Referring to FIG. 6, an electronic device (101) according to one embodiment may support a function of displaying an AI indicator even for AI content in which a portion of an image is generated by AI.

[0132] The electronic device (101) may display the first image (610) on at least a portion (e.g., the first area) of a touchscreen display (e.g., the display module (160) of FIG. 1) based on a user input of selecting a first thumbnail (630) (or first thumbnail image) corresponding to the first image (610) including partial AI information from a thumbnail list (e.g., the second area).

[0133] In one embodiment, the electronic device (101) may, in the case of video content, display a playback object (650) and / or a playback bar (655) indicating that the content is video content, or, unlike image content, display a playback time information object (660) indicating the playback time of the video on at least a portion of the touchscreen display. Depending on the settings, the electronic device (101) may display a separate playback object (651) on at least a portion of the bottom of the content.

[0134] An electronic device (101) according to one embodiment may remove a playback object (650) displayed in video content based on a user input selecting a playback object (650) displayed in video content, play the video content, and switch to displaying a thumbnail list expanded by frame units constituting the video.

[0135] According to one embodiment, an electronic device (101) may display a first thumbnail (630) corresponding to video content in a thumbnail list in a smaller or larger size than a second thumbnail (631) corresponding to image content.

[0136] <601> The first UI screen (or UI screen) may be a first UI screen (or UI screen) in a situation where the AI ​​indicator is set to be disabled. For example, the first UI screen may be an example in which a first image (610) of a still image is displayed, and a thumbnail list including a first thumbnail (630) corresponding to the first image (610) and second thumbnails (631) corresponding to the images are displayed. <601> In this case, the first thumbnail (630) may be displayed in a larger size than the second thumbnail (631), and a play bar (655) may be displayed on the first thumbnail (630). Although not shown in the drawing, the electronic device (101) may also display a visual effect (e.g., a border highlight effect (not shown)) to distinguish the first thumbnail (630) selected by the user from other thumbnails.

[0137] When the user changes the AI ​​indicator display setting through the settings item, the electronic device (101) <602> As illustrated, the electronic device (101) may switch to a second UI screen displaying an AI indicator. When switching from the first UI screen to the second UI screen, the electronic device (101) may display an AI indicator in an area where an AI object is located in the first image (610). For example, AI indicators such as a shading effect (670) and / or an outline (671) may be displayed in an area / location where a sun object (620) and a heart object (621) generated by AI are displayed in the first image (610), and a first type AI mark (641) indicating that the image is partially generated in at least a portion of the first image (610) or a lower area of ​​the first image (610) may be displayed, or a first type AI mark (641) may be displayed in at least a portion of the lower area outside the area displaying the first image (610). When switching to the second UI screen, in the case of a first thumbnail (630) corresponding to AI content (e.g., first image (610)) in which at least a part of the content is partially generated from the thumbnail list of the electronic device (101), a first type AI pointer object (680) may be displayed, and in the case of a second thumbnail (631) corresponding to AI content in which the entire content is generated, a second type AI pointer object (685) may be displayed.

[0138] The electronic device (101) displays a playback object (650), a playback time information object (660) and a playback bar (655) displayed on a first image (610) in a second UI screen according to the settings. <601> You can guide users to the presence of AI-applied parts by displaying different visual effects (e.g., color, size, contrast, etc.) to distinguish them from the first UI screen.

[0139] <603> As illustrated, based on an input of a user selecting a first thumbnail (630) or selecting a playback object (650) that plays the first image (610), the electronic device (101) may be a third UI screen that expands and displays a list of thumbnails into a list of frames (or a frame list (690)) constituting the first image (610). The frame list (690) may include, for example, a first frame (691), a second frame (692), a third frame (693), a fourth frame, and an Nth frame, and the frame number or frame order displayed in the frame list may change depending on the playback time of the first image (610).

[0140] When the first video (610) is being played on the third UI screen, the playing time of the playing time information object (660) may change according to the progress of the playing, and the frame position of the playing bar (655) may change.

[0141] An electronic device (101) according to one embodiment can identify whether an AI object is present in each frame of a video based on the metadata of the AI ​​object when playing back a video, and can display an AI indicator for each frame that partially contains the AI ​​object. For example, <603> In the example, the first frame (691) and the second frame (692) contain objects partially generated by AI, so the first type of AI pointer object (680) may be displayed respectively. The third frame (693) is a frame that does not contain an AI object generated by AI, so the AI ​​indicator may not be displayed.

[0142] also, <602> The second UI screen is a situation in which a first image (610) corresponding to a first frame (691) and AI indicators (e.g., a shading effect (670) and / or an outline (671)) corresponding to AI objects (e.g., a sea object (620) and a heart object (621)) included in the first image (610) are displayed, <603> The third UI screen may be a situation in which the first image (610) corresponding to the second frame (692) and AI indicators corresponding to AI objects included in the first image (610) are displayed.

[0143] According to one embodiment, when the first image (610) is played, the electronic device (101) may control the playback speed to be played at a slower speed than the normal speed in the portion where the frame containing the AI ​​object is played.

[0144] According to one embodiment, the electronic device (101) can control the scrolling speed or swipe speed to play at a normal slow speed when the play bar (655) is positioned over a frame area containing an AI object when the user scrolls (or swipes) the play bar (655) in the frame list (690).

[0145] <604> The fourth UI screen may be a situation in which the first image (610) of the third frame (693) that does not include an AI object is being played. The electronic device (101) may change the display characteristics (e.g., color, visual effect, dotted line, contrast) of the fourth UI screen to display it differently from the case in which frames including an AI object (e.g., the first frame (691), the second frame (692)) are played. For example, the electronic device (101) may apply different sizes or colors of the AI ​​marks (640, 641) and the play bar (655). In this case, the first image (610) corresponding to the third frame (693) may not display the AI ​​indicator because it does not include an AI object.

[0146] FIG. 7 illustrates examples of display screens displaying AI image content of an electronic device according to one embodiment.

[0147] Referring to FIG. 7, an electronic device (101) according to one embodiment may support a function of displaying an AI indicator even for AI content in which the entire image is generated by AI. Unlike FIG. 6, the embodiment of FIG. 7 is only for a situation in which the entire image is AI content generated by AI, but the functions and / or configurations applied to the UI screen described in FIG. 6 may also be applied to FIG. 7.

[0148] <701> The first UI screen (or UI screen) may be a first UI screen (or UI screen) in which the AI ​​indicator is set to be disabled. The first UI screen displays a first video (710) of a still image corresponding to the first thumbnail (730), and displays a list of thumbnails corresponding to the contents, but the first video (710) <601> Unlike the previous example, the entire video may be AI content generated by AI. <701> In this case, as described in FIG. 6, playback objects (750, 751) related to video content, playback time information object (760) and playback bar (755) can be displayed.

[0149] When the user changes the AI ​​indicator display setting through the settings item, the electronic device (101) <702> As illustrated, the screen may be switched to a second UI screen displaying an AI indicator (770). When switching from the first UI screen to the second UI screen, the electronic device (101) may display a second type of AI mark (740) indicating that the entire image is generated based on AI, or may display a second type of AI pointer object (770) indicating that the entire image is generated in the first thumbnail (730) (or the second thumbnail (731)) corresponding to the AI ​​content in which the entire image is generated in the thumbnail list. The electronic device (101) may change the display characteristics or visual effects (e.g., color, size, contrast, solid line display) of the playback objects (750, 751), the playback bar (755), and the playback time information object (760) included in the second UI screen according to the settings to be visually distinguishable from the first UI screen.

[0150] Based on an input from the user selecting a first thumbnail (70) or selecting a playback object (750) that plays the first image (70), the electronic device (101) <703> As shown in , the thumbnail list can be converted to a third UI screen that expands and displays a list of frames (or frame list (780)) (or frame thumbnail images) that constitute the first video (610). The frame list (780) can include a first frame (781), a second frame (782), a third frame (783), and an Nth frame, and the position of the play bar (755) can be changed according to the play time.

[0151] FIGS. 8A and 8B illustrate examples of display screens displaying AI content of a foldable electronic device according to one embodiment.

[0152] Referring to FIGS. 8A and 8B , according to one embodiment, the electronic device (101) may support a function of differently applying the display function of AI-related information based on a structural change or state change of the electronic device. The electronic device (101) illustrated in FIGS. 8A and 8B is an example of a foldable electronic device, but is not limited thereto.

[0153] <801> This may be an example of a first UI screen when a foldable electronic device is in an unfolded state (or unfolded state), in which a first image (810) corresponding to the first thumbnail (830) is displayed on at least a part of a touchscreen display (e.g., a first display) based on a first thumbnail (830) (or the first thumbnail image) being selected by a user input from a list of thumbnail images. The first thumbnail (830) may be displayed with a visual effect (e.g., a dotted border (835)) to distinguish it from other thumbnails.

[0154] When the foldable electronic device changes to an intermediate state (e.g., the folding angle is 70 to 110 degrees), the foldable electronic device <802> or <803> It can be switched to the second UI screen as shown in . For example, <802> In an example, the touchscreen display area between the thumbnail list and the first image (810) may be controlled to display text information (833) related to AI content. The text information may include a portion of information stored in the metadata of the AI ​​object (e.g., AI engine information, AI object information, AI prompt information). The second UI screen may also display a playback object (840) indicating that the first image is video content and / or an AI mark (845) indicating that the first image (810) is AI content. For another example, <803> In the example, the touchscreen display area between the thumbnail list and the first image (810) may be switched to a screen that displays a thumbnail (850) (and the next thumbnail (831)) with an AI indicator (860) applied on top of the AI ​​object (850) corresponding to the first image (810). In addition, in the case of the second UI screens, AI information may or may not be displayed in the thumbnail list depending on the settings.

[0155] <804> This may be a situation where a first image (810) is displayed on an external display (e.g., a second display) of the foldable electronic device when the foldable electronic device is switched to a closed state (or a folded state). In this case, the first image may be AI content generated based on AI, but information related to AI may not be displayed.

[0156] According to one embodiment, the foldable electronic device may display AI-related indicators on a first image displayed on an external display in a folded state, or may display a thumbnail related to the first image and display an AI indicator on the thumbnail, as described above. Since the screen sizes of the external display and the main display are different, the UI for displaying the AI ​​indicator may be provided differently for the first display and the second display.

[0157] When the foldable electronic device detects that it is transitioning from a closed state to an unfolded state, the foldable electronic device <805> As illustrated, a first image may be displayed on a touchscreen display, and a third UI screen may be displayed where a thumbnail list (or film strip) is displayed at the bottom of the first image. At this time, a first thumbnail (830) corresponding to the first image (810) may be displayed with a visual effect (e.g., a dotted border (835)) to distinguish it from other thumbnails. The third UI screen may display an AI indicator or information related to AI based on AI metadata related to the first image (810). For example, an AI indicator such as a light and dark effect (890) and an outline (891) may be displayed at an AI object (820, 821) and an AI object position included in the first image (810), or an AI mark (845) indicating AI content may be displayed. Also, in the thumbnail list, a first type AI pointer object (870) may be displayed in a partial AI thumbnail (e.g., a first thumbnail (830)) generated based on AI, and a second type AI pointer object (875) may be displayed in a full AI thumbnail (e.g., a second thumbnail (831)).

[0158] Although not illustrated in the drawings, the contents described in the present disclosure can be applied not only to foldable electronic devices but also to rollable electronic devices capable of changing the structure of the display, and when the display area increases due to the change in the display structure, AI-related information displayed on the UI screen in relation to AI may increase or the size of the AI ​​indicator may increase.

[0159] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0160] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0161] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0162] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0163] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; processor; and comprising a memory storing instructions executable by the processor; The above instructions cause the electronic device to: Receiving user input to display AI content that includes at least one AI (artificial intelligence) object, Based on the user input, displaying at least one AI content in a first area of the display, and displaying thumbnail images corresponding to the AI content in a second area of the display, Displaying an indicator representing at least one AI object on at least one thumbnail image displayed in the second area; An electronic device, characterized in that the AI content is stored in the memory.

2. In paragraph 1, The above instructions cause the electronic device to: Generating said indicator corresponding to said at least one AI object based on at least a portion of metadata related to said AI content; The above indicator is an electronic device including at least one of a graphic object, a graphic effect, an outline, a highlight, text, an icon or an image.

3. In paragraph 2, An electronic device, characterized in that the indicator is displayed at a location related to a thumbnail image or at least one AI object included in the at least one AI content.

4. In paragraph 1, The above AI content corresponds to video content, The above instructions cause the electronic device to: Receiving a second user input related to the thumbnail image through the display; In response to the second user input, a plurality of frame thumbnail images including a plurality of frames of the AI content are displayed in the second area through the display, An electronic device that causes the indicator to be displayed on at least some of the plurality of frame thumbnail images.

5. In paragraph 4, The above instructions cause the electronic device to: Displaying the indicator on a first frame thumbnail image including at least one AI object; An electronic device, characterized in that the first frame thumbnail image is included in the plurality of frame thumbnail images.

6. In paragraph 4, The above instructions cause the electronic device to: Displaying a playback bar indicating the playback position of the AI content on the plurality of thumbnail images through the display; An electronic device that causes said indicator to be displayed at a location related to said playback bar.

7. In paragraph 1, The above instructions cause the electronic device to: Displays graphic objects related to the AI display settings on the above display, Receiving a second user input for the graphic object through the display; An electronic device configured to display the indicator based on at least a portion of the second user input.

8. In paragraph 1, The above instructions cause the electronic device to: Receiving third user input to display at least some information of metadata related to said AI content; An electronic device that displays at least a portion of said metadata adjacent to said thumbnail image in response to said third user input.

9. In paragraph 8, An electronic device wherein at least a portion of said metadata comprises at least one of information from an AI engine that generates said at least one AI object, a location of said at least one AI within said AI content, or a text prompt to generate said at least one AI object.

10. In paragraph 1, The above instructions cause the electronic device to: An electronic device that displays a second indicator that is different from a first indicator indicating that the AI content partially includes at least one AI object, when the entire portion of the AI content corresponds to the AI content.

11. In paragraph 1, Further comprising a sensor for detecting the folding state of the electronic device; The above instructions cause the electronic device to: Displaying a part of the AI content in the first area through the display based on determining that at least a part of the electronic device is in a folded state through the sensor, and displaying the thumbnail image in the second area; An electronic device that displays additional information between a portion of the above AI content and a thumbnail image through the above display.

12. In paragraph 11, An electronic device comprising at least one of a portion of metadata related to said AI content and a thumbnail image including other indicators of said AI content.

13. In the method of displaying content on an electronic device, An action for receiving user input to display AI content including at least one AI (artificial intelligence) object; and An operation of displaying the AI content in a first area of the display and displaying thumbnail images corresponding to the AI content in a second area of the display based on the user input; and A method comprising an action of displaying an indicator representing at least one AI object on at least one thumbnail image displayed in the second area.

14. In paragraph 13, The action of displaying the above AI indicator is: Further comprising an action of generating said indicator corresponding to said at least one AI object based on at least a portion of metadata related to said AI content; A method wherein the indicator comprises at least one of a graphic object, a graphic effect, an outline, a highlight, text, an icon or an image.

15. A computer-readable recording medium having recorded thereon a program for executing a method of displaying contents of an electronic device on a computer, the method comprising: An action for receiving user input to display AI content including at least one AI (artificial intelligence) object; and A recording medium including an operation for displaying the AI content in a first area of the display, based on the user input, thumbnail images corresponding to the AI content in a second area of the display, and displaying an indicator representing the at least one AI object in at least one thumbnail image displayed in the second area.

Images