Electronic device for providing thumbnail image and operation method therefor
The electronic device addresses the issue of reduced legibility in thumbnail images by grouping and generating expanded thumbnail images using AI models, improving user navigation and privacy.
Patent Information
- Application Number
- PCT/KR2025/009363
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-09-25
- Filing Date
- 2025-07-01
- Publication Date
- 2026-01-08
AI Technical Summary
The legibility of thumbnail images is reduced due to the large number of images displayed, making it difficult for users to identify and navigate through them effectively.
An electronic device groups images based on detected events, obtains information about display areas, and generates expanded thumbnail images using artificial intelligence models to enhance visibility and representation.
Enhances user experience by providing larger, representative thumbnail images that improve navigation and visibility, while maintaining continuity and privacy for sensitive content.
Smart Images

Figure KR2025009363_08012026_PF_FP_ABST
Abstract
Description
Electronic device for providing thumbnail images and method of operation thereof
[0001] The present disclosure relates to an electronic device and an operating method for providing a thumbnail image.
[0002] With the advancement of digital technology, electronic devices are available in various forms, such as smartphones, tablet personal computers (PCs), and personal digital assistants (PDAs). These various electronic devices can display various types of images (e.g., images stored in a gallery) through their displays.
[0003] Electronic devices can provide thumbnail images for user convenience. A thumbnail image is a representative image of the image. Thumbnail images are typically generated for each individual image. When generating thumbnail images for each individual image, the large number of thumbnail images reduces the legibility of the thumbnail images.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.
[0005] According to one embodiment, an electronic device may be provided. The electronic device may include a display, at least one processor including a processing circuit, and a memory including at least one storage medium storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to perform at least one operation. The at least one operation may include an operation of grouping a plurality of images based on detection of an event for providing an expanded thumbnail image. The at least one operation may include an operation of obtaining information about a second area on which the expanded thumbnail image is to be displayed on a second thumbnail screen based on information about a first area on which a plurality of thumbnail images corresponding to the grouped plurality of images are displayed on the first thumbnail screen. The at least one operation may include an operation of obtaining a representative thumbnail image based on the grouped plurality of images. The at least one action may include an action of displaying the expanded thumbnail image within a second area of the second thumbnail screen based on the representative thumbnail image. The size of the expanded thumbnail image may be larger than the size of a single thumbnail image belonging to the plurality of thumbnail images.
[0006] According to one embodiment, a method of operating an electronic device may be provided. The method of operating the electronic device may include at least one operation. The at least one operation may include an operation of grouping a plurality of images based on detection of an event for providing an expanded thumbnail image. The at least one operation may include an operation of obtaining information about a second area in which the expanded thumbnail image is to be displayed in a second thumbnail screen, based on information about a first area in which a plurality of thumbnail images corresponding to the grouped plurality of images are displayed in the first thumbnail screen. The at least one operation may include an operation of obtaining a representative thumbnail image based on the grouped plurality of images. The at least one operation may include an operation of displaying the expanded thumbnail image in a second area of the second thumbnail screen, based on the representative thumbnail image. A size of the expanded thumbnail image may be larger than a size of a single thumbnail image belonging to the plurality of thumbnail images.
[0007] According to one embodiment, a storage medium storing at least one computer-readable instruction may be provided. The at least one instruction, when executed by at least a part of at least one processor of an electronic device, may cause the electronic device to perform at least one operation. The at least one operation may include an operation of grouping a plurality of images based on detection of an event for providing an expanded thumbnail image. The at least one operation may include an operation of obtaining information about a second area in which the expanded thumbnail image is to be displayed in a second thumbnail screen based on information about a first area in which a plurality of thumbnail images corresponding to the grouped plurality of images are displayed in the first thumbnail screen. The at least one operation may include an operation of obtaining a representative thumbnail image based on the grouped plurality of images. The at least one operation may include an operation of displaying the expanded thumbnail image in a second area of the second thumbnail screen based on the representative thumbnail image. The size of the above extended thumbnail image may be larger than the size of a single thumbnail image belonging to the plurality of thumbnail images.
[0008] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.
[0010] FIG. 2 is a diagram illustrating a generative artificial intelligence system according to one embodiment of the present disclosure.
[0011] FIG. 3 is a diagram illustrating thumbnail images provided according to a basic thumbnail mode and an extended thumbnail mode according to one embodiment of the present disclosure.
[0012] FIG. 4 is a flowchart illustrating a method by which an electronic device provides an expanded thumbnail image according to one embodiment of the present disclosure.
[0013] FIG. 5 is a diagram illustrating an operation of an electronic device providing an expanded thumbnail image according to one embodiment of the present disclosure.
[0014] FIG. 6 is a diagram illustrating an operation of an electronic device providing an additional image associated with an expanded thumbnail image according to one embodiment of the present disclosure.
[0015] FIG. 7 is a diagram illustrating an operation of an electronic device providing an expanded thumbnail image according to one embodiment of the present disclosure.
[0016] FIG. 8 is a diagram illustrating an operation of an electronic device providing an extended thumbnail image having a format of a motion image according to one embodiment of the present disclosure.
[0017] FIGS. 9A to 9C are diagrams illustrating an operation of an electronic device providing a customized expanded thumbnail image according to one embodiment of the present disclosure.
[0018] FIGS. 10A and 10B are diagrams illustrating an operation of an electronic device providing a customized extended thumbnail image according to one embodiment of the present disclosure.
[0019] FIG. 11 is a flowchart illustrating a method for an electronic device to reconstruct a thumbnail image according to one embodiment of the present disclosure.
[0020] FIG. 12 is a diagram illustrating thumbnail images provided according to a thumbnail reconstruction mode according to one embodiment of the present disclosure.
[0021] FIG. 13 is a diagram illustrating examples of thumbnail images according to one embodiment of the present disclosure.
[0022] FIGS. 14A and 14B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image containing sensitive information according to one embodiment of the present disclosure.
[0023] FIGS. 15A and 15B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image including a specific object according to one embodiment of the present disclosure.
[0024] FIGS. 16A and 16B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image using facial recognition according to one embodiment of the present disclosure.
[0025] FIGS. 17A and 17B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image using facial expression analysis according to one embodiment of the present disclosure.
[0026] FIG. 18 is a flowchart illustrating a method for an electronic device to reconstruct a thumbnail image according to one embodiment of the present disclosure.
[0027] FIG. 19 is a diagram illustrating a configuration of an electronic device according to one embodiment of the present disclosure.
[0028] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0029] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments of the present disclosure.
[0030] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0031] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0032] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0033] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0034] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0035] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0036] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0037] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0038] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0039] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0040] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0041] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0042] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0043] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0044] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0045] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0046] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a communication module (192) (e.g., a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0047] The communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The communication module (192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The communication module (192) may support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0048] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0049] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0050] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface).
[0051] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0052] FIG. 2 is a diagram illustrating a generative artificial intelligence system according to one embodiment of the present disclosure.
[0053] According to one embodiment, a user query / response interface (210) may receive input (e.g., user input or data acquired or generated by an electronic device (e.g., electronic device (101) of FIG. 1). The data acquired or generated by the electronic device may include, for example, image or video data generated using a processor (e.g., processor (120) of FIG. 1), values transmitted through a sensor (e.g., sensor module (176) of FIG. 1) or sensor hub (e.g., external illuminance, angle of the electronic device, temperature of the display (e.g., display module (160) of FIG. 1) or electronic device, display size or expansion / reduction information, captured images of an image sensor). The user input may be in the form of natural language, touch coordinates or stylus coordinates acquired through a touch panel or digitizer included in the display, images and / or videos, but is not limited thereto. In addition, context information may also be transmitted when transmitting the user input. The context information may include various additional information at the time of user input. It can include information. For example, the additional information can include information about the application the user is currently using or the user's location information. In addition, the user input can be a mixed form of the above-described natural language, images, sounds, and context information. In addition, the user input can also be a non-natural language form, such as selecting a menu. The user query / response interface (210) can output the results of the generative artificial intelligence system (200) and / or the results of analyzing the input to the user. The output can be in the form of natural language or a specific content, and can also be provided in the form of an action requested by the user. The user query / response interface (210) can output the results of the generative artificial intelligence system (200) to the user. The output can be in the form of natural language or a specific content, and can also be provided in the form of an action requested by the user.
[0054] According to one embodiment, the AI framework (240) can receive user input and coordinate and control each component necessary to perform the user's intention based on the user's query.
[0055] According to one embodiment, user input received at the user query / response interface (210) may be transmitted to a prompt design component (241). The prompt design component (241) may be used to generate prompts suitable for inputting the user input into a large language model (LLM) or a large multimodal model (LMM). The prompt design component (241) may be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design component (241) may access a knowledge component including user preference data, a prompt library, and prompt examples based on the user input to generate prompts, and may transmit the generated prompts to the LLM or LMM.
[0056] According to one embodiment, the API / Plug-in management component (242) may communicate with external information when there is a request for additional information when passing user input as input to the generative model. The API / Plug-in management component (242) may establish a channel for communicating with the outside of the AI Interface through the API, and may enable access to various data sources (e.g., knowledge repositories (220)) through the established channel. In addition, the API / Plug-in management component (242) may request the application / service component (230) through the API to perform an action that ultimately performs the user input, rather than an intermediate result, when the action needs to be performed in the application or service. Information obtained from the outside may be used to generate a prompt in the prompt design component (241) together with the user input, or may be passed as an input to the generative model.
[0057] According to one embodiment, the output modification component (also referred to as a refiner component) (243) can fine-tune the output from the generative model. For example, the output modification component (243) can verify that the content generated through the LLM and / or LMM is not irrelevant, does not contain biased content, or does not contain harmful content. In addition, the output modification component (243) can determine to what extent the content matches the result desired by the user and, if necessary, can perform additional processing. The output modification component (243) can additionally configure and provide the user with hints to avoid unwanted output.
[0058] According to one embodiment, a generative AI model (260) may generally refer to an artificial intelligence neural network that creates new types of data based on user input information. The generative AI model (260) may include a model that generates images and / or a model that generates languages. Representative models that generate images include a generative adversarial network (GAN) and a variational auto encoder (VAE), and examples include a diffusion-based generative model that uses a VAE and a Transformer structure. A model that generates languages is a model that is trained to statistically output the most appropriate output based on input values, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. In addition, there are also large multimodal models (LMMs) that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them.
[0059] According to one embodiment of the present disclosure, an electronic device (e.g., the electronic device (101) of FIG. 1) may display a thumbnail screen including at least one thumbnail image through a display (e.g., the display module (160) of FIG. 1) based on a thumbnail mode. The thumbnail mode may be a basic thumbnail mode, an expanded thumbnail mode, or a thumbnail reconstruction mode.
[0060] In one embodiment, the basic thumbnail mode may be a default thumbnail mode, for example, a thumbnail mode that provides individual thumbnail images corresponding to each image. In the basic thumbnail mode, the sizes of each individual thumbnail image may be the same as each other or may be sizes corresponding to the ratio of each original image. In the present disclosure, the basic thumbnail mode may be referred to as the default thumbnail mode.
[0061] According to one embodiment, the expanded thumbnail mode may be a thumbnail mode that provides an expanded thumbnail image for at least one individual thumbnail image that is related to each other. The size of the expanded thumbnail image of the expanded thumbnail mode may be larger than the size of the individual thumbnail image of the basic thumbnail mode. By providing the expanded thumbnail mode, a thumbnail image that represents at least one individual thumbnail image that is related to each other and has high visibility may be provided compared to the basic thumbnail mode. In the present disclosure, the expanded thumbnail mode may be referred to as a representative thumbnail mode, a first thumbnail mode, a clean view mode, or an AI clean view mode.
[0062] According to one embodiment, the thumbnail reconstruction mode may be a thumbnail mode that provides a reconstructed thumbnail image. The reconstructed thumbnail image may be a thumbnail image obtained by reconstructing an individual thumbnail image or an extended thumbnail image. By providing the thumbnail reconstruction mode, thumbnail images corresponding to sensitive content may not be exposed externally. In the present disclosure, the thumbnail reconstruction mode may be referred to as an alternative thumbnail mode, a second thumbnail mode, an AI thumbnail mode, or a private view mode.
[0063] FIG. 3 is a diagram illustrating thumbnail images provided according to a basic thumbnail mode and an extended thumbnail mode according to one embodiment of the present disclosure.
[0064] FIG. 4 is a flowchart illustrating a method by which an electronic device provides an expanded thumbnail image according to one embodiment of the present disclosure.
[0065] The components and operations of the components described with reference to FIGS. 3 and 4 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 and 2. The components and operations of the components described with reference to FIGS. 3 and 4 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 5 to 19, which will be described later.
[0066] Referring to FIGS. 3 and 4, according to one embodiment, at operation 410, an electronic device (e.g., electronic device (101) of FIG. 1) may group a plurality of images based on detecting an event for providing an expanded thumbnail image.
[0067] According to one embodiment, an event for providing an expanded thumbnail image (hereinafter referred to as a first event) may be detected, for example, based on the execution (or activation) of the expanded thumbnail mode or the setting of configuration information for the expanded thumbnail mode while the expanded thumbnail mode is executed (or activated). For example, the electronic device may identify that the first event has been detected when the expanded thumbnail mode is executed (or activated) or when configuration information for the expanded thumbnail mode is set while the expanded thumbnail mode is executed (or activated).
[0068] According to one embodiment, the expanded thumbnail mode may be executed based on receiving an input for executing the expanded thumbnail mode or satisfying a specified condition for executing the expanded thumbnail mode. For example, the electronic device may execute the expanded thumbnail mode when receiving an input for executing the expanded thumbnail mode or satisfying a specified condition for executing the expanded thumbnail mode.
[0069] According to one embodiment, an input for executing an expanded thumbnail mode may include, for example, a user input (e.g., a touch input) for selecting an expanded thumbnail mode among thumbnail modes through a user interface (e.g., the user interface (900, 1000) of FIGS. 9A and 10A) and / or a gesture input of an electronic device corresponding to the expanded thumbnail mode (hereinafter, referred to as a device gesture input). The device gesture input corresponding to the expanded thumbnail mode may be, for example, a gesture input for tilting the electronic device to the left or right. For example, the electronic device may identify a gesture input for tilting the electronic device to the left or right using at least one sensor, and execute the expanded thumbnail mode according to the identified gesture input. When executing the expanded thumbnail mode using a device gesture input, the expanded thumbnail mode may be executed more quickly compared to when executing the expanded thumbnail mode using a user input through a user interface.
[0070] According to one embodiment, the configuration information for the expanded thumbnail mode may include information regarding the size of the area in which the expanded thumbnail image is to be displayed and / or information regarding a method for generating the expanded thumbnail image. The information regarding the method for generating the expanded thumbnail image may include, for example, information regarding a method for obtaining a representative thumbnail image included in the expanded thumbnail image.
[0071] According to one embodiment, an electronic device can group multiple images based on specified grouping criteria. The multiple images may be, for example, images stored in a gallery (e.g., a photo application) of the electronic device, but are not limited thereto. For example, at least one of the multiple images may be an image stored on a server (e.g., server (108) of FIG. 1) linked to a user account of the electronic device.
[0072] According to one embodiment, the electronic device may group a plurality of images that are related to each other based on object information about an object (e.g., a person) included in an image, location information about a location where the image was captured (e.g., a capture location), and / or time information about a time when the image was captured (e.g., a capture date) according to a specified grouping criterion. As an example, the electronic device may group images that include the same person among images captured at the same location, group images that include the same person among images captured during the same period, group images captured at the same location during the same period, or group images that include the same person among images captured at the same location during the same period, but is not limited thereto. Through such image grouping, images that are related to each other (e.g., similar images) may be grouped. The images grouped in this way may be used to obtain a representative thumbnail image for an expanded thumbnail image.
[0073] According to one embodiment, in operation 420, the electronic device may obtain information about a second area in which an expanded thumbnail image is to be displayed in a second thumbnail screen (302), based on information about a first area in which a plurality of thumbnail images corresponding to a plurality of images grouped in a first thumbnail screen (301) are displayed. In the present disclosure, the first area may be referred to as a thumbnail area, and the second area may be referred to as an expanded thumbnail area.
[0074] According to one embodiment, the first thumbnail screen (301) may be a screen on which individual thumbnail image(s) are displayed according to the basic thumbnail mode. For example, as illustrated in FIG. 3, the first thumbnail screen (301) may include first thumbnail images (TIa1, TIa2) corresponding to first images grouped into a first image group (IGa), second thumbnail images (TIb1 to TIb4 and TIb6) corresponding to second images grouped into a second image group (IGb), and / or third thumbnail images (TIc1 to TIc3) corresponding to third images grouped into a third image group (IGc). For example, the sizes of the areas on which each thumbnail image is displayed in the first thumbnail screen (301) may be the same. In the present disclosure, thumbnail images corresponding to images grouped into an image group may be referred to as thumbnail images associated with the image group or thumbnail images belonging to the image group.
[0075] According to one embodiment, thumbnail images associated with the same image group may be arranged sequentially or discontinuously within the first thumbnail screen (301). For example, as illustrated in FIG. 3, first thumbnail images (TIa1, TIa2) associated with the first image group (IGa) may be arranged sequentially with respect to one another. An example of an operation of providing an extended thumbnail image for the sequentially arranged thumbnail images is described below with reference to FIG. 5. For example, as illustrated in FIG. 3, second thumbnail images (TIb1 to TIb4 and TIb6) associated with the second image group (IGb) may be arranged discontinuously with respect to one another because another thumbnail image (TId) not associated with the second image group (IGb) is arranged between some of the thumbnail images (TIb4, TIb6). An example of an operation for providing an extended thumbnail image for discontinuously arranged thumbnail images is described below with reference to FIG. 7.
[0076] According to one embodiment, the first thumbnail screen (301) may include a scroll (310) for scrolling the screen. By scrolling the screen using the scroll (310), the user can check other thumbnail images that are not currently displayed on the first thumbnail screen (301).
[0077] According to one embodiment, the second thumbnail screen (302) may be a screen that displays expanded thumbnail image(s) according to the expanded thumbnail mode. For example, as illustrated in FIG. 3, the second thumbnail screen (302) may include a first expanded thumbnail image (ETIa) for a first image group (IGa), a second expanded thumbnail image (ETIb) for a second image group (IGb), and / or a third expanded thumbnail image (ETIc) for a third image group (IGc). The second thumbnail screen (302) may also include at least one individual thumbnail image along with at least one expanded thumbnail image.
[0078] According to one embodiment, the electronic device may obtain information about a first area in which a plurality of thumbnail images corresponding to a plurality of images grouped into an image group are displayed based on the number and / or positions of the plurality of thumbnail images, and may obtain information about a second area in which an expanded thumbnail image for the image group is displayed based on the information about the first area. The size of the first area may be equal to or greater than the sum of the respective areas occupied by each of the plurality of thumbnail images corresponding to the plurality of grouped images. According to one embodiment, the position and / or size of the second area may correspond to the position and / or size of the first area. According to one embodiment, the size of the second area may be larger than the size of one thumbnail image included in the first area and smaller than the sizes of the plurality of thumbnail images. For example, the position and size of the second area may be equal to the position and size of the first area based on the entire display area of the electronic device. For example, the second area may be an area including the first area based on the entire display area of the electronic device. In this way, by providing an expanded thumbnail image on a second thumbnail screen (302) through a second area corresponding to a first area where all individual thumbnail images are displayed on a first thumbnail screen (301), continuity of the screen for providing thumbnail images can be ensured. Through this, a user can intuitively confirm which individual thumbnail images the expanded thumbnail image is for.
[0079] According to one embodiment, in operation 430, the electronic device may obtain a representative thumbnail image based on a plurality of grouped images (or a plurality of thumbnail images corresponding to the plurality of grouped images). For example, the electronic device may obtain a first representative thumbnail image for the first image group (IGa) based on a plurality of first images grouped into the first image group (IGa). The representative thumbnail image may be a single thumbnail image representing the plurality of grouped images. In the present disclosure, the representative thumbnail image may be referred to as a representative image.
[0080] According to one embodiment, the electronic device may obtain a representative thumbnail image based on a plurality of grouped images according to a set method. For example, the electronic device may select one of the plurality of grouped images as a representative thumbnail image. For example, the electronic device may generate a representative thumbnail image through a first artificial intelligence model or a first generative artificial intelligence model (e.g., the generative AI model (260) of FIG. 2 (e.g., LMM)) based on the plurality of grouped images. The first artificial intelligence model or the first generative artificial intelligence model may be trained to generate one representative thumbnail image based on the plurality of images. The electronic device may input information about the plurality of images and / or the second region (or the first region) into the trained first generative artificial intelligence model, and obtain a representative thumbnail image output from the first generative artificial intelligence model. The size of the representative thumbnail image may be equal to or smaller than the size of the second region.
[0081] According to one embodiment, in operation 440, the electronic device may display an extended thumbnail image within a second area of the second thumbnail screen (302) based on the representative thumbnail image. For example, the electronic device may display a first extended thumbnail image (ETIa) within the second area based on the first representative thumbnail image for the first image group (IGa).
[0082] According to one embodiment, the electronic device may display a representative thumbnail image in at least a portion of the second area. For example, the electronic device may display the representative thumbnail image in the entire second area. For example, the electronic device may display the representative thumbnail image in a first portion (e.g., a central portion) within the second area. When the representative thumbnail image is displayed in the first portion within the second area, the electronic device may generate an additional thumbnail image (e.g., an additional thumbnail image using an out-painting method) to be displayed in a second portion within the second area excluding the first portion within the second area using a designated method (e.g., an out-painting method). For example, the electronic device may generate an additional thumbnail image to be displayed in a remaining portion (hereinafter, referred to as a second portion) within the second area excluding the first portion within the second area using a second artificial intelligence model or a second generative artificial intelligence model (e.g., a generative AI model (260) of FIG. 2 (e.g., LMM)) based on the representative thumbnail image. A second artificial intelligence model or a second generative artificial intelligence model may be trained to generate additional thumbnail images based on a representative thumbnail image. The electronic device may input the representative thumbnail image, information about the first partial region, and / or information about the second region (or the second partial region) into the trained second generative artificial intelligence model, and obtain an additional thumbnail image output from the second generative artificial intelligence model. The electronic device may display the additional thumbnail image in the second partial region within the second region. In this way, even if the representative thumbnail image is not sufficient to fill the second region, an extended thumbnail image including the representative thumbnail image without any empty space may be provided. An example of an operation of generating an additional thumbnail image for the empty space within the second region is described below with reference to FIGS. 5 and 7. The first artificial intelligence model and the second generative artificial intelligence model may be one and the same model.
[0083] According to the method described above in FIG. 4, a clean thumbnail screen with improved visibility can be provided by providing a single expanded thumbnail image that is larger than the individual thumbnail images, instead of displaying each individual thumbnail image.
[0084] According to one embodiment, when an event (hereinafter, referred to as a screen transition event) for transitioning from a second thumbnail screen (302) to a first thumbnail screen (301) is detected, the electronic device may transition the screen from the second thumbnail screen (302) to the first thumbnail screen (301). The screen transition event may be detected when a user input (e.g., a touch input) is received. For example, the screen transition event may be detected when a user input (e.g., a touch input) that touches at least a part of an area where the first extended thumbnail image (ETIa), the second extended thumbnail image (ETIb), or the third extended thumbnail image (ETIc) is displayed is received. The screen transition event may be detected only after a specified period (e.g., 0.5 seconds) has elapsed after scrolling by the scroll (310) has stopped. For example, even if a user input (e.g., touch input) that touches at least a part of an area where the first extended thumbnail image (ETIa), the second extended thumbnail image (ETIb), or the third extended thumbnail image (ETIc) is displayed is received within a specified period (e.g., 0.5 seconds) after the scrolling by the scroll (310) stops, a screen transition event is not detected.
[0085] FIG. 5 is a diagram illustrating an operation of an electronic device providing an expanded thumbnail image according to one embodiment of the present disclosure.
[0086] FIG. 6 is a diagram illustrating an operation of an electronic device providing an additional image associated with an expanded thumbnail image according to one embodiment of the present disclosure.
[0087] The components and operations of the components described with reference to FIGS. 5 to 6 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 4. The components and operations of the components described with reference to FIGS. 5 to 6 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 7 to 19, which will be described later.
[0088] Referring to FIG. 5, according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) may sequentially display a first screen (501) (e.g., the first thumbnail screen (301) of FIG. 3), a second screen (502), and a third screen (503) (e.g., the second thumbnail screen (302) of FIG. 3) through a display. According to one embodiment, the electronic device may display the first screen (501) and then display the third screen (503) without displaying the second screen (502). For example, the electronic device may perform at least one operation (e.g., operations 410 to 440 of FIG. 4) for displaying the third screen (503) based on detecting an event for providing an expanded thumbnail image while the first screen (501) is being displayed. In this case, the second screen (502) is not a screen that is actually displayed externally, and the third screen (503), which is the final result screen, can be displayed externally.
[0089] According to one embodiment, the first screen (501) may include a plurality of thumbnail images (TI) corresponding to a plurality of images grouped into an image group (IG). In the first screen (501), the plurality of thumbnail images (TI) may be, for example, a plurality of thumbnail images corresponding to a plurality of images including the same object (e.g., a woman) taken at the same location (e.g., Seoul) on the same date (e.g., May 15). Each thumbnail image (TI) may be displayed in the same size on the first screen (501).
[0090] According to one embodiment, the second screen (502) may include at least a portion of an extended thumbnail image (ETI) for an image group (IG). The extended thumbnail image (ETI) may include a first portion (ETI1) of the extended thumbnail image (ETI) (e.g., a central portion) and a second portion (ETI2) of the extended thumbnail image (ETI) (e.g., a left portion and / or a right portion).
[0091] According to one embodiment, in the second screen (502), the first portion (ETI1) may include at least a portion of a representative thumbnail image. According to one embodiment, the electronic device may obtain the representative thumbnail image based on a plurality of grouped images. For example, the electronic device may select an image corresponding to a first thumbnail image (e.g., a first thumbnail image of the first screen (501)) among the plurality of grouped images as the representative thumbnail image. For example, the electronic device may generate the representative thumbnail image using a first generative AI model based on the plurality of grouped images. The electronic device may display the representative thumbnail image in an area corresponding to the first portion (ETI1) (e.g., a first area portion of an expanded thumbnail area). For example, when the size of the first portion (ETI1) and the size of the representative thumbnail image are different, the electronic device may adjust the ratio of the representative thumbnail image to display the representative thumbnail image in the first portion (ETI1).
[0092] According to one embodiment, in the second screen (502), the second portion (ETI2) does not include an image. The electronic device may generate an additional thumbnail image to be displayed in an area corresponding to the second portion (ETI2) (e.g., a second area portion of an extended thumbnail area) based on the representative thumbnail image. For example, the electronic device may generate the additional thumbnail image through a second generative AI model based on the representative thumbnail image. The additional thumbnail image may include, for example, an image that expands or extends a left portion and / or a right portion of the representative thumbnail image (e.g., the representative thumbnail image of the second screen (501)).
[0093] According to one embodiment, the third screen (503) may include an extended thumbnail image (ETI) for the image group (IG). The extended thumbnail image (ETI) may include a representative thumbnail image and / or an additional thumbnail image generated based on the representative thumbnail image. The electronic device may display the generated additional thumbnail image in an area corresponding to the second portion (ETI2). Instead of displaying individual thumbnail images individually through the first screen (501), a single extended thumbnail image larger than the individual thumbnail images is provided through the third screen (503), thereby providing a neat thumbnail screen with improved readability.
[0094] According to one embodiment, the position and / or size of the second area where the expanded thumbnail image (ETI) is displayed on the third screen (503) may correspond to the position and / or size of the first area where the plurality of thumbnail images (TI) are displayed on the first screen (501). For example, the position and size of the second area may be the same as the position and size of the first area based on the entire display area of the electronic device. For example, the second area may be an area that includes the first area based on the entire display area of the electronic device. According to one embodiment, the size of the second area may be larger than the size of one thumbnail image on the first screen (501). In this way, by providing the expanded thumbnail image on the third screen (503) through the second area corresponding to the first area where all individual thumbnail images are displayed on the first screen (501), screen continuity for providing the thumbnail image may be ensured. Through this, users can intuitively check which individual thumbnail images the expanded thumbnail image is for.
[0095] Referring to FIG. 6, according to one embodiment, the electronic device may display a first screen (601) (e.g., a third screen (503) of FIG. 5) including an extended thumbnail image (ETI).
[0096] According to one embodiment, while a first screen (601) including an expanded thumbnail image (ETI) is displayed, the electronic device may obtain a user input (610) (e.g., a touch input) for at least a portion of an area (an expanded thumbnail area) corresponding to an expanded thumbnail image (ETI) within the first screen (601), and identify whether the user input (610) satisfies a specified condition. For example, the electronic device may identify that the user input (610) satisfies a specified condition if the user input (610) is a long press input that presses at least a portion of the expanded thumbnail area for a specified period of time (e.g., 1 second or more).
[0097] In one embodiment, the electronic device may, in response to identifying that a user input (610) satisfies a specified condition, display a second screen (602) that provides an additional image (620) associated with the expanded thumbnail image (ETI). The additional image (620) may be, for example, in the form of a pop-up image displayed on the expanded thumbnail image (ETI).
[0098] In one embodiment, the additional image (620) may include, for example, at least one individual thumbnail image (TI) associated with an extended thumbnail image (ETI). For example, if the extended thumbnail image (ETI) is an extended thumbnail image for the individual thumbnail images (TI) of the first screen (501) of FIG. 5, the additional image (620) may include at least a portion of the individual thumbnail images (TI), as illustrated in FIG. 6. If the additional image (620) currently displayed on the second screen (602) includes only a portion of the individual thumbnail images (TI) associated with the extended thumbnail image (ETI), the second screen (502) may include a scroll (e.g., a scroll (310) of FIG. 3) associated with the additional image (620). In this case, the user can scroll through the portion of the screen where additional images (620) are displayed to view the remaining portions of the individual thumbnail images (TI).
[0099] According to one embodiment, the electronic device may switch the screen from the second screen (602) to the first screen (601) when an event (hereinafter referred to as a screen switching event) for switching from the second screen (602) on which the additional image (620) is displayed to the first screen (601) is detected. The screen switching event may be detected, for example, when a user input (e.g., a touch input) touching at least a portion of an area on which the additional image (620) is displayed is received.
[0100] FIG. 7 is a diagram illustrating an operation of an electronic device providing an expanded thumbnail image according to one embodiment of the present disclosure.
[0101] The components and operations of the components described with reference to FIG. 7 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 6. The components and operations of the components described with reference to FIG. 7 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 8 to 19, which will be described later.
[0102] In the embodiment of FIG. 7, it is assumed that at least one second thumbnail image (TIb) that does not belong to the first image group (IGa) is arranged between first thumbnail images (TIa) belonging to the first image group (IGa) on the first screen (701).
[0103] Referring to FIG. 7, according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) may sequentially display a first screen (701) (e.g., the first thumbnail screen (301) of FIG. 3) and a second screen (702) (e.g., the second thumbnail screen (302) of FIG. 3) through a display. For example, the electronic device may perform at least one operation (e.g., operations 410 to 440 of FIG. 4) to display the second screen (702) based on detecting an event for providing an expanded thumbnail image while the first screen (701) is being displayed.
[0104] According to one embodiment, the first screen (701) may include a plurality of first thumbnail images (TIa) corresponding to a plurality of first images grouped into a first image group (IGa), at least one second thumbnail image (TIb) corresponding to at least one second image not grouped into the first image group (IGa), and / or at least one third thumbnail image (TIc) corresponding to at least one third image not grouped into the first image group (IGa). The plurality of first thumbnail images (TIa) and the at least one second thumbnail image (TIb) may be displayed within a first area (A1) in the first screen (701). The at least one third thumbnail image (TIc) may be displayed outside the first area (A1) in the first screen (701).
[0105] According to one embodiment, the first thumbnail image (TIa) and the second thumbnail image (TIb) may be thumbnail images corresponding to images that are not related to each other. For example, the first thumbnail image (TIa) and the second thumbnail image (TIb) may be thumbnail images corresponding to images that differ in at least one attribute. The at least one attribute may include, for example, a shooting date, a shooting location, and / or an object included in the captured image. For example, as illustrated in FIG. 7, a first thumbnail image (TIa) may be a thumbnail image corresponding to an image including a first object (e.g., the Eiffel Tower) taken at a first location (e.g., Paris) on a first date (e.g., May 15), and a second thumbnail image (TIb) may be a thumbnail image corresponding to an image including a second object (e.g., ice cream) different from the first object (e.g., the Eiffel Tower) taken at the first location (e.g., Paris) on a first date (e.g., May 15). Therefore, the first thumbnail image (TIa) and the second thumbnail image (TIb) cannot be grouped into the same image group.
[0106] According to one embodiment, the second screen (702) may include a first extended thumbnail image (ETIa), at least one second thumbnail image (TIb), and / or at least one third thumbnail image (TIc) for the first image group (IGa). The extended thumbnail image (ETIa) may be displayed within a second area (A2) of the second screen (702). The at least one second thumbnail image (TIb) and the at least one third thumbnail image (TIc) may be displayed outside the second area (A2) of the second screen (702).
[0107] According to one embodiment, the second area (A2) in which the first extended thumbnail image (ETIa) is displayed in the second screen (702) may correspond to the first area (A1) in which the first thumbnail images (TIa) and at least one second thumbnail image (TIb) are displayed in the first screen (701). For example, based on the entire display area of the electronic device, the position and size of the second area (A2) may be the same as the position and size of the first area (A1). For example, based on the entire display area of the electronic device, the second area (A2) may be an area that includes the first area (A1). In this way, a neat thumbnail screen with guaranteed screen continuity can be provided by providing a single extended thumbnail image throughout the entire second area (A2) corresponding to the first area (A1) in which grouped thumbnail images and other thumbnail images arranged between the grouped thumbnail images are displayed, that is, including a portion corresponding to a portion in which other thumbnail images (e.g., the second thumbnail image TIb) of the first area (A1) are displayed within the second area (A2).
[0108] According to one embodiment, at least one second thumbnail image (TIb) displayed in the first area (A1) of the first screen (701) may be displayed by moving to the outside of the second area (A2) of the second screen (702). For example, as illustrated in FIG. 7, the third thumbnail image (TIc) may be displayed outside the second area (A2) of the second screen (702) at the same location as that displayed in the first screen (701), and the second thumbnail image (TIb) may be displayed outside the second area (A2) of the second screen (702) after the third thumbnail image (TIc). Meanwhile, according to one embodiment, at least one second thumbnail image (TIb) displayed in the first area (A1) of the first screen (701) may be displayed at the location immediately following that outside the second area (A2) of the second screen (702). For example, in the second screen (702), the second thumbnail image (TIb) may be displayed at the position of the third thumbnail image (TIc) illustrated in FIG. 7, and the third thumbnail image (TIc) may be displayed at the position of the second thumbnail image (TIb) illustrated in FIG. 7.
[0109] According to one embodiment, the first extended thumbnail image (ETIa) may include a first portion (ETIa1) (e.g., an upper portion) of the first extended thumbnail image (ETIa) and a second portion (ETIa2) (e.g., a lower portion) of the first extended thumbnail image (ETIa). The size of the first portion (ETIa1) may be different from the size of the second portion (ETIa2).
[0110] According to one embodiment, in the second screen (702), the first portion (ETIa1) may include at least a portion of a representative thumbnail image. According to one embodiment, the electronic device may obtain the representative thumbnail image based on the first plurality of grouped images. For example, the electronic device may select an image corresponding to a fifth thumbnail image (e.g., the fifth thumbnail image of the first screen (701)) among the first plurality of grouped images as the representative thumbnail image. For example, the electronic device may generate the representative thumbnail image using a first generative AI model based on the first plurality of grouped first images. The electronic device may display the representative thumbnail image in an area corresponding to the first portion (ETIa1) (e.g., a first area portion of an expanded thumbnail area). For example, when the size of the first portion (ETIa1) and the size of the representative thumbnail image are different, the electronic device may adjust the ratio of the representative thumbnail image to display the representative thumbnail image in the first portion (ETIa1).
[0111] According to one embodiment, in the second screen (702), the second portion (ETIa2) may include the remaining portion of the representative thumbnail image or an additional thumbnail image. For example, if the representative thumbnail image is an image suitable for filling both the first portion (ETIa1) and the second portion (ETIa2), the electronic device may display the representative thumbnail image in both the first portion (ETIa1) and the second portion (ETIa2). For example, if the representative thumbnail image is not an image suitable for filling both the first portion (ETIa1) and the second portion (ETIa2), the electronic device may display the representative thumbnail image in the first portion (ETIa1) and display an additional thumbnail image in the second portion (ETIa2). In this case, the electronic device may generate an additional thumbnail image to be displayed in an area corresponding to the second portion (ETI2) (e.g., a second area portion of the expanded thumbnail area) based on the representative thumbnail image. For example, the electronic device may generate an additional thumbnail image using a second generative AI model based on the representative thumbnail image. The additional thumbnail image may include, for example, an image that expands or extends a lower portion of the representative thumbnail image (e.g., the representative thumbnail image of the second screen (702)).
[0112] FIG. 8 is a diagram illustrating an operation of an electronic device providing an extended thumbnail image having a format of a motion image according to one embodiment of the present disclosure.
[0113] The components and operations of the components described with reference to Fig. 8 may be partially or entirely identical to the components and operations of the components described with reference to Figs. 1 to 7. The components and operations of the components described with reference to Fig. 8 may be partially or entirely identical to the components and operations of the components described with reference to Figs. 9 to 19, which will be described later.
[0114] In the embodiment of FIG. 8, it is assumed that the extended thumbnail image is provided in the format of a motion image.
[0115] Referring to FIG. 8, according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) may sequentially display a first screen (801) (e.g., the first thumbnail screen (301) of FIG. 3) and a second screen (802) (e.g., the second thumbnail screen (302) of FIG. 3) through a display. For example, the electronic device may perform at least one operation (e.g., operations 410 to 440 of FIG. 4) for displaying the second screen (802) based on detecting an event for providing an expanded thumbnail image (e.g., an event for providing an expanded thumbnail image having a format of a motion image) while the first screen (801) is being displayed.
[0116] According to one embodiment, the first screen (801) may include a plurality of thumbnail images (TI) corresponding to a plurality of images grouped into an image group (IG). In the first screen (801), the plurality of thumbnail images (TI) may be, for example, a plurality of thumbnail images corresponding to a plurality of images containing the same object (e.g., a woman) taken at the same location (e.g., Seoul) on the same date (e.g., May 15).
[0117] According to one embodiment, a plurality of images grouped into an image group (IG) may include images including a continuous motion. For example, as illustrated in FIG. 8, the plurality of images grouped into an image group (IG) may include images including a continuous motion of drinking coffee (e.g., images corresponding to the three thumbnail images (TI) displayed on the first screen (801) above). The electronic device may organize the images including the continuous motion within the image group (IG) into an image sequence (IS). The electronic device may obtain (or generate) an extended thumbnail image having a format of a motion image (e.g., GIF format, MP4 format) based on the images included in the image sequence (IS). For example, the electronic device may generate an extended thumbnail image having a format of a motion image through a generative AI model (e.g., the generative AI model (260) of FIG. 2 (e.g., LMM)) based on the images included in the image sequence (IS).
[0118] According to one embodiment, the second screen (802) may include an extended thumbnail image (ETI) in the form of a motion image, and at least one thumbnail image (TI). The at least one thumbnail image (TI) may be at least one thumbnail image (TI) that is not composed of an image sequence (IS) within an image group (IG) (e.g., images corresponding to the three thumbnail images (TI) below displayed on the first screen (801)). According to one embodiment, the at least one thumbnail image (TI) may be positioned adjacent to the extended thumbnail image (ETI). For example, the at least one thumbnail image (TI) may be positioned at a left portion, a right portion, an upper portion, or a lower portion of the extended thumbnail image (ETI).
[0119] FIGS. 9A to 9C are diagrams illustrating an operation of an electronic device providing a customized expanded thumbnail image according to one embodiment of the present disclosure.
[0120] The components and operations of the components described with reference to FIGS. 9A to 9C may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 8. The components and operations of the components described with reference to FIGS. 9A to 9C may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 10 to 19, which will be described later.
[0121] In the embodiments of FIGS. 9A to 9C, it is assumed that customized extended thumbnail images are provided using individual thumbnail images. In the embodiments of FIGS. 9A to 9C, for convenience of explanation, the customized extended thumbnail images are described as extended thumbnail images having the format of motion images, but are not limited thereto.
[0122] Referring to FIG. 9A, according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) may sequentially display a first screen (901) (e.g., the first thumbnail screen (301) of FIG. 3), a second screen (902), and a third screen (903) through a display. For example, while the first screen (901) is displayed, the electronic device may perform at least one operation (e.g., operations 410 to 440 of FIG. 4) for generating and providing a customized expanded thumbnail image based on detecting an event for providing an expanded thumbnail image (e.g., an execution event of an expanded thumbnail mode).
[0123] According to one embodiment, the first screen (901) may include at least one first thumbnail image (TIa), at least one second thumbnail image (TIb), and / or a user interface (900) for selecting a thumbnail mode. The thumbnail mode may be, for example, an AI clean view mode (expanded thumbnail mode) or an AI thumbnail mode (thumbnail reconstruction mode). The electronic device may obtain a user input (e.g., a touch input) for selecting a thumbnail mode through the user interface (900), and may identify the selected thumbnail mode (e.g., the AI clean view mode) based on the user input. Hereinafter, for convenience of explanation, an example in which the AI clean view mode is selected as the thumbnail mode, as illustrated in the first screen (901), will be described.
[0124] In one embodiment, the second screen (902) may include information indicating that an expanded thumbnail image is being generated according to the selected AI Clean View mode. While the second screen (901) is displayed, the electronic device may perform at least one operation (e.g., operations 410 to 440 of FIG. 4 ) to generate the expanded thumbnail image.
[0125] According to one embodiment, the third screen (903) may provide at least some of the thumbnail images displayed on the first screen (901) in a selectable form. For example, the third screen (903) may provide at least one first thumbnail image (TIa) and / or at least one second thumbnail image (TIb) displayed on the first screen (901) in a selectable form. The electronic device may obtain a user input (e.g., a touch input) for selecting at least one thumbnail image for providing a customized extended thumbnail image through the third screen (903), and may identify at least one thumbnail image (e.g., the first thumbnail images (TIa)) selected based on the user input. For convenience of explanation, the following description will be made as an example in which the first thumbnail images (TIa) having a continuous motion, as illustrated in the third screen (904), are selected for providing a customized extended thumbnail image.
[0126] Referring to FIGS. 9b and 9c, according to one embodiment, the electronic device may sequentially display a fourth screen (904b, 904c) and a fifth screen (905b, 905c) through the display. The fourth screen (904b, 904c) may be a screen provided after the third screen (903) of FIG. 9a.
[0127] According to one embodiment, the fourth screen (904b, 904c) may include a user interface (910) for selecting a thumbnail format (or, reconstruction method) to be generated. The user interface (910) may include at least one selectable item for selecting a thumbnail format to be generated. The at least one selectable item may include a blur processing item, a person selection item, a random generation item, an emoji item, and / or a direct input item. In the example of FIG. 9b, it is assumed that a random generation item is selected through the user interface (910), and in the example of FIG. 9c, it is assumed that a direct input item is selected through the user interface (910).
[0128] According to one embodiment, the fifth screen (905b, 905c) may include a customized extended thumbnail image (ETIa) and / or at least one thumbnail image (TIb). The electronic device may generate the customized extended thumbnail image (ETIa) based on the thumbnail images selected through the third screen (903) and the thumbnail format selected through the fourth screen (904b, 904c).
[0129] For example, as in FIG. 9a, if the thumbnail images selected through the third screen (903) are first thumbnail images (TIa) showing continuous movements of a person riding a snowboard, and as in FIG. 9b, if the thumbnail format selected through the fourth screen (904b) is a randomly generated format corresponding to a randomly generated item, the electronic device can provide a customized extended thumbnail image (ETIa) having a format (e.g., GIF format) of a motion image in which the person riding a snowboard is randomly replaced with another image (e.g., replaced with a penguin riding a snowboard) through the fifth screen (905b), as in FIG. 9b. As illustrated in FIG. 9b, the motion images (e.g., images showing continuous motion of a penguin snowboarding) that constitute the customized extended thumbnail image (ETIa) of the fifth screen (905b) may be images randomly reconstructed (e.g., replacing a person with a penguin) from the thumbnail images selected through the third screen (903) (e.g., images showing continuous motion of a person snowboarding).
[0130] For example, as in FIG. 9a, if the thumbnail images selected through the third screen (903) are first thumbnail images (TIa) showing continuous movements of a person riding a snowboard, and as in FIG. 9c, if the thumbnail format selected through the fourth screen (904c) is a generated format corresponding to the input content of the direct input item, “Make a person turn into a penguin,” the electronic device can provide, as in FIG. 9c, a customized extended thumbnail image (ETIa) having a format (e.g., GIF format) of a motion image showing the movement of a person riding a snowboard turning into a penguin corresponding to the directly input generated format, through the fifth screen (905c). As illustrated in FIG. 9c, the motion images (e.g., images showing continuous motion of a penguin riding a snowboard) that constitute the customized extended thumbnail image (ETIa) of the fifth screen (905c) may be images that are reconstructed (e.g., reconstructed to show the process of a person changing into a penguin) using content directly input by the user from the thumbnail images selected through the third screen (903) (e.g., images showing continuous motion of a person riding a snowboard).
[0131] FIGS. 10A and 10B are diagrams illustrating an operation of an electronic device providing a customized extended thumbnail image according to one embodiment of the present disclosure.
[0132] The components and operations of the components described with reference to FIGS. 10a and 10b may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 9c. The components and operations of the components described with reference to FIGS. 10a and 10b may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 11 to 19, which will be described later.
[0133] In the embodiments of FIGS. 10A and 10B, it is assumed that a customized extended thumbnail image is provided using an extended thumbnail image. The extended thumbnail image used to provide the customized extended thumbnail image can be obtained, for example, using the method described above with reference to FIGS. 3 to 9C. In the embodiments of FIGS. 10A and 10B, for convenience of explanation, an example is given in which the customized extended thumbnail image is generated based on an extended thumbnail image having a motion image format, but the present invention is not limited thereto.
[0134] Referring to FIGS. 10A and 10B , according to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 ) may sequentially display a first screen (1001) (e.g., the second thumbnail screen (302) of FIG. 3 ), a second screen (1002), a third screen (1003), a fourth screen (1004), and a fifth screen (903) through a display. For example, while the first screen (1001) is displayed, the electronic device may perform at least one operation (e.g., operations 410 to 440 of FIG. 4 ) for generating and providing a customized extended thumbnail image based on detecting an event (e.g., an execution event of an AI thumbnail mode) for providing a customized extended thumbnail image.
[0135] According to one embodiment, the first screen (1001) may include a first extended thumbnail image (ETIa), at least one second thumbnail image (TIb), and / or a user interface (1000) for selecting a thumbnail mode. The thumbnail mode may be, for example, an AI clean view mode (extended thumbnail mode) or an AI thumbnail mode (thumbnail reconstruction mode). The electronic device may obtain a user input (e.g., a touch input) for selecting a thumbnail mode (e.g., an AI thumbnail mode) through the user interface (1000), and may identify the selected thumbnail mode (e.g., an AI thumbnail mode) based on the user input. Hereinafter, for convenience of explanation, an example in which the AI thumbnail mode is selected as the thumbnail mode, as illustrated in the first screen (1001), will be described.
[0136] According to one embodiment, the second screen (1002) can provide the first extended thumbnail image (ETIa) and at least one second thumbnail image (TIb) displayed on the first screen (1001) in a selectable form. The electronic device can obtain a user input (e.g., a touch input) for selecting an extended thumbnail image for providing a customized extended thumbnail image through the second screen (1002), and can identify the selected extended thumbnail image based on the user input. Hereinafter, for convenience of explanation, it will be described as an example that the first extended thumbnail image (ETIa) having the format of a motion image, as illustrated in the second screen (1002), is selected for providing a customized extended thumbnail image.
[0137] According to one embodiment, the third screen (1003) may include a user interface (1010) for selecting a thumbnail format (or, a reconstruction method) to be generated. The user interface (1010) may include at least one selectable item for selecting the thumbnail format to be generated. The at least one selectable item may include a blur processing item, a reference selection item, a random generation item, an emoji item, and / or a direct input item. The electronic device may obtain a user input (e.g., a touch input) for selecting a thumbnail format to be generated through the user interface (1010) and identify the selected thumbnail format based on the user input. For convenience of explanation, the following description will be made by taking as an example the case where the reference selection item is selected through the user interface (1010) as illustrated in the third screen (1003).
[0138] According to one embodiment, the fourth screen (1004) may include a user interface for selecting a reference image corresponding to a reference selection item. The electronic device may identify a search word (e.g., board) for searching for a reference image entered in a search box, and may provide at least one reference image (e.g., a board image) found based on the search word through the fourth screen (1004). The at least one found reference image may be provided in a selectable form. The electronic device may obtain a user input (e.g., a touch input) for selecting one of the at least one found reference image, identify the selected reference image based on the user input, and customize the selected extended thumbnail image based on the selected reference image to generate a customized extended thumbnail image. For example, the electronic device may customize the selected first extended thumbnail image (ETIa) based on the selected reference image (e.g., an image of another person's snowboard) to generate a customized first extended thumbnail image (ETIa'). The first extended thumbnail image (ETIa) may be an extended thumbnail image in a motion image format showing a continuous motion of a user snowboarding, as exemplified in the first screen (1001), and the customized first extended thumbnail image (ETIa') may be a customized extended thumbnail image in a motion image format showing a continuous motion of another person snowboarding, as exemplified in the fifth screen (1005), for example. The continuous motion of snowboarding in the first extended thumbnail image (ETIa) and the customized first extended thumbnail image (ETIa') may be similar to each other.
[0139] According to one embodiment, the fifth screen (1004) may include a customized extended thumbnail image (ETIa') and / or at least one second thumbnail image (TIb).
[0140] FIG. 11 is a flowchart illustrating a method for an electronic device to reconstruct a thumbnail image according to one embodiment of the present disclosure.
[0141] FIG. 12 is a diagram illustrating thumbnail images provided according to a thumbnail reconstruction mode according to one embodiment of the present disclosure.
[0142] The components and operations of the components described with reference to FIGS. 11 to 12 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 10b. The components and operations of the components described with reference to FIGS. 11 to 12 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 13 to 19, which will be described later.
[0143] Referring to FIGS. 11 and 12 , according to one embodiment, in operation 1110, an electronic device (e.g., the electronic device (101) of FIG. 1 ) may select at least one thumbnail image to be reconstructed from a plurality of thumbnail images based on a detection of an event for reconstructing a thumbnail image. The at least one thumbnail image to be reconstructed may include, but is not limited to, a thumbnail image including sensitive information, a thumbnail image including a specific person, a thumbnail image associated with a specific expression, a thumbnail image directly selected by a user, and / or a thumbnail image satisfying content (e.g., a condition) directly input by a user.
[0144] According to one embodiment, an event for reconstructing a thumbnail image (hereinafter referred to as a second event) may be detected, for example, based on execution (or activation) of the thumbnail reconstruction mode or setting of configuration information for the thumbnail reconstruction mode while the thumbnail reconstruction mode is executed (or activated). For example, the electronic device may identify that the second event has been detected when the thumbnail reconstruction mode is executed (or activated) or when configuration information for the thumbnail reconstruction mode is set while the thumbnail reconstruction mode is executed (or activated).
[0145] According to one embodiment, the thumbnail reconstruction mode may be executed based on receiving an input for executing the thumbnail reconstruction mode or satisfying a specified condition for executing the thumbnail reconstruction mode. For example, the electronic device may execute the thumbnail reconstruction mode when receiving an input for executing the thumbnail reconstruction mode or satisfying a specified condition for executing the thumbnail reconstruction mode.
[0146] According to one embodiment, the input for executing the thumbnail reconstruction mode may include, for example, a user input (e.g., a touch input) for selecting a thumbnail reconstruction mode among the thumbnail modes through a user interface (e.g., a user interface (900) of FIG. 9A, a user interface (1000) of FIG. 10A) and / or a gesture input of an electronic device corresponding to the thumbnail reconstruction mode (hereinafter, referred to as a device gesture input).
[0147] According to one embodiment, a device gesture input corresponding to the thumbnail reconstruction mode (hereinafter referred to as a second device gesture input) may be different from a device gesture input corresponding to the expanded thumbnail mode (hereinafter referred to as a first device gesture input). For example, the first device gesture input may be a gesture input of tilting the electronic device left or right once, and the second device gesture input may be a gesture input of tilting the electronic device left or right twice. For example, the first device gesture input may be a gesture input of tilting the electronic device left or right, and the second device gesture input may be a gesture input of tilting the electronic device inward. The electronic device may identify the device gesture input using at least one sensor, and execute the thumbnail reconstruction mode or the expanded thumbnail mode according to the identified device gesture input.
[0148] According to one embodiment, the configuration information for the thumbnail reconstruction mode may include configuration information for selecting at least one thumbnail image to which thumbnail reconstruction will be applied and / or configuration information for selecting a thumbnail reconstruction method (or format). In the present disclosure, the thumbnail reconstruction method may be abbreviated as a reconstruction method.
[0149] According to one embodiment, the electronic device may select at least one thumbnail image to be reconstructed from a plurality of thumbnail images. For example, as illustrated in FIG. 12, the electronic device may select at least one thumbnail image (e.g., TI2, TI4, and / or TI6) to be reconstructed from a plurality of thumbnail images (e.g., TI1 to TI8) provided through the first screen (1201). The first screen (1201) and the second screen (1202) may include a scroll (310) associated with the thumbnail images. For a description of the scroll (310), refer to the description of FIG. 3.
[0150] According to one embodiment, the electronic device may select at least one thumbnail image via a first user interface for selecting a thumbnail image to be reconstructed (e.g., the first user interface 1410 of FIGS. 14a, 15a, 16a, and 17a). The first user interface may include at least one first selectable item for selecting the thumbnail image to be reconstructed. The at least one first selectable item may include, for example, a sensitive information item for selecting a thumbnail image including sensitive information, an AI facial expression analysis item for selecting a thumbnail image through AI facial expression analysis, a person selection item for selecting a thumbnail image including a specific person, a direct selection item for directly selecting a thumbnail image, and / or a direct input item for selecting a thumbnail image based on directly input content. The electronic device may obtain a user input (e.g., a touch input) for selecting one of the first selectable items via the first user interface, identify the selected item based on the user input, and select at least one thumbnail image to be reconstructed based on the selected item.
[0151] According to one embodiment, in operation 1120, the electronic device may select a reconstruction method for reconstructing at least one thumbnail image. The reconstruction method may include, but is not limited to, blurring the thumbnail image, replacing a specific person in the thumbnail image with a substitute person, replacing a specific object (e.g., a face) in the thumbnail image with another object (e.g., an emoji), omitting the thumbnail image, and / or reconstructing the thumbnail image based on content directly input by the user (e.g., a condition).
[0152] According to one embodiment, the electronic device may select a reconstruction method through a second user interface (e.g., the second user interface 1420 of FIGS. 14a, 15a, 16a, and 17a) for selecting a reconstruction method. The second user interface may include at least one second selectable item for selecting a reconstruction method. The at least one second selectable item may include, for example, a blur processing item for blurring a thumbnail image, a person selection item for replacing a person in the thumbnail image with a substitute person, an emoji item for replacing at least a portion of the thumbnail image with an emoji, an omission item for omitting the thumbnail image, and / or a direct input item for selecting a reconstruction method based on directly input content. The electronic device may obtain a user input (e.g., a touch input) for selecting one of the second selectable items through the second user interface, identify the selected item based on the user input, and select the reconstruction method based on the selected item.
[0153] According to one embodiment, in operation 1130, the electronic device may reconstruct at least one selected thumbnail image according to the selected reconstruction method. Examples of reconstructing thumbnail images according to the reconstruction method are described below with reference to FIGS. 13 to 18.
[0154] In one embodiment, the electronic device may provide at least one reconstructed thumbnail image through the second screen (1202). For example, the electronic device may provide at least one reconstructed thumbnail image (e.g., TI2', TI4', and / or TI6') through the second screen (1202).
[0155] According to one embodiment, the second area where the reconstructed thumbnail images (e.g., TI2', TI4', TI6') are displayed may correspond to the first area where the thumbnail images (e.g., TI2, TI4, TI6) are displayed before being reconstructed. For example, with respect to the entire display area, the position and size of the first area where the reconstructed thumbnail images (e.g., TI2', TI4', TI6') are displayed may be the same as the position and size of the second area where the thumbnail images (e.g., TI2, TI4, TI6) are displayed before being reconstructed. For example, with respect to the entire display area, the first area where the reconstructed thumbnail images (e.g., TI2', TI4', TI6') are displayed may be an area that includes the second area where the thumbnail images (e.g., TI2, TI4, TI6) are displayed before being reconstructed.
[0156] In the embodiment of FIG. 11 described above, operations 1110, 1120, and 1130 may be performed after the thumbnail reconstruction mode is executed, but are not limited thereto. For example, operations 1110 and 1120 may be performed as setup operations for the thumbnail reconstruction mode before the thumbnail reconstruction mode is executed, and operation 1130 may be performed after the thumbnail reconstruction mode is executed (e.g., after the thumbnail reconstruction mode is executed in response to identifying a device gesture input tilting the electronic device inward).
[0157] FIG. 13 is a diagram illustrating examples of thumbnail images according to one embodiment of the present disclosure.
[0158] FIGS. 14A and 14B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image containing sensitive information according to one embodiment of the present disclosure.
[0159] FIGS. 15A and 15B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image including a specific object according to one embodiment of the present disclosure.
[0160] FIGS. 16A and 16B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image using facial recognition according to one embodiment of the present disclosure.
[0161] FIGS. 17A and 17B are diagrams illustrating an operation of an electronic device reconstructing a thumbnail image using facial expression analysis according to one embodiment of the present disclosure.
[0162] The components and operations of the components described with reference to FIGS. 13 to 17b may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 12. The components and operations of the components described with reference to FIGS. 13 to 17b may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 18 to 19, which will be described later.
[0163] Referring to FIG. 13, the electronic device may provide (e.g., display) a plurality of thumbnail images (TI1 to TI7) through a thumbnail screen (1301) (e.g., the first thumbnail screen (301) of FIG. 3). The plurality of thumbnail images (TI1 to TI7) may include thumbnail images of various objects, properties, and / or characteristics. For example, as illustrated in FIG. 13, the plurality of thumbnail images (TI1 to TI7) may include, but are not limited to, thumbnail images (TI1, TI2) including a first person (e.g., a first woman), a thumbnail image (TI3) including a second person (e.g., a first man), a thumbnail image (TI4) including a third person and a fourth person (e.g., a second woman and a second man), a thumbnail image (TI5) including sensitive information (e.g., a name, a date of birth), and thumbnail images (TI6, TI6) including a first object (e.g., food).
[0164] Referring to FIGS. 14A and 14B , according to one embodiment, an electronic device may select at least one thumbnail image to be reconstructed from a plurality of thumbnail images. For example, the electronic device may select at least one thumbnail image through a first user interface (1410) for selecting a thumbnail image to be reconstructed, which is displayed on a first screen (1401). According to one embodiment, the first user interface (1410) may include at least one first selectable item for selecting a thumbnail image to be reconstructed. The at least one first selectable item may include, for example, a sensitive information item for selecting a thumbnail image including sensitive information, an AI facial expression analysis item for selecting a thumbnail image through AI facial expression analysis, a person selection item for selecting a thumbnail image including a specific person, a direct selection item for directly selecting a thumbnail image, and / or a direct input item for selecting a thumbnail image based on directly input content. The electronic device may obtain a user input (e.g., a touch input) for selecting one of the first selectable items through the first user interface (1410), identify the selected item based on the user input, and select at least one thumbnail image to be reconstructed based on the selected item. For example, as illustrated in the first screen (1401), when a sensitive information item is selected through the first user interface (1410), the electronic device may select a thumbnail image (TI5) including the sensitive information from a plurality of thumbnail images (TI1 to TI7).
[0165] According to one embodiment, the electronic device may select a reconstruction method for reconstructing at least one selected thumbnail image. For example, the electronic device may select the reconstruction method through a second user interface (1420) for selecting a reconstruction method displayed on a second screen (1402). According to one embodiment, the second user interface (1420) may include at least one second selectable item for selecting the reconstruction method. The at least one second selectable item may include, for example, a blur processing item for blurring a thumbnail image, a person selection item for replacing a person in the thumbnail image with a substitute person, an emoji item for replacing at least a portion of the thumbnail image with an emoji, an omission item for omitting the thumbnail image, and / or a direct input item for selecting a reconstruction method based on directly input content. The electronic device may obtain a user input (e.g., a touch input) for selecting one of the second selectable items through the second user interface (1420), identify the selected item based on the user input, and select a reconstruction method based on the selected item. For example, as illustrated in the second screen (1402), if a blur processing item is selected, the electronic device may select a method for blurring the thumbnail image in a reconstructed manner. In the embodiment of FIG. 14, the second screen (1402) is illustrated as being displayed after the first screen (1401), but this is not limited thereto. For example, the second screen (1402) may also be displayed before the first screen (1401).
[0166] According to one embodiment, the electronic device may reconstruct at least one selected thumbnail image according to the selected reconstruction method and provide the reconstructed at least one thumbnail image through the third screen (1403). For example, the electronic device may blur the selected thumbnail image (TI5) according to the selected blur processing method and provide the blurred thumbnail image (TI5) through the third screen (1403). Such blur processing may prevent sensitive information from being exposed externally through the thumbnail image.
[0167] Referring to FIGS. 15A and 15B , according to one embodiment, an electronic device may select at least one thumbnail image to be reconstructed from a plurality of thumbnail images. For example, the electronic device may select at least one thumbnail image through a first user interface (1410) for selecting a thumbnail image to be reconstructed, which is displayed on a first screen (1501). The electronic device may obtain a user input (e.g., a touch input) for selecting one of the first selectable items through the first user interface (1410), identify the selected item based on the user input, and select at least one thumbnail image to be reconstructed based on the selected item. For example, as illustrated in the first screen (1501), when a direct input item is selected through the first user interface (1410) and the directly input content is a food photo, the electronic device may select a thumbnail image (TI6, TI7) including a food photo from the plurality of thumbnail images (TI1 to TI7).
[0168] According to one embodiment, the electronic device may select a reconstruction method for reconstructing at least one selected thumbnail image. For example, the electronic device may select the reconstruction method through a second user interface (1420) for selecting a reconstruction method displayed on a second screen (1502). The electronic device may obtain a user input (e.g., a touch input) for selecting one of the second selectable items through the second user interface (1420), identify the selected item based on the user input, and select a reconstruction method based on the selected item. For example, as illustrated in the second screen (1502), if an omission item is selected, the electronic device may select a method for processing thumbnail images by omitting them as the reconstruction method. In the embodiment of FIG. 15, the second screen (1502) is illustrated as being displayed after the first screen (1501), but is not limited thereto. For example, the second screen (1502) may be displayed before the first screen (1501).
[0169] According to one embodiment, the electronic device may reconstruct at least one selected thumbnail image according to the selected reconstruction method, and provide the at least one reconstructed thumbnail image through the third screen (1503). For example, the electronic device may omit the selected thumbnail images (TI6, TI7) according to the selected omission processing method, and the omitted thumbnail images (TI6, TI7) are not provided through the third screen (1503). The electronic device may display another thumbnail image (TI8) at a position of the third screen (1503) corresponding to a position where the omitted thumbnail images (TI6, TI7) were displayed in a previous screen (e.g., the thumbnail screen (1301) of FIG. 13). Through such omission processing, for example, an image that a user does not want to be exposed externally can be prevented from being exposed externally through a thumbnail image.
[0170] Referring to FIGS. 16A and 16B , according to one embodiment, an electronic device may select at least one thumbnail image to be reconstructed from a plurality of thumbnail images. For example, the electronic device may select at least one thumbnail image through a first user interface (1410) for selecting a thumbnail image to be reconstructed, which is displayed on a first screen (1601). The electronic device may obtain a user input (e.g., a touch input) for selecting one of the first selectable items through the first user interface (1410), identify the selected item based on the user input, and select at least one thumbnail image to be reconstructed based on the selected item. For example, as illustrated in the first screen (1601), when a person selection item is selected through the first user interface (1410), the electronic device may display a second screen (1602) including a user interface for person selection. A user interface for selecting a person may include, for example, a search box for entering a search term (e.g., "Kim Ki-beom") to search for a person to be selected. The electronic device may identify the search term (e.g., "Kim Ki-beom") based on a user input (e.g., a user's keyboard input) entered into the search box, and select a thumbnail image (TI3) containing a person (e.g., "Kim Ki-beom") corresponding to the search term from a plurality of thumbnail images (TI1 to TI7) based on the search term.
[0171] According to one embodiment, the electronic device may select a reconstruction method for reconstructing at least one selected thumbnail image. For example, the electronic device may select the reconstruction method through a second user interface (1420) for selecting a reconstruction method displayed on a third screen (1603). The electronic device may obtain a user input (e.g., a touch input) for selecting one of the second selectable items through the second user interface (1420), identify the selected item based on the user input, and select a reconstruction method based on the selected item. For example, as illustrated in the third screen (1603), if a random generation item is selected, the electronic device may select a method for randomly processing thumbnail images as the reconstruction method. In the embodiment of FIG. 16, the second screen (1602) is illustrated as being displayed after the first screen (1601), but is not limited thereto. For example, the second screen (1602) may be displayed before the first screen (1601).
[0172] According to one embodiment, the electronic device may reconstruct at least one selected thumbnail image according to the selected reconstruction method, and provide the at least one reconstructed thumbnail image through the fourth screen (1604). For example, the electronic device may randomly process (e.g., replace with another person) the selected thumbnail image (TI3) according to the selected random processing method, and provide the randomly processed thumbnail image (TI3) through the fourth screen (1604). As illustrated in the fourth screen (1604), the randomly processed thumbnail image (TI3) may be an image that is processed to be difficult to identify as the same person by removing glasses and adding a beard. Through such person replacement processing, for example, an image of a copyrighted person can be prevented from being externally exposed through a thumbnail image.
[0173] Referring to FIGS. 17A and 17B , according to one embodiment, the electronic device may select at least one thumbnail image to be reconstructed from a plurality of thumbnail images. For example, the electronic device may select at least one thumbnail image through a first user interface (1410) for selecting a thumbnail image to be reconstructed, which is displayed on a first screen (1701). The electronic device may obtain a user input (e.g., a touch input) for selecting one of the first selectable items through the first user interface (1410), identify the selected item based on the user input, and select at least one thumbnail image to be reconstructed based on the selected item. For example, as illustrated in the first screen (1701), when an AI facial expression analysis item is selected through the first user interface (1410), the electronic device may select a thumbnail image (TI2) including an unusual facial expression (e.g., a nosebleed facial expression) based on the AI facial expression analysis from the plurality of thumbnail images (TI1 to TI7).
[0174] According to one embodiment, the electronic device may select a reconstruction method for reconstructing at least one selected thumbnail image. For example, the electronic device may select the reconstruction method through a second user interface (1420) for selecting a reconstruction method displayed on a second screen (1702). The electronic device may obtain a user input (e.g., a touch input) for selecting one of the second selectable items through the second user interface (1420), identify the selected item based on the user input, and select a reconstruction method based on the selected item. For example, as illustrated in the second screen (1702), if a direct input item is selected and “My Liked Selfie Face” is input, the electronic device may select a reconstruction method that replaces the thumbnail image with a face (or expression) preferred by the user (e.g., “My Liked Selfie Face”). In the embodiment of FIG. 17, the second screen (1702) is illustrated as being displayed after the first screen (1701), but is not limited thereto. For example, the second screen (1702) may be displayed before the first screen (1701).
[0175] According to one embodiment, the electronic device may reconstruct at least one selected thumbnail image according to a selected reconstruction method, and provide the reconstructed at least one thumbnail image through a third screen (1703). For example, the electronic device may replace the face of the selected thumbnail image (TI2) with the preferred face (or expression) according to a method of replacing the face (or expression) preferred by the selected user, and provide the thumbnail image (TI2) including the replaced face (or expression) through the third screen (1703). Through such face (or expression) replacement processing, the unusual appearance (sensitive appearance) of the user may be prevented from being exposed to the outside through the thumbnail image.
[0176] In the embodiments described above in FIGS. 14A to 17B, the operation of selecting at least one thumbnail image through the first user interface (1410) (e.g., operation 1110 of FIG. 11) (hereinafter, the first operation), the operation of selecting a reconstruction method through the second user interface (1420) (e.g., operation 1120 of FIG. 11) (hereinafter, the second operation), and the operation of reconstructing at least one thumbnail image selected according to the selected reconstruction method (e.g., operation 1130 of FIG. 11) (hereinafter, the third operation) may be performed after the thumbnail reconstruction mode is executed, but is not limited thereto. For example, the first operation and the second operation may be performed as setup operations before the thumbnail reconstruction mode is executed, and the third operation may be performed after the thumbnail reconstruction mode is executed (e.g., after the thumbnail reconstruction mode is executed in response to identifying a device gesture input tilting the electronic device inward).
[0177] FIG. 18 is a flowchart illustrating a method for an electronic device to reconstruct a thumbnail image according to one embodiment of the present disclosure.
[0178] The components and operations of the components described with reference to FIG. 18 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 17b. The components and operations of the components described with reference to FIG. 18 may be partially or entirely identical to the components and operations of the components described with reference to FIG. 19, which will be described later.
[0179] Referring to FIG. 18, according to one embodiment, in operation 1810, an electronic device (e.g., electronic device (101) of FIG. 1) may identify a private view mode (thumbnail reconstruction mode). For example, the electronic device may identify that the thumbnail reconstruction mode is running.
[0180] According to one embodiment, in operation 1820, the electronic device may determine whether a criterion for sensitive content has already been set. The criterion for sensitive content is a criterion for identifying specific content as sensitive content, and sensitive content according to the criterion may include, for example, content including personal information details (e.g., date of birth, resident registration number), content including an unusual facial expression (e.g., a sensitive facial expression), content including a face that the user does not prefer, content including a specific person, and / or content including a specific object. The criterion for sensitive content may be set through a first user interface (e.g., the first user interface (1410) of FIGS. 14a, 15a, 16a, and 17a) for selecting a thumbnail image to be reconstructed.
[0181] According to one embodiment, at operation 1830, the electronic device may identify an image (e.g., a thumbnail image)(s) that corresponds to sensitive content and is to be reconstructed (e.g., replaced) with another image based on established criteria for sensitive content.
[0182] In one embodiment, at operation 1840, the electronic device may identify image(s) (e.g., thumbnail images) that correspond to sensitive content and are to be replaced with other images based on arbitrarily designated criteria, based on the fact that no criteria for sensitive content have already been established. For example, the electronic device may arbitrarily designate sensitive content using an AI model and identify thumbnail image(s) that correspond to the arbitrarily designated sensitive content and are to be replaced with other images.
[0183] In one embodiment, at operation 1850, in response to identifying the image(s) to be replaced (e.g., thumbnail images), the electronic device may determine whether a type of replacement image (e.g., replacement thumbnail image) to replace the image(s) has already been set. The type of replacement image may include, for example, an image including a replacement person, an image including an emoji, a blurred image, an omitted image, and / or other images, as a type of image to replace the identified image(s). The type of replacement image may be set via a second user interface (e.g., the second user interface (1420) of FIGS. 14A, 15A, 16A, and 17A) for selecting a reconstruction method.
[0184] According to one embodiment, in operation 1860, the electronic device may replace an image (e.g., a thumbnail image) to be replaced with a replacement image of a previously set type based on identification that the type of replacement image has already been set. The replacement of the thumbnail image may be described, for example, with reference to the description of the embodiments of FIGS. 14 to 17 described above.
[0185] According to one embodiment, at operation 1870, the electronic device may replace the image(s) to be replaced (e.g., thumbnail images) with a randomly designated replacement image based on the identification that the type of the replacement image is not already set. For example, the electronic device may randomly designate the type of the replacement image using an AI model and replace the thumbnail image(s) to be replaced with the randomly designated type of the replacement image. The replacement of the thumbnail image may refer to the description of the embodiments of FIGS. 14 to 17 described above, for example.
[0186] FIG. 19 is a diagram illustrating a configuration of an electronic device according to one embodiment of the present disclosure.
[0187] The components and operations of the components described with reference to FIG. 19 may be partially or entirely identical to the components and operations of the components described with reference to FIGS. 1 to 18.
[0188] Referring to FIG. 19, according to one embodiment, an electronic device (1900) (e.g., electronic device (101) of FIG. 1) may include, but is not limited to, at least one processor (1910), at least one memory (1920), and / or at least a display (1930). The electronic device (1900) may further include other components (e.g., communication circuits) necessary to perform at least one operation.
[0189] According to one embodiment, at least one processor (1910) of the electronic device (1900) (e.g., processor (120) of FIG. 1) may be electrically and / or operatively connected to each other by a configuration such as a memory (1920) and / or a display (1930) and a communication bus.
[0190] According to one embodiment, at least one processor (1910) may control the overall operation of the electronic device (1900) and perform at least one operation of the electronic device (1900) (e.g., at least one of the operations described above in FIGS. 1 to 18). The processor (1910) may perform operations or data processing related to control and / or communication of at least one other component of the electronic device (1900). The processor (1910) may include at least one processing circuit that executes instructions stored in the memory (1920).
[0191] According to one embodiment, at least one processor (1910) may include various processing circuits and / or multiple processors. One or more of the at least one processor (1910) may be individually and / or collectively configured to perform various functions described herein. In this disclosure, when "a processor," "at least one processor," and "one or more processors" are described as being configured to perform various functions, these terms include, but are not limited to, situations where one processor performs some of the recited functions and other processor(s) perform other parts of the recited functions, and also situations where a single processor can perform all of the recited functions. Additionally, the at least one processor (1910) may include a combination of processors that perform the various recited / disclosed functions, for example, in a distributed manner. The at least one processor (1910) may execute program instructions to achieve or perform the various functions.
[0192] According to one embodiment, at least one processor (1910) may include at least one of a central processing unit (CPU), an NPU, a graphics processing unit (GPU), a micro processing unit (MPU), a micro controller unit (MCU), an application processor (AP), a communication processor (CP), a system on chip (SoC), or an integrated circuit (IC), a sensor hub, a supplementary processor, an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA), and may have multiple cores.
[0193] According to one embodiment, the memory (1920) (e.g., the memory (130) of FIG. 1) may store various data that may be used to control the operation of each component of the electronic device (1900). The memory (1920) may include, for example, at least one storage medium that stores a plurality of application programs used in the electronic device (1900), data for controlling the operation of the electronic device (1900), and instructions. The instructions stored in the memory (1920), when executed by at least one processor (1910), may cause the electronic device (1900) to perform at least one operation (e.g., at least one of the operations described above in FIGS. 1 to 18).
[0194] According to one embodiment, the memory (1920) can store at least one program for processing and controlling the processor (1910), and can store input and / or output data. The memory (1920) can also store at least one artificial intelligence model. The memory (1920) can include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD (secure digital) or XD (extreme digital) memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. According to one example, a web storage or a cloud server that performs a storage function on the Internet may be operated by the electronic device (1900).
[0195] According to one embodiment, at least one display (1930) (e.g., display module (160) of FIG. 1) can visually present information to an external party (e.g., a user) of the electronic device (1900).
[0196] According to one embodiment of the present disclosure, an electronic device may include a display; at least one processor including a processing circuit; and a memory including at least one storage medium storing instructions. The electronic device may group a plurality of images based on detection of an event for providing an expanded thumbnail image. The electronic device may obtain information about a second area in which the expanded thumbnail image is to be displayed in a second thumbnail screen based on information about a first area in which a plurality of thumbnail images corresponding to the grouped plurality of images are displayed in a first thumbnail screen. The electronic device may obtain a representative thumbnail image based on the grouped plurality of images. The electronic device may display the expanded thumbnail image in a second area of the second thumbnail screen based on the representative thumbnail image. The size of the expanded thumbnail image may be larger than the size of a single thumbnail image belonging to the plurality of thumbnail images.
[0197] According to one embodiment, the electronic device may display the representative thumbnail image in a first portion of the second area, and, based on the representative thumbnail image, generate an additional thumbnail image to be displayed in a second portion of the second area excluding the first portion of the second area through a generative artificial intelligence model, and display the additional thumbnail image in the second portion of the second area.
[0198] According to one embodiment, the first area includes a first portion on which at least one second thumbnail image that is not included in the grouped plurality of images is displayed, the at least one second thumbnail image is displayed outside the second area, and at least a portion of the expanded thumbnail image can be displayed in a second portion corresponding to the first portion within the second area.
[0199] According to one embodiment, the electronic device can select one image from among the grouped plurality of images as the representative thumbnail image.
[0200] According to one embodiment, the electronic device can generate the representative thumbnail image through a generative artificial intelligence model based on the grouped plurality of images.
[0201] According to one embodiment, the grouped plurality of images comprises an image sequence associated with a continuous motion, and the electronic device can generate a representative thumbnail image having a format of a motion image based on the plurality of images included in the image sequence.
[0202] According to one embodiment, a representative thumbnail image having the format of the motion image may be displayed inside the second area, and at least one thumbnail image corresponding to at least one image not included in the image sequence within the grouped plurality of images may be displayed outside the second area.
[0203] According to one embodiment, the position and size of the second region may be the same as the position and size of the first region based on the entire display area of the electronic device.
[0204] According to one embodiment, the event for providing the expanded thumbnail image may be detected when the expanded thumbnail mode is executed.
[0205] According to one embodiment, the electronic device, in response to obtaining a user input touching at least a portion of the second area, causes an additional image associated with the expanded thumbnail image to be provided in the form of a pop-up image, wherein the additional image may include at least a portion of the plurality of thumbnail images.
[0206] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0207] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0208] One embodiment of the present document may be implemented as software (e.g., a program (140) of FIG. 1) including one or more instructions stored in a storage medium (e.g., an internal memory (136) of FIG. 1 or an external memory (138) of FIG. 1) readable by a machine (e.g., an electronic device (101) of FIG. 1). For example, a processor (e.g., a processor (120) of FIG. 1) of the machine (e.g., an electronic device (101) of FIG. 1) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0209] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0210] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In electronic devices, display; At least one processor comprising a processing circuit; and A memory comprising at least one storage medium for storing instructions, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Grouping multiple images based on the detection of an event for providing an expanded thumbnail image, Based on information about a first area where a plurality of thumbnail images corresponding to the grouped plurality of images are displayed on a first thumbnail screen, information about a second area where the expanded thumbnail images are to be displayed on a second thumbnail screen is obtained, Based on the above grouped plurality of images, a representative thumbnail image is obtained, An electronic device that causes the expanded thumbnail image to be displayed within the second area of the second thumbnail screen based on the representative thumbnail image, wherein the size of the expanded thumbnail image is larger than the size of a single thumbnail image belonging to the plurality of thumbnail images.
2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Displaying the representative thumbnail image in a first part of the second area, Based on the representative thumbnail image, an additional thumbnail image to be displayed in a second area excluding the first area within the second area is generated through a generative artificial intelligence model, An electronic device that causes the additional thumbnail image to be displayed in the second partial area.
3. In paragraph 1 or 2, The first region includes a first portion on which at least one second thumbnail image that is not included in the grouped plurality of images is displayed, wherein at least one second thumbnail image is displayed outside of the second area; An electronic device, wherein at least a portion of the expanded thumbnail image is displayed in a second portion corresponding to the first portion within the second area.
4. In any one of paragraphs 1 to 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes one image among the grouped plurality of images to be selected as the representative thumbnail image.
5. In any one of paragraphs 1 to 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes the representative thumbnail image to be generated through a generative artificial intelligence model based on the grouped plurality of images.
6. In any one of paragraphs 1 to 5, The above grouped plurality of images comprise an image sequence associated with a continuous motion, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes a representative thumbnail image having a format of a motion image to be generated based on a plurality of images included in the image sequence.
7. In paragraph 6, An electronic device wherein a representative thumbnail image having the format of the motion image is displayed inside the second area, and at least one thumbnail image corresponding to at least one image not included in the image sequence within the grouped plurality of images is displayed outside the second area.
8. In any one of paragraphs 1 to 7, An electronic device, wherein the position and size of the second region are the same as the position and size of the first region, based on the entire display area of the electronic device.
9. In any one of paragraphs 1 to 8, An electronic device wherein the above event for providing the above extended thumbnail image is detected when the extended thumbnail mode is executed.
10. In any one of paragraphs 1 to 9, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device, wherein in response to a user input touching at least a portion of the second area, an additional image associated with the expanded thumbnail image is provided in the form of a pop-up image, the additional image including at least a portion of the plurality of thumbnail images.
11. In the method of an electronic device, An action of grouping multiple images based on the detection of an event for providing an expanded thumbnail image; An operation of obtaining information about a second area in which the expanded thumbnail image is to be displayed on a second thumbnail screen based on information about a first area in which a plurality of thumbnail images corresponding to the grouped plurality of images are displayed on the first thumbnail screen; An operation of obtaining a representative thumbnail image based on the above grouped plurality of images; and A method comprising: an operation of displaying the extended thumbnail image within the second area of the second thumbnail screen based on the representative thumbnail image, wherein the size of the extended thumbnail image is larger than the size of a single thumbnail image belonging to the plurality of thumbnail images.
12. In paragraph 11, The action of displaying the above-mentioned expanded thumbnail image within the above-mentioned second area is: An action of displaying the representative thumbnail image in a first portion of the second area; An operation of generating an additional thumbnail image to be displayed in a second portion of the second area excluding the first portion of the second area, based on the representative thumbnail image, through a generative artificial intelligence model; and A method comprising an action of displaying the additional thumbnail image in the second partial area.
13. In paragraph 11 or 12, The first region includes a first portion on which at least one second thumbnail image that is not included in the grouped plurality of images is displayed, wherein at least one second thumbnail image is displayed outside of the second area; A method wherein at least a portion of the expanded thumbnail image is displayed in a second portion corresponding to the first portion within the second area.
14. In any one of paragraphs 11 to 13, The actions to obtain the above representative thumbnail image are: A method comprising an action of selecting one image from among the grouped plurality of images as the representative thumbnail image.
15. In any one of paragraphs 11 to 13, The actions to obtain the above representative thumbnail image are: A method comprising an action of generating the representative thumbnail image through a generative artificial intelligence model based on the grouped plurality of images.
Citation Information
Patent Citations
Mobile terminal and method for controlling the same
KR101631966B1
Mobile terminal and method for controlling the same
KR1020150106243A
Mobile terminal and method for controlling the same
KR1020150140085A
Mobile terminal and method for controlling the same
KR1020160046641A
Pneumatic tire
KR1020250082956A