Electronic device, method, and non-transitory computer-readable storage medium for generating image filter

Abstract

An electronic device is disclosed. The electronic device may display, through a display, a screen including at least one visual object for inputting an image and reference data for generating an image filter. The electronic device may, while displaying the screen, receive a plurality of separate user inputs for the at least one visual object. The electronic device may generate the image filter on the basis of reference data selected on the basis of an initial user input among the plurality of user inputs, and display, through the display, a filtered image in which the generated image filter is applied to the image. The electronic device may update the image filter on the basis of a subsequent user input after the initial user input among the plurality of user inputs, and display, through the display, another filtered image obtained by applying the updated image filter to the image.

Description

Electronic device, method, and non-transient computer-readable storage medium for generating an image filter

[0001] The following descriptions relate to an electronic device for generating an image filter, a method, and a non-transient computer-readable storage medium.

[0002] Among the various features available for editing photos, the image filter function allows you to create photos with a special atmosphere by applying various effects. When an image filter is selected for a single photo, the same filter effect corresponding to the selected filter can be applied to the entire photo. Users can select image filters stored on the electronic device to apply the saved filter effect to the desired image.

[0003] An electronic device is disclosed. The electronic device may include at least one processor comprising a touchscreen display, an image sensor, and a processing circuit, and a memory comprising one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to display a preview image acquired through the image sensor via the touchscreen display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive a first user input regarding the preview image via the touchscreen display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to display a first thumbnail preview image and a first graphic object corresponding to a first filter on the preview image via the touchscreen display in response to the first user input. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive a second user input for the first graphic object through the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to display a plurality of thumbnail images on the preview image in response to the second user input. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the plurality of thumbnail images to include a first thumbnail image corresponding to the first image stored in the memory, and to receive a third user input for the first thumbnail image through the touchscreen display.When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause, in response to the third user input, to generate filter information using the first thumbnail image or the first image, and to generate a modified preview image in which the filter information is applied to the preview image. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the modified preview image to be displayed through the touchscreen display while the plurality of thumbnail images are displayed on the modified preview image.

[0004] A method is disclosed. The method may be performed by an electronic device comprising a touchscreen display and an image sensor. The method may include an operation of displaying a preview image obtained through the image sensor via the touchscreen display. The method may include an operation of receiving a first user input regarding the preview image via the touchscreen display. The method may include an operation of displaying a first thumbnail preview image corresponding to a first filter and a first graphic object on the preview image via the touchscreen display in response to the first user input. The method may include an operation of receiving a second user input regarding the first graphic object via the touchscreen display. The method may include an operation of displaying a plurality of thumbnail images on the preview image in response to the second user input, wherein the plurality of thumbnail images include a first thumbnail image corresponding to a first image stored in the memory. The above method may include an operation of receiving a third user input regarding the first thumbnail image through the touchscreen display. The above method may include an operation of generating filter information using the first thumbnail image or the first image in response to the third user input. The above method may include an operation of generating a modified preview image in which the filter information is applied to the preview image. The above method may include an operation of displaying the modified preview image while the plurality of thumbnail images are displayed on the modified preview image through the touchscreen display.

[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor of an electronic device comprising a touchscreen display and an image sensor, the electronic device may cause the instructions, when executed individually or collectively by the at least one processor, to display a preview image acquired through the image sensor via the touchscreen display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive a first user input regarding the preview image via the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause, in response to the first user input, to display a first thumbnail preview image corresponding to a first filter and a first graphic object on the preview image through the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause, through the touchscreen display, to receive a second user input regarding the first graphic object. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause, in response to the second user input, to display a plurality of thumbnail images on the preview image.When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the plurality of thumbnail images to include a first thumbnail image corresponding to a first image stored in the memory, and to receive a third user input for the first thumbnail image through the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause, in response to the third user input, to generate filter information using the first thumbnail image or the first image, and to generate a modified preview image in which the filter information is applied to the preview image. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the modified preview image to be displayed through the touchscreen display while the plurality of thumbnail images are displayed on the modified preview image.

[0006] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0007] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0008] FIG. 3 is a block diagram of a reference data database of an electronic device according to one embodiment.

[0009] FIG. 4 is a block diagram of a filter editing module of an electronic device according to one embodiment.

[0010] FIGS. 5a to 5d are drawings illustrating the operation of an electronic device generating an image filter through a camera application according to one embodiment.

[0011] FIGS. 6a to 6c are drawings illustrating the operation of an electronic device generating an image filter through a camera application according to one embodiment.

[0012] FIGS. 7a to 7f are drawings illustrating the operation of an electronic device generating an image filter through a gallery application according to one embodiment.

[0013] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0014] FIGS. 9a to 9d are drawings illustrating the operation of an electronic device generating an image filter through a camera application according to one embodiment.

[0015] FIG. 10 is a diagram illustrating user interaction with a camera application while an electronic device generates an image filter, according to one embodiment.

[0016] FIGS. 11a and FIGS. 11b are drawings illustrating the operation of an electronic device selecting an area of ​​an image for an image filter through a camera application according to one embodiment.

[0017] FIGS. 12a to 12c are drawings illustrating the operation of an electronic device generating an image filter through various contents according to one embodiment.

[0018] FIGS. 13a, FIGS. 13b, and FIGS. 13c are drawings illustrating the operation of an electronic device generating an image filter by referencing the content of another application according to one embodiment.

[0019] FIG. 14 is a diagram illustrating the operation of an electronic device generating an image filter by referencing the content of another application according to one embodiment.

[0020] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.

[0021] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0022] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0023] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0024] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0025] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0026] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0027] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0028] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0029] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0030] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0031] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0032] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0033] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0034] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0035] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0036] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0037] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0038] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 664 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 6 ms or less) for realizing URLLC.

[0039] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0040] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0041] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0042] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0043] FIG. 2 is a block diagram of an electronic device according to one embodiment. FIG. 3 is a block diagram of a reference data database of an electronic device according to one embodiment. FIG. 4 is a block diagram of a filter editing module of an electronic device according to one embodiment.

[0044] Referring to FIG. 2, the electronic device (101) may include a processor (120), memory (130), a display (260), and / or a camera (280). In one embodiment, the display (260) may correspond to the display module (160) of FIG. 1. In one embodiment, the camera (280) may correspond to the camera module (180) of FIG. 1.

[0045] In one embodiment, the memory (130) may store a reference data database (210), a reference data processing unit (220), a LUT (lookup table) generation module (230), a filter editing module (240), a filter database (250), and / or a filter application module (270) as a program (140).

[0046] In one embodiment, the reference data database (210) may manage reference data from one or more sources. In one embodiment, the reference data may be referenced to create an image filter (hereinafter referred to as a filter). In one embodiment, the image filter may include a lookup table (LUT) (or a color LUT). For example, the LUT may include a LUT for each of the colors (e.g., R (red), G (green), B (blue), or colors according to other color models (e.g., YUV, CMYK)). The LUT may be a table for converting the pixel value of each of the colors to another pixel value. In one embodiment, the LUT may be an N-dimensional (e.g., 2D, 3D, or 4D) table. For example, the table may have a specified size (e.g., 512 x 512) for each of the colors. For example, the table may be a table for changing attributes (e.g., transparency (e.g., alpha value), depth value, and / or HDR (high dynamic range)) based on the value of each of the colors.

[0047] In one embodiment, referring to FIG. 3, the reference data database (210) may manage image data (310), video data (320), image information (330), prompt (340), and / or custom tone data (350) as reference data.

[0048] For example, an electronic device (101) may obtain image data (310) and / or video data (320) from a media database (315) (e.g., storage and / or cloud server). For example, an electronic device (101) may obtain image data (310) and / or video data (320) from a media database (315) (e.g., storage and / or cloud server), including image quality information (e.g., resolution) and / or attribute information (e.g., exposure, color intensity, saturation, brightness, contrast, color temperature, color tone, or lighting information) of the media database (315) (e.g., storage and / or cloud server).

[0049] For example, the electronic device (101) may obtain image information (330) from a real-time image (335) (or a preview image obtained through a camera (280)). In one embodiment, the image information (330) may include scene information, attribute information (e.g., exposure, color intensity, saturation, brightness, contrast, color temperature, color tone, or lighting information), and / or image quality information. In one embodiment, the scene information may represent the overall environment or composition within the image (or video). For example, the scene information may represent the space and / or scene depicted by the image (or video). For example, the scene information may include information about a subject and / or background. In one embodiment, the subject is the object focused in the image (or video), and the background may be an object other than the subject.

[0050] For example, the electronic device (101) may obtain a prompt (340) from user input (345) (e.g., user's text and / or voice input). In one embodiment, the prompt (340) may indicate the user's taste and / or preference.

[0051] For example, the electronic device (101) may obtain custom tone data (350) from an LUT editing option (355). In one embodiment, the LUT editing option (355) may include a visual object for editing a LUT displayed within the screen of an application (e.g., a camera application and / or a gallery application). In one embodiment, the custom tone data (350) may include a LUT, attribute information, and / or image quality information. In one embodiment, the custom tone data (350) may indicate whether to apply a photographic effect (e.g., grain, vignetting, texture (or blur), cyan sky, violet sky, and / or reminisce) to the image. In one embodiment, grain may be a photographic effect that creates particle-like noise in an irregular pattern on the image. In one embodiment, vignetting may be a photographic effect that reduces the corners, appearance brightness, or saturation of the photograph. In one embodiment, the texture may be a photographic effect that smoothly changes details while maintaining the edges of the photograph. In one embodiment, the cyan sky may be a photographic effect that changes the color of pixels classified as blue areas among color areas distinguished by colors (e.g., R(red), G(green), B(blue)) to cyan. In one embodiment, the violet sky may be a photographic effect that changes the color of pixels classified as blue areas among color areas distinguished by colors to purple. In one embodiment, the reminisce may be a photographic effect that lowers the contrast and changes the color to a color area distinguished by white.

[0052] In one embodiment, the reference data processing unit (220) can extract scene information, attribute information, and / or image quality information.

[0053] In one embodiment, the reference data processing unit (220) can extract scene information, attribute information, and / or image quality information based on analyzing image data (310) and / or video data (320). In one embodiment, the reference data processing unit (220) can extract scene information, attribute information, and / or image quality information by analyzing image data (310) and / or video data (320) through an artificial intelligence model. For example, the artificial intelligence model may be a model trained to extract scene information, attribute information, and / or image quality information from input data. Hereinafter, the image data (310) and / or video data (320) may be referenced as input images.

[0054] In one embodiment, the reference data processing unit (220) can identify scene information, attribute information, and / or image quality information from image information (330). In one embodiment, the reference data processing unit (220) can identify image information (330) from a preview image (or real-time image (335)) obtained from a camera (280). In one embodiment, the reference data processing unit (220) can identify image information (330) of a specific area within a preview image (or real-time image (335)) obtained from a camera (280). In one embodiment, the reference data processing unit (220) can identify scene information, attribute information, and / or image quality information included in the image information (330). In one embodiment, the specific area may be an area containing a subject selected by the user among subjects within the preview image (or the field of view (FoV) of the camera (280).

[0055] In one embodiment, the reference data processing unit (220) can identify scene information, attribute information, and / or image quality information from the prompt (340). In one embodiment, the prompt (340) can indicate the user's taste and / or preference.

[0056] In one embodiment, the reference data processing unit (220) can identify scene information, attribute information, and / or image quality information from the custom tone data (350).

[0057] In one embodiment, the LUT generation module (230) can generate a LUT. In one embodiment, the LUT generation module (230) can generate a LUT based on an input image. In one embodiment, the LUT generation module (230) can generate a LUT based on identifying an image filter applied to the input image.

[0058] In one embodiment, the LUT generation module (230) can estimate an image filter applied to an input image based on a specified object (or subject) (e.g., a subject presumed to have a specified color) included in the input image. In one embodiment, the LUT generation module (230) can estimate an image filter applied to an input image based on the average color tone (or color values ​​of colors (e.g., R, G, B)) originally possessed by an object included in the input image. For example, the processor (120) can recognize an object (e.g., grass or sea) included in the input image and estimate an image filter based on the difference between the object's changed color tone and the object's original color tone according to the image filter applied to the input image. For example, the LUT generation module (230) can estimate an image filter applied to an input image based on comparing color values ​​between the input image and the estimated image. For example, the LUT generation module (230) can estimate an image filter applied to an input image based on the difference between the color values ​​of the colors (e.g., R, G, B)) of the input image and the color values ​​of the colors (e.g., R, G, B)) of the estimated image.

[0059] In one embodiment, the LUT generation module (230) can estimate the original image from the input image based on the estimated image filter. According to an embodiment, the LUT generation module (230) can estimate the image filter applied to the input image and / or the original image by analyzing the input image through an artificial intelligence model.

[0060] In one embodiment, the LUT generation module (230) can generate an LUT based on an image filter applied to an input image. For example, the LUT generation module (230) can generate an LUT for converting colors (e.g., R, G, B) according to the estimated image filter. For example, the LUT may be a table of a specified size (e.g., 512 x 512) for each of the colors (e.g., R, G, B). For example, the LUT may be a table for converting each pixel value of the colors corresponding to the color tone difference between the input image and the estimated image into a different pixel value.

[0061] In one embodiment, referring to FIG. 4, the filter editing module (240) may include an LUT editing unit (410), a real-time image generation unit (420), and / or a feedback processing unit (430).

[0062] In one embodiment, the LUT editing unit (410) can edit the LUT generated by the LUT generation module (230) based on reference data (e.g., image information (330), prompt (340), and / or custom tone data (350)). In one embodiment, the LUT editing unit (410) can edit the LUT based on the reference data based on scene information, attribute information, image quality information, and / or information regarding photo effects. In one embodiment, the LUT editing unit (410) can edit the LUT so that attribute information and / or photo effects are reflected. In one embodiment, as the generated LUT is edited, the LUT editing unit (410) can update (or generate) a filtered image in real time by applying an image filter based on the edited LUT to a target image (e.g., a preview image obtained from a camera (280), or an image selected from among the images).

[0063] In one embodiment, the LUT editing unit (410) can generate a filtered image by applying an image filter to a target image (e.g., a preview image obtained from a camera (280), or an image selected from among the images). For example, the LUT editing unit (410) can generate a filtered image by changing the color tone of the target image based on a LUT. For example, the LUT editing unit (410) can generate a filtered image by changing the color tone of the target image based on a LUT that reflects attribute information and / or photographic effects. However, the embodiment is not limited thereto. For example, the LUT editing unit (410) can generate a first filtered image by changing the color tone of the target image based on a LUT that does not reflect attribute information and / or photographic effects, and generate a second filtered image by changing the color tone of the first filtered image based on attribute information and / or photographic effects. For example, the second filtered image may correspond to a filtered image generated based on a LUT that reflects attribute information and / or photographic effects. Hereinafter, the reflection of attribute information and / or photographic effects on the image may be referred to as post-processing. Hereinafter, whether attribute information and / or photographic effects are reflected may be referred to as post-processing information. According to an embodiment, post-processing may include not only reflecting attribute information and / or photographic effects on the image, but also changing an object (or subject) within the image. For example, changing an object (or subject) may include changing (or overlaying) a designated object (e.g., a human face) to another designated object (e.g., an animal costume).

[0064] In one embodiment, the real-time image generation unit (420) can display a filtered image (or a second filtered image) on a preview screen within the display (260).

[0065] In one embodiment, the feedback processing unit (430) may display a user interface (UI) within the display (260) for changing an image filter applied to a filtered image displayed on a preview screen. In one embodiment, the feedback processing unit (430) may change an input image (e.g., image data (310), and / or video data (320)) based on user input to the UI (or subsequent user input) (or second user input). In one embodiment, the feedback processing unit (430) may generate a prompt (340) based on user input to the UI (or subsequent user input) (or second user input). In one embodiment, the feedback processing unit (430) may change custom tone data (350) based on user input to the UI (or subsequent user input) (or second user input). In one embodiment, the LUT editing unit (410) can change the LUT based on the changed input image, the generated prompt (340), and / or custom tone data (350).

[0066] In one embodiment, the feedback processing unit (430) can transmit an image filter to the filter database (250) based on user input to save an image filter applied to a filtered image through the UI.

[0067] In one embodiment, the filter database (250) may store and / or manage the generated image filter (or filter item) in memory (130). In one embodiment, the generated image filter may include a LUT.

[0068] In one embodiment, the filter application module (270) may display visual objects representing a plurality of image filters managed in the filter database (250) on the screen of the display (260). In one embodiment, the filter application module (270) may apply the selected image filter to the image based on user input selecting one of the plurality of image filters.

[0069] As described above, the electronic device (101) can enable the user to create an image filter desired by the user in real time by allowing the user to fine-tune the image filter. Additionally, as described above, the electronic device (101) can enable the user to check the image filter being fine-tuned in real time by applying the fine-tuned image filter to an image currently displayed on the display (260). Accordingly, the electronic device (101) can enable the user to create a personalized image filter.

[0070] FIGS. 5a to 5d are drawings illustrating the operation of an electronic device generating an image filter through a camera application according to one embodiment.

[0071] FIGS. 5a to 5d can be explained with reference to FIGS. 1 to 4.

[0072] In one embodiment, the electronic device (101) may display a screen of a camera application on a display (260). In one embodiment, referring to FIG. 5a, the screen of the camera application may include a preview area (501) where a preview image (510) is displayed, and control areas (505, 507) for changing the settings of the camera (280). In one embodiment, the control area (507) may include a visual object (515) for calling a UI (user interface) for applying an image filter (or a filter) to the preview image (510) (or an image obtained through the camera (280)).

[0073] In one embodiment, the electronic device (101) can identify user input (e.g., press input, or tap input) for a visual object (515). In one embodiment, the electronic device (101) can display a UI within the screen of a camera application for applying an image filter (or filter) to a preview image (510) (or an image obtained through the camera (280)) in response to user input for the visual object (515).

[0074] For example, referring to FIG. 5b, the electronic device (101) may display within the control area (505) a visual object (520) for creating a new image filter, a visual object (531) for converting to an original screen (or a screen without an image filter applied), and / or visual objects (533, 535) representing each of a plurality of image filters. In one embodiment, the visual objects (533, 535) representing each of a plurality of image filters may correspond to a plurality of image filters stored in a filter database (250). For example, the electronic device (101) may display within the control area (505) visual objects (533, 535) for each of a plurality of image filters identified in the filter database (250) through a filter application module (270). In the following, user input for creating a new image filter (or, initial user input) (or, first user input), and / or user input for modifying a new image filter (or, subsequent user input) (or, second user input) may be referred to as multiple separate user inputs. For example, the separation of user inputs may indicate that another user input is obtained after the creation (or modification) of an image filter based on one user input is completed.

[0075] For example, referring to FIG. 5b, the electronic device (101) may display an area (541) for obtaining text input for creating a new image filter within a control area (505) and a visual object (545) for confirming the text input.

[0076] For example, referring to FIG. 5b, the electronic device (101) may display an area (550) for adjusting a plurality of intensities of a new image filter within a control area (505). For example, the area (550) may include one or more visual objects (551, 553, 555, 557) for adjusting the applied intensity of the image filter and / or the applied intensity of attribute information (e.g., exposure, color intensity, saturation, brightness, contrast, color temperature, color tone, or lighting information). For example, the electronic device (101) may decrease or increase the intensity (e.g., contrast) set for the visual object (551) by dragging (or swiping) left or right on the visual object (551). For example, the electronic device (101) may decrease or increase the intensity (e.g., color intensity) set for the visual object (553) depending on dragging (or swiping) left or right on the visual object (553). For example, the electronic device (101) may decrease or increase the intensity (e.g., saturation) set for the visual object (555) depending on dragging (or swiping) left or right on the visual object (555). For example, the electronic device (101) may decrease or increase the intensity (e.g., color temperature) set for the visual object (557) depending on dragging (or swiping) left or right on the visual object (557). In one embodiment, the area (550) may be an area for adjusting the LUT editing option (355). The application intensity of the image filter and / or the application intensity of attribute information (e.g., exposure, color intensity, saturation, brightness, contrast, color temperature, color tone, or lighting information) may be an example of an LUT editing option (355).

[0077] In one embodiment, the electronic device (101) may receive user input (or initial user input) (or first user input) for creating an image filter within the screen of a camera application. For example, the electronic device (101) may receive user input for creating an image filter while a UI for applying an image filter within the screen of a camera application is displayed. For example, the user input may be a tap input and / or press input for selecting a visual object (520). For example, the user input for the visual object (520) may be an input for selecting image data (310) and / or video data (320). For example, the user input may be a text input for an area (541) and / or a tap input and / or press input for a visual object (545) for confirming the text input. For example, the user input for the area (541) and / or the visual object (545) may be an input for a prompt (340). For example, user input may be a swipe input and / or drag input for the area (550). For example, user input for the area (550) may be an input for custom tone data (350).

[0078] In one embodiment, the electronic device (101) can generate an LUT based on user input (or initial user input) (or first user input) for generating an image filter. For example, the electronic device (101) can generate an LUT through a reference data processing unit (220) and an LUT generation module (230) based on reference data determined based on user input for generating an image filter.

[0079] For example, the electronic device (101) may display a UI for allowing the user to select an input image (e.g., image data (310), and / or video data (320)) based on user input to a visual object (520). For example, referring to FIG. 5c, the electronic device (101) may display a UI including thumbnails (561, 565) representing one or more images (or videos) in a control area (505).

[0080] For example, the electronic device (101) can identify an image (or video) corresponding to a selected thumbnail as an input image based on a user input (or initial user input) (or first user input) selecting at least one of the thumbnails (561, 565). For example, the electronic device (101) can generate a LUT based on the input image through a reference data processing unit (220) and a LUT generation module (230).

[0081] For example, the electronic device (101) can generate a LUT through a reference data processing unit (220) and a LUT generation module (230) based on a selected subject (or area containing the subject) based on a user input (or initial user input) (or first user input) selecting a subject (or area containing the subject) within a preview image (510). In one embodiment, the subject (or area containing the subject) within the preview image (510) may be included as part of a real-time image (335). For example, the electronic device (101) can generate a LUT through a reference data processing unit (220) and a LUT generation module (230) based on image information (330) extracted from a subject (or area containing the subject) within the preview image (510).

[0082] For example, the electronic device (101) can identify the prompt (340) based on text input through the area (541). For example, the text input through the area (541) may include phrases indicating the user's taste and / or preference (e.g., “change to a bright image,” “change to a nostalgic feeling,” “change to the latest trend,” or “change to the art style (or concept) of 'AAA'”). For example, the electronic device (101) can generate a LUT based on the prompt (340) through the reference data processing unit (220) and the LUT generation module (230). For example, the electronic device (101) can generate a LUT corresponding to the prompt (340) by inputting the prompt (340) into an artificial intelligence model. For example, the LUT corresponding to the prompt (340) may be a LUT included in the image filter corresponding to the “bright image” among a plurality of image filters. For example, the LUT corresponding to the prompt (340) may be a LUT included in an image filter that is frequently used (or often used) by many users recently according to the “latest trend” among a plurality of image filters. For example, the LUT corresponding to the prompt (340) may be a LUT included in an image filter corresponding to the “'AAA' style (or concept)” among a plurality of image filters. According to an embodiment, the “'AAA' style (or concept) may be a work production pattern mainly used by an artist (e.g., painter, photographer, or musician).

[0083] For example, the electronic device (101) can identify custom tone data (350) based on user input (or subsequent user input) (or second user input) for intensity control through the area (550). For example, the custom tone data (350) may represent intensity for exposure, color intensity, saturation, brightness, contrast, color temperature, color tone, and / or lighting information. For example, the electronic device (101) can generate a LUT based on the custom tone data (350) through the reference data processing unit (220) and the LUT generation module (230).

[0084] In one embodiment, the electronic device (101) may generate an image filter including a generated LUT. In one embodiment, the electronic device (101) may generate an image filter including a LUT that reflects attribute information and / or a photographic effect. However, the embodiment is not limited thereto. In one embodiment, the electronic device (101) may include a LUT that does not reflect attribute information and / or a photographic effect, and post-processing information indicating whether attribute information and / or a photographic effect is applied. In one embodiment, the post-processing information may indicate whether attribute information and / or a photographic effect is applied.

[0085] In one embodiment, referring to FIG. 5d, the electronic device (101) can display a thumbnail (580) representing a generated image filter in a control area (505) within the screen of a camera application.

[0086] In one embodiment, the electronic device (101) can generate a filtered image by applying an image filter generated on a preview image (510) (or original image). For example, applying an image filter generated on a preview image (510) (or original image) may include changing the color tone of the preview image (510) (or original image) based on a LUT included in the image filter. For example, applying an image filter generated on a preview image (510) (or original image) may include performing post-processing (e.g., processing based on attribute information and / or photo effects) after changing the color tone of the preview image (510) (or original image) based on a LUT included in the image filter.

[0087] In one embodiment, referring to FIG. 5d, the electronic device (101) can display a filtered image (570) in a preview area (501) within the screen of a camera application.

[0088] In one embodiment, the electronic device (101) may receive user input (or subsequent user input) (or second user input) for adjusting (or modifying) a generated image filter within the screen of a camera application. For example, the electronic device (101) may receive user input (or subsequent user input) (or second user input) for adjusting (or modifying) a generated image filter while a UI for applying an image filter within the screen of a camera application is displayed. For example, the user input (or subsequent user input) (or second user input) may be an input for selecting a visual object (520). For example, the user input (or subsequent user input) (or second user input) may be a text input for an area (541). For example, the user input (or subsequent user input) (or second user input) may be an input for an area (550).

[0089] In one embodiment, the electronic device (101) can adjust (or modify) the LUT based on user input (or subsequent user input) (or second user input) for adjusting (or modifying) the generated image filter. For example, the electronic device (101) can adjust (or modify) the LUT through the LUT editing unit (410) based on reference data determined based on user input (or subsequent user input) (or second user input) for adjusting (or modifying) the generated image filter. For example, the electronic device (101) can adjust (or modify) post-processing information through the LUT editing unit (410) based on reference data determined based on user input for adjusting (or modifying) the generated image filter. According to an embodiment, when a user input for adjusting (or modifying) a generated image filter indicates selecting a new input image, the electronic device (101) can generate a new image filter through the reference data processing unit (220) and the LUT generation module (230) using the new input image.

[0090] In one embodiment, the electronic device (101) can generate a filtered image by applying an adjusted (or modified) image filter to a preview image (510) (or original image). In one embodiment, the electronic device (101) can display a filtered image (570) with an adjusted (or modified) image filter applied to a preview area (501) within the screen of a camera application.

[0091] In one embodiment, the electronic device (101) can capture an image through a camera application. For example, the electronic device (101) can acquire an image to which a generated image filter (or an adjusted (or modified) image filter) is applied. For example, the electronic device (101) can acquire an image to which a generated image filter (or an adjusted (or modified) image filter) is applied before storing the generated image filter (or an adjusted (or modified) image filter) in the filter database (250). For example, the generated image filter (or an adjusted (or modified) image filter) may be discarded without being stored in the filter database (250) after being used for capturing an image. For example, the generated image filter (or an adjusted (or modified) image filter) may be stored in the filter database (250) after being used for capturing an image.

[0092] The electronic device (101) described above can enable the user to create an image filter in real time by allowing the user to fine-tune the image filter while viewing a filtered image with an image filter applied to a preview image through a camera application.

[0093] FIGS. 6a to 6c are drawings illustrating the operation of an electronic device generating an image filter through a camera application according to one embodiment.

[0094] FIGS. 6a to 6c can be explained with reference to FIGS. 1 to 5d.

[0095] In one embodiment, the electronic device (101) may receive user input for a visual object (e.g., “All photos”) while displaying a UI for allowing the user to select an input image (e.g., image data (310), and / or video data (320)) based on user input for a visual object (520). For example, the electronic device (101) may receive user input for a visual object (e.g., “All photos”) while displaying a UI that includes thumbnails (561, 565) representing one or more images (or videos) in a control area (505).

[0096] In one embodiment, the electronic device (101) may display a screen containing thumbnail images of a plurality of images (or, videos) based on receiving user input for a visual object (e.g., “All photos”). For example, referring to FIG. 6a, the electronic device (101) may display a screen containing thumbnail images of a plurality of images (or, videos) instead of a camera application screen based on receiving user input for a visual object (e.g., “All photos”).

[0097] In one embodiment, the electronic device (101) can identify an image (or video) corresponding to a selected thumbnail (610) as an input image based on a user input (or initial user input) (or first user input) selecting at least one thumbnail (610) among the thumbnail images on a screen including thumbnail images.

[0098] In one embodiment, the electronic device (101) can generate a LUT through a reference data processing unit (220) and an LUT generation module (230) based on an input image corresponding to a selected thumbnail (610). In one embodiment, the electronic device (101) can generate an image filter including a LUT through a reference data processing unit (220) and an LUT generation module (230) based on an input image corresponding to a selected thumbnail (610).

[0099] In one embodiment, referring to FIG. 6b, the electronic device (101) may display a thumbnail (615) representing a generated image filter in a control area (505) within the screen of a camera application. In one embodiment, the electronic device (101) may display a filtered image (570) in a preview area (501) within the screen of a camera application.

[0100] In one embodiment, the electronic device (101) may receive user input for saving a generated image filter within the screen of a camera application. For example, the electronic device (101) may receive user input for saving a generated image filter while a UI for applying an image filter within the screen of a camera application is displayed (e.g., while the UI of FIG. 5d is displayed, or while the UI of FIG. 6b is displayed). For example, the user input may be an input for selecting a visual object (e.g., “Next”).

[0101] In one embodiment, the electronic device (101) may store the generated image filter in the filter database (250) based on user input for storing the generated image filter. For example, the electronic device (101) may display a screen containing information about the image filter to be stored (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) based on user input for storing the generated image filter. For example, referring to FIG. 6c, the electronic device (101) may display a screen containing a thumbnail (630) of the image filter to be stored in the control area (505) and / or identification information (635) of the image filter based on user input for storing the generated image filter. However, the embodiment is not limited thereto. For example, the electronic device (101) may include information about an image filter to be saved, such as an identifier of the image filter (e.g., filterID), a name of the image filter (e.g., filterName, and / or defaultFilterName), a thumbnail of the image filter (e.g., filterThumbBitmap) and / or a badge of the image filter (e.g., badgeBitmap). For example, the electronic device (101) may include information about an image filter to be saved, such as identification information of the creator of the image filter (e.g., resVendorID), information about parameters within the image filter (e.g., LUT, and / or post-processing information) (e.g., key-value data (e.g., JSON-based data)), referenced data (e.g., input image (e.g., referBitmap)), a type of image filter (e.g., mFilterViewType), attribute information, and / or whether a photo effect is applied.

[0102] In one embodiment, the electronic device (101) may receive user input to save a generated image filter while a screen containing information about an image filter to be saved within the screen of a camera application (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) is displayed (e.g., while the UI of FIG. 6c is displayed). For example, the user input may be an input selecting a visual object (e.g., “Done”). In one embodiment, the electronic device (101) may save the generated image filter to a filter database (250) based on the user input to save the generated image filter. In one embodiment, the electronic device (101) may transmit information about the image filter to be saved (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) to the filter database (250) based on the user input to save the generated image filter.

[0103] In one embodiment, the filter database (250) may store image filters based on information about image filters. Subsequently, the electronic device (101) may display visual objects for each of a plurality of image filters, including newly stored image filters identified in the filter database (250) through the filter application module (270), within the control area (505). However, the embodiment is not limited thereto. For example, the electronic device (101) may display visual objects for each of a plurality of image filters, including newly stored image filters identified in the filter database (250) through the filter application module (270), within the control area of ​​the gallery application.

[0104] FIGS. 7a to 7f are drawings illustrating the operation of an electronic device generating an image filter through a gallery application according to one embodiment.

[0105] FIGS. 7a to 7f can be explained with reference to FIGS. 1 to 6c.

[0106] In one embodiment, the electronic device (101) may display a screen of a gallery application on a display (260). In one embodiment, referring to FIG. 7a, the screen of the gallery application may include an image area (701) where an image (710) is displayed, a control area (705) for providing image-related functions (e.g., favorites, editing, AI (artificial intelligence) editing, sharing, and / or deletion), and a control area (707) for providing other image-related functions (e.g., rotation, and / or playback). In one embodiment, the control area (705) may include a visual object (715) for calling a UI (user interface) for applying an image filter (or filter) to an image (710) (or video).

[0107] In one embodiment, the electronic device (101) can identify user input (e.g., press input, or tap input) for a visual object (715). In one embodiment, the electronic device (101) can display a UI within the screen of a gallery application for applying an image filter (or filter) to an image (710) (or video) in response to user input for the visual object (715).

[0108] For example, referring to FIG. 7b, the electronic device (101) may display within the control area (705) a visual object (720) for creating a new image filter, a visual object (731) for converting to an original screen (or a screen without an image filter applied), and / or visual objects (733, 735) representing each of a plurality of image filters. In one embodiment, the visual objects (733, 735) representing each of a plurality of image filters may correspond to a plurality of image filters stored in a filter database (250). For example, the electronic device (101) may display within the control area (705) visual objects (733, 735) for each of a plurality of image filters identified in the filter database (250) through a filter application module (270).

[0109] For example, referring to FIG. 7b, the electronic device (101) may display an area (741) for obtaining text input for creating a new image filter and a visual object (745) for confirming the text input within a control area (705).

[0110] For example, referring to FIG. 7b, the electronic device (101) may display an area (750) for adjusting a plurality of intensities of a new image filter within a control area (705). For example, the area (750) may include one or more visual objects (751, 753, 755, 757) for adjusting the applied intensity of the image filter and / or the applied intensity of attribute information (e.g., exposure, color intensity, saturation, brightness, contrast, color temperature, hue, or lighting information). For example, the electronic device (101) may decrease or increase the intensity (e.g., contrast) set for the visual object (751) by dragging (or swiping) left or right on the visual object (751). In one embodiment, the area (750) may be an area for adjusting LUT editing options (355). The application intensity of the image filter and / or the application intensity of attribute information (e.g., exposure, color intensity, saturation, brightness, contrast, color temperature, color tone, or lighting information) may be an example of an LUT editing option (355).

[0111] In one embodiment, the electronic device (101) may receive user input (or initial user input) (or first user input) for creating an image filter within the screen of a gallery application. For example, the electronic device (101) may receive user input for creating an image filter while a UI for applying an image filter within the screen of a gallery application is displayed. For example, the user input may be a tap input and / or press input for selecting a visual object (720). For example, the user input for the visual object (720) may be an input for selecting image data (310) and / or video data (320). For example, the user input may be a text input for an area (741) and / or a tap input and / or press input for a visual object (745) for confirming the text input. For example, the user input for the area (741) and / or the visual object (745) may be an input for a prompt (340). For example, user input may be a swipe input and / or drag input for the area (750). For example, user input for the area (750) may be an input for custom tone data (350).

[0112] In one embodiment, the electronic device (101) can generate an LUT based on user input (or initial user input) (or first user input) for generating an image filter. For example, the electronic device (101) can generate an LUT through a reference data processing unit (220) and an LUT generation module (230) based on reference data determined based on user input for generating an image filter.

[0113] For example, the electronic device (101) may display a UI for allowing the user to select an input image (e.g., image data (310), and / or video data (320)) based on user input to a visual object (720). For example, referring to FIG. 7c, the electronic device (101) may display a UI including thumbnails (761, 765) representing one or more images (or videos) in a control area (705).

[0114] For example, the electronic device (101) can identify an image (or video) corresponding to a selected thumbnail as an input image based on user input selecting at least one of the thumbnails (761, 765).

[0115] For example, the electronic device (101) may receive user input for a visual object (e.g., “All photos”) while displaying a UI for allowing the user to select an input image (e.g., image data (310), and / or video data (320)) based on user input for a visual object (720). For example, the electronic device (101) may receive user input for a visual object (e.g., “All photos”) while displaying a UI that includes thumbnails (761, 765) representing one or more images (or videos) in a control area (705).

[0116] In one embodiment, the electronic device (101) may display a screen containing thumbnail images of a plurality of images (or, videos) based on receiving user input regarding a visual object (e.g., “All photos”). For example, referring to FIG. 7d, the electronic device (101) may display a screen (709) containing thumbnail images of a plurality of images (or, videos) instead of a gallery application screen based on receiving user input regarding a visual object (e.g., “All photos”). In one embodiment, the electronic device (101) may identify an image (or, video) corresponding to a selected thumbnail (765) as an input image based on user input selecting at least one thumbnail (765) among the thumbnail images in the screen (709) containing the thumbnail images.

[0117] For example, the electronic device (101) can generate a LUT based on an input image through a reference data processing unit (220) and a LUT generation module (230).

[0118] For example, the electronic device (101) can identify a prompt (340) based on text input through the area (741). For example, text input through the area (741) may include phrases indicating the user's taste and / or preference (e.g., “change to a bright image,” “change to a nostalgic feeling,” “change to the latest trend,” or “change to the 'AAA' style”). For example, the electronic device (101) can generate a LUT based on the prompt (340) through the reference data processing unit (220) and the LUT generation module (230).

[0119] For example, the electronic device (101) can identify custom tone data (350) based on user input for intensity control through the area (750). For example, the custom tone data (350) may represent intensity for exposure, color intensity, saturation, brightness, contrast, color temperature, color tone, and / or lighting information. For example, the electronic device (101) can generate a LUT based on the custom tone data (350) through the reference data processing unit (220) and the LUT generation module (230).

[0120] In one embodiment, the electronic device (101) may generate an image filter including a generated LUT. In one embodiment, the electronic device (101) may generate an image filter including a LUT that reflects attribute information and / or a photographic effect. However, the embodiment is not limited thereto. In one embodiment, the electronic device (101) may include a LUT that does not reflect attribute information and / or a photographic effect, and post-processing information indicating whether attribute information and / or a photographic effect is applied. In one embodiment, the post-processing information may indicate whether attribute information and / or a photographic effect is applied.

[0121] In one embodiment, referring to FIG. 7e, the electronic device (101) can display a thumbnail (780) representing a generated image filter in a control area (705) within the screen of a gallery application.

[0122] In one embodiment, the electronic device (101) can generate a filtered image by applying an image filter generated on an image (710) (or original image). For example, applying an image filter generated on an image (710) (or original image) may include changing the color tone of the image (710) (or original image) based on a LUT included in the image filter. For example, applying an image filter generated on an image (710) (or original image) may include performing post-processing (e.g., processing based on attribute information and / or photo effects) after changing the color tone of the image (710) (or original image) based on a LUT included in the image filter.

[0123] In one embodiment, referring to FIG. 7e, the electronic device (101) can display a filtered image (770) in an image area (701) within the screen of a gallery application.

[0124] In one embodiment, the electronic device (101) may receive user input (or subsequent user input) (or second user input) for adjusting (or modifying) a generated image filter within the screen of a gallery application. For example, the electronic device (101) may receive user input (or subsequent user input) (or second user input) for adjusting (or modifying) a generated image filter while a UI for applying an image filter within the screen of a gallery application is displayed. For example, the user input (or subsequent user input) (or second user input) may be an input for selecting a visual object (720). For example, the user input (or subsequent user input) (or second user input) may be a text input for an area (741). For example, the user input (or subsequent user input) (or second user input) may be an input for an area (750).

[0125] In one embodiment, the electronic device (101) can adjust (or modify) the LUT based on user input (or subsequent user input) (or second user input) for adjusting (or modifying) the generated image filter. For example, the electronic device (101) can adjust (or modify) the LUT through the LUT editing unit (410) based on reference data determined based on user input for adjusting (or modifying) the generated image filter. For example, the electronic device (101) can adjust (or modify) post-processing information through the LUT editing unit (410) based on reference data determined based on user input for adjusting (or modifying) the generated image filter. According to an embodiment, when a user input for adjusting (or modifying) a generated image filter indicates selecting a new input image, the electronic device (101) can generate a new image filter through the reference data processing unit (220) and the LUT generation module (230) using the new input image.

[0126] In one embodiment, the electronic device (101) can generate a filtered image by applying an adjusted (or modified) image filter to an image (710) (or original image). In one embodiment, the electronic device (101) can display a filtered image (770) with an adjusted (or modified) image filter applied to an image area (701) within the screen of a gallery application.

[0127] In one embodiment, the electronic device (101) may store an image to which an image filter (or, adjusted (or, modified) image filter) created through a gallery application is applied. For example, the electronic device (101) may store an image to which an image filter (or, adjusted (or, modified) image filter) is applied based on receiving user input for a visual object (e.g., “Save”) before storing the image filter (or, adjusted (or, modified) image filter) to the filter database (250). For example, the image filter (or, adjusted (or, modified) image filter) may be discarded without being stored in the filter database (250) after being used to create an image to which the image filter (or, adjusted (or, modified) image filter) is applied. For example, the image filter (or, adjusted (or, modified) image filter) may be stored in the filter database (250) after being used to create an image to which the image filter (or, adjusted (or, modified) image filter) is applied.

[0128] In one embodiment, the electronic device (101) may receive user input for saving a generated image filter within the screen of a gallery application. For example, the electronic device (101) may receive user input for saving a generated image filter while a UI for applying an image filter within the screen of a gallery application is displayed (e.g., while the UI of FIG. 7e is displayed). For example, the user input may be an input for selecting a visual object (e.g., “Next”).

[0129] In one embodiment, the electronic device (101) may store the generated image filter in the filter database (250) based on user input for storing the generated image filter. For example, the electronic device (101) may display a screen containing information about the image filter to be stored (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) based on user input for storing the generated image filter. For example, referring to FIG. 7f, the electronic device (101) may display a screen containing a thumbnail (790) of the image filter to be stored in the control area (705) and / or identification information (795) of the image filter based on user input for storing the generated image filter. However, the embodiment is not limited thereto. For example, the information about the image filter to be stored may include an identifier of the image filter, a name of the image filter, a thumbnail of the image filter, and / or a badge of the image filter. For example, the electronic device (101) may indicate information about the image filter to be stored, such as identification information of the creator of the image filter, information about parameters within the image filter, referenced data, type of image filter, attribute information, and / or whether a photo effect is applied.

[0130] In one embodiment, the electronic device (101) may receive user input to save a generated image filter while a screen containing information about an image filter to be saved (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) is displayed within the screen of the gallery application (e.g., while the UI of FIG. 7f is displayed). For example, the user input may be an input selecting a visual object (e.g., “Done”). In one embodiment, the electronic device (101) may save the generated image filter to the filter database (250) based on the user input to save the generated image filter. In one embodiment, the electronic device (101) may transmit information about the image filter to be saved (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) to the filter database (250) based on the user input to save the generated image filter.

[0131] In one embodiment, the filter database (250) may store image filters based on information about image filters. Subsequently, the electronic device (101) may display visual objects for each of a plurality of image filters, including newly stored image filters identified in the filter database (250) through the filter application module (270), within the control area (705). However, the embodiment is not limited thereto. For example, the electronic device (101) may display visual objects for each of a plurality of image filters, including newly stored image filters identified in the filter database (250) through the filter application module (270), within the control area (505) in the camera application.

[0132] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0133] FIG. 8 can be explained with reference to FIGS. 1 to 7f.

[0134] Referring to FIG. 8, in operation 810, the electronic device (101) may receive input for creating an image filter to apply an image effect to an image. In one embodiment, the electronic device (101) may receive input for selecting a visual object to call a user interface (UI) to apply an image filter to an image. In one embodiment, the electronic device (101) may receive input for creating an image filter to apply an image effect while displaying the screen of an application (e.g., a camera application or a gallery application) on the display (260). In one embodiment, the image may be an image displayed on the screen of the application.

[0135] In one embodiment, the electronic device (101) may display a UI for applying an image filter (or filter) to an image (or video) in response to user input on the screen of an application. In one embodiment, the UI for applying an image filter (or filter) to an image (or video) may include a visual object for creating a new image filter, an area for receiving text input for creating a new image filter, an area for adjusting a plurality of intensities of the new image filter, and / or an area for adjusting LUT editing options.

[0136] In operation 820, the electronic device (101) can identify reference data for generating an image filter based on input.

[0137] For example, the electronic device (101) may receive user input (or initial user input) (or first user input) for creating an image filter while a UI for applying an image filter within the screen of an application is displayed. For example, the user input (or initial user input) (or first user input) may be an input for determining reference data. For example, the user input (or initial user input) (or first user input) may be an input for selecting image data (310) and / or video data (320). For example, the user input (or initial user input) (or first user input) may be an input for a prompt (340). For example, the user input (or initial user input) (or first user input) may be an input for custom tone data (350).

[0138] In operation 830, the electronic device (101) can generate an image filter based on identified reference data.

[0139] In one embodiment, the electronic device (101) can generate an LUT through a reference data processing unit (220) and an LUT generation module (230) based on reference data determined based on user input for generating an image filter.

[0140] For example, the electronic device (101) can generate a LUT based on an input image through a reference data processing unit (220) and a LUT generation module (230). For example, the electronic device (101) can generate a LUT based on a selected subject (or an area containing the subject) based on user input selecting a subject (or an area containing the subject) within a (preview) image through a reference data processing unit (220) and a LUT generation module (230). For example, the electronic device (101) can generate a LUT based on a prompt (340) (e.g., “Change to a bright image,” “Change to a nostalgic feeling,” “Change to the latest trend,” or “Change to an 'AAA' style”) through a reference data processing unit (220) and a LUT generation module (230). For example, the electronic device (101) can generate a LUT based on custom tone data (350) through a reference data processing unit (220) and an LUT generation module (230).

[0141] In one embodiment, the electronic device (101) may generate an image filter including a generated LUT. In one embodiment, the electronic device (101) may generate an image filter including a LUT that reflects attribute information and / or a photographic effect. However, the embodiment is not limited thereto. In one embodiment, the electronic device (101) may include a LUT that does not reflect attribute information and / or a photographic effect, and post-processing information indicating whether attribute information and / or a photographic effect is applied. In one embodiment, the post-processing information may indicate whether attribute information and / or a photographic effect is applied.

[0142] In operation 840, the electronic device (101) can display an image with an image effect applied based on an image filter.

[0143] In one embodiment, the electronic device (101) can generate an image with an image effect applied (hereinafter, an image filtered image) by applying an image filter generated on an image (or, original image). For example, applying an image effect to an image (or, original image) may include changing the color tone of the image (or, original image) based on a LUT included in the image filter. For example, applying an image effect to an image (or, original image) may include performing post-processing (e.g., processing based on attribute information and / or photo effects) after changing the color tone of the image (or, original image) based on a LUT included in the image filter.

[0144] In operation 850, the electronic device (101) can determine whether to modify the image filter.

[0145] In one embodiment, the electronic device (101) may receive user input (or initial user input) (or first user input) for adjusting (or modifying) a generated image filter within the screen of an application. For example, the electronic device (101) may receive user input (or initial user input) (or first user input) for adjusting (or modifying) a generated image filter while a UI for applying an image filter within the screen of an application is displayed.

[0146] For example, the electronic device (101) may determine that the image filter is being modified based on receiving user input (or initial user input) (or first user input) for adjusting (or modifying) the image filter. For example, the electronic device (101) may determine that the image filter is not being modified based on not receiving user input for adjusting (or modifying) the image filter. For example, not receiving user input for adjusting (or modifying) the image filter may include receiving input for ending the modification of the image filter. For example, not receiving user input for adjusting (or modifying) the image filter may include receiving input for saving the image filter. For example, not receiving user input for adjusting (or modifying) the image filter may include receiving input for discarding the image filter.

[0147] For example, based on determining that the image filter is modified, the electronic device (101) can perform operation 860. For example, based on determining that the image filter is not modified, the electronic device (101) can perform operation 870.

[0148] In operation 860, the electronic device (101) can modify the image filter based on updated reference data.

[0149] In one embodiment, the electronic device (101) can adjust (or modify) the LUT based on user input for adjusting (or modifying) the generated image filter. For example, the electronic device (101) can adjust (or modify) the LUT through the LUT editing unit (410) based on reference data determined based on user input for adjusting (or modifying) the generated image filter. For example, the electronic device (101) can adjust (or modify) post-processing information through the LUT editing unit (410) based on reference data determined based on user input for adjusting (or modifying) the generated image filter.

[0150] In operation 870, the electronic device (101) can determine whether to store an image filter.

[0151] In one embodiment, the electronic device (101) may receive user input for saving a generated image filter within the screen of an application. For example, the electronic device (101) may receive user input for saving a generated image filter while a UI for applying an image filter within the screen of an application is displayed. For example, the electronic device (101) may receive user input for a visual object (e.g., “Done”) for saving a generated image filter within the screen of an application.

[0152] In one embodiment, the electronic device (101) may receive user input to discard a generated image filter while a UI for applying an image filter within the screen of an application is displayed. For example, the electronic device (101) may receive user input for a visual object (e.g., “Previous”) (or “Cancel”) to discard a generated image filter within the screen of an application.

[0153] For example, the electronic device (101) may determine to store an image filter based on receiving user input to store an image filter. For example, the electronic device (101) may determine to discard an image filter based on receiving user input to discard an image filter. For example, the electronic device (101) may determine to discard an image filter based on receiving user input to terminate a running application. However, the embodiments are not limited thereto. The electronic device (101) may store an image filter based on receiving user input to terminate a running application.

[0154] For example, based on determining that an image filter is stored, the electronic device (101) can perform operation 880. For example, based on determining that an image filter is not stored, the electronic device (101) can perform operation 890.

[0155] In operation 880, the electronic device (101) can store an image filter.

[0156] In one embodiment, the electronic device (101) may store the generated image filter in the image filter database (250) based on user input for storing the generated image filter. For example, the electronic device (101) may display a screen containing information about the image filter to be stored (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) based on user input for storing the generated image filter. For example, referring to FIG. 7f, the electronic device (101) may display a screen containing a thumbnail of the image filter to be stored in a control area and / or identification information of the image filter based on user input for storing the generated image filter. However, the embodiment is not limited thereto. For example, the information about the image filter to be stored may include an identifier of the image filter, a name of the image filter, a thumbnail of the image filter, and / or a badge of the image filter. For example, the electronic device (101) may indicate information about the image filter to be stored, such as identification information of the creator of the image filter, information about parameters within the image filter, referenced data, type of image filter, attribute information, and / or whether a photo effect is applied.

[0157] In one embodiment, the electronic device (101) may receive user input for saving a generated image filter while a screen containing information about an image filter to be saved within the screen of an application (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) is displayed. For example, the user input may be an input for selecting a visual object (e.g., “Done”). In one embodiment, the electronic device (101) may save the generated image filter to an image filter database (250) based on the user input for saving the generated image filter. In one embodiment, the electronic device (101) may transmit information about the image filter to be saved (e.g., a thumbnail of the image filter, and / or identification information of the image filter (e.g., a name)) to the image filter database (250) based on the user input for saving the generated image filter.

[0158] In one embodiment, the image filter database (250) may store image filters based on information about image filters. Subsequently, the electronic device (101) may display visual objects for each of a plurality of image filters, including newly stored image filters identified in the image filter database (250) through the image filter application module (270), within a control area.

[0159] In operation 890, the electronic device (101) may discard the image filter. For example, the electronic device (101) may delete the generated image filter without storing it in the filter database (250). For example, deleting the generated image filter may include deleting the generated image filter stored in the volatile memory (132) of the memory (130) from the volatile memory (132) without storing it in the non-volatile memory (134).

[0160] FIGS. 9a to 9d are drawings illustrating the operation of an electronic device generating an image filter through a camera application according to one embodiment.

[0161] FIGS. 9a to 9d can be explained with reference to FIGS. 1 to 8.

[0162] In one embodiment, the electronic device (101) may display a screen of a camera application on a display (260). In one embodiment, referring to FIG. 9a, the screen of the camera application may include a preview area (901) where a preview image (910) is displayed, and control areas (905, 907) for changing the settings of the camera (280). In one embodiment, the control area (907) may include a visual object (915) for calling a UI (user interface) for applying an image filter (or a filter) to the preview image (910) (or an image obtained through the camera (280)).

[0163] In one embodiment, the electronic device (101) can identify user input (e.g., press input, or tap input) for a visual object (915). In one embodiment, the electronic device (101) can display a UI within the screen of a camera application for applying an image filter (or filter) to a preview image (910) (or an image obtained through the camera (280)) in response to user input for the visual object (915).

[0164] For example, referring to FIG. 9b, the electronic device (101) may display within the control area (905) a visual object (920) for creating a new image filter, a visual object (931) for converting to an original screen (or a screen without an image filter applied), and / or visual objects (933, 935) representing each of a plurality of image filters. In one embodiment, the visual objects (933, 935) representing each of a plurality of image filters may correspond to a plurality of image filters stored in a filter database (250). For example, the electronic device (101) may display within the control area (905) visual objects (933, 935) for each of a plurality of image filters identified in the filter database (250) through a filter application module (270). In the following, user input for creating a new image filter (or, initial user input) (or, first user input), and / or user input for modifying a new image filter (or, subsequent user input) (or, second user input) may be referred to as multiple separate user inputs. For example, the separation of user inputs may indicate that another user input is obtained after the creation (or modification) of an image filter based on one user input is completed.

[0165] In one embodiment, the electronic device (101) may receive user input (or initial user input) (or first user input) for creating an image filter within the screen of a camera application. For example, the electronic device (101) may receive user input for creating an image filter while a UI for applying an image filter within the screen of a camera application is displayed. For example, the user input may be a tap input and / or press input for selecting a visual object (920). For example, the user input for the visual object (920) may be an input for selecting image data (310) and / or video data (320).

[0166] In one embodiment, the electronic device (101) can generate an LUT based on user input (or initial user input) (or first user input) for generating an image filter. For example, the electronic device (101) can generate an LUT through a reference data processing unit (220) and an LUT generation module (230) based on reference data determined based on user input for generating an image filter.

[0167] For example, the electronic device (101) may display a UI for allowing the user to select an input image (e.g., image data (310), and / or video data (320)) based on user input to a visual object (920). For example, referring to FIG. 9c, the electronic device (101) may display a UI including thumbnails (961, 963, 965, 967, 969) representing one or more images (or videos) in a control area (905).

[0168] In one embodiment, thumbnails (961, 963, 965, 967, 969) may represent one or more images (or videos) that are pre-selected (or sorted) (or filtered) according to the user's preference (or user's favorites). For example, while displaying a UI for allowing the user to select an input image (e.g., image data (310), and / or video data (320)), the electronic device (101) may display a UI including thumbnails (961, 963, 965, 967, 969) that represent one or more images (or videos) that are selected (or sorted) (or filtered) according to the user's preference (or user's favorites).

[0169] For example, the electronic device (101) can identify an image (or video) corresponding to a selected thumbnail as an input image based on a user input (or initial user input) (or first user input) selecting at least one of thumbnails (961, 963, 965, 967, 969). For example, the electronic device (101) can generate a LUT based on the input image through a reference data processing unit (220) and an LUT generation module (230).

[0170] In one embodiment, the electronic device (101) can generate an image filter including a generated LUT. In one embodiment, referring to FIG. 9d, the electronic device (101) can display a thumbnail representing the generated image filter on a visual object (920) within the screen of a camera application.

[0171] In one embodiment, the electronic device (101) can generate a filtered image by applying an image filter generated to a preview image (910) (or original image). In one embodiment, referring to FIG. 9d, the electronic device (101) can display the filtered image (970) in a preview area (901) within the screen of a camera application.

[0172] FIG. 10 is a diagram illustrating user interaction for a camera application while an electronic device generates an image filter, according to one embodiment.

[0173] FIG. 10 can be explained with reference to FIGS. 1 to 9d.

[0174] In one embodiment, referring to FIG. 10, within a state (1001), visual objects (920, 931, 933) for selecting image filters can be displayed in a preview area (901) within the screen of the camera application of the electronic device (101). In one embodiment, within a state (1001), a UI including thumbnails (961, 963, 965, 967, 969) representing one or more images (or videos) can be displayed in a control area (905) within the screen of the camera application of the electronic device (101). In one embodiment, the state (1001) of FIG. 10 may correspond to the state of the electronic device (101) of FIG. 9d.

[0175] In one embodiment, the electronic device (101) can transition to a state (1003) in which visual objects (920, 931, 933, 935) in which image filters can be selected are displayed in a control area (905) within a camera application screen, in accordance with a user input (1010) (e.g., drag to the left (or swipe to the left)) initiated from at least one of the visual objects (920, 931, 933) within a state (1001) in which visual objects (920, 931, 933) in which image filters can be selected are displayed, in a preview area (901) within a camera application screen, in which visual objects (920, 931, 933) in which image filters can be selected are displayed.

[0176] In one embodiment, within the state (1003), visual objects (920, 931, 933) for selecting an image filter can be displayed in a control area (905) within the screen of the camera application of the electronic device (101). In one embodiment, the state (1003) of FIG. 10 may correspond to the state of the electronic device (101) of FIG. 9b.

[0177] In one embodiment, the electronic device (101) can transition to a state (1001) in which visual objects (920, 931, 933) for selecting an image filter are displayed in a preview area (901) within the screen of the camera application, in accordance with a user input (1030) (e.g., drag to the right (or swipe to the right)) initiated from at least one of the visual objects (920, 931, 933) within a state (1003) in which visual objects (920, 931, 933) for selecting an image filter are displayed in a control area (905) within the screen of the camera application.

[0178] FIGS. 11a and FIGS. 11b are drawings illustrating the operation of an electronic device selecting an area of ​​an image for an image filter through a camera application according to one embodiment.

[0179] FIGS. 11a and FIGS. 11b can be explained with reference to FIGS. 1 through 10.

[0180] In one embodiment, the electronic device (101) may receive user input for saving a generated image filter within the screen of a camera application. For example, the electronic device (101) may receive user input for saving a generated image filter while a UI for applying an image filter within the screen of a camera application is displayed (e.g., during the state (1001) of FIG. 10). For example, the user input may be an input for selecting a visual object (e.g., “make”).

[0181] For example, referring to FIG. 11a, the electronic device (101) may display a screen including a thumbnail (1110) of an image filter to be stored in a control area (905) based on user input for storing a generated image filter, and / or a control element (1130) for determining an area of ​​an image to be used to utilize the image filter.

[0182] In one embodiment, the electronic device (101) may receive user input selecting the thumbnail (1110) and / or the control element (1130) while a screen is displayed that includes a thumbnail (1110) of an image filter to be stored in a control area (905) and / or a control element (1130) for determining an area of ​​an image to be used to use the image filter.

[0183] In one embodiment, referring to FIG. 11b, the electronic device (101) may display a screen for determining an area of ​​an image (1115) to be used for an image filter based on user input selecting a thumbnail (1110) and / or a control element (1130).

[0184] In one embodiment, the electronic device (101) may receive user input for a control element (1135) for determining an area of ​​an image (1115). In one embodiment, the electronic device (101) may determine an area of ​​the image (1115) to be used to generate an image filter according to the user input for the control element (1135).

[0185] In one embodiment, the electronic device (101) may receive user input for storing an image filter corresponding to an area of ​​the image (1115) determined by a control element (1135) while a screen for determining an area of ​​the image (1115) to be used for using an image filter is displayed. In one embodiment, the electronic device (101) may receive input for selecting a visual object (e.g., “Done”). In one embodiment, the electronic device (101) may store the generated image filter in a filter database (250) based on user input for storing an image filter according to an area of ​​the image (1115) determined by the control element (1135).

[0186] FIG. 12a is a diagram illustrating the operation of an electronic device generating an image filter through various contents according to one embodiment.

[0187] FIG. 12a can be explained with reference to FIG. 1 to FIG. 11b.

[0188] In one embodiment, the electronic device (101) can identify user input (e.g., press input, or tap input) for a visual object (e.g., 915 in FIG. 9a) for calling a user interface (UI) for applying an image filter (or filter) to a preview image (e.g., 910 in FIG. 9a) (or an image acquired through the camera (280). In one embodiment, the electronic device (101) can display a UI for applying an image filter (or filter) to a preview image (or an image acquired through the camera (280)) within the screen of the camera application in response to user input for the visual object (e.g., 915 in FIG. 9a).

[0189] For example, referring to FIG. 12a, the electronic device (101) may display a screen of a camera application on a display (260), including a preview area (1201) where a preview image (1210) is displayed in response to user input for a visual object (1215), and control areas (1205, 1207) for changing the settings of the camera (280). For example, the electronic device (101) may display a visual object (1220) for creating a new image filter, a visual object (1231) for converting to an original screen (or a screen without an image filter applied), and / or visual objects (1233) representing each of a plurality of image filters in the preview area (1201) where the preview image (1210) is displayed. For example, the electronic device (101) may display a UI in the control area (1205) to allow the user to select content (e.g., video data (1261), image data (1263), and / or audio data (1265)) to be used to create a new image filter. For example, the video data (1261) may represent a thumbnail of a video file. For example, the image data (1263) may represent a thumbnail of an image. For example, the audio data (1265) may represent album cover information of a music file or a pre-specified image related to a music file. However, the embodiments are not limited thereto. The content to be used to create a new image filter may include content (or images) obtained from a cloud server, content (or images) obtained from social media, comics (e.g., webtoons), notes, drawings, and images generated by a generative artificial intelligence model.

[0190] For example, the electronic device (101) can generate a LUT based on the selected content through a reference data processing unit (220) and a LUT generation module (230) based on a user input (or initial user input) (or first user input) selecting at least one of the content (e.g., video data (1261), image data (1263), and / or audio data (1265)). In one embodiment, the electronic device (101) can generate an image filter including the generated LUT.

[0191] For example, the electronic device (101) may generate a LUT using at least one frame (or a frame corresponding to a thumbnail, or a frame currently being played) among a plurality of frames included in the video data (1261), based on a user input (or an initial user input) (or a first user input) for selecting video data (1261). In one embodiment, the electronic device (101) may generate an image filter including a LUT generated based on the video data (1261) (or at least one frame (or a frame corresponding to a thumbnail, or a frame currently being played)).

[0192] For example, the electronic device (101) may generate a LUT using sound information (e.g., pitch, volume, timbre) and / or lyrics information included in the audio data (1265) based on a user input (or initial user input) (or first user input) selecting the audio data (1265). For example, the electronic device (101) may generate a LUT by inputting sound information (e.g., pitch, volume, timbre) and / or lyrics information (or title, singer) included in the audio data (1265) into an artificial intelligence model based on a user input selecting the audio data (1265). In one embodiment, the electronic device (101) may generate an image filter including the LUT generated based on the audio data (1265). For example, if the audio data (1265) is Spring of Vivaldi’s Four Seasons, a LUT corresponding to a note or title ('Spring') related to Spring of Vivaldi’s Four Seasons can be generated, and an image filter containing the generated LUT can be generated.

[0193] FIG. 12b is a diagram illustrating the operation of an electronic device generating an image filter through various contents according to one embodiment.

[0194] FIG. 12b can be described with reference to FIG. 1 to FIG. 12a.

[0195] Unlike in FIG. 12a, where the electronic device (101) generates an image filter using a single content, in FIG. 12b, the electronic device (101) can generate an image filter using multiple contents.

[0196] In one embodiment, referring to FIG. 12b, the electronic device (101) can receive user inputs (1271, 1273) for selecting at least two of the contents (e.g., video data (1261), image data (1263), and / or audio data (1265)).

[0197] In one embodiment, the electronic device (101) can generate a LUT through a reference data processing unit (220) and an LUT generation module (230) based on a content set (1270) selected through user inputs (1271, 1273). In one embodiment, the electronic device (101) can generate an image filter including the LUT generated based on the content set (1270).

[0198] For example, the electronic device (101) can extract at least some information (e.g., the subject of some frames of the video data (1261) (or a specific part of the subject (e.g., face))) from video data (1261) selected by user input (1271). For example, the electronic device (101) can extract at least some other information (e.g., some objects of the image data (1263) (e.g., subject, or background)) from image data (1263) selected by user input (1273).

[0199] For example, the electronic device (101) can extract at least some information for creating an image filter to be applied to a part area (e.g., a subject) of an image (1210) from video data (1261) selected by user input (1271). For example, the electronic device (101) can extract at least some other information for creating an image filter to be applied to a part other area (e.g., a background) of an image (1210) from image data (1263) selected by user input (1273).

[0200] In one embodiment, the electronic device (101) can generate a first LUT and a first image filter corresponding to the first LUT from video data (1261) selected by user input (1271). In one embodiment, the electronic device (101) can generate a second LUT and a second image filter corresponding to the second LUT from image data (1263) selected by user input (1273).

[0201] FIG. 12c is a diagram illustrating the operation of an electronic device generating an image filter through various contents according to one embodiment.

[0202] FIG. 12c can be explained with reference to FIG. 1 to FIG. 12b.

[0203] In one embodiment, the electronic device (101) may receive user input selecting a portion of an image (1210) to which an image filter is to be applied. For example, referring to FIG. 12c, the electronic device (101) may receive user input selecting a portion (1290) of an image (1210) to which an image filter is to be applied. In one embodiment, the part (1290) may be a subject (or a part of a subject (e.g., a face)) or a background (or a part of a background (e.g., a desk, a blackboard, a landscape, a building, the sky)). For example, the electronic device (101) may identify the part (1290) to which an image filter is to be applied based on user input within the image (1210). For example, the electronic device (101) may identify the part (1290) containing the subject (or a part of a subject) to which an image filter is to be applied based on an object detection algorithm (or a face detection algorithm) based on user input within the image (1210). According to an embodiment, the electronic device (101) may enlarge the part (1290) and display the enlarged part (1290) superimposed on the image (1210).

[0204] In one embodiment, the electronic device (101) may display some of the contents (e.g., video data (1261) and image data (1263)) among a plurality of contents in a control area (1205) in response to user input selecting a portion (1290) to which an image filter is to be applied within an image (1210). For example, the electronic device (101) may display some of the contents associated with the portion (1290) to which an image filter is to be applied within an image (1210). For example, if the portion (1290) is the face of a subject, some of the contents including (or depicting) the face may be displayed in the control area (1205). However, the embodiment is not limited thereto. The electronic device (101) may display some of the contents (e.g., video data (1261) and image data (1263)) among a plurality of contents according to the depiction of the image (1210). For example, if the image (1210) depicts a landscape, some of the content depicting the landscape can be displayed in the control area (1205).

[0205] In one embodiment, the electronic device (101) may receive a user input (or initial user input) (or first user input) for selecting at least one of some contents (e.g., video data (1261), and / or image data (1263)). In one embodiment, the electronic device (101) may generate a LUT through a reference data processing unit (220) and an LUT generation module (230) based on the selected content according to the user input for selecting at least one of some contents (e.g., video data (1261), and / or image data (1263)), and generate an image filter including the generated LUT.

[0206] FIGS. 13a, FIGS. 13b, and FIGS. 13c are drawings illustrating the operation of an electronic device generating an image filter by referencing the content of another application according to one embodiment.

[0207] FIGS. 13a to 13c can be explained with reference to FIGS. 1 to 12c.

[0208] In one embodiment, referring to FIG. 13a, within a state (1301), the electronic device (101) can simultaneously display screens (1310, 1320) of two or more applications on the display (260). In one embodiment, the electronic device (101) can display screens (1310, 1320) of two or more applications in different areas of the display (260). For example, the electronic device (101) can display a screen (1310) of a camera application and a screen (1320) of a gallery application on the display (260). In one embodiment, the screen (1310) of the camera application may include a visual object (1315) for calling a user interface (UI) for applying an image filter (or a filter) to a preview image (or an image obtained through the camera (280)). In one embodiment, the screen (1320) of the gallery application may include one or more thumbnail images (1331, 1333, 1335).

[0209] In one embodiment, the electronic device (101) can identify user input (1351) (e.g., press input, or tap input) for a visual object (1315). In one embodiment, as the electronic device (101) identifies user input (1351) (e.g., press input, or tap input) for a visual object (1315), it can enter a mode for applying an image filter to a preview image within a screen (1310) of a camera application.

[0210] For example, referring to FIG. 13b, in a state (1303) in which the electronic device (101) has entered a mode for applying an image filter, the electronic device (101) may receive a user input (1353) (or initial user input) (or first user input) for selecting at least one of one or more thumbnail images (1331, 1333, 1335).

[0211] For example, the electronic device (101) can identify an image (or video) corresponding to a selected thumbnail image (1331) as an input image based on user input (1353). For example, the electronic device (101) can generate a LUT through a reference data processing unit (220) and an LUT generation module (230) based on the input image corresponding to the thumbnail image (1331), and generate an image filter including the generated LUT.

[0212] In one embodiment, the electronic device (101) can generate a filtered image by applying an image filter generated on a preview image within a screen (1310) of a camera application. In one embodiment, referring to FIG. 13c, the electronic device (101) can display the filtered image within a screen (1310) of a camera application and also display an image (1360) indicating that an image filter has been applied to the image.

[0213] In one embodiment, the electronic device (101) can acquire (or store) an image with an image filter applied based on user input for image capture while displaying a filtered image within the screen (1310) of a camera application.

[0214] For example, the electronic device (101) may store an image with an image filter applied together with an original image in memory (130) based on user input for capturing an image. Accordingly, the electronic device (101) may display the original image instead of the image with the image filter applied, based on user input for restoration (or recovery) of the image with the image filter applied received while displaying the image with the image filter applied.

[0215] For example, the electronic device (101) may store information about the image filter as metadata of the image, along with an image to which the image filter has been applied, based on user input for capturing an image. In one embodiment, the metadata may include information about the image (or thumbnail image) used to create the image filter and the gallery application.

[0216] In one embodiment, the electronic device (101) can adjust (or modify) the LUT based on user input (or subsequent user input) (or second user input) for adjusting (or modifying) the generated image filter while displaying a filtered image within the screen (1310) of the camera application.

[0217] In one embodiment, the electronic device (101) may store a LUT and / or an image filter based on user input for storing a generated image filter while displaying a filtered image within the screen (1310) of a camera application.

[0218] For example, the electronic device (101) can adjust (or modify) the LUT through the LUT editing unit (410) based on reference data determined based on user input (or subsequent user input) (or second user input) for adjusting (or modifying) the generated image filter. For example, the electronic device (101) can adjust (or modify) post-processing information through the LUT editing unit (410) based on reference data determined based on user input for adjusting (or modifying) the generated image filter. According to an embodiment, if the user input for adjusting (or modifying) the generated image filter indicates selecting a new input image, the electronic device (101) can generate a new image filter through the reference data processing unit (220) and the LUT generation module (230) using the new input image.

[0219] FIG. 14 is a diagram illustrating the operation of an electronic device generating an image filter by referencing the content of another application according to one embodiment.

[0220] FIG. 14 can be explained with reference to FIGS. 1 to 13c.

[0221] Referring to FIG. 14, the electronic device (1401) may include a large screen display. For example, the electronic device (1401) may be a (multi)foldable electronic device or a tablet. For example, if the electronic device (1401) is a multifoldable electronic device, the electronic device (1401) may include an auxiliary display and a main display that is wider than the auxiliary display. For example, the operations illustrated in FIG. 5a through FIG. 7f may be performed through the electronic device (1401) while the electronic device (1401) is displaying a camera application (or a gallery application) through the auxiliary display (with the main display turned off).

[0222] For example, the operation according to FIG. 14 may be performed while the electronic device (1401) displays a camera application (or a gallery application) through the main display (with the auxiliary display turned off).

[0223] For example, referring to FIG. 14, the electronic device (1401) can simultaneously display screens of two or more applications (1411, 1413, 1415, 1417) on the main display. In one embodiment, the electronic device (1401) can display screens of two or more applications (1411, 1413, 1415, 1417) in different areas of the main display. For example, the electronic device (1401) can display a screen of a camera application (1411) in the left area of ​​the main display. For example, the electronic device (1401) can display a screen of a gallery application (1413) in the upper part of the central area of ​​the main display. For example, the electronic device (1401) can display a screen of a content playback application (1415) in the lower part of the central area of ​​the main display. For example, the electronic device (1401) can display a screen (1417) of a social media application in the right area of ​​the main display.

[0224] In one embodiment, the electronic device (1401) can identify user input (1421) (e.g., press input, or tap input) for a visual object to which an image filter (or, filter) is to be applied within the screen (1411) of the camera application. In one embodiment, the electronic device (1401) can enter a mode to apply an image filter to a preview image within the screen (1411) of the camera application by identifying user input (1421) for a visual object to which an image filter (or, filter) is to be applied.

[0225] For example, while the electronic device (1401) is in a state where it has entered a mode for applying an image filter, the electronic device (1401) may receive user input (1423, 1425, 1427) (or initial user input) (or first user input) within screens (1411, 1413, 1415, 1417) of two or more applications.

[0226] For example, the electronic device (1401) can select a thumbnail image based on user input (1423) within the screen (1413) of the gallery application. For example, the electronic device (1401) can generate an LUT and an image filter corresponding to the generated LUT using an image corresponding to the thumbnail image selected based on user input (1423) within the screen (1413) of the gallery application.

[0227] For example, the electronic device (1401) can identify at least one frame (or currently playing frame) within the video based on a user input (1425) selecting the video within the screen (1415) of the content playback application. For example, the electronic device (1401) can generate an LUT and an image filter corresponding to the generated LUT based on at least one frame (or currently playing frame) within the video identified based on the user input (1425) selecting the video within the screen (1415) of the content playback application. However, the embodiments are not limited thereto. For example, the electronic device (1401) can generate and / or update an image filter through frames displayed in real-time on the main display according to the playback of the video based on the user input (1425) selecting the video within the screen (1415) of the content playback application. For example, the electronic device (1401) can apply an image filter generated according to frames displayed in real time on the main display according to video playback to an image in the camera application screen (1411) in real time, based on a user input (1425) selecting a video in the screen (1415) of the content playback application.

[0228] For example, an electronic device (1401) can identify at least a portion of content (or image) based on user input (1427) selecting content (or image) within a screen (1417) of a social media application. For example, the electronic device (1401) can generate an LUT and an image filter corresponding to the generated LUT based on the content (or image) (or a portion thereof) identified based on user input (1427) within a screen (1417) of a social media application.

[0229] For example, the electronic device (1401) can extract an image filter applied to content (or an image) within a screen (1417) of a social media application (using an artificial intelligence model). For example, the electronic device (1401) can apply the extracted image filter to an image within a screen (1411) of a camera application.

[0230] For example, the electronic device (1401) can generate a LUT and an image filter corresponding to the generated LUT based on text (or audio) indicated by user input (1427) within the screen (1417) of the social media application. For example, if the text indicated by user input (1427) within the screen (1417) of the social media application is “dark black and white ghost,” the electronic device (1401) can generate a LUT and an image filter corresponding to the generated LUT (e.g., a dark black and white image filter) based on the text.

[0231] In FIG. 14, it is illustrated that the electronic device (1401) enters a mode for applying an image filter upon identifying user input (1421) in a camera application, but this is merely an example. For example, the electronic device (1401) may enter a mode for applying an image filter to content (or images) included in each of the screens (1411, 1413, 1415, 1417) of each of two or more applications.

[0232] For example, the electronic device (1401) may receive an input to enter a mode for applying an image filter within a screen (1413) of a gallery application. Accordingly, the electronic device (1401) may generate an LUT and an image filter corresponding to the generated LUT based on the selected object, in accordance with an input to select an object for the image filter in screens (1411, 1415, 1417) of other applications other than the gallery application, and apply the image filter to the content within the gallery application.

[0233] For example, the electronic device (1401) may receive an input to enter a mode for applying an image filter within a screen (1415) of a content playback application. Accordingly, the electronic device (1401) may generate an LUT and an image filter corresponding to the generated LUT based on the selected object, in accordance with an input to select an object for the image filter from screens (1411, 1413, 1417) of other applications other than the content playback application, and apply the image filter to the content within the content playback application.

[0234] For example, the electronic device (1401) may receive an input to enter a mode for applying an image filter within a screen (1417) of a social media application. Accordingly, the electronic device (1401) may generate an LUT and an image filter corresponding to the generated LUT based on the selected object, in accordance with an input to select an object for the image filter from screens (1411, 1413, 1415) of other applications other than the social media application, and apply the image filter to the content within the social media application.

[0235] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs.

[0236] As described above, the electronic device (101) may include a touchscreen display (260), an image sensor, at least one processor (120) including a processing circuit, and a memory (130) that stores instructions and includes one or more storage media. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to display a preview image obtained through the image sensor via the touchscreen display. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to receive a first user input regarding the preview image via the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to display a first thumbnail preview image corresponding to a first filter and a first graphic object on the preview image via the touchscreen display in response to the first user input. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to receive a second user input regarding the first graphic object via the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to display a plurality of thumbnail images on the preview image in response to the second user input.When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the plurality of thumbnail images to include a first thumbnail image corresponding to a first image stored in the memory, and to receive a third user input for the first thumbnail image through the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause, in response to the third user input, to generate filter information using the first thumbnail image or the first image, and to generate a modified preview image in which the filter information is applied to the preview image. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the modified preview image to be displayed through the touchscreen display while the plurality of thumbnail images are displayed on the modified preview image.

[0237] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the display of the plurality of thumbnail images at at least a portion of a first location where the first graphic object and the first thumbnail preview image are displayed, and the display of the first graphic object and the first thumbnail preview image at a second location different from the first location.

[0238] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause at least a portion of the first thumbnail image to be displayed at a location where the graphic object is displayed through the touchscreen display in response to a third user input.

[0239] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may be caused to display at least a portion of the first thumbnail image at the location and then display the modified preview image.

[0240] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may receive a fourth user input regarding the first thumbnail preview image through the touchscreen display, and in response to receiving the fourth user input, may cause the display of the plurality of thumbnail images to be withheld and the first thumbnail preview image and at least one part of the first thumbnail image to be displayed at the first location through the touchscreen display.

[0241] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may receive a fifth user input for the at least one part of the first thumbnail image through the touchscreen display, display the plurality of thumbnail images on the at least part of the first location through the touchscreen display, and display the first graphic object and the first thumbnail preview image at the second location.

[0242] The plurality of thumbnail images may further include a second thumbnail image corresponding to a second image stored in the memory. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may receive a sixth user input for the second thumbnail image through the touchscreen display, and in response to the sixth user input, generate other filter information using the second thumbnail image or the second image, display at least one part of the second thumbnail image at a location where at least one part of the first thumbnail image is displayed through the touchscreen display, generate the other modified preview image so that the other filter information is displayed on the preview image, and cause the other preview image to be displayed through the touchscreen display while the plurality of thumbnail images are displayed on the other modified preview image.

[0243] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may be caused to perform the generation of the filter information using a machine learning model stored in the memory. The machine learning model may be trained to generate the filter information based on at least one image.

[0244] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may receive a seventh user input for a graphic object representing at least a portion of the filter information while displaying the modified preview image through the touchscreen display, and in response to receiving the seventh user input, update the filter information, create another modified preview image with the updated filter information applied to the preview image, and display the other modified preview image while the plurality of thumbnail images are displayed on the other modified preview image through the touchscreen display.

[0245] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) receives an eighth user input for a graphic object representing at least a portion of the filter information while displaying the modified preview image through the touchscreen display, and in response to receiving the eighth user input, determines the intensity with which the filter information is applied to the preview image, generates another modified preview image with the filter information applied to the preview image according to the intensity, and causes the other modified preview image to be displayed while the plurality of thumbnail images are displayed on the other modified preview image through the touchscreen display.

[0246] As described above, the electronic device (101) may include a display (260), at least one processor (120) including a processing circuit, and a memory (130) including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the display (260) to display a screen including at least one visual object for inputting reference data for creating an image and an image filter. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the display of the screen to receive a plurality of separate user inputs for the at least one visual object. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may generate the image filter based on reference data selected based on the first user input among the plurality of user inputs, and display a filtered image with the generated image filter applied to the image through the display (260). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may update the image filter based on a subsequent user input after the first user input among the plurality of user inputs, and display another filtered image with the updated image filter applied to the image through the display (260).

[0247] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the selected image among a plurality of images to be determined as the reference data based on the initial user input. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the image filter to be generated based on other image filters applied to the selected image.

[0248] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to determine a prompt based on the subsequent user input. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the image filter to be updated by changing the lookup table and / or post-processing information of the image filter based on inputting the prompt into an artificial intelligence model.

[0249] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to determine the application strength of the image filter based on the subsequent user input. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to update the image filter by changing the lookup table and / or post-processing information of the image filter based on the application strength.

[0250] The above screen is a screen of a camera application, and the above image may be a preview image obtained through the camera (280).

[0251] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to receive user input for acquiring an image through the camera (280). When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to acquire an image with the image filter applied based on receiving the user input.

[0252] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to receive an input for storing the other filtered image before determining whether to store the image filter. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to store the other filtered image based on the input.

[0253] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may receive another input to determine whether to store the image filter after storing the other filtered image. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the image filter to be discarded without storing the image filter based on the other input indicating the discarding of the image filter. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the image filter to be stored in non-volatile memory (130) based on the other input indicating the storage of the image filter.

[0254] The above screen may be a screen of a gallery application. The above image may be an image selected through the gallery application among a plurality of images.

[0255] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to receive user input for storing the other filtered image for the selected image. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to store the other filtered image to which the image filter has been applied, based on receiving the user input.

[0256] The method described above may be performed by an electronic device (101) comprising a touchscreen display (260) and an image sensor. The method may include an operation of displaying a preview image obtained through the image sensor via the touchscreen display. The method may include an operation of receiving a first user input regarding the preview image via the touchscreen display. The method may include an operation of displaying a first thumbnail preview image corresponding to a first filter and a first graphic object on the preview image via the touchscreen display in response to the first user input. The method may include an operation of receiving a second user input regarding the first graphic object via the touchscreen display. The method may include an operation of displaying a plurality of thumbnail images on the preview image in response to the second user input, wherein the plurality of thumbnail images include a first thumbnail image corresponding to a first image stored in the memory. The above method may include an operation of receiving a third user input regarding the first thumbnail image through the touchscreen display. The above method may include an operation of generating filter information using the first thumbnail image or the first image in response to the third user input. The above method may include an operation of generating a modified preview image in which the filter information is applied to the preview image. The above method may include an operation of displaying the modified preview image while the plurality of thumbnail images are displayed on the modified preview image through the touchscreen display.

[0257] The above method may include the operation of displaying the plurality of thumbnail images at at least a portion of a first location where the first graphic object and the first thumbnail preview image are displayed, and the operation of displaying the first graphic object and the first thumbnail preview image at a second location different from the first location.

[0258] The above method may include an operation of displaying at least a portion of the first thumbnail image at a location where the graphic object is displayed through the touchscreen display in response to a third user input.

[0259] The above method may include the operation of displaying at least a portion of the first thumbnail image at the above location and then displaying the modified preview image.

[0260] The above method may include the operation of receiving a fourth user input regarding the first thumbnail preview image through the touchscreen display, the operation of refraining from displaying the plurality of thumbnail images in response to receiving the fourth user input, and the operation of displaying the first thumbnail preview image and at least one part of the first thumbnail image at the first location through the touchscreen display.

[0261] The above method may include receiving a fifth user input for at least one part of the first thumbnail image through the touchscreen display, displaying the plurality of thumbnail images on at least a part of the first position through the touchscreen display, and displaying the first graphic object and the first thumbnail preview image at the second position.

[0262] The plurality of thumbnail images may further include a second thumbnail image corresponding to a second image stored in the memory. The method may include: receiving a sixth user input for the second thumbnail image through the touchscreen display; generating other filter information using the second thumbnail image or the second image in response to the sixth user input; displaying at least one part of the second thumbnail image at a location where at least one part of the first thumbnail image is displayed through the touchscreen display; generating the other modified preview image so that the other filter information is displayed on the preview image; and displaying the other preview image through the touchscreen display while the plurality of thumbnail images are displayed on the other modified preview image.

[0263] The above method may include an operation of generating filter information using a machine learning model stored in the memory. The machine learning model may be trained to generate filter information based on at least one image.

[0264] The above method may include receiving a seventh user input for a graphic object representing at least a portion of the filter information while displaying the modified preview image through the touchscreen display, updating the filter information in response to receiving the seventh user input, generating another modified preview image with the updated filter information applied to the preview image, and displaying the other modified preview image while the plurality of thumbnail images are displayed on the other modified preview image through the touchscreen display.

[0265] The above method may include: receiving an eighth user input for a graphic object representing at least a portion of the filter information while displaying the modified preview image through the touchscreen display; determining the intensity with which the filter information is applied to the preview image in response to receiving the eighth user input; generating another modified preview image with the filter information applied to the preview image according to the intensity; and displaying the other modified preview image while the plurality of thumbnail images are displayed on the other modified preview image through the touchscreen display.

[0266] A method as described above may be performed by an electronic device (101) including a display (260). The method may include an operation of displaying a screen through the display (260) that includes at least one visual object for inputting reference data for creating an image and an image filter. The method may include an operation of receiving a plurality of separate user inputs for the at least one visual object while displaying the screen. The method may include an operation of creating the image filter based on reference data selected based on the first user input among the plurality of user inputs, and displaying a filtered image with the created image filter applied to the image through the display (260). The method may include an operation of updating the image filter based on a subsequent user input after the first user input among the plurality of user inputs, and displaying another filtered image with the updated image filter applied to the image through the display (260).

[0267] The above method may include an operation of determining a selected image among a plurality of images as the reference data based on the initial user input. The above method may include an operation of generating the image filter based on another image filter applied to the selected image.

[0268] The above method may include an operation to determine a prompt based on the subsequent user input. The above method may include an operation to update the image filter by changing the lookup table and / or post-processing information of the image filter based on the prompt.

[0269] The above method may include an operation of determining the application strength of the image filter based on the subsequent user input. The above method may include an operation of updating the image filter by changing the lookup table and / or post-processing information of the image filter based on the application strength.

[0270] The above method may include an operation of receiving user input to acquire an image through the camera (280). Based on receiving the user input, the above method may include an operation of acquiring an image to which the image filter is applied.

[0271] The above method may include an operation of receiving an input for storing the other filtered image before determining whether to store the image filter. The above method may include an operation of storing the other filtered image based on the input.

[0272] The above method may include an operation of receiving another input to determine whether to store the image filter after storing the other filtered image. The above method may include an operation of discarding the image filter without storing the image filter based on the other input indicating discarding the image filter. The above method may include an operation of storing the image filter in a non-volatile memory (130) based on the other input indicating storing the image filter.

[0273] The above method may include an operation of receiving user input for storing the other filtered image for the selected image. Based on receiving the user input, the above method may include an operation of storing the other filtered image to which the image filter is applied.

[0274] A non-transitory computer-readable storage medium as described above may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor (120) of an electronic device (101) comprising a touchscreen display (260) and an image sensor, the electronic device (101) may cause the electronic device (101) to display a preview image obtained through the image sensor via the touchscreen display. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to receive a first user input regarding the preview image via the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to display a first thumbnail preview image corresponding to a first filter and a first graphic object on the preview image via the touchscreen display in response to the first user input. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to receive a second user input regarding the first graphic object via the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to display a plurality of thumbnail images on the preview image in response to the second user input.When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the plurality of thumbnail images to include a first thumbnail image corresponding to a first image stored in the memory, and to receive a third user input for the first thumbnail image through the touchscreen display. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause, in response to the third user input, to generate filter information using the first thumbnail image or the first image, and to generate a modified preview image in which the filter information is applied to the preview image. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the modified preview image to be displayed through the touchscreen display while the plurality of thumbnail images are displayed on the modified preview image.

[0275] A non-transitory computer-readable storage medium as described above may store a program containing instructions. When the instructions are executed individually or collectively by at least one processor (120) of an electronic device (101) including a display (260), the electronic device (101) may cause the display (260) to display a screen containing at least one visual object for inputting reference data for creating an image and an image filter. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the display of the screen to receive a plurality of separate user inputs for the at least one visual object. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may generate the image filter based on reference data selected based on the first user input among the plurality of user inputs, and display a filtered image with the generated image filter applied to the image through the display (260). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may update the image filter based on a subsequent user input after the first user input among the plurality of user inputs, and display another filtered image with the updated image filter applied to the image through the display (260).

[0276] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0277] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0278] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0279] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0280] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0281] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., CD-ROM (compact disc read-only memory)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0282] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), touchscreen display (260), Image sensor, At least one processor (120) including a processing circuit, and The electronic device (101) includes a memory (130) that stores instructions and includes one or more storage media, and when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), A preview image obtained through the image sensor is displayed through the touchscreen display, and A first user input for the preview image is received through the touchscreen display, and In response to the first user input, a first thumbnail preview image corresponding to a first filter and a first graphic object are displayed on the preview image through the touchscreen display, and Through the touchscreen display, a second user input for the first graphic object is received, and In response to the second user input, a plurality of thumbnail images are displayed on the preview image, and the plurality of thumbnail images include a first thumbnail image corresponding to a first image stored in the memory, Receiving a third user input for the first thumbnail image through the touchscreen display, In response to the above third user input, filter information is generated using the above first thumbnail image or the above first image, and Generates a modified preview image in which the above filter information is applied to the above preview image, and Causing to display the modified preview image while the plurality of thumbnail images are displayed on the modified preview image through the touchscreen display, Electronic device.

2. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Displaying the plurality of thumbnail images at at least a portion of a first location where the first graphic object and the first thumbnail preview image are displayed, Causing the first graphic object and the first thumbnail preview image to be displayed at a second location different from the first location, Electronic device.

3. In claim 1 or claim 2, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), In response to a third user input, causing at least a portion of the first thumbnail image to be displayed at a location where the graphic object is displayed via the touchscreen display, Electronic device.

4. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Causing to display at least a portion of the first thumbnail image at the above location and then perform the display of the modified preview image, Electronic device.

5. In any one of claims 1 to 4, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Receiving a fourth user input for the first thumbnail preview image through the touchscreen display, In response to receiving the above fourth user input, the display of the plurality of thumbnail images is refrained from, and Causing to display the first thumbnail preview image and at least one part of the first thumbnail image at the first location through the touchscreen display, Electronic device.

6. In Claim 5, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Receiving a fifth user input for at least one portion of the first thumbnail image through the touchscreen display, Through the touchscreen display, the plurality of thumbnail images are displayed on at least a portion of the first position, and Causing the first graphic object and the first thumbnail preview image to be displayed at the second position, Electronic device.

7. In Claim 3, The plurality of thumbnail images further include a second thumbnail image corresponding to a second image stored in the memory, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Receiving a sixth user input for the second thumbnail image through the touchscreen display, In response to the sixth user input above, other filter information is generated using the second thumbnail image or the second image, and Through the touchscreen display, at least one part of the second thumbnail image is displayed at a location where at least one part of the first thumbnail image is displayed, and Generate the other modified preview image so that the other filter information is displayed on the preview image, and Causing to display the other preview image while the plurality of thumbnail images are displayed on the other modified preview image through the touchscreen display, Electronic device.

8. In any one of claims 1 to 7, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Using a machine learning model stored in the memory, the generation of the filter information is caused to be performed, and the machine learning model is trained to generate filter information based on at least one image. Electronic device.

9. In any one of claims 1 to 8, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), While displaying the modified preview image through the touchscreen display, receiving a seventh user input for a graphic object representing at least a portion of the filter information, and In response to receiving the above seventh user input, the filter information is updated, and Generates another modified preview image in which the above-mentioned updated filter information is applied to the above-mentioned preview image, and Causing to display the other modified preview image while the plurality of thumbnail images are displayed on the other modified preview image through the touchscreen display, Electronic device.

10. In any one of claims 1 to 9, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), While displaying the modified preview image through the touchscreen display, receiving an eighth user input for a graphic object representing at least a portion of the filter information, and In response to receiving the eighth user input, the intensity of the filter information applied to the preview image is determined, and Generates another modified preview image in which the filter information is applied to the preview image according to the above intensity, and Causing to display the other modified preview image while the plurality of thumbnail images are displayed on the other modified preview image through the touchscreen display, Electronic device.

11. A method of an electronic device (101) including a touchscreen display (260) and an image sensor, The operation of displaying a preview image obtained through the image sensor via the touchscreen display, The operation of receiving a first user input for the preview image through the touchscreen display, An operation of displaying a first thumbnail preview image corresponding to a first filter and a first graphic object on the preview image through the touchscreen display in response to the first user input, The operation of receiving a second user input for the first graphic object through the touchscreen display, An operation of displaying a plurality of thumbnail images on the preview image in response to the second user input, wherein the plurality of thumbnail images include a first thumbnail image corresponding to a first image stored in the memory, The operation of receiving a third user input for the first thumbnail image through the touchscreen display, An operation to generate filter information using the first thumbnail image or the first image in response to the third user input, The operation of generating a modified preview image in which the above filter information is applied to the above preview image, and The method includes an operation of displaying the modified preview image while the plurality of thumbnail images are displayed on the modified preview image through the touchscreen display. method.

12. In Claim 11, The operation of displaying the plurality of thumbnail images at at least a portion of a first location where the first graphic object and the first thumbnail preview image are displayed, and The operation of displaying the first graphic object and the first thumbnail preview image at a second location different from the first location. method.

13. In claim 11 or claim 12, The operation of displaying at least a portion of the first thumbnail image at a location where the graphic object is displayed via the touchscreen display in response to a third user input. method.

14. In Claim 13, The method includes the operation of displaying at least a portion of the first thumbnail image at the above location and then displaying the modified preview image. method.

15. In any one of claims 11 to 14, The operation of receiving a fourth user input for the first thumbnail preview image through the touchscreen display, An operation to refrain from displaying the plurality of thumbnail images in response to receiving the fourth user input, and The method includes the operation of displaying the first thumbnail preview image and at least one portion of the first thumbnail image at the first position through the touchscreen display. method.

Images