Electronic device and image correcting method for electronic device

Abstract

An electronic device (200) according to various embodiments of the present document may comprise: a display (230); a memory (220); and a processor (210) operatively connected to the display and the memory. The memory (220) may store instructions which can be executed by at least one processor and, when executed, instruct the electronic device (200) to: select any one original image among images stored in the memory; generate a corrected image by executing a correction function for the original image; identify, from among a plurality of objects included in the original image and the corrected image, at least one object having a large correction effect from the original image according to the execution of the correction function; generate at least one thumbnail including the identified at least one object; display at least a part of the original image and at least a part of the corrected image in a first area (410) of the display; and display the at least one thumbnail in a second area (430) of the display.

Description

Electronic devices and methods for image correction of electronic devices

[0001] This article relates to an electronic device, and more specifically to an electronic device that provides automatic correction of stored images.

[0002] Portable electronic devices (hereinafter, "electronic devices"), such as smartphones, can provide diverse user experiences through various applications. Electronic devices can capture images of their surroundings using cameras and download and store image files over a network. Electronic devices may include a gallery application that displays stored images and provides various functions, such as copying / deleting / moving them, sharing them with other devices, and editing images.

[0003] The gallery application can provide editing functions that allow users to directly edit images, and can also provide an automatic correction function that automatically analyzes and corrects images without user input.

[0004] When automatically correcting images in an electronic device's gallery application, the effect of the correction may not be significant, depending on the characteristics of the original image. In this case, users may not perceive significant improvements in the corrected image compared to the original, and it may be difficult to identify which parts of the image have been improved.

[0005] An electronic device according to this disclosure (or specification, invention) may include a display (230), a memory (220), and a processor (210) operatively connected to the display and the memory.

[0006] According to one embodiment, the memory (220) may be executed by at least one processor, and when executed, the electronic device may store instructions that cause the electronic device to select one original image from among images stored in the memory, execute a correction function for the original image to generate a corrected image, identify at least one object having a large correction effect from the original image according to the execution of the correction function among a plurality of objects included in the original image and the corrected image, generate at least one thumbnail including the identified at least one object, display at least a portion of the original image and at least a portion of the corrected image on a first area (410) of the display, and display the at least one thumbnail on a second area (430) of the display.

[0007] According to one embodiment, the memory (220) may store instructions that cause the electronic device (200) to display, in the first area, a first enlarged image (462) that enlarges an area including at least a part of an object included in the first thumbnail in the original image and a second enlarged image (464) that enlarges an area including at least a part of an object included in the first thumbnail in the corrected image when a user input for a first thumbnail (432) among the thumbnails displayed in the second area is received.

[0008] In accordance with various embodiments of the present document, a method for correcting an image of an electronic device may include: selecting an original image from among images stored in a memory of the electronic device; executing a correction function for the original image to generate a corrected image; identifying at least one object having a large correction effect from the original image according to execution of the correction function among a plurality of objects included in the original image and the corrected image; generating at least one thumbnail including the identified at least one object; displaying at least a portion of the original image and at least a portion of the corrected image in a first area of ​​a display of the electronic device, and displaying the at least one thumbnail in a second area of ​​the display; and, when a user input for a first thumbnail among the thumbnails displayed in the second area is received, displaying a first enlarged image in the first area, which is an enlarged area including at least a portion of an object included in the first thumbnail in the original image, and a second enlarged image in the first area, which is an enlarged area including at least a portion of an object included in the first thumbnail in the corrected image.

[0009] According to various embodiments of the present document, a method for correcting an image in an electronic device can be provided, in which, when automatically correcting an image in a gallery application of an electronic device, an area of ​​an object with a large correction effect is extracted from a corrected image and provided to the user, thereby enabling the user to easily recognize the effect of the automatic correction.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0011] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0012] FIG. 3 illustrates the architecture of an image auto-correction function according to one embodiment.

[0013] FIG. 4 illustrates screens sequentially displayed during automatic image correction in a gallery application according to one embodiment.

[0014] FIG. 5 illustrates an example of a screen showing an original image and a corrected image according to one embodiment.

[0015] FIG. 6 illustrates an example of a screen showing an original image and a corrected image according to one embodiment.

[0016] FIG. 7 illustrates an example of a screen showing an area of ​​a specific object in an original image and a corrected image according to one embodiment.

[0017] FIG. 8 illustrates screens sequentially displayed during automatic image correction in a gallery application according to one embodiment.

[0018] FIG. 9 illustrates screens sequentially displayed during automatic image correction in a gallery application according to one embodiment.

[0019] FIG. 10 illustrates an example of changing the effect of the correction engine by specifying a certain area while a specific object is displayed according to one embodiment.

[0020] FIG. 11 illustrates a method for determining the order of thumbnails corresponding to objects in an image according to one embodiment.

[0021] FIG. 12 illustrates a method for determining the order of thumbnails corresponding to objects in an image according to one embodiment.

[0022] FIG. 13 illustrates a method for determining the order of thumbnails corresponding to objects in an image according to one embodiment.

[0023] Fig. 14 is a flowchart of an image correction method of an electronic device according to one embodiment.

[0024] Hereinafter, various embodiments of the present invention will be described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, the invention disclosed in this document may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0025] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0026] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0027] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0028] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0029] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0030] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0031] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0032] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0033] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0034] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0035] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0036] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0037] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0038] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0039] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0040] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0041] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0042] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0043] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0044] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0045] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0046] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0047] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0048] Referring to FIG. 2, an electronic device (200) according to one embodiment may include a display (230), a camera (240), a processor (210), and a memory (220). Even if some of the illustrated components are omitted or replaced with other components, various embodiments of the present document may be implemented. In addition to the illustrated components, the electronic device (200) may further include at least some of the components and / or functions of the electronic device (101) of FIG. 1. At least some of the respective components of the illustrated (or not illustrated) electronic device (200) may be operatively, functionally, and / or electrically connected to each other.

[0049] According to one embodiment, some of the components of the electronic device (200) (e.g., processor (210), memory (220)) may be disposed inside the housing of the electronic device (200), and at least some of the other components (e.g., display (230), camera (240)) may be visually exposed to the outside of the housing. The electronic device (200) may be implemented as a device of various form factors, such as a foldable type, a rollable type (or a slidable type), etc., in which a display area may be expanded.

[0050] According to one embodiment, the display (230) can display various images provided from the processor (210). For example, the display (230) can be implemented as any one of a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display, but is not limited thereto. The display (230) can be configured as a touch screen that detects touch and / or proximity touch (or hovering) input using a part of a user's body (e.g., a finger) or an input device (e.g., a stylus pen). The display (230) can include at least some of the configurations and / or functions of the display module (160) of FIG. 1.

[0051] According to one embodiment, the camera (240) can capture a subject in the surroundings, convert the image information into digital data, and provide it to the processor (210). The electronic device (200) can include at least one camera on the front side where the display (230) is arranged in the housing and / or on the back side opposite thereto. According to one embodiment, the camera (240) can include a lens assembly including at least one lens that collects light emitted from an external environment (or a subject), an image sensor (e.g., a CCD (charged coupled device) sensor, a CMOS (complementary metal oxide semiconductor) sensor) that converts the light collected through the lens assembly into an electrical signal to generate image data, and an image signal processor that performs various processing on the image data acquired from the image sensor. The camera (240) can provide the acquired image data to the processor (210) in real time through an interface (e.g., a mobile industry processor interface). The camera (240) can include at least some of the configurations and / or functions of the camera module (180) of FIG. 1.

[0052] According to one embodiment, the memory (220) may temporarily or permanently store various data, including volatile memory and non-volatile memory. The memory (220) may include at least some of the configuration and / or functions of the memory (130) of FIG. 1, and may store the program (140) of FIG. 1.

[0053] According to one embodiment, the memory (220) may store various instructions that may be performed by the processor (210). Such instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that may be recognized by the processor (210).

[0054] According to one embodiment, the processor (210) may be configured as one or more processors capable of performing calculations or data processing related to control and / or communication of each component of the electronic device (200). The processor (210) may include at least some of the configurations and / or functions of the processor (120) of FIG. 1.

[0055] According to one embodiment, there is no limitation to the computational and data processing functions that the processor (210) can implement on the electronic device (200), but this document will describe various embodiments for extracting objects with a large correction effect and providing them to the user when generating a corrected image from an original image using the automatic correction function of the gallery application. The operations of the processor (210) described below can be performed by loading instructions stored in the memory (220).

[0056] In this document, the description that the processor (210) (or the electronic device (200)) can perform a certain operation (or function, work, task) may be interpreted to mean substantially the same as that an instruction (or command, computer program) that causes the electronic device (200) (or the processor (210)) to perform the corresponding operation is stored in the memory (220) (e.g., non-volatile memory, storage). In addition, the description that the processor (210) can perform a certain operation may be interpreted to mean substantially the same as that at least one processor, without a specific definition, can perform the corresponding operation.

[0057] According to one embodiment, the processor (210) can store and execute a gallery application. For example, the gallery application can display images stored in the memory (220) and support various functions such as copying / deleting / moving images, sharing with other devices, and editing images. The images provided by the gallery application can include images acquired by the camera application using the camera (240) and / or images downloaded via a network. Although the gallery application is described as an example in this document, the present invention is not limited thereto, and various embodiments of this document can be applied to various applications that provide functions for editing and displaying image data.

[0058] According to one embodiment, the processor (210) may provide an automatic correction function for a specific image selected by the user. Here, the automatic correction function (or remaster function) may be a function that analyzes the pixel data of the image and automatically improves the image using various image improvement engines. For example, the automatic correction function (or remaster function) may be provided in a gallery application, and when the automatic correction function is executed for a feature image in the gallery application, an unclear image due to shaking, blurring, etc., an image with low resolution, etc., may be corrected by analyzing the resolution, brightness, color, sharpness, as well as backlighting, shaking, etc. using artificial intelligence. Hereinafter, the image prior to correction that is the target of the automatic correction function may be referred to as the original image, and the image improved by reflecting the automatic correction function may be referred to as the compensated image. In addition, the automatic correction function may also be referred to as a remaster function, an image correction function, or an image editing function. The automatic correction function may be applied to still images and moving images.

[0059] According to one embodiment, the processor (210) may select an original image among images stored in the memory (220) based on a first user input (e.g., selection of an image thumbnail) detected on the display (230) while the gallery application is running, and may execute an automatic correction function for the selected original image based on a second user input (e.g., selection of an automatic correction function on a function menu). Executing the automatic correction function may improve a blurry, shaky, and / or low-resolution photo, thereby correcting the photo to be clear, sharp, and / or high-resolution.

[0060] In one embodiment, the automatic compensation function may be performed by at least some of the plurality of compensation engines. For example, the compensation function performed by the plurality of compensation engines may include, but is not limited to, at least one of improve color, improve clarity, remove shadow, upscaling, compensate low light image, high dynamic range (HDR), de-blurring, de-moire, auto-tone, or ultra-wide distortion correction for at least a portion of the original image. Each compensation engine may perform at least one of the compensation functions exemplified (or not exemplified). For example, compensation engine 1 may perform only de-blurring, and compensation engine 2 may perform both de-blurring and upscaling. According to one embodiment, the correction engine may be a software module stored in memory (220) and executed on the processor (210).

[0061] According to one embodiment, the processor (210) may analyze the original image, determine the necessary correction function for the original image, and select at least one correction engine.

[0062] According to another embodiment, the processor (210) can perform an automatic correction function by sequentially applying a filter determined on a single process without using a separate correction engine.

[0063] According to one embodiment, the original image may include multiple objects, and the automatic correction function may be applied to some of the multiple objects or to the entire image. For example, if the original image captured by the user includes a person, an animal, an object, and a background object, the improve face clarity function may be applied only to the face area of ​​the person object. According to one embodiment, when the automatic correction function is executed, the processor (210) may extract objects included in the image, analyze the characteristics of pixel data of each object, and determine at least one correction engine to be applied to each object or to the entire image.

[0064] According to one embodiment, when automatic image correction is completed and a compensated image is generated, the processor (210) may display the compensated image in at least a portion of a designated area (e.g., a first area) on the gallery application screen.

[0065] According to one embodiment, the processor (210) may display at least a portion of the original image and at least a portion of the corrected image together. For example, the processor (210) may display a first part of the original image on a first sub-area of ​​a first area of ​​a gallery application screen, and may display a second part of the corrected image on a second sub-area of ​​the first area. Here, the first part of the original image may be a left portion, the second part may be a right portion excluding the first part, and the first and second parts of the corrected image may be image parts at positions corresponding to the first and second parts of the original image, respectively. In this way, by displaying the first part of the original image and the second part of the corrected image together, the user may recognize the uncorrected portion and the corrected portion of the image together.

[0066] According to one embodiment, the processor (210) may display a boundary indicator that separates a first sub-region that displays at least a portion (e.g., a first part) of an original image and a second sub-region that displays at least a portion (e.g., a second part) of a corrected image. The position of the boundary indicator may be moved according to a user input (e.g., a touch and drag) to the boundary indicator, and accordingly, the sizes of the first and second sub-regions may be changed. For example, when a user touches the boundary indicator and then drags it to the left, the size of the first sub-region may decrease, thereby reducing the area where the original image is displayed, and the size of the second sub-region may increase, thereby increasing the area where the corrected image is displayed. An example of displaying the original image and the corrected image on the first and second sub-regions, which are separated by the boundary indicator, will be described in more detail with reference to FIG. 5.

[0067] According to one embodiment, the processor (210) may identify (or select) at least one object in the corrected image that has a large correction effect compared to the original image. When the automatic correction function is executed, the correction effect may be applied to at least some objects included in the original image, and the level of the correction effect applied to each object may also be different. For example, when facial sharpness improvement by a sharpness improvement engine is applied to the original image, the correction effect may be applied to a human face object among the objects included in the original image to a large extent, and the correction effect may be applied to other objects other than faces (e.g., other parts of the human body, animals, or objects).

[0068] According to one embodiment, the processor (210) may determine whether an object is significantly affected by the automatic correction function based on changes in pixel data of an area including an object in the original image and the corrected image. The processor (210) may extract a plurality of objects from the original image or the corrected image, and segment an area including each of the plurality of objects. The processor (210) may analyze pixel data of pixels included in each segmented object area.

[0069] According to one embodiment, the processor (210) may determine whether an object has a large automatic correction effect based on the average of the amount of change in pixel data of each pixel of an area including an object in the original image and the corrected image. For example, the processor (210) may calculate the difference between pixel data of a specific pixel of the original image and the same pixel in the corrected image in the area of ​​a specific object extracted, calculate the absolute value (or square) of the calculated difference, and obtain the average of the absolute values ​​(or squares) of the differences in pixel data calculated at each pixel. If the average of the absolute values ​​(or squares) of the differences in pixel data calculated in the area of ​​a specific object is greater than or equal to a reference value, the processor (210) may determine that the automatic correction function has a large correction effect for the object.

[0070] According to another embodiment, the processor (210) may determine whether an object has a large correction effect based on the ratio of pixels whose pixel data has changed among the pixels in an area including the object. For example, the processor (210) may compare pixel data of an original image and pixel data of a corrected image in an area of ​​a specific object extracted, and if the ratio of the number of pixels whose pixel data has changed to the total number of pixels in the area of ​​the object is greater than or equal to a reference value, the processor may determine that the correction effect of the automatic correction function for the object is large.

[0071] According to one embodiment, the processor (210) may generate at least one thumbnail corresponding to at least one object having a large correction effect. The thumbnail may be a reduced image of an area including the object. According to one embodiment, the processor (210) may generate a thumbnail of an area including multiple objects. For example, if the identified objects are of the same type (e.g., a human face) and the distance between each object is within a specified distance, the area including the objects may be generated as a single thumbnail.

[0072] According to one embodiment, the processor (210) may display at least one generated thumbnail together with at least a portion of the original image and / or at least a portion of the corrected image on the gallery application screen. According to one embodiment, the processor (210) may display at least a portion of the original image and at least a portion of the corrected image on a first area of ​​the display (230), and may display at least one thumbnail on a second area of ​​the display (230). Here, the second area may be an area below the first area on the gallery application screen. According to one embodiment, the processor (210) may generate a thumbnail of the original image or the corrected image and display it on the second area together with a thumbnail of an area including the object. In this document, the first area where the entire image or the image of the object is displayed may be referred to as a remaster area, and the second area where thumbnails are displayed may be referred to as a focus view area.

[0073] According to one embodiment, when a user input for any one of the thumbnails is received, the processor (210) may focus on an area including the thumbnail and display the focus on the gallery application screen. For example, when a user input for the first thumbnail is received while the processor (210) displays a first part of the original image and a second part of the corrected image based on the entire image area in a first area of ​​the gallery application screen, the processor (210) may enlarge an area of ​​an object included in the first thumbnail and display the enlarged area on the first area. In this case, the processor (210) may display a first enlarged image, which is an area including at least a part of the object included in the first thumbnail in the original image, in a first sub-area of ​​the first area of ​​the gallery application screen, and may display a second enlarged image, which is an area including at least another part of the object included in the first thumbnail in the corrected image, in a second sub-area of ​​the first area of ​​the gallery application screen.

[0074] According to one embodiment, when a second thumbnail is selected from among the thumbnails displayed in the second area while the area corresponding to the first thumbnail is displayed, the processor (210) may change the portion displayed in the first area into a portion of the original image including the object of the second thumbnail and a portion of the corrected image. In this case, the processor (210) may highlight the thumbnail selected by the user on the second area or the thumbnail corresponding to the object displayed on the first area.

[0075] In this way, by displaying the area of ​​the selected object in the original image and the corrected image together according to the selection of the thumbnail, the user can recognize how much of the correction effect has been applied to a specific part of the image.

[0076] According to one embodiment, the processor (210) may display on the display (230) an item indicating at least one correction engine applied to the corrected image. For example, the processor (210) may display the item on a third region, which is an area above a first region where the original image and / or the corrected image are displayed, on the gallery application screen. In this document, the third region where the item indicating the correction engine is displayed may also be referred to as a remastering engine region.

[0077] According to one embodiment, when the original image and the corrected image of the entire area are displayed in the first area, the processor (210) may display an item indicating all correction engines applied to the corrected image in the third area. Furthermore, when the area of ​​a specific object of the original image and the corrected image is displayed in the first area, the processor (210) may display an item indicating a correction engine applied to the displayed object among the correction engines applied to the corrected image in the third area.

[0078] According to one embodiment, the processor (210) can remove a correction effect by the correction engine for an item based on user input for the item that directs the correction engine.

[0079] According to one embodiment, when a user input is received for a specific item while at least a portion of an original image of the entire area and at least a portion of a corrected image are displayed on a first area, the processor (210) can remove a correction effect of a correction engine indicated by the item from the entire area of ​​the corrected image.

[0080] According to one embodiment, when a user input is received for a specific item while an object included in a first thumbnail is displayed in a first area, the processor (210) can remove the correction effect of the correction engine indicated by the item from the corrected image only for the object area of ​​the first thumbnail. According to another embodiment, when a user input is received for an item indicating a correction engine, the processor (210) provides an additional menu that allows the user to select an area (e.g., the entire area, the object area of ​​the thumbnail) from which to remove the correction effect of the correction engine of the item, and can remove the correction effect for the area selected by the user through the additional menu. This embodiment will be described in more detail with reference to FIGS. 6 and 7.

[0081] According to one embodiment, the processor (210) receives a user input designating a specific region of an image while displaying at least a portion of an original image and at least a portion of a corrected image, and removes a correction effect of a correction engine applied to the region designated by the user. This embodiment will be described in more detail with reference to FIG. 10.

[0082] According to one embodiment, when multiple areas of objects with large correction effects are extracted from a corrected image, the processor (210) may determine the arrangement order of multiple thumbnails indicating each object. According to one embodiment, the processor (210) may determine the arrangement order of each thumbnail on the second area based on the order of correction effects for the objects included in the thumbnails. According to one embodiment, the processor (210) may determine the arrangement order of each thumbnail based on the type (e.g., person, animal, object, background) and / or size of the object included in the thumbnail. An embodiment of determining the arrangement order of thumbnails on the second area will be described in more detail with reference to FIGS. 11 to 13.

[0083] Instructions for performing the operations of the electronic device (200) (or processor (210)) described above may be stored in a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs including the instructions.

[0084] FIG. 3 illustrates the architecture of an image auto-correction function according to one embodiment.

[0085] Each of the modules illustrated may be provided by a gallery application running on an electronic device (e.g., the electronic device (200) of FIG. 2) and may be a software module executed on a processor (e.g., the processor (210) of FIG. 2).

[0086] In one embodiment, an electronic device may execute an automatic correction function on an original image to generate a corrected image. The automatic correction function may analyze the pixel data of the image and automatically improve the image using various image enhancement engines, and may be referred to as a remaster function. The automatic correction function may be provided within a gallery application.

[0087] In one embodiment, the electronic device may trigger execution of an auto-correction function for a specific image. For example, the electronic device may select an original image from among images stored in memory based on a first user input detected on the display (e.g., selection of an image thumbnail) while the gallery application is running, and may execute the auto-correction function for the selected original image based on a second user input (e.g., selection of the auto-correction function from a function menu).

[0088] According to one embodiment, the estimator and enhancer selection module (310) can analyze an original image to be subjected to automatic correction and select at least one correction engine to be used in image correction. For example, the correction function performed by the plurality of correction engines can include, but is not limited to, at least one of improve color, improve clarity, remove shadow, upscaling, compensate low light image, high dynamic range (HDR), de-blurring, de-moire, auto-tone, or ultra-wide (UW) distortion correction for at least a portion of the original image.

[0089] According to one embodiment, the correction function performed by each correction engine may include at least one filter effect. For example, in the case of a color enhancement engine, at least one filter effect among light balance, brightness, exposure, contrast, and highlight may be applied to at least a portion of an image.

[0090] According to one embodiment, the evaluation module (320) can compare pixel data of images before and after application of the correction engine, and calculate the amount of change. For example, the evaluation module (320) can check pixel data in the original image and pixel data in the corrected image for all pixels or some samples included in an area of ​​a specific object, and calculate the difference and the absolute value (or square) of the difference. The evaluation module (320) can obtain the average of the absolute value (or square) of the difference of the pixel data calculated for each pixel. Alternatively, the evaluation module (320) can determine the ratio of pixels whose pixel data has changed in each object area before and after application of the correction engine.

[0091] According to one embodiment, the focus view module (330) may determine at least one object to be provided via a thumbnail in the focus view area of ​​the gallery application screen. For example, the focus view module (330) may compare the average of the absolute values ​​(or squares) of the differences in pixel data calculated by the evaluation module (320) with a reference value, and if it is greater than or equal to the reference value, the focus view module (330) may determine that the effect of applying the correction engine is large for the corresponding object. Alternatively, the focus view module (330) may determine that the effect of applying the correction engine is large for the corresponding object if the ratio of changed pixels in the pixel data calculated by the evaluation module (320) is greater than or equal to the reference value. The focus view module (330) may generate at least one thumbnail corresponding to at least one object determined to have a large effect of applying the correction engine.

[0092] According to one embodiment, the focus view module (330) may display at least one generated thumbnail in a focus view area of ​​a gallery application screen. For example, in the gallery application screen, a thumbnail of at least one generated object may be displayed on a focus view area (or second area) formed below a remaster area (or first area) in which at least a portion of an original image and at least a portion of a corrected image are displayed.

[0093] FIG. 4 illustrates screens sequentially displayed during automatic image correction in a gallery application according to one embodiment.

[0094] According to one embodiment, an electronic device (200) (e.g., the electronic device (200) of FIG. 2) may execute a gallery application and display a gallery application screen on a display (210). Hereinafter, the gallery application screen will be described as an example, but the present invention is not limited thereto, and various embodiments of the present document may be applied to other applications capable of editing and displaying image data.

[0095] Referring to (a) of FIG. 4, an image selected from among images stored in memory may be displayed. In addition, the application screen may include a list of scrollable thumbnails (470), a top item list (480) including a screen sharing (e.g., Smart view) item, an AI service (e.g., Bixby vision) item, and an image rotation item, and a bottom item list (490) including a favorite item, an image editing item, an image sharing item, a delete item, and a more options item (495).

[0096] According to one embodiment, the electronic device (200) may select an original image among images stored in the memory according to a first user input detected on the display (210) while the gallery application is running, and may execute an automatic correction function (or a remaster function) for the original image selected according to a second user input. For example, when a thumbnail is selected from the scrollable thumbnail list (470) of FIG. 4 (a), the electronic device (200) may display the image of the thumbnail. When the Show More Options item (495) of the bottom item list (490) is selected while a specific image is displayed, the electronic device (200) may provide an item that allows selection of the automatic correction function (or the remaster function) as one of the additional options, and execute the automatic correction function when the item is selected. The arrangement of the images, the thumbnail list, and each item is not limited to that illustrated in FIG. 4 (a), and may be implemented in various forms. In addition, the user interface for executing the automatic correction function is not limited to that described, and the automatic correction function item may be provided on the upper item list (480) or the lower item list (490), or the automatic correction function may be executed according to a predetermined touch input or voice input.

[0097] According to one embodiment, when the execution of the automatic correction function is triggered, the electronic device (200) may analyze the original image, determine the necessary correction function for the original image, and select at least one correction engine. Referring to (b) of FIG. 4, the electronic device (200) may provide a user interface indicating that automatic correction is in progress while performing the analysis operation, i.e., before the generation of the corrected image is completed.

[0098] According to one embodiment, when automatic image correction is completed and a corrected image is generated, the electronic device (200) may display at least a part of the corrected image on at least a part of a first area (or remaster area) (410) designated on the gallery application screen. According to one embodiment, the electronic device (200) may display a first part of the original image on a first sub-area (412) of the first area (410) of the gallery application screen, and may display a second part of the corrected image on a second sub-area (414) of the first area (410). Here, the first part of the original image may be a left part, the second part may be a right part excluding the first part, and the first part and the second part of the corrected image may be image parts at positions corresponding to the first part and the second part of the original image, respectively.

[0099] Referring to (c) of FIG. 4, the left part (or first part) of the original image and the right part (or second part) of the corrected image may be displayed on the first area (410) of the gallery application screen. In addition, the electronic device (200) may display a boundary indicator (420) that divides the first sub-area (412) that displays at least a part (e.g., the first part) of the original image and the second sub-area (414) that displays at least a part (e.g., the second part) of the corrected image. The sizes of the first sub-area (412) and the second sub-area (414) may be changed based on a user input to the boundary indicator (420).

[0100] According to one embodiment, items indicating whether the first sub-area (412) and the second sub-area (414) are before or after correction, such as before and after, may be displayed, and these items may include other phrases (e.g., before correction, after correction), may be displayed in the form of visual icons, or may not be displayed at all.

[0101] According to one embodiment, the electronic device (200) can identify at least one object in the corrected image that has a large correction effect compared to the original image. According to one embodiment, the electronic device (200) can determine whether the object has a large automatic correction effect based on the average of the amount of change in pixel data of each pixel in an area including the object in the original image and the corrected image. For example, the electronic device (200) can calculate the difference in pixel data of a specific pixel in the original image and the same pixel in the corrected image in an area of ​​a specific object extracted, calculate the absolute value (or square) of the calculated difference, and obtain the average of the absolute values ​​(or squares) of the differences in pixel data calculated at each pixel. If the average of the absolute values ​​(or squares) of the differences in pixel data calculated in the area of ​​a specific object is greater than or equal to a reference value, the electronic device (200) can determine that the correction effect of the automatic correction function for the corresponding object is large. According to another embodiment, the electronic device (200) can identify at least one object having a large correction effect based on at least one of the ratio of pixels in an area including the object whose pixel data has changed, the number of filters applied to each object, or the size of a filter parameter used in the filter.

[0102] According to one embodiment, the electronic device (200) may generate at least one thumbnail each corresponding to at least one object selected as having a large correction effect. The electronic device (200) may display the generated at least one thumbnail (431, 432) in a second area (or focus view area) (430) of a gallery application. According to one embodiment, the electronic device (200) may determine the arrangement order of the thumbnails on the second area (430) based on at least one of the order of the correction effect for the object included in each thumbnail, the type, or the size of the object.

[0103] Referring to (c) of FIG. 4, a thumbnail (431) of the entire image, a thumbnail (432) of the first object, and a thumbnail (434) of the second object may be displayed in a second area (430) below a first area (410) where an original image and a corrected image are displayed. The electronic device (200) may highlight a thumbnail (431) of the entire image corresponding to the image currently displayed in the first area (410) from the list of thumbnails in the second area (430).

[0104] According to one embodiment, each thumbnail displayed in the second area (430) can be selected by user input, and can be configured to be scrollable left and right when there are a large number of thumbnails.

[0105] According to one embodiment, the electronic device (200) may display an object area of ​​a thumbnail selected from the original image and the corrected image on the first area (410) based on the selection of any one of the thumbnails displayed in the second area (430). That is, when a thumbnail (432) of a first object is selected while the entire image is displayed as in (c) of FIG. 4, the image provided in the first area (410) may be changed to an enlarged image (460) that enlarges the area (440) including the first object of FIG. 4 (c) as in (d) of FIG.

[0106] According to one embodiment, the electronic device (200) may display a first enlarged image (462) that enlarges a left portion of a first object in an original image in a first sub-area (412), and display a second enlarged image (464) that enlarges a right portion of the first object in a corrected image in a second sub-area (414). That is, the before / after correction of a focused object may be enlarged and displayed together in the first area (410).

[0107] According to one embodiment, in the process of displaying a first enlarged image (462) and a second enlarged image (464) that are enlarged images of an area (440) including a first object based on selection of a thumbnail (432) of the first object, a correction effect different from the correction effect previously applied to the entire image displayed in the first area (410) may be applied. For example, only a portion of the correction filters applied to the entire image may be applied to the area (440) including the first object.

[0108] According to one embodiment, when a thumbnail of a second object is selected based on a user input while a first enlarged image (462) and a second enlarged image (464) are displayed on a first area (410) of a gallery application, the electronic device (200) can change the image displayed on the first area (410) to an image that enlarges a portion of an original image including the second object and an image that enlarges a portion of a corrected image.

[0109] In this way, the electronic device (200) can display the original image and the corrected image together in each object area, and the user can recognize how much of the correction effect has been applied to each part of the image by selecting a thumbnail.

[0110] FIG. 5 illustrates an example of a screen showing an original image and a corrected image according to one embodiment.

[0111] According to one embodiment, the electronic device (200) (e.g., the electronic device (200) of FIG. 2) may display at least a portion of the original image and at least a portion of the corrected image on a first area (or remaster area) (510) of the application screen when the automatic correction function (or remaster function) is executed.

[0112] According to one embodiment, the electronic device (200) can display a first part of an original image in a first sub-area (512) and a second part of a corrected image in a second sub-area (514), and the first sub-area (512) and the second sub-area (514) can be distinguished through boundary indicators (521, 522, 523, 524).

[0113] Referring to (a) of FIG. 5, when a thumbnail (531) of the entire image is selected among the thumbnails of the second area (530), the electronic device (200) can display a left part of the original image in the first sub-area (512) and a right part of the corrected image in the second sub-area (514). The first sub-area (512) and the second sub-area (514) can be distinguished through a boundary indicator (521).

[0114] According to one embodiment, the first sub-region (512) and the second sub-region (514) may change in size based on user input. Referring to (b) of FIG. 5, when the user touches the boundary indicator (522) and moves it to the left, the size (or area) of the first sub-region (512) may be reduced, and the size of the second sub-region (514) may be enlarged. Accordingly, the area where the original image is displayed may be reduced, and the area where the corrected image is displayed may be enlarged. The user may check which correction function has been applied to the image by moving the boundary indicator (522) to the left / right.

[0115] According to one embodiment, when a user input is received for any one of the thumbnails displayed in the second area (530), the electronic device (200) can enlarge and display the area including the thumbnail on the first area (510) of the gallery application screen.

[0116] Referring to (c) of FIG. 5, when a thumbnail (532) of a first object is selected from among the thumbnails of a second area (530), the electronic device (200) can display a left portion of the area of ​​the first object in the original image and a right portion of the area of ​​the first object in the corrected image in the first sub-area (512) and the second sub-area (514), respectively. Even when the image of the object is displayed in an enlarged manner, the first sub-area (512) and the second sub-area (514) can be distinguished through a boundary indicator (523).

[0117] Referring to (d) of FIG. 5, when a user touches the boundary indicator (524) and moves it to the left, the size (or area) of the first sub-region (512) may be reduced, and the size of the second sub-region (514) may be enlarged. Accordingly, an image in the area of ​​the object to which the correction effect has not been applied may be reduced, and an image to which the correction effect has been applied may be enlarged. The user may check which correction function has been applied to the object by moving the boundary indicator (524) to the left / right.

[0118] FIG. 6 illustrates an example of a screen showing an original image and a corrected image according to one embodiment.

[0119] According to one embodiment, the electronic device (200) may select at least one of a plurality of predetermined correction engines through analysis of the original image. For example, the correction function performed by the plurality of correction engines may include, but is not limited to, at least one of improve color, improve clarity, remove shadow, upscaling, compensate low light image, high dynamic range (HDR), de-blurring, de-moire, auto-tone, or ultra-wide (UW) distortion correction for at least a portion of the original image.

[0120] According to one embodiment, when an automatic correction function of an image is executed, the electronic device (200) (e.g., the electronic device (200) of FIG. 2) may display at least a portion of an original image and at least a portion of a corrected image in a first area (610) of an application screen, display a thumbnail of at least one object with a large correction effect in a second area (630), and display at least one item indicating a correction engine applied to the corrected image in a third area (650).

[0121] Referring to (a) of FIG. 6, when an automatic correction function is executed for a selected original image, color enhancement, face clarity enhancement, and HDR (high dynamic range) may be applied by at least one correction engine. When a thumbnail (631) of the entire image is selected from the thumbnails of the second area (630), the electronic device (200) may display the original image and the corrected image of the entire image on the first area (610). In addition, the electronic device (200) may display items (651, 652, 653) indicating the applied correction engine on the third area (650) (or remaster engine area) at the top of the first area (610). Each of the items (651, 652, 653) displayed on the third area (650) may be selectable by user input.

[0122] According to one embodiment, the electronic device (200) can remove a correction effect by the correction engine of a selected item based on a user input for the item that directs the correction engine.

[0123] In the application screen of Fig. 6 (a), when the user selects an item (651) indicating color enhancement among the items displayed in the third area (650), the color enhancement effect by the correction engine may be removed, as shown in Fig. 6 (b). In this case, the facial sharpness enhancement and HDR that were not selected by the user may be applied as is. Referring to Fig. 6 (b), there is no change in the original image displayed in the first sub-area, but the corrected image displayed in the second sub-area may have the color enhancement effect removed and only the facial sharpness enhancement and HDR applied. In this way, the user can directly remove at least some of the correction effects provided by the automatic correction function by using the item (651) indicating the correction engine displayed in the third area (650).

[0124] According to one embodiment, the electronic device (200) may display indicators indicating multiple filters applied by the correction engine in an area of ​​the display (e.g., a first area (610)). Referring to FIG. 6 (a), when an item (651) indicating a color enhancement engine is selected according to a user input, the electronic device (200) may display an indicator (656) indicating light balance, which is a filter applied by the color enhancement engine, an indicator (657) indicating brightness, and an indicator (658) indicating exposure in the first area (610). Each of the indicators (656, 657, 658) may be a toggle button selectable according to a user input, and when the user selects the indicator (656) indicating light balance, application of the light balance filter may be removed on the corrected image.

[0125] According to one embodiment, the electronic device (200) may determine whether to display indicators indicating multiple filters applied by the correction engine based on the user's settings. For example, if the user disables the display of the indicators in the gallery application's settings, the indicators (656, 657, 658) displayed on the first area (610) may not be displayed.

[0126] FIG. 7 illustrates an example of a screen showing an area of ​​a specific object in an original image and a corrected image according to one embodiment.

[0127] According to one embodiment, the electronic device (200) (e.g., the electronic device (200) of FIG. 2) may display the area of ​​the object of the selected thumbnail on the first area (or remaster area) (710) of the application screen when any one of the thumbnails of an object with a large correction effect displayed in the second area (730) is selected.

[0128] According to one embodiment, when performing an automatic correction function by a correction engine on an original image, at least some of the correction engines may be applied only to some of the objects included in the original image. For example, if the original image includes a person, an animal, an object, and a background object, the improve face clarity function may be applied only to the face area of ​​the person object. According to one embodiment, when the area of ​​a specific object of the original image and the corrected image is displayed in the first area (710) according to the selection of the thumbnail (732), the electronic device (200) may display an item (751, 752) indicating a correction engine applied to the displayed object among the correction engines applied to the corrected image in the third area (or remaster engine area) (750).

[0129] Referring to (a) of FIG. 7, when a thumbnail (732) of a first object is selected by a user input, the electronic device (200) can display an area of ​​the first object of the original image and an area of ​​the first object of the corrected image in a first area (710) of the gallery application screen. Among the correction engines applied to the entire image, such as improve color, improve face clarity, and HDR (high dynamic range), color enhancement and improve face clarity may be applied to the first object, and HDR may not be applied. In this case, the electronic device (200) can display items (751, 752) indicating the correction engine (e.g., color enhancement and improve face clarity) applied to the first object in a third area (750).

[0130] According to one embodiment, when a user input is received for an item indicating a correction engine displayed in a third area (750) while the first object included in the selected thumbnail (732) is displayed in the first area (710), the electronic device (200) can remove the correction effect of the correction engine indicated by the selected item from the area of ​​the first object in the corrected image. For example, when the user selects an item (751) indicating color enhancement in the screen of FIG. 7 (a), the color enhancement effect by the correction engine can be removed as shown in FIG. 7 (b). In this case, the facial sharpness enhancement that is not selected by the user can be applied as is to the first object. In addition, the color enhancement effect removed by the user can be applied as is to other objects in the corrected image, not the first object.

[0131] According to another embodiment, when a user input is received for an item indicating a correction engine, the electronic device (200) may provide an additional menu that allows the user to select an area (e.g., the entire area, an object area of ​​a thumbnail) from which to remove the correction effect of the correction engine of the corresponding item. For example, when the user selects an item (751) indicating color enhancement on the screen of FIG. 7 (a), the electronic device (200) may provide an additional menu (756, 757) in the form of a pop-up that allows the user to select whether to apply the removal of the color enhancement effect to the area of ​​the first object or the entire image, as shown in FIG. 7 (c). When the user selects the area of ​​the object (756) on the additional menu, the electronic device (200) may remove the color enhancement effect only from the area of ​​the first object, and when the user selects the entire image (757), the electronic device (200) may remove the color enhancement effect from the entire corrected image.

[0132] According to one embodiment, when a user input for an item indicating a correction engine is received, the electronic device (200) may provide a full image in the form of a preview with the correction effect of the correction engine of the corresponding item removed from the object area of ​​the thumbnail. For example, when an item indicating a specific correction engine is selected, the electronic device (200) may display an image with the correction effect of the corresponding item removed only from the object area of ​​the thumbnail in the form of a pop-up from the full image area. Accordingly, the user may check the image with the correction effect removed from the object area. Alternatively, the electronic device (200) may display the full image with the correction effect removed only from the specific object area on the first sub-area (712).

[0133] FIG. 8 illustrates screens sequentially displayed during automatic image correction in a gallery application according to one embodiment.

[0134] According to one embodiment, an electronic device (200) (e.g., the electronic device (200) of FIG. 2 ) may correct an original image using at least some of a plurality of predetermined engines. In this case, different correction engines may be applied depending on the type of each object included in the original image (e.g., person, animal, object, background).

[0135] Referring to (a) of FIG. 8, the electronic device (200) can apply an automatic correction function to the original image and display a left portion of the original image and a right portion of the corrected image on a first area (or remaster area) (810) of the gallery application screen. The electronic device (200) can identify a first object and a second object having a large correction effect in the entire area of ​​the image and display a thumbnail corresponding to the entire image, a thumbnail corresponding to the first object (832), and a thumbnail corresponding to the second object in the second area (830) (or focus view area).

[0136] Referring to (b) of FIG. 8, when a thumbnail (832) of a first object is selected from among the thumbnails displayed in the second area (830), the electronic device (200) can display a left portion of the original image of the first object and a right portion of the corrected image on the first area (810). The electronic device (200) can check the correction engines applied to the first object area, namely remove shadow and improve color, and display items (851, 852) indicating each correction engine on the third area (or correction engine area) (850).

[0137] Referring to (c) of FIG. 8, the electronic device (200) can remove the correction effect of the selected item when any one of the items indicating the correction engine displayed in the third area (850) is selected according to the user input. In (b) of FIG. 8, the shadow removal effect is applied to the corrected image, but in (c) of FIG. 8, when the user selects the item (851) indicating shadow removal in the third area (850), the shadow removal effect is removed so that the shadow can be expressed as it is in the corrected image as in the original image.

[0138] FIG. 9 illustrates screens sequentially displayed during automatic image correction in a gallery application according to one embodiment.

[0139] According to one embodiment, the electronic device (200) (e.g., the electronic device (200) of FIG. 2 ) may correct an original image using at least some of a plurality of predetermined engines. In this case, different correction engines may be applied depending on the characteristics of each object included in the original image. For example, if the image includes the faces of multiple people, the electronic device (200) may apply different correction engines depending on race or skin color.

[0140] Referring to (a) of Fig. 9, the image selected by the user may include three people with different skin colors (or races). The electronic device (200) may apply an automatic correction function to generate a corrected image, and display a left portion of the original image and a right portion of the corrected image in a first area (or remaster area) (910). The electronic device (200) may identify the faces of three people as objects with a large correction effect in the corrected image, and display thumbnails of each face in a second area (930) (or focus view area).

[0141] Referring to (b) of FIG. 9, when a thumbnail (932) of a first object is selected from among the thumbnails displayed in the second area (930), the electronic device (200) may display a left portion of the original image of the first object and a right portion of the corrected image on the first area (910). The electronic device (200) may display an item (951) indicating a de-blurring, which is a correction engine applied to the first object area, on the third area (950) (or remaster engine area). According to one embodiment, when at least one of the items (951) of the third area (950) is selected according to a user input, the electronic device (200) may remove the correction effect of the selected item on the corrected image.

[0142] Referring to (c) of FIG. 9, when a thumbnail (933) of a second object is selected from among the thumbnails displayed in the second area (930), the left part of the original image of the second object and the right part of the corrected image may be displayed on the first area (910). The electronic device (200) may display an item (956) indicating color enhancement and an item (957) indicating HDR, which are correction engines applied to the second object area, on the third area (950). Since the face of the person corresponding to the second object has a different skin color or race compared to the face of the person corresponding to the first object, a different correction engine may be applied from that of the first object. According to one embodiment, when at least one of the items (956, 957) of the third area (950) is selected according to a user input, the electronic device (200) may remove the correction effect of the selected item on the corrected image.

[0143] FIG. 10 illustrates an example of changing the effect of the correction engine by specifying a certain area while a specific object is displayed according to one embodiment.

[0144] According to one embodiment, an electronic device (200) (e.g., the electronic device (200) of FIG. 2) may receive a user input specifying a specific region of an image while at least a portion of an original image and at least a portion of a corrected image are displayed, and remove a correction effect of a correction engine applied to the region specified by the user.

[0145] Referring to (a) of FIG. 10, the electronic device (200) may focus on an area of ​​the first object included in the image based on a user input (1023) for a thumbnail (1032) of the first object among the thumbnails displayed in the second area (1030) and display the focus on the area of ​​the first object included in the image on the first area (1010) of the gallery application. In addition, an item indicating a correction engine applied to the first object may be displayed on the third area (1050). For example, correction effects of color enhancement and face sharpness enhancement may be applied to an area including the first object among the entire image, and the electronic device (200) may enlarge an area including the first object to which the correction effects have been applied and display the area on the first area (1010).

[0146] Referring to (b) of FIG. 10, the electronic device (200) can select an area (1020) from which a correction effect by a correction engine is to be removed on an image displayed in a first area (1010) based on a predetermined user input (1025). For example, when a specific location on the image is long-touched, an area including an object at the corresponding location is selected, or an area may be selected based on a touch or long-touch after a drawing gesture designating the area, or a specific area may be automatically designated based on a drawing gesture. The types of user input for selecting an area (1020) from which a correction effect is to be removed are not limited thereto.

[0147] According to one embodiment, when a user selects an area (1020) within an image based on a user input (1025), the electronic device (200) may provide an item (1040) indicating a function applicable to the area. For example, the item (1040) may include functions such as displaying, copying, sharing, or saving a sticker for the area. When a user selects a sticker item among the items (1040), the electronic device (200) may create and store the selected object as a sticker type that can be inserted into a message, and allow the user to add the sticker of the stored object when sending a message or uploading to SNS. When a user selects a copy item among the items (1040), the electronic device (200) may copy the selected area of ​​the image and allow the user to paste it onto a document or another image. When a user selects a share item from among the items (1040), the electronic device (200) may provide a menu list that allows the user to select an application (e.g., message, SNS) to share the image of the selected area with and / or a counterparty to share with. When a user selects a save item from among the items (1040), the electronic device (200) may save the image of the selected area as a separate image file.

[0148] According to one embodiment, the electronic device (200) may display a designated area (1020) separately from the remaining areas based on a user input. For example, the electronic device (200) may display a dotted line border (1021) on the designated area (1020). When a specific area (1020) is designated, the electronic device (200) may remove the correction effect of the correction engine applied to the designated area. In this case, items displayed in the third area (1050) may also be removed or their display may be changed to faint depending on the removal of the correction effect. According to one embodiment, the electronic device (200) may dim the thumbnail of the first object with the correction effect removed in the second area (1030).

[0149] According to another embodiment, the electronic device (200) may designate an area (1020) according to a user input, and then, based on a selection of an item displayed in a third area (1050), remove the correction effect of the selected item from the designated area (1020).

[0150] Referring to (c) of FIG. 10, the first area (1010) of the gallery application displays a left portion of the original image and a right portion of the corrected image, and the correction effect may not appear in an area (1020) designated by user input from which the correction effect is removed from the right portion of the corrected image. Since the correction effect may be applied as is to the remaining areas of the corrected image other than the area (1020) designated by user input, an item indicating the correction engine may be displayed without being removed in the third area (1050).

[0151] FIG. 11 illustrates a method for determining the order of thumbnails corresponding to objects in an image according to one embodiment.

[0152] According to one embodiment, the electronic device (200) can extract an area of ​​at least one object having a large correction effect on a corrected image, and generate and display at least one thumbnail corresponding to each object.

[0153] According to one embodiment, when a plurality of objects and thumbnails are generated, the electronic device (200) can determine the arrangement order of each thumbnail based on the amount of change in pixel data, the type and / or size of the object.

[0154] Referring to FIG. 11, the electronic device (200) can extract the first object and the second object, which are objects with a large correction effect, as a result of applying the automatic correction function to the original image. According to one embodiment, the electronic device (200) can calculate the degree of the correction effect based on the amount of change in pixel data of each pixel of the first object and the second object, and can preferentially display a thumbnail of the object with a large correction effect on the second area (1130) (or focus view area).

[0155] According to one embodiment, the electronic device (200) may determine the arrangement order of the thumbnail (1132) of the first object and the thumbnail (1133) of the second object based on the amount of change in pixel data of the original image and the corrected image for the first object and the second object. For example, the electronic device (200) may calculate the difference between the pixel data of the original image and the pixel data of the corrected image for each pixel of the first object, and may calculate the average of the absolute values ​​(or squares) of the differences calculated for each pixel. The electronic device (200) may compare the averages of the pixel data calculated for the first object and the second object, and display the thumbnail (1132) of the first object having a larger value before the thumbnail (1133) of the second object. Referring to FIG. 11, in the second area (1130), a thumbnail of the entire image, a thumbnail of the first object (1132), and a thumbnail of the second object (1133) are sequentially displayed.

[0156] According to another embodiment, the electronic device (200) may determine the arrangement order of the thumbnails based on the ratio of pixels whose pixel data has changed among the pixels in the area including the object. For example, the electronic device (200) may obtain the ratio of the number of pixels whose pixel data has changed from the original image to the total number of pixels in the area of ​​the first object of the corrected image, and may obtain the ratio of the number of pixels whose pixel data has changed from the original image to the total number of pixels in the area of ​​the second object. The electronic device (200) may determine that an object with a larger calculated ratio has a larger correction effect and may display it preferentially on the second area (1130).

[0157] FIG. 12 illustrates a method for determining the order of thumbnails corresponding to objects in an image according to one embodiment.

[0158] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may determine the arrangement order of each thumbnail based on the type of object included in the thumbnail. Here, the type of object may include a person, an animal, an object, and a background. The electronic device may extract multiple objects from an image and determine the type of each object using various algorithms. The electronic device may designate the entire area other than distinguishable objects such as people, animals, and objects as the background of the image, or may segment the background area according to the characteristics of pixel data and process it as at least one background object.

[0159] Referring to FIG. 12, the electronic device can extract five objects from an original image or a corrected image. The electronic device can determine the type of each object and the arrangement order of thumbnails for each object in the order of person - animal - object - background.

[0160] In one embodiment, the electronic device may determine that thumbnails of objects with a high degree of relevance (or intimacy) to the user are given higher priority for human and / or animal objects. For example, the electronic device may prioritize the arrangement order of human and / or animal objects that are frequently edited by the user of the electronic device, human or animal objects frequently edited by the user in the gallery application, or human and animal objects located in the vicinity of the user of the electronic device.

[0161] FIG. 13 illustrates a method for determining the order of thumbnails corresponding to objects in an image according to one embodiment.

[0162] According to one embodiment, an electronic device (e.g., electronic device (200) of FIG. 2) can determine the arrangement order of each thumbnail based on the size of the object contained in the thumbnail.

[0163] Referring to FIG. 13, an electronic device may extract three objects from an original image or a corrected image. The first object may include a face object of a person and may be relatively large in size. The second object may also include a face object of a person and may be smaller in size than the first object. The third object may include a shoe object classified as an object and may be relatively small in size. The electronic device may determine the priority when arranging thumbnails in the order of the first object, the second object, and the third object, which are the largest in size.

[0164] According to one embodiment, if an extracted object has a size less than a reference value, the electronic device may not generate a thumbnail for the object, even if the correction effect is determined to be significant. Here, the reference value for size may be, but is not limited to, the size of the thumbnail.

[0165] According to one embodiment, the electronic device may consider the amount of change in pixel data, the type of object, and the size of the object when determining the arrangement order of the thumbnails. For example, the electronic device may assign a score to each object based on the amount of change in pixel data, the type of object, and the size of the object, and may assign a higher priority to the thumbnail of the object with a higher score. In this case, the electronic device may calculate the score for each object by assigning different weights to the amount of change in pixel data, the type of object, and the size of the object, and for example, may assign higher weights in the order of the amount of change in pixel data, the type of object, and the size of the object.

[0166] Fig. 14 is a flowchart of an image correction method of an electronic device according to one embodiment.

[0167] The illustrated method can be performed by an electronic device (e.g., the electronic device (200) of FIG. 2) described through FIGS. 1 to 13, and the technical features described above will be omitted below.

[0168] According to one embodiment, in operation 1410, the electronic device may execute a gallery application. The gallery application may display images stored in memory and support various functions such as copying / deleting / moving images, sharing with other devices, and editing images.

[0169] According to one embodiment, in operation 1415, the electronic device may select an original image to be subjected to automatic correction based on a first user input on the display. For example, when a specific image thumbnail is selected while the gallery application is running, the electronic device may display the image of the thumbnail, and when the automatic correction function is executed, the currently displayed image may be selected as the original image.

[0170] According to one embodiment, in operation 1420, the electronic device may execute an automatic correction function based on a second user input on the display. For example, if the user selects an automatic correction function item provided by selecting the More Options item in the Gallery application, the electronic device may execute an automatic correction function for the original image.

[0171] According to one embodiment, in operation 1425, the electronic device may generate a corrected image by correcting the original image according to an auto-correction function (or a remastering function). According to one embodiment, the auto-correction function may be performed by at least some of a plurality of correction engines. For example, the correction functions performed by the plurality of correction engines may include, but are not limited to, at least one of improve color, improve clarity, remove shadow, upscaling, compensate low light image, high dynamic range (HDR), de-blurring, de-moire, auto-tone, or ultra-wide distortion correction for at least a portion of the original image. The electronic device may analyze the original image, determine a necessary correction function for the original image, and select at least one correction engine.

[0172] According to one embodiment, in operation 1430, the electronic device may select at least one object from the corrected image that has a large correction effect compared to the original image. The electronic device may determine whether the object has a large correction effect due to the automatic correction function based on changes in pixel data of an area including the object in the original image and the corrected image.

[0173] According to one embodiment, in operation 1435, the electronic device may determine a priority for determining the arrangement order of the selected objects. According to one embodiment, the electronic device may determine the arrangement order of each thumbnail based on the amount of change in pixel data in the original image and the corrected image of the object included in the thumbnail, the type of the object included in the thumbnail (e.g., person, animal, object, background), and / or the size.

[0174] According to one embodiment, in operation 1440, the electronic device may display at least a portion of the original image and at least a portion of the corrected image in a first area of ​​the gallery application screen. Additionally, the electronic device may display a thumbnail of at least one object in a second area of ​​the gallery application screen.

[0175] According to one embodiment, the electronic device may display a first part (e.g., a left part) of an original image on a first sub-area of ​​a first area of ​​a gallery application screen, and may display a second part (e.g., a right part) of a corrected image on a second sub-area of ​​the first area. The electronic device may display a boundary indicator that separates the first sub-area and the second sub-area, and the sizes of the first sub-area and the second sub-area may change according to a user input for the boundary indicator.

[0176] According to one embodiment, each thumbnail displayed in the second area may be a reduced image of an area containing the object, and in the second area, thumbnails of the entire image and thumbnails of the object area may be arranged in an arrangement order determined in operation 1435.

[0177] According to one embodiment, the electronic device may display an item indicating at least one correction engine applied to a corrected image on a third area of ​​the gallery application screen. Upon receiving a user input for an item indicating the correction engine, the electronic device may remove the correction effect of the correction engine of the selected item from the image currently displayed on the first area (e.g., the entire image, a specific object), based on the user input.

[0178] According to one embodiment, at operation 1445, the electronic device may select one of the thumbnails in the second area based on user input on the display.

[0179] According to one embodiment, in operation 1450, the electronic device may focus on an area of ​​an original image of the selected object and an area of ​​a corrected image and display the focus on a first area of ​​a gallery application screen. For example, when a thumbnail of the first object is selected, the electronic device may select a portion of the entire image that includes the first object, enlarge the portion, and display the portion on the first area of ​​the gallery application. The electronic device may display a first enlarged image that enlarges a left portion of the original image first object on a first sub-area of ​​the first area of ​​the gallery application screen, and display a second enlarged image that enlarges a right portion of the corrected image first object on a second sub-area.

[0180] In this way, by displaying the area of ​​the selected object in the original image and the corrected image together according to the selection of the thumbnail, the user can recognize how much of the correction effect has been applied to a specific part of the image.

[0181] Instructions for performing the above method may be recorded on a computer-readable recording medium. When executed by a processor of an electronic device, the instructions may cause the method to be performed.

[0182] An electronic device (200) according to various embodiments of the present document may include a display (230), a memory (220), and a processor (210) operatively connected to the display and the memory.

[0183] According to one embodiment, the processor (210) may select one original image among the images stored in the memory, execute a correction function for the original image to generate a corrected image, identify at least one object having a large correction effect from the original image according to the execution of the correction function among a plurality of objects included in the original image and the corrected image, generate at least one thumbnail including the identified at least one object, display at least a portion of the original image and at least a portion of the corrected image in a first area (410) of the display, and display the at least one thumbnail in a second area (430) of the display.

[0184] According to one embodiment, when a user input for a first thumbnail (432) among the thumbnails displayed in the second area is received, the processor (210) may be set to display, in the first area, a first enlarged image (462) that is an enlarged area including at least a part of an object included in the first thumbnail in the original image, and a second enlarged image (464) that is an enlarged area including at least a part of an object included in the first thumbnail in the corrected image.

[0185] According to one embodiment, the processor (210) may be set to select at least one object having a large correction effect among the plurality of objects based on an average of the amount of change in pixel data of each pixel of an area including an object in the original image and the corrected image, or a ratio of pixels in which pixel data has changed among pixels of an area including an object.

[0186] According to one embodiment, the processor (210) may be configured to, when the correction function is executed, analyze the original image, select at least one of a plurality of predetermined correction engines, and correct at least a portion of the original image using the selected at least one correction engine to generate the corrected image.

[0187] According to one embodiment, the processor (210) may be configured to display, in a third area (650) of the display, at least one item (651, 652, 653) indicating at least one correction engine applied to the corrected image displayed in the first area.

[0188] According to one embodiment, the processor (210) may be configured to remove a correction effect by a correction engine indicated by a selected item for the entire corrected image based on a user input for the item (651, 652, 653) displayed in the third area.

[0189] According to one embodiment, the processor (210) may be configured to display, in a third area of ​​the display, at least one item (751, 752) indicating at least one correction engine applied to an object included in the first thumbnail when the first enlarged image and the second enlarged image are displayed in the first area.

[0190] According to one embodiment, the processor (210) may be configured to remove a correction function by a correction engine indicated by a selected item for an object included in the first thumbnail, based on a user input for an item displayed in the third area.

[0191] According to one embodiment, the correction function performed by the plurality of correction engines may include at least one of color enhancement, sharpness enhancement, shadow removal, upscaling, low-light image compensation, high dynamic range (HDR), de-bluring, de-moire, auto-tone, or ultra-wide (UW) distortion correction for at least a portion of the original image.

[0192] According to one embodiment, the processor (210) may be configured to determine an arrangement order of the at least one thumbnail on the second area based on an order of a correction effect for an object included in the at least one thumbnail.

[0193] According to one embodiment, the processor (210) may be configured to determine the arrangement order of the at least one thumbnail on the second area further based on the type or size of the object included in the at least one thumbnail.

[0194] According to one embodiment, the processor (210) may be configured to select the original image from among images stored in the memory according to a first user input on the display while the gallery application is running, and to execute a correction function for the original image according to a second user input on the display.

[0195] According to one embodiment, the first region is divided into a first sub-region in which at least a portion of the original image is displayed and a second sub-region in which at least a portion of the corrected image is displayed through a boundary indicator (420), and the processor (210) may be set to change the sizes of the first sub-region and the second sub-region based on a user input for the boundary indicator.

[0196] In accordance with various embodiments of the present document, a method for correcting an image of an electronic device may include: selecting an original image from among images stored in a memory of the electronic device; executing a correction function for the original image to generate a corrected image; identifying at least one object having a large correction effect from the original image according to execution of the correction function among a plurality of objects included in the original image and the corrected image; generating at least one thumbnail including the identified at least one object; displaying at least a portion of the original image and at least a portion of the corrected image in a first area of ​​a display of the electronic device, and displaying the at least one thumbnail in a second area of ​​the display; and, when a user input for a first thumbnail among the thumbnails displayed in the second area is received, displaying a first enlarged image in the first area, which is an enlarged area including at least a portion of an object included in the first thumbnail in the original image, and a second enlarged image in the first area, which is an enlarged area including at least a portion of an object included in the first thumbnail in the corrected image.

[0197] According to one embodiment, the operation of selecting at least one object having a large correction effect may include an operation of selecting at least one object having a large correction effect among the plurality of objects based on an average of the amount of change in pixel data of each pixel of an area including the object in the original image and the corrected image, or a ratio of pixels having changed pixel data among pixels of an area including the object.

[0198] According to one embodiment, the operation of generating the corrected image may include, when the correction function is executed, analyzing the original image to select at least one of a plurality of predetermined correction engines, and correcting at least a portion of the original image using the selected at least one correction engine to generate the corrected image.

[0199] According to one embodiment, the method may further include displaying, in a third area of ​​the display, at least one item indicating at least one correction engine applied to the corrected image displayed in the first area, and removing a correction effect by the correction engine indicated by the selected item for the entire corrected image based on a user input for the item displayed in the third area.

[0200] According to one embodiment, when the first enlarged image and the second enlarged image are displayed in the first area, the method may further include: displaying at least one item indicating at least one correction engine applied to an object included in the first thumbnail in a third area of ​​the display; and removing a correction function by a correction engine indicated by a selected item for an object included in the first thumbnail based on a user input for the item displayed in the third area.

[0201] According to one embodiment, the correction function performed by the plurality of correction engines may include at least one of color enhancement, sharpness enhancement, shadow removal, upscaling, low-light image compensation, high dynamic range (HDR), de-bluring, de-moire, auto-tone, or ultra-wide (UW) distortion correction for at least a portion of the original image.

[0202] According to one embodiment, the method may further include an operation of determining an arrangement order of the at least one thumbnail on the second area based on at least one of an order of a correction effect for an object included in the at least one thumbnail, and a type or size of an object included in the at least one thumbnail.

[0203] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0204] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0205] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0206] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0207] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0208] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (200), Display (230); memory (220); and At least one processor (210) operatively connected to the display and the memory, The above memory (220) can be executed by at least one processor, and when executed, the electronic device (200), Select one of the original images stored in the above memory, By executing the correction function on the above original image, a corrected image is created, Among the plurality of objects included in the original image and the corrected image, at least one object having a large correction effect is identified from the original image according to the execution of the correction function, Generating at least one thumbnail containing at least one object identified above, Displaying at least a part of the original image and at least a part of the corrected image in a first area (410) of the display, and displaying at least one thumbnail in a second area (430) of the display, and An electronic device storing instructions for displaying, in the first area, a first enlarged image (462) that is an enlarged area including at least a part of an object included in the first thumbnail in the original image and a second enlarged image (464) that is an enlarged area including at least a part of an object included in the first thumbnail in the corrected image when a user input is received for a first thumbnail (432) among the thumbnails displayed in the second area.

2. In paragraph 1, The above memory (220) is the electronic device (200), An electronic device set to select at least one object having a large correction effect among the plurality of objects based on an average of the amount of change in pixel data of each pixel of an area including an object in the original image and the corrected image, or a ratio of pixels in which pixel data has changed among pixels of an area including an object.

3. In paragraph 1 or 2, The above memory (220) is the electronic device (200), When the above correction function is executed, the original image is analyzed to select at least one of a plurality of predetermined correction engines, An electronic device storing instructions for correcting at least a portion of the original image using at least one selected correction engine to generate the corrected image.

4. In paragraph 3, The above memory (220) is the electronic device (200), An electronic device storing instructions for causing at least one item (651, 652, 653) to be displayed in a third area (650) of the display, the at least one item instructing at least one correction engine to be applied to the corrected image displayed in the first area.

5. In paragraph 4, The above memory (220) is the electronic device (200), An electronic device storing instructions for removing a correction effect by a correction engine indicated by a selected item for the entire corrected image based on a user input for an item (651, 652, 653) displayed in the third area.

6. In any one of paragraphs 3 to 5, The above memory (220) is the electronic device (200), An electronic device storing instructions for causing at least one item (751, 752) to be displayed in a third area of ​​the display, the instructions indicating at least one correction engine applied to an object included in the first thumbnail, when the first enlarged image and the second enlarged image are displayed in the first area.

7. In paragraph 5, The above memory (220) is the electronic device (200), An electronic device storing instructions for removing a correction function by a correction engine indicated by a selected item for an object included in the first thumbnail, based on a user input for an item displayed in the third area.

8. In any one of paragraphs 1 to 7, The correction function performed by the above multiple correction engines is: An electronic device comprising at least one of color enhancement, sharpness enhancement, shadow removal, upscaling, low light compensation, high dynamic range (HDR), de-bluring, de-moire, auto-tone, or ultra-wide (UW) distortion correction for at least a portion of said original image.

9. In any one of paragraphs 1 to 8, The above memory (220) is the electronic device (200), While the gallery application is running, the original image is selected from among the images stored in the memory according to the first user input on the display, An electronic device storing instructions for executing a correction function for the original image according to a second user input on the display.

10. In any one of paragraphs 1 to 9, The first region is divided into a first sub-region in which at least a part of the original image is displayed and a second sub-region in which at least a part of the corrected image is displayed through a boundary indicator (420). The above memory (220) is the electronic device (200), An electronic device storing instructions for changing the sizes of the first sub-area and the second sub-area based on user input to the boundary indicator.

11. In a method for correcting an image of an electronic device, An action of selecting an original image from among the images stored in the memory of the electronic device; An action of executing a correction function on the above original image to generate a corrected image; An operation of identifying at least one object from the original image that has a large correction effect from the corrected image, among a plurality of objects included in the original image and the corrected image, according to execution of the correction function; An action of generating at least one thumbnail comprising at least one object identified above; An operation of displaying at least a portion of the original image and at least a portion of the corrected image on a first area of ​​a display of the electronic device, and displaying at least one thumbnail on a second area of ​​the display; and A method comprising: when a user input for a first thumbnail among the thumbnails displayed in the second area is received, displaying a first enlarged image in the first area that is enlarged from an area including at least a part of an object included in the first thumbnail in the original image; and a second enlarged image in the first area that is enlarged from an area including at least a part of an object included in the first thumbnail in the corrected image.

12. In paragraph 11, The operation of selecting at least one object having a large correction effect is: A method including an operation of selecting at least one object having a large correction effect among the plurality of objects based on an average of the amount of change in pixel data of each pixel of an area including an object in the original image and the corrected image, or a ratio of pixels in which pixel data has changed among pixels of an area including an object.

13. In paragraph 11 or 12, The operation of generating the above corrected image is: When the above correction function is executed, an operation of analyzing the original image and selecting at least one of a plurality of predetermined correction engines; and A method comprising the action of generating a corrected image by correcting at least a portion of the original image using at least one correction engine selected above.

14. In paragraph 13, An action of displaying in a third area of ​​the display at least one item indicating at least one correction engine applied to the corrected image displayed in the first area; and A method further comprising an action of removing a correction effect by a correction engine indicated by a selected item for the entire corrected image based on a user input for an item displayed in the third area.

15. In a non-transitory computer-readable recording medium, An action of selecting an original image from among the images stored in the memory of an electronic device; An action of executing a correction function on the above original image to generate a corrected image; An operation of identifying at least one object from the original image that has a large correction effect from the corrected image, among a plurality of objects included in the original image and the corrected image, according to execution of the correction function; An action of generating at least one thumbnail comprising at least one object identified above; An operation of displaying at least a portion of the original image and at least a portion of the corrected image on a first area of ​​a display of the electronic device, and displaying at least one thumbnail on a second area of ​​the display; and A recording medium storing instructions for performing an operation of displaying, in the first area, a first enlarged image that enlarges an area including at least a part of an object included in the first thumbnail in the original image and a second enlarged image that enlarges an area including at least a part of an object included in the first thumbnail in the corrected image, when a user input for a first thumbnail among the thumbnails displayed in the second area is received.

Images