Electronic device for providing enhanced image, operating method thereof, and storage medium

Abstract

According to an embodiment, an electronic device may comprise a camera, at least one processor, and a memory for storing instructions. According to an embodiment, the instructions, when executed individually or collectively by the at least one processor, may be configured to cause the electronic device to: acquire a first image via the camera and identify one or more regions in the first image, wherein at least one of brightness, saturation, or color of each of the one or more regions is changed; identify a plurality of recovery maps, wherein each of the plurality of recovery maps includes information about the position of a corresponding region among the one or more regions and information for changing at least one of brightness, saturation, or color of the corresponding region among the one or more regions; and store an image file including the first image and the plurality of recovery maps.

Description

Electronic device for providing enhanced images, method of operation thereof, and storage medium

[0001] One embodiment disclosed in this document relates to an electronic device for providing an enhanced image, a method of operation thereof, and a storage medium.

[0002] The electronic device can display an image detected by the built-in camera in preview mode as a preview image. Additionally, the electronic device can obtain a shooting start command when the user presses a shooting button (e.g., a shutter button) and can save the image acquired from the camera after the user presses the shooting button.

[0003] The electronic device can acquire a raw image through an image sensor before displaying a preview image, and can process the acquired raw image using a built-in image signal processor (ISP). The image signal processor can process the received raw image using an image quality enhancement algorithm, and accordingly, can provide an image with improved image quality.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] According to one embodiment, the electronic device may include a camera, at least one processor, and a memory for storing instructions.

[0006] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to acquire a first image through the camera.

[0007] According to one embodiment, the instructions may be set to check at least one area within the first image, and each of the at least one area may have at least one of brightness, saturation, or color changed.

[0008] According to one embodiment, the instructions may be configured to check a plurality of recovery maps.

[0009] According to one embodiment, each of the plurality of recovery maps may include information regarding the location of the corresponding area among the at least one area, and information for changing at least one of the brightness, saturation, or color of the corresponding area among the at least one area.

[0010] According to one embodiment, the instructions may be configured to store an image file including the first image and the plurality of recovery maps.

[0011] According to one embodiment, a method for providing an enhanced image in an electronic device may include the operation of acquiring a first image through a camera of the electronic device.

[0012] According to one embodiment, the method may include an operation of identifying at least one region within the first image, and each of the at least one region may have at least one of brightness, saturation, or color changed.

[0013] According to one embodiment, the method may include the operation of checking a plurality of recovery maps.

[0014] According to one embodiment, each of the plurality of recovery maps may include information regarding the location of the corresponding area among the at least one area, and information for changing at least one of the brightness, saturation, or color of the corresponding area among the at least one area.

[0015] According to one embodiment, the method may include the operation of storing an image file comprising the first image and the plurality of recovery maps.

[0016] According to one embodiment, in a storage medium storing at least one instruction readable by a computer, the at least one instruction causes the electronic device (101) to perform at least one operation when executed by at least one processor (320) of the electronic device, and the at least one operation may include the operation of acquiring a first image through a camera of the electronic device.

[0017] According to one embodiment, the at least one operation may include an operation of identifying at least one region within the first image, and each of the at least one region may have at least one of brightness, saturation, or color changed.

[0018] According to one embodiment, the at least one operation may include an operation to check a plurality of recovery maps.

[0019] According to one embodiment, each of the plurality of recovery maps may include information regarding the location of the corresponding area among the at least one area, and information for changing at least one of the brightness, saturation, or color of the corresponding area among the at least one area.

[0020] According to one embodiment, the at least one operation may include the operation of storing an image file comprising the first image and the plurality of recovery maps.

[0021] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0022] FIG. 2 is a block diagram illustrating a camera module according to one embodiment.

[0023] FIG. 3a is a schematic block diagram of an electronic device according to one embodiment.

[0024] FIG. 3b is a drawing for explaining the operation for providing an enhanced image according to one embodiment.

[0025] FIG. 4a is a flowchart of the operation of an electronic device according to one embodiment.

[0026] FIG. 4b is a detailed operation flowchart of an electronic device for providing an enhanced image according to one embodiment.

[0027] FIG. 5a is an example diagram showing a method of displaying an image with a multi-recovery map applied to an object according to one embodiment.

[0028] FIG. 5b is an example diagram illustrating a method of displaying an image with a multi-recovery map applied to a specific area according to one embodiment.

[0029] FIG. 6 is a diagram illustrating the conditions for generating a multi-recovery map according to one embodiment.

[0030] FIG. 7 is a diagram illustrating a method for generating a multi-recovery map when a focus function is set according to one embodiment.

[0031] FIG. 8 is a diagram illustrating a method for generating a multi-recovery map when shooting at a preferred location according to one embodiment.

[0032] FIG. 9a is a diagram showing a geo-based database according to one embodiment.

[0033] FIG. 9b is a diagram showing a preference location-based database according to one embodiment.

[0034] FIG. 10 is a diagram illustrating a method for generating a multi-recovery map in the case of continuous shooting according to one embodiment.

[0035] FIG. 11 is a diagram illustrating a method for generating a multi-recovery map when a zoom function is set according to one embodiment.

[0036] FIG. 12 is a diagram illustrating a method for determining the number of multi-recovery maps according to brightness or saturation according to one embodiment.

[0037] FIG. 13 is an illustrative diagram for explaining white clipping or black clipping within an image according to one embodiment.

[0038] FIG. 14 is a drawing showing a white clipping histogram and a black clipping histogram according to one embodiment.

[0039] FIG. 15 is a drawing for explaining the amount of brightness change per hour according to one embodiment.

[0040] FIG. 16 is a diagram illustrating an image file storage method according to one embodiment.

[0041] FIG. 17a is a diagram showing metadata for a recovery map stored in a custom area of ​​an image file according to one embodiment.

[0042] FIG. 17b is a diagram showing sub-metadata of an image file according to one embodiment.

[0043] FIG. 17c is a drawing for explaining a method for determining the location of a rectangular area within an image according to one embodiment.

[0044] FIG. 17d is a drawing for explaining a method for determining the location of a point area within an image according to one embodiment.

[0045] FIG. 17e is a drawing for explaining a method for determining the location of a polygon area within an image according to one embodiment.

[0046] FIG. 18 is a diagram showing a multi-recovery map stored in a file format according to one embodiment.

[0047] FIG. 19 is a diagram illustrating a method for determining the number of multi-recovery maps in an image file according to one embodiment.

[0048] FIG. 20 is a diagram illustrating a method for outputting an image with a multi-recovery map applied according to one embodiment.

[0049] FIG. 21 is a diagram showing an example of mapping a multi-recovery map for each region according to one embodiment.

[0050] FIG. 22 is an example diagram showing a case where images to which a multi-recovery map according to one embodiment is applied are output sequentially.

[0051] FIG. 23 is a diagram illustrating a method for outputting images to which a multi-recovery map considering transition time according to one embodiment is applied.

[0052] FIG. 24 is an example diagram showing a case in which images with a multi-recovery map applied considering transition time according to one embodiment are sequentially output.

[0053] FIG. 25 is a diagram illustrating image recovery using a recovery map of another image according to one embodiment.

[0054] FIG. 26 is a diagram illustrating a method of outputting a recovered image using a recovery map of another image according to one embodiment.

[0055] FIG. 27 is a diagram illustrating a method for setting a representative image according to one embodiment.

[0056] FIG. 28 is an example diagram showing a case where images with a multi-recovery map applied are sequentially output when a representative image according to one embodiment is set.

[0057] FIG. 29 is a drawing for explaining a method of generating a video using an original image according to one embodiment.

[0058] FIG. 30 is a drawing for explaining a method of selecting and sharing an image according to one embodiment.

[0059] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0060] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to one embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through the server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0061] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0062] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0063] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0064] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0065] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0066] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0067] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0068] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0069] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0070] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0071] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0072] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0073] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0074] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0075] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0076] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0077] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0078] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0079] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0080] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0081] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0082] In the following detailed description, reference numbers in the drawings may be assigned identically or omitted for configurations that can be easily understood through prior embodiments, and detailed descriptions thereof may also be omitted. An electronic device (101) according to one embodiment disclosed in this document may be implemented by selectively combining configurations of different embodiments, and a configuration of one embodiment may be replaced by a configuration of another embodiment. For example, it should be noted that the present invention is not limited to specific drawings or embodiments.

[0083] FIG. 2 is a block diagram (200) illustrating a camera module (180) according to one embodiment.

[0084] Referring to FIG. 2, the camera module (180) may include a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250) (e.g., a buffer memory), or an image signal processor (260). The lens assembly (210) may collect light emitted from a subject that is the subject of the image capture. The lens assembly (210) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (210). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (210) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from the lens properties of the other lens assemblies. The lens assembly (210) may include, for example, a wide-angle lens or a telephoto lens.

[0085] A flash (220) may emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (220) may include one or more light-emitting diodes (e.g., RGB (red-green-blue) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. An image sensor (230) may acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through a lens assembly (210) into an electrical signal. According to one embodiment, the image sensor (230) may include, for example, one image sensor selected from image sensors with different properties such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (230) may be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0086] The image stabilizer (240) can move at least one lens or image sensor (230) included in the lens assembly (210) in a specific direction or control the operational characteristics of the image sensor (230) (e.g., adjusting read-out timing) in response to the movement of the camera module (180) or the electronic device (101) including it. This allows for compensating for at least some of the negative effects caused by the movement on the captured image. According to one embodiment, the image stabilizer (240) can detect such movement of the camera module (180) or the electronic device (101) using a gyroscope sensor (not shown) or an accelerometer sensor (not shown) placed inside or outside the camera module (180). According to one embodiment, the image stabilizer (240) can be implemented, for example, as an optical image stabilizer. The memory (250) can temporarily store at least some of the image acquired through the image sensor (230) for the next image processing operation. For example, when image acquisition by the shutter is delayed or multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in memory (250), and the corresponding copy image (e.g., a low-resolution image) can be previewed through the display module (160). When a specified condition is satisfied (e.g., user input or system command), at least a portion of the original image stored in memory (250) can be acquired and processed, for example, by an image signal processor (260). According to one embodiment, memory (250) may be configured as at least a portion of memory (130) or as a separate memory that operates independently thereof.

[0087] The image signal processor (260) can perform one or more image processing operations on an image acquired through the image sensor (230) or an image stored in memory (250) (e.g., original image). The above one or more image processing methods may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softing). Additionally or generally, the image signal processor (260) may perform control (e.g., exposure time control, or readout timing control, etc.) over at least one of the components included in the camera module (180) (e.g., image sensor (230)). The image processed by the image signal processor (260) may be stored back in memory (250) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display module (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (260) may be composed of at least a part of the processor (120), or It may be configured as a separate processor that operates independently of the processor (120). If the image signal processor (260) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (260) may be displayed through the display module (160) as is or after additional image processing by the processor (120).

[0088] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different attributes or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera and at least another may be a rear camera.

[0089] According to one embodiment, the camera module (180) may be referred to as a camera or a camera device.

[0090] FIG. 3a is a schematic block diagram of an electronic device according to one embodiment. To aid in understanding the description of FIG. 3a, the description will be explained with reference to FIG. 3b. FIG. 3b is a diagram illustrating an operation for providing an enhanced image according to one embodiment.

[0091] The electronic device (101) in FIG. 3a may be the electronic device (101) of FIG. 1. Also, the electronic device (101) in FIG. 3a may have the same configuration as the electronic device (101) of FIG. 1.

[0092] Referring to FIG. 3a, the electronic device (101) may include a camera (380), at least one processor (320), memory (330), and / or a display (360). Here, not all components shown in FIG. 3a are essential components of the electronic device (101), and the electronic device (101) may be implemented with more or fewer components than those shown in FIG. 3a. In describing the electronic device (101) of FIG. 3a, detailed descriptions of configurations similar to the embodiment of FIG. 1 or easily understood through the embodiment of FIG. 1 may be omitted.

[0093] According to one embodiment, a processor (320) (e.g., the processor (120) of FIG. 1) can control the overall operation of the electronic device (101). For example, the processor (320) includes a processing circuit and can be implemented as an application processor (AP) or a digital signal processor (DSP).

[0094] According to one embodiment, the processor (320) may display an image obtained through the camera (380) in preview mode during shooting as a preview image. The processor (320) may obtain a shooting start command by the user pressing a shooting button (e.g., a shutter button) and may save an image obtained through the camera (380) after the user presses the shooting button. The processor (320) may obtain a raw image through the image sensor (230) unlike the preview image displayed through the display (360), and the image saved after pressing the shooting button may be an image processed by an image signal processor (ISP) (360) using an image quality enhancement algorithm on the raw image.

[0095] According to one embodiment, the processor (320) may perform operations related to generating and storing a recovery map (321). In response to a request (e.g., user input) to verify a captured (or stored) image (322), the processor (320) may perform an operation to enhance the image using the recovery map and may output (or display) the enhanced image. Additionally, the processor (320) may perform an operation (324) to share the enhanced image with an external electronic device. Additionally, the processor (320) may provide an editing function for the enhanced image.

[0096] According to one embodiment, a recovery map may include information associated with at least one region (or at least one object) within an image so that at least one of the brightness, saturation, or color of at least one region (or at least one object) within the image changes over time while the image is displayed. According to one embodiment, the recovery map may include information regarding at least one of the brightness, saturation, or color of the at least one region. For example, to acquire (or generate) two or more images having different parameters (e.g., at least one of a parameter representing brightness, a parameter representing saturation, or a parameter representing color) for at least one region, the processor (320) may save the parameter information for each region (or each object) as a single image file together with the saved image (e.g., the original image) when saving the image after pressing the capture button. For example, the parameters may include various parameters to reveal visual features in each region (or each object) within the image when the captured image is displayed (or while the captured image is displayed). For example, a recovery map may be referred to by terms such as adjustment information, parameter information, or additional information regarding at least one area within an image, which adjusts the brightness, saturation, or color of at least one area within an image. However, for the convenience of explanation, the term recovery map will be used as the standard below.

[0097] According to one embodiment, when the processor (320) acquires an image through the camera (380), while displaying the acquired image as a preview image through the display (360), the image used for generating the recovery map may be a raw image acquired through the image sensor (230).

[0098] According to one embodiment, the processor (320) can use the raw image to identify at least one area (or at least one object) within the raw image where at least one of brightness, saturation, or color is changed.

[0099] According to one embodiment, the processor (320) can recognize at least one object by applying an object recognition algorithm to an image obtained using a camera (380). For example, at least one object may include a person, an animal, an object, or a plant, and the types of objects may not be limited thereto and may include various types. By recognizing at least one object included in the image, the processor (320) can identify at least one area in which at least one of brightness, saturation, or color is changed.

[0100] Additionally, the processor (320) can identify (or recognize) at least one area represented by pixel coordinates by applying a recognition algorithm obtained through machine learning or deep learning. For example, at least one area may include a fireworks area, a mountain area, a cloud area, a moon area, a star area, or a sky area, and the type of area may not be limited thereto and may include various types of areas. Additionally, the processor (320) can obtain classification information using the color distribution within the image without a recognition process, and obtain classification information that, for example, it is classified as 'fireworks'. For example, the processor (320) can identify a group of pixels using the color distribution within the image and recognize the identified group of pixels as a 'fireworks' area.

[0101] According to one embodiment, the operation of identifying the type of area or object using artificial intelligence (e.g., machine learning, deep learning, or generative artificial intelligence) by the electronic device (101) is not limited to the example of the processor (320), and can be performed using at least one other processor (e.g., auxiliary processor (123) (e.g., graphics processing unit, neural processing unit (NPU)) or by using an external artificial intelligence processing operation through the cloud.

[0102] In the following description, the operation of recognizing (or extracting) at least one region within an image should be understood to include the operation of recognizing at least one object.

[0103] According to one embodiment, the processor (320) may identify multiple recovery maps for changing at least one of the brightness, saturation, or color multiple times over time for each of the at least one region. Here, the multiple recovery maps may be referred to as multiple recovery maps or recovery maps.

[0104] According to one embodiment, the processor (320) may determine (or verify) the number of recovery maps to change at least one of brightness, saturation, or color multiple times over time for each of at least one area within an image. For example, the processor (320) may store a determined number of recovery maps corresponding to each verified area within the image. If, when saving a captured image, three recovery maps are corresponded to a first area of ​​the image and two recovery maps are corresponded to a second area of ​​the second image and saved as a single image file together with the captured image (e.g., original image), then in response to a request to display the captured image, three images with three recovery maps applied to the first area and two images with two recovery maps applied to the second area may be generated together with the saved original image. Here, each of the recovery maps may include information regarding the location of the corresponding area among the at least one area and information regarding at least one of brightness, saturation, or color for the corresponding area among the at least one area. Meanwhile, the structure of the image file where the recovery maps are stored will be described later.

[0105] According to one embodiment, the processor (320) may output (or display) the original image, three images generated in relation to a first area, and two images generated in relation to a second area sequentially through the display (360) at regular time intervals during a specified time period in response to a request to display a captured image. A recovery map for causing at least one of brightness, saturation, or color to change multiple times (e.g., two times or more) over time for each area in this manner may be referred to as a multi-recovery map. When the multi-recovery map is applied to an image, the processor (320) may generate multiple images in which at least one of brightness, saturation, or color of at least one area within the image changes multiple times over time, and may sequentially display the generated multiple images.

[0106] According to one embodiment, the processor (320) may analyze a stored image file in response to a request for stored image verification (322) (e.g., user input) and, based on the results of the analysis, generate a plurality of images to which a multi-recovery map is applied. The processor (320) may sequentially display the generated plurality of images, along with an image (e.g., original image) within the stored image file, through a display (360) at regular time intervals for a set time. Here, the set time may be changeable, and if the set time is changed, the processor (320) may sequentially display the image and the plurality of images at regular time intervals within the changed time. In addition, not only the set time but also the time interval for displaying the image and the plurality of images may be adjustable.

[0107] According to one embodiment, the processor (320) can determine whether to generate a multi-recovery map using a raw image. For example, when acquiring an image through the camera (380), the processor (320) can determine setting information related to at least one of a user-preferred location (or place) or preferred object. Additionally, when acquiring an image through the camera (380), the processor (320) can determine information related to at least one of whether to perform a focus function, whether to perform a zoom function, whether to use a flash, whether to perform continuous shooting, or the illuminance of the image. Based on at least some of the confirmed information, the processor (320) can determine whether to generate a multi-recovery map using the raw image. Based on the confirmed information, the processor (320) can determine whether it is necessary to generate (or acquire) a multi-recovery map for the image.

[0108] For example, in the case of a zoom function, the processor (320) may consider that capturing an object of interest (or region of interest) by zooming in is an intentional shot, and may decide to generate (or acquire) a multi-recovery map for said object of interest from an image acquired during shooting. Additionally, in the case of continuous shooting, the processor (320) may consider that capturing an object of interest (or region of interest) continuously is an intentional shot, and may decide to generate (or acquire) a multi-recovery map for said object of interest from an image acquired during shooting. The operation for generating a multi-recovery map will be described later.

[0109] According to one embodiment, when it is decided to generate a multi-recovery map, the processor (320) may determine how many recovery maps to generate for at least one area within the image. To do this, the processor (320) may check the brightness or saturation of the image and determine the number of multi-recovery maps based on the checked brightness or saturation. For example, the processor (320) may check whether white clipping or black clipping occurs as a result of checking the brightness. If white clipping or black clipping occurs, the processor may check the change in brightness per hour in a histogram representing the brightness of the image and determine the number of multi-recovery maps for at least one area based on the change in brightness per hour. For example, the processor (320) may determine the number of multi-recovery maps using a mathematical formula related to the amount of change in brightness per hour.

[0110] According to one embodiment, the memory (330) (e.g., the memory (130) of FIG. 1) may store a control program for controlling the electronic device (101), a UI related to an application provided by the manufacturer or downloaded from an external source, images for providing the UI, user information, documents, databases, or related data.

[0111] According to one embodiment, the memory (330) may store instructions that control the processor (320) to perform various operations during execution. According to one embodiment, the memory (330) may be operatively connected to the camera (380), the display (360), and the processor (320).

[0112] According to one embodiment, the memory (330) can store instructions configured to store an image file including the image and the plurality of recovery maps, wherein the memory acquires an image through a camera (380), identifies at least one area within the image in which at least one of brightness, saturation, or color is changed, identifies a plurality of recovery maps for changing at least one of the brightness, saturation, or color multiple times over time for each of the at least one area, and each of the recovery maps includes information about the location of the area among the at least one area and information about at least one of the brightness, saturation, or color for the area among the at least one area.

[0113] According to one embodiment, the electronic device (101) may include a camera (180, 380), at least one processor (120, 320), and a memory (130, 330) for storing instructions.

[0114] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to acquire a first image through the camera.

[0115] According to one embodiment, the instructions may be set to check at least one area within the first image, and each of the at least one area may have at least one of brightness, saturation, or color changed.

[0116] According to one embodiment, the instructions may be configured to check a plurality of recovery maps.

[0117] According to one embodiment, each of the plurality of recovery maps may include information regarding the location of the corresponding area among the at least one area, and information for changing at least one of the brightness, saturation, or color of the corresponding area among the at least one area.

[0118] According to one embodiment, the instructions may be configured to store an image file including the first image and the plurality of recovery maps.

[0119] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may generate a plurality of images in response to an input for displaying the image file stored in the memory. Each of the plurality of images is generated by applying one of the plurality of recovery maps to the first image included in the image file, and may be configured to display a second image corresponding to the first image to which one of the plurality of images is applied.

[0120] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to sequentially display the plurality of images such that at least one of the brightness, saturation, or color of at least one region within the first image is changed multiple times over time.

[0121] According to one embodiment, the at least one region may include a plurality of regions to which each of the plurality of recovery maps is applied.

[0122] According to one embodiment, the image file may include a plurality of recovery map fields corresponding to each of the plurality of regions and a metadata field for the plurality of recovery map fields.

[0123] According to one embodiment, each of the plurality of recovery map fields may include a plurality of recovery maps corresponding to the area and a sub-metadata field for the plurality of recovery maps corresponding to the area.

[0124] According to one embodiment, the sub-metadata field may include the number of a plurality of recovery maps corresponding to the area, information about the location of the area, and information for changing at least one of the brightness, saturation, or color of the area.

[0125] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to identify the plurality of recovery maps based on the metadata field included in the image file in response to an input for displaying the image file stored in the memory, identify the plurality of regions to which the plurality of recovery maps are to be applied in response to identifying the plurality of recovery maps, identify the plurality of recovery maps corresponding to each of the identified plurality of regions based on the sub-metadata field, and sequentially display the first image and the plurality of images to which the identified plurality of recovery maps are applied to the identified plurality of regions for a set time.

[0126] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to sequentially display the first image and the plurality of images at regular time intervals within the set time, and when the set time is changed, to sequentially display the first image and the plurality of images at regular time intervals within the changed time.

[0127] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to identify the at least one region by recognizing at least one object included in the first image.

[0128] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to identify the at least one region by determining to identify setting information related to at least one of a preferred location or preferred object according to user preference and, based on the setting information, to generate the plurality of recovery maps.

[0129] According to one embodiment, the instructions may be configured to identify the at least one area by determining, when executed individually or collectively by the at least one processor, that the electronic device, when acquiring the first image through the camera, checks information related to whether a focus function is performed, whether a zoom function is performed, whether a flash is used, or the illuminance of the first image, and, based on the confirmed information, determines to generate the plurality of recovery maps.

[0130] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to check the brightness or saturation of the first image and, based on the checked brightness or saturation, determine the plurality of recovery maps for the at least one region.

[0131] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to check the brightness change per hour in a histogram representing the brightness of the first image and determine the plurality of recovery maps for the at least one region based on the brightness change per hour.

[0132] FIG. 4a is a flowchart of the operation of an electronic device for providing an enhanced image according to one embodiment. Referring to FIG. 4a, the operation method may include operations 405 through 420. Each operation of the operation method of FIG. 4a may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1 and FIG. 3a), and at least one processor of the electronic device (e.g., the processor (120) of FIG. 1, the processor (320) of FIG. 3a). In one embodiment, at least one of operations 405 through 420 may be omitted, the order of some operations may be changed, or other operations may be added.

[0133] According to one embodiment, in operation 405, the electronic device (101) can acquire a first image through a camera (380). For example, the electronic device (101) can display the first image acquired through the camera (380) as a preview image through a display (360). The camera (380) may include an image sensor (230), and the camera (380) can output an image in which an optical signal input through the image sensor (230) is converted into an electrical image signal. The electronic device (101) can acquire a raw image through the image sensor (230) before displaying the preview image.

[0134] According to one embodiment, in operation 410, the electronic device (101) can identify at least one region within the first image. According to one embodiment, the operation of identifying at least one region may include identifying at least one object within the image as a region. For example, the electronic device (101) can detect (or recognize) at least one object included in the first image. According to one embodiment, the electronic device (101) can identify the at least one region by recognizing at least one object included in the first image. The identified at least one region may be a region where at least one of brightness, saturation, or color is changed (or changed). The identified at least one region may be a region where a recovery map is applied to change at least one of brightness, saturation, or color. According to one embodiment, the electronic device (101) can determine or recognize an object based on an affinity-based DB or an object recognition DB.

[0135] According to one embodiment, the electronic device (101) can identify the at least one area by determining, upon acquiring the first image through the camera, setting information related to at least one of a preferred location or preferred object according to user preference, and determining to generate the plurality of recovery maps based on the setting information.

[0136] According to one embodiment, the electronic device (101) can identify the at least one area by determining whether to perform a focus function, whether to perform a zoom function, whether to use a flash, whether to take continuous shots, or the illumination level of the first image when acquiring the first image through the camera, and by determining to generate the plurality of recovery maps based on the identified information.

[0137] According to one embodiment, in operation 415, the electronic device (101) can check a plurality of recovery maps. Each of the plurality of recovery maps may include information about the location of a corresponding area among the at least one area and information for changing at least one of brightness, saturation, or color for the corresponding area among the at least one area. Each of the plurality of recovery maps may include information for changing at least one of brightness, saturation, or color multiple times over time for each of the at least one area.

[0138] According to one embodiment, the electronic device (101) can determine the brightness or saturation of the first image and, based on the determined brightness or saturation, determine the plurality of recovery maps for the at least one area. For example, the electronic device (101) can determine the number of plurality of recovery maps to be generated (or acquired) for the at least one area and generate (or acquire) the determined number of plurality of recovery maps for the at least one area.

[0139] According to one embodiment, each of the plurality of recovery maps may include information regarding the location of the corresponding area among the at least one area, and information for changing at least one of the brightness, saturation, or color of the corresponding area among the at least one area.

[0140] According to one embodiment, in operation 420, the electronic device (101) can store an image file including the first image and the plurality of recovery maps.

[0141] According to one embodiment, the electronic device (101) may generate a plurality of images in response to an input for displaying the stored image file, and each of the plurality of images may be generated by applying one of the plurality of recovery maps to the first image included in the image file. The electronic device (101) may display a second image corresponding to the first image to which one of the plurality of images has been applied. According to one embodiment, the electronic device (101) may generate the plurality of images by applying the plurality of recovery maps to the first image so that the plurality of images are displayed such that at least one of the brightness, saturation, or color of at least one region within the first image changes multiple times over time, based on the plurality of recovery maps included in the image file. According to one embodiment, the generated plurality of images may be displayed sequentially.

[0142] According to one embodiment, the plurality of images may be displayed sequentially such that at least one of the brightness, saturation, or color of at least one region within the first image is changed multiple times over time.

[0143] According to one embodiment, the electronic device (101) may pre-generate a plurality of images by applying a plurality of recovery maps corresponding to each region within the first image based on an image file. The electronic device (101) may sequentially display the generated plurality of images together with the first image in response to an input for displaying an image stored in the form of an image file.

[0144] According to one embodiment, the electronic device (101) may generate the plurality of images in response to an input for displaying the stored image file and sequentially display the generated plurality of images together with the first image.

[0145] According to one embodiment, the at least one region may include a plurality of regions to which each of the plurality of recovery maps is applied.

[0146] According to one embodiment, the electronic device (101) can determine how many recovery maps to apply to a specific area within the first image based on the image file. The image file may include a plurality of recovery maps determined to correspond to at least one area within the first image, together with the first image.

[0147] According to one embodiment, the image file may include a plurality of recovery map fields corresponding to each of the plurality of regions and a metadata field for the plurality of recovery map fields. Each of the plurality of recovery map fields may include a plurality of recovery maps corresponding to the region and a sub-metadata field for the plurality of recovery maps corresponding to the region. The sub-metadata field may include the number of the plurality of recovery maps corresponding to the region, information regarding the location of the region, and information for changing at least one of the brightness, saturation, or color of the region.

[0148] According to one embodiment, the electronic device (101) can identify the plurality of recovery maps based on the metadata field included in the image file in response to an input for displaying the stored image file. The electronic device (101) can identify the plurality of regions to which the plurality of recovery maps are to be applied in response to identifying the plurality of recovery maps. The electronic device (101) can identify the plurality of recovery maps corresponding to each of the identified plurality of regions based on the sub-metadata field. For example, the electronic device (101) can identify the number of the plurality of recovery maps corresponding to each of the identified plurality of regions.

[0149] The electronic device (101) can sequentially display a plurality of images in which the identified plurality of recovery maps are applied to the first image and the identified plurality of regions during a set time. For example, the electronic device (101) can determine the number of corresponding plurality of recovery maps for each of the identified plurality of regions and generate images in which the identified number of plurality of recovery maps are applied for each region. Accordingly, the electronic device (101) can sequentially display the generated plurality of images for the first image together with the first image in response to an input for displaying the stored image file.

[0150] According to one embodiment, the electronic device (101) can sequentially display the first image and the plurality of images at regular time intervals within the set time, and when the set time is changed, the first image and the plurality of images can sequentially display at regular time intervals within the changed time.

[0151] FIG. 4b is a detailed operation flowchart of an electronic device for providing an enhanced image according to one embodiment. Referring to FIG. 4b, the operation method may include operations 450 through 490. In one embodiment, at least one of operations 405 through 490 may be omitted, the order of some operations may be changed, or other operations may be added. To aid in understanding the description of FIG. 4b, the description will be explained with reference to FIG. 5a through 6. FIG. 5a is an example diagram showing a method of displaying an image with a multi-recovery map applied to an object according to one embodiment, and FIG. 5b is an example diagram showing a method of displaying an image with a multi-recovery map applied to a specific area according to one embodiment.

[0152] Referring to FIG. 4b, in operation 450, the electronic device (101) can determine whether to generate a multi-recovery map in operation 455 when an image is input. The electronic device (101) can check specified conditions for determining whether to generate a multi-recovery map. For example, the electronic device (101) can check various specified conditions such as shooting at a location (or place) preferred by the user, shooting related to an object preferred by the user, shooting using a focus function, shooting using a zoom function, shooting using a flash function, or continuous shooting.

[0153] The electronic device (101) can determine the number of multi-recovery maps in 450 operations based on confirming that at least one of the specified conditions is satisfied.

[0154] According to one embodiment, the electronic device (101) can determine (or verify, determine) the number of multi-recovery maps based on a change amount of any one of brightness, saturation, or color for at least one area in operation 460. According to one embodiment, the electronic device (101) can use shutter speed and information about an object to determine the number of multi-recovery maps. For example, the electronic device (101) can determine the number of multi-recovery maps by checking the shutter speed and checking the object. According to one embodiment, the electronic device (101) can verify (or determine) the number of multi-recovery maps corresponding to the change amount by referring to a pre-stored table representing the relationship between the change amount and the number of recovery maps. According to one embodiment, the electronic device (101) can verify (or determine) the number of multi-recovery maps corresponding to the change amount by referring to a mathematical formula that determines the number of recovery maps based on the change amount.

[0155] In operation 465, the electronic device (101) can generate a multi-recovery map, and in operation 470, save the original image and the multi-recovery map.

[0156] According to one embodiment, the electronic device (101) can generate (or acquire) a determined number of multi-recovery maps for at least one area. The electronic device (101) can store the determined number of multi-recovery maps so that they correspond to the at least one area. For example, the electronic device (101) can store the original image together with the multi-recovery maps as a single image file so that a determined number of multi-recovery maps correspond to each area.

[0157] In operation 475, when selecting an original image, the electronic device (101) can perform an image output function in operation 480 if the selection corresponds to a view selection for the original image. In operation 485, the device can perform an image editing function if the selection corresponds to an edit selection. In operation 490, the device can perform an image sharing function if the selection corresponds to a share selection. A detailed explanation thereof will be provided later. In one embodiment, the order of execution of each of operations 405 to 490 may be changed, some operations may be added between the operations, or at least one of the operations may not be performed.

[0158] For example, the electronic device (101) can generate a number of images with a determined number of multi-recovery maps applied to at least one area together with the original image in response to the view selection, and sequentially display the number of images generated together with the original image.

[0159] Referring to FIG. 5a, the electronic device (101) may generate a plurality of images to which a determined number of multi-recovery maps are applied to at least one region (or object) by referring to an image file. For example, if information is stored in the image file such that two multi-recovery maps correspond to a first object (e.g., baby face) (510), the electronic device (101) may generate, based on the information stored in the image file, an image (500b) containing a first object (e.g., baby face) (520) to which a first recovery map is applied that includes information on brightness, saturation, or at least one of the first object, and an image (500c) containing a first object (e.g., baby face) (530) to which a second recovery map is applied that includes information on brightness, saturation, or color of the first object. The second recovery map is different from the first recovery map, and for example, at least one of the brightness, saturation, or color of the first object may be different.

[0160] The electronic device (101) can sequentially display a plurality of images (500b, 500c) generated together with the original image (500a) at regular intervals (e.g., n ms) in response to a request for verification (e.g., selection of view) of the original image (or stored image). Accordingly, the electronic device (101) can sequentially display the original image (500a) and the plurality of generated images (500b, 500c) at regular intervals within a set time, such that at least one of the brightness, saturation, or color of an object (e.g., baby face) of the original image (500a) changes multiple times over time.

[0161] Meanwhile, although the above description used an example where at least one of the brightness, saturation, or color of an object in an image changes over time, as illustrated in FIG. 5b, at least one of the brightness, saturation, or color of at least one area in the image may change over time. For example, at least one area may include a flame area, a mountain area, a cloud area, a moon area, a star area, or a sky area.

[0162] Accordingly, the electronic device (101) can sequentially display the original image (500d) and a plurality of generated images (500e, 500f) at regular time intervals (e.g., n milliseconds (ms)) within a set time, such that at least one of the brightness, saturation, or color of a region (e.g., a fireworks region) (540) of the original image (500d) is changed multiple times over time. For example, images (500e) including a region (550) to which a first recovery map containing information of at least one of brightness, saturation, or color is applied for a region (e.g., a fireworks region) (540) within the original image (500d), and images (500f) including a region (560) to which a second recovery map different from the first recovery map is applied may be sequentially displayed.

[0163] According to one embodiment, an image can be displayed in which at least one of brightness, saturation, or color changes only for a specific object (e.g., a baby face) or a specific area (e.g., a fireworks area) within the image. As such, according to one embodiment, visual effects can be provided by adjusting the color, brightness, saturation, etc., of at least one area (or at least one object) within the image, and the image can be displayed (or output) more naturally, thereby enhancing the user's emotions, immersion, and / or realism.

[0164] According to one embodiment, by applying a multi-recovery map, various raw data that was deleted and could not be recovered during image capture can be utilized. For example, if a flame image is captured, various levels of saturation maps for red color can be obtained and the corresponding effect applied during image output to further enhance the image output effect and allow for a realistic flame effect to be seen.

[0165] FIG. 6 is a diagram illustrating the conditions for generating a multi-recovery map according to one embodiment.

[0166] Referring to FIG. 6, the electronic device (101) can determine whether to generate a recovery map based on specified conditions such as a set geo-based check (610), a continuous shooting check (620), a focus check (630), a set area check (640), a set zoom check (650), and / or a flash check (660).

[0167] For example, a condition such as a configured geo-based verification (610) may be a condition in which the electronic device (101) checks whether the current shooting location is a place or a preferred location within the geo-based DB by referring to at least one of a geo-based (or location) database (DB) and a preferred location-based DB. If the electronic device (101) confirms that the current shooting location corresponds to a place or a preferred location within the geo-based DB, it may decide to generate a recovery map for the preferred object of the captured image. A specific description regarding the configured geo-based verification (610) will be described later in FIGS. 8 to 9b. For example, a condition such as a continuous shooting verification (620) may be a condition in which it determines that the shooting is continuous by comparing the similarity between the captured images. If the electronic device (101) confirms that the shooting is continuous based on the result of the similarity comparison, it may decide to generate a recovery map for the continuous shooting target (or object) of the captured image. A specific description regarding the continuous shooting verification (620) will be described later in FIG. 10.

[0168] For example, a condition such as focus verification (630) may be a condition that determines that the focused area is the area of ​​interest when the focus function is set during shooting. The electronic device (101) may decide to generate a recovery map for the focus area of ​​the captured image when the focus function is set. A specific description regarding focus verification (630) will be described later in FIG. 7.

[0169] For example, a condition such as the set area verification (640) may be a condition in which the electronic device (101) checks whether the current shooting target is a set area (or preferred object) by referring to various databases such as a preferred person object DB or an object object DB. If the electronic device (101) confirms that the current shooting target exists in the person object DB or object object DB, it may decide to generate a recovery map for the set area (or preferred object) of the captured image. A specific description related to the set area verification (640) will be described later together in FIGS. 8 to 9b, which correspond to the section describing the set geo-based verification (610).

[0170] For example, a condition such as a set zoom confirmation (650) may be a condition in which the electronic device (101) checks whether a zoom function is performed according to a user request. The electronic device (101) may decide to generate a recovery map for the zoom area of ​​the captured image when the zoom function is performed. A specific description regarding the set zoom confirmation (650) will be described in detail later in FIG. 11.

[0171] For example, a condition such as flash verification (660) may be a condition in which the electronic device (101) checks whether a flash function is performed in response to a user request. When the flash function is performed, the electronic device (101) may decide to create a recovery map for a bright area greater than a set size of the captured image, since the captured image may contain an area with a brightness greater than a threshold.

[0172] According to one embodiment, the electronic device (101) can determine the generation of a recovery map based on satisfying at least one of the specified conditions.

[0173] According to one embodiment, the electronic device (101) may decide to generate a recovery map for the entire captured image or to generate a recovery map for only a part of the captured image, based on satisfying at least one of the specified conditions.

[0174] According to one embodiment, the electronic device (101) can determine to generate a recovery map (670) for the entire image based on the result of performing a set geographic-based verification (610) operation or a continuous shooting verification (620) operation.

[0175] According to one embodiment, the electronic device (101) may determine to generate a recovery map (680) for a portion of the entire image based on the result of performing focus check (630), set area check (640), set zoom check (650), and / or flash check (660). According to one embodiment, when the electronic device (101) determines to generate a recovery map, it may determine (690) to generate a multi-recovery map for the entire image or a portion of the entire image.

[0176] FIG. 7 is a diagram illustrating a method for generating a multi-recovery map when a focus function is set according to one embodiment.

[0177] Referring to FIG. 7, in the case of the focus check (630) operation of FIG. 6, the electronic device (101) can determine whether to generate (or extract, acquire) a multi-recovery map by checking whether the focus function is performed. For example, the electronic device (101) can decide to generate a multi-recovery map when the focus function is set.

[0178] In FIG. 7, two focuses are set, and according to one embodiment, when the focus sizes are both N x N (e.g., 1200 x 1200), the electronic device (101) can determine (or extract) a region of interest (ROI) area (710, 720) corresponding to the focused area in the entire image (700). When pixel information for the first region of interest (710) is top-left coordinates (e.g., 1000, 500) and bottom-right coordinates (e.g., 2200, 1700), and pixel information for the second region of interest (720) is top-left coordinates (e.g., 2400, 500) and bottom-right coordinates (e.g., 3600, 1700), the pixel information for the determined region of interest can be used to determine the type or number of multi-recovery maps.

[0179] FIG. 8 is a diagram illustrating a method for generating a multi-recovery map when shooting at a preferred location according to one embodiment. To aid in understanding the explanation of FIG. 8, the explanation will be described with reference to FIG. 9a and FIG. 9b. FIG. 9a is a diagram showing a geographic-based database according to one embodiment, and FIG. 9b is a diagram showing a preference location-based database according to one embodiment. FIG. 8 illustrates a detailed operation flow for the set geographic-based verification (610) operation and the set area (or object) verification (640) operation of FIG. 6.

[0180] Referring to FIG. 8, in operation 805, the electronic device (101) can check a geographic (or location)-based database (DB). In operation 810, the electronic device (101) can check whether the current shooting location is a place within the geographic-based DB. If the current shooting location is a place within the geographic-based DB, in operation 815, the electronic device (101) can decide to create (or extract, acquire) a recovery map. For example, the electronic device (101) can decide to create a recovery map when camera shooting is performed at a location set within the geographic-based DB.

[0181] FIG. 9a illustrates the configuration of a geographic-based database, which can be implemented within a server (e.g., the server (108) of FIG. 1), and an electronic device (101) can obtain geographic information about a specific attraction from the server. The electronic device (101) can determine that it is an attraction by using the number of reviews (count) and the number of registered images (count) provided by the server, and can decide to generate a recovery map if the current shooting location is within the error tolerance range of the geographic information about the attraction by comparing the geographic information about the attraction with the current shooting location. Additionally, the electronic device (101) can decide to generate a multi-recovery map for a partial region of interest (ROI) and extract the multi-recovery map.

[0182] For example, if a user takes a photo at ‘Namsan Tower’, the shooting location has a latitude of 37.55119 and a logitude of 126.9881, and the location set in the geographic-based DB (e.g., Namsan Tower) has a latitude of 37.55120 and a logitude of 126.9882, then the latitude error between the shooting location and the set location may be 0.00001 and the longitude error may be 0.0001. If the above latitude error and longitude error are within the set error range, the electronic device (101) may determine to generate a recovery map by considering that the user is taking a photo of a landmark (e.g., Namsan Tower) at the current shooting location. Here, the electronic device (101) can generate (or extract) a recovery map for the entire image including Namsan Tower, but may also generate a recovery map only for the area corresponding to Namsan Tower within the entire image.

[0183] Meanwhile, if the current shooting location is not a location within the geo-based DB, in operation 820, the electronic device (101) can check the preference location-based DB and determine whether it is a location within the preference location-based DB. If it is a location within the preference location-based DB, the number of shots within the preference location-based DB can be updated in operation 830. On the other hand, if it is not a location within the preference location-based DB, it can be newly registered in the preference location DB based on the current shooting location in operation 835.

[0184] Figure 9b illustrates a preference location-based database, and among preference locations A, B, and C, a higher number of shots may indicate a location that is more preferred by the user. For example, if a user frequently takes photos at a place (or location), the number of shots may be high, and a location with a high number of shots can be considered a target location for generating an image that displays a visual effect by creating a recovery map.

[0185] For example, a personal preference location-based database may be established, and there may be cases where a photo is taken again at that location. The electronic device (101) can manage the preference location-based database using on-device AI and can record and update the number of times a user has taken a photo at a specific location. Accordingly, the electronic device (101) can use the preference location-based database to determine whether to create a recovery map by considering the location where the photo is taken as a place where a recovery map must be created (or extracted) if the shooting location corresponds to any one of the preference locations (e.g., preference A, B, C) within the preference location-based database.

[0186] Meanwhile, although the above description explains the case where the creation of a recovery map is determined based on a configured geographic-based DB and a preference location-based DB, various DBs such as a user-preferred person object DB and object object DB may be built within the electronic device (101) and continuously updated to determine the creation of a recovery map using the various DBs. For example, the person object DB may include father, mother, spouse, personal pet, brother, sister, son, and daughter, and the object object DB may include various types of object objects such as mountains, clouds, flames, stars, the moon, flowers, lions, and tigers. In this way, the types of objects used to determine the creation of a recovery map may not be limited to these and may include various types.

[0187] FIG. 10 is a diagram illustrating a method for generating a multi-recovery map in the case of continuous shooting according to one embodiment. FIG. 10 is an example diagram illustrating the operation of continuous shooting confirmation (620) of FIG. 6.

[0188] Referring to FIG. 10, in the case of the continuous shooting confirmation (620) operation of FIG. 6, the electronic device (101) can determine whether to generate (or extract, acquire) a multi-recovery map by checking whether continuous shooting is performed.

[0189] For example, in the case of continuous shooting (1010, 1020, 1030) as illustrated in FIG. 10, the electronic device (101) may determine to generate (or obtain) a multi-recovery map for the object of interest from the images obtained during shooting, by considering the continuous shooting of the object of interest (or region of interest) as intentional shooting. The electronic device (101) may determine to generate a multi-recovery map by comparing the similarity between the images taken in the case of continuous shooting. For example, after the first captured image (1010), the electronic device (101) may determine the similarity value between the first captured image (1010) and the second captured image (1020), and if the similarity value is 0.95 (minimum: 0, maximum: 1.00) and the setting value for similarity determination is set to 0.95 or higher, it may determine that it is continuous shooting, thereby generating (or extracting) a multi-recovery map. Here, PSNR (peak signal-to-noise ratio) can be used as a similarity judgment algorithm.

[0190] FIG. 11 is a diagram illustrating a method for generating a multi-recovery map when a zoom function is set according to one embodiment. FIG. 11 is an example diagram illustrating the set zoom confirmation (640) operation of FIG. 6.

[0191] Referring to FIG. 11, when a zoom function is performed during shooting, the original image (1100) is not saved, but only the image area corresponding to the zoom area relative to the original image (1100) can be saved as a zoom image (1110). For example, when a zoom function is performed, the electronic device (101) may decide to generate (or acquire) a multi-recovery map for the object of interest from the image acquired during shooting, considering that shooting by zooming in on the object of interest (or area of ​​interest) is an intentional shooting. For example, the electronic device (101) may decide to generate (or extract) a multi-recovery map for the remaining area (e.g., background image) excluding the zoom area when the zoom area is greater than or equal to a set value (e.g., 2x).

[0192] Meanwhile, in the case of the flash check (660) operation of FIG. 6, if the user uses the flash function when taking a picture, the captured image may contain an area with a brightness greater than a threshold. Therefore, when the flash function is performed, the electronic device (101) can check whether data of a bright area greater than a set size is included in the image at the time of shooting. If data of a bright area greater than a set size is included in the image, the electronic device (101) can decide to generate (or extract) a multi-recovery map.

[0193] According to one embodiment as described above, the generation (or extraction) of a multi-recovery map can be determined based on various specified conditions, such as shooting at a designated location, shooting at a user-preferred location, shooting related to a coral object, shooting using a focus function, shooting using a zoom function, shooting using a flash function, or continuous shooting, and the types of conditions for determining whether to generate a multi-recovery map may not be limited thereto. For example, in addition to the specified conditions shown in FIG. 6, the electronic device (101) can check the ambient light level during shooting. If the brightness of the image obtained through the camera (380) is below a threshold, for example, in the case of an image having a brightness below a value set for day or night, it may be determined to generate (or extract) a multi-recovery map.

[0194] Meanwhile, if it is decided to generate a multi-recovery map, the electronic device (101) can determine how many multi-recovery maps to extract for at least one area of ​​the image. For example, assuming that there are two identified areas in the image, n multi-recovery maps are extracted for the first area and m multi-recovery maps are extracted for the second area, the following description will explain how to determine the number of multi-recovery maps (e.g., n, m) corresponding to each area.

[0195] FIG. 12 is a diagram illustrating a method for determining the number of multi-recovery maps according to brightness or saturation according to one embodiment. To aid in understanding the explanation of FIG. 12, the explanation will be described with reference to FIG. 13 to FIG. 15. FIG. 13 is an example diagram illustrating white clipping or black clipping within an image according to one embodiment, FIG. 14 is a diagram showing a white clipping histogram and a black clipping histogram according to one embodiment, and FIG. 15 is a diagram illustrating the amount of brightness change per unit of time according to one embodiment.

[0196] Referring to FIG. 12, in operation 1205, the electronic device (101) can determine at least one of the brightness or saturation of a target area within an image obtained through a camera (380). Here, the target area is an area determined to generate a multi-recovery map, and may be an area corresponding to at least one area (or at least one object) within the image determined by applying a recognition algorithm.

[0197] Based on the result of checking at least one of the brightness or saturation of the target area, in operation 1210, the electronic device (101) can check whether clipping occurs. For example, as an operation to check whether clipping occurs, the electronic device (101) can check whether at least one of white clipping or black clipping has occurred. If clipping has occurred, in operation 1215, the electronic device (101) can determine the number of recovery maps.

[0198] Referring to FIG. 13, for example, when there are N target regions (e.g., 3) within an image (1300), in order to determine the number of multi-recovery maps for each of the first region (1305), second region (1310), and third region (1315), the electronic device (101) can check the brightness for each region (1305, 13010, 1315). For example, it can be assumed that the first region (1305) is a region of interest containing the first object (e.g., the sea) and has coordinate values ​​of top-left (300, 100) and bottom-right (600, 400), the second region (1310) has coordinate values ​​of top-left (1400, 900) and bottom-right (2100, 2000), and the third region (1315) has coordinate values ​​of top-left (2200, 900) and bottom-right (2900, 2000). The electronic device (101) can determine brightness information from the raw image corresponding to the coordinate values ​​of each region (1305, 13010, 1315). The electronic device (101) can generate (or extract) a multi-recovery map based on a histogram representing brightness information as illustrated in FIG. 14. For example, if white clipping occurs, a histogram of the form of the white clipping histogram (1400a) of FIG. 14 may appear. Since information about the target area may be lost due to overexposure when white clipping occurs, information about the target area can be obtained (or extracted) from the raw image and applied to the target area to prevent information loss caused by overexposure of the target area. For example, white clipping may occur due to an increase in brightness during flash shooting, but the area where white clipping occurred may be recovered by obtaining a brightness map.

[0199] According to one embodiment, when black clipping occurs, a histogram representing brightness information may correspond to a black clipping histogram (1400b). Since black clipping occurs when information about the target area cannot be expressed due to underexposure, information about the target area can be obtained (or extracted) from the raw image and applied to the target area to prevent information loss due to underexposure.

[0200] As mentioned above, when an area that is too bright or too dark occurs in the image obtained during image capture, the effect of correction for the target area can be obtained by generating and applying a multi-recovery map for the target area.

[0201] According to one embodiment, the electronic device (101) can determine the number of recovery maps based on a histogram representing brightness information. For example, the number of recovery maps can be determined based on the amount of brightness change per hour.

[0202] On the other hand, if clipping does not occur, in operation 1225, the electronic device (101) can check whether the amount of brightness change within a set time is greater than or equal to a reference value. Additionally, if clipping does not occur, the electronic device (101) can check whether color saturation occurs in operation 1230. For example, if clipping does not occur, the electronic device (101) can perform an operation to check whether the amount of brightness change within a set time is greater than or equal to a reference value in operation 1225, or perform an operation to check whether color saturation occurs in operation 1230.

[0203] According to one embodiment, FIG. 12 shows that the operation of checking whether clipping has occurred (1210), the operation of checking whether the amount of brightness change within a set time is greater than or equal to a reference value (1225), and the operation of checking whether color saturation has occurred (1230) are sequential, but it should be understood that the order of the 1210 operation, the 1225 operation, and the 1230 operation may be changed or performed simultaneously. For example, if it is confirmed that color saturation has not occurred, the electronic device (101) may check whether the amount of brightness change within a set time is greater than or equal to a reference value, and the order of the operations is not limited thereto.

[0204] According to one embodiment, if the amount of brightness change within the set time is greater than or equal to a reference value, the electronic device (101) can determine the number of recovery maps in operation 1215. For example, the electronic device (101) can determine the number of multi-recovery maps by checking the amount of brightness change per hour. For example, the electronic device (101) can determine the number of multi-recovery maps by checking the amount of brightness change using the histogram average value and checking the amount of change of the histogram average value per hour.

[0205] For example, assuming a situation where the preview image is displayed in a fixed state, if the average value of the histogram (1500a) of the first image in FIG. 15 is 30 and the average value of the histogram of the second image (1500b) is 70, and the change time standard is set to 100 ms, it can be seen that the average value of the histogram has changed from 30 to 70 within 100 ms.

[0206] If it is set to extract a recovery map for each change amount of 10 of the histogram average value, the electronic device (101) may decide to extract a total of 4 recovery maps based on the following mathematical formula 1.

[0207]

[0208] According to the above mathematical formula 1, 70 - 30 / 10 = 4, so the number of recovery maps can be 4. Accordingly, the electronic device (101) can extract (or acquire, generate) as many multi-recovery maps as the number of recovery maps determined.

[0209] According to one embodiment, if color saturation occurs in operation 1230, the electronic device (101) can determine the number of recovery maps in operation 1215. According to one embodiment, the electronic device (101) can determine the number of recovery maps in operation 1215 in response to identifying that at least one condition among clipping occurs, color saturation occurs, or the amount of brightness change within a set time is greater than or equal to a reference value is satisfied.

[0210] For example, the electronic device (101) can check the saturation of the target area as in operation 1205. The electronic device (101) can check the amount of change in saturation based on the histograms for the R, G, and B channels. The electronic device (101) can determine to extract a saturation map if clipping based on the histograms for the R, G, and B channels occurs, and can determine the number of recovery maps as in operation 1215. On the other hand, the electronic device (101) can check whether color saturation has occurred as in operation 1230 if clipping based on the histograms for the R, G, and B channels has not occurred, and if color saturation has occurred, determine to extract a saturation map and determine the number of recovery maps as in operation 1215.

[0211] The electronic device (101) can determine the number of saturation maps by calculating the difference between the value where clipping or color saturation occurs and the reference value. In this way, the electronic device (101) can check the amount of change in saturation and determine the number of recovery maps corresponding to the amount of change in saturation. For example, if the target area includes a person object, a multi-recovery map containing information about the color of the target area (e.g., R (red) channel) can be extracted. Also, if the target area includes a plant object, a multi-recovery map containing information about the color of the target area (e.g., G (green) channel) can be extracted. Also, if it is confirmed that the target area is a sky area, a multi-recovery map containing information about the color of the target area (e.g., B (blue) channel) can be extracted. However, this is merely an example, and the determined recovery maps corresponding to the type of target area may not be limited thereto. A determined recovery map corresponding to the type of target area can be set by the user or automatically set by the electronic device (101).

[0212] As the number of recovery maps is determined in operation 1215, in operation 1220, the electronic device (101) can extract (or create, acquire) the determined number of multi-recovery maps.

[0213] According to one embodiment, when the number of multi-recovery maps is determined, the electronic device (101) can store the number of multi-recovery maps determined at the time of image storage together with the image in a single image file. The operation of storing such an image file will be explained with reference to FIG. 16.

[0214] FIG. 16 is a diagram illustrating an image file storage method according to one embodiment.

[0215] Referring to FIG. 16, in operation 1605, the electronic device (101) can check the image file format. According to one embodiment, after the operation of determining the number of recovery maps in FIG. 12 and extracting the determined number of multi-recovery maps is performed, the operation of checking and saving the custom data area of ​​the image file format can be performed. For example, the electronic device (101) can check the file format of the image to be saved, such as JPEG, HEIF, AVIF, PNG. The electronic device (101) can check the custom area in operation 1610. For example, the electronic device (101) can check whether there is a custom area in the file format based on the checked image file format. If there is no separate custom area within the image file format, recovery map metadata can be configured to be stored at the very last location (or area) of the image file.

[0216] The electronic device (101) can generate recovery map metadata in operation 1615 and can store the generated recovery map metadata in a custom data area in operation 1620.

[0217] According to one embodiment, metadata for a recovery map stored in a custom area of ​​an image file may have the form as illustrated in FIG. 17a. FIG. 17a is a diagram showing metadata for a recovery map stored in a custom area of ​​an image file according to one embodiment.

[0218] Referring to FIG. 17a, according to one embodiment, metadata (1705) of a custom area may include information indicating how many multi-recovery maps for a total of areas are stored. Each piece of information may be stored as 8 bytes, based on an int (4 bytes).

[0219] According to one embodiment, the electronic device (101) can determine the location of a metadata structure for a recovery map within an image file through 'syncWord' of a metadata field (1705) within a custom area. For example, 'syncWord' can be used to indicate the location in a form such as 0x52656376, but this is merely an example and other values ​​may be used.

[0220] According to one embodiment, the 'Count' value of the metadata (1705) field may be used to determine how many recovery maps are stored for a certain number of regions (or target regions).

[0221] According to one embodiment, the 'recoveryMapOffset' of the metadata (1705) field may be used to identify the location of sub-metadata representing each region (or each of the target regions) within the image.

[0222] According to one embodiment, the sub metadata (1710) may be used to identify a multi-recovery map (or multi-recovery map information) corresponding to each region (or each target region).

[0223] According to one embodiment, the 'Count' value of the sub-metadata (1710) field may be used to check how many multi-recovery maps are stored.

[0224] According to one embodiment, the sub-metadata (1710) field may include a 'Region Type' (1715) indicating the type of the target area, for example, the location (or pixel location) of the target area (or object) within the image, and for example, the 'Region Type' (1715) field may include a 'Rectangle' (1720), a 'Point' (1725), or a 'Polygon' (1730). According to one embodiment, the location of the target area may be indicated using at least one of a 'Rectangle' (1720), a 'Point' (1725), or a 'Polygon' (1730), and the method of expressing the location is not limited thereto. According to one embodiment, the target region may correspond to an object in an image, and the sub-metadata (1710) field (or 'Region Type' (1715)) may further include items such as 'leftPosition', 'topPosition', 'rightPosition', and 'bottomPosition' to indicate the pixel location of the object in the image through said items.

[0225] According to one embodiment, the sub-metadata (1710) field may include a 'Preference Type' (1735) representing a person object preferred by the user, an 'Object Type' (1740) representing an object object, and a 'Recovery Type' (1745) representing a recovery map type.

[0226] The structure of the sub-metadata (1710) of FIG. 17a can be schematically represented as shown in FIG. 17b. FIG. 17b is a diagram showing the sub-metadata of an image file according to one embodiment.

[0227] Referring to FIG. 17a and FIG. 17b, for example, when the 'count' field value in the sub-metadata (1710) field is 3, the sub-metadata (1710) may include three pieces of information such as RecoveryType[0], RecoveryType[1], and RecoveryType[2]. For example, Recovery 1 (1750) may correspond to the first area, Recovery 2 (1755) may correspond to the second area, and Recovery 3 (1760) may correspond to the third area.

[0228] According to one embodiment, the 'RecoveryType' (1745) field represents the target of the recovery map information, and may mean, for example, illuminance, saturation, zoom background, R channel information (R_Channel), G channel information (G_Channel), and B channel information (B_Channel). The information included in the 'RecoveryType' (1745) field may vary in addition to the values ​​(or information) defined above.

[0229] According to one embodiment, the electronic device (101) can determine which target the recovery map refers to through the 'RecoveryType' (1745) field. For example, if the value of the 'PreferenceType' (1735) field represents a pet, the 'PreferenceType' (1735) field may indicate that it is a recovery map for a pet. Of course, various values ​​(or information) can be added in addition to the value (or information) defined in the 'PreferenceType' (1735) field.

[0230] The electronic device (101) can determine which object the recovery map represents through the 'ObjectType' (1740) field. For example, if the value of the 'ObjectType' (1740) field represents a star, the 'ObjectType' (1740) field may indicate that it is a recovery map for a star. Also, if the value of the 'ObjectType' (1740) field represents a lion, the 'ObjectType' (1740) field may indicate that it is a recovery map for a lion.

[0231] The electronic device (101) can check the location of information for each region through the 'RegionOffset' field within the sub-metadata (1710) field and check the size of the target region information through the 'RegionSize' field. Additionally, the electronic device (101) can check the location of recovery map information through the information in the 'RecoveryOffset' field within the sub-metadata (1710) field and check the size of the recovery map information through the information in the 'RecoverySize' field.

[0232] The electronic device (101) can determine the location (or pixel location) of a target area (or object) within an image through the 'RegionType' (1715) field. For example, the location of the target area can be represented using at least one of 'Rectangle' (1720), 'Point' (1725), and 'Polygon' (1730), but the method of representing the location is not limited thereto. To examine each of the fields 'Rectangle' (1720), 'Point' (1725), and 'Polygon' (1730) in detail, it will be described with reference to FIGS. 17c through 17e.

[0233] FIG. 17c is a drawing for explaining a method for determining the location of a rectangular area within an image according to one embodiment.

[0234] According to one embodiment, if the value (or information) of the 'RegionType' (1715) field represents 'Rectangle', the coordinate position of the area within the image can be expressed through four values: left, top, right, and bottom, as shown in FIG. 17c. If the value (or information) of the 'RegionType' (1715) field represents 'Rectangle', the 'RegionSize' of the sub-metadata (1710) field is 4. The electronic device (101) can determine the position of the target area through the (left, top), (right, top), (left, bottom), and (right, bottom) coordinates, as shown in FIG. 17c. Accordingly, the electronic device (101) can determine the pixel position through the coordinates and can determine the pixel position corresponding to the image part to be reinforced, that is, the target area within the original image.

[0235] FIG. 17d is a drawing for explaining a method for determining the location of a point area within an image according to one embodiment.

[0236] According to one embodiment, when the value (or information) of the 'RegionType' (1715) field represents 'Point', the location of the target area within the image can be expressed as (x, y) coordinates, as shown in FIG. 17d. When the value (or information) of the 'RegionType' (1715) field represents 'Point' and 'RegionSize' is 12, the location of the target area can be expressed with a total of 6 (x, y) pieces of information.

[0237] FIG. 17e is a drawing for explaining a method for determining the location of a polygon area within an image according to one embodiment.

[0238] According to one embodiment, when the value (or information) of the 'RegionType' (1715) field indicates 'Polygon', the location of the target area within the image can be represented as a polygon based on (x, y) coordinates, as shown in FIG. 17e. When the value of the 'RegionType' (1715) field indicates 'Polygon' and 'RegionSize' is 10, the location of the target area within the image can be represented as a polygon using a total of 5 (x, y) pieces of information.

[0239] Multi-recovery maps are stored to correspond to each region within the image in the structure described above, and a number of multi-recovery maps and original images determined for each region can be stored as a single image file, and the structure of the image file is as shown in FIG. 18.

[0240] FIG. 18 is a diagram showing a multi-recovery map stored in a file format (e.g., JPEG) according to one embodiment.

[0241] According to one embodiment, when there are multiple target areas for changing at least one of brightness, saturation, or color within an image acquired during shooting, multiple recovery maps for causing at least one of brightness, saturation, or color to change multiple times over time for each of the target areas may be stored together with the image in the form of a single image file as shown in FIG. 18. FIG. 18 illustrates JPEG as an example of an image file format, but the image file format may vary, such as HEIF, AVIF, and PNG.

[0242] Referring to FIG. 18, the image file (1800) may include a plurality of recovery map fields corresponding to each of a plurality of target regions (e.g., Region 1 recovery map (1806), Region 2 recovery map (1807), Region 3 recovery map (1808)), and a metadata field (1805) for the plurality of recovery map fields. As illustrated in FIG. 18, the image file (1800) includes a custom (or custom data) region (1802), and the custom region (1802) may include a plurality of recovery map fields (e.g., Region 1 recovery map (1806), Region 2 recovery map (1807), Region 3 recovery map (1808)) and a metadata field (1805).

[0243] According to one embodiment, each of the plurality of recovery map fields (e.g., Region 1 recovery map (1806), Region 2 recovery map (1807), Region 3 recovery map (1808)) may include a plurality of recovery maps corresponding to the region and a sub-metadata field for the plurality of recovery maps corresponding to the region. For example, if the Region 1 recovery map (1806) represents a recovery map for a baby face region, it may include a sub-metadata field for the purpose of indicating how many recovery maps are stored to correspond to the baby face region.

[0244] According to one embodiment, the sub-metadata field (1810) may include the number of recovery maps corresponding to the region, information about the location of the region, and information about at least one of brightness, saturation, or color of the region. For example, if the Region 1 recovery map (1806) represents a recovery map for the baby face region, the electronic device (101) can confirm that a total of four recovery maps (1811, 1812, 1813, 1814) are stored corresponding to Region 1 (e.g., baby face region) by checking the sub-metadata field (1810).

[0245] FIG. 19 is a diagram illustrating a method for determining the number of multi-recovery maps in an image file according to one embodiment. To aid in understanding the explanation of FIG. 19, FIG. 18 may be referenced.

[0246] Referring to FIG. 19, in operation 1905, the electronic device (101) can obtain metadata information. In response to receiving an input (e.g., user input) for displaying an image stored in the form of an image file, the electronic device (101) can identify the plurality of recovery maps (e.g., Region 1 recovery map (1806), Region 2 recovery map (1807), Region 3 recovery map (1808)) based on the metadata (1805) fields included in the image file (1800) of FIG. 18.

[0247] In operation 1910, the electronic device (101) can determine the number of total regions. For example, the electronic device (101) can determine the multiple regions (e.g., Region 1, Region 2, Region 3) to which the multiple recovery maps are to be applied, in response to determining the multiple recovery maps (e.g., Region 1, Region 2, Region 3)

[0248] The electronic device (101) can obtain sub-metadata information in operation 1915. In operation 1920, the electronic device (101) can check the number of recovery maps for each area.

[0249] For example, the electronic device (101) can identify a plurality of recovery maps corresponding to each of the identified plurality of regions based on the sub-metadata (1810) field. For example, the electronic device (101) can identify four recovery maps corresponding to Region 1, and in the same way, can identify how many recovery maps correspond to Regions 2 and 3, respectively.

[0250] The electronic device (101) can sequentially display multiple images in which the identified multiple recovery maps are applied to the image and the identified multiple regions during a set time.

[0251] As described above, when displaying a stored image, the electronic device can check the information of multiple recovery maps for each region within the image file in the order of operation as shown in FIG. 19.

[0252] FIG. 20 is a diagram illustrating a method for outputting an image with a multi-recovery map applied according to one embodiment. To facilitate understanding of the description of FIG. 20, the explanation will be described with reference to FIG. 21 and FIG. 22. FIG. 21 is a diagram illustrating an example of mapping a multi-recovery map to each area according to one embodiment, and FIG. 22 is an example diagram illustrating a case where images with a multi-recovery map applied according to one embodiment are output sequentially.

[0253] Referring to FIG. 20, when an image stored in memory (330) is selected to be displayed via a display (360) in operation 2005, the electronic device (101) can check whether there is a recovery map to be applied to the original image in operation 2010. For example, the electronic device (101) can check whether there is a recovery map to be applied to the image by checking the information contained in the metadata field based on the structure of the image file as shown in FIG. 18.

[0254] According to one embodiment, if there is no recovery map to apply to the original image, a representative image may be output in the 2015 operation. According to one embodiment, at the end of the display of enhanced images with the recovery map applied together with the original image, the representative image may be finally displayed.

[0255] On the other hand, if there is a recovery map to be applied to the original image, the electronic device (101) can apply the recovery map to the corresponding area in operation 2020. For example, the electronic device (101) can determine how many recovery maps there are by checking the information (e.g., count) included in the sub-metadata field. For example, the electronic device (101) can check four recovery maps corresponding to Region 1 as shown in FIG. 201, three recovery maps corresponding to Region 2, and two recovery maps corresponding to Region 3.

[0256] In operation 2025, you can wait for a set period after the image output. In operation 2030, you can check whether the image output with the recovery map applied has finished. If the image output with the recovery map applied has not finished, you can return to operation 2010 and repeat the aforementioned operation.

[0257] Referring to FIG. 21, according to one embodiment, the electronic device (101) can determine the number of multi-recovery maps for each region (Region 1, 2, 3), for example, that there are a total of 12 multi-recovery maps.

[0258] According to one embodiment, the electronic device (101) can generate and sequentially display images in which different multi-recovery maps are applied to each region (Region 1, 2, 3) within the original image (2201) as shown in FIG. 22. The electronic device (101) can generate images in which nine multi-recovery maps are applied to the corresponding regions within the image after outputting (or displaying) the original image (2201), and output (or display) the generated images sequentially at regular time intervals. For example, images (2202, 2203, 2204, 2205) with four multi-recovery maps applied to a first region (e.g., Region 1) within the original image (2201) may be generated, images (2206, 2207, 2208) with three multi-recovery maps applied to a second region (e.g., Region 2) may be generated, and images (2209, 2210) with two multi-recovery maps applied to a third region (e.g., Region 3) may be generated. As described above, according to one embodiment, the image can be further enhanced by applying nine multi-recovery maps after outputting the original image. Here, if the time interval is 30 ms, the original image and the images with nine recovery maps applied may be displayed (or shown) for a set time (e.g., about 300 ms).

[0259] According to one embodiment, the image currently being output may be output in a different way. For example, when a user selects a different image or runs a different application, the change in the image to which the recovery map has been applied can be controlled to be output more actively by taking into account the execution time (e.g., transition time).

[0260] FIG. 23 is a diagram illustrating a method for outputting images to which a multi-recovery map considering transition time is applied according to one embodiment. To aid in understanding the explanation of FIG. 23, the explanation will be described with reference to FIG. 24. FIG. 24 is an example diagram illustrating a case in which images to which a multi-recovery map considering transition time is applied is output sequentially according to one embodiment.

[0261] Referring to FIG. 23, in operation 2305, the electronic device (101) can detect a transition event in operation 2310 when selecting an image for displaying an image stored in memory (330). For example, the electronic device (101) can check whether a transition event occurs due to the selection of another image or the execution of another application while the original image is displayed.

[0262] If it is confirmed that a transition event has occurred, the electronic device (101) can check the transition time in operation 2315. For example, if the electronic device (101) checks the transition time and determines a set transition time (e.g., 200ms), it can check in operation 2320 whether there is a recovery map to be applied to the original image. If there is no recovery map to be applied to the original image, the above operation is terminated, and if there is a recovery map to be applied to the original image, the recovery map is applied to the corresponding area in operation 2325, and then in operation 2330, the device can wait after considering the transition time after outputting the image. The electronic device (101) can return to operation 2320 according to the transition time cycle to check if there is a recovery map to be applied to the original image, and if there is a recovery map, the device can repeat the operation of applying the recovery map to the corresponding area and outputting it. For example, as illustrated in FIG. 24, when displaying the original image and images with nine recovery maps applied, images (2402, 2403, 2404, 2405) with four multi-recovery maps applied to a first region (e.g., Region 1) within the original image (2401) may be created, images (2406, 2407, 2408) with three multi-recovery maps applied to a second region (e.g., Region 2) may be created, and images (2409, 2410) with two multi-recovery maps applied to a third region (e.g., Region 3) may be created. When the transition time is determined to be the first transition time (e.g., 200ms), a total of 10 images including the original image (2401) can be output (or displayed), so the original image and the images with 9 recovery maps applied are displayed sequentially at regular intervals (e.g., 20ms) during the set transition time (e.g., 200ms), after which another image corresponding to the transition event can be output or another application can be executed.

[0263] As described above, according to one embodiment, a transition effect can be provided by using the original image and images with a recovery map applied at a fixed time interval (e.g., 20 ms) that is modified considering the transition time. Accordingly, a screen transition effect without delay can be provided in terms of the user interface during the transition. Meanwhile, although the selection of another image or the execution of another application was described as an example of a transition event in the above description, the image output can be varied according to the folding angle by checking the amount of change in the folding angle of the foldable electronic device.

[0264] FIG. 25 is a diagram illustrating image recovery using a recovery map of another image according to one embodiment. To aid in understanding the explanation of FIG. 25, the explanation will be described with reference to FIG. 26. FIG. 26 is a diagram illustrating a method of outputting a recovered image using a recovery map of another image according to one embodiment.

[0265] Referring to FIG. 25, when an image for displaying an image stored in memory (330) is selected in operation 2505, the electronic device (101) can check the zoom image in operation 2510 and recover the background through a recovery map in operation 2515. For example, referring to 2600a in FIG. 26, when shooting, a zoom image (2605) corresponding to the zoom area according to the zoom function is acquired and stored among the entire image (2610), but when a recovery map for the zoom image (2605) is stored, the background image (2610) including the zoom image (2605) can be recovered using the recovery map. According to one embodiment, for areas other than the zoom area, the image can be recovered using a multi-recovery map.

[0266] In operation 2520, the electronic device (101) can add an area to the zoomed image (2605) as illustrated in 2600c by using a recovery map of another image containing multiple objects (2611, 2612, 2613) such as 2600b of FIG. 26. Accordingly, it can be restored and displayed in the form of a full image (2615) containing an added area (e.g., a background area) containing multiple objects (2611, 2612, 2613). According to one embodiment, by utilizing recovery map information of another image, an image containing various backgrounds can be restored, thereby enhancing the original image. According to one embodiment, by utilizing the preference type among the recovery map information, a recovery map corresponding to an image with high personal preference can be applied. Therefore, although the above description explains the restoration of a zoomed image corresponding to a zoom area as an example, it is of course possible to restore an image that reflects user preference for images other than zoomed images.

[0267] FIG. 27 is a diagram illustrating a method for setting a representative image according to one embodiment. To aid in understanding the explanation of FIG. 27, the explanation will be described with reference to FIG. 28. FIG. 28 is an example diagram illustrating a case where images with a multi-recovery map applied are sequentially output when a representative image is set according to one embodiment.

[0268] Referring to FIG. 27, in operation 2705, the electronic device (101) can perform image editing in operation 2710 after selecting an image. In response to image editing, in operation 2715, the electronic device (101) can perform an operation for preview verification. For example, when editing an image, the user can view an image with a multi-recovery map applied on the preview screen. In operation 2720, depending on the user's selection, the electronic device (101) can set a representative image. For example, the electronic device (101) can set a representative image using the 'representativeImage' information within the metadata (1705) field of FIG. 17a. If a 'representativeImage' using a multi-recovery map is not set, the value may be set to '-1'. Referring to FIG. 28, if the user determines the 6th image (2807) among the original image (2801) displayed through the preview screen and the 9 images (2802, 2803, 2804, 2805, 2806, 2807, 2809, 2810) to be the representative image, the user can set 'representativeImage = 6' and output the image (2807) as the representative image.

[0269] FIG. 29 is a drawing for explaining a method of generating a video using an original image according to one embodiment.

[0270] Referring to FIG. 29, in operation 2905, when an image is selected, the electronic device (101) can transmit it to the video encoder input in operation 2910. In operation 2915, the electronic device (101) checks whether there is a recovery map to apply to the original image, and if there is no recovery map to apply to the original image, it terminates the operation, and if there is a recovery map to apply to the original image, it can check the image with the recovery map applied in operation 2920. In operation 2925, the electronic device (101) checks whether there is an image with the same preference type, and if there is no image with the same preference type, it can terminate video encoding in operation 2930. On the other hand, if there is an image with the same preference type, the electronic device (101) can return to operation 2905 and transmit the image with the recovery map applied to the video encoder input.

[0271] According to one embodiment, referring to FIG. 17a, in order to determine whether there is an image with the same preference type in operation 2925, the electronic device (101) can check the 'Preference Type' (1735) of the sub-metadata (1710) field to identify a recovery map representing a user preference (e.g., pet). For example, images containing objects representing pets and images with multi-recovery maps applied can be transmitted as inputs to a video encoder. According to one embodiment, the electronic device (101) can check the user preference (e.g., pet) in other images using the 'Preference Type' (1735) included in the metadata of the recovery map, select the image, and additionally generate it as the next frame of the video. By repeating the above operation, the electronic device (101) can generate a video that is continuously output for images where the field value (or information) of the 'Preference Type' (1735) is the same.

[0272] According to one embodiment, when the 'Preference Type' (1735) included in the metadata of the recovery map for each image is checked, the electronic device (101) can create a video with a story by collecting only images with the same preference type. For example, frames can be constructed using a plurality of images to which a multi-recovery map is applied, in which at least one of the brightness, saturation, or color of said object changes over time, along with an original image containing an object representing a pet, and a video can be created using the constructed frames.

[0273] According to one embodiment, the electronic device (101) can generate a video using a selected image and a multi-recovery map. According to one embodiment, the electronic device (101) can generate a video by generating the next frame using the original image. For example, the electronic device (101) can select the original image and then generate the selected original image as the next frame of the video. By repeating the operation of continuously generating the next frame in this way, a video can be generated that is continuously output for images with the same 'Preference Type'. For example, the electronic device (101) can select the original image and pass it to the video encoder input, and then sequentially apply the multi-recovery map to pass images with the same 'Preference Type' to the video encoder input. Thus, a single video can be generated in which images with the original image and images to which the multi-recovery maps have been applied are sequentially output.

[0274] FIG. 30 is a drawing for explaining a method of selecting and sharing an image according to one embodiment.

[0275] Referring to FIG. 30, the electronic device (101) can check the ability of the device to deliver the image (e.g., the counterpart device) in operation 3010 if there is a sharing request after selecting an image in operation 3005. Here, the ability of the device to deliver the image (e.g., another device or counterpart device) can be indicated by checking information about multi-recovery maps included in the image file and generating images with multi-recovery maps applied based on information about multi-recovery maps.

[0276] According to one embodiment, by checking the ability of a device to transmit an image (e.g., a counterpart device), the electronic device (101) can check whether the other device supports a multi-recovery map in operation 3015.

[0277] According to one embodiment, if there is a request to share the selected image after the image has been selected, the electronic device (101) can verify the capabilities of the other device in various ways. For example, the electronic device (101) can verify this through a message transmitted from the other device (e.g., HTTP Request Header field information). The electronic device (101) can verify whether the other device supports a multi-recovery map by checking the Android version or specific keywords in the information within the message (e.g., HTTP Request Header User-Agent information). Additionally, the other device may store and transmit information specified within the message, and the electronic device (101) may verify whether the other device supports a multi-recovery map by checking the information specified within the message.

[0278] If the other device supports a multi-recovery map, the electronic device (101) in operation 3020 can transmit an image including the multi-recovery map. For example, if the other device supports a multi-recovery map, the other device can generate images with the multi-recovery maps applied based on information about the multi-recovery maps, so the image including the multi-recovery map can be transmitted.

[0279] For example, supporting a multi-recovery map means that metadata and sub-metadata defined for multi-recovery can be parsed and viewed on the other device.

[0280] On the other hand, if the other device does not support a multi-recovery map, the electronic device (101) can check in operation 3025 whether there is a request to apply a video effect. If there is a request to apply a video effect from the other device, the electronic device (101) can perform video encoding by applying a multi-recovery map in operation 3030. Accordingly, the electronic device (101) can provide the video-encoded file to the other device. For example, a request from the other device to apply a video effect may be to receive a video effect in which at least one of the brightness, saturation, or color of the target area of ​​the original image changes over time by sequentially displaying images with the multi-recovery map applied along with the original image. However, since the other device does not support a multi-recovery map, the electronic device (101) may encode and provide a video with the multi-recovery map applied on behalf of the other device.

[0281] On the other hand, if there is no request to apply video effects, the electronic device (101) can transmit only the representative image in the 3035 operation and delete the multi-recovery map. If there is no request to apply video effects, the electronic device (101) can check the representative image using metadata and transmit the image with the representative image effect applied.

[0282] According to one embodiment, visual effects can be provided by adjusting the color, brightness, saturation, etc. of at least one area (or at least one object) within an image, and the image can be displayed (or output) more naturally, thereby enhancing the user's emotions, immersion, and / or realism.

[0283] According to one embodiment, by using a multi-recovery map, dynamic image output and video effects using a single image may be applied when outputting an image.

[0284] According to one embodiment, a representative image can be set through editing, and GIFs and videos can also be generated using a single image.

[0285] According to one embodiment, in terms of sharing, after checking whether the device supports a multi-recovery map, multi-recovery information is transmitted together, thereby enabling the use of an image containing a multi-recovery map on other devices.

[0286] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0287] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0288] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0289] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0290] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0291] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0292] According to one embodiment, in a storage medium storing at least one instruction readable by a computer, the at least one instruction causes the electronic device (101) to perform at least one operation when executed by at least one processor (320) of the electronic device, and the at least one operation may include the operation of acquiring a first image through a camera of the electronic device.

[0293] According to one embodiment, the at least one operation may include an operation of identifying at least one region within the first image, and each of the at least one region may have at least one of brightness, saturation, or color changed.

[0294] According to one embodiment, the at least one operation may include an operation of checking a plurality of recovery maps. According to one embodiment, each of the plurality of recovery maps may include information regarding the location of a corresponding area among the at least one area, and information for changing at least one of brightness, saturation, or color for the corresponding area among the at least one area.

[0295] According to one embodiment, the at least one operation may include the operation of storing an image file comprising the first image and the plurality of recovery maps.

Claims

1. In an electronic device (101), Camera (380); At least one processor (320); and It includes a memory (330) for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, A first image is obtained through the above camera, and At least one region within the first image is identified, and each of the at least one region has at least one of brightness, saturation, or color changed, and A plurality of recovery maps are checked, and each of the plurality of recovery maps includes information regarding the location of a corresponding area among the at least one area and information for changing at least one of brightness, saturation, or color of the corresponding area among the at least one area. An electronic device for storing an image file including the first image and the plurality of recovery maps.

2. In paragraph 1, when the instructions are executed individually or collectively by the at least one processor, the electronic device, In response to an input for displaying the image file stored in the memory, a plurality of images are generated, and Each of the above plurality of images is generated by applying one of the plurality of recovery maps to the first image included in the image file, and An electronic device configured to display a second image corresponding to a first image to which one of the plurality of images is applied.

3. In claim 1 or 2, when the instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device configured to sequentially display a plurality of images such that at least one of the brightness, saturation, or color of at least one region within the first image is changed multiple times over time.

4. In any one of paragraphs 1 to 3, the at least one region includes a plurality of regions to which each of the respective plurality of recovery maps is applied, and The above image file includes a plurality of recovery map fields corresponding to each of the plurality of regions, and a metadata field for the plurality of recovery map fields. Each of the above plurality of recovery map fields includes a plurality of recovery maps corresponding to the area and a sub-metadata field for the plurality of recovery maps corresponding to the area, and The above sub-metadata field comprises the number of multiple recovery maps corresponding to the area, information about the location of the area, and information for changing at least one of the brightness, saturation, or color of the area, in an electronic device.

5. In any one of claims 1 to 4, when the instructions are executed individually or collectively by the at least one processor, the electronic device, In response to an input for displaying the image file stored in the memory, the plurality of recovery maps are identified based on the metadata fields included in the image file, and In response to verifying the plurality of recovery maps mentioned above, a plurality of areas to which the plurality of recovery maps are to be applied are identified, and Based on the above sub-metadata field, identify a plurality of recovery maps corresponding to each of the identified plurality of regions, and An electronic device configured to sequentially display a plurality of images in which the plurality of identified recovery maps are applied to the first image and the plurality of identified regions during a set time.

6. In any one of claims 1 to 5, when the instructions are executed individually or collectively by the at least one processor, the electronic device, The first image and the plurality of images are displayed sequentially at regular time intervals within the set time, and An electronic device configured to sequentially display the first image and the plurality of images at regular time intervals within the changed time when the set time is changed.

7. In any one of claims 1 to 6, when the instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device configured to identify at least one region by recognizing at least one object included in the first image.

8. In any one of claims 1 to 7, when the instructions are executed individually or collectively by the at least one processor, the electronic device, When acquiring the first image through the camera, setting information related to at least one of the preferred location or preferred object according to user preference is checked, and An electronic device configured to identify at least one region by determining to generate the plurality of recovery maps based on the above configuration information.

9. In any one of claims 1 through 8, when the instructions are executed individually or collectively by the at least one processor, the electronic device, When acquiring the first image through the camera, information related to at least one of whether a focus function is performed, whether a zoom function is performed, whether a flash is used, or the illuminance of the first image is checked, and An electronic device configured to identify at least one region by determining to generate the plurality of recovery maps based on the above-mentioned confirmed information.

10. In any one of claims 1 to 9, when the instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device configured to check the brightness or saturation of the first image and, based on the checked brightness or saturation, determine the plurality of recovery maps for the at least one region.

11. A method for providing an enhanced image in an electronic device, The operation of acquiring a first image through the camera of the electronic device; An operation of identifying at least one region within the first image; each of the at least one region has at least one of brightness, saturation, or color changed, and An operation of checking a plurality of recovery maps; each of the plurality of recovery maps includes information regarding the location of a corresponding area among the at least one area and information for changing at least one of brightness, saturation, or color for the corresponding area among the at least one area, and A method for providing an enhanced image, comprising the operation of storing an image file including the first image and the plurality of recovery maps.

12. In Paragraph 11, An operation to generate a plurality of images in response to an input for displaying the above-stored image file; each of the plurality of images is generated by applying one of the plurality of recovery maps to the first image included in the image file, and A method for providing an enhanced image, further comprising the operation of displaying a second image corresponding to the first image to which one of the plurality of images is applied.

13. In paragraph 11 or 12, the plurality of images are, A method for providing an enhanced image, wherein at least one of the brightness, saturation, or color of at least one region within the first image is displayed sequentially as if changing multiple times over time.

14. In any one of paragraphs 11 through 13, The above at least one region includes a plurality of regions to which each of the plurality of recovery maps is applied, and The above image file includes a plurality of recovery map fields corresponding to each of the plurality of regions, and a metadata field for the plurality of recovery map fields. Each of the above plurality of recovery map fields includes a plurality of recovery maps corresponding to the area and a sub-metadata field for the plurality of recovery maps corresponding to the area, and A method for providing an enhanced image, wherein the above sub-metadata field includes the number of multiple recovery maps corresponding to the area, information about the location of the area, and information for changing at least one of the brightness, saturation, or color of the area.

15. In a storage medium storing at least one instruction readable by a computer, the at least one instruction causes the electronic device (101) to perform at least one operation when executed by at least one processor (320) of the electronic device, and the at least one operation is, The operation of acquiring a first image through the camera of the electronic device; An operation of identifying at least one region within the first image; each of the at least one region has at least one of brightness, saturation, or color changed, and An operation of checking a plurality of recovery maps; each of the plurality of recovery maps includes information regarding the location of a corresponding area among the at least one area and information for changing at least one of brightness, saturation, or color for the corresponding area among the at least one area, and A storage medium comprising the operation of storing an image file including the first image and the plurality of recovery maps.

Images