Electronic device for changing preview image during image photographing, method thereof, and non-transitory computer-readable storage medium

Abstract

Disclosed is an electronic device. The electronic device may acquire a preview image including a first object and a second object through an image sensor. The electronic device may display the preview image as a preview, through the display. The electronic device may receive a user input for the preview image for requesting a target image generated by a plurality of images obtained through the image sensor. In response to the user input, the electronic device may generate an image including the first object and the second object, on the basis of the preview image. While the target image is generated by the plurality of images, the electronic device may display the image through the display by changing the brightnesses of the first object and the second object at different speeds.

Description

Electronic device, method, and non-transient computer-readable storage medium for changing a preview image during image capture

[0001] The following descriptions relate to an electronic device, a method, and a non-transient computer-readable storage medium for changing a preview image during image capture.

[0002] With the recent development of digital technology, various types of electronic devices such as mobile communication terminals, smartphones, tablet PCs, personal digital assistants (PDAs), electronic notebooks, notebooks, or wearable devices are widely used.

[0003] The electronic device may include a camera module. For example, the electronic device may output a preview image acquired from the camera module to a display and take a photograph in response to a touch input to the shutter button. The electronic device may acquire multiple images in a low-light environment and generate a single composite image through the acquired multiple images. The electronic device may display a preview image while generating a single composite image in a low-light environment.

[0004] An electronic device is disclosed. The electronic device may include at least one processor comprising an image sensor, a display, and a processing circuit, and a memory comprising one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to acquire a preview image comprising a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the preview image to be displayed as a preview through the display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive user input regarding the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to generate an image including the first object and the second object based on the preview image in response to the user input. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the image to be displayed through the display by changing the brightness of the first object and the second object at different rates while generating the target image from the plurality of images.

[0005] An electronic device is disclosed. The electronic device may include an image sensor, a display including a touch-sensitive circuit, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to acquire a preview image including a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to display the preview image as a preview through the display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive user input regarding the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the preview image to be displayed through the display by adjusting the first brightness of the first object and the second brightness of the second object while the target image is generated by the plurality of images.

[0006] A method is disclosed. The method may be performed by an electronic device comprising a camera and a display. The method may include an operation of displaying a screen of a camera application through the display. The method may include an operation of receiving an input requesting an image generated by a plurality of images through the camera while displaying the screen. The method may include an operation of displaying the preview image through the display by changing the brightness of at least two parts of the preview image at different rates while generating the image by the plurality of images obtained in response to the input.

[0007] A method is disclosed. The method may be performed by an electronic device comprising an image sensor and a display comprising a touch-sensitive circuit. The method may include an operation of acquiring a preview image comprising a first object and a second object through the image sensor. The method may include an operation of displaying the preview image as a preview through the display. The method may include an operation of receiving user input regarding the preview image requesting a target image generated by a plurality of images acquired through the image sensor. The method may include, while generating the target image by the plurality of images: displaying the preview image through the display by adjusting the first brightness of the first object, and displaying the preview image through the display by adjusting the first brightness of the first object and the second brightness of the second object.

[0008] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor of an electronic device comprising an image sensor and a display, the electronic device may cause the electronic device to acquire a preview image comprising a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the preview image to display as a preview through the display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive user input regarding the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to generate an image including the first object and the second object based on the preview image in response to the user input. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the image to be displayed through the display by changing the brightness of the first object and the second object at different rates while generating the target image from the plurality of images.

[0009] A non-transient computer-readable storage medium is disclosed. The non-transient computer-readable storage medium may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor of an electronic device comprising an image sensor and a display comprising a touch-sensitive circuit, the electronic device may cause the electronic device to acquire a preview image comprising a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the preview image to display as a preview through the display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive user input regarding the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the preview image to be displayed through the display by adjusting the first brightness of the first object and the second brightness of the second object while the target image is generated by the plurality of images.

[0010] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0011] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0012] FIG. 3a is a drawing illustrating a screen of a camera application of an electronic device according to one embodiment.

[0013] FIG. 3b is a drawing illustrating a preview image obtained by an electronic device according to one embodiment.

[0014] FIG. 3c is a drawing illustrating parts of a preview image acquired by an electronic device according to one embodiment.

[0015] FIG. 4 is a graph showing the brightness change of parts of a preview image that an electronic device changes according to one embodiment.

[0016] FIGS. 5a to 5d are drawings illustrating a change in brightness of a preview image displayed by an electronic device according to one embodiment.

[0017] FIG. 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0018] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0019] FIGS. 8a to 8d are drawings illustrating screens of a camera application for adjusting shooting time according to one embodiment.

[0020] Figure 9 is a diagram showing an example of comparison between a preview image and an expected target image in a low-light environment.

[0021] FIG. 10 is a drawing illustrating one or more layers applied to a preview image.

[0022] FIG. 11 is a diagram illustrating an image processing flow of an electronic device according to one embodiment.

[0023] FIG. 12 is a drawing illustrating a preview image generated by an electronic device according to one embodiment.

[0024] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.

[0025] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0026] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0027] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0028] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0029] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0030] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0031] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0032] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0033] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0034] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0035] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0036] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0037] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0038] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0039] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0040] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0041] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0042] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 664 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 6 ms or less) for realizing URLLC.

[0043] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0044] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0045] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0046] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0047] FIG. 2 is a block diagram of an electronic device according to one embodiment. FIG. 3a is a diagram illustrating a screen of a camera application of an electronic device according to one embodiment. FIG. 3b is a diagram illustrating a preview image acquired by an electronic device according to one embodiment. FIG. 3c is a diagram illustrating parts of a preview image acquired by an electronic device according to one embodiment. FIG. 4 is a graph showing the brightness change of parts of a preview image that are changed by an electronic device according to one embodiment. FIG. 5a to 5d are diagrams illustrating the brightness change of a preview image displayed by an electronic device according to one embodiment.

[0048] FIGS. 2 to 5d can be explained with reference to FIG. 1.

[0049] Referring to FIG. 2, the electronic device (101) may include a processor (120), memory (130), a display (260), and a camera (280). In one embodiment, the display (260) may correspond to the display module (160) of FIG. 1. In one embodiment, the camera (280) may correspond to the camera module (180) of FIG. 1.

[0050] In one embodiment, the memory (130) may include a camera application (210), an image processing model (220), and / or a device manager (230) as a program (140). In one embodiment, the camera application (210) may include a camera manager (211), a setting manager (213), and / or an overlay manager (215).

[0051] In one embodiment, an electronic device (101) (or a processor (120)) can execute a camera application (210). In one embodiment, referring to FIG. 3a, the electronic device (101) can display a screen of the camera application (210) through a display (260). In one embodiment, the screen of the camera application (210) may include visual objects (310, 311, 313) for one or more functions related to the camera application (210).

[0052] In one embodiment, the screen of the camera application (210) may include a visual object (310) representing a shutter button requesting a shot of the camera (280).

[0053] In one embodiment, the screen of the camera application (210) may include a preview area (320) in which a preview image is displayed. The preview image displayed in the preview area (320) may represent an image acquired by the camera (280) of the electronic device (101) in a low-light environment.

[0054] In one embodiment, the screen of the camera application (210) may include a visual object (311) indicating that it is a low-light shooting mode according to a low-light environment. In one embodiment, the screen of the camera application (210) may not include the visual object (311) when the environment is not a low-light environment (or when it is a normal shooting mode).

[0055] In one embodiment, the screen of the camera application (210) may include a visual object (313) indicating a shooting time (e.g., 4 seconds) set according to a low-light shooting mode according to a low-light environment. In one embodiment, the shooting time (e.g., 4 seconds) may be set by a user. In one embodiment, the shooting time (e.g., 4 seconds) may be determined by the performance and / or illumination of the electronic device (101).

[0056] Referring again to FIG. 2, in one embodiment, a camera manager (211) may perform control related to taking a photograph through a camera (280). In one embodiment, control related to taking a photograph may include setting a shooting mode of the camera (280) (e.g., taking a photograph, taking a video, taking a low-light photograph (or taking a night photograph)). In one embodiment, control related to taking a photograph may include driving the camera (280) (or acquiring an image). In one embodiment, control related to taking a photograph may include setting and / or applying shooting conditions of the camera (280) (or parameters of the camera (280)). In one embodiment, control related to taking a photograph may include saving a photograph acquired through the camera (280). Control related to taking a photograph may include turning on and / or turning off the camera (280).

[0057] In one embodiment, the camera manager (211) may determine whether to set up low-light shooting (or night shooting) based on the intensity of external light (or illuminance) received through the camera (280) and / or sensor module (e.g., 176 in FIG. 1). In one embodiment, the camera manager (211) may change to a mode for low-light shooting (or night shooting) based on the fact that the illuminance outside the electronic device (101) is below a reference illuminance. In one embodiment, the electronic device (101) may stop changing to a mode for low-light shooting (or night shooting) based on the fact that the illuminance outside the electronic device (101) is below a reference illuminance.

[0058] In one embodiment, the camera manager (211) can identify an input. In one embodiment, the camera manager (211) can identify a touch input to a visual object (310) through a touch-sensitive circuit within the display (260).

[0059] In one embodiment, the camera manager (211) may initiate photography in response to identifying a touch input to a visual object (310). For example, the camera manager (211) may initiate photography based on a shooting mode in response to identifying a touch input to a visual object (310). For example, the camera manager (211) may initiate photography based on low-light shooting (or night shooting) according to the external illumination of the electronic device (101).

[0060] In one embodiment, the camera manager (211) can acquire an image to be displayed in the preview area (320) through the camera (280). In one embodiment, the camera manager (211) can acquire an image to be displayed in the preview area (320) through the camera (280) in response to identifying a touch input to the visual object (310). In one embodiment, the camera manager (211) can acquire an image to be displayed in the preview area (320) through the camera (280) via a specified high sensitivity in response to identifying a touch input to the visual object (310) requesting low-light shooting. For example, referring to FIG. 3b, the image (330) acquired via the specified high sensitivity may be a bright image. However, it is not limited thereto. For example, the image (330) may be an image acquired while a light source (or flash) for changing external illumination is turned on. For example, the image (330) may be an image generated from a preview image displayed in a preview area (320) prior to a touch input to a visual object (310). For example, the image (330) may be an image previously acquired at a location (or composition) where the electronic device (101) is located. For example, the previously acquired image may be an image already stored within the electronic device (101). For example, the previously acquired image may be an image acquired by the electronic device (101) from a server (108).

[0061] In one embodiment, the camera manager (211) may display an image (330) in a preview area (320). In one embodiment, the camera manager (211) may remove noise from the preview image and display the noise-removed image (330) in the preview area (320). In one embodiment, the image (330) may be an image that is brighter than the preview image (e.g., the preview image of FIG. 3a) displayed in the preview area (320) before identifying touch input to the visual object (310) in a low-light environment. In one embodiment, the image (330) may have a brightness corresponding to the composite image obtained in a low-light environment. In one embodiment, the composite image obtained by shooting in a low-light environment (or night shooting) may be an image composited from a plurality of images obtained through different setting values ​​for the camera (280).

[0062] In one embodiment, the camera manager (211) may provide information about a setting value (or shooting condition) (or parameter of the camera (280)) for the camera (280) to the setting manager (213) and / or image processing model (220). In one embodiment, the setting value (or shooting condition) (or parameter of the camera (280)) for the camera (280) may include sensitivity (or ISO (International Organization for Standardization) sensitivity), shutter speed, exposure value (EV), focus, F-value, brightness value (BV), and / or white balance (WB).

[0063] In one embodiment, the setting manager (213) may acquire (or receive) basic data for generating setting information (or setting data) required by the overlay manager (215). For example, the setting information (or setting data) required by the overlay manager (215) may be setting information (or setting data) for setting a change in brightness of an image (330) displayed in a preview area (320).

[0064] In one embodiment, the setting manager (213) may receive an image (330) from the camera manager (211). In one embodiment, the setting manager (213) may receive information regarding shooting conditions (or parameters of the camera (280)) from the camera manager (211). In one embodiment, the setting manager (213) may receive information regarding the status of the electronic device (101) from the device manager (230). In one embodiment, the status of the electronic device (101) may include information regarding resources in use and / or available resources of the processor (120) and / or memory (130). However, it is not limited thereto. For example, the state of the electronic device (101) may include the physical state of the electronic device (101) (e.g., in the case of a foldable display, whether the display (260) is folded) (e.g., the temperature of the electronic device (101), the charge amount of the electronic device (101)).

[0065] In one embodiment, the setting manager (213) may receive information about one or more images acquired by the camera (280) from the camera manager (211). In one embodiment, the setting manager (213) may receive information about an image (330) acquired by the camera (280) from the camera manager (211). For example, information about the image may include the composition of the image (e.g., histogram (e.g., information about the image's contrast, brightness, and / or color distribution), objects (or segmented objects), or semantic information (e.g., landscape photos, group photos, family photos, or animal photos, etc.). For example, information about the image may include depth values ​​for each of one or more objects included in the image. In one embodiment, the depth value may represent the distance between the electronic device (101) and the object identified through a depth sensor (e.g., a ToF (time of flight) sensor). For example, information about the image may be obtained by analyzing the image (330) through an artificial intelligence module. In one embodiment, the artificial intelligence module may be a transformer-based artificial intelligence module. In one embodiment, the artificial intelligence module may be a large language model-based artificial intelligence module.

[0066] In one embodiment, the setting manager (213) can identify the expected shooting time. In one embodiment, the setting manager (213) can identify the expected shooting time for low-light shooting (or night shooting). In one embodiment, the expected shooting time may be determined based on the performance of the electronic device (101). For example, the expected shooting time may include the shooting time of a plurality of photos to be acquired through the camera (280). For example, the expected shooting time may include the shooting time of a plurality of photos required based on the external illumination of the electronic device (101) in low-light shooting. For example, the expected shooting time may include the expected image processing time for a plurality of photos of the image processing model (220). For example, the expected image processing time for a plurality of photos of the image processing model (220) may be determined based on the number and / or size of the plurality of photos. For example, the estimated image processing time for a plurality of photos of the image processing model (220) may be determined based on the computational performance of the processor (120) (e.g., a graphics processing unit, and / or a neural network processing unit) and overhead (e.g., load related to the processor (120) and / or memory (130)). For example, image processing for a plurality of photos may include processing to generate a single image through the plurality of photos. For example, the estimated shooting time may be determined within the maximum time allowed by the electronic device (101) (or camera manager (211)). However, it is not limited thereto. For example, the estimated shooting time may be determined based on the user's settings. In one embodiment, the estimated shooting time may be determined as the longer of the time determined based on the user's settings or the performance of the electronic device (101). In one embodiment, the estimated shooting time may be determined as the shorter of the time determined based on the user's settings or the performance of the electronic device (101).

[0067] In one embodiment, the setting manager (213) can identify two or more parts to which a brightness change is to be applied based on the image (330). In one embodiment, each of the two or more parts may include any one of the objects (e.g., a person, object, animal, or building). In one embodiment, each of the two or more parts may be a landscape and / or background part of the image (330).

[0068] For example, referring to FIG. 3c, the setting manager (213) can identify parts containing people (340) and / or objects (351, 353, 355) within the image (330) as parts to which a brightness change is to be applied. For example, the setting manager (213) can determine setting information for parts containing people (340) and / or objects (351, 353, 355) within the image (330). For example, the setting manager (213) can determine information regarding the operation time of the brightness change for parts containing people (340) and / or objects (351, 353, 355). For example, the setting manager (213) can determine information regarding the initial brightness and / or final brightness of parts containing people (340) and / or objects (351, 353, 355). For example, the setting manager (213) can determine information regarding the rate (or pattern) of brightness change of parts including a person (340) and / or objects (351, 353, 355), respectively. According to an embodiment, the setting manager (213) can identify parts of a person (340) or objects (351, 353, 355) within the image (330) as parts to which brightness change is to be applied.

[0069] In one embodiment, the initial brightness may be lower than the original brightness of the image (330). In one embodiment, the initial brightness may be determined based on external illumination and / or brightness set on the display (260). For example, the initial brightness may be determined based on the size of the display (260) (or the size of the preview area). In one embodiment, the final brightness may have the original brightness of the image (330).

[0070] For example, referring to FIG. 3c, the setting manager (213) can identify at least some of the regions (361, 363, 365, 367) within the image (330) as areas to which a brightness change is to be applied. For example, the setting manager (213) can determine setting information for at least some of the regions (361, 363, 365, 367). For example, the setting manager (213) can determine information regarding the operation time of the brightness change for at least some of the regions (361, 363, 365, 367). For example, the setting manager (213) can determine information regarding the initial brightness and / or final brightness of at least some of the regions (361, 363, 365, 367). For example, the setting manager (213) can determine information about the rate (or pattern) of brightness change (or color change) of at least some of the regions (361, 363, 365, 367). For example, the brightness change (or color change) may represent the rate of change of pixel values ​​(or pixel values ​​representing brightness) (or pixel values ​​representing color) over time.

[0071] According to an embodiment, the setting manager (213) may identify a portion containing at least one object (e.g., 340) and at least one area (e.g., 363) within the image (330) as the portion to which a brightness change is to be applied. For example, the setting manager (213) may identify any one of the objects (e.g., person (340), and / or things (351, 353, 355)), and / or areas (361, 363, 365, 367) within the image (330) to which a brightness change is to be applied, depending on the composition and / or depth of the image (330). For example, if the image (330) is a portrait, the setting manager (213) may identify an object representing the nearest person and a background area around the object as the portion to which a brightness change is to be applied within the image (330). For example, if the image (330) is a landscape photograph, the setting manager (213) can identify areas close to the center of the image (330) as areas to which a brightness change will be applied.

[0072] In one embodiment, the setting manager (213) can identify brightness change patterns to be applied to two or more parts based on the image (330). In one embodiment, the setting manager (213) can identify brightness change patterns to be applied to two or more parts based on the estimated shooting time. In one embodiment, the brightness change pattern may represent a brightness change rate along a linear (e.g., predefine interpolator), gradient, or curve.

[0073] In one embodiment, the setting manager (213) may determine the rate of change in brightness of two or more parts as the rate of change according to any one of the brightness change patterns. For example, referring to FIG. 4, in the brightness change pattern (415) exemplified in graph (410), the rate of change in brightness may gradually increase from the beginning and gradually decrease in the later part. For example, in the brightness change pattern (425) exemplified in graph (420), the rate of change in brightness may gradually increase. For example, in the brightness change pattern (435) exemplified in graph (430), the rate of change in brightness may rapidly increase and then decrease. For example, in the brightness change pattern (435) exemplified in graph (430), there may be at least some time intervals where the brightness change is higher than the last brightness change. For example, in the brightness change pattern (445) exemplified in graph (440), the rate of change in brightness may gradually decrease. For example, the rate of change in brightness of the brightness change pattern (455) exemplified in the graph (450) may be constant. For example, the rate of change in brightness may be the slope of each of the brightness change patterns (415, 425, 435, 445, 455). For example, the rate of change in brightness may correspond to the rate of change of the pixel value (or the pixel value representing brightness) over time. Although the brightness change patterns (415, 425, 435, 445, 455) have been described above, the setting manager (213) may determine the rate of change in color of two or more parts in the same way as the rate of change according to any one of the color change patterns.

[0074] In one embodiment, the setting manager (213) may determine brightness change patterns corresponding to each of the depths of two or more parts of the image (330). For example, the setting manager (213) may determine the brightness change patterns of two or more parts based on brightness change patterns that are each set for the depths. For example, the setting manager (213) may determine the brightness change patterns of two or more parts of the image (330) so that they become brighter as the depth increases.

[0075] In one embodiment, the setting manager (213) may determine brightness change patterns corresponding to each of the sizes of two or more parts of the image (330). For example, the setting manager (213) may determine the brightness change patterns of two or more parts based on brightness change patterns set for each of the sizes. For example, the setting manager (213) may determine the brightness change patterns of two or more parts of the image (330) so that they become brighter faster as the size increases.

[0076] In one embodiment, the setting manager (213) may determine brightness change patterns corresponding to each of the locations of two or more parts of the image (330). For example, the setting manager (213) may determine the brightness change patterns of two or more parts based on brightness change patterns that are each set for the locations. For example, the setting manager (213) may determine the brightness change patterns of two or more parts of the image (330) so that the closer the location is to the center of the image (330), the faster it becomes brighter. For example, the setting manager (213) may determine the brightness change patterns of two or more parts of the image (330) so that a specific part within the image (330) (e.g., a wall (e.g., areas (365, 367) in FIG. 3c)) becomes brighter first, and another specific part (e.g., a floor (e.g., area (363) in FIG. 3c))) becomes brighter.

[0077] In one embodiment, the setting manager (213) can determine brightness change patterns corresponding to each of the objects of two or more parts of the image (330). For example, the setting manager (213) can determine the brightness change patterns of two or more parts based on the brightness change patterns that are each set for the objects.

[0078] In one embodiment, the setting manager (213) may generate setting information (or setting data) based on shooting conditions (or parameters of the camera (280). In one embodiment, the setting manager (213) may set the initial brightness of two or more parts of the image (330) where the brightness changes based on shooting conditions (or parameters of the camera (280). In one embodiment, the setting manager (213) may set the initial brightness of two or more parts based on brightness (BV) and / or white balance (WB). In one embodiment, the setting manager (213) may set the initial brightness of two or more parts higher as the brightness (BV) and / or white balance (WB) increases, but is not limited thereto. In one embodiment, the setting manager (213) may set the initial brightness of two or more parts lower as the depth value increases (or as it moves further away from the electronic device (101)).

[0079] In one embodiment, the setting manager (213) may generate setting information (or setting data) based on information regarding the expected shooting time. In one embodiment, the setting manager (213) may determine a time interval in which the brightness of two or more parts of the image (330) changes within the expected shooting time. In one embodiment, the setting manager (213) may determine different time intervals in which the brightness of two or more parts changes within the expected shooting time. For example, the setting manager (213) may determine that the brightness of the first part among the two or more parts changes from the start of shooting, and the brightness of the second part changes from after a specified time.

[0080] In one embodiment, the overlay manager (215) can initialize (or remove) a layer (or overlay layer). For example, the overlay manager (215) can initialize (or remove) the settings of a layer applied in a previous shot. For example, if a layer applied in a previous shot exists, the overlay manager (215) can set the transparency of the layer to 0 (or completely transparent). For example, the overlay manager (215) can set the transparency of the layer to 0 (or completely transparent) by setting a setting related to the transparency of the layer (e.g., a visibility attribute) to invisible or gone. For example, the overlay manager (215) can set the transparency of the layer to 0 (or completely transparent) by setting another setting related to the transparency of the layer (e.g., an alpha value) to 0. For example, the electronic device (101) may add a layer with a transparency of 0 (or completely transparent) if there is no layer applied in a previous shot. In one embodiment, the overlay manager (215) may create the layer in advance (e.g., before touch input to the visual object (310)). In one embodiment, the overlay manager (215) may create a new image to be input to the pre-created layer each time a shot is taken.

[0081] In one embodiment, the overlay manager (215) may overlay an overlay layer on an image (330) displayed in a preview area (320). For example, the overlay manager (215) may overlay an overlay layer on two or more parts of the image (330). For example, the overlay manager (215) may change the brightness of two or more parts of the image (330) visible to the user through the display (260) by changing the transparency (or color) (or brightness) of the overlay layer overlaid on two or more parts of the image (330). For example, the rate according to the brightness change pattern may be the rate of change of the transparency (or color) (or brightness) of the overlay layer overlaid on two or more parts of the image (330). In one embodiment, the overlay manager (215) can control the brightness of an overlay layer superimposed on two or more parts of an image (330) based on setting information from the setting manager (213). In one embodiment, while the camera manager (211) generates a composite image of low-light shooting using a plurality of images, the overlay manager (215) can change the brightness of an overlay layer superimposed on at least two parts of the image (330) to different brightness changes (or rates of change). In one embodiment, the overlay manager (215) can change the brightness of an overlay layer superimposed on two or more parts of the image (330) to rates of change according to specified brightness change patterns.

[0082] In one embodiment, the overlay manager (215) can change the brightness of an overlay layer superimposed on two or more parts of an image (330) during the expected shooting time. In one embodiment, the overlay manager (215) can change the brightness of an overlay layer superimposed on two or more parts of an image (330) during different time intervals within the expected shooting time.

[0083] In one embodiment, the overlay manager (215) can change the brightness of an overlay layer superimposed on two or more parts of an image (330) from an initial brightness to a final brightness using brightness change rates according to brightness change patterns. In one embodiment, the initial brightness of the preview area (320) by the image (330) and the overlay layer may be lower than the original brightness of the image (330). In one embodiment, the final brightness of the preview area (320) by the image (330) and the overlay layer may be the original brightness of the image (330).

[0084] In one embodiment, the overlay manager (215) can change the brightness of an overlay layer overlapping two or more parts of an image (330) visible to the user through the display (260) by changing the transparency (or color) (or brightness) of the overlay layer overlapping two or more parts of the image (330). For example, the rate according to the brightness change pattern may be the rate of change of the transparency (or color) (or brightness) of the overlay layer overlapping two or more parts of the image (330).

[0085] In one embodiment, referring to FIGS. 5a through 5d, the overlay manager (215) can change the brightness of an overlay layer superimposed on parts of an image (330) during an expected shooting time for taking a picture of a person (340). For example, referring to FIG. 5a, the overlay manager (215) can display an image (510) at a brightness corresponding to a preview image (e.g., a preview image displayed in the preview area (320) of FIG. 3a) before receiving input for taking a picture in a low-light environment. For example, the overlay manager (215) can display an image (510) at a brightness corresponding to a preview image (e.g., a preview image displayed in the preview area (320) of FIG. 3a) before receiving input for taking a picture in a low-light environment by superimposing a layer with changing brightness (or transparency) on the image (510). In one embodiment, the image (510) may be generated from a preview image. For example, the image (510) may be a preview image displayed in a preview area (320) prior to a touch input to a visual object (e.g., 310 in FIG. 3a).

[0086] In one embodiment, the overlay manager (215) can change the brightness of an overlay layer superimposed on parts including objects (e.g., object (340)) and / or regions within the image (510). For example, by adjusting the brightness (or transparency) of the layer superimposed on parts of the image (510) by the overlay manager (215), the user may perceive that the brightness of parts of the image (510) visible through the preview area (320) has been changed.

[0087] For example, the overlay manager (215) can change the brightness of the overlay layer overlaid on the object (313) among the parts within the image (510) to be brighter than the overlay layer overlaid on the background within the image (510). For example, referring to FIG. 5b, by changing the brightness of the overlay layer overlaid on the object (313), the user may perceive the brightness of the object (340) within the image (520) visible through the preview area (320) as being brighter than the initial brightness (e.g., the brightness of the image (510)). For example, the brightening of the overlay layer overlaid on the object (340) within the image (520) may include a rapid brightening at the beginning of the expected shooting time based on the rate of brightness change according to the brightness change patterns (435, 445) of FIG. 4. For example, the overlay manager (215) changes the brightness (or transparency) of the layer overlaid on the object (313) among the parts within the image (510) to be brighter than the brightness (or transparency) of the layer overlaid on the background within the image (510), so that the user can perceive that the brightness of the image (510) seen through the preview area (320) is changing.

[0088] For example, the brightness of the overlay layer superimposed on the background other than the object (340) in the image (520) may be similar to the initial brightness (e.g., the brightness of the image (510)) or slightly brighter. For example, the slight brightening of the brightness of the overlay layer superimposed on the background in the image (520) may include a slight brightening at the beginning of the expected shooting time based on the rate of brightness change according to the brightness change patterns (415, 425) of FIG. 4.

[0089] For example, referring to FIG. 5c, the brightness of an overlay layer superimposed on some objects (351, 353, 355) of the background other than the object (340) in the image (530) may be brighter than the initial brightness (e.g., the brightness of the image (510)). For example, the brightness of an overlay layer superimposed on some objects (351, 353, 355) of the image (530) may be brightened slightly at the beginning of the expected shooting time based on the brightness change rate according to the brightness change pattern (415) of FIG. 4. For example, the brightness of an overlay layer superimposed on some objects (351, 353, 355) of the image (530) may change at a different rate of change than the brightness of an overlay layer superimposed on the background other than some objects (351, 353, 355) of the image (530). For example, the brightness of an overlay layer superimposed on some objects (351, 353, 355) may change according to the brightness change pattern (415) of FIG. 4, and the brightness of an overlay layer superimposed on a background other than some objects (351, 353, 355) may change according to the brightness change pattern (425) of FIG. 4. For example, the overlay manager (215) changes the brightness (or transparency) of a layer superimposed on some objects (351, 353, 355) in the image (530) to be brighter than the brightness (or transparency) of a layer superimposed on a background other than some objects (351, 353, 355) in the image (520), so that the user may perceive that the brightness of the image (530) visible in the preview area (320) visible through the preview area (320) is changing.

[0090] For example, referring to FIG. 5d, the overlay manager (215) can display the image (540) and the overlay layer superimposed thereon so that the image (540) appears bright to the user by adjusting the overlay layer to the final brightness. For example, the overlay manager (215) can display the image (540) and the overlay layer superimposed thereon so that the image (540) appears bright to the user by adjusting the overlay layer to the final brightness at the time when the expected shooting time is finished.

[0091] For example, referring to FIG. 5d, the brightness of the objects (340, 351, 353, 355) and the overlay layer superimposed on the background within the image (540) displayed at the time when the expected shooting time is finished can correspond to the brightness of the acquired image (330) when an input for taking a photograph is received in a low-light environment.

[0092] In one embodiment, the overlay manager (215) can change the display of the image (330) based on a plurality of images acquired during low-light shooting. For example, the overlay manager (215) can replace at least two parts within the image (330) with at least a portion of the plurality of images acquired during low-light shooting.

[0093] For example, the overlay manager (215) can change the displayed image based on multiple images acquired during low-light shooting upon receiving input for low-light shooting.

[0094] For example, the overlay manager (215) may display a first image based on a first set of images among a plurality of images acquired during low-light shooting. For example, the first brightness of a first part of the first image may be brighter than the brightness of the first parts of the images included in the first set of images. The second brightness of a second part of the first image may be (substantially) the same as the brightness of the second parts of the images included in the first set of images. For example, the overlay manager (215) may change a part (361) of the image (330) to a part of a specific image corresponding to the part (361) of the images included in the first set of images. For example, a specific image among the images included in the first set of images may be an image having a part that is slightly brighter than the part (361) of the image (330). For example, the overlay manager (215) can change a portion (363) of an image (330) to a portion (363) of another specific image that corresponds to the portion (363) of the images included in the first image set. For example, the other specific image included in the first image set may be an image having a bright portion substantially identical to the portion (363) of the image (330).

[0095] For example, the overlay manager (215) may display a first image based on a first set of images among a plurality of images acquired during low-light shooting, and then display a second image based on a second set of images among the plurality of images. In one embodiment, the images included in the first set of images when displaying the first image may be images acquired up to the time of displaying the first image among a plurality of images acquired for low-light shooting. In one embodiment, the images included in the second set of images when displaying the second image may be images acquired up to the time of displaying the second image among a plurality of images acquired for low-light shooting. For example, the first set of images may have a relationship of being included in the second set of images.

[0096] For example, the overlay manager (215) can change a portion (361) of an image (330) to a portion of a specific image corresponding to the portion (361) of the images included in the second image set. For example, the specific image included in the second image set may be an image having a portion that is substantially the same as the portion (361) of the image (330). For example, the overlay manager (215) can change a portion (363) of an image (330) to a portion of another specific image corresponding to the portion (363) of the images included in the second image set. For example, the other specific image included in the second image set may be an image having a portion that is slightly brighter than the portion (363) of the image (330).

[0097] In one embodiment, a specific image for part (361) and / or another specific image for part (363) may be selected from images including parts having brightness according to brightness change patterns (415, 425, 435, 445, 445) applied to parts (361, 363). However, it is not limited thereto. In one embodiment, a specific image for part (361) and / or another specific image for part (363) may be an image being composited up to the point of displaying the image.

[0098] In one embodiment, the overlay manager (215) can initialize the layer when the shooting ends. For example, the overlay manager (215) can set the transparency of the layer to 0 (or completely transparent) if there is a layer applied in the previous shooting.

[0099] According to an embodiment, the overlay manager (215) may superimpose one or more animations on the image (330) while changing the brightness of the image (330). For example, one or more animations may include visual representations (e.g., changing shadows, falling snow, or falling rain) to highlight the part where the brightness changes. For example, one or more animations may include character motions indicating the part where the brightness changes.

[0100] FIG. 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0101] FIG. 6 can be explained with reference to FIGS. 1 to 5d.

[0102] Referring to FIG. 6, in operation 610, the electronic device (101) may receive a target image capture request. For example, the electronic device (101) may identify a touch input (e.g., press input) for a visual object (310) within the screen of a camera application (210) as a target image capture request. For example, the electronic device (101) may receive a target image capture request in a low-light environment. For example, the electronic device (101) may receive a touch input (e.g., press input) for a visual object (310) requesting the acquisition of a target image due to low-light shooting.

[0103] In operation 620, the electronic device (101) can determine the expected shooting time.

[0104] In one embodiment, the electronic device (101) can identify the expected shooting time required for low-light shooting. In one embodiment, the expected shooting time may be determined based on the performance of the electronic device (101) and / or the low-light environment.

[0105] In one embodiment, the estimated shooting time may be shorter as the performance of the electronic device (101) is higher, or when the electronic device (101) is not in a busy state (e.g., when there is spare resources in the processor (120) and / or memory (130) of the electronic device (101). For example, the higher the illumination, the fewer images are required to generate a composite image for low-light shooting. Accordingly, the higher the illumination, the shorter the estimated shooting time may be. For example, the estimated shooting time may be determined based on user settings.

[0106] In one embodiment, the electronic device (101) may determine one of the expected shooting time based on the performance of the electronic device (101) and the user's set value as the expected shooting time. For example, the expected shooting time may be determined within the maximum time allowed by the electronic device (101) (or the camera manager (211)). For example, the expected shooting time may be determined as the longer of the time determined based on the user's set value or the performance of the electronic device (101). In one embodiment, the expected shooting time may be determined as the shorter of the time determined based on the user's set value or the performance of the electronic device (101).

[0107] In operation 630, the electronic device (101) may change the display of the image during shooting based on the expected shooting time. For example, the electronic device (101) may change the display of the image displayed in an area (320) within the screen of the camera application (210) while shooting an image according to operation 640. In one embodiment, changing the display of the image during shooting may include changing the brightness of an overlay layer superimposed on the image. For example, the electronic device (101) may change the brightness of an overlay layer superimposed on two or more parts of the image during the expected shooting time using speeds according to different brightness change patterns.

[0108] In operation 640, the electronic device (101) can capture a target image. For example, it can acquire multiple images and synthesize the acquired images to create a single target image.

[0109] In one embodiment, operation 640 may be performed in parallel with operations 620 and / or 630. For example, operations 620 and 630 may be performed in the electronic device (101) while operation 640 is being performed.

[0110] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0111] FIG. 7 can be described with reference to FIG. 1 through 6. Operation 710 of FIG. 7 may correspond to operation 610 of FIG. 6. Operation 750 of FIG. 7 may correspond to operation 630 of FIG. 6. Operations 720 through 740 of FIG. 7 may be performed in parallel with operation 620 of FIG. 6.

[0112] Referring to FIG. 7, in operation 710, the electronic device (101) may receive a request to capture a target image. For example, the electronic device (101) may receive a touch input (e.g., a press input) for a visual object (310) requesting the acquisition of a target image due to low-light shooting.

[0113] In operation 720, the electronic device (101) can acquire an image. According to an embodiment, operation 720 may be performed prior to operation 710.

[0114] In one embodiment, the electronic device (101) can acquire an image (330) to be displayed in a preview area (320) through a camera (280). In one embodiment, the electronic device (101) can acquire the image (330) through a specified high sensitivity in response to identifying an input requesting low-light shooting. For example, the image (330) acquired through the specified high sensitivity may be a bright image. In one embodiment, the image (330) may be an image that is brighter than the preview image (e.g., the preview image of FIG. 3A) displayed in the preview area (320) before identifying a touch input to a visual object (310) in a low-light environment. For example, the image (330) may be an image with higher sensitivity than the preview image (e.g., the preview image of FIG. 3A) displayed in the area (320) before identifying a touch input to a visual object (310) in a low-light environment. In one embodiment, the image (330) may have a brightness corresponding to an image obtained in a low-light environment. In one embodiment, the image obtained by shooting (or night shooting) in a low-light environment may be a composite image of multiple images obtained through different setting values ​​for the camera (280).

[0115] In operation 730, the electronic device (101) can analyze the image.

[0116] In one embodiment, the electronic device (101) can analyze the composition of the image (330) (e.g., histogram (e.g., information about the contrast, brightness, and / or color distribution of the image), objects (or segmented objects), and semantic information (e.g., landscape photos, group photos, family photos, or animal photos, etc.). In one embodiment, the electronic device (101) can analyze the depth values ​​of each of one or more objects included in the image (330).

[0117] In operation 740, the electronic device (101) can identify parts of the image display to be changed based on the analysis results.

[0118] In one embodiment, the electronic device (101) can identify two or more parts to which a brightness change is to be applied based on the image (330). In one embodiment, each of the two or more parts can be identified by the subject of the image (330) (e.g., portrait (e.g., single portrait, family portrait, or group portrait), animal portrait, or landscape portrait (e.g., building portrait, or nature portrait)).

[0119] In one embodiment, the electronic device (101) may identify portions containing a person (340) and / or objects (351, 353, 355) within the image (330) as portions to which a brightness change is to be applied. In one embodiment, the electronic device (101) may identify at least some of the regions (361, 363, 365, 367) within the image (330) as portions to which a brightness change is to be applied. In one embodiment, the electronic device (101) may identify a portion containing at least one object (e.g., 340) and at least one region (e.g., 363) within the image (330) as portions to which a brightness change is to be applied. In one embodiment, the electronic device (101) may identify any one of the objects (e.g., person (340), and / or things (351, 353, 355)), and / or regions (361, 363, 365, 367) as the part of the image (330) to which a brightness change is to be applied, depending on the composition and / or depth of the image (330). In one embodiment, if the image (330) is a portrait, the electronic device (101) may identify the object representing the nearest person and the background region around the object as the part of the image (330) to which a brightness change is to be applied. In one embodiment, if the image (330) is a landscape photograph, the electronic device (101) may identify regions close to the center of the image (330) as the part to which a brightness change is to be applied.

[0120] In operation 750, the electronic device (101) can change the display of parts of the image during shooting. In one embodiment, changing the display of parts of the image may include changing the brightness of an overlay layer superimposed on the parts. For example, the electronic device (101) can change the display of an overlay layer superimposed on parts of the image while shooting a target image according to operation 650. For example, the electronic device (101) can change the brightness (or color) of an overlay layer superimposed on two or more parts of the image using speeds according to different brightness change patterns.

[0121] FIGS. 8a to 8d are drawings illustrating screens of a camera application for adjusting shooting time according to one embodiment.

[0122] FIGS. 8a to 8d can be explained with reference to FIGS. 1 to 7.

[0123] In one embodiment, referring to FIGS. 8a and 8b, the electronic device (101) may display visual objects (810, 820) for setting a shooting time within the screen of the camera application (210). For example, the electronic device (101) may display visual objects (810, 820) for setting a shooting time within the screen of the camera application (210) while a visual object (311) indicating a low-light environment is displayed.

[0124] In one embodiment, as shown in FIG. 8a, the electronic device (101) can set the expected shooting time according to automatic setting to 4 seconds by selecting a visual object (810) for automatic setting. In one embodiment, the expected shooting time according to automatic setting may correspond to the time required to generate a composite image by the performance and / or illumination of the electronic device (101). In one embodiment, as shown in FIG. 8b, the electronic device (101) can set the expected shooting time to 25 seconds, which is the maximum shooting time, by selecting a visual object (820) for setting the maximum shooting time.

[0125] In one embodiment, referring to FIGS. 8c and FIGS. 8d, the electronic device (101) may display a visual object (830) for setting a shooting time based on user input within the screen of the camera application (210). For example, the electronic device (101) may display a visual object (830) for setting a shooting time within the screen of the camera application (210) while a visual object (311) indicating a low-light environment is displayed.

[0126] In one embodiment, in FIG. 8c, the electronic device (101) can set an estimated shooting time according to user settings by a touch input (e.g., drag input) within a visual object (830). In one embodiment, in FIG. 8d, the electronic device (101) can set the estimated shooting time within the maximum shooting time in response to a touch input (e.g., drag input) to increase the estimated shooting time.

[0127] Figure 9 is a diagram showing an example of comparison between an image in a low-light environment and an expected target image.

[0128] FIG. 9 can be explained with reference to FIGS. 1 to 8d.

[0129] Referring to FIG. 9, the images (910, 930) may be darker than the expected target image (950). The image (970) may be an image having substantially the same brightness as the expected target image (950).

[0130] For example, the images (910, 930, 970) may be images displayed in the preview area (320) before identifying touch input for the visual object (310).

[0131] For example, when an input requesting low-light shooting is received, the electronic device (101) can compare images (910, 930, 970) with an expected target image (950). For example, the electronic device (101) can determine whether the image changes based on the comparison result.

[0132] For example, if the difference in brightness between the images (910, 930) and the expected target image (950) is greater than or equal to a reference brightness difference, the electronic device (101) may decide to change the brightness of the image during low-light shooting. Accordingly, the electronic device (101) may display an image such that the brightness changes from the images (910, 930) to an image corresponding to the expected target image (950) during shooting to generate a composite image.

[0133] In one embodiment, when the brightness changes from an image (910) to an image corresponding to an expected target image (950), the electronic device (101) can determine that a longer shooting time is required due to the difference in brightness. Accordingly, the electronic device (101) can display an image in which the brightness changes from an image (910) to an image corresponding to an expected target image (950) for a relatively long time (e.g., 7 seconds).

[0134] In one embodiment, when the brightness changes from an image (930) to an image corresponding to an expected target image (950), the electronic device (101) can determine that a shorter shooting time is required due to the difference in brightness. Accordingly, the electronic device (101) can display an image in which the brightness changes from an image (930) to an image corresponding to an expected target image (950) for a relatively short time (e.g., 4 seconds).

[0135] For example, if the difference in brightness between the image (970) and the expected target image (950) is less than the reference brightness difference, the electronic device (101) may decide not to change the brightness of the image during low-light shooting. For example, the electronic device (101) may display the image (970) without changing the brightness of the image (970) during low-light shooting.

[0136] FIG. 10 is a drawing illustrating one or more layers applied to an image.

[0137] FIG. 10 can be explained with reference to FIGS. 1 to 9.

[0138] Referring to FIG. 10, for a change in the brightness of the image (330), the electronic device (101) may superimpose one or more (overlay) layers (1010, 1020, 1030, 1040) on the image (330).

[0139] For example, each of one or more layers (1010, 1020, 1030, 1040) may have a setting related to transparency changed to change the brightness (or, color) of parts including different objects and / or regions. For example, the electronic device (101) may change the setting related to transparency of each of one or more layers (1010, 1020, 1030, 1040) during low-light shooting. For example, the electronic device (101) may change the setting related to transparency of each of one or more layers (1010, 1020, 1030, 1040) based on brightness change patterns for each of one or more layers (1010, 1020, 1030, 1040) during low-light shooting. For example, the electronic device (101) may change the setting related to the transparency of each of one or more layers (1010, 1020, 1030, 1040) so that the transparency becomes 0 (or completely transparent) at the end of the expected shooting time. In one embodiment, the layer (1010) may include parts (1051, 1053) for changing the brightness of objects (351, 353). In one embodiment, the layer (1020) may include parts (1065, 1067) for changing the brightness of a wall surface. In one embodiment, the layer (1030) may include parts (1063) for changing the brightness of a floor surface.

[0140] According to one embodiment, at least two of one or more layers (1010, 1020, 1030, 1040) may have different brightness change patterns. For example, according to a scenario in which the brightness of an object is increased and then the brightness around the object is increased, the electronic device (101) may change the transparency of at least two layers at different rates. For example, the electronic device (101) may first decrease the transparency of the layer (1010) for brightness change of objects (351, 353), and then later decrease the transparency of parts (1065, 1067) above the objects (351, 353).

[0141] According to one embodiment, the uppermost layer (1040) among one or more layers (1010, 1020, 1030, 1040) can change the overall color and / or brightness of the image. For example, the electronic device (101) can determine the color change of the layer (1040) based on the overall color tone to be applied to the image determined by the result of analyzing the image.

[0142] Among one or more layers (1010, 1020, 1030, 1040), the layer (1030) that is nested to change a specific part of the image (e.g., bottom) can change the color and / or brightness of the image to emphasize the shading of the object in the image.

[0143] FIG. 11 is a diagram illustrating an image processing flow of an electronic device according to one embodiment.

[0144] In one embodiment, the electronic device (101) can composite a portion of another image onto an image. In one embodiment, the electronic device (101) can composite another portion of a replacement image onto a portion of an image.

[0145] Referring to FIG. 11, the image sensor (1110) can periodically acquire a raw image (1111). For example, the image sensor (1110) can periodically acquire a raw image (1111) prior to a request for image capture in a low-light environment. For example, the image sensor (1110) can store the periodically acquired raw image (1111) in a buffer (1115).

[0146] In one embodiment, an image signal processor (ISP, 1120) can synthesize a raw image (1111) that is periodically acquired by an image sensor (1110). In one embodiment, the ISP (1120) can store a composite image (1131) based on the raw image (1111) in a buffer (1125). In one embodiment, the ISP (1120) can generate a plurality of composite images that are progressively brightened based on the raw image (1111) and store them in a buffer (1125).

[0147] In one embodiment, the ISP (1120) may receive a request for image capture from a user. For example, the ISP (1120) may receive a request for low-light capture in a low-light environment.

[0148] For example, the ISP (1120) (or processor (120)) can display an image (1135) through the display (260). For example, the ISP (1120) (or processor (120)) can display an image within an area to change from the image (1135) to a composite image (1131). In one embodiment, the ISP (1120) can sequentially display the image (1135) and a plurality of composite images that are progressively brightened as images.

[0149] For example, the ISP (1120) (or processor (120)) may store the composite image (1131) in memory (130) rather than in the buffer (1125). For example, the buffer (1125) may be memory within the ISP (1120), and the memory (130) may be memory outside the ISP (1120).

[0150] For example, the ISP (1120) (or processor (120)) may generate a composite image (1131) with a resolution higher than the resolution of the area and store the generated high-resolution composite image (1131) in memory (130). In one embodiment, the ISP (1120) (or processor (120)) may, in response to receiving a request for low-light shooting in a low-light environment, change the high-resolution composite image (1131) stored in memory (130) to a lower size (or lower resolution) through resizing (or resolution conversion). The composite image (1131) with the changed size (or resolution) may be displayed as an image through the display (260). In this case, the electronic device (101) may superimpose one or more (overlay) layers on the composite image (1131) with a changed size (or resolution) so that the brightness of the image gradually increases from the original image (1135) to the composite image (1131) with a changed size (or resolution).

[0151] According to an embodiment, the electronic device (101) can display an image such that the color of the image changes gradually, not only in low-light shooting in a low-light environment but also in shooting to acquire an image with HDR (high dynamic range) applied.

[0152] In one embodiment, the electronic device (101) can synthesize a raw image (1111) that is periodically acquired and store the synthesized image in buffers (1115, 1125) connected to an image sensor (1110) or an ISP (1120).

[0153] For example, the electronic device (101) can display an image such that the color of the image (1135) gradually changes into the composite image (1131) during shooting for HDR. For example, the electronic device (101) can change the color of the composite image (1131) displayed as a preview image by applying different speeds according to the brightness change pattern to different parts of the composite image (1131) during shooting for HDR.

[0154] FIG. 12 is a drawing illustrating an image generated by an electronic device according to one embodiment.

[0155] FIG. 12 can be described with reference to FIGS. 1 through 11. In one embodiment, FIG. 12 may show an example in which the brightness of parts (1221, 1223, 1225) changes at different speeds.

[0156] Referring to FIG. 12, the electronic device (101) can change the brightness of parts at different speeds based on analyzing an image. For example, the electronic device (101) can set the rate of change differently for parts of the image that are relatively far from the electronic device (101) and parts of the image that are relatively close to the electronic device (101), depending on the depth value. For example, the electronic device (101) can set the rate of change of parts of the image differently depending on the position within the image. For example, the electronic device (101) can set the rate of change of parts of the image differently depending on the object within the image.

[0157] For example, the electronic device (101) can display on the display (260) an image (1230) in which a specific part (1223) is relatively bright, instead of an image (1210) in which all parts (1221, 1223, 1225) are dark. For example, the specific part (1223) that is brightened within the image (1230) may be the part where the central object is located. For example, the specific part (1223) that is brightened within the image (1230) may be the part located relatively in the center.

[0158] For example, the electronic device (101) may display an image (1270) that is brighter overall on the display (260) instead of an image (1230) in which a specific part (1223) is relatively brighter. For example, parts (1211, 1225) that are relatively brighter within the image (1270) may be parts where the central object is not located. For example, parts (1211, 1225) that are relatively brighter within the image (1270) may be parts located relatively far from the center.

[0159] According to an embodiment, the electronic device (101) can generate a target image (e.g., image (1270)) through an artificial intelligence model (or, generative artificial intelligence model) (or, a large language model). For example, the electronic device (101) can generate a target image (e.g., image (1270)) by inputting a current image (1210) into an artificial intelligence model in response to a shooting request. For example, the electronic device (101) can generate a target image (e.g., image (1270)) in which the brightness of at least some parts has been changed by inputting the current image (1210) and a prompt indicating the parts to be improved in brightness into an artificial intelligence model in response to a shooting request.

[0160] According to an embodiment, the electronic device (101) can display an image changing from image (1210) to target image (e.g., image (1270)) through a display (260) by overlaying a (overlay) layer on a target image (e.g., image (1270)).

[0161] According to an embodiment, the electronic device (101) may generate two or more intermediate images through an artificial intelligence model (or, generative artificial intelligence model) (or, a large language model). In one embodiment, the electronic device (101) may sequentially display an image (1210) to be displayed first, two or more intermediate images, and a target image (e.g., image (1270)) to be displayed finally.

[0162] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0163] As described above, the electronic device (101) may include an image sensor, a display (260), at least one processor (120) including a processing circuit, and a memory (130) including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to acquire a preview image including a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the preview image to be displayed as a preview through the display (260). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to receive user input regarding the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to generate an image including the first object and the second object based on the preview image in response to the user input. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the image to be displayed through the display (260) by changing the brightness of the first object and the second object at different speeds while generating the target image by the plurality of images.

[0164] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to determine the external brightness of the electronic device (101) using the preview image. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to perform the display of the image by changing the brightness of the first object and the second object at the different speeds, based at least in part on determining that the external brightness is less than a first reference brightness. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to display the preview image while generating the target image, based at least in part on determining that the external brightness is greater than or equal to a second reference brightness which is higher than the first reference brightness.

[0165] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to determine the time required to generate the target image. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the change in brightness to be performed during the identified time.

[0166] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the first brightness of the first object to be changed at least in a first time interval and the second brightness of the second object to be changed in a second time interval different from the first time interval as at least part of the operation of displaying the image. The first time interval and the second time interval may be included in the time.

[0167] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the determined time to be displayed in the display. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the target image to be generated during the identified time based on receiving the input requesting the image after the determined time has been displayed.

[0168] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may be caused to determine the depths of the first object and the second object within the preview image or the image. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may be caused to perform an operation of changing the brightness of the first object and the second object at different speeds corresponding to the depths.

[0169] The first object has a first depth value, and the second object may have a second depth value greater than the first depth value. The part corresponding to the first object may become brighter before the part corresponding to the second object.

[0170] When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to determine the characteristics of the first object and the second object within the preview image or the image. When the above instructions are executed individually or collectively by the at least one processor (120), they may cause the electronic device (101) to perform an operation to change the brightness based on each of the characteristics of the first object and the second object.

[0171] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause at least one layer having a first part corresponding to the first object and a second part corresponding to the second object to be superimposed on the image. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to perform an operation to change the brightness by adjusting the transparency of the first part and the second part.

[0172] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may be caused to perform the operation of generating the image by adjusting the brightness of the preview image.

[0173] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the device to perform an operation of changing the brightness of the first object of the image from a first brightness to a second brightness that is brighter than the first brightness.

[0174] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may be caused to perform the operation of generating the image by adjusting the brightness of the preview image.

[0175] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the brightness of the at least two parts of the image to change from a brightness lower than the original brightness to the original brightness.

[0176] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the first brightness of the first part of the at least two parts of the image to change the brightness of the first part of the image from the low brightness to the original brightness, such that the first brightness of the first part of the at least two parts temporarily has a brightness that exceeds the original brightness of the first part.

[0177] A method as described above may be performed by an electronic device (101) comprising a camera (280) and a display (260). The method may include an operation of displaying a screen of a camera application (210) through the display (260). The method may include an operation of receiving an input requesting an image generated by a plurality of images through the camera (280) while displaying the screen. The method may include an operation of displaying the preview image through the display (260) by changing the brightness of at least two parts of the preview image at different speeds while generating the image by the plurality of images obtained in response to the input.

[0178] The above method may include an operation of identifying the external brightness of the electronic device (101). The method may include an operation of changing the brightness of the at least two parts of the preview image at different speeds in response to identifying that the external brightness is less than a reference brightness. The method may include an operation of maintaining the brightness of the preview image in response to identifying that the external brightness is greater than or equal to the reference brightness.

[0179] The above method may include an operation of identifying the time required to generate the image. The above method may include an operation of changing the brightness of the at least two parts of the preview image during the identified time.

[0180] The above method may include an operation of identifying the depths of a plurality of objects within the preview image. The above method may include an operation of identifying at least two objects having different depths among the plurality of objects. The above method may include an operation of changing the brightness of the at least one two parts containing the at least two objects at rates corresponding to each of the depths of the at least two objects.

[0181] The above method may include the operation of overlaying layers having a size corresponding to each of the at least two parts of the preview image on the at least two parts. The above method may include the operation of changing the brightness of the at least two parts of the preview image at different speeds by increasing the transparency of the layers at different speeds.

[0182] A non-transitory computer-readable storage medium as described above may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor (120) of an electronic device (101) comprising an image sensor and a display (260), the electronic device (101) may cause the electronic device (101) to acquire a preview image comprising a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the preview image to display as a preview through the display (260). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to receive user input regarding the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to generate an image including the first object and the second object based on the preview image in response to the user input. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the image to be displayed through the display (260) by changing the brightness of the first object and the second object at different speeds while generating the target image by the plurality of images.

[0183] As described above, the electronic device (101) may include an image sensor, a display (260) including a touch-sensitive circuit, at least one processor (120) including a processing circuit, and a memory (130) including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to acquire a preview image including a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the preview image to be displayed as a preview through the display (260). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to receive user input for the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to display the preview image through the display by adjusting the first brightness of the first object and the second brightness of the second object while generating the target image by the plurality of images.

[0184] A method as described above may be performed by an electronic device (101) comprising an image sensor and a display (260) comprising a touch-sensitive circuit. The method may include an operation of acquiring a preview image including a first object and a second object through the image sensor. The method may include an operation of displaying the preview image as a preview through the display (260). The method may include an operation of receiving user input for the preview image requesting a target image generated by a plurality of images acquired through the image sensor. While generating the target image by the plurality of images, the method may include an operation of displaying the preview image through the display by adjusting the first brightness of the first object, and displaying the preview image through the display by adjusting the first brightness of the first object and the second brightness of the second object.

[0185] A non-transitory computer-readable storage medium as described above may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor (120) of an electronic device (101) comprising an image sensor and a display (260) comprising a touch-sensitive circuit, the electronic device (101) may cause the electronic device (101) to acquire a preview image comprising a first object and a second object through the image sensor. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the preview image to display as a preview through the display (260). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to receive user input for the preview image requesting a target image generated by a plurality of images acquired through the image sensor. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the electronic device (101) to display the preview image through the display by adjusting the first brightness of the first object and the second brightness of the second object while generating the target image by the plurality of images.

[0186] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0187] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0188] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0189] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0190] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0191] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., CD-ROM (compact disc read-only memory)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0192] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), Image sensor, Display (260), At least one processor (120) including a processing circuit; and The electronic device (101) includes a memory (130) that stores instructions and includes one or more storage media, and when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), A preview image including a first object and a second object is obtained through the image sensor above, and Through the above display (260), the preview image is displayed as a preview, and Receiving user input for the preview image requesting a target image generated by a plurality of images acquired through the image sensor, and In response to the above user input, an image including the first object and the second object is generated based on the above preview image, and While generating the target image by the plurality of images, changing the brightness of the first object and the second object at different speeds causes the image to be displayed through the display (260). Electronic device.

2. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Using the above preview image, the brightness of the outside of the electronic device (101) is determined, and Based at least in part on determining that the above external brightness is less than a first reference brightness, the display of the image is performed by changing the brightness of the first object and the second object at the different speeds, and Based at least in part on determining that the above external brightness is greater than or equal to a second reference brightness which is higher than the first reference brightness, causing the preview image to be displayed while generating the target image, Electronic device.

3. In claim 1 or claim 2, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Determine the time required to generate the above target image, and Causing the above change in brightness to be performed during the above identified time, Electronic device.

4. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), As at least part of the operation of displaying the above image, changing the first brightness of the first object in at least a first time interval and causing the second brightness of the second object in a second time interval different from the first time interval, wherein the first time interval and the second time interval are included in the time. Electronic device.

5. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Display the determined time above within the display, and Based on receiving the input requesting the image after displaying the determined time, causing the target image to be generated during the determined time, Electronic device.

6. In any one of claims 1 to 5, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Determining the depths of the first object and the second object within the above preview image or the above image, and causing the operation to change the brightness of the first object and the second object at different speeds corresponding to the depths, Electronic device.

7. In Claim 6, The first object has a first depth value, and the second object has a second depth value greater than the first depth value. The part corresponding to the first object becomes brighter before the part corresponding to the second object. Electronic device.

8. In any one of claims 1 to 7, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Determining the characteristics of the first object and the second object within the above preview image or the above image, and Causing to perform an operation to change the brightness based on each of the characteristics of the first object and the second object, Electronic device.

9. In any one of claims 1 to 8, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), At least one layer having a first part corresponding to the first object and a second part corresponding to the second object is superimposed on the image, and By adjusting the transparency of the first part and the second part, causing the operation of changing the brightness to be performed, Electronic device.

10. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), By adjusting the brightness of the above preview image, causing the operation of generating the above image to be performed, Electronic device.

11. In any one of claims 1 to 9, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Causing to perform an operation to change the brightness of the first object of the above image from a first brightness to a second brightness brighter than the first brightness, Electronic device.

12. In Claim 11, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), causing the brightness of the first object to be changed so that the brightness of the first object temporarily exceeds the second brightness, Electronic device.

13. A method of an electronic device (101) including a camera (280) and a display (260), The operation of displaying the screen of the camera application (210) through the above display (260), While displaying the above screen, the operation of receiving an input requesting an image generated by a plurality of images through the camera (280), and The operation of displaying the preview image through the display (260) by changing the brightness of at least two parts of the preview image at different speeds while generating the image using the plurality of images obtained in response to the above input. method.

14. In Claim 13, Operation of identifying the external brightness of the electronic device (101), An operation of changing the brightness of the at least two parts of the preview image at the different speeds in response to identifying that the external brightness is less than the reference brightness, and In response to identifying that the external brightness is greater than or equal to the reference brightness, the operation of maintaining the brightness of the preview image method.

15. In claim 13 or claim 14, An operation to identify the time required to generate the above image, and operation of changing the brightness of the at least two parts of the above preview image during the identified time method.

Images