Electronic device and image capturing method

Abstract

An electronic device according to various embodiments of the present invention may comprise: a display; a first camera having a first angle of view; a second camera having a second angle of view different from the first angle of view; at least one processor; and memory. The memory may store instructions that are executable by the at least one processor, and when executed, cause the electronic device to: display, on the display, a first preview image which includes a first image having a first zoom factor and acquired using the first camera; and generate a first object image by extracting a first object included in the first image in response to a first user input in a state in which the first preview image is displayed. The memory may store instructions that cause the electronic device to superimpose the first object image and a second image having the first zoom factor and acquired using the second camera, and display the superimposed image as a second preview image on the display. Various other embodiments are possible.

Description

Electronic devices and imaging methods

[0001] This article is about electronic devices, and for example, how electronic devices take images.

[0002] Portable electronic devices (hereinafter, "electronic devices"), such as smartphones and tablet PCs, may include cameras for capturing images of the surrounding environment to provide diverse user experiences. For example, the electronic device may include at least one camera positioned on the front and / or rear.

[0003] Electronic devices can provide various functions for editing stored images. For example, an electronic device may provide a function for synthesizing multiple images into a single image, as an example of an editing function. For example, an electronic device may also provide a function for creating a video using multiple images, as an example of an editing function.

[0004] When a user wishes to synthesize multiple images on an electronic device, a process may be required: first, each image is acquired, then the desired region is segmented from each image, and then the segmented regions are synthesized. This process requires a cumbersome synthesis process to obtain the final image, can produce inconsistent composite effects, and may not reflect the characteristics of the cameras used to capture the images.

[0005] An electronic device according to the present disclosure (or specification, invention) may include a display, a first camera having a first angle of view, a second camera having a second angle of view different from the first angle of view, at least one processor, and a memory.

[0006] According to one embodiment, the memory may store instructions that are executable by at least one processor and, when executed, cause the electronic device to display a first preview image including a first image of a first zoom ratio acquired using the first camera on the display, and, in a state where the first preview image is displayed, extract a first object included in the first image in response to a first user input, thereby generating a first object image.

[0007] According to one embodiment, the memory may store instructions that cause the electronic device to display, on the display, a second preview image by overlapping the second image of the first zoom ratio obtained using the second camera and the first object image.

[0008] According to one embodiment, the memory may store instructions that cause the electronic device to change the zoom magnification of the second image to a second zoom magnification, and to display the second image at the second zoom magnification and the first object image as a third preview image on the display.

[0009] According to one embodiment, the memory may store instructions that cause the electronic device to store a composite image corresponding to the displayed third preview image.

[0010] According to one embodiment, the memory may store instructions that are executable by at least one processor and, when executed, cause the electronic device to display, through the display, a first preview image including a first image acquired using the first camera, generate a first object image associated with the first object from among a first object and a second object included in the first preview image, display, through the display, a second preview image including a second image acquired using the second camera, the second image including the second object, and the first object image, display the second image on the second preview image by adjusting it according to a selected magnification, and store a third image corresponding to the second preview image.

[0011] A method for capturing an image of an electronic device according to various embodiments of the present document may include: displaying a first preview image including a first image of a first zoom magnification acquired using a first camera; extracting a first object included in the first image in response to a first user input while the first preview image is displayed, thereby generating a first object image; overlapping a second image of the first zoom magnification acquired using a second camera having a different angle of view from the first camera and the first object image, thereby displaying the image as a second preview image; changing a zoom magnification of the second image to a second zoom magnification, overlapping the second image of the second zoom magnification and the first object image, thereby displaying the image as a third preview image; and storing a composite image corresponding to the displayed third preview image.

[0012] A computer-readable non-transitory recording medium according to various embodiments of the present document may store instructions for performing an operation of displaying a first preview image including a first image of a first zoom magnification acquired using a first camera, an operation of extracting a first object included in the first image in response to a first user input while the first preview image is displayed, and generating a first object image, an operation of superimposing a second image of the first zoom magnification acquired using a second camera having a different angle of view from the first camera and the first object image and displaying the superimposed image as a second preview image, an operation of changing a zoom magnification of the second image to a second zoom magnification, and displaying the superimposed second image of the second zoom magnification and the first object image as a third preview image, and an operation of storing a composite image corresponding to the displayed third preview image.

[0013] According to various embodiments of the present document, when an image is to be taken with the ratio of a main subject and a background object adjusted using a camera of an electronic device, an electronic device and an image taking method of the electronic device can be provided that can automatically set a shooting area and provide an intuitive shooting experience for the image.

[0014] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0015] FIG. 2 is a block diagram of a camera module according to various embodiments.

[0016] FIG. 3 illustrates cameras arranged on the rear of an electronic device according to one embodiment.

[0017] FIG. 4 illustrates a process of capturing an image of an electronic device according to one embodiment.

[0018] FIG. 5 is a block diagram of an electronic device according to various embodiments.

[0019] FIG. 6 illustrates an image obtained using a first camera and a second camera of an electronic device according to one embodiment.

[0020] FIG. 7 is a flowchart of a method for an electronic device to execute a dynamic zoom mode according to one embodiment.

[0021] FIG. 8 illustrates a UI provided by an electronic device when executing dynamic zoom mode according to one embodiment.

[0022] FIG. 9 is a flowchart of a method for an electronic device according to one embodiment to synthesize a main subject and a background object and provide it as a preview.

[0023] FIG. 10 illustrates a process of an electronic device extracting a main subject from a first image according to one embodiment.

[0024] FIG. 11 illustrates a process by which an electronic device according to one embodiment determines a zoom ratio corresponding to the boundary of a background object.

[0025] FIG. 12 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0026] FIG. 13 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0027] Figure 14 illustrates a process for acquiring an image according to one embodiment.

[0028] FIG. 15 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0029] FIG. 16 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0030] FIG. 17 is a flowchart of a method for processing and storing images of a main subject and a background object by an electronic device according to one embodiment.

[0031] FIG. 18 illustrates a process of an electronic device matching feature points in a first image and a second image according to one embodiment.

[0032] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0033] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0034] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0035] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0036] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0037] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0038] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0039] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0040] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0041] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0042] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0043] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0044] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0045] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0046] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0047] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0048] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0049] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0050] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0051] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0052] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0053] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0054] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0055] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0056] FIG. 2 is a block diagram (200) illustrating a camera module (e.g., 180 of FIG. 1) according to various embodiments.

[0057] Referring to FIG. 2, the camera module (180) may include a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250) (e.g., a buffer memory), or an image signal processor (260). The lens assembly (210) may collect light emitted from a subject that is a target of image capturing. The lens assembly (210) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (210). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (210) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties that are different from the lens properties of the other lens assemblies. A lens assembly (210) may include, for example, a wide-angle lens or a telephoto lens.

[0058] According to one embodiment, the flash (220) can emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (220) can include one or more light emitting diodes (e.g., red-green-blue (RGB) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. The image sensor (230) can acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly (210) into an electrical signal. According to one embodiment, the image sensor (230) can include one image sensor selected from among image sensors having different properties, such as, for example, an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same property, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (230) can be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0059] The image stabilizer (240) can move at least one lens or image sensor (230) included in the lens assembly (210) in a specific direction or control the operating characteristics of the image sensor (230) (e.g., adjusting the read-out timing, etc.) in response to the movement of the camera module (180) or the electronic device (101) including the same. This allows compensating for at least some of the negative effects of the movement on the captured image. In one embodiment, the image stabilizer (240) can detect such movement of the camera module (180) or the electronic device (101) using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module (180). In one embodiment, the image stabilizer (240) can be implemented as, for example, an optical image stabilizer. The memory (250) can temporarily store at least a portion of the image acquired through the image sensor (230) for the next image processing task. For example, when image acquisition is delayed due to the shutter, or when multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in the memory (250), and a corresponding copy image (e.g., a low-resolution image) can be previewed through the display device (160). Thereafter, when a specified condition is satisfied (e.g., a user input or a system command), at least a portion of the original image stored in the memory (250) can be acquired and processed, for example, by the image signal processor (260). According to one embodiment, the memory (250) can be configured as at least a portion of the memory (130) or as a separate memory that operates independently therefrom.

[0060] The image signal processor (260) can perform one or more image processing operations on an image acquired through an image sensor (230) or an image stored in a memory (250). The one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor (260) may perform control (e.g., exposure time control, read-out timing control, etc.) on at least one of the components included in the camera module (180) (e.g., image sensor (230)). An image processed by the image signal processor (260) may be stored back in the memory (250) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display device (160), electronic device (102), electronic device (104), or server (108)). In one embodiment, the image signal processor (260) may be at least a part of the processor (120). It may be configured as a separate processor that is configured or operates independently from the processor (120). If the image signal processor (260) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (260) may be displayed through the display device (160) as is or after undergoing additional image processing by the processor (120).

[0061] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different properties or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera, and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera, and at least another may be a rear camera.

[0062] FIG. 3 illustrates cameras arranged on the rear of an electronic device according to one embodiment.

[0063] According to one embodiment, the electronic device (300) may include at least one front camera disposed on the front of a housing in which a display (e.g., display module (160) of FIG. 1) is disposed, and at least one rear camera disposed on the rear of the housing in which a rear cover is disposed.

[0064] Referring to FIG. 3, the electronic device (300) may include three cameras (e.g., a first camera (312), a second camera (314), and a third camera (316)) arranged adjacent to each other on the rear side (e.g., the upper left side of the rear side) of the housing, but the number and / or arrangement of the cameras is not limited thereto. The first camera (312), the second camera (314), and the third camera (316) may include at least some of the configurations and / or functions of the camera module (180) of FIG. 1 and / or the camera module (180) of FIG. 2. According to one embodiment, the first camera (312), the second camera (314), and the third camera (316) may be arranged adjacent to each other and may capture images in substantially the same direction.

[0065] In one embodiment, the first camera (312), the second camera (314), and the third camera (316) may have different optical characteristics. For example, the first camera (312), the second camera (314), and the third camera (316) may differ in at least some of the lens optical characteristics, such as the angle of view, the focal length, the aperture, the lens material, the structure, the refractive index, or the refractive / diffraction characteristics, and / or may differ in at least some of the sensor characteristics, such as the sensor pitch and the number of pixels.

[0066] According to one embodiment, the first camera (312), the second camera (314), and the third camera (316) can capture images with different fields of view. Here, the field of view may refer to the range of a scene that the camera can capture at one time. For example, the first camera (312) may be an ultra-wide-angle camera (or UW (ultra-wide) camera) that captures a very wide field of view (e.g., about 120 degrees), the second camera (314) may be a wide-angle camera (or W (wide) camera) that captures a wide field of view (e.g., about 84 degrees), and the third camera (316) may be a telephoto camera (or T (telescope) camera) that captures a narrow field of view (e.g., about 20 degrees). Accordingly, when an electronic device captures the same scene with a first camera (312) and a second camera (314), when shooting with the first camera (312), an environment with a relatively wide angle of view is captured, so the size of a specific subject may be small, and when shooting with the second camera (314), an environment with a relatively narrow angle of view is captured, so the size of a specific subject may be large.

[0067] According to one embodiment, when a camera application (or an application using camera resources) is executed, the electronic device (300) activates any one of the first camera (312), the second camera (314), or the third camera (316), and the electronic device (300) can display an image acquired from the camera on the display in real time as a preview (or viewfinder).

[0068] According to one embodiment, the electronic device (300) may provide a user interface (UI) that can set a zoom ratio when a camera application is executed. For example, the UI may be provided with selectable items corresponding to various zoom ratios (e.g., x0.6, x1.0, x3.0), may be provided in the form of a scrollable bar that can select a specific zoom ratio, and / or may be provided so that the zoom ratio can be adjusted according to a user's multi-touch interaction (e.g., pinch to zoom). According to one embodiment, when the camera application is executed, the electronic device (300) may acquire an image with a default zoom ratio (e.g., x1.0) and change the zoom ratio based on a user input through the UI.

[0069] According to one embodiment, the electronic device (300) may provide a hybrid zoom function. Here, the hybrid zoom function may include analog optical zoom and digital zoom (or digital crop zoom), and may use analog optical zoom in some zoom magnification ranges and digital zoom in other zoom magnification ranges. Analog optical zoom may be a method of enlarging or reducing the field of view using a camera lens and optical elements. Digital zoom may be a method of enlarging or reducing the field of view of an image to be displayed or stored by cropping a portion of the original image through digital processing of the original image acquired from the image sensor without changing the optical elements. For example, the first camera (312), the second camera (314), and the third camera (316) acquire original images with analog optical zoom magnifications of x0.6, x1.0, and x5.0, respectively, and the electronic device (300) may acquire images using the first camera (312) in a section (e.g., x0.6 to x1.0) where the current zoom magnification is less than the optical zoom magnification of the second camera (314) (e.g., x1.0), may acquire images using the second camera (314) in a section (e.g., x1.0 to x5.0) where the current zoom magnification is greater than or equal to the optical zoom magnification of the second camera (314) and less than the optical zoom magnification of the third camera (316) (e.g., x5.0 to x30.0), and may acquire images using the third camera (316) in a section (e.g., x5.0 to x30.0) where the current zoom magnification is greater than or equal to the optical zoom magnification of the third camera (316). The electronic device (300) crops a portion of the acquired image and displays it as a preview image in response to the currently set zoom ratio, and can change the size of the area to be cropped in the image when the zoom ratio is changed.

[0070] According to one embodiment, the electronic device (300) may provide a dynamic zoom function. In this document, the dynamic zoom function may mean a function of fixing the size (or zoom ratio) of at least one subject (e.g., a main subject) in an image and reducing or enlarging the remaining subjects (e.g., a background object) through zoom-in or zoom-out. For example, the electronic device (300) may select at least one camera among the cameras (312, 314, 316) to acquire an image including a main subject (or a first object), extract and separate an area of ​​the main subject from the acquired image, select at least one camera among the cameras (312, 314, 316) to acquire an image including a background object (or a second object), and then synthesize an image of the separated area of ​​the main subject and the background object. According to one embodiment, the electronic device (300) may provide a dynamic zoom function while displaying a preview image of the camera. Hereinafter, various embodiments related to the dynamic zoom function provided by the electronic device (300) will be described with reference to FIGS. 4 to 18.

[0071] FIG. 4 illustrates a synthesis process of a photographed image of an electronic device according to one embodiment.

[0072] FIG. 4 illustrates an embodiment of generating a composite image by adjusting the ratio of a main subject and a background object in a plurality of independently captured and stored images (e.g., two images) and then synthesizing them. For example, if there is a main subject and a background object located further away from the main subject in a captured scene, the user may want to adjust the size of the main subject and / or the background object to be different from the actual size. For example, the electronic device may store a plurality of images (e.g., two images) captured using at least one of a plurality of cameras (e.g., the first camera (312), the second camera (314), and the third camera (316) of FIG. 3), and may generate a composite image by enlarging or reducing the size of the main subject and / or the background object according to the user's editing and / or correction on the gallery application (420).

[0073] According to one embodiment, the electronic device may provide a function to separate (or segment) a specific object from an image and then enlarge and synthesize the separated object according to a user's input on the gallery application (420). For example, the electronic device may separate a specific object from an image acquired through any one of a plurality of cameras (e.g., the first camera (312), the second camera (314), and the third camera (316) of FIG. 3) according to a user's input, enlarge the separated object, and synthesize the separated object into the original image. This embodiment is limited to a method of substantially enlarging the size of the separated object, requires many steps for the user to go through during the image editing process, and / or may result in lower image quality as the size of the object is enlarged.

[0074] According to one embodiment, an electronic device may provide a function for isolating a specific object from an image on a gallery application (420), enlarging or reducing the image based on a user's input, and then synthesizing the image using the function of a generative AI. In the present embodiment, when a specific object is reduced, the empty space is not reflected with actual image information, but rather the generative AI obtains information from another image, which may result in unnatural parts in the synthesized image.

[0075] According to one embodiment, the electronic device may provide a function for separating a specific object from a first image and then synthesizing the separated object into a second image on the gallery application (420). For example, the electronic device may acquire a first image and a second image having different angles of view and / or zoom ratios using at least one (e.g., two) camera among a plurality of cameras. The electronic device may separate a specific object from the first image according to a user input and then synthesize the separated object into the second image. In the case of the present embodiment, although the user's complex needs can be reflected, the user may have to go through many steps in the form of post-capture correction.

[0076] Figure 4 illustrates the shooting and synthesis operations of the first image and the second image in the embodiments described above.

[0077] According to one embodiment, the electronic device may perform an operation (430) of capturing and storing a first image according to a user input using a camera application (410). For example, with one of the cameras of the electronic device (e.g., the first camera, the second camera, and the third camera of FIG. 3) activated, the electronic device may set a capturing angle according to the position of a main subject (e.g., a person) (432), capture a first image including the subject according to a user input for a capture button (434), and store the first image (436).

[0078] In one embodiment, the electronic device may perform an operation (440) of capturing and storing a second image before or after an operation (430) of capturing and storing a first image. For example, the electronic device may adjust a zoom ratio so that a background object is included in the image while activating one of the cameras of the electronic device (442), capture a second image including the subject according to a user input to a capture button (444), and store the second image (446).

[0079] According to one embodiment, the electronic device may perform an operation (450) of synthesizing a first image and a second image stored in a gallery application (420). For example, the electronic device may execute the gallery application (420) and, based on a user input, select a first image including a main subject and a second image including a background object. The electronic device may separate the main subject from the first image (452) and store the separated main subject image (454). The electronic device may synthesize the separated main subject image and the second image (456).

[0080] In one embodiment, the second image may have a different angle of view and / or zoom ratio than the first image. Alternatively, the electronic device may enlarge or reduce the size of the second image based on user input. Accordingly, the synthesized image may differ in the ratio of the main subject and background objects in the actual scene.

[0081] In order to implement a function of adjusting the ratio between the main subject and the background object as in the embodiment of FIG. 4, an image including the main subject and an image including the background object may be captured and saved separately, and an additional process of separating the subject in the gallery application (420) may be performed to create and save the images, and then the separated subject image may be synthesized with the background object image again (450). In this way, the ratio adjustment process requires many steps, and since the user can check the synthesized image only after going through all the editing processes, immediate confirmation may be difficult. In addition, a heterogeneous part may occur at the boundary when synthesizing the separated subject and background object. In addition, when synthesizing images acquired using different cameras, the size, ratio, or perspective of each object may vary depending on the optical characteristics of each camera, which may be insufficient to satisfy the complex needs of the user.

[0082] Fig. 4 may be a comparative example of an image capturing method using the dynamic zoom function described in Fig. 5 or below. However, the content disclosed in Fig. 4 is not recognized as prior art.

[0083] According to one embodiment, the electronic device may perform the processes of separating a main subject (452), storing the separated main subject image (454), and synthesizing the images (456) for the first image and the second image acquired using the dynamic zoom function.

[0084] FIG. 5 is a block diagram of an electronic device according to various embodiments.

[0085] Referring to FIG. 5, an electronic device (300) according to various embodiments may include a plurality of cameras (310), a display (330), a communication circuit (340), a processor (350), and a memory (320). Even if at least some of the illustrated configurations are omitted or replaced with other configurations, various embodiments of the present document may be implemented. In addition to the illustrated configurations, the electronic device (300) may further include at least some of the configurations and / or functions of the electronic device (101) of FIG. 1. At least some of the respective configurations of the illustrated (or not illustrated) electronic device (300) (e.g., the communication circuit (340), the processor (350), the memory (320)) may be disposed within a housing of the electronic device (300), and at least some of the other configurations (e.g., the display (330), the cameras (310)) may be at least partially visually exposed to the outside of the housing. At least some of the components of the electronic device (300) may be operatively, functionally and / or electrically connected to one another.

[0086] According to one embodiment, the display (330) can display image information provided from the processor (350). The display (330) can be implemented as any one of a liquid crystal display (LCD), a light-emitting diode (LED) display, and an organic light-emitting diode (OLED) display, but is not limited thereto. The display (330) can be configured as a touch screen that detects a touch and / or proximity touch (or hovering) input using a part of a user's body (e.g., a finger) or an input device (e.g., a stylus pen). The display (330) can include at least some of the configurations and / or functions of the display module (160) of FIG. 1.

[0087] According to one embodiment, the display (330) may be a flexible display having at least a portion that is flexible. The electronic device (300) may be implemented in various form factors, such as a foldable device or a rollable device, in which the size of the display area can be changed by utilizing the characteristics of the flexible display.

[0088] According to one embodiment, the electronic device (300) may include at least one camera on the front and / or the back. As described with reference to FIG. 3, the electronic device (300) may include three cameras (e.g., a first camera (312), a second camera (314), and a third camera (316)) on the back of the housing where the back cover is disposed; however, the number of cameras included in the electronic device (300) is not limited thereto. In this document, the electronic device (300) is described as including a first camera (312), a second camera (314), and a third camera (316); however, various embodiments of this document may be implemented even when the electronic device (300) includes two cameras or four or more cameras. In addition, although this document describes implementing the dynamic zoom function by using at least one of the cameras (312, 314, 316) positioned on the rear of the electronic device, the dynamic zoom function may also be implemented by further using images acquired from a camera positioned on the front (not shown) or an external camera (not shown) connected by wire or wirelessly.

[0089] According to one embodiment, the cameras (310) may further include at least some of the components and / or functions of the camera module (180) of FIG. 2, such as a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250), and an image signal processor (260).

[0090] According to one embodiment, the cameras (310) are arranged adjacent to each other so that they can capture images in substantially the same direction. Accordingly, even when the zoom ratio is switched from the digital zoom range of the first camera (312) to the analog optical zoom range of the second camera (314), and even when the digital zoom range of the second camera (314) is switched to the analog optical zoom range of the third camera (316), the change in the angle of view of the image provided through the preview can be substantially continuous.

[0091] In one embodiment, each of the cameras (310) can capture images with different angles of view. For example, the first camera (312) can be an ultra-wide camera (or UW (ultra-wide) camera) that captures images with a very wide angle of view (e.g., about 120 degrees), the second camera (314) can be a wide-angle camera (or W (wide) camera) that captures images with a wide angle of view (e.g., about 84 degrees), and the third camera (316) can be a telephoto camera (or T (telescope) camera) that captures images with a narrow angle of view (e.g., about 20 degrees). Accordingly, when the electronic device (300) captures the same scene with the first camera (312) and the second camera (314), when shooting with the first camera (312), a scene with a relatively wide angle of view is captured, so the size of a specific subject may be small, and when shooting with the second camera (314), a scene with a relatively narrow angle of view is captured, so the size of a specific subject may be large.

[0092] According to one embodiment, the memory (320) may temporarily or permanently store various data, including volatile memory and non-volatile memory. The memory (320) may include at least some of the configuration and / or functions of the memory (130) of FIG. 1 and may store the program (140) of FIG. 1. The memory (320) may store various instructions that may be executed by the processor (350). Such instructions may include control commands such as arithmetic and logical operations, data movement, and input / output that may be recognized by the processor (350).

[0093] According to one embodiment, the processor (350) may be configured to perform calculations or data processing related to control and / or communication of each component of the electronic device (300), and may be configured with one or more processors. For example, the processor (350) may correspond to a plurality of processors that collectively perform a plurality of operations by dividing them among the processors. The processor (350) may include at least some of the configurations and / or functions of the processor (120) of FIG. 1. The calculation and data processing functions that the processor (350) may implement on the electronic device (300) are not limited, but in this document, various embodiments for synthesizing and capturing an image including a main subject image and a background object will be described in detail. The operations of the processor (350) described below may be performed by loading instructions stored in the memory (320).

[0094] In this document, the description that a processor (350) can perform a certain operation (or function, work, task) may be interpreted to mean substantially the same as that an instruction (or command, computer program) that causes the electronic device (300) (or processor (350)) to perform the corresponding operation is stored in the memory (320) (e.g., non-volatile memory, storage). In addition, the description that a processor (350) can perform a certain operation may be interpreted to mean substantially the same as that at least one processor, without specifying the operation, can perform the corresponding operation.

[0095] According to one embodiment, the electronic device (300) may provide a dynamic zoom function through a camera application or another application utilizing camera resources. In this document, the dynamic zoom function may refer to a function that fixes the size of a specific object (e.g., a main subject) within an image through image synthesis, while adjusting the size of another object (e.g., a background object) or other remaining areas of the image through zooming in or out.

[0096] According to one embodiment, when a camera application is executed, the processor (350) may activate any one of the first camera (312), the second camera (314), and the third camera (316), and display a preview image including an image acquired in real time using the activated camera through the display (330). For example, in response to the execution of the camera application, the processor (350) may activate the second camera (314) (e.g., W (wide) camera) set as a default, and display a preview image through the display (330) at a predetermined zoom ratio (e.g., x1.0).

[0097] According to one embodiment, the processor (350) may execute the dynamic zoom mode when an image acquired through an activated camera satisfies a specified condition. According to one embodiment, when the specified condition is satisfied, the processor (350) may display an item capable of triggering the dynamic zoom mode on the display (330) and execute the dynamic zoom mode based on a user input for the item. Alternatively, when the specified condition is satisfied, the processor (350) may execute the dynamic zoom mode directly without additional user input.

[0098] According to one embodiment, the specified condition for triggering the dynamic zoom mode may include whether the image acquired from the activated camera includes the entire area of ​​the main subject (or first object) and a portion of the background object (or second object). Here, the background object may be an object located behind the main subject from the electronic device (300). For example, if a specific person is located in front of a specific building in a shooting scene and an image is to be captured centered on the person, the entire area or a portion of the building may be formed in the image depending on the distance between the electronic device (300) and the person and the building, the size of the building, and / or the angle of view of the activated camera. In this case, when capturing using the second camera (314) or the third camera (316) having a relatively narrow angle of view among the cameras (310) of the electronic device (300), only a portion of the background object (e.g., the building) is formed in the image, and when capturing using the first camera (312) having a relatively wide angle of view, the entire area of ​​the background object may be formed in the image. The processor (350) may perform a shooting process in a normal mode when the entire area of ​​the main subject and the entire area of ​​the background object are included within the field of view of the acquired image, and may directly execute a dynamic zoom mode when the entire area of ​​the main subject and a part of the background object are included within the field of view (or a part of the outer edge of the background object is cut off), or may provide a UI that can execute a dynamic zoom mode.

[0099] In one embodiment, the processor (350) may determine that a portion of a background object is included in the image if the boundary of the background object is not recognized within the image. For example, the processor (350) may use at least one of various edge detection algorithms to determine whether the boundary of the background object is included within the image.

[0100] According to one embodiment, the processor (350) can determine whether the entire area or a portion of the background object is formed within the image by using the continuity of pixel data of image pixels or by using a technique for identifying the type of object and the shape of the object by type.

[0101] According to one embodiment, the specified condition for triggering the dynamic zoom mode may be based on the type of scene of the captured image and / or the type of object included in the image. For example, the processor (350) may determine, as the type of scene, whether the photo the user is trying to capture is a landscape, a person, an animal, a sport, a panorama, a night scene, a party, a nature, a city, an indoor, or an outdoor photo. In addition, the processor (350) may determine, as the type of object in the image, whether each of at least one object included in the image is a person, an animal, a building, the sky, the sea, a mountain, or an object (e.g., a car, an airplane, a bag, a piece of clothing). The processor (350) may trigger the dynamic zoom mode when the recognized scene is one of the specified types (e.g., landscape, night scene, nature, outdoor, etc.), the main subject is one of the specified types (e.g., person, animal, etc.), and / or the background object is one of the specified types (e.g., building, mountain, tree, etc.). According to one embodiment, the processor (350) may trigger the dynamic zoom mode further based on the composition of the image being acquired. For example, the processor (350) may determine whether the composition of the image being acquired is a central composition in which the main subject is positioned at the center of the screen, a split composition in which the main subject is divided and arranged vertically or horizontally, or a composition combining a central composition and a split composition.

[0102] According to one embodiment, the processor (350) may recognize whether a background object corresponds to a defined landmark based on current location information of the electronic device (300) and / or image information acquired through a camera. If the background object corresponds to a defined landmark, the processor (350) may execute a dynamic zoom mode and recommend a suitable shooting position or posture for capturing the landmark.

[0103] According to one embodiment, the processor (350) may provide a UI indicating the dynamic zoom mode when the dynamic zoom mode is executed. For example, the processor (350) may overlay an item indicating the dynamic zoom mode on a preview image, and / or display an item indicating the dynamic zoom mode through a mode setting UI.

[0104] According to one embodiment, when the dynamic zoom mode is executed, the processor (350) may select the currently activated camera as the primary camera to acquire the first image. Hereinafter, among the cameras (310) of the electronic device (300), a camera that captures a first image including a portion of the main subject and a background object in the dynamic zoom mode may be defined as a primary camera, and a camera that captures a second image including the entire area of ​​the main subject and the background object after capturing the first image may be defined as a secondary camera. For example, the electronic device (300) may use at least one of the first camera (312), the second camera (314), or the third camera (316) as the primary camera or the secondary camera. Alternatively, the electronic device (300) may use at least one external camera connected to the electronic device by wire or wirelessly as the primary camera or the secondary camera. In one embodiment, the processor (350) may select a camera with a wider field of view than the primary camera as the secondary camera. In another embodiment, the electronic device may use a single camera as both the primary camera and the secondary camera.

[0105] According to one embodiment, the processor (350) may display a first preview image including a first image of a first zoom ratio acquired using a primary camera on the display (330). According to one embodiment, the processor (350) may use a camera activated before the dynamic zoom mode is executed as the primary camera, and may maintain the previous zoom ratio even when the dynamic zoom mode is executed.

[0106] According to one embodiment, the processor (350) may select a secondary camera among the cameras (310) to be used in dynamic zoom mode. According to one embodiment, the processor (350) may select a camera among the cameras (310) that has a wider angle of view than the primary camera (or the currently activated camera) as the secondary camera. For example, when the second camera (314) (or W camera) is acquiring an image as the primary camera and displaying it as a preview image, the processor (350) may select the first camera (312) (or UW camera) that has a wider angle of view than the second camera (314) as the secondary camera.

[0107] According to one embodiment, the processor (350) may select, as the secondary camera, a camera among the cameras (310) that can include a larger area of ​​a background object than the primary camera. For example, the processor (350) may select, but is not limited to, a camera among the cameras (310) that can include the entire area of ​​a background object in an image as the secondary camera. The processor (350) may determine, at the current location, a camera that can include a larger area (e.g., the entire view) of a background object in an image, considering the angle of view and / or magnification, among the cameras (310) that the electronic device (300) may provide. For example, if the first image acquired by the third camera (316) (or T camera), which is the primary camera, includes a main subject and a portion of a background object, the processor (350) may activate the second camera (314) (or W camera) in the background to acquire the image. The processor (350) may activate the first camera (312) (or UW camera) in the background to acquire an image if the image acquired through the second camera (314) does not include the entire area of ​​the background object, or if at least a portion of the boundary of the background object is not included in the image. The processor (350) may determine the first camera (312) as a secondary camera if the image acquired through the first camera (312) includes the entire area of ​​the background object.

[0108] According to one embodiment, the processor (350) may determine the composition and / or ratio of the image through at least one of the depth of the image, the distance between the main subject and the background object, the distance between the electronic device (300) and the main subject and the background object, the ratio of the area each of the main subject and the background object occupies in the image, and the size difference between the plurality of objects, and may compare the composition and / or ratio with a reference composition and / or ratio that is stored in advance according to the type of the scene and / or object. The reference composition and / or ratio may be stored as a value in the form of a table that takes into account the position of the object on the image according to the size and / or resolution of the reference image or the image. The processor (350) may select a camera that can obtain image information of the background object according to the reference composition and / or ratio among the cameras (310) as a secondary camera.

[0109] According to one embodiment, if there is no camera capable of including the entire area of ​​a background object in an image, the processor (350) may provide a movement guide UI through the display (330) to guide movement of the user of the electronic device (300). For example, the processor (350) may analyze images acquired from each camera to determine in which direction and by how much the position of the electronic device (300) must be moved to include the entire image of the background object. The processor (350) may provide the user with the determined movement direction and / or distance through the movement guide UI on the preview image. The movement guide UI may include graphic elements indicating the movement direction, distance, angle, height, and / or the appearance of the object to be included in the changing field of view during movement. When the user of the electronic device (300) moves according to the movement guide UI, a specific camera may be able to capture the entire area of ​​the background object, and the corresponding camera may be selected as a secondary camera.

[0110] According to one embodiment, the processor (350) can capture an image by applying a composition, object-specific size, and ratio according to the type of scene and / or object that the user wants to capture. For example, the processor (350) can identify whether the photo to be captured is of a person or a specific object (e.g., a flower, food), and select a primary and / or secondary camera to capture the final photo by considering the recommended framing for the main subject and / or the recommended framing for the background object, or adjust the zoom ratio of the primary and / or secondary camera.

[0111] According to one embodiment, the processor (350) may capture and store a first image based on a user input while displaying a first preview image including a first image acquired using a primary camera on a display (330). For example, the user input for capturing an image may include a touch input to a capture button or a voice input.

[0112] According to one embodiment, the processor (350) may extract a main subject (or a first object) from a first image (or a first preview image) to generate a main subject image (or a first object image). The processor (350) may segment the main subject (e.g., a person) from the first image using an object segmentation function. According to one embodiment, the processor (350) may identify objects included in an image acquired through a currently activated camera and confirm an area of ​​the main subject. For example, the processor (350) may identify objects included in the image using various object detection algorithms based on deep learning, such as R-CNN (region-based convolutional neural networks), YOLO (you only look once), and SSD (single shot multibox detector). The processor (350) may store the main subject image generated from the first image in the memory (320).

[0113] According to one embodiment, when a first image is captured according to a user input, the processor (350) may display a second preview image, which includes a main subject image acquired from the first image and a second image acquired in real time through a secondary camera, on the display (330). When changing from the first preview image to the second preview image, the processor (350) may maintain the zoom ratio in the second preview image to be the same zoom ratio as that in the first preview image (e.g., the first zoom ratio). For example, when the first image is captured at a zoom ratio of x1.0 using the second camera (314), which is the primary camera, the processor (350) may set the zoom ratio of the first camera (312), which is the secondary camera, to x1.0, and crop and display the image acquired by the first camera (312) to correspond to x1.0. When switching to the second preview image, since the zoom ratio is the same as that of the first preview image, there is no sense of incongruity to the user, and the main subject can be displayed at practically the same size.

[0114] In one embodiment, the processor (350) may display guidelines related to capturing the second image to the user via the display (330) at least partially concurrently with the display of the second preview image. For example, the guidelines may include an outline indicating a range of acceptable shake of the electronic device (300), or a range within which a main subject should be positioned.

[0115] According to one embodiment, the processor (350) can adjust the zoom magnification of the second preview image to display a third preview image of the second zoom magnification. In this case, the processor (350) can fix the main subject image and only adjust the zoom magnification of the second image including the background object. The processor (350) can provide in real time through the display (330) an image change according to the change in the zoom magnification of the second image, and in this case, since the preview image is a composite of the second image whose zoom magnification is changed in real time and the main subject image having a fixed size, the main subject can be displayed in the same position regardless of the change in the zoom magnification. The processor (350) can adjust the zoom magnification of the second preview image according to the manual zoom mode or the automatic zoom mode.

[0116] According to another embodiment, the processor (350) may also change the size (or zoom ratio) of the main subject image while adjusting the zoom ratio of the second preview image. In this case, the processor (350) may change the size (or zoom ratio) of the main subject image by a smaller amount than the change in the size (or zoom ratio) of the second image.

[0117] According to one embodiment, when set to manual zoom mode, the processor (350) may provide a zoom setting UI through the display (330) that can set a zoom factor at least partially simultaneously with the display of the second preview image. For example, the zoom setting UI may be provided as selectable items corresponding to multiple zoom factors (e.g., x0.6, x1.0, x3.0), may be provided in the form of a scrollable bar that can select a specific zoom factor, and / or may be provided so that the zoom factor can be adjusted according to a user's multi-touch interaction (e.g., pinch to zoom).

[0118] According to one embodiment, the processor (350) may adjust the zoom ratio of an image acquired from a secondary camera based on a user input, and display the main subject image by overlapping it. According to one embodiment, the size of the main subject may be displayed by overlapping it with a fixed size. According to another embodiment, the size of the main subject may be changed according to the adjustment of the zoom ratio, but may be overlaid while changing by a smaller amount than the change in the size of the image acquired from the secondary camera. According to one embodiment, the processor (350) may adjust the zoom ratio according to the user input, and then capture the image acquired from the secondary camera based on the user input for the capture button. The process of changing the preview screen in the manual zoom mode will be described in more detail with reference to FIG. 13.

[0119] According to one embodiment, when set to auto zoom mode, the processor (350) may determine a second zoom factor to be applied to the second image based on a background object included in the second image captured by the secondary camera. According to one embodiment, the processor (350) may determine any one of zoom factors at which the entire area of ​​the background object included in the second image can be displayed as the second zoom factor. According to one embodiment, the processor (350) may determine a maximum zoom factor at which the entire area of ​​the background object included in the second image can be displayed as the second zoom factor. For example, at a first zoom factor, only a part of the background object may be included in the second preview image, and the processor (350) may gradually decrease the zoom factor at the first zoom factor to determine a zoom factor at which a boundary of the background object can be formed within the preview image. According to one embodiment, the second zoom factor to be applied to the second image may be determined according to a guide or reference composition provided by the electronic device (300).

[0120] According to one embodiment, the processor (350) may determine the second zoom factor by a binary search using the first zoom factor and the optical zoom factor of the secondary camera. For example, if the user takes the first image with the first zoom factor of the first preview image being x1.0, the processor (350) may determine the maximum zoom factor at which the boundary of the background object can be formed within the preview image by a binary search using the optical zoom factor of x0.6 of the secondary camera (e.g., UW camera) and the first zoom factor of x1.0. The processor (350) may crop the image to a size corresponding to x0.8, which is an intermediate value between x0.6 and x1.0, and then determine whether the boundary of the background object is formed within the image of x0.8. If the boundary line of the background object is not formed in the image of x0.8, the processor (350) can crop the image to a size corresponding to x0.7, which is an intermediate value between x0.6 and x0.8, and check whether the boundary line of the background object is formed. If the zoom ratio at which the boundary line of the background object is formed is confirmed in the binary search process, it is checked whether the boundary line of the background object is formed in the image of an intermediate value with a larger zoom ratio, and through this process, the maximum zoom ratio at which the boundary line of the background object is formed can be confirmed. The method of determining the second zoom ratio using the binary search method will be described in more detail with reference to FIG. 11.

[0121] According to one embodiment, the processor (350) may determine the second zoom factor by considering the size and position of the main subject, the distance from the background object, or the characteristics of the background object. For example, if the background object includes specific text or a characteristic shape, the processor (350) may determine the second zoom factor as a zoom factor that allows the text or shape to become larger than a certain size.

[0122] According to one embodiment, the processor (350) adjusts the zoom ratio of an image acquired from a secondary camera according to the determined second zoom ratio, and displays the main subject image by overlapping it with a fixed size. Accordingly, during the process of changing the zoom ratio, the main subject remains at the same size as before the change in the zoom ratio, and the background object can be provided with the effect of being zoomed in or out. The process of changing the preview screen in the automatic zoom mode will be described in more detail with reference to FIG. 12.

[0123] According to one embodiment, the processor (350) may, during the zoom ratio adjustment process, fix the size of at least one object selected based on a user input from among a plurality of objects included in a first image acquired from a primary camera. For example, if the first image includes two or more people, at least one of the people may be selected based on a user input, and the selected person may be extracted from the first image (or the first preview image) and maintained at a fixed size, while unselected people may be zoomed out together with the zoom-out of the second image. An embodiment of selecting a plurality of objects as a main subject will be described in more detail with reference to FIG. 16.

[0124] According to one embodiment, the processor (350) may capture a second image acquired from a secondary camera based on a user input to a shooting button when the zoom ratio of the preview image changes according to the determined second zoom ratio in the auto zoom mode, or capture the second image immediately after the change to the second zoom ratio without a user input.

[0125] According to one embodiment, the electronic device (300) may provide multiple screens that are logically or physically separated. For example, if the electronic device (300) is implemented as a foldable device, the display (330) may include a first region and a second region that are divided left and right or up and down along the folding axis. In this case, the processor (350) may display a preview image acquired from the first camera (312) or a photographed first image in the first region, and may display a preview image (e.g., a second preview image, a third preview image) that overlaps the second image and the main subject image in real time in the second region.

[0126] According to one embodiment, the processor (350) may acquire a second image while the third preview image is displayed, and generate a composite image (or dynamic zoom image) by synthesizing the main subject image extracted from the first image and the second image. For example, in the composite image, the ratio of the size of the main subject to the size of the background object may be larger compared to the first image, the second image, or the actual shooting scene. According to one embodiment, the processor (350) may perform an operation of generating a composite image by synthesizing the main subject image and the second image in the background while capturing an image in dynamic zoom mode.

[0127] According to one embodiment, the processor (350) can store the process of zooming in or out from the second preview image to the third preview image as video information in the memory (320).

[0128] According to one embodiment, the processor (350) may synthesize a main subject image with a background object of the second image by using feature detection and / or feature matching from the first image and / or the second image. For example, the processor (350) may find characteristic parts, such as shape, brightness, and color, in the first image and / or the second image through a feature extraction process. The processor (350) may find characteristic parts common between the two images through a feature matching process. For example, the processor (350) may find characteristic parts in each of the two images, measure the similarity of each characteristic part, and match the most similar characteristic parts to each other. The processor (350) may use the matched characteristic parts to match a main subject and a background object in two images with different magnifications, and may position the main subject separated from the first image at the correct position on the synthesized image (or dynamic zoom image).

[0129] In one embodiment, the processor (350) may perform feature extraction and / or feature matching processes for image synthesis using an AI model. For example, the processor (350) may transmit the first image and / or the second image to a server AI model via a communication module and receive the processing results of the server AI model, or may utilize an on-device AI model executed by the processor (350).

[0130] According to one embodiment, when a movement occurs in a main subject (e.g., a person) while a second preview image or a third preview image is displayed after a first image is acquired using a primary camera, the processor (350) may recognize the occurrence of the movement. For example, the person, which is the main subject, may move, such as by raising a hand, before capturing a second image using a secondary camera. In this case, interference may occur between the area of ​​the person, which is the main subject, and the area of ​​the building, which is the background object, as the hand is raised. That is, the area where the person raised his hand may be the area where the building is displayed in the first image, but the area where the person's hand is displayed in the second image. According to one embodiment, when a movement of the main subject occurs before acquiring the second image while displaying the second preview image or the third preview image, the processor (350) may use an AI model to perform in-painting or out-painting processing on the interfered area.

[0131] According to one embodiment, the processor (350) may continuously or periodically acquire second image information by operating the secondary camera in the background while operating the primary camera or at least partly simultaneously with the time during which the first image information is acquired through the primary camera. The processor (350) may use at least a portion of the second image information acquired through the background operation to generate a composite image through synthesis with a main subject image. For example, if movement occurs in the main subject (e.g., a person) and interference occurs between the main subject and a background object while the second preview image or the third preview image is displayed after acquiring the first image, the processor (350) may use second image information acquired in advance using the secondary camera at or before the time when the main subject image is acquired to generate a composite image.

[0132] According to one embodiment, the processor (350) may extract a main subject from a second image captured using a secondary camera, remove an area of ​​the main subject, and in-paint the removed area with reference to image information of a surrounding area using an AI model to generate a third image. The processor (350) may notify a user that a third image has been generated in which the main subject has been removed and only the background area remains. The processor (350) may display a preview screen including the generated third image as a second preview image by overlapping the main subject image obtained by extracting the main subject from the first image, and may change the zoom magnification of the third image to display the third preview image.

[0133] According to one embodiment, when a shooting command is received while the primary camera is operating and first image information is acquired, and movement occurs in the primary subject, the processor (350) can notify the user of a change in the primary subject through the UI.

[0134] According to one embodiment, the processor (350) may determine a zoom ratio of the secondary camera related to a background object using second image information acquired through the secondary camera in the background while a preview image acquired through the primary camera is displayed, store the first image acquired through the primary camera in response to a user's shooting command, and store a composite image (or dynamic zoom image) obtained by synthesizing the main subject image extracted from the first image and the second image acquired through the secondary camera in the memory (320).

[0135] According to one embodiment, the processor (350) may generate a composite image (or dynamic zoom image) and then change the secondary camera to another camera among the cameras (310) to generate a composite image again. For example, the processor (350) may select the third camera (316) as the primary camera and the second camera (314) as the secondary camera, and may generate and store a first composite image by synthesizing the main subject image acquired by the third camera (316) and the background object image acquired by the second camera (314), and may select the third camera (316) as the primary camera and the first camera (312) as the secondary camera, and may generate and store a second composite image by synthesizing the main subject image acquired by the third camera (316) and the background object image acquired by the first camera (312). For example, when a plurality of background objects are positioned in the background of the main subject, the processor (350) may generate a first composite image including the main subject captured by the third camera (316) and a first background object (e.g., a part of a building, a natural object, a sign, a trademark) of a relatively small size captured by the second camera (314), and may generate a second composite image including the main subject captured by the third camera (316) and a second background object (e.g., an entire building) of a relatively large size captured by the first camera (312).

[0136] According to one embodiment, the processor (350) may acquire a main subject image with a primary camera (e.g., a third camera (316)), adjust a zoom ratio of a secondary camera (e.g., a second camera (314)) while keeping the size of the main subject image fixed to acquire an image of a first background object, and adjust a zoom ratio of a tertiary camera (e.g., a first camera (312)) while keeping the main subject image and the first background object image fixed to acquire an image of a second background object, and then synthesize the main subject image, the first background object image, and the second background object image captured with different zoom ratios to generate a composite image (or final image).

[0137] According to one embodiment, the processor (350) may perform various post-processing processes on the generated composite image (or dynamic zoom image) and then store the results in the memory (320). For example, the post-processing processes may include edge correction and / or wide-angle distortion correction. Edge correction may include a process of setting and adjusting the area of ​​the boundary through a tri-mapping process, and processing the boundary at a low scale to blur it to create a natural result. The processor (350) may perform edge correction on the boundary between the main subject and the background object when compositing the main subject image and the second image. In addition, the processor (350) may correct distortion caused by differences in refractive indices of the main subject and the background object captured at different angles to create a natural result. The processor (350) may perform various other image post-processing operations.

[0138] According to one embodiment, the processor (350) may provide the user with composite images (or dynamic zoom images) stored in the memory (320) through a gallery application.

[0139] According to one embodiment, the processor (350) may select one of the first image, the second image, and the composite image stored through the gallery application as a representative photo and provide it as a thumbnail. Based on a user input for the thumbnail, the processor (350) may display at least one of the first image, the second image, and the composite image, and may provide a menu through which the user can set options such as storing, deleting, or editing the image.

[0140] According to one embodiment, the processor (350) may provide a function to select and modify the magnification of a background object in a gallery application. For example, the processor (350) may store image information acquired before the secondary camera acquires a second image as video information. For example, the stored video information may include a fixed-size main subject image and an image in which the zoom magnification changes from a second preview image to a third preview image. When a user adjusts the zoom magnification of a background object in a dynamic zoom image of the gallery application, the processor (350) may acquire a frame corresponding to the zoom magnification adjusted by the user based on the previously stored video information and synthesize it with the main subject image.

[0141] In one embodiment, the composite image may be a still image or a video. For example, if the processor (350) wishes to implement the composite image as a video, it may capture a video by extracting the main subject area from the first video information acquired using the primary camera, zooming out the second video information acquired using the secondary camera, and then synthesizing it with the main subject area.

[0142] Instructions for performing the operations of the electronic device (300) (or processor (350)) described above may be stored on a computer-readable recording medium. The recording medium may be tangible and non-transitory. The recording medium may store one or more computer programs including the instructions.

[0143] FIG. 6 illustrates an image obtained using a first camera and a second camera of an electronic device according to one embodiment.

[0144] According to one embodiment, an electronic device (e.g., electronic device (300) of FIG. 5) may include a first camera (e.g., first camera (312) of FIG. 3, first camera (312) of FIG. 5) and a second camera (e.g., second camera (314) of FIG. 3, second camera (314) of FIG. 5) having different angles of view. For example, the first camera may be an ultra-wide (UW) camera capable of capturing an image with an angle of view corresponding to an analog optical zoom ratio of x0.6, and the second camera may be a wide (W) camera capable of capturing an image with an angle of view corresponding to an analog optical zoom ratio of x1.0.

[0145] In one embodiment, the first camera and the second camera are positioned adjacent to each other so that they can capture images in substantially the same direction. Accordingly, the main subject may be included in both the first camera's image and the second camera's image, and at least some objects other than the main subject may be included in the first camera's image but not in the second camera's image.

[0146] According to one embodiment, the image (610) captured by the first camera may have a relatively wide angle of view. Referring to (a) of FIG. 6, the image (610) captured by the first camera includes a person (622) as the main subject, a building (624) as the background object, and may further include other surrounding objects (626, 628). The image (630) captured by the second camera may have a narrower angle of view than the image (610) of the first camera. Referring to (b) of FIG. 6, the image (630) captured by the second camera may include only a portion (644) of the person (642) as the main subject and the building as the background object.

[0147] According to one embodiment, the electronic device may acquire a first image (610) and a second image (630) having different angles of view, and display the first image (610) as a preview image by overlapping the main subject (642) extracted from the second image (630). When the electronic device changes the zoom ratio according to a user input or automatically changes the zoom ratio (e.g., zoom-in / zoom-out) to a determined zoom ratio, the zoom ratio of the first image (610) may be changed, but the size of the main subject (642) extracted from the second image (630) may be fixed.

[0148] FIG. 7 is a flowchart of a method for an electronic device to execute a dynamic zoom mode according to one embodiment.

[0149] According to one embodiment, the illustrated method (700) can be performed by an electronic device (e.g., the electronic device (300) of FIG. 5), and the technical features described above may be omitted from the description below.

[0150] According to one embodiment, at operation 710, the electronic device may execute a camera application.

[0151] In one embodiment, at operation 720, the electronic device may activate the primary camera and display a first image acquired from the primary camera as a first preview image on the display. The first image may include a portion of a main subject (e.g., a person) and a background object (e.g., a building).

[0152] According to one embodiment, in operation 730, the electronic device may extract a main subject and a background object from the first image. For example, the electronic device may use an object segmentation function in the first image to separate an area of ​​each object including the main subject (or first object).

[0153] According to one embodiment, in operation 740, the electronic device may determine whether a boundary line of a background object (or a second object) is formed within the first image. If the first image includes only a portion of the background object, the boundary line of the background object may not be formed within the first image.

[0154] According to one embodiment, the electronic device may determine whether to trigger a dynamic zoom mode based further on the scene of the captured image and / or the type of object included in the image.

[0155] According to one embodiment, if the boundary of the background object is not formed within the first image, in operation 750, the electronic device may provide a UI suggesting a dynamic zoom mode. For example, the electronic device may display an item indicating the dynamic zoom mode on the preview image, and / or display an item indicating the dynamic zoom mode through a mode setting UI.

[0156] According to one embodiment, at operation 760, the electronic device can determine whether a user input for executing a dynamic zoom mode is received, and if the user input is received, at operation 770, execute the dynamic zoom mode according to the user input.

[0157] According to one embodiment, the electronic device may provide an item indicating the execution of the dynamic zoom mode on the preview image when the dynamic zoom mode is executed. According to one embodiment, even when the dynamic zoom mode is executed, the electronic device may continue to display the preview image acquired from the active primary camera at the same zoom ratio as before the dynamic zoom mode was executed.

[0158] According to one embodiment, if the boundary of the background object is formed within the first image as a result of the verification in operation 740, or if no user input for executing the dynamic zoom mode is received in operation 760, then in operation 780, the electronic device may operate in the normal zoom mode.

[0159] According to one embodiment, instructions for performing each operation constituting the method may be stored in a tangible, non-transitory computer-readable recording medium.

[0160] FIG. 8 illustrates a UI provided by an electronic device when executing dynamic zoom mode according to one embodiment.

[0161] Figure 8 (a) illustrates a screen provided through a display (320) of an electronic device (300) when a specified condition for triggering a dynamic zoom mode is satisfied.

[0162] Referring to (a) of FIG. 8, the camera application screen of the electronic device (300) may include a preview area (810) where a preview image is displayed, an option menu area (820) including menus for setting various shooting-related options (e.g., filter, motion photo, ratio, timer, flash), a shooting button area (840) including a shooting button (842), a gallery launch button (844), and a front / rear camera switching button (846), and a mode setting area (830) including items for selecting a shooting mode.

[0163] According to one embodiment, the electronic device (300) may provide an item (832) capable of executing the dynamic zoom mode when a specified condition for triggering the dynamic zoom mode is satisfied, for example, when the entire area of ​​the background object is not formed within the first image and / or the boundary of the background object is not formed within the first image. The electronic device (300) may execute the dynamic zoom mode when a user input for the item (832) is received. In addition, when a user input for an item (834) capable of switching to the normal zoom mode while the dynamic zoom mode is running is received, the electronic device (300) may switch back to the normal zoom mode. According to another embodiment, the electronic device (300) may execute the dynamic zoom mode when a user input for the item (832) capable of executing the dynamic zoom mode is received within the mode setting area (830) without a process of analyzing information within the image to determine whether the specified condition is satisfied.

[0164] According to one embodiment, the electronic device (300) may provide an auto selection item (812) that allows automatic shooting or manual shooting to be selected in a dynamic zoom mode. For example, automatic shooting may be a method in which, when a shooting command is received while the first preview image is displayed, a second preview image is displayed that overlaps a main subject image extracted from the first image with a second image, and after the zoom ratio is changed, the second image is captured without additional user input and is synthesized and saved with the main subject image. Manual shooting may be a method in which, while the second preview image is displayed, the zoom ratio is changed and, in response to a user's input to a shooting button (842), the second image is captured and a composite image (or dynamic zoom image) is saved. According to one embodiment, the auto selection item (812) may be configured as a button that can be turned on / off by touch input, and may be displayed as an overlay on the preview image on the preview area (810).

[0165] Referring to (b) of FIG. 8, when a user input for an auto selection item (812) is received, the electronic device (300) may proceed with automatic shooting and highlight the auto selection item (812) to instruct automatic shooting as in (c) of FIG. 8.

[0166] FIG. 9 is a flowchart of a method for an electronic device according to one embodiment to synthesize a main subject and a background object and provide it as a preview.

[0167] According to one embodiment, the illustrated method (900) can be performed by an electronic device (e.g., the electronic device (300) of FIG. 5), and the technical features described above may be omitted from the description below.

[0168] According to one embodiment, in operation 910, the electronic device may execute a dynamic zoom mode. When the dynamic zoom mode is executed, the electronic device may provide an item indicating the dynamic zoom mode through a preview area and / or a mode setting area of ​​the camera application screen. Even when the dynamic zoom mode is executed, the electronic device may continuously display images acquired from a previously activated primary camera at the same zoom ratio as before (e.g., the first zoom ratio).

[0169] According to one embodiment, in operation 920, the electronic device may receive a first user input for capturing an image and acquire a first image. For example, the electronic device may receive a first user input for a capture button while a first preview image is displayed. In response to the first user input, the electronic device may acquire a first image at a first zoom ratio.

[0170] According to one embodiment, in operation 930, the electronic device may extract and separate a main subject (or first object) (e.g., a person) from a first image. The first image may include the main subject and a portion of a background object positioned behind the main subject, and the electronic device may separate the main subject from the first image using an object segmentation function. The electronic device may store the extracted and separated area of ​​the main subject as a main subject image (or first object image).

[0171] In one embodiment, at operation 940, the electronic device may acquire a second image using a secondary camera.

[0172] According to one embodiment, the electronic device may select a camera among the cameras that can include the entire area of ​​the background object in the image as the secondary camera. For example, if the primary camera is a second camera (or a W camera) with a relatively narrow angle of view, the electronic device may select a first camera (or a UW camera) with a relatively wide angle of view as the secondary camera. According to one embodiment, the electronic device may select a camera among the cameras that can acquire image information of the background object according to a standard composition and / or ratio as the secondary camera.

[0173] According to one embodiment, if none of the cameras can capture the entire area of ​​a background object within an image, the electronic device may provide a movement guide UI via the display to guide the user of the electronic device to move. When the user of the electronic device moves according to the movement guide UI, a specific camera can capture the entire area of ​​the background object, and the camera can be selected as the secondary camera.

[0174] According to one embodiment, the electronic device may display a second preview image by overlapping a main subject image (or a first object image) with a second image. When changing from the first preview image to the second preview image, the electronic device may maintain the zoom ratio at the same zoom ratio as that of the first preview image (e.g., the first zoom ratio). Accordingly, when switching to the second preview image, the user does not experience a sense of incongruity, and the main subject may be displayed at substantially the same size.

[0175] According to one embodiment, in operation 950, the electronic device may determine a zoom factor according to a boundary line of a background object of the second image. According to one embodiment, the electronic device may determine a zoom factor (or a maximum zoom factor) at which the entire area of ​​the background object included in the second image can be displayed as the second zoom factor. For example, at the first zoom factor, only a part of the background object may be included in the second preview image, and the electronic device may gradually decrease the zoom factor from the first zoom factor to determine a zoom factor at which a boundary line of the background object can be formed within the preview image. According to one embodiment, the second zoom factor may be determined by a binary search using the first zoom factor and the optical zoom factor of the secondary camera.

[0176] According to one embodiment, when set to manual zoom mode, the electronic device provides a zoom setting UI that can set a zoom factor at least partially simultaneously with display of a second preview image, and determines the second zoom factor based on a user input to the zoom setting UI.

[0177] According to one embodiment, in operation 960, the electronic device can fix the main subject and adjust the zoom ratio of the second image according to the determined zoom ratio. Accordingly, during the process of changing the zoom ratio, the main subject can be maintained at the same size, while the background object can be zoomed out, providing an effect.

[0178] According to one embodiment, the electronic device can capture the second image automatically or based on a user's shooting command after the zoom ratio of the second image is changed.

[0179] According to one embodiment, instructions for performing each operation constituting the method (900) may be stored in a tangible, non-transitory computer readable recording medium.

[0180] FIG. 10 illustrates a process of an electronic device extracting a main subject from a first image according to one embodiment.

[0181] According to one embodiment, an electronic device (e.g., the electronic device (300) of FIG. 5) may display, on a display, a first preview image including a first image (1010) acquired from one of the cameras (e.g., the primary camera) among the first camera (312), the second camera (314), and the third camera (316) of FIG. 5) while the dynamic zoom mode is running. Referring to FIG. 10, the first image (1010) may include a person (1012) as a main subject and a portion of a building (1032) as a background object.

[0182] According to one embodiment, the electronic device can acquire a first image (1010) in response to a first user history while the first preview image is displayed.

[0183] According to one embodiment, the electronic device can extract a main subject (or first object) included in the acquired first image (1010). According to one embodiment, the electronic device can segment the main subject (e.g., a person) (1012) from the first image (1010) using an object segmentation function. The electronic device can identify objects included in the first image and confirm an area (1022) of the main subject among the identified objects. For example, the electronic device can identify objects included in the image using various object detection algorithms based on deep learning, such as R-CNN (region-based convolutional neural networks), YOLO (you only look once), and SSD (single shot multibox detector).

[0184] According to one embodiment, the electronic device can highlight and display an area (1022) of the extracted main subject.

[0185] According to one embodiment, the main subject image generated from the first image (1010) of the electronic device can be temporarily stored in memory.

[0186] Referring to FIG. 10, the electronic device can extract an area (1022) of a person as a main subject from a first image (1010) and store it as a main subject image (or first object image).

[0187] FIG. 11 illustrates a process by which an electronic device according to one embodiment determines a zoom ratio corresponding to the boundary of a background object.

[0188] Referring to FIG. 11, when an electronic device acquires a first image using a second camera (e.g., the second camera (314) of FIG. 5) as a primary camera, the electronic device may select the first camera (e.g., the first camera (312) of FIG. 5) as a secondary camera to acquire a second image (1110). The first camera may have a wider angle of view than the second camera.

[0189] According to one embodiment, the electronic device may determine a second zoom magnification to be applied to the second image (1110) based on a background object included in the second image (1110) captured by the secondary camera. According to one embodiment, the electronic device may determine a zoom magnification (or maximum zoom magnification) at which the entire area of ​​the background object included in the second image (1110) can be displayed as the second zoom magnification. For example, at the first zoom magnification, only a part of the background object may be included in the second preview image, and the electronic device may gradually decrease the zoom magnification at the first zoom magnification to determine a zoom magnification at which a boundary line of the background object can be formed within the preview image.

[0190] In one embodiment, the boundary of a background object may or may not be included in the image (or preview image) depending on the zoom factor. For example, in the case of an image captured by zooming in at a relatively high magnification (e.g., x1.0, x0.8), the boundary of the background object may be formed outside the field of view of the image due to the relatively narrow field of view, and thus the boundary of the background object may not be formed within the image. In this case, when the electronic device zooms out at a low magnification (e.g., x0.7), the field of view increases and the boundary of the background object may be included within the image.

[0191] In one embodiment, the electronic device can determine the second zoom factor using a binary search method. The binary search method is an algorithm for quickly finding a specific value in a sorted array. The binary search method divides the array in half to narrow the search range and find the target value. The electronic device can determine the second zoom factor using the binary search method using the first zoom factor of the first preview image and the optical zoom factor of the second camera.

[0192] According to one embodiment, when a user captures a second image (1110) with a first zoom magnification of the first preview image being x1.0, the electronic device can determine the maximum zoom magnification at which a boundary of a background object can be formed within the preview image by using a binary search method using x0.6, which is an optical zoom magnification of the first camera determined as a secondary camera, and x1.0, which is the first zoom magnification.

[0193] Referring to FIG. 11, the electronic device can crop the second image (1110) into an image (1122) having a zoom ratio of x1.0 and display the image as a second preview image. The electronic device can crop an image (1124) to a size corresponding to x0.8, which is an intermediate value between x0.6 and x1.0, and then check whether a boundary line of a background object is formed within the image (1124) of x0.8. If a boundary line of a background object is not formed within the image (1124) of x0.8, the electronic device can crop an image (1126) to a size corresponding to x0.7, which is an intermediate value between x0.6 and x0.8, and then check whether a boundary line of a background object is formed within the image (1126) of x0.7.

[0194] According to one embodiment, when a zoom ratio at which a boundary line of a background object is formed is confirmed in a binary search process, the electronic device can determine whether a boundary line of a background object is formed in an image of an intermediate value with a larger zoom ratio, and through this process, can determine a maximum zoom ratio at which a boundary line of a background object is formed.

[0195] According to the embodiment of FIG. 11, the image (1126) of x0.7 includes the entire area of ​​the background object, and the image (1124) of x0.8 does not include the entire area of ​​the background object, and in this case, the electronic device can determine x0.7 as the second zoom magnification.

[0196] FIG. 12 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0197] According to one embodiment, when the second zoom ratio is determined, the electronic device (300) can change the zoom ratio of the second image to the second zoom ratio, and display the second image at the second zoom ratio and the main subject image (1260) (or the first object image) as a third preview image on the display by overlapping them.

[0198] According to one embodiment, when a first image with a first zoom ratio is captured in a dynamic zoom mode, the electronic device (300) may crop a second image acquired from a first camera determined as a secondary camera with the first zoom ratio, and display the cropped image as a second preview image on the display by overlapping the main subject image (1260) extracted from the first image.

[0199] Referring to (a) of FIG. 12, the first zoom magnification may be x1.0, and the electronic device (300) may display a second preview image (1272) by overlapping a main subject image (1260) extracted from the first image and a second image cropped to x1.0. The zoom magnification of the second preview image (1272) may be the same as the zoom magnification of the first preview image previously displayed, thereby providing continuity of the preview images.

[0200] According to one embodiment, the electronic device (300) can change the zoom magnification of the second image to the second zoom magnification according to the determined second zoom magnification. The electronic device (300) can display the second image at the second zoom magnification and the main subject image (1260) as a third preview image by overlapping them on the display. For example, the second zoom magnification may be x0.7, and the electronic device (300) can zoom out the second image from x1.0, which is the first zoom magnification, to x0.7. In this case, the size of the main subject image (1260) may be fixed.

[0201] Referring to (b) of FIG. 12, the size of the main subject (1260) is fixed, while the background object (e.g., a building) of the second image is zoomed out, so that a larger area of ​​the background object can be provided as a preview image (1274).

[0202] (c) of Fig. 12 shows a state in which the second image is zoomed out to the second zoom magnification, and the size of the main subject (1260) is fixed while the entire area of ​​the background object can be provided as a preview image (1276). In this way, in the process of changing in the order of (a), (b), and (c) of Fig. 12, the main subject can be maintained at the same size while the background object can be provided with an effect of being zoomed out.

[0203] FIG. 13 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0204] According to one embodiment, when the dynamic zoom mode is set to the manual zoom mode, the electronic device (300) may provide a zoom setting UI (1320) that can set a zoom factor at least partially simultaneously with the display of the second preview image through the display (1310). For example, the zoom setting UI (1320) may be provided as selectable items corresponding to several zoom factors (e.g., x0.6, x1.0, x3.0), may be provided in the form of a scrollable bar that can select a specific zoom factor, and / or may be provided so that the zoom factor can be adjusted according to a user's multi-touch interaction (e.g., pinch to zoom).

[0205] According to one embodiment, referring to (a) of FIG. 13, the zoom setting UI (1320) may be provided in the form of a scrollable bar in various zoom ratio ranges, and the zoom ratio may be changed according to the user's touch and drag. The zoom setting UI (1320) may be displayed overlapping with a preview image (1372).

[0206] According to one embodiment, the electronic device (300) can adjust the zoom ratio of an image acquired from a secondary camera based on a user input, and display the main subject image (1360) by overlapping it at a fixed size.

[0207] Referring to (b) of FIG. 13, when the zoom ratio is changed to x0.6 according to a user input for the zoom setting UI (1320), the second image including the background object on the preview image (1374) may be zoomed out, but the main subject may be fixed to the same size as the zoom ratio of x1.0. When the user presses the capture button (1342) after changing the zoom ratio in this way, the electronic device (300) may capture the second image based on the currently displayed preview image (1374), and may synthesize and store the main subject image (or first object image) (1360) and the second image.

[0208] FIG. 14 illustrates a process for obtaining a composite image in an automatic zoom mode and a manual zoom mode according to one embodiment.

[0209] According to one embodiment, the electronic device (300) may provide an auto selection item (1412) that allows automatic shooting or manual shooting to be selected in a dynamic zoom mode. For example, automatic shooting may be a method in which, when a shooting command is received while the first preview image is displayed, a second preview image is displayed that overlaps a main subject image extracted from the first image with a second image, and after the zoom ratio is changed, the second image is captured without additional user input and is synthesized with the main subject image and stored. Manual shooting may be a method in which, while the second preview image is displayed, the zoom ratio is changed and, in response to a user's input to a shooting button (1442), the second image is acquired and the synthesized image is stored. According to one embodiment, the auto selection item (1412) may be configured as a toggle button that can be turned on / off by touch input, and may be displayed by overlaying the preview image on the preview area.

[0210] Referring to (a) of FIG. 14, the electronic device (300) can display a third preview image (1410) that overlaps a main subject image extracted from a first image and a second image with a second zoom magnification on a preview area. For example, when a shooting command is received while the first preview image is displayed, the electronic device (300) can display a second preview image that overlaps a main subject image extracted from the first image and a second image with a first zoom magnification, and display the third preview image by adjusting the zoom magnification of the second image to the second zoom magnification while fixing the main subject image.

[0211] When automatic shooting is selected as in (a) of FIG. 14, the electronic device (300) can capture the second image immediately without additional input from the user after the zoom ratio of the second image is changed from the second preview image having the first zoom ratio to the third preview image (1410) having the second zoom ratio. The electronic device (300) can composite the captured second image with the main subject image and save it as a composite image.

[0212] When manual shooting is selected as in (b) of Fig. 14, the electronic device (300) can change to the third preview image (1410) and then shoot a second image in response to a user input for the shooting button (1442) and save the composite image.

[0213] FIG. 15 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0214] According to one embodiment, the electronic device (300) may determine a second zoom factor to be applied to the second image based on a background object included in the second image captured by the secondary camera. The electronic device (300) may determine the second zoom factor as a zoom factor (or maximum zoom factor) at which the entire area of ​​the background object included in the second image can be displayed or at which the boundary of the background object can be included.

[0215] According to one embodiment, the electronic device (300) may determine the second zoom factor by considering the size and position of the main subject, the distance from the background object, or the characteristics of the background object. For example, if the background object includes text or a characteristic shape, the electronic device (300) may determine the second zoom factor as a zoom factor that allows the text or shape to be larger than a certain size.

[0216] Referring to (a) of FIG. 15, the first image acquired through the primary camera may include a person (1560) as the main subject and text (1573) as a background object. The electronic device (300) may display a first preview image including the first image on the display (1510).

[0217] Referring to (b) of FIG. 15, the electronic device (300) can extract the main subject (1560) included in the first image and generate a main subject image.

[0218] Referring to (c) of FIG. 15, the electronic device (300) can zoom in on the second image at a second zoom ratio corresponding to the maximum size at which the text (1575), which is a background object, is not obscured by the main subject (1560). In this case, the size of the main subject (1560) can be fixed. The electronic device (300) can acquire the second image by automatic or manual shooting, and synthesize and store the second image and the main subject image.

[0219] FIG. 16 illustrates a process of changing a zoom ratio by an electronic device according to one embodiment.

[0220] According to one embodiment, the electronic device (300) can extract at least one object selected according to a user input from among a plurality of objects included in a first image acquired through a primary camera.

[0221] Referring to (a) of FIG. 16, the first image may include a first person (1660), a second person (1670), and a sculpture as a background object. The electronic device (300) may provide a graphic effect indicating that the first person (1660) and the second person (1670) are selectable, and may select the first person (1660) and / or the second person (1670) as the main subject based on a user's touch input.

[0222] Referring to (b) of FIG. 16, when a first person (1662) is selected as a main subject according to a user input, the electronic device (300) can extract the first person (1662) selected as a main subject from the first image and generate a main subject image. When zooming out the second image, the electronic device (300) can synthesize the main subject image and display it as a third preview image. Since the unselected second person (1672) is not recognized as a main subject, it can be zoomed out like a sculpture, which is a background object, when zooming out the second image. According to another embodiment, the electronic device can remove the unselected second person (1672) from the image. In this case, the electronic device can fill in the removed area of ​​the second person (1672) through in-painting using an AI model.

[0223] According to one embodiment, the electronic device (300) may select at least one object to be included in a main subject image through image analysis. For example, the electronic device (300) may analyze an image of at least a portion (e.g., a facial area) of a first person (1660) and / or a second person (1670) and, if the image is recognized as a person (e.g., a family member, a friend) related to the user of the electronic device (300), determine the object to be included in the main subject image. In this case, the electronic device (300) may determine whether the first person (1660) and / or the second person (1670) is a person related to the user by using images pre-stored in the gallery application.

[0224] Referring to (c) of FIG. 16, when a first person (1664) and a second person (1674) are selected based on a user input, the electronic device (300) can extract the first person (1664) and the second person (1674) selected as the main subject from the first image to generate a main subject image. When zooming out the second image, the electronic device (300) can synthesize the main subject image including the first person (1664) and the second person (1674) and display it as a third preview image, and the first person (1664) and the second person (1674) can be displayed in a fixed size even when zooming out.

[0225] FIG. 17 is a flowchart of a method for an electronic device to synthesize and store images of a main subject and a background object according to one embodiment.

[0226] According to one embodiment, the illustrated method (1700) can be performed by an electronic device (e.g., the electronic device (300) of FIG. 5), and the technical features described above may be omitted from the description below.

[0227] According to one embodiment, in operation 1710, the electronic device may acquire a second image captured by the secondary camera. According to one embodiment, the electronic device may capture the second image based on a user's shooting command or in response to the zoom magnification of the second image being changed to the second zoom magnification while a third preview image is displayed that superimposes the main subject image and the second image whose zoom magnification is changed from the first zoom magnification to the second zoom magnification.

[0228] According to one embodiment, in operation 1720, the electronic device may synthesize a first object image (or a main subject image) extracted from a first image and a second image. The second image may have a wider angle of view than the first image, and the first object image extracted from the first image may be larger in size than the first object included in the second image.

[0229] According to one embodiment, an electronic device may synthesize a first object image with a background object of a second image by using feature detection and feature matching from a first image and a second image. The electronic device may detect and coordinate characteristic parts, such as shape, brightness, and color, within the first image and the second image through a feature extraction process. The processor may identify common characteristic points found between the two images through a feature matching process and match the identified characteristic points. For example, the electronic device may find characteristic parts in each of the two images, measure the similarity of each characteristic part, and match the most similar characteristic parts with each other. The processor may use the matched characteristic parts in this way to match a main subject and a background object in two images with different magnifications, and may position the main subject separated from the first image at the correct position on the synthesized image.

[0230] According to one embodiment, in operation 1730, the electronic device may perform a post-processing operation on the composite image. For example, the post-processing may include edge correction and / or wide-angle distortion correction. Edge correction may include a process of setting and adjusting a boundary area through a tri-mapping process, and processing the boundary at a low scale to apply a blur effect to create a natural result. The electronic device may perform edge correction on the boundary between a main subject and a background object when compositing a first object image and a second image. In addition, the electronic device may correct distortion caused by a difference in refractive index of the main subject and the background object captured at different angles of view to create a natural result.

[0231] According to one embodiment, when movement of the main subject occurs between the capture of the first image and the capture of the second image, and interference occurs between the first image and the second image in the area of ​​the main subject, the electronic device can fill in image information of the area where interference occurs through an in-painting technique using an AI model.

[0232] According to one embodiment, at operation 1740, the electronic device may store the post-processed image in a gallery application.

[0233] According to one embodiment, instructions for performing each operation constituting the method (1700) may be stored in a tangible, non-transitory computer readable recording medium.

[0234] FIG. 18 illustrates a process of an electronic device matching feature points in a first image and a second image according to one embodiment.

[0235] According to one embodiment, the electronic device can synthesize a first object image with a background object of a second image (1860) by using feature detection and feature matching from the first image (1810) and the second image (1860).

[0236] Referring to (a) of FIG. 18, the first image (1810) is an image captured with a narrow angle of view and includes a main subject (1820) and a portion of a background object (1830), and the second image (1860) is an image captured with a wide angle of view and may include the entire area (1880) of the main subject (1870) and a background object.

[0237] According to one embodiment, the electronic device can detect and coordinate characteristic parts, such as shape, brightness, and color, through analysis of pixel data of the first image (1810) and the second image (1860). For example, the electronic device can recognize the main subject (1820, 1870) in the first image (1810) and the second image (1860), respectively, and recognize characteristic areas (1822, 1824, 1826, 1872, 1874, 1876) of the main subject, such as corners, edges, and blobs. The electronic device can confirm the coordinates of the characteristic points (1822, 1824, 1826, 1872, 1874, 1876) recognized in the first image (1810) and the second image (1860).

[0238] According to one embodiment, the electronic device can identify common features found between the first image (1810) and the second image (1860) and match the identified features. For example, the features of FIG. 18 (a) can be recognized on the boundary line (e.g., edge, corner) of the main subject, and can be matched with the features of FIG. 18 (b), respectively.

[0239] According to one embodiment, the matched characteristic parts can be used to match the main subject and the background object in two images with different magnifications, and the main subject separated from the first image (1810) can be positioned at the correct position in the composite image.

[0240] In one embodiment, the process of synthesizing the main subject image and the second image (1860) may be performed by the AI ​​model (1801). For example, the processor may transmit the first image (1810) and the second image (1860) to the server AI model (1801) via a communication module and receive the processing result of the server AI model (1801), or may utilize an on-device AI model (1801) executed by the processor.

[0241] In one embodiment, the AI ​​model (1801) may include a machine learning model trained to determine the composition of subsequently recommended photos based on the electronic device's photo taking, saving, deleting, and / or sharing history. For example, the machine learning model may be trained or learned through sufficient training data about the usage history of the camera and / or gallery application, the photo sharing history, the photo sharing target, etc., to be able to associate a specific type of photo with a specific composition. In one embodiment, the AI ​​model (1801) may include various transformer models. The operation of the AI ​​model (1801) may include a learning and inference process of finding patterns in data, storing them as generalized, regular models, and inputting new data into the trained model to obtain results.

[0242] According to one embodiment, a user's inputs (e.g., functions repeatedly performed in a consistent order) on an electronic device can be monitored to train an AI model (1801). The electronic device (e.g., an application / framework module of the electronic device, a data platform module) can provide the AI ​​model (1801) with information such as which subject the user photographed, which subject the user photographed with which composition, which camera the user selected for which subject, which shooting option (e.g., brightness, focus, motion photo) the user selected, which photo the user saved, which photo the user shared, which photo the user edited and how the user edited the photo, which photo the user deleted, or which photo the user took in which location. Information about functions and images used in relation to the photo can be input values ​​for learning, and results of using the functions can correspond to target outputs.

[0243] According to one embodiment, the AI ​​model (1801) can learn usage patterns across various devices linked to a user account. The training of the AI ​​model (1801) performed via the electronic device may correspond to initial training or retraining. The training process of the AI ​​model (1801) may include forward propagation and backward propagation. Algorithms such as regression, decision trees, neural networks, and k-nearest neighbors may be used for the training, and multiple different machine learning models may be used for each target task.

[0244] In one embodiment, the AI ​​model (1801) may include a large language model (LLM). The neural network of the AI ​​model (1801) may include various foundation models, such as a code model, an image model, and / or other artificial intelligence neural network models, in addition to the language model.

[0245] An electronic device according to various embodiments of the present document may include a display, a first camera having a first angle of view, a second camera having a second angle of view different from the first angle of view, at least one processor, and a memory.

[0246] According to one embodiment, the memory may store instructions that are executable by at least one processor and, when executed, cause the electronic device to display a first preview image including a first image of a first zoom ratio acquired using the first camera on the display, and, in a state where the first preview image is displayed, extract a first object included in the first image in response to a first user input, thereby generating a first object image.

[0247] According to one embodiment, the memory may store instructions that cause the electronic device to display, on the display, a second preview image by overlapping the second image of the first zoom ratio obtained using the second camera and the first object image.

[0248] According to one embodiment, the memory may store instructions that cause the electronic device to change the zoom magnification of the second image to a second zoom magnification, and to display the second image at the second zoom magnification and the first object image as a third preview image on the display.

[0249] According to one embodiment, the memory may store instructions that cause the electronic device to store a composite image corresponding to the displayed third preview image.

[0250] According to one embodiment, the first camera and the second camera are arranged to face substantially the same direction, and the second angle of view may be larger than the first angle of view.

[0251] According to one embodiment, the first image may include a portion of the first object and a second object positioned behind the first object, and the second image may include the entire portion of the first object and the second object.

[0252] According to one embodiment, the memory may store instructions that cause the electronic device to determine the second zoom factor based on a boundary line of the second object included in the second image.

[0253] According to one embodiment, the memory may store instructions that cause the electronic device to determine a zoom ratio at which an entire area of ​​the second object included in the second image can be displayed as the second zoom ratio.

[0254] According to one embodiment, the memory may store instructions that cause the electronic device to determine the second zoom factor using a binary search method using the first zoom factor and the optical zoom factor of the first camera.

[0255] According to one embodiment, the memory may store instructions that cause the electronic device to store the composite image in response to a change in the zoom ratio of the second image from the first zoom ratio to the second zoom ratio.

[0256] According to one embodiment, the memory may store instructions for causing the electronic device to provide a zoom setting UI through the display that can set a zoom ratio at least partially simultaneously with displaying the second preview image, and to change the zoom ratio of the second image to the second zoom ratio based on a third user input to the zoom setting UI, while maintaining the size of the first object image.

[0257] According to one embodiment, the memory may store instructions that cause the electronic device to store the composite image based on a fourth user input input while the third preview image is displayed.

[0258] According to one embodiment, the memory may store instructions that cause the electronic device to display a mode setting UI through the display that guides execution of a dynamic zoom mode when the first image includes the first object and a portion of a second object located behind the first object, and, based on a fourth user input to the mode setting UI, perform an operation of generating the first object image, an operation of displaying the second preview image, and an operation of displaying the third preview image when the dynamic zoom mode is executed.

[0259] According to one embodiment, the memory may store instructions that cause the electronic device to further overlap and display a third object image generated by extracting the third object from the first image from the second preview image and the third preview image when the first object and the third object are selected based on a fifth user input from among a plurality of objects included in the first image.

[0260] An electronic device according to various embodiments of the present document may include a display, a first camera, a second camera having a different angle of view from the first camera, at least one processor, and a memory.

[0261] According to one embodiment, the memory may store instructions that are executable by at least one processor and, when executed, cause the electronic device to display, through the display, a first preview image including a first image acquired using the first camera, generate a first object image associated with the first object from among a first object and a second object included in the first preview image, display, through the display, a second preview image including a second image acquired using the second camera, the second image including the second object, and the first object image, display the second image on the second preview image by adjusting it according to a selected magnification, and store a third image corresponding to the second preview image.

[0262] According to one embodiment, the second image further includes the first object, and the first object image included in the second preview image can be displayed at least partially overlapping the first object included in the second preview image.

[0263] According to one embodiment, the memory may store instructions that cause the electronic device to switch to a shooting mode in which the second preview image is provided based on a determination that only a portion of the second object can be displayed on the first preview image, and to display the second preview image when a shooting command is received in the switched shooting mode.

[0264] According to one embodiment, the memory may store instructions that cause the electronic device to display a user interface that guides the electronic device to move a position of the electronic device so that the entire second object can be displayed on the second preview image through the display.

[0265] In one embodiment, the magnification may be automatically selected by the electronic device such that at least the entirety of the second object is displayed within the second preview image.

[0266] According to one embodiment, the memory may store instructions that cause the electronic device to acquire a second object image representing the second object using the second camera while the first preview image is displayed, and to generate the third image using a portion of the second object image.

[0267] According to one embodiment, when the first preview image and the second preview image include a third object, and an input is received from a user specifying that the first object be generated as the first object image, the third object may be removed from the third image and the location of the third object may be in-painted with other image information by the artificial intelligence model.

[0268] A method for capturing an image of an electronic device according to various embodiments of the present document may include: displaying a first preview image including a first image of a first zoom magnification acquired using a first camera; extracting a first object included in the first image in response to a first user input while the first preview image is displayed, thereby generating a first object image; overlapping a second image of the first zoom magnification acquired using a second camera having a different angle of view from the first camera and the first object image, thereby displaying the image as a second preview image; changing a zoom magnification of the second image to a second zoom magnification, overlapping the second image of the second zoom magnification and the first object image, thereby displaying the image as a third preview image; and storing a composite image corresponding to the displayed third preview image.

[0269] A computer-readable non-transitory recording medium according to various embodiments of the present document may store instructions for performing an operation of displaying a first preview image including a first image of a first zoom magnification acquired using a first camera, an operation of extracting a first object included in the first image in response to a first user input while the first preview image is displayed, and generating a first object image, an operation of superimposing a second image of the first zoom magnification acquired using a second camera having a different angle of view from the first camera and the first object image and displaying the superimposed image as a second preview image, an operation of changing a zoom magnification of the second image to a second zoom magnification, and displaying the superimposed second image of the second zoom magnification and the first object image as a third preview image, and an operation of storing a composite image corresponding to the displayed third preview image.

[0270] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0271] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0272] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0273] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0274] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0275] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separately arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; A first camera having a first angle of view; A second camera having a second angle of view different from the first angle of view; at least one processor; and Contains memory, The above memory is executable by at least one processor, and when executed, the electronic device: A first preview image including a first image of a first zoom ratio obtained using the first camera is displayed on the display, In a state where the first preview image is displayed, in response to a first user input, a first object included in the first image is extracted to generate a first object image, The second image of the first zoom ratio obtained using the second camera and the first object image are superimposed to display the second preview image on the display, Changing the zoom ratio of the second image to a second zoom ratio, and superimposing the second image of the second zoom ratio and the first object image, and displaying them on the display as a third preview image, and An electronic device storing instructions for storing a composite image corresponding to the third preview image displayed above.

2. In paragraph 1, The first camera and the second camera are arranged facing substantially the same direction, An electronic device wherein the second angle of view is larger than the first angle of view.

3. In paragraph 1 or 2, The first image includes the first object and a portion of the second object located behind the first object, An electronic device wherein the second image includes the entire area of ​​the first object and the second object.

4. In paragraph 3, The above memory, the electronic device, Based on the boundary line of the second object included in the second image, the second zoom ratio is determined, or An electronic device storing instructions for determining a zoom ratio at which the entire area of ​​the second object included in the second image can be displayed as the second zoom ratio.

5. In paragraph 4, The above memory, the electronic device, An electronic device storing instructions for determining the second zoom ratio using a binary search method using the first zoom ratio and the optical zoom ratio of the first camera for the second image.

6. In any one of paragraphs 1 to 5, The above memory, the electronic device, An electronic device storing instructions for storing the composite image in response to the zoom ratio of the second image being changed from the first zoom ratio to the second zoom ratio.

7. In any one of paragraphs 1 to 6, The above memory, the electronic device, Providing a zoom setting UI that can set the zoom ratio at least partially simultaneously with the display of the second preview image through the display, and An electronic device storing instructions for changing the zoom ratio of the second image to the second zoom ratio based on a third user input to the zoom setting UI, while maintaining the size of the first object image.

8. In any one of paragraphs 1 to 7, The above memory, the electronic device, An electronic device storing instructions for storing the composite image based on a fourth user input input while the third preview image is displayed.

9. In any one of paragraphs 1 to 8, The above memory, the electronic device, When the first image includes the first object and a portion of a second object located behind the first object, a mode setting UI guiding execution of the dynamic zoom mode is displayed through the display, and An electronic device storing instructions for performing an operation of generating the first object image, an operation of displaying the second preview image, and an operation of displaying the third preview image when the dynamic zoom mode is executed based on a fourth user input for the mode setting UI.

10. In electronic devices, display; Camera 1; A second camera having a different angle of view from the first camera; at least one processor; and Contains memory, The above memory is executable by at least one processor, and when executed, the electronic device: Through the above display, a first preview image including a first image acquired using the first camera is displayed, Generate a first object image associated with the first object among the first object and the second object included in the first preview image, Through the above display, a second image obtained using the second camera, the second image including the second object, and a second preview image including the first object image are displayed, The second image is displayed by adjusting it according to the selected magnification on the second preview image, and An electronic device storing instructions for storing a third image corresponding to the second preview image.

11. In paragraph 10, An electronic device wherein the second image further includes the first object, and the first object image included in the second preview image is displayed at least partially overlapping the first object included in the second preview image.

12. In paragraph 10, The above memory, the electronic device, Based on the judgment that only a part of the second object can be displayed on the first preview image, switching to a shooting mode in which the second preview image is provided, and An electronic device storing instructions for displaying the second preview image when a shooting command is received in the above-mentioned switched shooting mode.

13. In paragraph 10, The above memory, the electronic device, An electronic device storing instructions for obtaining a second object image representing the second object using the second camera while the first preview image is displayed, and generating the third image using a portion of the second object image.

14. In paragraph 10, The first preview image and the second preview image include a third object, An electronic device in which, when an input specifying that the first object is to be generated as the first object image is received from a user, the third object is removed from the third image and the location of the third object is in-painted with other image information by an artificial intelligence model.

15. In a method for capturing an image of an electronic device, An action of displaying a first preview image including a first image of a first zoom magnification acquired using a first camera; An operation of extracting a first object included in the first image in response to a first user input while the first preview image is displayed, thereby generating a first object image; An operation of superimposing a second image of the first zoom ratio obtained using a second camera having a different angle of view from the first camera and the first object image, and displaying the superimposed image as a second preview image; An operation of changing the zoom ratio of the second image to a second zoom ratio, overlapping the second image of the second zoom ratio and the first object image, and displaying them as a third preview image; and A method comprising the action of storing a composite image corresponding to the third preview image displayed above.

Images