Electronic device comprising image sensor, and operation method thereof

Abstract

An electronic device according to an embodiment may comprise: a first camera including a first image sensor; a second camera including a second image sensor; at least one processor including processing circuitry; and a memory for storing instructions. The electronic device may be configured to determine a magnification for an image to be obtained. The electronic device may be configured to obtain, when the determined magnification is less than a first magnification, an image from the first image sensor on the basis of a first mode enabling the first image sensor to output an image having a first resolution. The electronic device may be configured to obtain, when the determined magnification is greater than or equal to the first magnification and less than a second magnification, an image from the second image sensor on the basis of a second mode enabling the second image sensor to output an image having a second resolution. The electronic device may be configured to obtain, when the determined magnification is greater than or equal to the second magnification and less than a third magnification, an image from the first image sensor on the basis of a third mode enabling the first image sensor to output an image having a third resolution greater than the first resolution.

Description

Electronic device including image sensor and method of operating same

[0001] The present disclosure relates to an electronic device including an image sensor and a method of operating the same.

[0002] An electronic device can acquire an image frame from the output of an image sensor that converts an optical signal into an electrical signal. The image sensor can include a color filter and a photodetector. The photodetector can receive light that has passed through a color filter corresponding to a specific color and output an electrical signal corresponding to the received light. For example, a complementary metal-oxide semiconductor (CMOS) image sensor (CIS) can convert the electrical signal output from the photodetector into a digital signal through an analog-digital converter (ADC) and output the digital signal. The electronic device can acquire image data including a set of pixel values ​​determined based on the signal output from the image sensor. The image quality of the acquired image is affected by the number of pixels included in the image, and devices and methods for acquiring images with a high pixel count are being developed to improve the image quality.

[0003] Since the photodetector receives light that has passed through a color filter of a specific color, the information detected through a single photodetector can correspond to a single color. The color filter plays a role in allowing the final image to express color, but it can also cause the final image to be expressed at a lower resolution than the total number of photodetectors arranged in the image sensor. Color reproduction and resolution can be in a conflicting relationship. The Bayer pattern has been widely used as a pattern to accurately reproduce color while reducing the loss of resolution.

[0004] A camera containing an image sensor can capture images based on the field of view (FOV) it can support. For example, a lens may be referred to as an ultra-wide angle lens, a wide angle lens, a standard lens, or a telephoto lens, in that order of their field of view. A camera equipped with each of these lenses may be referred to as an ultra-wide angle camera, a wide angle camera, a standard camera, or a telephoto camera.

[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0006] An electronic device according to one embodiment may include a touchscreen display, a first camera including a first image sensor, a second camera including a second image sensor, at least one processor including processing circuitry, and a memory storing instructions. The instructions may be individually or collectively executed by the at least one processor to cause the electronic device to determine a magnification for an image to be acquired. The instructions may be individually or collectively executed by the at least one processor to cause the electronic device to acquire a first image through the first image sensor in a first mode in which the first image sensor outputs an image having a first resolution. The instructions may be individually or collectively executed by the at least one processor to cause the electronic device to display a preview image based on the first image through the touchscreen display. The commands may be individually or collectively executed by the at least one processor to cause the electronic device to receive, through the touchscreen display, a user input for adjusting a magnification. The commands may be individually or collectively executed by the at least one processor to cause the electronic device to acquire a second image in a second mode, wherein the second image sensor outputs an image having a second resolution, at least in part based on determining that a magnification corresponding to the user input is greater than or equal to the first magnification and less than the second magnification.The instructions may be individually or collectively executed by the at least one processor to cause the electronic device to acquire a third image in a third mode, wherein the first image sensor outputs an image having a third resolution higher than the first resolution, at least in part based on determining that a magnification corresponding to the user input is greater than or equal to the second magnification and less than the third magnification.

[0007] The method may include an operation of acquiring a first image through the first image sensor in a first mode in which the first image sensor outputs an image with a first resolution. The method may include an operation of displaying a preview image based on the first image through a touchscreen display. The method may include an operation of receiving a user input for adjusting a magnification through the touchscreen display. The method may include an operation of acquiring a second image through the second image sensor in a second mode in which the second image sensor outputs an image with a second resolution, at least partially based on a determination that a magnification corresponding to the user input is greater than or equal to the first magnification and less than a second magnification. The method may include an operation of acquiring a third image through the first image sensor in a third mode in which the first image sensor outputs an image with a third resolution higher than the first resolution, at least partially based on a determination that a magnification corresponding to the user input is greater than or equal to the second magnification and less than a third magnification.

[0008] In one embodiment, an electronic device may include a touchscreen display, a first camera including a first image sensor, a second camera including a second image sensor, at least one processor including a processing circuit, and a memory storing instructions. The instructions may be individually or collectively executed by the at least one processor to cause the electronic device to determine a magnification for an image to be acquired. The instructions may be individually or collectively executed by the at least one processor to cause the electronic device to receive, through the touchscreen display, a user input for adjusting the magnification. The instructions may be individually or collectively executed by the at least one processor to cause the electronic device to acquire a first image in a first mode, wherein the first image sensor outputs an image having a first resolution, at least in part based on the magnification corresponding to the user input being determined to be a first magnification. The above commands may be individually or collectively executed by the at least one processor to cause the electronic device to obtain a second image by cropping at least a portion of an image obtained through the second image sensor in a second mode in which the second image sensor outputs an image of a second resolution, at least in part based on the magnification corresponding to the user input being determined to be the first magnification. The above commands may be individually or collectively executed by the at least one processor to cause the electronic device to obtain a first composite image by synthesizing the first image and the second image.The commands may be individually or collectively executed by the at least one processor to cause the electronic device to obtain a third image by cropping at least a portion of an image obtained through the first image sensor in the first mode, at least in part based on the determination that the magnification corresponding to the user input is a second magnification higher than the first magnification. The commands may be individually or collectively executed by the at least one processor to cause the electronic device to obtain a fourth image through the second image sensor in a third mode, at least in part based on the determination that the magnification corresponding to the user input is a second magnification higher than the first magnification, causing the second image sensor to output an image having a third resolution higher than the second resolution. The commands may be individually or collectively executed by the at least one processor to cause the electronic device to obtain a second composite image by synthesizing the third image and the fourth image.

[0009] According to one embodiment, a method of operating an electronic device including a first camera including a first image sensor and a second camera including a second image sensor may determine an operation of determining a magnification for an image to be acquired. The method may include an operation of receiving a user input for adjusting the magnification through a touchscreen display. The method may include an operation of acquiring a first image through the first image sensor in a first mode in which the first image sensor outputs an image with a first resolution, at least partially based on a determination that the magnification corresponding to the user input is less than a defined magnification. The method may include an operation of acquiring a second image through the second image sensor in a second mode in which the second image sensor outputs an image with a second resolution, at least partially based on a determination that the magnification corresponding to the user input is less than the defined magnification. The method may include an operation of acquiring a first image obtained by synthesizing the first image and the second image, at least partially based on a determination that the magnification corresponding to the user input is less than the defined magnification. The method may include an operation of acquiring a third image in a third mode, causing the first image sensor to output an image of a third resolution higher than the first resolution, through the first image sensor, at least partially based on a determination that the magnification corresponding to the user input is greater than or equal to the defined magnification. The method may include an operation of acquiring a fourth image in a second mode, through the second image sensor, at least partially based on a determination that the magnification corresponding to the user input is greater than or equal to the defined magnification.The method may include obtaining a second composite image by synthesizing the third image and the fourth image, at least in part based on determining that a magnification corresponding to the user input is greater than or equal to the defined magnification.

[0010] A computer-readable non-transitory recording medium according to one embodiment may have recorded thereon a computer program for executing at least one of the above-described methods.

[0011] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0012] FIG. 2 is a block diagram illustrating a camera module according to various embodiments.

[0013] FIG. 3 is a block diagram illustrating a configuration of an electronic device according to one embodiment.

[0014] FIG. 4 is a diagram illustrating the configuration of an image sensor according to one embodiment.

[0015] FIG. 5 is a drawing illustrating an example of a pattern of a light-receiving element, a microlens, and a color filter arranged in an image sensor according to one embodiment.

[0016] FIG. 6 is a diagram illustrating an example of a configuration of a color pattern of an image acquired based on a first sensor pattern of an image sensor according to one embodiment.

[0017] FIG. 7 is a diagram illustrating an example of a configuration of a color pattern of an image acquired based on a second sensor pattern of an image sensor according to one embodiment.

[0018] FIG. 8 is a diagram illustrating an example of a configuration of a color pattern of an image acquired based on a third sensor pattern of an image sensor according to one embodiment.

[0019] FIG. 9 is a diagram illustrating an example of a configuration of a color pattern of an image acquired based on a fourth sensor pattern of an image sensor according to one embodiment.

[0020] FIG. 10 is a flowchart illustrating a process by which an electronic device acquires an image according to a magnification according to one embodiment.

[0021] FIG. 11 is a graph showing the resolution of images acquired by an electronic device according to magnification through cameras according to one embodiment.

[0022] FIG. 12 is a diagram illustrating an operating state according to a magnification of an electronic device according to one embodiment.

[0023] FIG. 13 is a flowchart illustrating a process by which an electronic device acquires an image according to a magnification according to one embodiment.

[0024] FIG. 14 is a graph illustrating the resolution of images acquired by an electronic device according to an embodiment of the present invention through cameras according to magnification.

[0025] FIG. 15 is a diagram illustrating an operating state according to a magnification of an electronic device according to one embodiment.

[0026] FIG. 16 is a drawing illustrating an example of a screen displayed by an electronic device according to one embodiment.

[0027] FIG. 17 is a flowchart illustrating a process by which an electronic device acquires an image using down-scale according to one embodiment.

[0028] FIG. 18 illustrates an operational state in which an electronic device according to one embodiment acquires an image using down-scaling according to a magnification.

[0029] FIG. 19 is a flowchart illustrating a process by which an electronic device acquires a composite image according to one embodiment.

[0030] FIG. 20 is a flowchart illustrating a process by which an electronic device according to one embodiment acquires a composite image according to a magnification using two cameras.

[0031] FIG. 21 illustrates examples of states in which an electronic device according to one embodiment acquires images for generating a composite image using two cameras.

[0032] FIG. 22 is a flowchart illustrating a process by which an electronic device according to one embodiment acquires a composite image according to magnification using three cameras.

[0033] FIG. 23 illustrates examples of states in which an electronic device according to one embodiment acquires images for generating a composite image using three cameras.

[0034] FIG. 24 is a side view illustrating an example of a first form of an electronic device including a hinge structure, in one embodiment.

[0035] FIG. 25 is a perspective view illustrating an example of a first form of an electronic device including a hinge structure, in one embodiment.

[0036] FIG. 26 is a side view illustrating an example of a second form of an electronic device including a hinge structure, in one embodiment.

[0037] FIG. 27 is a perspective view illustrating an example of a second form of an electronic device including a hinge structure, in one embodiment.

[0038] FIG. 28 is a side view illustrating an example of a third form of an electronic device including a hinge structure, in one embodiment.

[0039] FIG. 29 is a perspective view illustrating an example of a third form of an electronic device including a hinge structure, in one embodiment.

[0040] FIG. 30 is a flowchart illustrating a process by which an electronic device acquires an image based on the shape of the electronic device according to one embodiment.

[0041] FIG. 31 illustrates an example of an electronic device displaying an image acquired in a second form or a third form according to one embodiment.

[0042] FIG. 32 illustrates an example of an electronic device displaying an image acquired in a first form according to one embodiment.

[0043] FIG. 33 illustrates, in one embodiment, a plan view of an exemplary electronic device within a first state of a rollable display and an area for acquiring an image from an image sensor.

[0044] FIG. 34 is a bottom view of an exemplary electronic device within a first state of a rollable display, in one embodiment.

[0045] FIG. 35 illustrates, in one embodiment, a plan view of an exemplary electronic device within a second state of a rollable display and an area for acquiring an image from an image sensor.

[0046] FIG. 36 is a bottom view of an exemplary electronic device within a second state of a rollable display, in one embodiment.

[0047] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the disclosed embodiments may be implemented in various different forms and are not limited to the embodiments described herein.

[0048] An electronic device and an operating method thereof according to one embodiment may be for reducing the size of a camera module including a plurality of cameras in implementing a zoom operation using a plurality of cameras.

[0049] An electronic device and its operating method according to one embodiment may be configured to reduce differences in properties (e.g., resolution) between images to be synthesized when synthesizing images acquired using a plurality of cameras supporting different FOVs.

[0050] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary skill in the technical field to which the present disclosure pertains.

[0051] In the present disclosure, the term 'pixel' (or picture element) may refer to the smallest unit that constitutes a digital image. The resolution of an image may be expressed by the number of pixels included in the image. For example, if an image is composed of axb pixels arranged in a rows and b columns, it may be indicated as an image with axb resolution. The term 'sensor pixel' in the present disclosure may refer to a component that becomes a unit by which an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383) of FIG. 3, the second image sensor (384)) can obtain a pixel value through a light-receiving element. The pixel value mentioned in the present disclosure may also include a pixel address value.

[0052] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0053] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0054] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0055] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0056] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0057] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0058] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0059] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0060] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0061] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0062] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0063] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0064] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0065] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0066] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0067] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0068] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0069] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0070] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0071] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0072] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0073] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0074] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0075] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0076] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0077] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0078] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0079] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0080] FIG. 2 is a block diagram (200) illustrating a camera module (180) according to various embodiments. Referring to FIG. 2, the camera module (180) may include a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250) (e.g., a buffer memory), or an image signal processor (260). The lens assembly (210) may collect light emitted from a subject that is a target of image capturing. The lens assembly (210) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (210). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (210) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties that are different from the lens properties of the other lens assemblies. A lens assembly (210) may include, for example, a wide-angle lens or a telephoto lens.

[0081] The flash (220) can emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (220) can include one or more light-emitting diodes (e.g., red-green-blue (RGB) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. The image sensor (230) can acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly (210) into an electrical signal. According to one embodiment, the image sensor (230) can include one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same property, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (230) can be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0082] The image stabilizer (240) can move at least one lens or image sensor (230) included in the lens assembly (210) in a specific direction or control the operating characteristics of the image sensor (230) (e.g., adjusting the read-out timing, etc.) in response to the movement of the camera module (180) or the electronic device (101) including the same. This allows compensating for at least some of the negative effects of the movement on the captured image. In one embodiment, the image stabilizer (240) can detect such movement of the camera module (180) or the electronic device (101) using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module (180). In one embodiment, the image stabilizer (240) can be implemented as, for example, an optical image stabilizer. The memory (250) can temporarily store at least a portion of the image acquired through the image sensor (230) for the next image processing task. For example, when image acquisition is delayed due to the shutter, or when multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in the memory (250), and a corresponding copy image (e.g., a low-resolution image) can be previewed through the display module (160). Thereafter, when a specified condition is satisfied (e.g., a user input or a system command), at least a portion of the original image stored in the memory (250) can be acquired and processed, for example, by the image signal processor (260). According to one embodiment, the memory (250) can be configured as at least a portion of the memory (130) or as a separate memory that operates independently therefrom.

[0083] The image signal processor (260) can perform one or more image processing operations on an image acquired through an image sensor (230) or an image stored in a memory (250). The one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor (260) may perform control (e.g., exposure time control, read-out timing control, etc.) for at least one of the components included in the camera module (180) (e.g., image sensor (230)). An image processed by the image signal processor (260) may be stored back in the memory (250) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display module (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (260) may include at least one of the processors (120). It may be configured as a separate processor that is configured as a part of the processor (120) or operates independently of the processor (120). If the image signal processor (260) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (260) may be displayed through the display module (160) as is or after undergoing additional image processing by the processor (120).

[0084] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different properties or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera, and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera, and at least another may be a rear camera.

[0085] FIG. 3 is a block diagram illustrating the configuration of an electronic device (101) according to one embodiment.

[0086] In one embodiment, the electronic device (101) may include at least one processor (320) (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2), a memory (330) (e.g., the memory (130) of FIG. 1, the memory (250) of FIG. 2), and a plurality of cameras (e.g., the camera module (180) of FIGS. 1 and 2). In the present disclosure, the operations performed by the electronic device (101) may be understood as being performed by the at least one processor executing instructions stored in the memory to perform operations or controlling components of the electronic device (101). In one embodiment, the at least one processor (320) may include at least one of a central processing unit (CPU), an image signal processor (ISP) (e.g., the image signal processor (260) of FIG. 2), a graphical processing unit (GPU), or a neural processing unit (NPU). For example, at least one processor (320) may include an application processor capable of integrating and processing multiple functions. At least one processor (320) may acquire image data based on an image frame including information read from at least one of the first image sensor (383) or the second image sensor (384).

[0087] In one embodiment, at least one processor (320) can transmit a control signal for controlling an image sensor (e.g., a first image sensor (383), a second image sensor (384)) through a communication method (e.g., I2C (inter-integrated circuit), I3C (improved inter-integrated circuit)) connected between the at least one processor (320) and the image sensor. The image sensor can output an image including pixel values ​​read from sensor pixels within the image sensor to the at least one processor (320) based on the control signal. For example, the image sensor can transmit image data through an interface (e.g., MIPI (mobile industry processor interface)) connected to the at least one processor (320). An image output from the image sensor to the at least one processor (320) may also be referred to as a raw image.

[0088] In one embodiment, the plurality of cameras may include a first camera (381) including a first image sensor (383) (e.g., image sensor (230) of FIG. 2). The plurality of cameras may include a second camera (383) including a second image sensor (384) (e.g., image sensor (230) of FIG. 2). The plurality of cameras may further include at least one camera. In one embodiment, the first camera (381) and the second camera (382) may be configured to support different magnifications. For example, the first camera (381) may be configured to support a 1.0x magnification, and the second camera (382) may be configured to support a 1.5x magnification. In one embodiment, the first camera (381) may support a first field of view (FOV), and the second camera (382) may support a second FOV that is different from the first FOV. For example, the first camera (381) may be referred to as a wide-angle camera. For example, the second camera (382) may be referred to as an ultra-wide-angle camera. For example, the second FOV may correspond to a wider angle of view or a shorter focal length than the first FOV, but is not limited thereto.

[0089] In one embodiment, the electronic device (101) may further include a display (360) (e.g., the display module (160) of FIG. 1). At least one processor (320) may display a screen configured based on an image acquired from an image sensor through the display (360). For example, the at least one processor (320) may display a preview screen including a preview image updated based on an image acquired from the image sensor through the display (360). When the display (360) includes a touch screen, the electronic device (101) may receive a touch input corresponding to a location of the displayed screen.

[0090] In one embodiment, the first image sensor (383) may include a pixel array including a plurality of sensor pixels. The second image sensor (384) may include a pixel array including a plurality of sensor pixels. The number of sensor pixels included in the first image sensor (383) and the number of sensor pixels included in the second image sensor (384) may be the same, but are not limited thereto.

[0091] FIG. 4 is a diagram illustrating a configuration of an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383) of FIG. 3, the second image sensor (384)) according to one embodiment.

[0092] In one embodiment, the image sensor may include a micro lens array (MLA) (411), a color filter (413), a light receiving unit (415), and a computation unit (417).

[0093] In one embodiment, the microlens array (411) may be configured such that a light bundle (421) that passes through the lens unit (e.g., the lens assembly (210) of FIG. 2) and forms an image on an image sensor is focused on a light-receiving element of the light-receiving unit (415). The light bundles (423) that pass through the microlens array (411) may have at least a portion of wavelengths other than a band corresponding to a specific color blocked as they pass through the color filter (413). The light bundles (425) that pass through the color filter (413) may be detected by a light-receiving element (e.g., a photodiode) of the light-receiving unit (415). The light-receiving unit (415) may include a light-receiving element that generates a charge when receiving light and converts it into an electrical signal, and a circuit that selectively reads out the charge of the light-receiving element. A circuit for digitizing the signal read from the light receiving unit (415) or reducing noise may be placed between the light receiving unit (415) and the calculation unit (417).

[0094] In one embodiment, the microlens array (411) may be arranged to correspond to at least one light-receiving element. For example, when viewed from the direction in which the light bundle (421) is incident, an area in which a single microlens included in the microlens array (411) is arranged may at least partially overlap an area in which a plurality of light-receiving elements are arranged. The microlenses included in the microlens array (411) may be arranged in a different color channel from adjacent microlenses, but a plurality of microlenses corresponding to the same color channel may be arranged adjacent to each other. The arrangement between the microlens array (411), the color filter (413), and the light-receiving unit (415) may be configured differently depending on the type of image sensor.

[0095] In one embodiment, the calculation unit (417) can perform an operation to process electrical data (427) output from the light receiving unit (415). The calculation unit (417) can output data acquired based on the calculation result. The output of the calculation unit (417) can be an output of an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383), the second image sensor (384) of FIG. 3). In one embodiment, the calculation unit (417) can perform an operation to calibrate the read data as an operation to process the electrical data (427). For example, the operation performed by the operation unit (417) may include at least one of an operation for reducing deviation between pixels due to optical asymmetry or relative positions of sensors, an operation for reducing noise generated in an analog signal, an operation for removing defects, an operation for performing re-mosaic, or an operation according to a specific application field (e.g., proximity sensor function, timing adjustment function, HDR (high dynamic range) tone mapping function). The sensor output (429) output from the operation unit (417) may be input to at least one processor (e.g., application processor) through an interface.

[0096] In FIG. 4, the color pattern of the color filter (413) is illustrated based on the Bayer pattern, but the color pattern of the color filter (413) according to one embodiment is not limited to that illustrated in FIG. 4. Areas within the color filter (413) corresponding to a plurality of adjacent micro lenses may be configured to include the same color channel. For example, an image sensor including a color filter (413) may include a structure in which the pattern illustrated in FIG. 5 is repeated.

[0097] FIG. 5 is a diagram illustrating an example of a pattern of a light-receiving element (e.g., a light-receiving element included in a light-receiving unit (415) of FIG. 4), a microlens (e.g., a microlens included in a microlens array (411) of FIG. 4), and a color filter (e.g., a color filter (413) of FIG. 4) disposed in an image sensor (e.g., an image sensor (230) of FIG. 2, a first image sensor (383) of FIG. 3, a second image sensor (384) of FIG. 3) according to one embodiment.

[0098] According to one embodiment, an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383), the second image sensor (384) of FIG. 3) of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) may be configured to output images with different resolutions depending on the operating mode in which the image sensor operates. The pattern in which the microlenses, light-receiving elements, and color filters included in the image sensor are arranged may be configured in various ways. For example, the image sensor may include a pattern in which any one of the first sensor pattern (501), the second sensor pattern (502), the third sensor pattern (503), or the fourth sensor pattern (504) is repeated. However, the patterns illustrated in FIG. 5 are only examples for explaining one embodiment and are not limited thereto. The image sensor may output an image with a resolution depending on the operating mode based on the pattern. Each light-receiving element may include an element (e.g., a photodiode) that can detect light and output an electrical signal. At least one photodetector included in the image sensor may be arranged in an area corresponding to one microlens. In FIG. 5, the area corresponding to each photodetector may be referred to as a sensor pixel.

[0099] According to one embodiment, in the first sensor pattern (501), four light-receiving elements (511, 512, 513, 514) arranged in a 2 x 2 array may be arranged to correspond to one micro lens (520). The micro lens (520) within the first sensor pattern (501) may be arranged in an area corresponding to one color channel (e.g., a green channel) of a color filter. Within the first sensor pattern (501), another micro lens arranged adjacent to the micro lens (520) may be arranged in an area corresponding to a color of the color filter corresponding to the area where the micro lens (520) is arranged and another color channel (e.g., a red channel, a blue channel) of the color filter.

[0100] According to one embodiment, in the second sensor pattern (502), four micro lenses (541, 542, 543, 544) arranged in a 2 x 2 array may be arranged in the same color channel (e.g., green channel) of the color filter. The light-receiving elements may include two light-receiving elements arranged to correspond to one micro lens. For example, referring to FIG. 5, the light-receiving elements (531, 532) may be arranged to correspond to the micro lens (541). The light-receiving elements (533, 534) may be arranged to correspond to the micro lens (542). The light-receiving elements (535, 536) may be arranged to correspond to the micro lens (543). The light-receiving elements (537, 538) may be arranged to correspond to the micro lens (544).

[0101] According to one embodiment, in the third sensor pattern (503), nine light-receiving elements (551, 552, 553, 554, 555, 556, 557, 558, 559) arranged in a 3 x 3 array may be arranged to correspond to one micro lens (560). The micro lens (560) within the third sensor pattern (503) may be arranged in an area corresponding to one color channel (e.g., a green channel) of a color filter. Within the third sensor pattern (503), another micro lens arranged adjacent to the micro lens (560) may be arranged in an area corresponding to a color channel (e.g., a red channel, a blue channel) different from the color channel of the color filter corresponding to the area where the micro lens (560) is arranged.

[0102] According to one embodiment, in the fourth sensor pattern (504), four micro lenses (591, 592, 593, 594) arranged in a 2 x 2 array may be arranged in the same color channel (e.g., green channel) of the color filter. The light-receiving elements may include four light-receiving elements arranged in a 2 x 2 array and arranged to correspond to one micro lens. For example, in the fourth sensor pattern (504), four light-receiving elements (571, 572, 573, 574) may be arranged to correspond to the micro lens (591). Four light-receiving elements (575, 576, 577, 578) may be arranged to correspond to the micro lens (592). Four light-receiving elements (579, 580, 581, 582) may be arranged to correspond to the micro lens (593). Four photodetectors (583, 584, 585, 586) can be arranged to correspond to the micro lens (594).

[0103] In one embodiment, the pattern of the image sensor is not limited to the patterns illustrated in FIG. 5. For example, the pattern of the image sensor may be replaced with another pattern that can operate by changing the resolution.

[0104] FIG. 6 is a diagram illustrating an example of a configuration of a color pattern of an image obtained based on a first sensor pattern (501) of an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383) of FIG. 3, the second image sensor (384)) according to one embodiment.

[0105] In one embodiment, an image sensor of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) may perform a binning operation to merge the outputs of a 2 x 2 array of sensor pixels (e.g., the photodetectors (511, 512, 513, and 514) of FIG. 5) that include information for the same color channel within a first sensor pattern (501) to output an image having a first raw image pattern (610) corresponding to a Bayer pattern. In this case, the image having the first raw image pattern (610) may have a resolution of 1 / 4 compared to the number of sensor pixels of the image sensor. For example, an image having a first raw image pattern (610) having a resolution of 4 x 4 may be output from an 8 x 8 array of photodetectors included in the first sensor pattern (501) illustrated in FIG. 5.

[0106] In one embodiment, an image sensor of an electronic device can acquire an image in which each sensor pixel has a second raw image pattern (620) corresponding to pixels of the image. The electronic device can perform a remosaic operation that converts a color order on the raw image having the second raw image pattern (620) to acquire an image having a Bayer pattern (625). In the present disclosure, the remosaic operation may be performed on an image acquired from the image sensor by at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3), but it can be understood that the image sensor may also output a result of performing the remosaic operation. An image obtained based on the second raw image pattern (620) (e.g., an image having a Bayer pattern (625)) may have a resolution four times higher than an image obtained based on the first raw image pattern (610).

[0107] FIG. 7 is a diagram illustrating an example of a configuration of a color pattern of an image obtained based on a second sensor pattern (502) of an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383) of FIG. 3, the second image sensor (384)) according to one embodiment.

[0108] In one embodiment, an image sensor of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) may perform a binning operation to merge outputs of a 2 x 4 array of sensor pixels (e.g., the photodetectors (531, 532, 533, 534, 535, 536, 537, 538) of FIG. 5) that include information for the same color channel within the second sensor pattern (502) illustrated in FIG. 5, thereby outputting an image having a first raw image pattern (710) corresponding to a Bayer pattern. In this case, the image having the first raw image pattern (710) may have a resolution of 1 / 8 compared to the number of sensor pixels of the image sensor.

[0109] In one embodiment, an image sensor of an electronic device may perform a binning operation that merges outputs of sensor pixels in a 1 x 2 array (e.g., photodetectors (531, 532) of FIG. 5) to obtain an image having a second raw image pattern (720). The electronic device may perform a remosaic operation on the image having the second raw image pattern (720) to obtain an image having a Bayer pattern (725). An image obtained based on the second raw image pattern (720) (e.g., an image having the Bayer pattern (725)) may have a resolution four times higher than that of the first raw image pattern (710).

[0110] FIG. 8 is a diagram illustrating an example of a configuration of a color pattern of an image acquired based on a third sensor pattern of an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383) of FIG. 3, the second image sensor (384)) according to one embodiment.

[0111] In one embodiment, an image sensor of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) may perform a binning operation to merge outputs of a 3 x 3 array of sensor pixels (e.g., the photodetectors (551, 552, 553, 554, 555, 556, 557, 558, 559) of FIG. 5) that include information for the same color channel within a third sensor pattern (503) to output an image having a first raw image pattern (810) corresponding to a Bayer pattern. In this case, the image having the first raw image pattern (810) may have a resolution of 1 / 9 compared to the number of sensor pixels of the image sensor. For example, from the 6 x 6 array of light-receiving elements included in the third sensor pattern (503) illustrated in FIG. 5, an image having a first raw image pattern (810) with a resolution of 2 x 2 can be output.

[0112] In one embodiment, an image sensor of an electronic device can acquire an image having a second raw image pattern (820). The electronic device can perform a remosaic operation on the image having the second raw image pattern (820) to acquire an image having a Bayer pattern (825). An image acquired based on the second raw image pattern (820) (e.g., an image having the Bayer pattern (825)) can have a resolution nine times higher than an image acquired based on the first raw image pattern (810).

[0113] FIG. 9 is a diagram illustrating an example of a configuration of a color pattern of an image acquired based on a fourth sensor pattern of an image sensor (e.g., the image sensor (230) of FIG. 2, the first image sensor (383) of FIG. 3, the second image sensor (384)) according to one embodiment.

[0114] In one embodiment, an image sensor of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) may perform a binning operation to merge a 4 x 4 array of sensor pixels containing information for the same color channel within the fourth sensor pattern (504) illustrated in FIG. 5 to output an image having a first raw image pattern (910) corresponding to a Bayer pattern. The image having the first raw image pattern (910) may have a resolution of 1 / 16 relative to the number of sensor pixels of the image sensor.

[0115] In one embodiment, the electronic device can perform a binning operation that merges outputs of sensor pixels in a 2 x 2 array to obtain an image having a second raw image pattern (920). The electronic device can perform a re-mosaic operation on the image having the second raw image pattern (920) to obtain an image having a Bayer pattern (925). An image obtained based on the second raw image pattern (920) (e.g., an image having the Bayer pattern (925)) can have a resolution four times higher than an image obtained based on the first raw image pattern (910).

[0116] In one embodiment, the electronic device can acquire an image in which each sensor pixel has a third raw image pattern (930) corresponding to pixels of the image. The electronic device can perform a re-mosaic operation on the image having the third raw image pattern (930) to acquire an image having a Bayer pattern (935). An image acquired based on the third raw image pattern (930) (e.g., an image having the Bayer pattern (935)) can have a resolution 16 times higher than an image acquired based on the first raw image pattern (910).

[0117] FIG. 10 is a flowchart (1000) illustrating a process by which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) acquires an image according to a magnification according to one embodiment.

[0118] According to one embodiment, in operation 1010, the electronic device may determine a magnification for acquiring an image. For example, the electronic device may determine a magnification set as a default value or a previously last set magnification when a camera application for controlling the operation of a camera (e.g., the camera module (180) of FIG. 1 , the camera module (180) of FIG. 2 , the first camera (381) and the second camera (382) of FIG. 3 ) is executed. For example, the electronic device may display a user interface for determining a magnification through a display (e.g., the display module (160) of FIG. 1 , the display (360) of FIG. 3 ) and receive a user input (e.g., a touch input) for selecting or adjusting the magnification through the user interface. The electronic device may determine a magnification for an image to be acquired based on the user input. An electronic device may include a first camera (e.g., the first camera (381) of FIG. 3) including a first image sensor (e.g., the first image sensor (383) of FIG. 3) and a second camera (e.g., the second camera (382) of FIG. 3) including a second image sensor (e.g., the second image sensor (384) of FIG. 3). The first image sensor and the second image sensor may have the same sensor pattern, but the first image sensor and the second image sensor may also have different sensor patterns.

[0119] In one embodiment, the electronic device may receive user input for adjusting the magnification. The electronic device may determine a magnification corresponding to the user input. For example, the electronic device may receive a touch input for selecting a magnification through a touchscreen display (e.g., the display module (160) of FIG. 1 or the display (360) of FIG. 3).

[0120] According to one embodiment, in operation 1020, the electronic device may determine whether the determined magnification is less than a first magnification. The first magnification may be set according to the configuration of the first camera and the second camera included in the electronic device. In one embodiment, if the basic magnification of the second camera is greater than the basic magnification of the first camera, the first magnification may correspond to the basic magnification of the second camera. For example, if the basic magnification of the first camera is a 1.0x magnification and the basic magnification of the second camera is a 1.5x magnification, the first magnification may be set to a 1.5x magnification. However, the value of the first magnification is not limited thereto. For example, the first magnification may be set to a 2.0x magnification.

[0121] According to one embodiment, when the determined magnification is less than the first magnification, in operation 1025, the electronic device may acquire an image from the first image sensor (e.g., the first image sensor (383) of FIG. 3) based on the first mode. For example, when a camera application is executed and the magnification is set as a default value, the electronic device may display a preview image through a display (e.g., a touchscreen display) based on the first image acquired through the first image sensor in the first mode. For example, the first mode may mean a sensor operation mode in which the first image sensor outputs an image having the first raw image pattern (610) of FIG. 6. For example, the first mode may also mean a sensor operation mode in which the first image sensor outputs an image having the first raw image pattern (710) of FIG. 7. For example, the first mode may also mean a sensor operation mode in which the first image sensor outputs an image having the first raw image pattern (810) of FIG. 8. For example, the first mode may mean a sensor operation mode in which the first image sensor outputs an image having the first raw image pattern (910) of FIG. 9.

[0122] According to one embodiment, if the determined magnification is greater than or equal to the first magnification, in operation 1030, the electronic device may determine whether the determined magnification is less than or equal to the second magnification. In one embodiment, the second magnification may be set according to the basic magnification of the first camera and the sensor pattern of the first image sensor. For example, if the basic magnification of the first camera is 1.0x and the first image sensor has the first sensor pattern (501) or the second sensor pattern (502) of FIG. 5, the second magnification may be set to 2.0x. For example, if the basic magnification of the first camera is 1.0x and the first image sensor has the third sensor pattern (503) of FIG. 5, the first magnification may be set to 2.0x and the second magnification may be set to 3.0x. For example, if the base magnification of the first camera is 1.0x magnification, the first image sensor has the fourth sensor pattern (504) of FIG. 5, the first mode corresponds to the first raw image pattern (910), and the third mode corresponds to the second raw image pattern (920), the second magnification may be set to 2.0x magnification. For example, if the base magnification of the first camera is 1.0x magnification, the first image sensor has the fourth sensor pattern (504) of FIG. 5, the first mode corresponds to the second raw image pattern (920), and the third mode corresponds to the third raw image pattern (930), the second magnification may be set to 2.0x magnification. For example, if the basic magnification of the first camera is 1.0x magnification, the first image sensor has the fourth sensor pattern (504) of FIG. 5, the first mode corresponds to the first raw image pattern (910), and the third mode corresponds to the third raw image pattern (930), the second magnification can be set to 4.0x magnification. However, the value of the second magnification is not limited thereto.

[0123] According to one embodiment, when the determined magnification is less than the second magnification, in operation 1035, the electronic device may acquire an image from the second image sensor (e.g., the second image sensor (384) of FIG. 3) based on the second mode. For example, the second mode may refer to a sensor operation mode in which the second image sensor outputs an image having the first raw image pattern (610) of FIG. 6. For example, the second mode may refer to a sensor operation mode in which the second image sensor outputs an image having the first raw image pattern (710) of FIG. 7. For example, the second mode may refer to a sensor operation mode in which the second image sensor outputs an image having the first raw image pattern (810) of FIG. 8. For example, the second mode may refer to a sensor operation mode in which the second image sensor outputs an image having the first raw image pattern (910) of FIG. 9.

[0124] According to one embodiment, if the determined magnification is greater than or equal to the second magnification, in operation 1040, the electronic device may determine whether the determined magnification is less than or equal to the third magnification. In one embodiment, the third magnification may be set according to the basic magnification of the second camera and the sensor pattern of the second image sensor. For example, if the basic magnification of the second camera is 1.5x and the second image sensor has the first sensor pattern (501) or the second sensor pattern (502) of FIG. 5, the third magnification may be set to 3.0x. For example, if the basic magnification of the second camera is 1.5x and the second image sensor has the third sensor pattern (503) of FIG. 5, the third magnification may be set to 4.5x. For example, if the base magnification of the second camera is 1.5x magnification, the second image sensor has the fourth sensor pattern (504) of FIG. 5, the second mode corresponds to the first raw image pattern (910), and the fourth mode corresponds to the second raw image pattern (920), the third magnification may be set to 3.0x magnification. For example, if the base magnification of the second camera is 1.5x magnification, the second image sensor has the fourth sensor pattern (504) of FIG. 5, the second mode corresponds to the second raw image pattern (920), and the fourth mode corresponds to the third raw image pattern (930), the third magnification may be set to 3.0x magnification. For example, if the base magnification of the second camera is 1.5x magnification, the second image sensor has the fourth sensor pattern (504) of FIG. 5, the second mode corresponds to the first raw image pattern (910), and the fourth mode corresponds to the third raw image pattern (930), the third magnification may be set to 6.0x magnification. The first mode and the second mode may correspond to each other, but are not limited thereto.

[0125] According to one embodiment, when the determined magnification is less than the third magnification, in operation 1045, the electronic device may acquire an image from the first image sensor based on a third mode. For example, the third mode may refer to a sensor operation mode in which the first image sensor acquires an image having the second raw image pattern (620) of FIG. 6. For example, the third mode may refer to a sensor operation mode in which the first image sensor acquires an image having the second raw image pattern (720) of FIG. 7. For example, the third mode may refer to a sensor operation mode in which the first image sensor acquires an image having the second raw image pattern (820) of FIG. 8. For example, the third mode may refer to a sensor operation mode in which the first image sensor acquires an image having the second raw image pattern (920) or the third raw image pattern (930) of FIG. 9. In one embodiment, the electronic device may perform a re-mosaic operation on the acquired image based on the third mode.

[0126] According to one embodiment, when the determined magnification is greater than or equal to the third magnification, in operation 1055, the electronic device may acquire an image from the second image sensor based on a fourth mode. For example, the fourth mode may refer to a sensor operation mode in which the second image sensor acquires an image having the second raw image pattern (620) of FIG. 6. For example, the fourth mode may refer to a sensor operation mode in which the second image sensor acquires an image having the second raw image pattern (720) of FIG. 7. For example, the fourth mode may refer to a sensor operation mode in which the second image sensor acquires an image having the second raw image pattern (820) of FIG. 8. For example, the fourth mode may refer to a sensor operation mode in which the second image sensor acquires an image having the second raw image pattern (920) or the third raw image pattern (930) of FIG. 9. The third mode and the fourth mode may correspond to each other, but are not limited thereto. In one embodiment, the electronic device can perform a remosaic operation on an image acquired based on the fourth mode.

[0127] In one embodiment, the electronic device may perform a function of an application based on the image acquired in operation 1025, operation 1035, operation 1045, or operation 1055. For example, the electronic device may display a preview screen including a preview image generated based on the acquired image through a display (e.g., the display module (160) of FIG. 1, the display (360) of FIG. 3). For example, the electronic device may store a still image or a moving image generated based on the acquired image in a memory (e.g., the memory (130) of FIG. 1, the memory (330) of FIG. 3). For example, the electronic device may transmit an image frame generated based on the acquired image to an external device through a communication circuit (e.g., the communication module (190) of FIG. 1).

[0128] In one embodiment, operation 1055 may be omitted. In an embodiment where operation 1055 is omitted, the electronic device may perform operation 1045 if the determined magnification is greater than or equal to the second magnification. The performance of operation 1040 may be excluded.

[0129] In one embodiment, at operation 1060, the electronic device may determine whether the image capture has ended. If the image capture has not ended, the electronic device may perform operation 1010 again. If the image capture has ended, the electronic device may terminate the process illustrated in flowchart (1000). For example, the electronic device may repeat the process illustrated in flowchart (1000) while the camera application is running and displaying a preview image.

[0130] Operations 1020 to 1040 illustrated in FIG. 10 are provided to illustrate examples of determining conditions for selecting an operation to be performed by an electronic device based on a range within which a determined magnification falls, but are not limited thereto. The process by which an electronic device determines an operation to select an operation based on a magnification may be modified in various ways.

[0131] FIG. 11 is a graph illustrating the resolution of an image acquired by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to an embodiment of the present invention through cameras (e.g., the camera module (180) of FIG. 1, the camera module (180) of FIG. 2, the first camera (381) of FIG. 3, the second camera (384) of FIG. 3) according to magnification. The resolution illustrated in FIG. 11 may indicate the resolution of an image acquired by the electronic device cropping at least a portion of an image output from a camera.

[0132] In one embodiment, the electronic device may provide an image acquired through the first camera based on the first mode during a first period (1110) in which the determined magnification is less than the first magnification. Since a portion of the image acquired through the first camera is cropped and provided within the first period (1110), the resolution of the provided image may decrease as the magnification increases.

[0133] In one embodiment, when the determined magnification is the first magnification, the resolution of the image provided through the second camera (e.g., the second camera (384) of FIG. 3) based on the second mode is higher than the resolution of the image provided through the first camera (e.g., the first camera (381) of FIG. 3) based on the first mode, and therefore, the electronic device may provide the image acquired through the second camera. During the second section (1120) in which the determined magnification is greater than or equal to the first magnification and less than the second magnification, the resolution of the image provided through the second camera may be higher than the resolution of the image provided through the first camera. Therefore, the electronic device may be configured to provide the image through the second camera during the second section (1120).

[0134] In one embodiment, when the determined magnification increases and reaches the second magnification, the electronic device may change the sensor operation mode of the first image sensor included in the first camera (e.g., the first image sensor (383) of FIG. 3) to a third mode capable of acquiring an image with a higher resolution than the first mode. Based on the third mode, the electronic device may acquire an image with the second magnification and a higher resolution than the image acquired through the second camera in the second mode. Accordingly, when the determined magnification is the second magnification, the electronic device may provide the image acquired through the first camera. During a third period (1130) in which the determined magnification is greater than or equal to the second magnification and less than the third magnification, the electronic device may be configured to provide an image through the first camera.

[0135] In one embodiment, when the determined magnification increases and reaches a third magnification, the electronic device may change the operation mode of the second image sensor included in the second camera (e.g., the second image sensor (384) of FIG. 3) to a fourth mode capable of acquiring an image with a higher resolution than the second mode. Based on the fourth mode, the electronic device may acquire an image with the third magnification and a higher resolution than the image acquired through the first camera in the third mode. Accordingly, when the determined magnification is the third magnification, the electronic device may provide an image acquired through the second camera. When the determined magnification is equal to or greater than the third magnification, the electronic device may provide an image acquired through the second camera.

[0136] FIG. 12 is a diagram illustrating an operating state according to a magnification of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment.

[0137] In one embodiment, while the magnification determined to acquire an image is less than the first magnification (1201), the electronic device may operate in a first state (1210). In the first state (1210), the electronic device may provide a function of the electronic device based on an image stream output from a first camera (e.g., the first camera (381) of FIG. 3). In the first state (1210), the first camera may output an image stream generated based on the first mode to at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3).

[0138] In one embodiment, while the magnification determined to acquire an image is greater than or equal to the first magnification (1201) and less than the second magnification (1202), the electronic device may operate in a second state (1220). In the second state (1220), the electronic device may provide its functions based on an image stream output from a second camera (e.g., the second camera (382) of FIG. 3). In the second state (1220), the second camera may output an image stream generated based on the second mode to at least one processor.

[0139] In one embodiment, while the magnification determined to acquire an image is greater than or equal to the second magnification (1202) and less than the third magnification (1203), the electronic device may operate in a third state (1230). In the third state (1230), the electronic device may provide a function of the electronic device based on an image stream output from the first camera. In the third state (1230), the first camera may output an image stream generated based on a third mode capable of outputting an image with a higher resolution than the first mode to at least one processor.

[0140] In one embodiment, while the magnification determined to acquire an image is greater than or equal to the third magnification (1203), the electronic device may operate in a fourth state (1240). In the fourth state (1240), the electronic device may provide its functions based on an image stream output from the second camera. In the fourth state (1240), the electronic device may output an image stream generated based on a fourth mode capable of outputting an image with a higher resolution than the second mode to at least one processor.

[0141] FIG. 13 is a flowchart (1300) illustrating a process by which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) acquires an image according to a magnification according to one embodiment.

[0142] According to one embodiment, in operation 1010, the electronic device may determine a magnification for acquiring an image. For example, the electronic device may determine a magnification set as a default value or a previously last set magnification when a camera application for controlling the operation of a camera (e.g., the camera module (180) of FIG. 1 , the camera module (180) of FIG. 2 , the first camera (381) and the second camera (382) of FIG. 3 ) is executed. For example, the electronic device may display a user interface for determining a magnification through a display (e.g., the display module (160) of FIG. 1 , the display (360) of FIG. 3 ) and receive a user input (e.g., a touch input) for selecting or adjusting the magnification through the user interface. The electronic device may determine a magnification for an image to be acquired based on the user input. An electronic device may include a first camera (e.g., the first camera (381) of FIG. 3) including a first image sensor (e.g., the first image sensor (383) of FIG. 3) and a second camera (e.g., the second camera (382) of FIG. 3) including a second image sensor (e.g., the second image sensor (384) of FIG. 3). The first image sensor and the second image sensor may have the same sensor pattern, but the first image sensor and the second image sensor may also have different sensor patterns.

[0143] In one embodiment, the electronic device may receive user input for adjusting the magnification. The electronic device may determine a magnification corresponding to the user input. For example, the electronic device may receive a touch input for selecting a magnification through a touchscreen display (e.g., the display module (160) of FIG. 1 or the display (360) of FIG. 3).

[0144] According to one embodiment, in operation 1020, the electronic device may determine whether the determined magnification is less than a first magnification. The first magnification may be set according to the configuration of the first camera and the second camera included in the electronic device. In one embodiment, if the basic magnification of the second camera is greater than the basic magnification of the first camera, the first magnification may correspond to the basic magnification of the second camera. For example, if the basic magnification of the first camera is a 1.0x magnification and the basic magnification of the second camera is a 1.5x magnification, the first magnification may be set to a 1.5x magnification. However, the value of the first magnification is not limited thereto.

[0145] According to one embodiment, when the determined magnification is less than the first magnification, in operation 1025, the electronic device may acquire an image from the first image sensor (e.g., the first image sensor (383) of FIG. 3) based on the first mode. For example, when a camera application is executed and the magnification is set as a default value, the electronic device may display a preview image through a display (e.g., a touchscreen display) based on the first image acquired through the first image sensor in the first mode. For example, the first mode may mean a sensor operation mode in which the first image sensor outputs an image having the first raw image pattern (910) of FIG. 9.

[0146] According to one embodiment, if the determined magnification is greater than or equal to the first magnification, in operation 1030, the electronic device may determine whether the determined magnification is less than or equal to the second magnification. In one embodiment, the second magnification may be set according to the basic magnification of the first camera and the sensor pattern of the first image sensor. For example, if the basic magnification of the first camera is a 1.0x magnification and the first image sensor has the fourth sensor pattern (504) of FIG. 5, the second magnification may be set to a 2.0x magnification. However, the value of the second magnification is not limited thereto.

[0147] According to one embodiment, if the determined magnification is less than the second magnification, in operation 1035, the electronic device may acquire an image from a second image sensor (e.g., the second image sensor (384) of FIG. 3) based on a second mode. For example, the second mode may refer to a sensor operation mode in which the second image sensor outputs an image having the first raw image pattern (910) of FIG. 9.

[0148] According to one embodiment, if the determined magnification is greater than or equal to the second magnification, in operation 1040, the electronic device may determine whether the determined magnification is less than or equal to the third magnification. In one embodiment, the third magnification may be set according to the basic magnification of the second camera and the sensor pattern of the second image sensor. For example, if the basic magnification of the second camera is a 1.5x magnification and the second image sensor has the fourth sensor pattern (504) of FIG. 5, the third magnification may be set to a 3.0x magnification. The first mode and the second mode may correspond to each other, but are not limited thereto.

[0149] According to one embodiment, if the determined magnification is less than the third magnification, in operation 1045, the electronic device may acquire an image from the first image sensor based on a third mode. For example, the third mode may refer to a sensor operation mode in which the first image sensor acquires an image having the second raw image pattern (920) of FIG. 9. In one embodiment, the electronic device may perform a remosaic operation on the acquired image based on the third mode.

[0150] According to one embodiment, if the determined magnification is greater than or equal to the third magnification, in operation 1350, the electronic device may determine whether the determined magnification is less than or equal to the fourth magnification. In one embodiment, the fourth magnification may be set according to the basic magnification of the first camera and the sensor pattern of the first image sensor. For example, if the basic magnification of the first camera is a 1.0x magnification and the first image sensor has the fourth sensor pattern (504) of FIG. 5, the fourth magnification may be set to a 4.0x magnification.

[0151] In one embodiment, if the determined magnification is less than the fourth magnification, in operation 1055, the electronic device may acquire an image from the second image sensor based on the fourth mode. For example, the fourth mode may refer to a sensor operation mode in which the second image sensor acquires an image having the second raw image pattern (920) of FIG. 9. In one embodiment, the electronic device may perform a remosaic operation on the acquired image based on the fourth mode.

[0152] According to one embodiment, if the determined magnification is greater than or equal to the fourth magnification, in operation 1360, the electronic device may determine whether the determined magnification is less than or equal to the fifth magnification. In one embodiment, the fifth magnification may be set according to the basic magnification of the second camera and the sensor pattern of the first image sensor. For example, if the basic magnification of the second camera is a 1.5x magnification and the second image sensor has the fourth sensor pattern (504) of FIG. 5, the fifth magnification may be set to a 6.0x magnification.

[0153] According to one embodiment, if the determined magnification is less than the fifth magnification, in operation 1365, the electronic device may acquire an image from the first image sensor based on the fifth mode. For example, the fifth mode may refer to a sensor operation mode in which the first image sensor acquires an image having the third raw image pattern (930) of FIG. 9. In one embodiment, the electronic device may perform a remosaic operation on the acquired image based on the fifth mode.

[0154] According to one embodiment, if the determined magnification is greater than or equal to the fifth magnification, in operation 1375, the electronic device may acquire an image from the second image sensor based on a sixth mode. For example, the sixth mode may refer to a sensor operation mode in which the second image sensor acquires an image having the third raw image pattern (930) of FIG. 9. In one embodiment, the electronic device may perform a remosaic operation on the acquired image based on the sixth mode.

[0155] In one embodiment, the electronic device may perform a function of an application based on the image acquired in operation 1025, operation 1035, operation 1045, operation 1055, operation 1365, or operation 1375. For example, the electronic device may display a preview screen including a preview image generated based on the acquired image through a display (e.g., the display module (160) of FIG. 1, the display (360) of FIG. 3). For example, the electronic device may store a still image or a moving image generated based on the acquired image in a memory (e.g., the memory (130) of FIG. 1, the memory (330) of FIG. 3). For example, the electronic device may transmit an image frame generated based on the acquired image to an external device through a communication circuit (e.g., the communication module (190) of FIG. 1).

[0156] According to one embodiment, at operation 1380, the electronic device may determine whether the image capture has ended. If the image capture has not ended, the electronic device may perform operation 1010 again. If the image capture has ended, the electronic device may terminate the process illustrated in flowchart (1300). For example, the electronic device may repeat the process illustrated in flowchart (1300) while the camera application is running and displaying a preview image.

[0157] FIG. 14 is a graph illustrating the resolution of an image acquired by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to an embodiment of the present invention through cameras (e.g., the camera module (180) of FIG. 1, the camera module (180) of FIG. 2, the first camera (381) of FIG. 3, the second camera (384) of FIG. 3) according to magnification. The resolution illustrated in FIG. 14 may indicate the resolution of an image acquired by the electronic device cropping at least a portion of an image output from a camera.

[0158] In one embodiment, the electronic device may provide an image acquired through the first camera based on the first mode during a first period (1410) in which the determined magnification is less than the first magnification. Since a portion of the image acquired through the first camera is cropped and provided within the first period (1410), the resolution of the provided image may decrease as the magnification increases.

[0159] In one embodiment, when the determined magnification is the first magnification, the resolution of the image provided through the second camera (e.g., the second camera (384) of FIG. 3) based on the second mode is higher than the resolution of the image provided through the first camera (e.g., the first camera (381) of FIG. 3) based on the first mode, and therefore, the electronic device may provide the image acquired through the second camera. During the second section (1420) in which the determined magnification is greater than or equal to the first magnification and less than the second magnification, the resolution of the image provided through the second camera may be higher than the resolution of the image provided through the first camera. Therefore, the electronic device may be configured to provide the image through the second camera during the second section (1420).

[0160] In one embodiment, when the determined magnification increases and reaches the second magnification, the electronic device may change the sensor operation mode of the first image sensor included in the first camera (e.g., the first image sensor (383) of FIG. 3) to a third mode capable of acquiring an image with a higher resolution than the first mode. Based on the third mode, the electronic device may acquire an image with the second magnification and a higher resolution than the image acquired through the second camera in the second mode. Accordingly, when the determined magnification is the second magnification, the electronic device may provide the image acquired through the first camera. During a third period (1430) in which the determined magnification is greater than or equal to the second magnification and less than the third magnification, the electronic device may be configured to provide an image through the first camera.

[0161] In one embodiment, when the determined magnification increases and reaches a third magnification, the electronic device may change the operation mode of the second image sensor included in the second camera (e.g., the second image sensor (384) of FIG. 3) to a fourth mode capable of acquiring an image with a higher resolution than the second mode. Based on the fourth mode, the electronic device may acquire an image with the third magnification and a higher resolution than the image acquired through the first camera in the third mode. Accordingly, when the determined magnification is the third magnification, the electronic device may provide the image acquired through the second camera. During the fourth section (1440) in which the determined magnification is greater than or equal to the third magnification and less than the fourth magnification, the electronic device may provide the image acquired through the second camera.

[0162] In one embodiment, when the determined magnification increases and reaches a fourth magnification, the electronic device may change the sensor operation mode of the first image sensor included in the first camera (e.g., the first image sensor (383) of FIG. 3) to a fifth mode capable of acquiring an image with a higher resolution than the third mode. Based on the fifth mode, the electronic device may acquire an image with the fourth magnification at a higher resolution than the image acquired through the second camera in the fourth mode. Accordingly, when the determined magnification is the fourth magnification, the electronic device may provide the image acquired through the first camera. During a fifth period (1450) in which the determined magnification is greater than or equal to the fourth magnification and less than the fifth magnification, the electronic device may be configured to provide an image through the first camera.

[0163] In one embodiment, when the determined magnification increases and reaches the fifth magnification, the electronic device may change the operation mode of the second image sensor included in the second camera (e.g., the second image sensor (384) of FIG. 3) to a sixth mode capable of acquiring an image with a higher resolution than the fourth mode. Based on the sixth mode, the electronic device may acquire an image with the fifth magnification at a higher resolution than the image acquired through the first camera in the fifth mode. Accordingly, when the determined magnification is the fifth magnification, the electronic device may provide an image acquired through the second camera. During the sixth section (1460) in which the determined magnification is equal to or greater than the fifth magnification, the electronic device may provide an image acquired through the second camera.

[0164] Although not shown in the above drawing, the electronic device may have three camera modules output different resolutions depending on the magnification.

[0165] In the above drawing, when the fourth magnification is reached, the electronic device can change the operation mode of the third image sensor included in the third camera to a seventh mode capable of acquiring an image with a higher resolution than the fourth mode of the second image sensor. Based on the seventh mode, the electronic device can acquire an image with the fourth magnification at a higher resolution than the image acquired through the second camera in the fourth mode. Accordingly, when the determined magnification is the fourth magnification, the electronic device can provide the image acquired through the third camera. During the fifth section (1450) in which the determined magnification is equal to or greater than the fourth magnification and less than the fifth magnification, the electronic device can be configured to provide an image through the third camera.

[0166] In one embodiment, when the determined magnification increases and reaches the fifth magnification, the electronic device may change the operation mode of the second image sensor included in the second camera (e.g., the second image sensor (384) of FIG. 3) to a sixth mode capable of acquiring an image with a higher resolution than the fourth mode. Based on the sixth mode, the electronic device may acquire an image with the fifth magnification at a higher resolution than the image acquired through the third camera in the seventh mode. Accordingly, when the determined magnification is the fifth magnification, the electronic device may provide an image acquired through the second camera. During the sixth section (1460) in which the determined magnification is equal to or greater than the fifth magnification, the electronic device may provide an image acquired through the second camera.

[0167] Although not shown in the above figure, in one embodiment, when the determined magnification increases to reach the sixth magnification, the electronic device may change the operation mode of the third image sensor included in the third camera to an eighth mode capable of acquiring an image with a higher resolution than the seventh mode. Based on the eighth mode, the electronic device may acquire an image with the sixth magnification at a higher resolution than the image acquired through the second camera in the sixth mode. Accordingly, when the determined magnification is the sixth magnification, the electronic device may provide an image acquired through the third camera. During the seventh period when the determined magnification is equal to or greater than the sixth magnification, the electronic device may provide an image acquired through the third camera.

[0168] FIG. 15 is a diagram illustrating an operating state according to a magnification of an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) according to one embodiment.

[0169] In one embodiment, while the magnification determined to acquire an image is less than the first magnification (1501), the electronic device may operate in a first state (1510). In the first state (1510), the electronic device may provide a function of the electronic device based on an image stream output from a first camera (e.g., the first camera (381) of FIG. 3). In the first state (1510), the first camera may output an image stream generated based on the first mode to at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3).

[0170] In one embodiment, while the magnification determined to acquire an image is greater than or equal to the first magnification (1501) and less than the second magnification (1502), the electronic device may operate in a second state (1520). In the second state (1520), the electronic device may provide its functions based on an image stream output from a second camera (e.g., the second camera (382) of FIG. 3). In the second state (1520), the second camera may output an image stream generated based on the second mode to at least one processor.

[0171] In one embodiment, while the magnification determined to acquire an image is greater than or equal to the second magnification (1502) and less than the third magnification (1503), the electronic device may operate in a third state (1530). In the third state (1530), the electronic device may provide a function of the electronic device based on an image stream output from the first camera. In the third state (1530), the first camera may output an image stream generated based on a third mode capable of outputting an image with a higher resolution than the first mode to at least one processor.

[0172] In one embodiment, while the magnification determined to acquire an image is greater than or equal to the third magnification (1503) and less than the fourth magnification (1504), the electronic device may operate in a fourth state (1540). In the fourth state (1540), the electronic device may provide a function of the electronic device based on an image stream output from the second camera. In the fourth state (1540), the electronic device may output an image stream generated based on a fourth mode capable of outputting an image with a higher resolution than the second mode to at least one processor.

[0173] In one embodiment, while the magnification determined to acquire an image is greater than or equal to the fourth magnification (1504) and less than the fifth magnification (1505), the electronic device may operate in a fifth state (1550). In the fifth state (1550), the electronic device may provide a function of the electronic device based on an image stream output from the first camera. In the fifth state (1550), the first camera may output an image stream generated based on a fifth mode capable of outputting an image with a higher resolution than the third mode to at least one processor.

[0174] In one embodiment, while the magnification determined for acquiring an image is greater than or equal to the fifth magnification (1505), the electronic device may operate in a sixth state (1560). In the sixth state (1560), the electronic device may provide a function of the electronic device based on an image stream output from the second camera. In the sixth state (1560), the electronic device may output an image stream generated based on a sixth mode capable of outputting an image with a higher resolution than the fourth mode to at least one processor.

[0175] FIG. 16 is a drawing illustrating an example of a screen displayed by an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment.

[0176] In one embodiment, the electronic device can display an image acquired through at least one of a plurality of cameras (e.g., the camera module (180) of FIG. 1, the camera module (180) of FIG. 2, the first camera (381) of FIG. 3, the second camera (384) of FIG. 3) through a display (e.g., the display module (160) of FIG. 1, the display module (360) of FIG. 3).

[0177] In one embodiment, the electronic device may acquire an image through a first camera (e.g., the first camera (381) of FIG. 3) based on a first pattern (1613) (e.g., the first raw image pattern (910) of FIG. 9) in a range of magnification from 1.0x to 1.4x. The electronic device may display a preview screen (1610) including a preview image (1611) generated based on the image acquired through the first camera through a display.

[0178] In one embodiment, the electronic device can acquire an image based on a second pattern (1623) (e.g., the first raw image pattern (910) of FIG. 9) in a range of magnification from 1.5x to 1.9x. The electronic device can display a preview screen (1620) including a preview image (1621) generated based on the image acquired through the second camera through a display.

[0179] In one embodiment, the electronic device may acquire an image through the first camera based on a third pattern (1633) (e.g., the second raw image pattern (920) of FIG. 9) in a range of magnification from 2.0x to 2.9x. The electronic device may display a preview screen (1630) including a preview image (1631) generated based on the image acquired through the first camera through the display.

[0180] In one embodiment, the electronic device can acquire an image based on a fourth pattern (1643) (e.g., the second raw image pattern (920) of FIG. 9) in a range of magnification from 3.0x to 3.9x. The electronic device can display a preview screen (1640) including a preview image (1641) generated based on the image acquired through the second camera through the display.

[0181] In one embodiment, the electronic device may acquire an image through the first camera based on a fifth pattern (1653) (e.g., the third raw image pattern (930) of FIG. 9) in a range of magnification from 4.0x to 5.9x. The electronic device may display a preview screen (1650) including a preview image (1651) generated based on the image acquired through the first camera through the display.

[0182] In one embodiment, the electronic device may acquire an image based on a sixth pattern (1663) (e.g., the third raw image pattern (930) of FIG. 9) in a section having a magnification of 6.0x or greater. The electronic device may display a preview screen (1660) including a preview image (1661) generated based on an image acquired through the second camera through a display.

[0183] FIG. 17 is a flowchart (1700) illustrating a process by which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) acquires an image using down-scale according to one embodiment.

[0184] According to one embodiment, in operation 1710, the electronic device may determine whether the magnification of the image to be provided is greater than a defined magnification. For example, within a state interval in which the electronic device operates in the first state (1510) of FIG. 15, the electronic device may determine whether the determined magnification is greater than 1.0x. For example, within a state interval in which the electronic device operates in the second state (1520) of FIG. 15, the electronic device may determine whether the determined magnification is greater than 1.5x. For example, within a state interval in which the electronic device operates in the fifth state (1530) of FIG. 15, the electronic device may determine whether the determined magnification is greater than 2.0x.

[0185] According to one embodiment, if the determined magnification is greater than the defined magnification, in operation 1720, the electronic device may acquire an image in a mode that outputs an image with a higher resolution than the operation mode assigned to the corresponding state section. For example, in the first state (1510) of FIG. 15, the electronic device may acquire an image from the first camera based on a third mode that outputs an image with a higher resolution than the first mode. For example, in the second state (1520) of FIG. 15, the electronic device may acquire an image from the second camera based on a fourth mode that outputs an image with a higher resolution than the second mode. For example, in the third state (1530) of FIG. 15, the electronic device may acquire an image from the first camera based on a fifth mode that outputs an image with a higher resolution than the third mode. For example, in the fourth state (1540) of FIG. 15, the electronic device may acquire an image from the second camera based on a sixth mode that outputs an image with a higher resolution than the fourth mode.

[0186] According to one embodiment, in operation 1730, the electronic device may crop at least a portion of the image acquired in operation 1720. For example, the electronic device may crop an area corresponding to an image to be provided according to the determined magnification. In operation 1740, the electronic device may downscale the cropped image based on the size of the image to be provided. In one embodiment, the image sensor may output only an area corresponding to an image to be provided according to the determined magnification. In this case, operation 1730, in which the processor of the electronic device crops a portion of the acquired image, may be omitted.

[0187] According to one embodiment, in operation 1715, if the determined magnification is equal to (or less than or equal to) the defined magnification, the electronic device may acquire an image based on the operation state assigned to the state section. For example, in the first state (1510) of FIG. 15, the electronic device may acquire an image from the first camera based on the first mode. For example, in the second state (1520) of FIG. 15, the electronic device may acquire an image from the second camera based on the second mode. For example, in the third state (1530) of FIG. 15, the electronic device may acquire an image from the first camera based on the third mode. For example, in the fourth state (1540) of FIG. 15, the electronic device may acquire an image from the second camera based on the fourth mode.

[0188] FIG. 18 illustrates an operational state in which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment acquires an image using down-scaling according to a magnification.

[0189] In one embodiment, while the determined magnification is less than the first magnification (1801) and corresponds to (or is less than or equal to) the defined magnification within a range less than or equal to the first magnification (1801), the electronic device may operate in a first state (1810). In the first state (1810), the electronic device may provide a function of the electronic device based on an image stream output from a first camera (e.g., the first camera (381) of FIG. 3). In the first state (1810), the first camera may output an image stream generated based on the first mode to at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3).

[0190] In one embodiment, while the determined magnification is less than the first magnification (1801) and greater than the magnification defined within a range less than or equal to the first magnification (1801), the electronic device may operate in a first down-scaling state (1820). In the first down-scaling state (1820), the electronic device may acquire an image based on operations 1720 to 1740 of FIG. 17. For example, the electronic device may perform an operation of down-scaling an image acquired from the first camera based on a third mode capable of acquiring an image with a higher resolution than the first mode.

[0191] In one embodiment, while the determined magnification is the first magnification (1801), the electronic device may operate in a second state (1830). In the second state (1830), the electronic device may provide its functions based on an image stream output from a second camera (e.g., the second camera (382) of FIG. 3). In the second state (1830), the second camera may output an image stream generated based on the second mode to at least one processor.

[0192] In one embodiment, while the determined magnification is greater than the first magnification (1801) and less than the second magnification (1802), the electronic device may operate in a second down-scaling state (1840). In the second down-scaling state (1840), the electronic device may acquire an image based on operations 1720 to 1740 of FIG. 17. For example, the electronic device may perform an operation of down-scaling an image acquired from the second camera based on a fourth mode capable of acquiring an image with a higher resolution than the second mode.

[0193] In one embodiment, while the determined magnification is the second magnification (1802), the electronic device may operate in a third state (1850). In the third state (1850), the electronic device may provide its functions based on an image stream output from the first camera. In the third state (1850), the first camera may output an image stream generated based on the third mode to at least one processor.

[0194] In one embodiment, while the determined magnification is greater than the second magnification (1802) and less than the third magnification (1803), the electronic device may operate in a third down-scaling state (1860). In the third down-scaling state (1860), the electronic device may acquire an image based on operations 1720 to 1740 of FIG. 17. For example, the electronic device may perform an operation of down-scaling an image acquired from the first camera based on a fifth mode capable of acquiring an image with a higher resolution than the third mode.

[0195] In one embodiment, while the determined magnification is the third magnification (1803), the electronic device may operate in a fourth state (1870). In the fourth state (1870), the electronic device may provide its functions based on an image stream output from the second camera. In the fourth state (1870), the second camera may output an image stream generated based on the fourth mode to at least one processor.

[0196] In one embodiment, while the determined magnification is greater than the third magnification (1803), the electronic device may operate in a fourth down-scaling state (1880). In the fourth down-scaling state (1880), the electronic device may acquire an image based on operations 1720 to 1740 of FIG. 17. For example, the electronic device may perform an operation of down-scaling an image acquired from the second camera based on a sixth mode capable of acquiring an image with a higher resolution than the fourth mode.

[0197] FIG. 19 is a flowchart (1900) illustrating a process by which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) acquires a composite image according to one embodiment.

[0198] An electronic device according to one embodiment may generate a composite image by synthesizing images acquired through multiple cameras. For example, the electronic device may generate a composite image by synthesizing a first image acquired through a first camera (e.g., the first camera (381) of FIG. 3) and a second image acquired through a second camera (e.g., the second camera (382) of FIG. 3) to which a bokeh effect is applied to blur a portion of the image.

[0199] In one embodiment, an electronic device may acquire an image through a first camera at operation 1910. At operation 1920, the electronic device may determine whether an image for generating a composite image can be captured through a second camera. If capturing through the second camera is not possible, the electronic device may perform operation 1910.

[0200] According to one embodiment, when shooting through a second camera is possible, in operation 1930, the electronic device may activate the second camera. The electronic device may set the second camera so that an image captured through the second camera corresponds to an FOV captured through the first camera. According to one embodiment, in operation 1930, the electronic device may set the first camera to an operation mode in which the image sensor outputs an image with a higher resolution. When the second camera has a narrower FOV (or angle of view) than the first camera, the electronic device may change the operation mode of the first camera to acquire an image with the same or similar resolution as that acquired through the second camera based on a wider FOV (or angle of view).

[0201] According to one embodiment, at operation 1940, the electronic device may determine whether a user input to capture an image has been received. In response to receiving the user input, the electronic device may acquire and store a composite image by synthesizing the image acquired through the first camera and the image acquired through the second camera, at operation 1950.

[0202] FIG. 20 is a flowchart (2000) illustrating a process in which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment acquires a composite image according to a magnification using two cameras (e.g., the first camera (381) of FIG. 3, the second camera (382)).

[0203] In one embodiment, the first camera may include a camera that supports a wider field of view (FOV) than the second camera. For example, the first camera may include a wide-angle camera, and the second camera may include a telephoto camera. In operation 2010, the electronic device may determine a magnification for providing the image.

[0204] According to one embodiment, in operation 2020, the electronic device may determine whether the determined magnification is included in a section that is greater than or equal to the first magnification and less than the second magnification. If the determined magnification is greater than or equal to the first magnification and less than the second magnification, the electronic device may perform operations 2021, 2023, and 2025 for acquiring a first image and a second image. In operation 2021, the electronic device may acquire a first image through a first image sensor based on a first mode. For example, the first mode may correspond to the second raw image patterns (620, 720, 820, and 920) of FIGS. 6 to 9. In operation 2023, the electronic device may acquire an image through the second image sensor based on a second mode. For example, the second mode may correspond to the first raw image patterns (610, 710, 810, 910) of FIGS. 6 to 9. In operation 2025, the electronic device may acquire a second image by cropping an area corresponding to the FOV of the first image within the image acquired in operation 2023. Even if the first camera supports a wider FOV (field of view) than the second camera, if the first image sensor operates based on an operation mode that supports a high resolution, the electronic device may crop the image acquired from the second image sensor. For example, if both the first image sensor and the second image sensor output images in an operation mode corresponding to the first raw image pattern (610, 710, 810, 910), the electronic device may crop the image acquired from the first image sensor. At operation 2050, the electronic device can synthesize the first image acquired at operation 2021 and the second image acquired at operation 2025.

[0205] According to one embodiment, in operation 2030, the electronic device may determine whether the determined magnification is included in a section that is greater than or equal to the second magnification and less than the third magnification. If the determined magnification is greater than or equal to the second magnification and less than the third magnification, the electronic device may perform operations 2031, 2033, and 2035 for acquiring a third image and a fourth image. In operation 2031, the electronic device may acquire an image through a first image sensor based on a first mode. In operation 2035, the electronic device may acquire a fourth image through a second image sensor based on a fourth mode. The fourth mode may be a sensor operation mode capable of outputting an image with a higher resolution than the second mode. For example, the third mode may correspond to the second raw image patterns (620, 720, 820, and 920) of FIGS. 6 to 9. In operation 2033, the electronic device can obtain a third image by cropping an area corresponding to the FOV of the fourth image within the image obtained in operation 2031. In operation 2050, the electronic device can synthesize the third image obtained in operation 2033 and the fourth image obtained in operation 2035.

[0206] According to one embodiment, when the determined magnification is equal to or greater than the third magnification, the electronic device may perform operations 2041, 2043, and 2045 for acquiring a fifth image and a sixth image. In operation 2041, the electronic device may acquire a fifth image through the first image sensor based on a third mode. The third mode may be a sensor operation mode capable of outputting an image with a higher resolution than the first mode. For example, the third mode may correspond to the third raw image patterns (630, 730, 830, and 930) of FIGS. 6 to 9. In operation 2043, the electronic device may acquire an image through the second image sensor based on a fourth mode. The electronic device may acquire a sixth image obtained by cropping an area corresponding to the FOV of the fifth image within the image acquired in operation 2043. At operation 2050, the electronic device can synthesize the fifth image acquired at operation 2041 and the sixth image acquired at operation 2045.

[0207] FIG. 21 illustrates examples of states in which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment acquires images for generating a composite image using two cameras (e.g., the first camera (381) of FIG. 3, the second camera (382) of FIG. 3).

[0208] An electronic device according to one embodiment may acquire images through cameras based on a state according to a magnification of an image to be acquired. For example, a first state (2110) may include a state in which the magnification is a first magnification (e.g., 2.0x magnification). A second state (2120) may include a state in which the magnification is a second magnification (e.g., 3.0x magnification). A third state (2130) may include a state in which the magnification is a third magnification (e.g., 4.0x magnification).

[0209] An electronic device according to one embodiment can acquire a first image (2111) based on a first mode of a first camera in a first state (2110). The first image (2111) can have, for example, a resolution of 12 Mp. The electronic device can acquire a second image (2115) obtained by cropping a portion of an image (2113) acquired based on a second mode of a second camera in the first state (2110). The second image (2115) obtained by cropping an area corresponding to the first image (2111) within the image (2113) can have, for example, a resolution of 6.75 Mp. The electronic device can generate a composite image by synthesizing the first image (2111) and the second image (2115).

[0210] According to one embodiment, an electronic device may acquire a fourth image (2125) based on a fourth mode of a second camera in a second state (2120). The fourth image (2125) may have, for example, a resolution of 12 Mp. The electronic device may acquire a third image (2123) obtained by cropping a portion of an image (2121) acquired based on a first mode of a first camera in a second state (2120). The third image (2123) obtained by cropping an area corresponding to the fourth image (2125) within the image (2121) may have, for example, a resolution of 5.3 Mp. The electronic device may generate a composite image by synthesizing the third image (2123) and the fourth image (2125).

[0211] An electronic device according to one embodiment can acquire a fifth image (2131) acquired based on a third mode of a first camera in a third state (2130). The fifth image (2131) can have, for example, a resolution of 12 Mp. The electronic device can acquire a sixth image (2135) obtained by cropping a portion of an image (2133) acquired based on a fourth mode of a second camera in the third state (2130). The sixth image (2135) obtained by cropping an area corresponding to the fifth image (2131) within the image (2133) can have, for example, a resolution of 6.75 Mp. The electronic device can generate a composite image by synthesizing the fifth image (2131) and the sixth image (2135).

[0212] FIG. 22 is a flowchart illustrating a process in which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment acquires a composite image according to magnification using three cameras.

[0213] An electronic device according to one embodiment may further include a third camera including a third image sensor in addition to a first camera (e.g., the first camera (381) of FIG. 3) and a second camera (e.g., the second camera (382) of FIG. 3). The first camera may include a camera supporting a wider angle of view than the second camera. The third camera may include a camera supporting a wider angle of view than the first camera. For example, the first camera may include a wide-angle camera. For example, the second camera may include a telephoto camera. For example, the third camera may include an ultra-wide-angle camera. In operation 2210, the electronic device according to one embodiment may determine a magnification for providing an image.

[0214] In operation 2220, the electronic device according to one embodiment may determine whether the determined magnification is included in a section that is greater than or equal to the first magnification and less than the second magnification. If the determined magnification is greater than or equal to the first magnification and less than the second magnification, the electronic device may perform operations 2221 and 2223 for acquiring a first image and a second image. In operation 2221, the electronic device may acquire a first image through a first image sensor based on a first mode. For example, the first mode may correspond to the second raw image patterns (620, 720, 820, 920) of FIGS. 6 to 9. In operation 2223, the electronic device may acquire an image through a third image sensor based on a second mode. For example, the second mode may correspond to the first raw image patterns (610, 710, 810, 910) of FIGS. 6 to 9. At operation 2250, the electronic device can synthesize the first image acquired at operation 2221 and the second image acquired at operation 2225.

[0215] In operation 2230, the electronic device according to one embodiment may determine whether the determined magnification is included in a section in which the determined magnification is greater than or equal to the second magnification and less than the third magnification. If the determined magnification is greater than or equal to the second magnification and less than the third magnification, the electronic device may perform operations 2231, 2233, and 2235 for acquiring a third image and a fourth image. In operation 2231, the electronic device may acquire an image through a first image sensor based on a first mode. In operation 2235, the electronic device may acquire a fourth image through a second image sensor based on a fourth mode. For example, the fourth mode may correspond to the second raw image patterns (620, 720, 820, and 920) of FIGS. 6 to 9. In operation 2233, the electronic device may acquire a third image obtained by cropping an area corresponding to the FOV of the fourth image within the image acquired in operation 2231. At operation 2250, the electronic device can synthesize the third image acquired at operation 2233 and the fourth image acquired at operation 2235.

[0216] According to one embodiment, when the determined magnification is equal to or greater than the third magnification, the electronic device may perform operations 2241, 2243, and 2245 for acquiring a fifth image and a sixth image. In operation 2241, the electronic device may acquire a fifth image through the first image sensor based on a third mode. The third mode may be a sensor operation mode capable of outputting an image with a higher resolution than the first mode. For example, the fourth mode may correspond to the third raw image patterns (630, 730, 830, and 930) of FIGS. 6 to 9. In operation 2243, the electronic device may acquire an image through the second image sensor based on the fourth mode. The electronic device may acquire a sixth image obtained by cropping an area corresponding to the FOV of the fifth image within the image acquired in operation 2243. At operation 2050, the electronic device can synthesize the fifth image acquired at operation 2241 and the sixth image acquired at operation 2245.

[0217] FIG. 23 illustrates examples of states in which an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment acquires images for generating a composite image using three cameras.

[0218] An electronic device according to one embodiment may acquire images through cameras based on a state according to a magnification of an image to be acquired. For example, a first state (2310) may include a state in which the magnification is a first magnification (e.g., 2.0x magnification). A second state (2320) may include a state in which the magnification is a second magnification (e.g., 3.0x magnification). A third state (2330) may include a state in which the magnification is a third magnification (e.g., 4.0x magnification).

[0219] An electronic device according to one embodiment can acquire a first image (2311) based on a first mode of a first camera in a first state (2310). The first image (2311) can have, for example, a resolution of 12 Mp. The electronic device can acquire a second image (2313) acquired based on a second mode of a third camera in the first state (2310). The second image (231) can have, for example, a resolution of 12 Mp. In contrast to the first state (2110) of FIG. 21, which synthesizes a 12 Mp image and a 6.75 Mp image, the first state (2310) of FIG. 23 synthesizes two 12 Mp images, thereby allowing the electronic device to generate a composite image based on an image with a higher resolution.

[0220] According to one embodiment, an electronic device can acquire a fourth image (2325) based on a fourth mode of a second camera in a second state (2320). The fourth image (2325) can have, for example, a resolution of 12 Mp. The electronic device can acquire a third image (2323) obtained by cropping a portion of an image (2321) acquired based on a first mode of a first camera in a second state (2320). The third image (2323) obtained by cropping an area corresponding to the fourth image (2325) within the image (2321) can have, for example, a resolution of 5.3 Mp. The electronic device can generate a composite image by synthesizing the third image (2323) and the fourth image (2325).

[0221] According to one embodiment, an electronic device may acquire a fifth image (2331) acquired based on a third mode of a first camera in a third state (2330). The fifth image (2331) may have, for example, a resolution of 12 Mp. The electronic device may acquire a sixth image (2335) obtained by cropping a portion of an image (2333) acquired based on a fourth mode of a second camera in the third state (2330). The sixth image (2335) obtained by cropping an area corresponding to the fifth image (2331) within the image (2333) may have, for example, a resolution of 6.75 Mp. The electronic device may generate a composite image by synthesizing the fifth image (2331) and the sixth image (2335).

[0222] FIG. 24 is a side view illustrating an example of a first form of an electronic device (101) including a hinge structure, in one embodiment. FIG. 25 is a perspective view illustrating an example of a first form of an electronic device (101) including a hinge structure, in one embodiment.

[0223] In one embodiment, the electronic device (101) may include a foldable device including a plurality of housings and at least one hinge structure connected between two of the plurality of housings. However, the foldable device is an example of a form of the electronic device (101) and is not limited thereto. Referring to FIG. 24, the electronic device (101) may include a first housing (2410), a second housing (2420), a third housing (2430), a first hinge structure (2440), and a second hinge structure (2450). The electronic device (101) may include at least one camera (2480) disposed in the third housing (2430) (e.g., the first camera (381) and the second camera (382) of FIG. 3 , the first camera and the second camera of FIGS. 20 and 21 , and the first camera and the second camera of FIGS. 22 and 23 ).

[0224] In one embodiment, the electronic device (101) may include a folding detection sensor capable of detecting whether the electronic device (101) is folded by at least one hinge structure. For example, the folding detection sensor may include at least one of a rotation detection sensor or a Hall sensor. The electronic device (101) may further include at least one camera (2490) (e.g., the third camera of FIGS. 22 and 23) disposed in the second housing (2420). In one embodiment, the electronic device (101) may obtain a composite image based on the process illustrated in FIG. 22 based on the electronic device (101) being in the first configuration. The electronic device (101) may obtain a composite image based on the process illustrated in FIG. 20 based on the electronic device (101) being other than the first configuration (e.g., being in the second configuration or the third configuration).

[0225] In one embodiment, a first hinge structure (2440) may be disposed between a first housing (2410) and a second housing (2420). The first hinge structure (2440) may rotatably connect the first housing (2410) and the second housing (2420). A second hinge structure (2450) may be disposed between a second housing (2420) and a third housing (2440). The second hinge structure (2450) may rotatably connect the second housing (2420) and the third housing (2430).

[0226] In one embodiment, a flexible display (2460) (e.g., display module (160) of FIG. 1, display (360) of FIG. 3) may be disposed in at least one of the first housing (2410), the second housing (2420), or the third housing (2430). The flexible display (2460) may be disposed toward one side of the electronic device (101) depending on the shape of the electronic device. The flexible display (2460) may be disposed to span an area corresponding to at least one of the first hinge structure (2440) or the second hinge structure (2450). The flexible display (2460) may be folded or unfolded by pivoting one of the first housing (2410), the second housing (2420), or the third housing (2430) relative to the other.

[0227] In one embodiment, the flexible display (2460) may include a first region, a second region, and a third region. For example, the first region may include a region corresponding to the first housing (2410) within the entire area of ​​the flexible display (2460). For example, the second region may include a region corresponding to the second housing (2420) within the entire area of ​​the flexible display (2460). For example, the third region may include a region corresponding to the third housing (2430) within the entire area of ​​the flexible display (2460).

[0228] In one embodiment, referring to FIGS. 24 and 25, the electronic device (101) may have a state in which the first housing (2410), the second housing (2420), and the third housing (2430) are unfolded so that they substantially correspond to one side. The unfolded state of the electronic device (101) may be referred to as a first configuration. In the first configuration, the first region, the second region, and the third region of the flexible display (2460) may be arranged to face substantially the same direction. For example, the first region, the second region, and the third region of the flexible display (2460) may be arranged to face a first direction (e.g., the +z-axis direction).

[0229] FIG. 26 is a side view illustrating an example of a second form of an electronic device (101) including a hinge structure, in one embodiment. FIG. 27 is a perspective view illustrating an example of a second form of an electronic device (101) including a hinge structure, in one embodiment.

[0230] In one embodiment, the electronic device (101) may have a state in which the second housing (2420) is rotated relative to the first housing (2410) by the first hinge structure (2440) so that the first region and the second region of the flexible display (2460) face each other. The first region may be arranged to face a second direction (e.g., the -z-axis direction), and the second region may be arranged to face an opposite direction (e.g., the first direction (+z-axis direction)). The electronic device (101) may have a state in which the second housing (2420) and the third housing (2430) are unfolded and connected by the second hinge structure (2450) so that the second region and the third region of the flexible display (2460) face substantially the same direction (e.g., the first direction (+z-axis direction)). A state in which the first and second regions face each other and the second and third regions are arranged so as to face substantially the same direction can be referred to as the second form.

[0231] FIG. 28 is a side view illustrating an example of a third form of an electronic device (101) including a hinge structure, in one embodiment. FIG. 29 is a perspective view illustrating an example of a third form of an electronic device (101) including a hinge structure, in one embodiment.

[0232] In one embodiment, the electronic device (101) may have a state in which the second housing (2420) is rotated relative to the first housing (2410) by the first hinge structure (2440) so that the first region and the second region of the flexible display (2460) face each other. The first region may be arranged to face a first direction (e.g., the +z-axis direction), and the second region may be arranged to face an opposite direction (e.g., the second direction (-z-axis direction)). The electronic device (101) may have a state in which the third housing (2430) is rotated relative to the second housing (2420) by the second hinge structure (2450) so that the second region and the third region of the flexible display (2460) face opposite directions. The third region may be arranged to face an opposite direction (e.g., the first direction (+z-axis direction)) to the direction in which the second region faces.

[0233] In one embodiment, the electronic device (101) may further include a second display (2470). The second display (2470) may be positioned so that at least a portion thereof is visually exposed in the third configuration. For example, when the second display (2470) is positioned in an area corresponding to the second housing (2420), it may be positioned on the opposite side from the side where the flexible display (2460) is positioned. However, the present invention is not limited thereto. For example, the second display may also be positioned in an area corresponding to the third housing (2430).

[0234] The shape of the electronic device (101) illustrated in FIGS. 24 to 29 is for explaining an example of one embodiment, and the shape of the electronic device (101) is not limited to the shape illustrated in FIGS. 24 to 29.

[0235] FIG. 30 is a flowchart (3000) illustrating a process for acquiring an image based on the shape of the electronic device (101) according to one embodiment. FIG. 31 illustrates an example in which the electronic device (101) according to one embodiment displays an image acquired in a second shape or a third shape. FIG. 32 illustrates an example in which the electronic device according to one embodiment displays an image acquired in a first shape.

[0236] According to one embodiment, in operation 3010, the electronic device (101) can identify the shape of the electronic device (101). The electronic device (101) can determine whether the electronic device is in a folded state by at least one hinge structure (2440, 2450) through at least one folding detection sensor. For example, the electronic device (101) can determine an angle formed by two housings connected by the hinge structure through the folding detection sensor. If the angle between the two housings falls within a first range (e.g., 0 degrees or more and less than 15 degrees), the electronic device (101) can determine that the portion corresponding to the hinge structure is in a folded state. If the angle between the two housings falls within a second range (e.g., 165 degrees or more and 180 degrees or less), the electronic device (101) can determine that the portion corresponding to the hinge structure is in an unfolded state. When the electronic device (101) includes a plurality of hinge structures, the electronic device (101) can determine the shape of the electronic device (101) based on a combination of folding / unfolding states for the plurality of hinge structures.

[0237] According to one embodiment, in operation 3020, the electronic device (101) may determine whether the electronic device (101) is in the first form. If the electronic device (101) is not in the first form (e.g., in the second form or the third form), the electronic device (101) may perform operation 1020 of FIG. 10 or operation 1020 of FIG. 13. Referring to FIG. 31, the electronic device (101-2) in the second form may display a preview image (3112) acquired through a camera (e.g., the first camera (381), the second camera (382) of FIG. 3, the first camera and the second camera of FIGS. 20 and 21, the first camera and the second camera of FIGS. 22 and 23, and at least one camera (2480) of FIG. 24) in the third area (3112) of the flexible display (2460). A third type of electronic device (101-3) can display a preview image (3113) acquired through a camera (e.g., the first camera (381), the second camera (382) of FIG. 3, the first camera and the second camera of FIGS. 20 and 21, the first camera and the second camera of FIGS. 22 and 23, and at least one camera (2480) of FIG. 24) on a second display (3113).

[0238] Referring to FIG. 31, in the second type of electronic device (101-2) or the third type of electronic device (101-3), the preview image may be displayed in a display area (3122) (e.g., portrait) having an aspect ratio in which the height in the vertical direction (e.g., y-axis direction) is greater than the width in the horizontal direction (e.g., x-axis direction). When the aspect ratio of the image (3132) acquired through the camera corresponds to the aspect ratio of the display area (3122), the electronic device (101-2, 101-3) may display the image (3132) itself based on the process illustrated in FIG. 10 or FIG. 13, or may display an image obtained by cropping the corresponding area (3134) according to the magnification as the preview image (3112, 3113).

[0239] According to one embodiment, in operation 3020, when the electronic device (101) is in the first form, the electronic device (101) may perform operation 1040 of FIG. 10 or operation 1040 of FIG. 13. Referring to FIG. 32, the electronic device (101-1) of the first form may display a preview image (3111) acquired through a camera across the first area, the second area, and the third area of ​​the flexible display (2460). The preview image (3111) displayed on the electronic device (101-1) of the first form may be displayed within a display area (3121) (e.g., landscape) having an aspect ratio in which the width in the horizontal direction (e.g., x-axis direction) is greater than the height in the vertical direction (e.g., y-axis direction). In contrast, the image (3131) acquired through the camera may have an aspect ratio in which the height in the vertical direction is greater than the width in the horizontal direction. Since the aspect ratio of the display area (3121) and the aspect ratio of the image (3131) acquired through the camera are different, the first type electronic device (101-1) may crop a portion (3133) of the image (3131) to display the preview image (3111). Since the portion of the image (3131) acquired through the camera is cropped and displayed, the image quality of the displayed preview image (3111) may deteriorate. Therefore, the first type electronic device (101-1) may skip operations 1020, 1025, 1030, and 1035 and perform operation 1040. If the set magnification is less than the third magnification, the first type electronic device (101-1) may perform operation 1045. When the user adjusts the magnification to be greater than or equal to the third magnification and less than or equal to the fourth magnification, the first type electronic device (101-1) can perform operation 1055. When the user adjusts the magnification to be greater than or equal to the fourth magnification and less than or equal to the fifth magnification, the first type electronic device (101-1) can perform operation 1365.When the user adjusts the magnification to a 5th magnification or higher, the first type of electronic device (101-1) can perform operation 1375.

[0240] In one embodiment, the first type of electronic device (101-1) displays a preview image over a relatively large area, so that a user may be sensitive to the resolution of the preview image. Accordingly, when the electronic device (101) has the first type, the electronic device operates based on an operating mode in which the image sensor can output an image with the highest resolution, and may also crop an image acquired from the image sensor to display the preview image.

[0241] In one embodiment, an electronic device may include a flexible display. The flexible display may output a screen through a display area that is visually exposed toward the outside of the electronic device. At least a portion of the flexible display may be rollable into or slidable into an interior space of the electronic device. For example, the size of the display area may change depending on the size of at least a portion of the display that is rolled or slid into the housing. For example, the electronic device may be in any one of a plurality of states, including a first state providing a display area having a first size and a second state providing a display area having a second size different from the first size.

[0242] FIG. 33 illustrates, in one embodiment, a plan view of an exemplary electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) in a first state of a rollable display and an area for acquiring an image from an image sensor.

[0243] Referring to FIG. 33, the electronic device (101) may include a first housing (3310), a second housing (3320) movable relative to the first housing (3310) in a first direction (3361) parallel to the y-axis or a second direction (3362) parallel to the y-axis and opposite to the first direction (3361), and a display (3330) (e.g., the display module (160) of FIG. 1). Although the second housing (3320) is described as moving relative to the first housing (3310), this is not limited thereto. For example, the first housing (3310) may move relative to the second housing (3320). For example, the size of the display area of ​​the display (3330) visually exposed toward the outside of the electronic device (101) may change depending on a change in the relative positional relationship between the first housing (3310) and the second housing (3320).

[0244] For example, within the first state, the second housing (3320) may be movable relative to the first housing (3310) in a first direction (3361) among the first direction (3361) and the second direction (3362). For example, within the first state, the second housing (3320) may not be movable relative to the first housing (3310) in the second direction (3362).

[0245] For example, the first state may be a state in which the display (3330) has a display area having the smallest size. For example, within the first state, the display area may correspond to the first area (3331). For example, within the first state, the first area (3331) of the display (3330) and another area (e.g., the second area (3332) of FIG. 35) may be disposed within the first housing (3310). For example, within the first state, the second area (3332) of FIG. 35 may be disposed within the internal space of the electronic device (101). For example, within the first state, the first area (3331) may be disposed in a planar shape. For example, within the first state, at least a portion of the second area (3332) of FIG. 35 may be disposed in a curved shape. However, the present invention is not limited thereto.

[0246] In one embodiment, the second housing (3320) may include a front camera (3351) positioned to capture visual information through a portion of the first region (3331) and to capture images in a third direction (3363) parallel to the z-axis. In one embodiment, the second housing (3320) may include at least one rear camera (e.g., rear cameras (3352) of FIG. 34) that is visually exposed through a portion of the second housing (3320) and faces a fourth direction (3364) opposite to the third direction (3363).

[0247] Referring to FIG. 33, within the first state, a display area of ​​a display corresponding to a first area (3331) may have a first aspect ratio. In one embodiment, when an image (3370) acquired through a camera (e.g., a front camera (3351) or a rear camera (3352)) has the first aspect ratio, the electronic device (101) may display the image (3370) in the display area (3331) or display an image obtained by cropping the area (3371) having the first aspect ratio as a preview image according to a magnification.

[0248] FIG. 34 is a bottom view of an exemplary electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) in a first state of a rollable display, in one embodiment.

[0249] Referring to FIG. 34, within the first state, at least one rear camera (3352) disposed within the second housing (3320) may be disposed within a structure formed in the first housing (3310) for the at least one rear camera (3352). For example, the at least one rear camera (3352) may be visually exposed to the outside of the electronic device (101) through the structure. The structure may be implemented in various ways. For example, the structure may be an opening or a notch. However, the present invention is not limited thereto.

[0250] In one embodiment, the state of an electronic device may change from a first state to a second state. For example, the electronic device may change from a first state to an intermediate state between the first and second states and then to a second state.

[0251] FIG. 35 illustrates, in one embodiment, a plan view of an exemplary electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) in a second state of a rollable display and an area for acquiring an image from an image sensor.

[0252] In one embodiment, the second housing (3320) may be movable relative to the first housing (3310) in a first direction (3361) and a second direction (3362) within the second state. Within the second state, the second housing (3320) may not be movable in the first direction (3361).

[0253] For example, within the second state, the display (3330) may provide a display area having the largest size. For example, within the second state, the display area may correspond to an area (3333) including a first area (3331) and a second area (3332). For example, the second area (3332), which was housed within the first housing (3310) within the first state, may be visually exposed toward the outside of the electronic device (101) (e.g., in the third direction (3363)) within the second state. For example, within the second state, the first area (3331) and the second area (3332) may include a planar shape. However, the present invention is not limited thereto. For example, at least one of the first area (3331) or the second area (3332) may include a curved portion extending from the planar shape and positioned at an edge portion of the area (3333).

[0254] According to one embodiment, in the second state, the display (3330) may display a screen in an area (3333) having a different aspect ratio than in the first state. In the second state, the aspect ratio of the image (3370) acquired by the electronic device (101) through the camera may be different from that of the area (3333). Since the aspect ratios of the image (3370) and the area (3333) are different, in the second state, the electronic device (101) may crop a portion (3372) of the acquired image (3370) and display it within the area (3333). If a portion of the image (3370) acquired by the camera is displayed as a preview image, the image quality of the displayed image may deteriorate compared to the image (3370). Therefore, in the second state, the electronic device (101) can omit operations 1020, 1025, 1030, and 1035 of FIG. 10 and perform operation 1040.

[0255] In one embodiment, the electronic device (101) in the second state displays the preview image over a relatively large area, so that the user can be sensitive to the resolution of the preview image. Accordingly, in the second state, the electronic device (101) operates based on an operating mode in which the image sensor can output an image with the highest resolution, and may crop the image acquired from the image sensor to display the preview image.

[0256] FIG. 36 is a bottom view of an exemplary electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) in a second state of a rollable display, in one embodiment.

[0257] Referring to FIG. 36, in the second state, at least one rear camera (3352) may be positioned outside the structure. For example, in the second state, at least one rear camera (3352) may be visually exposed to the outside in the second state.

[0258] Although not illustrated in FIGS. 33 to 36, the electronic device (101) may have an intermediate state between the first state and the second state. For example, the size of the display area in the intermediate state may be larger than the size of the display area in the first state and smaller than the size of the display area in the second state. For example, the display area in the intermediate state may correspond to a portion of area (3333). However, the present invention is not limited thereto. According to one embodiment, the electronic device in the intermediate state may perform the same operation as either the operation in the first state or the operation in the second state.

[0259] An electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) according to one embodiment comprises a touchscreen display (e.g., the display module (160) of FIG. 1, the display (360) of FIG. 3), a first camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the first camera (381) of FIG. 3) including a first image sensor (e.g., the first image sensor (383) of FIG. 3), a second camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the second camera (382) of FIG. 3) including a second image sensor (e.g., the second image sensor (384) of FIG. 3), at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) including processing circuitry, and It may include a memory (e.g., memory (130) of FIG. 1, memory (250) of FIG. 2, memory (330) of FIG. 3) that stores instructions. The instructions may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to determine a magnification for an image to be acquired.The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to acquire a first image in a first mode through the first image sensor (e.g., first image sensor (383) of FIG. 3) to output an image with a first resolution. The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to display a preview image based on the first image through the touchscreen display (e.g., display module (160) of FIG. 1, display (360) of FIG. 3). The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to receive a user input for adjusting a magnification through the touchscreen display (e.g., display module (160) of FIG. 1, display (360) of FIG. 3).The above instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a second image in a second mode, wherein the second image sensor (e.g., the second image sensor (384) of FIG. 3) outputs an image of a second resolution, at least in part based on a determination that a magnification corresponding to the user input is greater than or equal to the first magnification and less than the second magnification. The above instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a third image in a third mode, wherein the first image sensor (e.g., the first image sensor (383) of FIG. 3) outputs an image having a third resolution higher than the first resolution, at least in part based on a determination that a magnification corresponding to the user input is greater than or equal to the second magnification and less than the third magnification.

[0260] In one embodiment, the first image sensor (e.g., the first image sensor (383) of FIG. 3) may be configured to output an image by binning a plurality of sensor pixels within the first image sensor (e.g., the first image sensor (383) of FIG. 3) in the first mode. The second image sensor (e.g., the second image sensor (384) of FIG. 3) may be configured to output an image by binning a plurality of sensor pixels within the second image sensor (e.g., the second image sensor (384) of FIG. 3) in the second mode. The above instructions may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to perform a remosaic operation of transforming a color order of pixel values ​​included in a raw image acquired from the first image sensor (e.g., first image sensor (383) of FIG. 3) as at least a part of acquiring the third image in the third mode. The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to obtain the third image based on the result of performing the remosaic operation.

[0261] In one embodiment, the instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and the at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a fourth image in a fourth mode, wherein the second image sensor (e.g., the second image sensor (384) of FIG. 3) outputs an image having a fourth resolution higher than the second resolution, based at least in part on a determination that a magnification corresponding to the user input is greater than or equal to the third magnification and less than the fourth magnification.

[0262] In one embodiment, the instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and the at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a fifth image in a fifth mode, wherein the first image sensor (e.g., the first image sensor (383) of FIG. 3) outputs an image having a fifth resolution higher than the third resolution, at least in part based on a determination that a magnification corresponding to the user input is greater than or equal to the fourth magnification and less than the fifth magnification. The above commands may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a sixth image in a sixth mode, which causes the second image sensor (e.g., the second image sensor (384) of FIG. 3) to output an image having a sixth resolution higher than the fourth resolution, at least in part based on the determination that a magnification corresponding to the user input is equal to or greater than the fifth magnification.

[0263] In one embodiment, the third magnification may be twice the first magnification. The second magnification may be between the first magnification and the third magnification.

[0264] In one embodiment, the fourth magnification may be twice the second magnification. The fifth magnification may be twice the third magnification.

[0265] In one embodiment, the first camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the first camera (381) of FIG. 3) and the second camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the second camera (382) of FIG. 3) may support different fields of view (FOV).

[0266] In one embodiment, the instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire an image having the third resolution in the third mode through the first image sensor based on a magnification corresponding to the user input being smaller than the first magnification, and to acquire the first image by down-scaling the image having the third resolution.

[0267] In one embodiment, the instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and the at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a first image having the first resolution from the first image sensor (e.g., the first image sensor (383) of FIG. 3) in the first mode, at least in part based on a determination that a magnification corresponding to the user input corresponds to a sixth magnification that is less than the first magnification. The above commands may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a seventh image of the third resolution in the third mode through the first image sensor (e.g., the first image sensor (383) of FIG. 3) based at least in part on the determination that a magnification corresponding to the user input is greater than the sixth magnification and less than the first magnification. The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to down-scale at least a portion of the seventh image based on the determined magnification.The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to display at least a portion of the down-scaled seventh image as the preview image through the touchscreen display (e.g., display module (160) of FIG. 1, display (360) of FIG. 3).

[0268] A method of operating an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) including a first camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the first camera (381) of FIG. 3)) including a first image sensor (e.g., the first image sensor (383) of FIG. 3) according to one embodiment and a second camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the second camera (382) of FIG. 3)) including a second image sensor (e.g., the second image sensor (384) of FIG. 3) may include an operation of determining a magnification for an image to be acquired. The method may include an operation of acquiring a first image in a first mode, which causes the first image sensor (e.g., the first image sensor (383) of FIG. 3) to output an image having a first resolution, through the first image sensor. The method may include an operation of displaying a preview image based on the first image through a touchscreen display (e.g., the display module (160) of FIG. 1, the display (360) of FIG. 3). The method may include an operation of receiving a user input for adjusting a magnification through the touchscreen display (e.g., the display module (160) of FIG. 1, the display (360) of FIG. 3). The method may include an operation of acquiring a second image in a second mode, such that the second image sensor (e.g., the second image sensor (384) of FIG. 3) outputs an image having a second resolution, based at least in part on a determination that a magnification corresponding to the user input is greater than or equal to the first magnification and less than the second magnification.The method may include an operation of acquiring a third image in a third mode, such that the first image sensor (e.g., the first image sensor (383) of FIG. 3) outputs an image having a third resolution higher than the first resolution, based at least in part on determining that a magnification corresponding to the user input is greater than or equal to the second magnification and less than the third magnification.

[0269] In the method, the operation of acquiring the first image from the first image sensor (e.g., the first image sensor (383) of FIG. 3) in the first mode may include an operation of the first image sensor (e.g., the first image sensor (383) of FIG. 3) binning a plurality of sensor pixels within the first image sensor (e.g., the first image sensor (383) of FIG. 3) and outputting the image. In the method, the operation of acquiring the second image from the second image sensor (e.g., the second image sensor (384) of FIG. 3) in the second mode may include an operation of the second image sensor (e.g., the second image sensor (384) of FIG. 3) binning a plurality of sensor pixels within the second image sensor (e.g., the second image sensor (384) of FIG. 3) and outputting the image. In the third mode, the operation of acquiring the third image from the first image sensor (e.g., the first image sensor (383) of FIG. 3) may include a re-mosaic operation of converting the color order of pixel values ​​included in the raw image acquired from the first image sensor (e.g., the first image sensor (383) of FIG. 3). In the third mode, the operation of acquiring the third image from the first image sensor (e.g., the first image sensor (383) of FIG. 3) may include an operation of acquiring the third image based on a result of performing the re-mosaic operation.

[0270] In one embodiment, the method may further include an operation of acquiring a fourth image in a fourth mode, through the second image, such that the second image sensor (e.g., the second image sensor (384) of FIG. 3) outputs an image having a fourth resolution higher than the second resolution, based at least in part on determining that a magnification corresponding to the user input is greater than or equal to the third magnification and less than the fourth magnification.

[0271] In one embodiment, the method may include acquiring a fifth image in a fifth mode, through the first image sensor (e.g., the first image sensor (383) of FIG. 3), such that the first image sensor (e.g., the first image sensor (383) of FIG. 3) outputs an image having a fifth resolution higher than the third resolution, based at least in part on the determination that a magnification corresponding to the user input is greater than or equal to the fourth magnification and less than or equal to the fifth magnification. The method may include acquiring a sixth image in a sixth mode, through the second image sensor (e.g., the second image sensor (384) of FIG. 3), such that the second image sensor (e.g., the second image sensor (384) of FIG. 3) outputs an image having a sixth resolution higher than the fourth resolution, based at least in part on the determination that a magnification corresponding to the user input is greater than or equal to the fifth magnification.

[0272] In one embodiment, the third magnification may be twice the first magnification. The second magnification may be between the first magnification and the third magnification.

[0273] In one embodiment, the fourth magnification may be twice the second magnification. The fifth magnification may be twice the third magnification.

[0274] In one embodiment, the first camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the first camera (381) of FIG. 3) and the second camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the second camera (382) of FIG. 3) may support different fields of view (FOV).

[0275] In one embodiment, the operation of acquiring the first image through the first image sensor may include an operation of acquiring an image having the third resolution in the third mode through the first image sensor based on a magnification corresponding to the user input being smaller than the first magnification, and an operation of acquiring the first image by down-scaling the image having the third resolution.

[0276] In one embodiment, the operation of acquiring the first image through the first image sensor (e.g., the first image sensor (383) of FIG. 3) may include an operation of acquiring the first image at the first resolution in the first mode through the first image sensor (e.g., the first image sensor (383) of FIG. 3) based at least in part on determining that the magnification corresponding to the user input corresponds to a sixth magnification that is less than the first magnification. A method, wherein the operation of acquiring the first image through the first image sensor (e.g., the first image sensor (383) of FIG. 3) includes an operation of acquiring a seventh image of the third resolution from the first image sensor (e.g., the first image sensor (383) of FIG. 3) in the third mode through the first image sensor (e.g., the first image sensor (383) of FIG. 3) based at least in part on the determination that a magnification corresponding to the user input is greater than the sixth magnification and less than the first magnification, down-scaling at least a portion of the seventh image based on the determined magnification, and displaying at least a portion of the down-scaled seventh image as a preview image through the touchscreen display (e.g., the display module (160) of FIG. 1, the display (360) of FIG. 3).

[0277] In one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) comprises a touchscreen display (e.g., display module (160) of FIG. 1, display (360) of FIG. 3), a first camera (e.g., camera module (160) of FIG. 1, camera module (160) of FIG. 2, first camera (381) of FIG. 3) including a first image sensor (e.g., first image sensor (383) of FIG. 3), a second camera (e.g., camera module (160) of FIG. 1, camera module (160) of FIG. 2, second camera (382) of FIG. 3) including a second image sensor (e.g., second image sensor (384) of FIG. 3), at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) including a processing circuit), and instructions for storing The instructions may include a memory (e.g., a memory (130) of FIG. 1, a memory (250) of FIG. 2, a memory (330) of FIG. 3). The instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to determine a magnification for an image to be acquired by the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3). The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to receive a user input for adjusting a magnification through the touchscreen display (e.g., display module (160) of FIG. 1, display (360) of FIG. 3).The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to acquire a first image in a first mode, such that the first image sensor (e.g., first image sensor (383) of FIG. 3) outputs an image having a first resolution, at least in part based on the determination that a magnification corresponding to the user input is a first magnification. The above commands may be individually or collectively executed by at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to obtain a second image obtained by cropping at least a portion of an image obtained through the second image sensor (e.g., the second image sensor (384) of FIG. 3) in a second mode in which the second image sensor (e.g., the second image sensor (384) of FIG. 3) outputs an image having a second resolution, at least in part based on the determination that the magnification corresponding to the user input is the first magnification. The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to obtain a first composite image that synthesizes the first image and the second image.The above commands may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to obtain a third image obtained by cropping at least a portion of an image obtained through the first image sensor (e.g., the first image sensor (383) of FIG. 3) in the first mode, at least in part based on the determination that the magnification corresponding to the user input is a second magnification higher than the first magnification. The above instructions may be individually or collectively executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image signal processor (260) of FIG. 2, and at least one processor (320) of FIG. 3) to cause the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) to acquire a fourth image in a third mode, through the second image sensor (e.g., the second image sensor (384) of FIG. 3), to output an image having a third resolution higher than the second resolution, at least in part based on the determination that the magnification corresponding to the user input is a second magnification higher than the first magnification. The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to obtain a second composite image that is a composite of the third image and the fourth image.

[0278] In one embodiment, the first image sensor (e.g., the first image sensor (383) of FIG. 3) may be configured to bin and output the output of a plurality of sensor pixels within the first image sensor (e.g., the first image sensor (383) of FIG. 3) in the first mode. The second image sensor (e.g., the second image sensor (384) of FIG. 3) may be configured to bin and output the output of a plurality of sensor pixels within the second image sensor (e.g., the second image sensor (384) of FIG. 3) in the second mode. The above instructions may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to perform a remosaic operation of transforming a color order of pixel values ​​included in a raw image acquired from the first image sensor as at least a part of acquiring the third image in the third mode. The above commands may be individually or collectively executed by at least one processor (e.g., processor (120) of FIG. 1, image signal processor (260) of FIG. 2, at least one processor (320) of FIG. 3) to cause the electronic device (e.g., electronic device (101) of FIG. 1, electronic device (101) of FIG. 3) to obtain a third image based on a result of performing the remosaic operation.

[0279] A method of operating an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (101) of FIG. 3) including a first camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the first camera (381) of FIG. 3)) including a first image sensor (e.g., the first image sensor (383) of FIG. 3) according to one embodiment and a second camera (e.g., the camera module (160) of FIG. 1, the camera module (160) of FIG. 2, the second camera (382) of FIG. 3)) including a second image sensor (e.g., the second image sensor (384) of FIG. 3) may determine an operation of determining a magnification for an image to be acquired. The method may include an operation of receiving a user input for adjusting the magnification through a touchscreen display (e.g., the display module (160) of FIG. 1, the display (360) of FIG. 3). The method may include an operation of acquiring a first image in a first mode, which causes the first image sensor (e.g., the first image sensor (383) of FIG. 3) to output an image with a first resolution, through the first image sensor (e.g., the first image sensor (383) of FIG. 3), based at least in part on the determination that the magnification corresponding to the user input is less than a defined magnification. The method may include an operation of acquiring a second image in a second mode, which causes the second image sensor (e.g., the second image sensor (384) of FIG. 3) to output an image with a second resolution, based at least in part on the determination that the magnification corresponding to the user input is less than a defined magnification. The method may include an operation of acquiring a first image, which is a composite of the first image and the second image, based at least in part on the determination that the magnification corresponding to the user input is less than a defined magnification.The method may include an operation of acquiring a third image in a third mode, causing the first image sensor (e.g., the first image sensor (383) of FIG. 3) to output an image having a third resolution higher than the first resolution, through the first image sensor (e.g., the first image sensor (383) of FIG. 3), at least partially based on the determination that the magnification corresponding to the user input is greater than or equal to the defined magnification. The method may include an operation of acquiring a fourth image in a second mode, through the second image sensor (e.g., the second image sensor (384) of FIG. 3), at least partially based on the determination that the magnification corresponding to the user input is greater than or equal to the defined magnification. The method may include an operation of acquiring a second composite image, which is a composite of the third image and the fourth image, at least partially based on the determination that the magnification corresponding to the user input is greater than or equal to the defined magnification.

[0280] In one embodiment, the operation of acquiring the first image may include an operation of the first image sensor (e.g., the first image sensor (383) of FIG. 3) binning outputs of a plurality of sensor pixels within the first image sensor (e.g., the first image sensor (383) of FIG. 3) and outputting the binned outputs. The operation of acquiring the second image may include an operation of the second image sensor (e.g., the second image sensor (384) of FIG. 3) binning outputs of a plurality of sensor pixels within the second image sensor (e.g., the second image sensor (384) of FIG. 3) and outputting the binned outputs. The operation of acquiring the fourth image may include an operation of the second image sensor (e.g., the second image sensor (384) of FIG. 3) binning outputs of a plurality of sensor pixels within the second image sensor (e.g., the second image sensor (384) of FIG. 3) and outputting the binned outputs. The operation of acquiring the third image may include a remosaic operation of converting the color order of pixel values ​​included in the raw image acquired from the first image sensor (e.g., the first image sensor (383) of FIG. 3). The operation of acquiring the third image may include an operation of acquiring the third image based on the result of performing the remosaic operation.

[0281] An electronic device and an operating method thereof according to various embodiments can reduce the physical size of a camera module including a plurality of cameras by lowering the magnification of an optical system included in the plurality of cameras.

[0282] An electronic device and an operating method thereof according to various embodiments can reduce differences in properties between images acquired through a plurality of cameras to synthesize a plurality of images.

[0283] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the description of the present disclosure.

[0284] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

[0285] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to the embodiments described in the claims or specification of the present disclosure.

[0286] In the present disclosure, a function or operation performed by an electronic device may be performed by one or more processors executing one or more instructions stored in a memory. The function or operation of the electronic device mentioned in the present disclosure may be performed by one processor executing one or more instructions, or may be performed by a combination of multiple processors executing one or more instructions. The processor mentioned in the present disclosure may be understood to include a circuit for performing an operation or controlling other components of the electronic device. For example, the one or more processors may include at least one of a central processing unit (CPU), a microprocessor unit (MPU), an application processor (AP), a communication processor (CP), a neural processing unit (NPU), a system on chip (SoC), an application-specific integrated circuit (ASIC), or an integrated circuit (IC) configured to execute one or more instructions. The one or more processors may be configured to perform the operations of the electronic device described above.

[0287] In the present disclosure, a program (software module, software) may be stored in a non-volatile memory including a random access memory (RAM), a flash memory, a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), digital versatile discs (DVDs) or other forms of optical storage devices, a magnetic cassette. Or, it may be stored in a memory formed by a combination of some or all of these. The memory may be formed by a single storage medium, or may be formed by a combination of a plurality of storage media. The one or more commands may be stored in a single storage medium, or may be distributed and stored in a plurality of storage media.

[0288] Additionally, the program may be stored on an attachable storage device that is accessible via a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure via an external port. Additionally, a separate storage device on the communication network may be connected to a device performing an embodiment of the present disclosure.

[0289] In the specific embodiments of the present disclosure described above, components included in the disclosure are expressed in the singular or plural form, depending on the specific embodiment presented. However, the singular or plural expressions are selected to suit the presented situation for convenience of explanation, and the present disclosure is not limited to singular or plural components. Components expressed in the plural form may be composed of singular elements, or components expressed in the singular form may be composed of plural elements.

[0290] Additionally, in the present disclosure, terms such as “part”, “module”, etc. may refer to a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.

[0291] A "component" or "module" may be implemented by a program stored in an addressable storage medium and executed by a processor. For example, a "component" or "module" may be implemented by components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

[0292] The specific implementations described in this disclosure are merely exemplary and do not limit the scope of the present disclosure in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.

[0293] Additionally, in the present disclosure, “comprising at least one of a, b, or c” may mean “comprising only a, including only b, including only c, or including a combination of two or more (including a and b, including b and c, including a and c, or including all of a, b, and c).

[0294] While the detailed description of this disclosure has described specific embodiments, it should be understood that various modifications are possible without departing from the scope of this disclosure. Therefore, the scope of this disclosure should not be limited to the described embodiments, but should be defined not only by the scope of the claims described below, but also by equivalents thereof.

[0295] In this disclosure, the term "if" will be understood to mean "when, upon," "in response to determining," or "in response to detecting," as the context requires. Similarly, "if it is determined to do," or "if [a stated condition or event] is detected," will be understood to optionally mean "upon determining," or "in response to determining," "upon detecting [a stated condition or event]," or "in response to detecting [a stated condition or event]."

[0296] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. A processing device (or processing circuit) may execute an operating system (OS) and one or more software applications running on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device is sometimes described, but one of ordinary skill in the art will recognize that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0297] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0298] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0299] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

Claims

1. In electronic devices, Touchscreen display; A first camera comprising a first image sensor; A second camera comprising a second image sensor; At least one processor comprising processing circuitry; and Contains memory that stores instructions, The instructions are individually or collectively executed by the at least one processor, such that the electronic device: Through the first image sensor, a first image is acquired in a first mode that causes the first image sensor to output an image of a first resolution, Through the above touch screen display, a preview image is displayed based on the first image, Through the above touchscreen display, user input for adjusting the magnification is received, At least partially based on the determination that the magnification corresponding to the user input is greater than or equal to the first magnification and less than the second magnification, a second image is acquired in a second mode through the second image sensor so that the second image sensor outputs an image of a second resolution, An electronic device that acquires a third image in a third mode, wherein the first image sensor outputs an image having a third resolution higher than the first resolution, at least in part based on the determination that the magnification corresponding to the user input is greater than or equal to the second magnification and less than the third magnification.

2. In claim 1, The first image sensor outputs an image by binning a plurality of sensor pixels within the first image sensor in the first mode, The second image sensor outputs an image by binning a plurality of sensor pixels within the second image sensor in the second mode, The above instructions are individually or collectively executed by the at least one processor, so that the electronic device: As at least a part of acquiring the third image in the third mode, performing a remosaic operation that converts the color order of pixel values ​​included in the raw image acquired from the first image sensor; An electronic device that obtains the third image based on the result of performing the above remosaic operation.

3. In claim 1, The electronic device, wherein the commands are individually or collectively executed by the at least one processor to cause the electronic device to acquire a fourth image in a fourth mode, wherein the second image sensor outputs an image having a fourth resolution higher than the second resolution, at least in part based on determining that a magnification corresponding to the user input is greater than or equal to the third magnification and less than or equal to the fourth magnification.

4. In claim 3, The above instructions are individually or collectively executed by the at least one processor, so that the electronic device: Acquire a fifth image in a fifth mode, wherein the first image sensor outputs an image having a fifth resolution higher than the third resolution, at least in part based on the determination that the magnification corresponding to the user input is greater than or equal to the fourth magnification and less than the fifth magnification, through the first image sensor; An electronic device that acquires a sixth image based on a sixth mode that causes the second image sensor to output an image having a sixth resolution higher than the fourth resolution, at least partially based on determining that a magnification corresponding to the user input is greater than or equal to the fifth magnification.

5. In claim 4, The above third magnification is twice the above first magnification, An electronic device wherein the second magnification is between the first magnification and the third magnification.

6. In claim 5, The above fourth magnification is twice the above second magnification, An electronic device wherein the fifth magnification is twice that of the third magnification.

7. In claim 1, An electronic device wherein the first camera and the second camera support different fields of view (FOV).

8. In claim 1, The above instructions are individually or collectively executed by the at least one processor, so that the electronic device: Based on the fact that the magnification corresponding to the user input is less than the first magnification: Through the first image sensor, an image having the third resolution is acquired in the third mode, An electronic device that obtains the first image by down-scaling an image having the third resolution.

9. A method of operating an electronic device including a first camera including a first image sensor and a second camera including a second image sensor, An operation of acquiring a first image from the first image sensor based on a first mode for outputting an image of a first resolution through the first image sensor; An action of displaying a preview image based on the first image through a touch screen display; An action of receiving user input for adjusting the magnification through the above touchscreen display; An operation of acquiring a second image in a second mode, through the second image sensor, such that the second image sensor outputs an image of a second resolution, at least partially based on the determination that the magnification corresponding to the user input is greater than or equal to the first magnification and less than the second magnification; and An electronic device that acquires a third image in a third mode, wherein the first image sensor outputs an image having a third resolution greater than the first resolution, based at least in part on the determination that the magnification corresponding to the user input is greater than or equal to the second magnification and less than the third magnification.

10. In claim 9, The operation of acquiring the first image from the first image sensor in the first mode includes an operation of the first image sensor binning a plurality of sensor pixels within the first image sensor and outputting the binning, The operation of acquiring the second image from the second image sensor in the second mode includes an operation of the second image sensor binning a plurality of sensor pixels within the second image sensor and outputting the binning, The operation of acquiring the third image from the first image sensor in the third mode is: A remosaic operation for converting the color order of pixel values ​​included in a raw image acquired from the first image sensor, and A method comprising an operation of obtaining the third image based on a result of performing the above remosaic operation.

11. In claim 9, A method further comprising: acquiring a fourth image in a fourth mode, wherein the second image sensor outputs an image having a fourth resolution higher than the second resolution, based at least in part on the determination that the magnification corresponding to the user input is greater than or equal to the third magnification and less than the fourth magnification.

12. In claim 11, An operation of acquiring a fifth image in a fifth mode, wherein the first image sensor outputs an image having a fifth resolution higher than the third resolution, based at least in part on the determination that the magnification corresponding to the user input is greater than or equal to the fourth magnification and less than the fifth magnification; and A method further comprising: acquiring a sixth image in a sixth mode, wherein the second image sensor outputs an image having a sixth resolution higher than the fourth resolution, at least partially based on determining that the magnification corresponding to the user input is greater than or equal to the fifth magnification.

13. In claim 9, The operation of acquiring the first image through the first image sensor is: Based on the fact that the magnification corresponding to the user input is less than the first magnification: An operation of acquiring an image having the third resolution in the third mode through the first image sensor, and A method comprising the action of obtaining the first image by down-scaling an image having the third resolution.

14. In electronic devices, Touchscreen display; A first camera comprising a first image sensor; A second camera comprising a second image sensor; At least one processor comprising a processing circuit; and Contains memory for storing commands, The above instructions are individually or collectively executed by the at least one processor, so that the electronic device: Through the above touchscreen display, user input for adjusting the magnification is received, At least in part based on the determination that the magnification corresponding to the user input is the first magnification: Through the first image sensor, a first image is acquired in a first mode that causes the first image sensor to output an image of a first resolution, In a second mode in which the second image sensor outputs an image of a second resolution, a second image is acquired by cropping at least a portion of an image acquired through the second image sensor, Obtaining a first composite image by synthesizing the first image and the second image, At least in part based on determining that the magnification corresponding to said user input is a second magnification higher than said first magnification: Acquire a third image by cropping at least a portion of the image acquired through the first image sensor in the first mode, Through the second image sensor, a fourth image is acquired in a third mode in which the second image sensor outputs an image with a third resolution higher than the second resolution, An electronic device that obtains a second composite image by synthesizing the third image and the fourth image.

15. In claim 14, The first image sensor bins and outputs the output of a plurality of sensor pixels within the first image sensor in the first mode, The second image sensor bins and outputs the output of a plurality of sensor pixels within the second image sensor in the second mode, The above instructions are individually or collectively executed by the at least one processor, so that the electronic device: As at least a part of acquiring the third image in the third mode, performing a remosaic operation that converts the color order of pixel values ​​included in the raw image acquired from the first image sensor; An electronic device that acquires a third image based on the result of performing the above remosaic operation.

Images