Method for providing image and electronic device supporting the same

Abstract

An electronic device according to various embodiments of the present invention comprises a distance sensor including a plurality of cameras, a light-emitting unit and a light-receiving unit, and at least one processor functionally connected to the plurality of cameras and the distance sensor, wherein the at least one processor identifies a range corresponding to a zoom magnification for acquiring an image among a plurality of ranges related to a zoom magnification, acquires one or more signals corresponding to the one or more regions based on light emitted from the light-emitting unit and received by one or more regions of the light-receiving unit, acquires one or more first distances based on one or more first peaks of the one or more signals, identifies whether there exists a distance greater than a designated first distance corresponding to the identified range among the one or more first distances, and if the distance exists, identifies whether the maximum value of the values ​​of the one or more first peaks is less than a designated first value, and determines a camera for acquiring the image among the plurality of cameras based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the designated first value.

Description

Technology Field

[0001] Various embodiments of the present invention relate to a method for providing an image and an electronic device supporting the same. Background Technology

[0003] An electronic device (e.g., a smartphone) may include a plurality of cameras. For example, the electronic device may include a plurality of cameras positioned on the rear of the electronic device in addition to at least one camera positioned on the front of the electronic device.

[0004] An electronic device can select a camera for acquiring an image from among a plurality of cameras (e.g., a plurality of cameras positioned on the rear of the electronic device) based on the distance between the electronic device and the subject. For example, among the plurality of cameras, the electronic device can select a camera with a longer focal length as the distance between the electronic device and the subject increases as the distance increases as the distance between the electronic device and the subject increases as the camera for acquiring the image. The problem to be solved

[0006] The electronic device may include a range sensor for measuring the distance between the electronic device and the subject.

[0007] If a distance different from the actual distance between the electronic device and the subject is measured through a distance sensor, the electronic device may select, among a plurality of cameras (e.g., a plurality of cameras placed on the rear of the electronic device), a camera that is not suitable for the actual distance between the electronic device and the subject as the camera for acquiring an image. For example, if the distance sensor is obscured by foreign matter or a user (e.g., a user's finger), a distance different from the actual distance between the electronic device and the subject (e.g., a distorted distance) may be measured due to the influence of the foreign matter or the user. The electronic device may select, among the plurality of cameras, a camera to acquire an image based on the distance different from the actual distance between the electronic device and the subject. In such cases, the image quality of the image acquired by the electronic device may be degraded.

[0008] Various embodiments of the present invention relate to a method for providing an image and an electronic device supporting the same, which can select an optimal camera among a plurality of cameras included in an electronic device by using a signal obtained through a distance sensor even when the distance sensor is affected by foreign matter or a user.

[0009] The technical problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0011] An electronic device according to various embodiments of the present invention comprises a distance sensor including a plurality of cameras, a light-emitting unit and a light-receiving unit, and at least one processor functionally connected to the plurality of cameras and the distance sensor, wherein the at least one processor identifies a range corresponding to a zoom magnification for acquiring an image among a plurality of ranges related to a zoom magnification, acquires one or more signals corresponding to the one or more regions based on light emitted from the light-emitting unit and received by one or more regions of the light-receiving unit, acquires one or more first distances based on one or more first peaks of the one or more signals, identifies whether there exists a distance greater than a designated first distance corresponding to the identified range among the one or more first distances, and if the distance exists, identifies whether the maximum value of the values ​​of the one or more first peaks is less than a designated first value, and determines a camera for acquiring the image among the plurality of cameras based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the designated first value.

[0012] A method for providing an image in an electronic device according to various embodiments of the present invention may include: a step of determining a range corresponding to a zoom ratio for acquiring the image among a plurality of ranges related to a zoom ratio; a step of acquiring one or more signals corresponding to one or more regions based on light emitted from a light-emitting part of a distance sensor of the electronic device and received by one or more regions of a light-receiving part of the distance sensor; a step of acquiring one or more first distances based on one or more first peaks of the one or more signals; a step of determining whether there exists a distance greater than or equal to a designated first distance corresponding to the determined range among the one or more first distances; a step of determining whether, if the distance exists, the maximum value of the values ​​of the one or more first peaks is less than a designated first value; and a step of determining a camera for acquiring the image among a plurality of cameras included in the electronic device based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the designated first value. Effects of the invention

[0014] A method for providing an image according to various embodiments of the present invention and an electronic device supporting the same can select an optimal camera among a plurality of cameras included in the electronic device by using a signal obtained through a distance sensor, even when the distance sensor is affected by foreign matter or a user. Through this, the electronic device can obtain an image with improved image quality. Brief explanation of the drawing

[0016] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2 is a block diagram of an electronic device according to various embodiments. FIG. 3 is a drawing showing the rear side of an electronic device according to various embodiments. FIGS. 4a to 4c are exemplary drawings illustrating cases in which a distance sensor is obscured by an obstacle, according to various embodiments. FIG. 5 is a drawing for explaining distance sensors according to various embodiments. FIG. 6 is a diagram showing a signal obtained through a distance sensor according to various embodiments. FIGS. 7a and 7b are drawings showing values ​​of one or more second distances and one or more second peaks obtained when a part of the distance sensor is obscured by an obstacle, according to various embodiments. FIG. 7c is a diagram showing the values ​​of one or more second distances and one or more second peaks obtained when the entire distance sensor is obscured by an obstacle, according to various embodiments. FIG. 7d is a diagram showing the values ​​of one or more second distances and one or more second peaks obtained when a subject is located at a specific distance from a distance sensor according to various embodiments. FIG. 8 is a flowchart illustrating a method for providing an image according to various embodiments. FIG. 9 is a flowchart illustrating a method for providing an image according to various embodiments. FIG. 10 is a flowchart illustrating a method for providing an image, taking into account cases where the entire distance sensor is obscured by an obstacle, according to various embodiments. FIG. 11 is a flowchart illustrating a method for providing an image while taking into account the hysteresis of a camera according to various embodiments. FIG. 12 is a flowchart illustrating a method for providing an image according to various embodiments. Specific details for implementing the invention

[0017] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.

[0018] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0019] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0020] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0021] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0022] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0023] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0024] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0025] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0026] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0027] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0028] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0029] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0030] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0031] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0032] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0033] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0034] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0035] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0036] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0037] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0038] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0039] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0040] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0041] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0042] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0043] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0044] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0045] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0047] FIG. 2 is a block diagram of an electronic device (101) according to various embodiments.

[0048] Referring to FIG. 2, in one embodiment, the electronic device (101) may include a display (210), a plurality of cameras (220), a distance sensor (230), a memory (240), and / or a processor (250).

[0049] In one embodiment, the display (210) may be included in the display module (160) of FIG. 1. In one embodiment, the display (210) may display an image (e.g., a dynamic image and / or a still image) obtained through a camera. For example, the display (210) may display a preview image obtained through the camera when a camera application is running. In another example, the display (210) may display an image obtained when an image is obtained through the camera.

[0050] In one embodiment, a plurality of cameras (220) may be included in the camera module (180) of FIG. 1. The plurality of cameras (220) will be described in detail below with reference to FIG. 3.

[0051] FIG. 3 is a drawing showing the rear view of an electronic device (101) according to various embodiments.

[0052] Referring to FIG. 3, in one embodiment, the electronic device (101) may include a camera 1 (221), a camera 1 (222), a camera 1 (223), a camera 4 (224), a distance sensor (230), a flicker sensor (310), and / or a flash LED (flash light emitting diode) (320).

[0053] In one embodiment, Camera 1 (221), Camera 2 (222), Camera 3 (223), and Camera 4 (224) may be referred to as an ultra-wide angle camera, an optical camera, a first telephoto camera, and a second telephoto camera, respectively. In one embodiment, Camera 1 (221), Camera 2 (222), Camera 3 (223), and Camera 4 (224) may have different angles of view. For example, Camera 1 (221), Camera 3 (222), Camera 3 (223), and Camera 4 (224) may have angles of view of about 120°, about 83°, about 35°, and about 10°, respectively. In one embodiment, Camera 1 (221), Camera 2 (222), Camera 3 (223), and Camera 4 (224) may have different focal lengths. For example, camera 1 (221), camera 2 (222), camera 3 (223), and camera 4 (224) may have short focal lengths in the order of camera 1 (221), camera 2 (222), camera 3 (223), and camera 4 (224).

[0054] In one embodiment, as illustrated in FIG. 3, the electronic device (101) is illustrated as including four cameras (e.g., Camera 1 (221), Camera 2 (222), Camera 3 (223), and Camera 4 (224)) through the rear (e.g., the side opposite to the side where the display (210) is exposed), but is not limited thereto. For example, the electronic device (101) may include two cameras, three cameras, or five or more cameras through the rear. In one embodiment, although not illustrated in FIG. 3, the electronic device (101) may include at least one camera (e.g., a front camera) through the front (e.g., the side where the display (210) is exposed).

[0055] Hereinafter, for convenience of explanation, two or more cameras placed on the rear of the electronic device (101), such as camera 1 (221), camera 2 (222), camera 3 (223), and camera 4 (224), will be referred to as ‘multiple cameras’.

[0056] In one embodiment, the flicker sensor (310) may be a sensor for detecting flickering of an artificial light source placed in the surrounding environment of the electronic device (101). For example, the flicker sensor (310) may be configured to calculate the frequency at which the artificial light source emits light based on ambient light received from the surrounding environment. In one embodiment, the flicker sensor (310) may be placed adjacent to the distance sensor (230), as shown in FIG. 3.

[0057] Although not illustrated in FIG. 3, the electronic device (101) may include an illuminance sensor for measuring the brightness of the surroundings of the electronic device (101) based on light received from the surrounding environment of the electronic device (101) through the front.

[0058] In one embodiment, as illustrated in FIG. 3, a plurality of cameras (221, 222, 223, 224), a distance sensor (230), a flicker sensor (310), and / or a flash LED (320) are disposed on the rear of the electronic device (101), but are not limited thereto. For example, depending on the embodiment, the electronic device (101) may not include the flicker sensor (310) (and / or light sensor) and / or the flash LED (320).

[0059] In one embodiment, the distance sensor (230) may be configured to measure the distance between the electronic device (101) (e.g., the distance sensor (230)) and the subject. Hereinafter, the object that the user wishes to photograph will be referred to as the 'subject,' and any foreign matter or the user's finger that obscures the distance sensor (230) will be referred to as the 'obstacle.'

[0060] In one embodiment, the distance sensor (230) is configured to measure the distance between the electronic device (101) and the subject based on the travel time and travel speed that occur after a designated type of signal emitted from the distance sensor (230) is reflected from the subject and then incident on the distance sensor (230). For example, depending on the type of designated signal used by the distance sensor (230), it may be implemented as an acoustic method (e.g., ultrasonic sensor), an infrared method (e.g., infrared sensor), a laser method (e.g., LIDAR, light detection and ranging sensor), a radio wave method (e.g., RADAR, radio detecting and ranging sensor), and / or an optical method (e.g., camera sensor (passive sensor)).

[0062] Hereinafter, through FIGS. 4a to 4c, the case in which the distance sensor (230) is obscured by foreign matter or a user will be explained.

[0063] FIGS. 4a to 4c are exemplary drawings (400a, 400b, 400c) showing cases in which a distance sensor (230) is obscured by an obstacle according to various embodiments.

[0064] Referring to FIGS. 4a through 4c, reference numeral 410 may indicate a case where part of the distance sensor (230) is obscured by a foreign substance (e.g., clay) in an experimental environment. In one embodiment, the distance sensor (230) may receive light affected by the foreign substance when part of the distance sensor (230) is obscured by the foreign substance (411). For example, when the foreign substance (411) is located within the field of view of the light-emitting part (hereinafter referred to as the 'light-emitting part') of the distance sensor (230) (and the field of view of the light-receiving part (hereinafter referred to as the 'light-receiving part') of the distance sensor (230), the distance sensor (230) may receive light that is emitted from the light-emitting part of the distance sensor (230) and reflected by the foreign substance (411) and light that is reflected by the subject.

[0065] Reference numeral 420 may indicate a case where part of the distance sensor (230) is obscured by a finger (421) holding the electronic device (101). In one embodiment, the distance sensor (230) may receive light affected by the finger (421) when part of the distance sensor (230) is obscured by the finger (421). For example, the distance sensor (230) may receive light reflected by the finger (421) and light reflected by the subject after being emitted from the light-emitting part of the distance sensor (230) when the finger (421) is located within the field of view of the light-emitting part (and the field of view of the light-receiving part).

[0066] Reference numeral 430 may indicate a case where the entire distance sensor (230) is covered by a finger (431) holding the electronic device (101) (e.g., the distance sensor (230) is completely covered by the finger (431). In one embodiment, when the entire distance sensor (230) is covered by the finger (431), only the finger (431) is positioned within the angle of view of the light-emitting part and the angle of view of the light-receiving part of the distance sensor (230) by the finger (431), so that only the light reflected by the finger (431) after being emitted from the light-emitting part of the distance sensor (230) can be received without receiving the reflected light from the subject after being emitted from the light-emitting part of the distance sensor (230).

[0067] Although not illustrated in FIG. 4, in one embodiment, the entire distance sensor (230) and the flicker sensor (310) may be obscured by an obstacle. For example, the entire distance sensor (230) and the flicker sensor (310) placed adjacent to the distance sensor (230) may be obscured by an obstacle.

[0068] In one embodiment, the distance sensor (230) (and / or processor (250)) can acquire a signal based on light that is emitted from a light-emitting unit and then reflected by a subject and / or an obstacle. With reference to FIGS. 5 and 6, the operation of the distance sensor (230) acquiring a signal based on light that is emitted from a light-emitting unit and then reflected by a subject and / or an obstacle will be described in detail below.

[0069] FIG. 5 is a drawing (500) for explaining a distance sensor (230) according to various embodiments.

[0070] FIG. 6 is a drawing (600) showing a signal obtained through a distance sensor (230) according to various embodiments.

[0071] Referring to FIGS. 5 and 6, in one embodiment, the distance sensor (230) may include a light-emitting part (231), a first optical element (232), a light-receiving part (233), a second optical element (234), and / or a control circuit (235). In one embodiment, the distance sensor (230) illustrated in FIG. 5 may be a distance sensor using a direct TOF (time-of-flight) method. However, it is not limited thereto, and the distance sensor (230) may include a distance sensor using an indirect TOF method. Even if the distance sensor (230) includes a distance sensor using an indirect TOF method, at least some of the following examples may be applied identically or similarly.

[0072] In one embodiment, the light-emitting unit (231) may be configured to emit light having a pulse (hereinafter interchangeably with 'photon'). For example, the light-emitting unit (231) may include a laser (e.g., VCSELs (vertical cavity surface emitting lasers) and / or edge-emitting lasers) or LEDs (light emitting diodes) capable of emitting light having a pulse (236).

[0073] In one embodiment, the first optical element (232) may include a first lens and / or diffuser. In one embodiment, the first lens may include a micro lens. Light (236) emitted from the light-emitting part (231) may be uniformly diffused through the first lens and / or diffuser, such as pulsed light (237).

[0074] In one embodiment, the light receiving unit (233) can receive (e.g., collect) light (238) that is incident after diffused light (237) is reflected by the subject (239) through a second optical element (234) (e.g., a macro lens).

[0075] In one embodiment, the light receiving unit (233) may include a plurality of regions for receiving light (238) (hereinafter referred to as 'a plurality of regions of the light receiving unit (233)' or 'a plurality of regions').

[0076] In one embodiment, a plurality of regions of the light receiving unit (233) may each include one or more photo detectors (or also referred to as 'pixels') (e.g., SPADs (single-photon avalanche diodes), APDs (avalanche diodes), or SiPMs (silicon photomultipliers). For example, the plurality of regions of the light receiving unit (233) may include 64 regions, and each of the 64 regions may include one or more photo detectors.

[0077] In one embodiment, at least some of the plurality of regions of the light receiving unit (233) may correspond to a plurality of cameras. For example, when camera 1 (221) among the plurality of cameras is used for image acquisition, one or more first regions among the plurality of regions of the light receiving unit (233) (e.g., one or more first regions having a field of view that overlaps with at least a portion of the field of view of camera 1 (221) among the plurality of regions of the light receiving unit (233)) may be used for measuring the distance between the electronic device (101) and the subject (239). In another example, when camera 4 (224) among the plurality of cameras is used for image acquisition, one or more first regions among the plurality of regions of the light receiving unit (233) and one or more second regions (e.g., one or more second regions having a field of view that overlaps with at least a portion of the field of view of camera 4 (224) among the plurality of regions of the light receiving unit (233)) may be used for measuring the distance between the electronic device (101) and the subject (239).

[0078] In one embodiment, the control circuit (235) can control the operation of the distance sensor (230). For example, the control circuit (235) can control the operation of the light emitting unit (231) and the light receiving unit (233) (e.g., timing control). In another example, the control circuit (235) can detect the time difference (△T) between the emission time (irradiation time) of light emitted through the light emitting unit (231) and the reception time of light received through the light receiving unit (233) by using a time-to-digital converter (TDC) circuit.

[0079] In one embodiment, the control circuit (235) (or processor (250)) can calculate the distance between the electronic device (101) and the subject (239) based on the time difference (△T) between the emission time of light emitted through the light-emitting unit (231) and the reception time of light received through the light-receiving unit (233), and the speed of light.

[0080] In one embodiment, reference numeral 610 and reference numeral 620, respectively, may represent a signal obtained by a control circuit (or processor (250)) in one area of ​​a light receiving unit.

[0081] In one embodiment, the first signal (611) and the second signal (621) each may represent the number of photons (e.g., photons) acquired over time (t) in one area of ​​the light receiving unit (233). For example, a control circuit (or processor (250)) may acquire the first signal (611) or the second signal (621) by counting the number of photons (e.g., photons) acquired over time in one area of ​​the light receiving unit (233). In one embodiment, the first signal (611) and the second signal (621) illustrated in FIG. 6 may be signals acquired within one cycle in which the light receiving unit (233) receives light having a pulse (e.g., one cycle in which the light receiving unit (233) receives light corresponding to one cycle in which the light emitting unit (231) emits light having a pulse).

[0082] In one embodiment, as illustrated in reference numerals 610 and 620, the first signal (611) and the second signal (621) may each have one or more peaks. Hereinafter, a point having the largest number of photons within a portion of a signal having a number of photons greater than a threshold number will be referred to as a 'peak (or peak point)', and data representing the number of photons corresponding to the peak will be referred to as the 'value of the peak'. For example, the first signal (611) may include a peak (612), and the value of the peak (612) may be data representing the number of photons (m1) received at the time (t1) when the peak (612) was acquired. As another example, the second signal (621) may include a peak (622) and a peak (623). The value of peak (622) is data representing the number of photons (m2) received at the time (t2) when peak (622) was acquired, and the value of peak (623) may be data representing the number of photons (m3) received at the time (t3) when peak (623) was acquired.

[0083] In one embodiment, when a subject exists within the field of view of the distance sensor (230), a peak (e.g., peak (612)) can be obtained, such as the first signal (611). For example, when a subject exists within the field of view of the distance sensor (230), light emitted by the light-emitting unit (231) is reflected by the subject and received by one area of ​​the light-receiving unit (233), thereby obtaining a peak (e.g., peak (612)). However, this is not limited thereto, and if the distance sensor (230) is completely obscured by an obstacle (e.g., a user's finger) (e.g., the case of reference numeral 430 in FIG. 4), light emitted by the light-emitting unit (231) is reflected by the obstacle (e.g., light emitted by the light-emitting unit (231) is not incident on the subject (239) and is reflected by the obstacle), and is received by one area of ​​the light-receiving unit (233), thereby obtaining one peak (e.g., peak (612)).

[0084] In one embodiment, when an obstacle and a subject are present within the field of view of the distance sensor (230), two peaks (e.g., peak (622) and peak (623)) may be obtained, such as the second signal (621). For example, when part of the distance sensor (230) is obscured by an obstacle (e.g., a foreign object or a user's finger) (e.g., the case of reference numeral 410 and reference numeral 420 in FIG. 4), peak (622) may be obtained by light emitted by the light-emitting unit (231) being reflected by the obstacle and received by one area of ​​the light-receiving unit (233), and peak (623) may be obtained by light emitted by the light-emitting unit (231) being reflected by a subject and received by one area of ​​the light-receiving unit (233) (e.g., one area that receives light emitted by the light-emitting unit (231) and reflected by the obstacle).

[0085] In one embodiment, FIG. 6 illustrates that a signal obtained in one area of ​​the light receiving unit (233), such as the first signal (611) and the second signal (621), has one or two peaks, but is not limited thereto. For example, a signal obtained in one area of ​​the light receiving unit (233) may have three or more peaks depending on the number of subjects present within the field of view of the distance sensor (230).

[0086] Hereinafter, peaks of one or more signals obtained in one or more regions among the plurality of regions included in the light receiving unit (233) (e.g., one or more regions used to determine a camera among the plurality of cameras to acquire an image among the plurality of regions) (e.g., peaks obtained from all signals obtained in one or more regions) will be referred to as 'one or more first peaks'. For example, in FIG. 6, peak (612), peak (622), and peak (623) may be included in one or more first peaks.

[0087] Additionally, below, among one or more first peaks, the peaks that are first (timest to earliest) acquired in each of one or more signals acquired in one or more regions among the plurality of regions included in the light receiving unit (233) will be referred to as 'one or more second peaks'. For example, the peak (612) of the first signal in reference numeral 610 may be included in one or more second peaks. As another example, among the peak (622) and peak (623) of the second signal in reference numeral 620, the first acquired peak (622) may be included in one or more second peaks.

[0088] In one embodiment, the control circuit (or processor (250)) may acquire one or more first distances (hereinafter referred to as 'one or more first distances') corresponding to one or more first peaks based on the times when one or more first peaks are acquired. For example, the control circuit (or processor (250)) may acquire distance 1 representing the distance between the electronic device (101) and the subject or the distance between the electronic device (101) and the obstacle based on the time (t1) when the peak (612) is acquired (and the time and speed of light when the light forming the basis of the first signal is emitted from the light-emitting unit (231)). In another example, the control circuit (or processor (250)) may acquire distances 2 and 3 representing the distance between the electronic device (101) and the subject and / or the distance between the electronic device (101) and the obstacle, based on the times (t2 and t3) when the peak (622) and the peak (623) are acquired (and the time and speed of light when the light forming the basis of the second signal is emitted from the light-emitting unit (231). In the examples described above, distance 1 corresponding to the peak (612), distance 2 corresponding to the peak (622), and distance 3 corresponding to the peak (623) may be included in one or more first distances.

[0089] Hereinafter, among one or more first distances, distances corresponding to one or more second peaks will be referred to as 'one or more second distances'. For example, in FIG. 6, distance 1 corresponding to peak (612) and distance 2 corresponding to peak (622) may be included in one or more second distances.

[0090] In one embodiment, some of the operations performed by the control circuit included in the distance sensor (230) may be performed by the processor (250).

[0091] In one embodiment, the memory (240) may be included in the memory (130) of FIG. 1.

[0092] In one embodiment, the memory (240) may store information for performing an operation to provide an image. The information stored by the memory (240) to perform an operation to provide an image will be described in detail later.

[0093] In one embodiment, the processor (250) may be included in the processor (120) of FIG. 1.

[0094] In one embodiment, the processor (250) can control the overall operation for performing the operation to provide an image. In one embodiment, the processor (250) may include one or more processors to perform the operation to provide an image.

[0095] In one embodiment, the processor (250) may determine a camera among a plurality of cameras to acquire an image based on the values ​​of one or more first distances, one or more second distances, and / or one or more first peaks.

[0096] In one embodiment, the processor (250) may obtain different values ​​of one or more first distances, one or more second distances, and / or one or more first peaks depending on the distance between the electronic device (101) and the subject, whether part of the distance sensor (230) is obscured by an obstacle, and / or whether the entire distance sensor (230) is obscured by an obstacle. Hereinafter, through FIGS. 7a to 7d, information obtained differently through the distance sensor (230) depending on the distance between the electronic device (101) and the subject, whether part of the distance sensor (230) is obscured by an obstacle, and / or whether the entire distance sensor (230) is obscured by an obstacle will be described.

[0097] FIGS. 7a and 7b are drawings (710, 720) showing values ​​of one or more second distances and one or more second peaks obtained when part of the distance sensor (230) is obscured by an obstacle, according to various embodiments.

[0098] Referring to FIG. 7a and FIG. 7b, in one embodiment, FIG. 7a may show values ​​of one or more second distances and one or more second peaks obtained when a part of the light receiving portion (233) of the distance sensor (230) is affected by an obstacle as a part of the distance sensor (230) is obscured by an obstacle. In one embodiment, FIG. 7b may show values ​​of one or more second distances and one or more second peaks obtained when the entire light receiving portion (233) of the distance sensor (230) is affected by an obstacle as a part of the distance sensor (230) is obscured by an obstacle.

[0099] FIGS. 7a and 7b may show values ​​of one or more second distances and one or more second peaks obtained when the number of multiple regions included in the light receiving part (233) of the distance sensor (230) is 64. However, the number of multiple regions included in the light receiving part (233) of the distance sensor (230) is not limited to 64. Additionally, FIGS. 7a and 7b illustrate that values ​​of one or more second distances and one or more second peaks are obtained across a plurality of regions included in the light receiving unit (233) of the distance sensor (230), but values ​​of one or more second distances and one or more second peaks may be obtained in one or more of the plurality of regions included in the light receiving unit (233) of the distance sensor (230) (e.g., values ​​of one or more second distances and one or more second peaks obtained in one or more of the plurality of regions included in the light receiving unit (233) of the distance sensor (230) may be used to determine a camera for obtaining an image among a plurality of cameras).

[0100] In one embodiment, at reference numeral 711, among the second distances, the maximum distance may be about 427 (mm) (711-2) and the minimum distance may be about 0 (mm) (711-1). At reference numeral 711, the average distance of the second distances may be about 76 (mm). At reference numeral 711, the maximum distance may be the distance obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by a subject and then incident on the light-receiving part (233) of the distance sensor (230). At reference numeral 711, the minimum distance may be the distance obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by an obstacle and then incident on the light-receiving part (233) of the distance sensor (230).

[0101] In one embodiment, at reference numeral 712, among the values ​​of the second peaks, the maximum value is about 403 (712-2) (wherein about 403 may be data corresponding to the number of photons forming the second peak (e.g., peak (612) and / or peak (622)) (e.g., m1 of reference numeral 610 and / or m2 of reference numeral 620)), and the minimum value may be about 44 (712-1). At reference numeral 712, the average value of the second peaks may be about 76. At reference numeral 712, the minimum value may be the value of the peak obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by the subject and then incident on the light-receiving part (233) of the distance sensor (230). In reference numeral 712, the maximum value may be the peak value obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by an obstacle and then incident on the light-receiving part (233) of the distance sensor (230).

[0102] In one embodiment, in reference numeral 721, among the second distances, the maximum distance may be about 15 (mm) (721-2) and the minimum distance may be about 1 (mm) (721-1). In reference numeral 721, the average distance of the second distances may be about 8 (mm). In reference numeral 721, 'N' (721-3) may indicate a case where the reliability of the acquired distance is lower than a specified reliability. In reference numeral 721, the entirety of the second distances may be distances acquired when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by an obstacle and then incident on the light-receiving part (233) of the distance sensor (230).

[0103] In one embodiment, among the values ​​of the second peaks in reference numeral 722, the maximum value may be about 2576 (722-2) and the minimum value may be about 330 (722-1). In reference numeral 722, the average value of the second peaks may be about 729. In reference numeral 722, the values ​​of the second peaks may be the values ​​of peaks obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by an obstacle and then incident on the light-receiving part (233) of the distance sensor (230).

[0104] In one embodiment, as shown in FIGS. 7a and 7b, when part of the distance sensor (230) is obscured by an obstacle, the maximum value of the second peak values ​​obtained (e.g., about 2576 (722-2)) may be less than about 10000.

[0105] FIG. 7c is a drawing (730) showing values ​​of one or more second distances and one or more second peaks obtained when the entire distance sensor (230) is obscured by an obstacle, according to various embodiments.

[0106] Referring to FIG. 7c, FIG. 7c can show values ​​of one or more second distances and one or more second peaks obtained when the number of multiple regions included in the light receiving part (233) of the distance sensor (230) is 64.

[0107] In one embodiment, in reference numeral 731, among the second distances, the maximum distance may be about 17 (mm) (731-2) and the minimum distance may be about 2 (mm) (731-1). In reference numeral 731, the average distance of the second distances may be about 11 (mm). In reference numeral 731, 'N' (731-3) may indicate a case where the reliability of the acquired distance is lower than a specified reliability. In reference numeral 731, the entirety of the second distances may be distances acquired when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by an obstacle and then incident on the light-receiving part (233) of the distance sensor (230).

[0108] In one embodiment, among the values ​​of the second peaks in reference numeral 732, the maximum value may be about 292337 (732-2) and the minimum value may be about 71854 (732-1). In reference numeral 732, the average value of the second peaks may be about 130340. In reference numeral 732, the values ​​of the second peaks may be the values ​​of peaks obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by an obstacle and then incident on the light-receiving part (233) of the distance sensor (230).

[0109] In one embodiment, as illustrated in FIG. 7c, when the entire distance sensor (230) is obscured by an obstacle (e.g., when the distance sensor (230) is completely obscured by a user's finger), there may be a second peak value greater than about 290,000 among the values ​​of the second peaks. For example, when the entire distance sensor (230) is obscured by an obstacle, the maximum value among the values ​​of the second peaks (about 292,337 (732-2)) may be greater than about 290,000.

[0110] FIG. 7d is a drawing (740) showing values ​​of one or more second distances and one or more second peaks obtained when an object with a bright color (e.g., a desk with an ivory surface color) is located within a specific distance (e.g., about 50 mm) from a distance sensor (230), according to various embodiments.

[0111] In one embodiment, at reference numeral 741, among the second distances, the maximum distance may be about 19 (mm) (741-2) and the minimum distance may be about 3 (mm) (741-1). At reference numeral 741, the average distance of the second distances may be about 12 (mm).

[0112] In reference numeral 741, the entire second distance may be distances obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by an object spaced about 10 (mm) away from the distance sensor (230) and then incident on the light-receiving part (233) of the distance sensor (230).

[0113] In one embodiment, among the values ​​of the second peaks in reference numeral 742, the maximum value may be about 262703 (742-2) and the minimum value may be about 26526 (742-1). In reference numeral 742, the average value of the second peaks may be about 130804. In reference numeral 742, the maximum value of the second peaks may be the value of the peaks obtained when light emitted from the light-emitting part (231) of the distance sensor (230) is reflected by a subject spaced about 10 (mm) away from the distance sensor (230) and then incident on the light-receiving part (233) of the distance sensor (230).

[0114] In one embodiment, as illustrated in FIG. 7d, when the subject is located within a specific distance (e.g., about 50 mm) from the distance sensor (230), the minimum value of the second peak values ​​(e.g., about 26526) may be greater than the second peak value obtained when the distance sensor (230) is partially obscured by an obstacle (e.g., about 10000 or less). In one embodiment, when the subject is located within a specific distance (e.g., about 50 mm) from the distance sensor (230), the maximum value of the second peaks (e.g., about 262703) may be smaller than the second peak value obtained when the distance sensor (230) is completely obscured by an obstacle (e.g., about 290,000).

[0115] In one embodiment, FIG. 7d illustrates a case where the subject is a desk located within a specific distance (e.g., about 50 mm) from the distance sensor (230) and the surface color is a light color (e.g., ivory), but depending on the color and / or material of the subject (e.g., the material of the surface of the subject), the values ​​of the second peaks may be obtained differently. For example, depending on the color and / or material of the subject, the ratio of light emitted from the light-emitting part (231) of the distance sensor (230) being reflected by the subject may differ. For example, a subject with a dark color may have a lower ratio of light emitted from the light-emitting part (231) of the distance sensor (230) being reflected than a subject with a light color.

[0116] For example, the reflection rate by a black object can be about 10%, which is lower than the reflection rate by a white object, which is about 88%.

[0117] For another example, in the case of a subject with a rough surface material, the total amount of light incident on the light receiving part (233) may be reduced due to irregular diffuse reflection of light emitted from the light-emitting part (231) of the distance sensor (230) on the rough surface of the subject, so the reflection rate may be lower than that of a subject with a flat surface material.

[0118] In one embodiment, depending on the color and / or material of the subject (e.g., the material of the surface of the subject), the values ​​of the second peaks may be obtained differently.

[0119] In one embodiment, even in the case of a subject having a color and / or material with a low reflection rate of light emitted from the light-emitting part (231) of the distance sensor (230), when the subject is located within a specific distance (e.g., about 50 (mm)) from the distance sensor (230), the minimum value of the second peak values ​​may be greater than the second peak value obtained when the distance sensor (230) is partially obscured by an obstacle (e.g., about 10,000 or less). In one embodiment, even in the case of a subject having a color and / or material having a low reflection rate of light emitted from the light-emitting part (231) of the distance sensor (230), when the subject is located within a specific distance (e.g., about 50 (mm)) from the distance sensor (230), the maximum value of the second peaks may be smaller than the second peak value obtained when the distance sensor (230) is completely obscured by an obstacle (e.g., about 290,000).

[0120] Hereinafter, with reference to FIGS. 8 to 12, the operation of a processor (250) determining a camera among a plurality of cameras to acquire an image based on the values ​​of one or more first distances, one or more second distances, and / or one or more first peaks will be described in detail.

[0121] In FIG. 2, the electronic device (101) is illustrated as including a display (210), a plurality of cameras (220), a distance sensor (230), a memory (240), and / or a processor (250), but is not limited thereto. For example, the electronic device (101) may further include at least one of the configurations shown in FIG. 1.

[0123] An electronic device (101) according to various embodiments of the present invention comprises a plurality of cameras (220), a distance sensor (230) including a light-emitting unit (231) and a light-receiving unit (233), and at least one processor (250) functionally connected to the plurality of cameras (220) and the distance sensor (230). The at least one processor (250) identifies a range corresponding to a zoom magnification for acquiring an image among a plurality of ranges related to a zoom magnification, acquires one or more signals corresponding to the one or more regions based on light emitted from the light-emitting unit (231) and received into one or more regions of the light-receiving unit (233), acquires one or more first distances based on one or more first peaks of the one or more signals, determines whether there exists a distance greater than or equal to a designated first distance corresponding to the identified range among the one or more first distances, and if the distance exists, determines whether the maximum value of the values ​​of the one or more first peaks is less than a designated first value, and determines whether the distance exists Alternatively, the camera for acquiring the image among the plurality of cameras (220) may be configured to be determined based on at least one of whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the specified first value.

[0124] In various embodiments, the at least one processor (250) may be configured to determine a camera for acquiring the image among a first camera included in the plurality of cameras (220) and a second camera having a focal length shorter than the focal length of the first camera, based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the specified first value.

[0125] In various embodiments, the at least one processor (250) may be configured to identify one or more second distances corresponding to one or more second peaks first acquired in each of the one or more first signals among the one or more first distances, and to identify whether there exists a distance among the one or more second distances that is shorter than the designated first distance and less than the designated second distance, and if there is no distance among the first camera and the second camera, to determine the first camera as the camera for acquiring the image, and if there is a distance among the one or more first distances that is greater than the designated first distance corresponding to the identified range.

[0126] In various embodiments, the at least one processor (250) may be configured to determine, among the first camera and the second camera, the second camera for acquiring the image when the distance does not exist.

[0127] In various embodiments, the at least one processor (250) may be configured to check whether the maximum value of the values ​​of the one or more first peaks is greater than or equal to a specified second value, which is greater than the specified first value, when the distance does not exist.

[0128] In various embodiments, the at least one processor (250) may be configured to determine the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value.

[0129] In various embodiments, the at least one processor (250) may be configured to determine the second camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is not greater than or equal to the specified second value.

[0130] In various embodiments, the electronic device (101) further includes a flicker sensor (310), and the at least one processor (250) may be configured to determine the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information acquired through the flicker sensor (310) satisfies a specified condition.

[0131] In various embodiments, the electronic device (101) further includes an illuminance sensor, and the at least one processor may be configured to determine the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information obtained through the flicker sensor (310) and / or the illuminance sensor satisfies a specified condition.

[0133] FIG. 8 is a flowchart (800) illustrating a method for providing an image according to various embodiments.

[0134] Referring to FIG. 8, in operation 801, in one embodiment, the processor (250) can identify a range corresponding to the zoom magnification for acquiring an image among a plurality of ranges related to the zoom magnification.

[0135] In one embodiment, the processor (250) may determine a zoom ratio for acquiring an image while the camera application is running. For example, the processor (250) may determine a zoom ratio for acquiring an image that is set to default (e.g., 1.0x) in response to the execution of the camera application. In another example, the processor (250) may acquire user input for adjusting the zoom ratio (e.g., multi-touch pinch zoom in / out, volume up / down key press) while the camera application is running. The processor (250) may determine the adjusted zoom ratio as the zoom ratio for acquiring an image based on the acquired user input. However, examples for determining the zoom ratio for acquiring an image are not limited to the examples described above. Hereinafter, the zoom ratio determined for acquiring an image will be referred to as the 'determined zoom ratio'.

[0136] In one embodiment, when a zoom ratio for acquiring an image is determined, the processor (250) can identify a range corresponding to the determined zoom ratio (e.g., a range to which the determined zoom ratio belongs) among a plurality of ranges related to the zoom ratio.

[0137] In one embodiment, each of the plurality of ranges related to the zoom magnification may correspond to two of the plurality of cameras (e.g., a plurality of cameras positioned through the rear of the electronic device (101)). In one embodiment, [Table 1] below may be a table illustrating two cameras corresponding to each of the plurality of ranges related to the zoom magnification.

[0139] Multiple ranges related to zoom magnification 2 cameras 0.5x or more and less than 3.0x Camera 1 (221) Camera 2 (222) 3.0x or higher and less than 10.0x Camera 2 (222) Camera 3 (223) 10.0x or higher and less than 15.0x Camera 3 (223) Camera 4 (224)

[0141] In one embodiment, as shown in [Table 1], a first zoom magnification range (e.g., 0.5x or more and less than 3.0x) corresponds to Camera 1 (221) (ultra-wide camera) and Camera 2 (222) (wide camera), a second zoom magnification range (e.g., 3.0x or more and less than 10.0x) corresponds to Camera 2 (222) and Camera 3 (223) (first telephoto camera), and a third zoom magnification range (e.g., 10.0x or more and less than 15.0x) corresponds to Camera 3 (223) and Camera 4 (224) (e.g., second telephoto camera).

[0142] In one embodiment, among a plurality of ranges related to zoom magnification (hereinafter referred to as 'a plurality of zoom magnification ranges'), one of two cameras corresponding to the range to which the determined zoom magnification belongs may be determined as the camera to acquire the image. For example, among the plurality of zoom magnification ranges, if the determined zoom magnification is 2.0x, the zoom magnification 2.0x may belong to a first zoom magnification range (e.g., 0.5x or more and less than 3.0x). As the zoom magnification 2.0x belongs to the first zoom magnification range (e.g., 0.5x or more and less than 3.0x), one of camera 1 (221) and camera 2 (222) corresponding to the first zoom magnification range (e.g., 0.5x or more and less than 3.0x) may be determined as the camera to acquire the image.

[0143] In one embodiment, the processor (250) can identify a designated first distance (hereinafter referred to as 'designated first distance') corresponding to the identified zoom magnification range when the zoom magnification range to which the determined zoom magnification belongs among a plurality of zoom magnification ranges is identified. For example, the processor (250) can identify a designated first distance necessary to determine the camera for acquiring an image among two cameras corresponding to the identified zoom magnification range.

[0144] In one embodiment, depending on the distance between the distance sensor (230) and the subject, one of the two cameras corresponding to the zoom magnification range may obtain an image with better quality than the other camera. For example, among Camera 1 (221) and Camera 2 (222) corresponding to the first zoom magnification range (e.g., 0.5x or more and less than 3.0x), if the distance between the distance sensor (230) and the subject is less than a specified first distance (e.g., about 28 cm), the image quality obtained through Camera 1 (221), which has a shorter focal length than the focal length of Camera 2 (222), may be better than the image quality obtained through Camera 2 (222). As another example, among camera 2 (222) and camera 3 (223) corresponding to a second zoom magnification range (e.g., 3.0x or more and less than 10.0x), if the distance between the distance sensor (230) and the subject is less than a specified first distance (e.g., about 40 cm), the image quality obtained through camera 2 (222), which has a shorter focal length compared to the focal length of camera 3 (223), may be better than the image quality obtained through camera 3 (223). As another example, among camera 3 (223) and camera 4 (224) corresponding to a third zoom magnification range (e.g., 10.0x or more and less than 15.0x), if the distance between the distance sensor (230) and the subject is less than a specified first distance (e.g., about 80 cm), the image quality obtained through camera 3 (223), which has a shorter focal length compared to the focal length of camera 4 (224), may be better than the image quality obtained through camera 4 (224).

[0145] In one embodiment, the specified first distance may be a distance set to determine the camera capable of acquiring an image with better quality among two cameras corresponding to a confirmed zoom magnification range.

[0146] In one embodiment, the specified first distance may vary depending on the identified zoom magnification range. For example, the specified first distance may be about 28 cm when the identified zoom magnification range is a first zoom magnification range (e.g., 0.5x or more and less than 3.0x), about 40 cm when the identified zoom magnification range is a second zoom magnification range (e.g., 3.0x or more and less than 10.0x), and about 80 cm when the identified zoom magnification range is a third zoom magnification range (e.g., 10.0x or more and less than 15.0x).

[0147] In one embodiment, the specified first distance may be changed (e.g., adjusted) in consideration of the camera's hysteresis (or also referred to as 'hysteresis characteristics') depending on the camera currently acquiring the image (e.g., preview image). Examples of how the specified first distance is changed in consideration of the camera's hysteresis depending on the camera currently acquiring the image will be described later with reference to FIG. 11.

[0148] In operation 803, in one embodiment, the processor (250) can acquire one or more signals corresponding to one or more regions included in the light receiving part (233) of the distance sensor (230) based on light that is emitted from the light emitting part (231) of the distance sensor (230) and then received into one or more regions of the light receiving part (233) of the distance sensor (230).

[0149] In one embodiment, one or more regions (hereinafter used interchangeably with 'one or more regions') included in the light receiving portion (233) of the distance sensor (230) may be regions set for two cameras corresponding to a zoom magnification range to which a determined zoom magnification belongs, among all multiple regions of the light receiving portion (233) of the distance sensor (230). For example, when the zoom magnification range to which the determined zoom magnification belongs is a first zoom magnification range (e.g., 0.5x or more and less than 3.0x), the one or more regions may be regions set for two cameras (e.g., Camera 1 (221) and Camera 2 (222)) corresponding to the first zoom magnification range (e.g., regions set considering the field of view of Camera 1 (221), the field of view of Camera 2 (222), and the field of view of the distance sensor (230)). However, this is not limited thereto, and one or more areas may be set as a total of multiple areas of the light receiving part (233) of the distance sensor (230).

[0150] In one embodiment, the processor (250) may acquire signals in each of one or more regions based on the number of photons received in each of one or more regions after being emitted from the light-emitting part (231) of the distance sensor (230). For example, the processor (250) may acquire a signal, such as a first signal (611) or a second signal (621), in each of one or more regions, as described through FIG. 6.

[0151] In operation 805, in one embodiment, the processor (250) can obtain one or more first distances based on one or more first peaks of one or more signals.

[0152] In one embodiment, the processor (250) may obtain at least one peak in each of one or more signals obtained through operation 803. For example, as described through FIG. 6, the processor (250) may obtain a peak (612) from the first signal (611) when the first signal (611) is obtained. The processor (250) may obtain a peak (622) and a peak (623) of the second signal (621) when the second signal (621) is obtained. In one embodiment, one or more first peaks may include peaks obtained from all of the signals obtained in one or more regions.

[0153] In one embodiment, the processor (250) can obtain one or more first distances based on one or more first peaks of one or more signals. For example, the processor (250) can obtain one or more first distances corresponding to one or more first peaks based on the times when one or more first peaks were obtained.

[0154] In one embodiment, the processor (250) may obtain values ​​of one or more first peaks of one or more signals. In one embodiment, the values ​​of one or more first peaks may be values ​​representing the number of photons corresponding to each of one or more first peaks (e.g., m1, m2, and m3 of FIG. 6).

[0155] In one embodiment, the processor (250) can acquire one or more second peaks of one or more signals. For example, among one or more first peaks of one or more signals, one or more second peaks acquired first (timest to earliest) in each of one or more signals acquired in one or more regions among a plurality of regions included in the light receiving unit (233) can be acquired.

[0156] In one embodiment, the processor (250) can obtain one or more second distances based on one or more second peaks. For example, the processor (250) can obtain one or more second distances corresponding to one or more second peaks based on the times when one or more second peaks were obtained.

[0157] In FIG. 8, operations 803 and 805 are exemplified as being performed after operation 801, but are not limited thereto. For example, operation 801 may be performed after operations 803 and 805 are performed or while operations 803 and 805 are being performed.

[0158] In operation 807, in one embodiment, the processor (250) can determine whether there exists a distance greater than a designated first distance corresponding to a range identified among one or more first distances. For example, the processor (250) can determine whether there exists a distance greater than a designated first distance corresponding to a zoom magnification range identified through operation 801 among one or more first distances obtained through operation 805. In another example, the processor (250) can determine whether the maximum distance of one or more first distances obtained through operation 805 is greater than a designated first distance corresponding to a zoom magnification range identified through operation 801.

[0159] In one embodiment, a designated first distance corresponding to a range identified among one or more first distances may be about 28 cm when the determined zoom magnification falls within a first zoom magnification range (e.g., 0.5x or more and less than 3.0x), about 40 cm when the determined zoom magnification falls within a second zoom magnification range (e.g., 3.0x or more and less than 10.0x), and about 80 cm when the determined zoom magnification falls within a third zoom magnification range (e.g., 10.0x or more and less than 15.0x).

[0160] In operation 807, if there is no distance greater than the designated first distance corresponding to the identified range among one or more first distances, in operation 809, in one embodiment, the processor (250) may determine a second camera among a plurality of cameras as a camera for image acquisition. For example, if there is no distance greater than the designated first distance corresponding to the identified range among one or more first distances, the processor (250) may determine a camera among two cameras corresponding to the identified range that has a shorter focal length than the focal length of the other camera (e.g., Camera 1 (221), Camera 2 (222), or Camera 3 (223) in each of the zoom magnification ranges of [Table 1]) as a camera for image acquisition.

[0161] In one embodiment, if there is no distance greater than the designated first distance corresponding to the identified range among one or more first distances, it may be a case where the subject is within the designated first distance from the distance sensor (230). For example, if there is no distance greater than the designated first distance corresponding to the identified range among one or more first distances, it may be a case where only the subject is within the designated first distance from the distance sensor (230), or where the subject is within the designated first distance from the distance sensor (230) and part of the distance sensor (230) is obscured by an obstacle.

[0162] If, in operation 807, there exists a distance greater than a specified first distance corresponding to a range identified among one or more first distances, in operation 811, in one embodiment, the processor (250) can determine whether the maximum value of the values ​​of one or more first peaks is less than a specified first value.

[0163] In one embodiment, the specified first value may be set to distinguish between cases where part of the distance sensor (230) is obscured by an obstacle and cases where an object is present within a specified second distance (e.g., about 5 cm) from the distance sensor (230). For example, when part of the distance sensor (230) is obscured by an obstacle, the maximum value of one or more first peak values ​​may be less than about 10,000, such as the maximum value of the second peak values ​​of reference numeral 722 in FIG. 7b (e.g., about 2,576 (722-2)). When an object is present within a specified second distance (e.g., about 5 cm) from the distance sensor (230), the maximum value of one or more first peak values ​​may be greater than or equal to about 10,000, such as the maximum value of the second peak values ​​of reference numeral 742 in FIG. 7d (e.g., about 2,62703 (742-2)). The processor (250) can set a specified first value, such as about 10000, to distinguish between cases where part of the distance sensor (230) is obscured by an obstacle and cases where an object is present within a specified second distance (e.g., about 5 cm) from the distance sensor (230).

[0164] In operation 811, if the maximum value of the values ​​of one or more first peaks is less than the specified first value, in operation 813, in one embodiment, the processor (250) may determine the first camera among a plurality of cameras as the camera for image acquisition. For example, if the maximum value of the values ​​of one or more first peaks is less than the specified first value, the processor (250) may determine the camera having a longer focal length than the focal length of the other camera among two cameras corresponding to the identified range (e.g., zoom range to which the determined zoom magnification belongs) (e.g., Camera 2 (222), Camera 3 (223), or Camera 4 (224) in each of the plurality of zoom ranges of [Table 1]) as the camera for image acquisition.

[0165] In one embodiment, the maximum value of the values ​​of one or more first peaks is less than the specified first value, which may be when the subject is at a distance greater than the specified first distance from the distance sensor (230) (e.g., when the subject is not within the specified first distance from the distance sensor (230)) or when the subject is at a distance greater than the specified first distance from the distance sensor (230) and part of the distance sensor (230) is obscured by an obstacle.

[0166] If, in operation 811, the maximum value of the values ​​of one or more first peaks is not less than a specified first value, in operation 809, in one embodiment, the processor (250) may determine a second camera among a plurality of cameras as a camera for image acquisition.

[0167] In one embodiment, the maximum value of the values ​​of one or more first peaks is not less than the specified first value, in addition to the object existing at a distance greater than the specified first distance from the distance sensor (230), the object exists within a specified second distance (e.g., about 5 cm) from the distance sensor (230).

[0168] Although not illustrated in FIG. 8, in one embodiment, the processor (250) can acquire an image through a determined camera.

[0170] FIG. 9 is a flowchart (900) illustrating a method for providing an image according to various embodiments.

[0171] Referring to FIG. 9, in operation 901, in one embodiment, the processor (250) can identify a range corresponding to the zoom magnification for acquiring an image among a plurality of ranges related to the zoom magnification.

[0172] In operation 903, in one embodiment, the processor (250) can acquire one or more signals corresponding to one or more regions included in the light receiving part (233) of the distance sensor (230) based on light that is emitted from the light emitting part (231) of the distance sensor (230) and then received into one or more regions of the light receiving part (233) of the distance sensor (230).

[0173] In operation 905, in one embodiment, the processor (250) can obtain one or more first distances based on one or more first peaks of one or more signals.

[0174] In operation 907, in one embodiment, the processor (250) can determine whether there exists a distance greater than a specified first distance corresponding to a range identified among one or more first distances.

[0175] Since operations 901 to 907 are each identical or similar in at least part to operations 801 to 807 of FIG. 8, a detailed description will be omitted.

[0176] In operation 911, in one embodiment, the processor (250) can determine whether there is a distance less than a specified second distance among one or more second distances.

[0177] In one embodiment, when part of the distance sensor (230) is obscured by an obstacle, the maximum value of one or more first peak values, such as the maximum value of the second peak values ​​of reference numeral 722 in FIG. 7b (e.g., about 2576 (722-2)), may be smaller than a specified first value (e.g., about 10000). When an object is present within a specified second distance (e.g., about 5 (cm)) from the distance sensor (230), the maximum value of one or more first peak values, such as the maximum value of the second peak values ​​of reference numeral 742 in FIG. 7d (e.g., about 262703 (742-2)), may be greater than or equal to a specified first value (e.g., about 10000).

[0178] If, in operation 911, there is no distance less than the designated second distance among one or more second distances, in operation 915, in one embodiment, the processor (250) may determine the first camera among a plurality of cameras as the camera for image acquisition.

[0179] If there is a distance less than the specified second distance among one or more second distances in operation 911, operation 913 can check whether the maximum value of one or more first peak values ​​is less than the specified first value.

[0180] If, in operation 913, the maximum value of the values ​​of one or more first peaks is less than the specified first value, in operation 915, in one embodiment, the processor (250) may determine the first camera among a plurality of cameras as the camera for image acquisition.

[0181] In operation 913, if the maximum value of the values ​​of one or more first peaks is not less than the specified first value, in operation 909, in one embodiment, the processor (250) may determine the second camera among the plurality of cameras as the camera for image acquisition.

[0182] Since operations 913, 915, and 909 are, respectively, at least partially identical or similar to operations 811, 813, and 809 of FIG. 8, a detailed description will be omitted.

[0184] FIG. 10 is a flowchart (1000) illustrating a method for providing an image, taking into account the case where the entire distance sensor (230) is obscured by an obstacle, according to various embodiments.

[0185] Referring to FIG. 10, in operation 1001, in one embodiment, the processor (250) can identify a range corresponding to the zoom magnification for acquiring an image among a plurality of ranges related to the zoom magnification.

[0186] In operation 1003, in one embodiment, the processor (250) can acquire one or more signals corresponding to one or more regions included in the light receiving part (233) of the distance sensor (230) based on light that is emitted from the light emitting part (231) of the distance sensor (230) and then received into one or more regions of the light receiving part (233) of the distance sensor (230).

[0187] In operation 1005, in one embodiment, the processor (250) can obtain one or more first distances based on one or more first peaks of one or more signals.

[0188] In operation 1007, in one embodiment, the processor (250) can determine whether there exists a distance greater than a specified first distance corresponding to a range identified among one or more first distances.

[0189] Since operations 1001 to 1007 are each at least partially identical or similar to operations 801 to 807 of FIG. 8, a detailed description will be omitted.

[0190] If, in operation 1007, there is no distance greater than a specified first distance corresponding to a range identified among one or more first distances, in operation 1009, in one embodiment, the processor (250) can determine whether the maximum value of the values ​​of one or more first peaks is greater than or equal to a specified second value.

[0191] In one embodiment, a designated second value may be set to distinguish between cases where the entire distance sensor (230) is obscured by an obstacle and cases where an object is within a designated second distance (e.g., about 5 mm) from the distance sensor (230). For example, when the entire distance sensor (230) is obscured by an obstacle (e.g., when the distance sensor (230) is completely covered by a finger), as illustrated in FIG. 7c, the maximum value of the values ​​of one or more first peaks (e.g., the values ​​of one or more second peaks) may be about 290,000 or more (e.g., about 292,337 (732-2)). In another example, when the subject is within a specified second distance (e.g., about 5 mm) from the distance sensor (230), as illustrated in FIG. 7d, the maximum value of the values ​​of one or more first peaks (e.g., the values ​​of one or more second peaks) may be less than about 290,000 (e.g., about 262,703 (742-2)). In one embodiment, the specified second value may be set to a value (e.g., about 290,000) to distinguish between the case where the entire distance sensor (230) is obscured by an obstacle and the case where the subject is within a specified second distance (e.g., about 5 mm) from the distance sensor (230).

[0192] If, in operation 1009, the maximum value of the values ​​of one or more first peaks is greater than or equal to a specified second value, in operation 1015, in one embodiment, the processor (250) may determine, among a plurality of cameras (e.g., a first camera and a second camera), the first camera with a longer focal length (e.g., camera 2 (222), camera 3 (223), or camera 4 (224) in [Table 1]) as the camera for image acquisition.

[0193] In one embodiment, the case where the maximum value of one or more first peak values ​​is greater than or equal to a specified second value may be a case where the entire distance sensor (230) is obscured by an obstacle. When the entire distance sensor (230) is obscured by an obstacle, the light receiving part (233) of the distance sensor (230) receives only light reflected by the obstacle, so the processor (250) may not be able to determine the actual distance between the distance sensor (230) and the subject. For example, when the entire distance sensor (230) is obscured by an obstacle, the processor (250) may not be able to determine whether the actual distance between the distance sensor (230) and the subject is greater than or equal to a specified first distance. If the actual distance between the distance sensor (230) and the subject is not determined, the processor (250) may determine the first camera, which has a focal length longer than the focal length of the second camera among the first camera and the second camera, as the camera for image acquisition. For example, an image obtained by using a second camera to photograph a subject located at a distance greater than or equal to a first distance specified from the distance sensor (230) may have better image quality compared to the image obtained by using a first camera to photograph a subject located at a distance less than or equal to a first distance specified from the distance sensor (230). Additionally, the frequency with which a user photographs a subject located at a distance greater than or equal to a first distance specified by the camera may be higher than the frequency with which a user photographs a subject located at a distance less than or equal to a first distance specified by the camera. In one embodiment, the processor (250), taking into account the examples described above, may determine the first camera as the camera for image acquisition among the first camera and the second camera when the maximum value of the values ​​of one or more first peaks is greater than or equal to a specified second value (e.g., when the entire distance sensor (230) is obscured by an obstacle).

[0194] In operation 1009, if the maximum value of the values ​​of one or more first peaks is not greater than or equal to a specified second value (e.g., if the subject is within a specified second distance (e.g., about 5 mm)) from the distance sensor (230), in operation 1011, in one embodiment, the processor (250) may determine, among a plurality of cameras (e.g., a first camera and a second camera), the second camera with a shorter focal length (e.g., camera 1 (221), camera 2 (222), or camera 3 (223) in each of the zoom magnification ranges of [Table 1]) as the camera for image acquisition.

[0195] If, in operation 1007, there exists a distance greater than a specified first distance corresponding to a range identified among one or more first distances, in operation 1013, in one embodiment, the processor (250) can determine whether the maximum value of the values ​​of one or more first peaks is less than a specified first value.

[0196] Since operation 1013 is at least partially identical or similar to 811 of FIG. 8, a detailed description will be omitted.

[0197] If, in operation 1013, the maximum value of the values ​​of one or more first peaks is not less than a specified first value, in operation 1009, in one embodiment, the processor (250) can determine whether the maximum value of the values ​​of one or more first peaks is greater than or equal to a specified second value.

[0198] If, in operation 1013, the maximum value of the values ​​of one or more first peaks is less than the specified first value, in operation 1015, in one embodiment, the processor (250) may determine, among a plurality of cameras, the first camera as the camera for image acquisition.

[0199] Although not illustrated in FIG. 10, in one embodiment, the processor (250) may determine whether the entire distance sensor (230) is obscured by an obstacle by further considering information obtained through the flicker sensor (310) and / or the light sensor (e.g., whether the information obtained through the flicker sensor (310) and / or the light sensor satisfies a specified condition). For example, the processor (250) may determine that the entire distance sensor (230) is obscured by an obstacle if the maximum value of the values ​​of one or more first peaks is greater than or equal to a specified second value and the value obtained through the flicker sensor (310) (e.g., a value representing the intensity of light incident on the flicker sensor (310)) is less than or equal to a specified value (e.g., about 0). In another example, the processor (250) may determine that the entire distance sensor (230) is obscured by an obstacle if the maximum value of one or more first peak values ​​is greater than or equal to a specified second value and the ratio of light incident on the flicker sensor (310) (e.g., the ratio of the intensity of light incident on the flicker sensor (310) after being emitted from the light-emitting part (231) of the distance sensor (230) to the total intensity of light) is greater than or equal to a specified ratio. In yet another example, the processor (250) may determine that the entire distance sensor (230) is obscured by an obstacle if the maximum value of one or more first peak values ​​is greater than or equal to a specified second value and the frequency detected through the flicker sensor (310) (e.g., the frequency at which an artificial light source located around the electronic device (101) emits light) is changed or irregular.In another example, the processor (250) may determine that the entire distance sensor (230) is obscured by an obstacle when the maximum value of one or more first peak values ​​is greater than or equal to a specified second value and the information obtained through the flicker sensor (310) satisfies a specified condition (e.g., the value obtained through the flicker sensor (310) is less than or equal to a specified value, the ratio of light incident on the flicker sensor (310) is greater than or equal to a specified ratio, or the frequency detected through the flicker sensor (310) is changed or irregular), and when the information obtained through the illuminance sensor satisfies a specified condition (e.g., the value obtained through the illuminance sensor (e.g., a value representing the intensity of light incident on the illuminance sensor) is greater than or equal to a specified value).

[0200] In one embodiment, the processor (250) may determine a first camera among a plurality of cameras as a camera for image acquisition if the maximum value of the values ​​of one or more first peaks is greater than or equal to a specified second value and the information acquired through the flicker sensor (310) and / or the illuminance sensor satisfies a specified condition. In one embodiment, the processor (250) may determine a second camera among a plurality of cameras as a camera for image acquisition if the maximum value of the values ​​of one or more first peaks is not greater than or equal to a specified second value or the information acquired through the flicker sensor (310) and / or the illuminance sensor does not satisfy a specified condition.

[0202] FIG. 11 is a flowchart (1100) illustrating a method for providing an image while taking into account the hysteresis of a camera according to various embodiments.

[0203] In one embodiment, the examples of FIG. 11 may be examples performed while acquiring an image through the second camera after the second camera among the plurality of cameras is determined to be the camera for acquiring an image in each of FIGS. 8 to 10.

[0204] In operation 1101, in one embodiment, the processor (250) may acquire one or more signals through the distance sensor (230) while acquiring an image (e.g., a preview image) through the second camera.

[0205] Since the operation of acquiring one or more signals of operation 1101 is at least partially identical or similar to the operation of acquiring one or more signals of operation 803 of FIG. 8, a detailed description will be omitted.

[0206] In operation 1103, in one embodiment, the processor (250) can obtain one or more first distances based on one or more first peaks of one or more signals.

[0207] Since operation 1103 is at least partially identical or similar to operation 805, a detailed description will be omitted.

[0208] In operation 1105, in one embodiment, the processor (250) can determine whether there exists a distance greater than a specified third distance corresponding to a range identified among one or more first distances.

[0209] In one embodiment, the designated third distance may be set to a longer distance than the designated first distance. For example, if it is determined that the zoom magnification for acquiring an image in operation 801 of FIG. 8 falls within a first zoom magnification range (e.g., 0.5x or more and less than 3.0x), the designated third distance may be set to a longer distance (e.g., 30cm) than the designated first distance (e.g., 28cm) corresponding to the first zoom magnification range. As another example, if it is determined that the zoom magnification for acquiring an image in operation 801 of FIG. 8 falls within a second zoom magnification range (e.g., 3.0x or more and less than 10.0x), the designated third distance may be set to a longer distance (e.g., 50cm) than the designated first distance (e.g., 40cm) corresponding to the second zoom magnification range. As another example, if it is determined that the zoom magnification for acquiring an image in operation 801 of FIG. 8 falls within a third zoom magnification range (e.g., 10.0x or more and less than 15.0x), the specified third distance may be set to a longer distance (e.g., 100cm) than the specified first distance (e.g., 80cm) corresponding to the third zoom magnification range.

[0210] In operation 1105, if there is no distance greater than a designated third distance corresponding to a range identified among one or more first distances, in operation 1107, in one embodiment, the processor (250) may determine, among a plurality of cameras, a second camera as a camera for acquiring an image. For example, if there is no distance greater than a designated third distance corresponding to a range identified among one or more first distances, the processor (250) may determine to maintain the operation of acquiring an image through the second camera currently acquiring an image.

[0211] If, in operation 1105, there exists a distance greater than or equal to a specified third distance corresponding to a range identified among one or more first distances, in operation 1109, in one embodiment, the processor (250) can determine whether the maximum value of the values ​​of one or more first peaks is less than a specified first value.

[0212] Since operation 1109 is at least partially identical or similar to operation 811 of FIG. 8, a detailed description will be omitted.

[0213] In operation 1109, if the maximum value of the values ​​of one or more first peaks is not less than a specified first value, in operation 1107, in one embodiment, the processor (250) may determine, among a plurality of cameras, a second camera as a camera for image acquisition.

[0214] If, in operation 1109, the maximum value of the values ​​of one or more first peaks is less than a specified first value, in operation 1111, in one embodiment, the processor (250) may determine the first camera among a plurality of cameras as the camera for image acquisition. For example, the processor (250) may switch the camera for image acquisition from the second camera to the first camera.

[0215] Although not illustrated in FIG. 11, in each of FIGS. 8 to 10, when the first camera among the plurality of cameras is determined to be the camera for acquiring an image, considering the hysteresis of the camera, the designated first distance may be used in place of the designated third distance exemplified in operation 1105 in FIG. 11.

[0217] FIG. 12 is a flowchart (1200) illustrating a method for providing an image according to various embodiments.

[0218] In one embodiment, FIG. 12 may be a flowchart for a method of determining a camera to acquire an image among a plurality of cameras (e.g., two cameras) without considering the zoom magnification for acquiring the image.

[0219] Referring to FIG. 12, in operation 1201, in one embodiment, the processor (250) can obtain one or more signals corresponding to one or more regions included in the light receiving part (233) of the distance sensor (230) based on light that is emitted from the light emitting part (231) of the distance sensor (230) and then received into one or more regions of the light receiving part (233) of the distance sensor (230).

[0220] In operation 1203, in one embodiment, the processor (250) can obtain one or more first distances based on one or more first peaks of one or more signals.

[0221] Since operation 1201 and operation 1203 are, respectively, at least partially identical or similar to operation 803 and operation 805 of FIG. 8, a detailed description will be omitted.

[0222] In operation 1205, in one embodiment, the processor (250) can determine whether there exists a distance greater than or equal to a designated fourth distance among one or more first distances.

[0223] In one embodiment, the designated fourth distance may be a distance set to determine the camera capable of acquiring an image with better quality among the two cameras when the electronic device (101) includes two cameras through the rear of the electronic device (101) (e.g., when the electronic device (101) includes only two cameras among camera 1 (221) to camera 4 (224). For example, the designated fourth distance may be a distance set by taking into account the focal lengths of the two cameras included in the electronic device (101).

[0224] In operation 1205, if there is no distance greater than or equal to a designated fourth distance among one or more first distances, in operation 1207, in one embodiment, the processor (250) may determine the second camera among two cameras included in the electronic device (101) as the camera for image acquisition. For example, if there is no distance greater than or equal to a designated fourth distance corresponding to a identified range among one or more first distances, the processor (250) may determine the second camera with a shorter focal length among the first camera and the second camera included in the electronic device (101) as the camera for image acquisition.

[0225] If, in operation 1205, there exists a distance greater than or equal to a specified fourth distance among one or more first distances, in operation 1209, in one embodiment, the processor (250) can determine whether the maximum value of the values ​​of one or more first peaks is less than a specified first value.

[0226] Since operation 1209 is at least partially identical or similar to operation 811 of FIG. 8, a detailed description will be omitted.

[0227] In operation 1209, if the maximum value of the values ​​of one or more first peaks is less than the specified first value, in operation 1211, in one embodiment, the processor (250) may determine the first camera among a plurality of cameras as the camera for image acquisition. For example, if the maximum value of the values ​​of one or more first peaks is less than the specified first value, the processor (250) may determine the first camera with a longer focal length among the first camera and the second camera included in the electronic device (101) as the camera for image acquisition.

[0228] In operation 1209, if the maximum value of the values ​​of one or more first peaks is not less than a specified first value, in operation 1207, in one embodiment, the processor (250) may determine a second camera among a plurality of cameras as a camera for image acquisition.

[0229] Although not illustrated in FIG. 12, when determining a camera to acquire an image among a plurality of cameras (e.g., two cameras) without considering the zoom magnification for acquiring the image as in FIG. 12, the examples described through FIG. 9 to FIG. 11 may be applied in the same or similar way.

[0231] A method for providing an image in an electronic device (101) according to various embodiments of the present invention comprises: a step of determining a range corresponding to a zoom ratio for acquiring the image among a plurality of ranges related to a zoom ratio; a step of acquiring one or more signals corresponding to the one or more regions based on light emitted from a light-emitting part (231) of a distance sensor (230) of the electronic device (101) and received by one or more regions of a light-receiving part (233) of the distance sensor (230); a step of acquiring one or more first distances based on one or more first peaks of the one or more signals; a step of determining whether there exists a distance greater than or equal to a designated first distance corresponding to the determined range among the one or more first distances; a step of determining whether, if the distance exists, the maximum value of the values ​​of the one or more first peaks is less than a designated first value; and, based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the designated first value, among a plurality of cameras (220) included in the electronic device, the image It may include an action to determine the camera for acquisition.

[0232] In various embodiments, the operation of determining the camera for acquiring the image may include determining the camera for acquiring the image among a first camera included in the plurality of cameras (220) and a second camera having a focal length shorter than the focal length of the first camera, based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the specified first value.

[0233] In various embodiments, the operation of determining a camera for acquiring the image may include, when the maximum value of the values ​​of one or more first peaks is less than or equal to the designated first value, determining the first camera among the first camera and the second camera for acquiring the image.

[0234] In various embodiments, the method may further include: a step of identifying one or more second distances corresponding to one or more second peaks first acquired in each of the one or more first signals among the one or more first distances among the one or more first peaks; a step of identifying whether there exists a distance less than a specified second distance that is shorter than the specified first distance among the one or more second distances; a step of determining, among the first camera and the second camera, the first camera as the camera for acquiring the image if there does not exist a distance less than the specified second distance; and a step of identifying whether there exists a distance greater than or equal to a specified first distance corresponding to the identified range among the one or more first distances if there exists a distance less than the specified second distance.

[0235] In various embodiments, the operation of determining the camera for acquiring the image may include, when the distance does not exist, determining the second camera among the first camera and the second camera for acquiring the image.

[0236] In various embodiments, the operation of determining the camera for acquiring the image may further include, when the distance does not exist, an operation of checking whether the maximum value of the values ​​of the one or more first peaks is greater than or equal to a specified second value which is greater than the specified first value.

[0237] In various embodiments, the operation of determining a camera for acquiring the image may further include, when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value, determining the first camera among the first camera and the second camera for acquiring the image.

[0238] In various embodiments, the operation of determining the camera for acquiring the image may include, when the maximum value of the values ​​of the one or more first peaks is not greater than or equal to the specified second value, the operation of determining the second camera among the first camera and the second camera for acquiring the image.

[0239] In various embodiments, the operation of determining the camera for acquiring the image may further include the operation of determining the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information acquired through the flicker sensor (310) of the electronic device (101) satisfies the specified condition.

[0240] In various embodiments, the operation of determining the camera for acquiring the image may further include the operation of determining the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information acquired through the flicker sensor (310) and / or the illuminance sensor satisfies the specified condition.

[0242] In addition, the structure of the data used in the above-described embodiment of the present invention may be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).

[0243] The present invention has been described above with reference to its preferred embodiments. Those skilled in the art will understand that the present invention may be embodied in modified forms without departing from the essential characteristics of the invention. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the invention is defined by the claims, not by the foregoing description, and all variations within the scope of the claims should be interpreted as being included in the invention. Explanation of the symbols

[0245] 101: Electronic device 108: Server

Claims

Claim 1 An electronic device comprising: a plurality of cameras; a distance sensor including a light-emitting part and a light-receiving part; and at least one processor functionally connected to the plurality of cameras and the distance sensor, wherein the at least one processor identifies a range corresponding to a zoom magnification for acquiring an image among a plurality of ranges related to a zoom magnification, acquires one or more signals corresponding to the one or more regions based on light emitted from the light-emitting part and received by one or more regions of the light-receiving part, acquires one or more first distances based on one or more first peaks of the one or more signals, determines whether there exists a distance greater than or equal to a designated first distance corresponding to the identified range among the one or more first distances, and if the distance exists, determines whether the maximum value of the values ​​of the one or more first peaks is less than a designated first value, and determines a camera among the plurality of cameras for acquiring the image based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the designated first value. Claim 2 An electronic device configured such that, in claim 1, the at least one processor determines a camera for acquiring an image among a first camera included in the plurality of cameras and a second camera having a focal length shorter than the focal length of the first camera, based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the specified first value. Claim 3 An electronic device configured such that, in the case where the maximum value of the values ​​of the one or more first peaks is less than or equal to the specified first value, the first camera among the first camera and the second camera is the camera for acquiring the image. Claim 4 An electronic device configured such that, in claim 3, the at least one processor identifies, among the one or more first distances, one or more second distances corresponding to one or more second peaks initially acquired in each of the one or more first signals among the one or more first peaks, and among the one or more second distances, whether there exists a distance less than a specified second distance that is shorter than the specified first distance, and if there is no distance less than the specified second distance, among the first camera and the second camera, the first camera is determined as the camera for acquiring the image, and if there is a distance less than the specified second distance, whether there exists a distance greater than or equal to a specified first distance corresponding to the identified range among the one or more first distances. Claim 5 In claim 3, the electronic device configured such that, when the distance does not exist, the second camera among the first camera and the second camera is the camera for acquiring the image. Claim 6 In claim 2, the electronic device configured such that the at least one processor determines whether, when the distance does not exist, the maximum value of the values ​​of the one or more first peaks is greater than or equal to a specified second value which is greater than the specified first value. Claim 7 An electronic device configured such that, in claim 6, the at least one processor determines the first camera as the camera for acquiring the image among the first camera and the second camera when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value. Claim 8 An electronic device configured such that, in claim 7, the at least one processor determines the second camera among the first camera and the second camera to be the camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is not greater than or equal to the specified second value. Claim 9 An electronic device according to claim 6, further comprising a flicker sensor, wherein the at least one processor is configured to determine, among the first camera and the second camera, the first camera as the camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information acquired through the flicker sensor satisfies a specified condition. Claim 10 An electronic device according to claim 9, further comprising an illuminance sensor, wherein the at least one processor is configured to determine the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information acquired through the flicker sensor and / or the illuminance sensor satisfies a specified condition. Claim 11 A method for providing an image in an electronic device, comprising: a step of identifying a range corresponding to a zoom ratio for acquiring the image among a plurality of ranges related to a zoom ratio; a step of acquiring one or more signals corresponding to the one or more regions based on light emitted from a light-emitting part of a distance sensor of the electronic device and received by one or more regions of a light-receiving part of the distance sensor; a step of acquiring one or more first distances based on one or more first peaks of the one or more signals; a step of identifying whether there exists a distance greater than or equal to a designated first distance corresponding to the identified range among the one or more first distances; a step of identifying whether, if the distance exists, the maximum value of the values ​​of the one or more first peaks is less than a designated first value; and a step of determining a camera for acquiring the image among a plurality of cameras included in the electronic device based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the designated first value. Claim 12 A method according to claim 11, wherein the operation of determining a camera for acquiring the image comprises determining a camera for acquiring the image among a first camera included in the plurality of cameras and a second camera having a focal length shorter than the focal length of the first camera, based on at least one of whether the distance exists or whether the maximum value of the values ​​of the one or more first peaks is less than or equal to the specified first value. Claim 13 In claim 12, the operation of determining a camera for acquiring the image comprises, when the maximum value of the values ​​of one or more first peaks is less than or equal to the designated first value, determining the first camera among the first camera and the second camera for acquiring the image. Claim 14 A method according to claim 13, further comprising: an operation of identifying one or more second distances corresponding to one or more second peaks first acquired in each of the one or more first signals among the one or more first distances; an operation of identifying whether there exists a distance less than a designated second distance among the one or more second distances that is shorter than the designated first distance; an operation of determining, among the first camera and the second camera, the first camera as the camera for acquiring the image, if there does not exist a distance less than the designated second distance; and an operation of identifying whether there exists a distance greater than or equal to a designated first distance corresponding to the identified range among the one or more first distances, if there exists a distance less than the designated second distance. Claim 15 In claim 13, the operation of determining the camera for acquiring the image includes, when the distance does not exist, determining the second camera among the first camera and the second camera for acquiring the image. Claim 16 In claim 12, the operation of determining the camera for acquiring the image further includes, when the distance does not exist, an operation of checking whether the maximum value of the values ​​of the one or more first peaks is greater than or equal to a specified second value which is greater than the specified first value. Claim 17 In claim 16, the operation of determining a camera for acquiring the image further includes, when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value, the operation of determining the first camera among the first camera and the second camera for acquiring the image. Claim 18 In claim 17, the operation of determining a camera for acquiring the image comprises, when the maximum value of the values ​​of one or more first peaks is not greater than or equal to the specified second value, determining the second camera among the first camera and the second camera for acquiring the image. Claim 19 In claim 16, the operation of determining the camera for acquiring the image further includes the operation of determining the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information acquired through the flicker sensor of the electronic device satisfies the specified condition. Claim 20 In claim 19, the operation of determining the camera for acquiring the image further includes the operation of determining the first camera among the first camera and the second camera for acquiring the image when the maximum value of the values ​​of the one or more first peaks is greater than or equal to the specified second value and the information acquired through the flicker sensor and / or illuminance sensor satisfies the specified condition.

Images