Electronic device and method for changing magnification of image using multiple cameras
By enabling the second camera before receiving user input in the electronic device and displaying a preview image based on the image acquired by the second camera, the delay problem caused by camera activation in the prior art is solved, and the efficiency of magnification adjustment and user experience are improved.
Patent Information
- Application Number
- CN202411973741.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2019-02-19
- Filing Date
- 2020-02-19
- Publication Date
- 2025-03-28
AI Technical Summary
When the existing electronic devices adjust the image magnification, the user experience will be affected due to the delay caused by the camera activation.
By receiving user input in a state where the preview image is displayed, the second camera among the plurality of cameras is enabled, and before receiving the second input for adjusting the magnification, the preview image is partially displayed based on the image acquired by the second camera, thereby reducing the delay caused by camera activation.
It realizes that the camera is enabled before receiving inputs from the user to adjust the magnification, thereby reducing the delay in magnification adjustment and improving the user experience.
Smart Images

Figure CN119729208A_ABST
Abstract
Description
[0001] This application is a divisional application of a patent application with an application date of February 19, 2020, application number 202010101260.3, and invention name “Electronic device and method for changing the magnification of an image using multiple cameras”. Technical Field
[0002] Various embodiments described below relate to an electronic device and method thereof for changing the magnification of an image using a plurality of cameras. Background Art
[0003] Recently, with the development of digital technology, various types of electronic devices are widely used, such as mobile communication terminals, smart phones, tablet computers, personal computers (PCs), electronic notebooks, personal digital assistants (PDAs), wearable devices, etc. The electronic devices may include one or more cameras for capturing images and / or videos. Summary of the invention
[0004] When the field-of-view angles of multiple cameras included in the electronic device at least partially overlap and the supported magnification ranges are different from each other, the electronic device may switch the camera for capturing an image between the multiple cameras according to controlling the electronic device to adjust the magnification by a user. The switching of the cameras may cause a delay caused by the activation of the cameras.
[0005] The technical problems to be solved in this article are not limited to the technical problems mentioned above, and a person having ordinary knowledge in the technical field to which the present invention belongs can clearly understand other technical problems not mentioned from the following description.
[0006] According to various embodiments, the electronic device may include: a display, a plurality of cameras, a memory storing instructions, and at least one processor operably coupled to the display, the plurality of cameras, and the memory. When the at least one processor executes the instructions, a preview image is displayed in the display based on at least a portion of an image being acquired from a first camera among the plurality of cameras; a first input is received in a state where the preview image is displayed, the first input is received before a second input for adjusting the magnification of the preview image; in response to the reception of the first input, a second camera among the plurality of cameras is enabled; in a state where another image different from the image is acquired using the enabled second camera, the second input for adjusting the magnification of the preview image is received; and the preview image is displayed based on at least a portion of the another image based at least in part on the reception of the second input.
[0007] According to various embodiments, a method for an electronic device may include: an operation of displaying a preview image in a display of the electronic device based on at least a portion of an image being acquired from a first camera among multiple cameras; an operation of receiving a first input in a state of displaying the preview image, the first input being received before a second input for adjusting the magnification of the preview image; an operation of enabling a second camera among the multiple cameras in response to the reception of the first input; an operation of receiving the second input for adjusting the magnification of the preview image in a state of acquiring another image different from the image using the enabled second camera; and an operation of displaying the preview image based on at least a portion of the another image based at least in part on the reception of the second input.
[0008] The electronic device and method thereof according to various embodiments can enable a camera before receiving a user's input for adjusting a magnification, thereby preventing a delay caused by a user recognizing activation of the camera, and can provide enhanced usability.
[0009] Effects obtainable in the present disclosure are not limited to the effects mentioned above, and a person having ordinary knowledge in the technical field to which the present disclosure belongs can clearly understand other effects not mentioned from the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] Figure 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0011] Figure 2 is a block diagram illustrating a camera module according to various embodiments.
[0012] Figure 3 is a block diagram for explaining an electronic device according to various embodiments.
[0013] Figure 4 is a flowchart for explaining the operation of an electronic device according to various embodiments.
[0014] Figure 5a to Figure 5c is an exemplary diagram for explaining operations performed by an electronic device based on multiple cameras according to various embodiments.
[0015] Figure 6a to Figure 6b is an exemplary diagram for explaining an operation of an electronic device adjusting a magnification of at least one of a plurality of cameras based on an example of a gesture performed in a display according to one embodiment.
[0016] Figure 7a to Figure 7b is an exemplary diagram for explaining an operation of an electronic device adjusting a magnification of at least one of a plurality of cameras based on another example of a gesture performed within a display according to one embodiment.
[0017] Figure 8a to Figure 8bis an exemplary diagram for explaining an operation of an electronic device adjusting a magnification of at least one of a plurality of cameras based on a movement of an external object included in a preview image according to one embodiment.
[0018] Fig. 9 is a flowchart for explaining an operation of an electronic device enabling at least one camera among a plurality of cameras according to various embodiments.
[0019] Fig.10 is a flowchart for explaining an operation performed by at least one of a plurality of cameras included in an electronic device according to various embodiments.
[0020] Fig.11 is a flowchart for explaining the operation of an electronic device according to various embodiments. DETAILED DESCRIPTION
[0021] Hereinafter, various embodiments of the present disclosure will be described with reference to the attached drawings. However, it should be understood that this is not intended to limit the technology described in the present disclosure to specific embodiments, but rather includes various changes, equivalent forms and / or alternative forms of the embodiments of the present disclosure. For the description of the drawings, similar reference numerals may be used to refer to similar components.
[0022] In the present disclosure, expressions such as “having”, “may have”, “including” or “may include” refer to the existence of corresponding features (for example, constituent elements such as values, functions, operations or components), and do not exclude the existence of additional features.
[0023] In the present disclosure, expressions such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B or C" may include all possible combinations of the items listed together. For example, "A or B", "at least one of A and B", or "at least one of A or B" may refer to (1) including at least one A; (2) including at least one B; (3) all including at least one A and at least one B.
[0024] Expressions such as "1st", "2nd", "first" or "second" used in the present disclosure may be used to modify various components regardless of order or importance, and to distinguish one component from another component without limiting the corresponding components. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without exceeding the scope of rights recorded in the present disclosure, a first component may be named a second component, and similarly, a second component may be replaced and named as a first component.
[0025] It will be understood that if an element (e.g., a first element) is referred to as being "(operably or communicatively) coupled" to another element (e.g., a second element), "coupled to another element (e.g., a second element)", "connected to another element (e.g., a second element)", it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element. Conversely, if an element (e.g., a first element) is referred to as being "directly coupled to" another element (e.g., a second element) or "directly connected to" another element (e.g., a second element), it means that there are no other elements (e.g., a third element) between the element and the other element.
[0026] The expression "configured to (or set to) ..." used in the present disclosure may be used interchangeably, for example, as "suitable for ...", "capable of ...", "designed to ...", "adapted to ...", "manufactured to ...", or "capable of ...", depending on the circumstances. The term "configured to (set to) ..." may not necessarily mean only "specially designed to" in hardware. Alternatively, in some cases, the expression "a device configured so that ..." may mean that the device "can" "perform ..." together with other devices or components. For example, the phrase "a processor configured to (or set to) be able to perform A, B, and C" may mean a dedicated processor (e.g., an embedded processor) for performing the corresponding operations, or a general-purpose processor (e.g., a central processing unit (CPU) or an application processor) that is able to perform the corresponding operations by executing one or more software programs stored in a memory device.
[0027] The terms used in the present disclosure are only used to illustrate specific embodiments and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the relevant context clearly indicates otherwise. The terms used herein, including technical terms or scientific terms, may have the same meanings commonly understood by people with common knowledge in the technical field recorded in the present disclosure. The terms usually defined in dictionaries in the terms used in the present disclosure may be interpreted as having the same or similar meanings as the context of the relevant technology, and unless clearly indicated in the present disclosure, they are not interpreted as ideal or exaggerated formal meanings. Depending on the circumstances, even the terms defined in the present disclosure cannot be interpreted as excluding embodiments of the present disclosure.
[0028] The electronic device according to various embodiments of the present disclosure may include at least one of a smart phone, a tablet computer, a mobile phone, a video phone, an e-book reader, a desktop computer, a laptop computer, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device. According to various embodiments, the wearable device may include at least one of a decorative type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head mounted device (HMD)), a fabric or clothing integrated type (e.g., electronic clothing), a body attached type (e.g., a skin pad or a tattoo), or a human body implant type (e.g., an implanted circuit).
[0029] In one embodiment, the electronic device may be a home appliance. The home appliance may include, for example, at least one of a television, a digital video disk (DVD) player, a stereo, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a TV box (e.g., Samsung HomeSync™, Apple TV™, or GoogleTV™), a game console (e.g., Xbox™, PlayStation™), an electronic dictionary, an electronic key, a camcorder, or an electronic photo album.
[0030] In other embodiments, the electronic device may include, for example, at least one of various medical machines (e.g., various portable medical measuring machines (blood glucose meters, heart rate meters, blood pressure meters, or thermometers, etc.), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), cameras, or ultrasound machines, etc.), navigation devices, global navigation satellite systems (GNSS), event data recorders (EDRs), flight data recorders (FDRs), automotive infotainment equipment, ship electronic equipment (e.g., ship navigation devices, gyrocompasses, etc.), avionics equipment, security equipment, vehicle head units, industrial or household robots, automated teller machines (ATMs) of financial institutions, points of sale in stores, or the Internet of Things (e.g., light bulbs, various sensors, electrical appliances or gas meters, sprinklers, fire alarms, thermostats, street lights, toasters, sports equipment, hot water tanks, heaters, boilers, etc.).
[0031] According to some embodiments, the electronic device may include at least one of a part of furniture or a building / structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (e.g., a water, electricity, gas, or radiation meter, etc.). In various embodiments, the electronic device may be one of the various devices described above or a combination of more than one of them. According to some embodiments, the electronic device may be a flexible electronic device or a foldable electronic device. In addition, the electronic device according to the embodiments of the present disclosure is not limited to the above-mentioned devices and may include new electronic devices as technology develops.
[0032] In the present disclosure, a user may refer to a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).
[0033] Hereinafter, various embodiments are described in detail with reference to the accompanying drawings. However, for the convenience of description, the size of the components may be enlarged or reduced in the accompanying drawings. For example, the size and thickness of each element shown in the accompanying drawings are arbitrarily shown for the convenience of description, and the present invention is not necessarily limited thereto.
[0034] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit.For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).
[0035] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 , or as part of the main processor 121 .
[0036] When the main processor 121 is in a disabled (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 (not the main processor 121), or when the main processor 121 is in an enabled state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123.
[0037] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.
[0038] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .
[0039] The input device 150 may receive commands or data from outside the electronic device 101 (eg, a user) to be used by other components of the electronic device 101 (eg, the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus).
[0040] The sound output device 155 can output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as a part of the speaker.
[0041] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of a force caused by a touch.
[0042] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.
[0043] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0044] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly with an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0045] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0046] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.
[0047] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.
[0048] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0049] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0050] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a Wide Area Network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.
[0051] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiation element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiation element may be additionally formed as part of the antenna module 197.
[0052] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.
[0053] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute the requested at least part of the function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.
[0054] Figure 2 2 is a block diagram showing a camera module 180 according to various embodiments. Figure 2, the camera module 180 may include a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (e.g., a buffer memory), or an image signal processor 260. The lens assembly 210 may collect light emitted or reflected from an object whose image is to be captured. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 210. In this case, the camera module 180 may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies 210 may have the same lens properties (e.g., viewing angle, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from those of another lens assembly. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.
[0055] The flash 220 may emit light, wherein the emitted light is used to enhance light reflected from an object. According to an embodiment, the flash 220 may include one or more light emitting diodes (LEDs) (e.g., red, green, blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or xenon lamps. The image sensor 230 may acquire an image corresponding to an object by converting light emitted or reflected from an object and transmitted through the lens assembly 210 into an electrical signal. According to an embodiment, the image sensor 230 may include one image sensor selected from a plurality of image sensors having different properties (e.g., an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 230 may be implemented using, for example, a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.
[0056] The image stabilizer 240 may move the image sensor 230 or at least one lens included in the lens assembly 210 in a specific direction, or control an operational property of the image sensor 230 (e.g., adjust the readout timing) in response to the movement of the camera module 180 or the electronic device 101 including the camera module 180. In this way, at least part of the negative effects (e.g., image blur) generated due to the movement of the image being captured is allowed to be compensated. According to an embodiment, the image stabilizer 240 may sense such movement of the camera module 180 or the electronic device 101 using a gyroscope sensor (not shown) or an acceleration sensor (not shown) arranged inside or outside the camera module 180. According to an embodiment, the image stabilizer 240 may be implemented as, for example, an optical image stabilizer. The memory 250 may at least temporarily store at least part of the image acquired via the image sensor 230 for subsequent image processing tasks. For example, if multiple images are captured quickly or image capture is delayed due to shutter lag, the acquired original image (e.g., Bayer pattern image, high-resolution image) may be stored in the memory 250, and its corresponding copy image (e.g., low-resolution image) may be previewed via the display device 160. Then, if a specified condition is satisfied (e.g., by a user's input or a system command), at least a portion of the original image stored in the memory 250 may be acquired and processed by, for example, the image signal processor 260. According to an embodiment, the memory 250 may be configured as at least a portion of the memory 130, or the memory 250 may be configured as a separate memory that operates independently of the memory 130.
[0057] The image signal processor 260 may perform one or more image processing on an image acquired via the image sensor 230 or an image stored in the memory 250. The one or more image processing may include, for example, depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor 260 may perform control (e.g., exposure time control or readout timing control) on at least one of the components included in the camera module 180 (e.g., image sensor 230). The image processed by the image signal processor 260 may be stored back to the memory 250 for further processing, or the image may be provided to an external component (e.g., memory 130, display device 160, electronic device 102, electronic device 104, or server 108) outside the camera module 180. According to an embodiment, the image signal processor 260 may be configured as at least part of the processor 120, or the image signal processor 260 may be configured as a separate processor that operates independently of the processor 120. If the image signal processor 260 is configured as a separate processor from the processor 120, at least one image processed by the image signal processor 260 may be displayed as it is by the processor 120 via the display device 160, or may be displayed after being further processed.
[0058] According to an embodiment, the electronic device 101 may include a plurality of camera modules 180 having different properties or functions. In this case, at least one camera module 180 of the plurality of camera modules 180 may form, for example, a wide-angle camera, and at least another camera module 180 of the plurality of camera modules 180 may form a telephoto camera. Similarly, at least one camera module 180 of the plurality of camera modules 180 may form, for example, a front camera, and at least another camera module 180 of the plurality of camera modules 180 may form a rear camera.
[0059] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.
[0060] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with another element (e.g., the second element)”, “coupled to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” with or without the terms “operably” or “communicatively” being used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.
[0061] As used herein, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).
[0062] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.
[0063] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) the computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, a server of an application store, or a forwarding server).
[0064] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as a corresponding one of the multiple components performing one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run or omitted in a different order, or one or more other operations may be added.
[0065] Figure 3 is a block diagram for explaining an electronic device 101 according to various embodiments. Figure 3 The electronic device 101 can be connected with Figure 1 The electronic device 101 corresponds to the electronic device 101. The electronic device 101 may be a smart phone, a personal digital assistant (PDA), a tablet computer (PC) such as a smart tablet, a desktop computer, or a laptop computer. According to various embodiments, the electronic device 101 may be an embedded computer that may be included in a part of another electronic device, or a wearable device such as a smart watch.
[0066] The electronic device 101 may include a processor 120, a memory 130, an input device 150, a display device 160, and a plurality of cameras. Figure 3 , the electronic device 101 may include a first camera 130-1 and a second camera 310-2. The number of cameras included in the electronic device 101 is not limited to Figure 3 For example, the electronic device 101 may include three or more cameras. The processor 120, the memory 130, the input device 150, the display device 160, and the multiple cameras included in the electronic device 101 may be electrically and / or operably coupled via an electrical interface such as a communication bus.
[0067] The processor 120 may execute one or more instructions stored in the memory 130. The memory 120 may include a circuit for processing data, such as an integrated circuit (IC), an arithmetic logic unit (ALU), a field programmable gate array (FPGA), and a large-scale integration (LSI). The number of processors 120 is not limited to Figure 3For example, the electronic device 101 may include a plurality of processors 120. The memory 130 may store data related to the electronic device 101. The memory 130 may include: a volatile memory, such as a random access memory (RAM) including a static random access memory (SRAM) or a dynamic random access memory (DRAM), or a non-volatile memory, such as a read-only memory (ROM), a magnetoresistive RAM (MRAM), a spin torque MRAM (STT-MRAM), a phase change RAM (PRAM), a resistive RAM (RRAM), a ferroelectric RAM (FeRAM), and a flash memory, an embedded multimedia card (eMMC), a solid state drive (SSD), etc.
[0068] The memory 130 may store instructions related to applications and instructions related to an operating system (OS). The operating system is system software executed by the processor 120. By executing the operating system by the processor 120, hardware components included in the electronic device 101 can be managed. The operating system may provide an application programming interface (API) as remaining software other than the system software.
[0069] One or more applications as a set of multiple applications may be set in the memory 130. The application being set in the memory 130 means that the application is stored in a form executable by the processor 120 coupled to the memory 130. For example, an instruction set for controlling the first camera 310-1 and / or the second camera 310-2 included in the electronic device 101 such as a camera application may be set in the memory 130. The processor 120 may execute the instruction set to control the first camera 310-1 and / or the second camera 310-2.
[0070] The display device 160 may visually output information to the user using at least one of an organic light emitting diode (OLED), a liquid crystal display (LCD), and a light emitting diode (LED). The electronic device 101 may include a touch sensor panel (TSP) (not shown) arranged in a display area where a user interface (UI) is visualized, so that the user interface output through the display device 160 can be controlled more intuitively. The touch sensor panel uses at least one of a resistive film, a capacitive element, a surface ultrasonic wave, and an infrared ray, so that it can detect that an external object (e.g., a user's finger, a stylus pen) touches the display device 160 or hovers above the display device 160.
[0071] In one embodiment, the processor 120 may control the first camera 310-1 and / or the second camera 310-2 according to a gesture of a user based on an external object. In order for the user to control the first camera 310-1 and / or the second camera 310-2 more intuitively, the processor 120 may display a preview image based at least in part on an image acquired from the first camera 310-1 and / or the second camera 310-2 in the display device 160. For example, the processor 120 may display a preview image in the display device 160 based on one of the first camera 310-1 and the second camera 310-2. The number of cameras used to display the preview image may vary according to the embodiment. For example, the processor 120 may display a preview image in the display device 160 based on a plurality of images acquired simultaneously from at least two of the plurality of cameras. Based on the movement of an external object in the preview image and / or a user interface (UI) in a display including the preview image, the processor 120 may control the first camera 310-1 and / or the second camera 310-2.
[0072] In one embodiment, the processor 120 may control the first camera 310-1 and / or the second camera 310-2 based on the movement and / or command of the user recognized through the input device 150. For example, based on a voice signal of the user received through a microphone (not shown) included in the input device 150, the processor 120 may control the first camera 310-1 and / or the second camera 310-2. Based on the movement of an external object captured by the first camera 310-1 and / or the second camera 310-2, the processor 120 according to one embodiment may control the first camera 310-1 and / or the second camera 310-2. Figure 6a to Figure 6b , Figure 7a to Figure 7b as well as Figure 8a to Figure 8b , which details the user input detected by the processor 120 using the input device 150, the display device 160 and / or at least one camera.
[0073] The electronic device 101 according to various embodiments uses the first camera 310-1 and / or the second camera 310-2 to photograph an object existing in the external space, thereby being able to acquire an image file or a video file. Each of the first camera 310-1 and the second camera 310-2 may be based on Figure 2 The camera module 180 may include at least one hardware component of the camera module 180. For example, each of the first camera 310-1 and the second camera 310-2 may include Figure 2 The lens assembly 210, the image sensor 230, the image stabilizer 240, the memory 250 and / or the image signal processor (ISP) 260.
[0074] The image sensor included in each of the first camera 310-1 and the second camera 310-2 may include pixels arranged in two dimensions. The image sensor may convert an image formed by the lens assembly into an electrical signal of a pixel unit based on a photoelectric effect. Each of the pixels may include a plurality of photodiodes (PDs) that change an optical signal into an electrical signal based on a photoelectric effect.
[0075] Each of the first camera 310-1 and the second camera 310-2 may be disposed at least one of the front side (e.g., the side of the housing visible from the display device 160) or the rear side (e.g., the other side of the housing opposite to the front side) of the housing of the electronic device 101. In one embodiment, when the first camera 310-1 and the second camera 310-2 are all disposed at the rear side of the housing, the first camera 310-1 and the second camera 310-2 may all output images based on external light toward the rear side.
[0076] The images output by the first camera 310-1 and the second camera 310-2 may be different according to the field of view, focal length, and / or magnification of each of the first camera 310-1 and the second camera 310-2. The field of view may refer to the angle at which the camera can accommodate the image. The focal length may refer to the lens included in the camera (e.g., Figure 2 The distance between the principal point and the focal point of the lens assembly 210 of the electronic device 101. A telephoto lens may refer to a lens with a relatively long focal length, and a wide-angle lens may refer to a lens with a relatively short focal length. A standard lens may refer to a lens with a focal length that is less than the focal length of a telephoto lens and greater than the focal length of a wide-angle lens. The magnification is a value that shows the degree to which a subject is magnified and captured within an image, and increases as the focal length becomes longer. For example, a telephoto lens may support a larger magnification than a wide-angle lens. The magnification range may refer to the range of magnifications that can be supported by a camera. In one embodiment, each of the first camera 310-1 to the second camera 310-2 included in the electronic device 101 may include a short focus lens having a different magnification from each other, or include a zoom lens having a magnification that changes within a specified magnification range.
[0077] When the field of view angle, focal length and / or magnification range of the first camera 310-1 and the second camera 310-2 are different from each other, for example, when the first camera 310-1 and the second camera 310-2 include lens assemblies and / or image sensors of different forms and / or specifications from each other, the first camera 310-1 and the second camera 310-2 capturing the same subject may output images different from each other. For example, when the field of view angle of the first camera 310-1 is wider than the field of view angle of the second camera 310-2, the first camera 310-1 may output an image including external light within the wide field of view angle including the subject, and the second camera 310-2 may output an image including external light within the narrow field of view angle including the subject.
[0078] The field of view angle, focal length and / or magnification range may be subordinate to each other. For example, when the field of view angle of the first camera 310-1 is wider than the field of view angle of the second camera 310-2, the maximum value of the focal length and / or magnification range of the first camera 310-1 may be smaller than the maximum value of the second camera 310-2. In this case, the first camera 310-1 may be used to shoot a subject relatively close to the electronic device 101, and the second camera 310-2 may be used to shoot a subject relatively far from the electronic device 101. Alternatively, the first camera 310-1 may be used to shoot the entire subject, and the second camera 310-2 may be used to zoom in on a portion of the subject being shot. In this case, the first camera 310-1 may include a wide-angle lens, and the second camera 310-2 may include a telephoto lens. Based on the user's input, the electronic device 101 according to various embodiments may control at least one of the first camera 310-1 and the second camera 310-2 to shoot the subject.
[0079] After the electronic device 101 is turned on, the state of the first camera 310-1 and / or the second camera 310-2 may not be kept in the enabled state. The enabled state is the state after the initialization of the camera is completed, and may refer to the state in which the camera can capture the subject based on the control signal (e.g., the control signal received from the processor 120). In one embodiment, the enabled state may refer to the state in which the camera is powered on by a battery (e.g., Figure 1 The enabled state refers to a state in which the battery 189 of the camera 130 receives normal power, reference power, or power above a specified power (voltage or current). In one embodiment, the enabled state may refer to a state in which the camera stores an image being acquired from the image sensor in a specified area of the memory 130, such as a buffer. For example, the enabled state may include a stream-on state in which an image stream being acquired from the image sensor is stored in a buffer. In one embodiment, the processor 120 displays at least a portion of the image stream as a preview image in the display device 160, thereby displaying the image currently being captured by the camera to the user in substantially real time.
[0080] According to various embodiments, after the boot is completed, the state of the first camera 310-1 and the second camera 310-2 may be switched between an enabled state and a sleep state. The sleep state may refer to a state for transitioning to an enabled state, which requires obtaining normal power from a power management integrated circuit (PMIC) although initialization is not required. In one embodiment, the sleep state may refer to a state in which the camera obtains power lower than a reference power from a power management integrated circuit (PMIC). In one embodiment, the sleep state may refer to a state in which the camera does not store an image being obtained from an image sensor in a buffer. In one embodiment, the sleep state may include one or more of a non-enabled state, an idle state, a standby state, a stream off state, or a low power state. In one embodiment, the sleep state may include a power-off state in which no power is received.
[0081] In one embodiment, in order to save power consumption of the first camera 310-1 and the second camera 310-2, the processor 120 may switch the state of the first camera 310-1 and / or the second camera 310-2 between an enabled state and a sleep state. The processor 120 may switch the state of the first camera 310-1 and the second camera 310-2 between an enabled state and a sleep state based on a user input for zooming in and / or out of a subject for photographing.
[0082] For example, in a state where a subject is captured based on the first camera 310-1 having a field of view wider than that of the second camera 310-2, based on receiving an input from the user for increasing the magnification, the processor 120 may switch the camera capturing the subject from the first camera 310-1 to the second camera 310-2. In order to switch the camera capturing the subject from the first camera 310-1 to the second camera 310-2, the processor 120 may switch the second camera 310-2 from a sleep state to an enabled state. In one embodiment, the time point at which the state of the second camera 310-2 is switched from the sleep state to the enabled state may be determined based on the user's input for increasing the magnification. For example, the state of the second camera 310-2 may be switched by the processor 120 so that the user cannot recognize a delay that occurs when the state of the second camera 310-2 is switched. Below, reference is made to Figure 4 , describing in detail operations of the electronic device 101 and / or the processor 120 converting the states of the first camera 310 - 1 and / or the second camera 310 - 2 according to various embodiments.
[0083] Figure 4 is a flowchart 400 for explaining the operation of an electronic device according to various embodiments. Figure 4 Electronic devices can be used with Figure 1 and Figure 3 Corresponding to the electronic device 101. Figure 4 The operation can be performed by, for example Figure 3 The electronic device 101 and / or the processor 120 may be executed. For example, the execution may be performed in response to a user's request. Figure 4 The user's request is for executing an application (eg, a camera application) related to a camera included in the electronic device among a plurality of applications set in the electronic device.
[0084] refer to Figure 4 In operation 410, the electronic device according to various embodiments may display a preview image based on at least a portion of an image being acquired from a first camera among a plurality of cameras. Figure 3 As described in the electronic device, the electronic device may include multiple cameras, and the first camera may be connected to one of the multiple cameras (for example, Figure 3 The preview image corresponds to one of the first camera 310-1 or the second camera 310-2. The preview image is based on the image output from the image sensor of the first camera, and may have the same resolution as the output image or a smaller resolution than the output image.
[0085] In one embodiment, the first camera may correspond to a camera designated by an application running in the electronic device among the plurality of cameras. For example, the first camera may correspond to a camera designated as the first camera to be enabled by the setting of the application. The electronic device according to one embodiment may turn on or convert the first camera among the plurality of cameras to an enabled state. For example, the electronic device may include a memory designated to store images (e.g., Figure 1 and / or Figure 3 The first camera may store an address of a buffer in the memory 130 of the first camera and send a command to the first camera to store the image being acquired by the first camera in the buffer (e.g., direct memory access (DMA) is turned on). The buffer may be a portion of the memory that stores a plurality of images (e.g., images corresponding to 8 frames continuously captured in the first camera) based on a queue method.
[0086] In response to receiving the command, the first camera may store the image being acquired from the image sensor of the first camera in at least a portion of the memory corresponding to the address. According to one embodiment, the electronic device may display at least a portion of the image stored in the buffer as a preview image in the display. For example, the electronic device may directly display the image, or may display a compressed image so that the resolution of the compressed image is lower than that of the image. In one embodiment, the electronic device may display one or more visual elements (e.g., buttons, icons, text boxes, progress bars) for controlling at least one of the multiple cameras together with the preview image. Reference Figure 5a to Figure 5c , details an example of a user interface as a user interface displayed on a display of an electronic device, including a preview image and one or more visual elements.
[0087] refer to Figure 4 In operation 420, the electronic device according to various embodiments may receive a first input from a user of the electronic device. In one embodiment, in a state where a preview image is displayed within a display based on operation 410, the electronic device may receive a specified first input from a user. In one embodiment, the first input may refer to an input received before a second input for adjusting a magnification of the preview image. In one embodiment, the first input may be defined as an input received before a second input. For example, the first input may correspond to a user's behavior that must be received before receiving the second input.
[0088] For example, when the second input is a touch gesture such as pinch-to-zoom performed on the display, the first input may include the user's behavior of contacting at least two fingers on the display in order to perform the pinch-to-zoom. For example, when the second input is a user's voice command for adjusting the magnification (for example, "Please zoom in" or "Please zoom out"), the first input may include a wake-up command (for example, "Hi, bixby") issued by the user before the voice command in order to inform the electronic device of the sound of the voice command. For example, when the second input is a gesture of pressing a physical button for adjusting the magnification, the first input may include a gesture of pressing the physical button with a specified pressure on the physical button (for example, a pressure less than the critical pressure at which the physical button is pressed). For example, when the second pressure is a touch gesture of dragging a visual element such as a progress bar (for example, a zoom bar) displayed in the display in order to adjust the magnification, the first input may include a user's gesture performed to display the visual element. For example, when the progress bar is displayed in the display, the first input may include a gesture of touching a position in the progress bar in order to drag the position. Reference Figure 6a to Figure 6b , Figure 7a to Figure 7b and / or Figure 8a to Figure 8b , various examples of first input and second input performed by the user are described in detail.
[0089] refer to Figure 4 , in operation 430, the electronic device according to various embodiments may enable at least one second camera different from the first camera. In one embodiment, in response to receiving the first input, the electronic device may enable at least one second camera different from the first camera being operated for displaying a preview image. The number of at least one second camera enabled among the multiple cameras may be based at least in part on the first input and / or the magnification and / or magnification range of the first camera. For example, the electronic device may enable at least one second camera among the multiple cameras that supports a magnification that is not included in the magnification range of the first camera being operated for displaying a preview image. For example, the electronic device may enable at least one second camera having another short focal lens having a magnification different from the magnification of the first camera including the short focal lens among the multiple cameras.
[0090] refer to Figure 3 , when the electronic device 101 receives a first input in a state where the first camera 310-1 is enabled, the electronic device 101 may enable a second camera 310-2 that is different from the first camera 310-1. Similarly, when the electronic device 101 receives a first input in a state where the second camera 310-2 is enabled, the electronic device 101 may enable the first camera 310-1 that is different from the second camera 310-2.
[0091] Since the electronic device enables at least one second camera in response to receiving the first input, the at least one second camera may be converted from a power-off state and / or a sleep state to an enabled state before receiving the second input performed to adjust the magnification. In one embodiment, the electronic device may include a memory (e.g., Figure 1 and / or Figure 3 The memory 130 of the second camera stores an address of a buffer in the memory 130 of the second camera, and sends a command (e.g., direct memory access (DMA) on) to store the image being acquired by the at least one second camera in the buffer. In one embodiment, the buffer may be different from the buffer included in the command stored to the first camera in order to enable the first camera. The buffer may be a portion of the memory that stores a plurality of images (e.g., images corresponding to 8 frames continuously captured in the second camera) based on a queue method.
[0092] In a state where at least one second camera is enabled based on operation 430, the processor of the electronic device may receive a plurality of images being acquired from each of the first camera and the at least one second camera. For example, the images being acquired from the first camera are stored in a designated first buffer of the memory, and the images being acquired from the at least one second camera are stored in a designated second buffer of the memory. After enabling at least one second camera based on operation 430, the electronic device may also keep displaying a preview image based at least in part on the image being acquired from the first camera based on operation 410.
[0093] refer to Figure 4, in operation 440, the electronic device according to various embodiments may receive a second input for adjusting the magnification of the preview image. At least one second camera that is different from the first camera for displaying the preview image and has a magnification that is not supported by the first camera may be enabled before receiving the second input based on operation 430. For example, the second input may include a pinch-to-zoom gesture for zooming in or out of the preview image. For example, the second input may include a touch gesture of a user performed on a visual element such as a zoom bar for adjusting the magnification. For example, the second input may include a voice command of a user for adjusting the magnification. In response to the receipt of the second input, the electronic device may adjust the magnification of the preview image being displayed in the display based on the second input. The adjustment of the magnification of the preview image may be based at least in part on, for example, digital zooming. The adjustment of the magnification is performed by controlling the first camera and / or the second camera corresponding to the preview image according to the second input.
[0094] refer to Figure 4 , in operation 450, the electronic device according to various embodiments may determine whether the magnification adjusted by the second input is included in the magnification range associated with the second camera. The magnification range may be based on at least one of the magnification range supported by the second camera or the magnification range supported by the first camera. In one embodiment, the electronic device may determine whether the magnification adjusted by the second input is included in the magnification range not supported by the first camera. For example, the electronic device may determine whether the magnification adjusted by the second input is included in the magnification range supported by at least one second camera while not included in the magnification range supported by the first camera.
[0095] When the magnification adjusted by the second input is not included in the magnification interval associated with the second camera (450-No), in operation 470, the electronic device according to various embodiments may display a preview image based at least in part on the image being acquired from the first camera. For example, in a state where the magnification adjusted by the second input is included in the magnification range supported by the first camera, the electronic device may continue to display the preview image based at least in part on the image being acquired from the first camera. In one embodiment, the electronic device may control the first camera based on the second input, thereby displaying a preview image based on the magnification adjusted according to the second input.
[0096] When the magnification adjusted by the second input is included in the magnification interval associated with the second camera (450-Yes), in operation 460, the electronic device according to various embodiments may display a preview image based at least in part on another image being acquired from the second camera. For example, when the magnification adjusted by the second input is not included in the magnification range supported by the first camera, the electronic device may change the camera used to display the preview image from the first camera to the second camera. In a state where the preview image is displayed based at least in part on another image being acquired from the second camera, the electronic device may interrupt the display of the preview image based on at least a portion of the image being acquired from the first camera.
[0097] In one embodiment, the electronic device may switch a camera for displaying a preview image from the first camera of operation 410 to at least one second camera enabled based on operation 430 based on operation 460. Since the at least one second camera is enabled before the magnification of the preview image is adjusted by the second input, in operation 460, the electronic device may seamlessly perform switching between the first camera and the second camera according to the adjustment of the magnification.
[0098] refer to Figure 4 , in operation 480, the electronic device according to various embodiments may determine whether the second input is interrupted by the user. For example, when the second input is a touch gesture such as pinch-to-zoom performed on the display, the electronic device may recognize the interruption of the second input in response to detecting that at least two fingers performing the touch gesture are separated from the display. For example, when the second input is a touch gesture of dragging a visual element such as a zoom bar, the electronic device may recognize the interruption of the second input in response to detecting that at least two fingers performing the touch gesture are separated from the display. For example, when the second input is a touch gesture of dragging a visual element such as a zoom bar and the movement of the position of the dragged display stops for more than a specified time, the electronic device may decide that the second input is interrupted. For example, when the second input is a user's voice command for adjusting the magnification and another voice command fails to be executed during a specified time after the occurrence of the voice command, the electronic device may recognize the interruption of the second input.
[0099] When the second input is not interrupted by the user (480-No), the electronic device according to various embodiments may Figure 4At least one of operations 450, 460, and 470 is performed, and the operation of adjusting the magnification of the preview image and / or the conversion of the camera according to the adjustment of the magnification is continued based on the second input. For example, after the electronic device converts the camera for displaying the preview image from the first camera to the second camera based on operation 460, when it is determined that the magnification adjusted by the second input is not included in the magnification range associated with the second camera (for example, when the magnification enters the magnification range associated with the first camera and exceeds the magnification range associated with the second camera), the electronic device may convert the camera for displaying the preview image from the second camera to the first camera again based on operation 470.
[0100] When the second input is interrupted by the user (480-Yes), the electronic device according to various embodiments may disable the remaining cameras except the camera related to the preview image in operation 490. For example, when the electronic device displays the preview image based on the image being acquired from the second camera based on operation 460, the electronic device may disable the first camera based on operation 490. For example, when the electronic device displays the preview image based on the image being acquired from the first camera based on operation 470, the electronic device may disable at least one second camera enabled in operation 430 based on operation 490.
[0101] In one embodiment, disabling the remaining cameras except the camera associated with the preview image may be performed based on a command sent by the processor of the electronic device to the remaining cameras and / or a control signal including a command. For example, the command may include a command to convert the state of the camera to a sleep state. For example, the command may include a command to interrupt the storage of the image being acquired by the camera in the buffer in the memory (e.g., DMA is turned off).
[0102] refer to Figure 4 , other cameras (e.g., at least one second camera) different from the camera enabled for displaying the preview image (e.g., the first camera) are enabled by the first input that must be performed before the second input for adjusting the magnification, and can be disabled by the interruption of the second input. In one embodiment, among the plurality of cameras included in the electronic device, the number of enabled cameras may be two or more in the time interval from the time point when the first input is received to the time point when the second input is interrupted, and may be one at the remaining time points other than the time interval.
[0103] Figure 5a to Figure 5c 310 - 1 , 310 - 2 , and 310 - 3 are exemplary diagrams for explaining operations performed by the electronic device 101 based on a plurality of cameras 310 - 1 , 310 - 2 , and 310 - 3 according to various embodiments. Figure 5a to Figure 5c The electronic device 101 and / or the hardware components in the electronic device 101 may be connected to Figures 1 to 3 Corresponding to the electronic device 101 and / or hardware components within the electronic device 101. Figure 5a to Figure 5cThe electronic device 101 may, for example, execute Figure 4 at least one of the operations.
[0104] refer to Figure 5a , a plurality of cameras 310-1, 310-2, 310-3 are arranged behind the housing of the electronic device 101. The number of cameras included in the electronic device 101 is not limited to Figure 5a to Figure 5c For example, at the back, 2 to 4 cameras may be arranged at the back of the electronic device 101, and at least one camera may be arranged at the front.
[0105] The field of view angles and / or focal lengths of the plurality of cameras 310-1, 310-2, 310-3 may be different from each other. Figure 5c , the field of view of each of the multiple cameras 310-1, 310-2, and 310-3 is illustrated. For example, the first camera 310-1 is based on a wide-angle lens and may have the widest field of view and the shortest focal length among the multiple cameras 310-1, 310-2, and 310-3. For example, the second camera 310-2 is based on a standard lens and may have a narrower field of view and a longer focal length than the first camera 310-1. For example, the third camera 310-3 is based on a telephoto lens and may have the narrowest field of view and the longest focal length among the multiple cameras 310-1, 310-2, and 310-3.
[0106] When a user inputs a request for the electronic device 101 to run a camera application, the electronic device 101 according to one embodiment may Figure 4 Operation 410 of the electronic device 101 enables one of the multiple cameras 310-1, 310-2, 310-3. The electronic device 101 may display a preview image based at least in part on an image being acquired from the enabled camera. In one embodiment, the electronic device 101 may display the preview image within a user interface for controlling at least one of the multiple cameras 310-1, 310-2, 310-3. After displaying the user interface, the electronic device 101 may perform Figure 4 The remaining operations after operation 410.
[0107] refer to Figure 5b , an example of a user interface displayed in a display 510 of an electronic device 101 according to an embodiment is shown. The display 510 may be used with, for example, Figure 3 The display device 160 is related to the display device 510. The display 510 may be exposed to the outside via the front side opposite to the rear side where the plurality of cameras 310-1, 310-2, 310-3 are arranged in the electronic device 101. The electronic device 101 according to one embodiment may display a preview image 520 based at least in part on an image being acquired from an enabled camera among the plurality of cameras 310-1, 310-2, 310-3 in at least a portion of the display 510.
[0108] According to one embodiment, the electronic device 101 may display a visual element (e.g., an icon in the form of a shutter) 530 for capturing an image using at least one of the plurality of cameras 310-1, 310-2, 310-3 (e.g., a camera in an enabled state for displaying the preview image 520) in at least a portion of the display 510. The visual element 530 may be displayed overlapping at least a portion of the display 510 on which the preview image 520 is displayed. In response to an input by a user touching the visual element 530, the electronic device 101 may control a camera corresponding to the preview image among the plurality of cameras 310-1, 310-2, 310-3 to capture at least one image.
[0109] refer to Figure 5b , there is illustrated an exemplary case of displaying a preview image 520 including a plurality of subjects (e.g., triangular prisms, quadrangular prisms, pentagonal prisms) spaced at different distances from the electronic device 101. When the field of view angles and / or focal lengths of the plurality of cameras 310-1, 310-2, 310-3 are different from each other, the number of subjects included in the preview image 520 may change depending on whether one of the plurality of cameras 310-1, 310-2, 310-3 is enabled to display the preview image 520.
[0110] When the electronic device 101 displays the preview image 520 based at least in part on the image being acquired from the first camera 310-1, the number of subjects displayed in the preview image 520 may become the largest because the wide angle of the first camera 310-1 is the widest. Figure 5b When the electronic device 101 displays the preview image 520 using the first camera 310-1, the preview image 520 displayed by the electronic device 101 may include the portion 540-1 of the image corresponding to the triangular prism, the portion 540-2 of the image corresponding to the quadrangular prism, and the portion 540-3 of the image corresponding to the pentagonal prism.
[0111] When the camera for displaying the preview image 520 gradually changes from the first camera 310-1 to the third camera 310-3, the number of objects displayed in the preview image 520 may gradually decrease. For example, when the camera for displaying the preview image 520 gradually changes from the first camera 310-1 to the third camera 310-3, the portion 540-3 of the image corresponding to the pentagonal prism closest to the center of the preview image 520 gradually enlarges, and the portion 540-1 of the image corresponding to the triangular prism and the portion 540-2 of the image corresponding to the quadrangular prism may move away from the center of the preview image 520 or disappear.
[0112] According to various embodiments, the electronic device 101 may selectively enable multiple cameras 310-1, 310-2, and 310-3 according to magnifications, thereby preventing the degradation of image quality caused by digital zooming. For example, when the user increases the magnification of the preview image 520 to a specified critical value or more, the electronic device 101 may enable the third camera 310-3 based on a telephoto lens that supports the maximum magnification among the multiple cameras 310-1, 310-2, and 310-3. When the user reduces the magnification of the preview image 520 while the preview image 520 is displayed based on the third camera 310-3, the electronic device 101 may enable the first camera 310-1 based on a wide-angle lens and / or the second camera 310-2 based on a standard lens that supports the minimum magnification among the multiple cameras 310-1, 310-2, and 310-3.
[0113] According to various embodiments, the time point when the electronic device 101 enables at least one of the multiple cameras 310-1, 310-2, and 310-3 may be before receiving an input for adjusting the magnification. In this case, the electronic device 101 may continuously perform the switching of the camera corresponding to the preview image 520 based on the magnification adjusted by the user. By continuously performing the switching of the camera, the delay caused by the switching of the camera corresponding to the preview image 520 can be minimized.
[0114] Figure 6a to Figure 6b 5 is an exemplary diagram for explaining an operation of adjusting a magnification of at least one of a plurality of cameras based on an example of performing an operation within the display 510 in the electronic device 101 according to an embodiment. Figure 6a to Figure 6b The electronic device 101 can be used with Figure 1 , Figure 3 as well as Figure 5a to Figure 5b Corresponding to the electronic device 101. Figure 6a to Figure 6b The electronic device 101 may execute, for example, Figure 4 at least one of the operations.
[0115] The electronic device 101 according to various embodiments may adjust the magnification of the preview image 520 based on the drag gesture recognized within the display 510. In response to receiving the first input defined as having to be received before receiving the drag gesture, the electronic device 101 may enable the remaining cameras of the plurality of cameras of the electronic device 101 except for the camera corresponding to the preview image 520. The second input, as an input performed after the first input, may include a drag gesture.
[0116] According to one embodiment, the electronic device 101 may change the magnification of the preview image 520 based on a drag gesture (eg, a pinch-to-zoom gesture) of at least two fingers via the touch display 510. Figure 6a, an example of positions 610, 620 between two fingers touching the display 510 is illustrated. The positions 610, 620 may be included in at least a portion of the display 510 displaying the preview image 520. The time point when the electronic device 101 enables at least one of the multiple cameras other than the camera associated with the preview image 520 may coincide with the time point when at least two external objects such as two fingers touching the display 510 touching the positions 610, 620 are detected. In this case, the first input is defined as another touch gesture received before the drag gesture included in the second input, and may include a touch gesture in which at least two fingers are substantially simultaneously touched on the display 510 in order to perform the drag gesture included in the second input.
[0117] After the user touches the positions 610 and 620 on the display 510, the user may drag at least one of the fingers touching the positions 610 and 620. Figure 6b , the user may drag the first finger touching position 610 from position 610 to position 615. While dragging the first finger, the user may drag the second finger touching position 620 from position 620 to position 625. In this case, the second input may include a drag gesture that adjusts the intervals of the multiple fingers touching display 510 in such a manner that the multiple fingers are not separated from display 510.
[0118] In response to recognizing a change in the interval between the fingers touching the display 510, the electronic device 101 may change the magnification of the preview image 520 according to the interval between the fingers. For example, when the interval between the fingers touching the display 510 gradually decreases (e.g., a pinch gesture), the electronic device 101 may gradually reduce the magnification of the preview image 520.
[0119] For example, Figure 6b As shown, when the interval between the fingers gradually increases (e.g., a zoom-in gesture), the electronic device 101 may gradually increase the magnification of the preview image 520. The increase in the magnification of the preview image 520 may be performed by controlling a camera for displaying the preview image 520 based on the interval, or by enlarging the preview image 520 based on an image being acquired from the camera.
[0120] When the magnification exceeds a specified critical value and increases, the electronic device 101 may use a camera for displaying the preview image 520, for example, based on Figure 4 For example, when the electronic device 101 displays the preview image 520 based on the first camera including the wide-angle lens, the user performs the operation 450 and 460 to increase the magnification. Figure 6a to Figure 6b, the electronic device 101 may switch the camera used to display the preview image 520 from the first camera to the second camera including a standard lens or the third camera including a telephoto lens. The critical value of the magnification for switching of the multiple cameras may be set based on the magnification and / or focal length supported by each of the multiple cameras included in the electronic device 101.
[0121] When the user executes Figure 6b After the pinch-to-zoom gesture illustrated in , when the finger touching the positions 615 and 625 is separated from the display 510, the electronic device 101 may disable the remaining cameras of the enabled multiple cameras except the camera corresponding to the preview image 520. For example, after the camera for displaying the preview image 520 is switched from the first camera to the third camera through the second input, the electronic device 101 may disable the remaining cameras except the third camera in response to recognizing that the external object touching the positions 615 and 625 is separated from the display 510. The electronic device 101 disabling at least one of the multiple cameras may be based on, for example, Figure 4 Operations 480 and 490 are performed.
[0122] According to various embodiments, the electronic device 101 enables the remaining cameras except the camera corresponding to the preview image 520 in response to the first input received before the second input for adjusting the magnification, so that the delay caused by the activation of the camera may not occur when the camera for displaying the preview image 520 is switched through the second input. For example, the delay occurring when the camera for displaying the preview image 520 is switched may be minimized. According to one embodiment, the electronic device 101 may enable the remaining cameras except the camera corresponding to the preview image 520 in response to the first input received before the second input for adjusting the magnification. Figure 6a to Figure 6b The camera conversion is performed using other forms of first input and second input than the first input and second input illustrated in FIG.
[0123] Figure 7a to Figure 7b 5 is an exemplary diagram for explaining an operation of adjusting a magnification of at least one of a plurality of cameras by the electronic device 101 based on another example of a gesture performed within the display 510 according to one embodiment. Figure 7a to Figure 7b The electronic device 101 can be used with Figure 1 , Figure 3 , Figure 5a to Figure 5b as well as Figure 6a to Figure 6b Corresponding to the electronic device 101. Figure 7a to Figure 7b The electronic device 101 may execute, for example, Figure 4 at least one of the operations.
[0124] In one embodiment, the electronic device 101 may adjust the magnification of the preview image 520 based on a user's touch gesture and / or drag gesture performed within a specified axis. The electronic device 101 may display the axis within the display 510 using, for example, a visual element such as a progress bar. The second input for adjusting the magnification may include a user's touch gesture and / or drag gesture performed within the specified axis.
[0125] The first input performed before the second input may include a gesture and / or action that must be received before the second input. Figure 7a , before receiving any input from the user after executing the camera application, the electronic device 101 may not display any visual element for adjusting the magnification. In this case, the first input may include a user's designated behavior (e.g., a gesture of pressing a designated physical button, a touch gesture performed on the display 510, and / or a designated voice command) that causes the visual element for adjusting the magnification to be displayed.
[0126] refer to Figure 7a , the first input may be a drag gesture that starts in the portion 710 within the visual element 530 corresponding to the shutter-shaped icon. For example, when an external object (e.g., a user's finger) in contact with the portion 710 within the visual element 530 moves in a direction beyond the portion of the display 510 on which the visual element 530 is displayed (e.g., Figure 7a In the case where the user drags the image in the horizontal direction, the electronic device 101 may determine that the first input has been received from the user.
[0127] In response to receiving the first input, the electronic device 101 may display a user interface 720 for adjusting the magnification in a portion of the display 510 as shown in FIG7. The electronic device 101 enabling the remaining cameras of the plurality of cameras other than the camera corresponding to the preview image 520 may correspond to the time point when it is determined to receive the first input.
[0128] For example, assume that the magnification of the preview image 520 is 1.0x before receiving the first input and the electronic device 101 enables a first camera based on a wide-angle lens among multiple cameras (eg, Figure 5c In response to receiving the first input, the electronic device 101 may enable the remaining cameras of the plurality of cameras based on the magnification range of the first camera. For example, when the electronic device 101 further includes a second camera based on a standard lens (eg, Figure 5c A second camera 310-2 based on a telephoto lens (eg, Figure 5c When the third camera 310 - 3 is activated, the electronic device 101 may activate a second camera having a magnification range relatively adjacent to the activated first camera among the second camera and the third camera.
[0129] In one embodiment, the electronic device 101 may enable different cameras among the multiple cameras based on the first input. For example, in a state where the first camera based on the wide-angle lens is enabled, when the electronic device 101 receives a first input starting from the portion 710 and moving at a specified speed or above, the electronic device 101 may enable the second camera and the third camera at the same time, or only enable the third camera.
[0130] refer to Figure 7b In response to receiving the first input, the electronic device 101 may display an image in the form of a ruler and at least one text box adjacent to the image to display the magnification and / or zoom ratio within the user interface 720. After displaying the user interface 720, the electronic device 101 may receive a second input received after the first input, for example, a drag gesture starting from portion 710 and interrupted at portion 715 within the user interface 720 that is different from portion 710. The electronic device 101 may adjust the magnification of the preview image 520 based on the performed drag gesture. When the second input received after the first input is a drag gesture moving in the user interface 720 in an increasing direction, the electronic device 101 may gradually increase the magnification of the preview image 520 from 1.0x based on the digital zoom.
[0131] When the magnification of the preview image 520 is based on the second input and the magnification of the first camera and the second camera based on the standard lens (eg, Figure 5c When a specified critical value (e.g., 2.0x) of the conversion between the first camera and the second camera 310-2) corresponds to, the electronic device 101 may change the camera used to display the preview image 520 from the first camera to the second camera. As described above, the activation of the second camera is enabled by the first input received before the second input, so the change of the camera can be seamlessly performed at the time point corresponding to the specified critical value. After the camera used to display the preview image 520 is changed from the first camera to the second camera, the electronic device 101 according to one embodiment may also enable the remaining cameras of the multiple cameras (e.g., a third camera having a magnification range adjacent to the magnification range of the second camera) based on the magnification range of the second camera.
[0132] The electronic device 101 may interrupt the enabling of the remaining cameras except the camera for displaying the preview image 520 based at least in part on the interruption of the second input. For example, when no additional input is received within the user interface 720 during a specified time after the second input such as a drag gesture is interrupted at the position 715, the electronic device 101 interrupts the display of the user interface 720 and may disable the remaining cameras except the camera for displaying the preview image 520.
[0133] Since the electronic device 101 according to various embodiments enables the camera to be switched through the second input based on the first input received before the second input for adjusting the magnification executed in the user interface 720, it is possible to minimize the delay occurring in the switching of the camera due to the second input. Figure 6a To Figure 6 and Figure 7a to Figure 7b In addition to the various gestures (pinch-to-zoom gesture, drag gesture) on the display 510 described in the figure, the electronic device 101 according to various embodiments can also adjust the magnification of the preview image 520 and switch between multiple cameras in response to receiving input in other forms different from touch gestures.
[0134] Figure 8a to Figure 8b 8 is an exemplary diagram for explaining an operation of the electronic device 101 adjusting a magnification of at least one of a plurality of cameras based on a movement of an external object 810 included in a preview image 520 according to one embodiment. Figure 8a to Figure 8b The electronic device 101 can be used with Figure 1 , Figure 3 , Figure 5a to Figure 5b , Figure 6a to Figure 6b as well as Figure 7a to Figure 7b Corresponding to the electronic device 101. Figure 8a to Figure 8b The electronic device 101 may execute, for example, Figure 4 at least one of the operations.
[0135] In one embodiment, the electronic device 101 may adjust the magnification of the preview image 520 based on the user's gestures being captured by multiple cameras. Figure 8a As shown in the figure, the electronic device 101 can detect the user within the image acquired by the camera for displaying the preview image 520. The user can adjust the magnification of the preview image 520 based on voice commands and / or movements without touching the electronic device 101. For example, the second input for adjusting the magnification may include the user's movement of moving the user's palm in a specified direction (e.g., an upper direction and / or a lower direction). The form of the second input is not limited to the above example, and other examples may include the user's movement of adjusting the distance between the two palms of the user.
[0136] The electronic device 101 may utilize an enabled camera to recognize a first input that must be received before a second input. For example, the first input may include movement of an open palm. When a user directs an external object such as a palm toward the electronic device 101 and / or displays the camera of the electronic device 101, the electronic device 101 may recognize the first input based on, for example, a palm detection method. Figure 8a, the electronic device 101 may identify a portion 810 in which an external object related to the first input is captured within the preview image 520. In response to the recognition of the first input, the electronic device 101 may enable other cameras other than the camera corresponding to the preview image 520 among the plurality of cameras.
[0137] After opening the palm toward the electronic device 101 , the user may move the palm in an upward direction and / or a downward direction. Figure 8b is a diagram showing a user interface 720 displayed in the display 510 by the electronic device 101 according to the first input received with the movement of the user's palm. For example, when the user moves the palm to the upper side direction, the electronic device 101 may gradually increase the magnification of the preview image 520 according to the moving distance and / or moving speed of the palm. When the magnification of the preview image 520 corresponds to a specified critical value for the conversion between multiple cameras, the electronic device 101 may perform the conversion between multiple cameras. For example, the electronic device 101 may convert the camera used to display the preview image 520 from a camera with a relatively low magnification to a camera with a relatively high magnification. As another example, when the user moves the palm to the lower side direction, the electronic device 101 may gradually reduce the magnification of the preview image 520 according to the moving distance and / or moving speed of the palm. In this case, the camera used to capture the preview image 520 and / or the image may be converted from a camera with a relatively high magnification to a camera with a relatively low magnification.
[0138] According to one embodiment, the electronic device 101 may display the change of the magnification of the preview image 520 and / or the result of switching the camera in the display 510 (for example, in the user interface 720). In one embodiment, the electronic device 101 may output the change of the magnification of the preview image 520 and / or the result of switching the camera based on a voice signal and / or a tactile signal (for example, a tactile signal based on a vibration motor). For example, referring to Figure 8b In response to adjusting the magnification of the preview image 520 based on the movement of the user's palm, the electronic device 101 may display the adjusted magnification (e.g., a value of 3.5x) within the user interface 720 while using the speaker of the electronic device 101 to output a voice signal indicating the magnification (e.g., "the magnification has been changed to 3.5x").
[0139] Fig. 9 900 is a flowchart for explaining an operation of an electronic device enabling at least one camera among a plurality of cameras according to various embodiments. Fig. 9 Electronic devices can be used with Figure 1 and Figure 3 Corresponding to the electronic device 101. Fig. 9 The operation can be done by, for example Figure 3 Executed by the electronic device 101 and / or the processor 120. Fig. 9 The operation can be used with, for example Figure 4 at least part of the operation (e.g., Figure 4 For example, in response to the operation 420, 430 based on Figure 4 Operation 410 receives the first input, the electronic device 101 may execute Fig. 9 at least one of the operations.
[0140] refer to Fig. 9 In operation 910, the electronic device according to various embodiments may identify a magnification range of the first camera associated with the preview image. In response to a first input received before a second input received to adjust the magnification, the electronic device may perform operation 910. The first camera may be enabled to display the preview image within a display of the electronic device before receiving the first input.
[0141] In one embodiment, the electronic device may identify a first camera among a plurality of cameras that stores an image in a buffer of a memory. In response to the identification of the first camera, the electronic device may identify a magnification range of the first camera based on operation 910. In one embodiment, the electronic device may identify information related to the magnification range and / or focal length of the first camera. The information may include a range of magnifications that can be adjusted based on the first camera and / or a critical value of a magnification that becomes a standard for converting a camera used to capture an image from the first camera to another camera.
[0142] refer to Fig. 9 In operation 920, the electronic device according to various embodiments may select at least one second camera among the plurality of cameras based on the recognized magnification range of the first camera based on operation 910. The second camera may be a remaining camera different from the first camera among the plurality of cameras included in the electronic device. For example, the electronic device may select a camera having a magnification range adjacent to the magnification range of the first camera among the plurality of cameras as the second camera. For example, the electronic device may select at least one camera designated as being converted to the first camera based on a designated critical value among the plurality of cameras as the second camera.
[0143] exist Figure 5cIn the example of , when the third camera 310-3 including a telephoto lens is enabled, the electronic device may select the second camera 310-2 including a standard lens based on operations 910 and 920. The magnification range of the second camera 310-2 may be adjacent to the magnification range of the third camera 310-3. When displaying a preview image based on the second camera 310-2 including a standard lens, the electronic device may select all of the first camera 310-1 including a wide-angle lens and the third camera 310-3 including a telephoto lens based on operations 910 and 920. The magnification ranges of the first camera 310-1 and the third camera 310-3 may be adjacent to the magnification range of the second camera 310-2. When displaying a preview image based on the first camera 310-1, the electronic device may perform operations 910 and 920 in response to the first input and select the second camera 310-2 having a magnification range adjacent to the magnification range of the first camera 310-1.
[0144] In one embodiment, the electronic device may select at least one second camera from among the plurality of cameras based on the magnification range of the first camera and the first input. Figure 5c , in a state where the third camera 310 - 3 is enabled, in response to receiving a drag gesture performed at a speed above a specified speed (eg, Figure 7a ), the electronic device may select the second camera 310-2 having a magnification range adjacent to the magnification range of the third camera 310-3 and to the first camera 310-1.
[0145] refer to Fig. 9 In operation 930, the electronic device according to various embodiments may enable the selected at least one second camera based on operation 920. In one embodiment, the electronic device may allocate a buffer for storing images to the at least one second camera. In one embodiment, the electronic device may transmit a command (e.g., DMA on) to the at least one second camera to store images being acquired from the at least one second camera in the allocated buffer. The at least one second camera may enter an enabled state from a sleep state based on operation 920. The at least one second camera may store images acquired from the image sensor within a designated portion (e.g., a buffer) based on a designated period (e.g., a period of a vertical synchronization (Vsync) signal). After the at least one second camera is enabled, the electronic device may, for example, enable the image based on Figure 4 The operations (440 to 470) may switch a camera for displaying a preview image between the first camera and at least one second camera.
[0146] Fig.10 1000 is a flowchart for explaining an operation performed by at least one of a plurality of cameras included in an electronic device according to various embodiments. Fig.10 Electronic devices can be used with Figure 1 and Figure 3 Corresponding to the electronic device 101. Fig.10 The operation can be done by, for example Figure 3 The electronic device 101 and / or at least one of the multiple cameras 310-1, 310-2 is executed. Fig.10 The operation can be used with, for example Figure 4 Operation and / or Fig. 9 is related to at least one of the operations.
[0147] refer to Fig.10 In operation 1010, a camera of an electronic device according to various embodiments may receive a request to activate the camera from a processor. The processor may communicate with, for example, Figure 1 and / or Figure 3 In one embodiment, the processor may be based on Figure 4 Operation 430 and / or Fig. 9 Operation 930 of the embodiment sends the request to the camera. Before receiving the request, the state of the camera may correspond to a sleep state.
[0148] refer to Fig.10 In operation 1020, the camera of the electronic device according to various embodiments may initialize the camera based on the request. In one embodiment, the camera may be initialized in response to receiving the request. The initialization of the camera may include initialization of the image sensor and / or an Internet Service Provider (ISP) coupled to the image sensor.
[0149] refer to Fig.10 In operation 1030, the camera of the electronic device according to various embodiments may identify the buffer included in the memory in the request. In one embodiment, the camera may identify the buffer after initialization. The buffer is, for example, a designated portion of the memory, and may include a queue for storing a plurality of images continuously output from the image sensor based on a first-in-first-out (FIFO) manner. In one embodiment, the camera may extract the in-memory address of the buffer included in the request of operation 1010, thereby identifying the buffer.
[0150] refer to Fig.10 In operation 1040, the camera of the electronic device according to various embodiments may store the image being acquired from the image sensor in the identified memory. In one embodiment, in response to identifying the buffer based on operation 1030, the camera may store the image being acquired from the image sensor in the identified buffer. The camera storing the image in the buffer may be performed based on, for example, a signal having a specified period such as a vertical synchronization (Vsync) signal. The image stored in the buffer may be used to display, for example, a video based on Figure 4 A preview image of operations 460 and 470 is shown.
[0151] refer to Fig.10In operation 1050, the camera of the electronic device according to various embodiments may determine whether to receive a request to disable the camera from the processor. In one embodiment, in a state where an image being acquired from the image sensor is stored in the buffer based on operation 1040, the electronic device may receive a request to disable the camera from the processor. In one embodiment, the processor may request disabling of the camera based at least in part on an interruption of the second input. In one embodiment, when the camera is utilized for display of a preview image, the processor may not request disabling of the camera even after an interruption of the second input, and may request disabling of the camera based on other activities such as termination of a camera application.
[0152] When the request to disable the camera is not received from the processor (1050-No), the electronic device may keep storing the image being acquired from the image sensor in the buffer based on, for example, operation 1040. When the request to disable the camera is received from the processor (1050-Yes), in operation 1060, the camera of the electronic device according to various embodiments may interrupt storing the image in the buffer.
[0153] In one embodiment, in response to receiving a request related to the disablement of the camera, the camera may enter the sleep state from the enabled state. In response to entering the sleep state, the camera may interrupt the storage of images in the buffer. In one embodiment, the camera entering the sleep state based on operation 1060 may re-receive a request related to the enablement of the camera from the processor. In this case, the camera may not perform the initialization of the camera based on operation 1020, and may restart the storage of images in the buffer based on operations 1030 and 1040.
[0154] Fig.11 is a flowchart 1100 for illustrating the operation of an electronic device according to various embodiments. Fig.11 Electronic devices can be used with Figure 1 and Figure 3 Corresponding to the electronic device 101. Fig.11 The operation can be done by, for example Figure 3 Executed by the electronic device 101 and / or the processor 120. Fig.11 The operation can be used with, for example Figure 4 is related to at least one of the operations. Fig.11 The operation can be performed by running a designated application such as a camera application.
[0155] refer to Fig.11In operation 1110, an electronic device according to various embodiments may display a preview image based at least in part on an image being acquired from a first camera among multiple cameras. In one embodiment, the first camera may enter an enabled state for displaying the preview image, and the remaining cameras among the multiple cameras except the first camera may remain in a sleep state. The preview image may be displayed on at least a portion of a display of the electronic device and in conjunction with at least one visual element for controlling the multiple cameras (e.g., Figure 5b In one embodiment, the electronic device may be displayed with a visual element 530. Figure 4 Operation 1110 is performed similarly to operation 410 .
[0156] refer to Fig.11 In operation 1120, the electronic device according to various embodiments may receive a first input from a user of the electronic device. The first input may be an input defined as being received before receiving a second input for adjusting the magnification. The first input may be an input that must be received before the second input. For example, the first input may include Figure 6a A user's gesture of touching at least two positions 610, 620 of the preview image 520 at the same time, Figure 7a A user's gesture of starting from a designated position 710 within the visual element 530 and dragging to the outside of the visual element 530, Figure 8a In one embodiment, the electronic device may be connected to the user's gesture of the external object specified by the display, and / or a voice signal including a wake-up command. Figure 4 Operation 1120 is performed similarly to operation 420 .
[0157] refer to Fig.11 In operation 1130, the electronic device according to various embodiments may enable at least one second camera different from the first camera. In one embodiment, in response to receiving the first input based on operation 1120, the electronic device may enable at least one second camera. For example, the electronic device may Figure 4 Operation 430 and / or Fig. 9 Operation 1130 is performed similarly to operations 920 and 930. At least one second camera may be based on Fig.10 At least one of the operations enters the enabled state.
[0158] refer to Fig.11 In operation 1140, the electronic device according to various embodiments may receive a second input for a magnification of the preview image. For example, the second input may be an input received continuously after the first input. For example, the second input may include Figure 6b pinch to zoom, Figure 7b gestures performed within the user interface 720, Figure 8bIn one embodiment, the electronic device may be connected to the control unit of the present invention. Figure 4 Operation 1140 is performed similarly to operation 440 .
[0159] refer to Fig.11 In operation 1150, the electronic device according to various embodiments may display a preview image based at least in part on another image being acquired from the second camera. Figure 4 Operations 450 and 460 of the electronic device may similarly perform operation 1150. In a state where the preview image is displayed based at least in part on another image, the electronic device may interrupt displaying the preview image based at least in part on another image being acquired from the first camera.
[0160] According to various embodiments, the electronic device may increase the number of cameras enabled among the plurality of cameras in response to a specified first input, such as a first input received before a second input for adjusting the magnification. The camera additionally enabled in response to the first input may be used to display a preview image by adjusting the magnification according to the second input. For example, when the magnification adjusted by the second input enters a magnification range corresponding to the additionally enabled camera, the electronic device may display a preview image using an image being acquired from the additionally enabled camera. In response to recognizing an interruption of the second input, the electronic device may reduce the number of enabled cameras. For example, the electronic device may disable the remaining cameras among the plurality of cameras except for the camera used to display the preview image.
[0161] According to various embodiments, the electronic device may include: a display, multiple cameras, a memory storing instructions, and at least one processor operably coupled to the display, the multiple cameras, and the memory. When the at least one processor executes the instructions, based on at least a portion of an image being acquired from a first camera among the multiple cameras, a preview image is displayed in the display; in a state where the preview image is displayed, a first input is received before a second input for adjusting the magnification of the preview image; in response to the reception of the first input, a second camera among the multiple cameras is enabled; in a state where another image different from the image is acquired using the enabled second camera, a second input for adjusting the magnification of the preview image is received; and based at least in part on the reception of the second input, the preview image is displayed based on at least a portion of the other image.
[0162] In an electronic device according to one embodiment, it may be that, when executing instructions, at least one processor; in response to a first input, enables a second camera having a magnification range different from a specified first magnification range associated with the first camera; in response to recognizing that the magnification of the preview image enters the magnification range of the second camera according to the second input, changes the image used to display the preview image from an image being acquired from the first camera to another image being acquired from the second camera.
[0163] In an electronic device according to an embodiment, at least one processor may interrupt displaying the preview image based at least in part on receipt of a second input when executing instructions, wherein displaying the preview image is based on at least a portion of an image being acquired from the first camera.
[0164] In the electronic device according to one embodiment, when executing the instructions, at least one processor may keep acquiring the image from the first camera in a state where a preview image is displayed based on at least a portion of another image.
[0165] In an electronic device according to one embodiment, it may be that, when executing instructions, at least one processor enables the second camera in response to receiving a first input including a gesture of touching at least two locations in a display; and adjusts the magnification of the preview image according to the distance between the at least two locations based at least in part on the receipt of a second input including a gesture of adjusting the distance between the at least two locations in the display.
[0166] In an electronic device according to one embodiment, it may be that, when executing instructions, at least one processor changes the image used to display the preview image from an image being acquired from a first camera to another image being acquired from a second camera based on a moving distance or a moving speed between at least two positions in a display.
[0167] In an electronic device according to one embodiment, it may be that, when executing instructions, at least one processor, in response to receiving a first input for displaying a user interface (UI) for adjusting the magnification, displays the user interface in the display, and while the user interface is displayed, receives a second input based on a position of a touch on a portion of the display where the user interface is displayed.
[0168] In an electronic device according to one embodiment, it may be that, when executing instructions, at least one processor changes the image used to display the preview image from the image being acquired from the first camera to another image being acquired from the second camera in response to receiving a second input of a touch gesture included in a designated area of the user interface, or a drag gesture interrupted within the designated area.
[0169] In the electronic device according to one embodiment, when executing instructions, at least one processor may recognize interruption of the second input while displaying a preview image based on at least a portion of another image; and in response to recognizing the interruption of the second input, disable the first camera.
[0170] In the electronic device according to an embodiment, when executing the instructions, the at least one processor may store the image being acquired from the first camera in the memory in response to recognizing an interrupt of the second input.
[0171] In the electronic device according to one embodiment, when executing instructions, at least one processor may store the image being acquired from the first camera and another image being acquired from the enabled second camera in at least one memory-based buffer in response to the second camera being enabled.
[0172] According to various embodiments, a method for an electronic device may include: an operation of displaying a preview image in a display of the electronic device based on at least a portion of an image being acquired from a first camera among multiple cameras; an operation of receiving a first input in a state in which the preview image is displayed, the first input being received before a second input for adjusting the magnification of the preview image; an operation of enabling a second camera among the multiple cameras in response to the reception of the first input; an operation of receiving a second input for adjusting the magnification of the preview image in a state in which another image different from the image is acquired using the enabled second camera; and an operation of displaying the preview image based on at least a portion of another image based at least in part on the reception of the second input.
[0173] According to one embodiment, the operation of enabling the second camera includes: in response to receiving a first input, enabling the operation of the second camera having a magnification range different from that of the first camera; the operation of displaying a preview image based on at least a portion of another image includes: in response to recognizing that the magnification of the preview image enters the magnification range of the second camera according to the second input, changing the image used to display the preview image from the image being acquired from the first camera to another image being acquired from the second camera.
[0174] According to one embodiment, the operation of displaying the preview image based on a portion of another image may include: interrupting the operation of displaying the preview image based on at least a portion of the image being acquired from the first camera.
[0175] According to one embodiment, the operation of displaying the preview image based on at least a portion of another image may include: maintaining the operation of acquiring the image from the first camera.
[0176] According to one embodiment, the operation of receiving a first input may include: the operation of receiving the first input, the first input including a gesture of contacting at least two positions in the display; the operation of receiving a second input may include: the operation of receiving a second input, the second input including a gesture of adjusting the distance between at least two positions.
[0177] According to one embodiment, the operation of displaying a preview image based on at least a portion of another image may include: based on a moving distance or a moving speed between at least two positions in the display, changing the image used to display the preview image from an image being acquired from a first camera to another image being acquired from a second camera.
[0178] According to one embodiment, the method of the electronic device also includes: in response to receiving a first input for displaying a user interface for adjusting the magnification, an operation of displaying the user interface in a display; an operation of receiving a second input includes an operation of receiving the second input while the user interface is displayed, the second input being based on a position of contact within a portion of the display where the user interface is displayed.
[0179] According to one embodiment, the operation of displaying a preview image based on at least a portion of another image may include: in response to receiving a second input including a touch gesture within a designated area of the user interface or a drag gesture interrupted within the designated area, changing the image used to display the preview image from an image being acquired from a first camera to another image being acquired from a second camera.
[0180] The method of the electronic device according to one embodiment may further include: in a state where a preview image is displayed based on at least a portion of another image, in response to an interruption of recognizing the second input; and in response to the interruption of recognizing the second input, an operation of disabling the first camera.
[0181] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.
[0182] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. One or more programs stored in the computer-readable storage medium are configured to be run by one or more programs in an electronic device. One or more programs include instructions for causing the electronic device to run the method according to the embodiment described in the claims or specification of the present disclosure.
[0183] Such a program (software module, software) may be stored in a random access memory, a non-volatile memory including a flash memory, a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic disk storage device, a compact disk read-only memory (CD-ROM), a digital versatile disk (DVD) or other forms of optical storage devices, or a cassette tape. Alternatively, it may be stored in a memory composed of a combination of part or all of them. In addition, each constituent memory may include a plurality of them.
[0184] In addition, the program may be stored in an attachable storage device that is accessible through a communication network such as the Internet, an Intranet, a Local Area Network (LAN), a Wide Area Network (WLAN), or a Storage Area Network (SAN), or a communication network composed of a combination thereof. Such a storage device may be connected to the apparatus for executing the embodiments of the present disclosure through an external interface. In addition, a separate storage device on the communication network may also be connected to the apparatus for executing the embodiments of the present disclosure.
[0185] In the specific embodiments of the present disclosure described above, the components included in the disclosure are expressed in the singular or plural according to the specific embodiments proposed. However, for the convenience of explanation, the singular or plural is selected to suit the situation proposed, and the present disclosure is not limited to singular or plural components, even if the components are expressed in the plural, they can be constituted in the singular, or even if the components are expressed in the singular, they can be constituted in the plural.
[0186] On the other hand, the specific embodiments of the present disclosure are described with respect to specific embodiments, but it is obvious that various modifications can be made within the limits of the scope of the present disclosure. Therefore, the scope of the present disclosure is not limited to the described embodiments, and the scope of the claims should be determined by the scope equivalent to the claims.
Claims
1. An electronic device, comprising: monitor; Multiple cameras; a memory storing instructions; as well as at least one processor operably coupled to the display, the plurality of cameras, and the memory, The instructions can be executed by the at least one processor to cause the electronic device to: displaying a preview image on the display based on using at least a portion of an image acquired from a first camera among the plurality of cameras; while the preview image acquired by the first camera is displayed, identifying a first movement of a visual object included in the preview image; In response to identifying the first movement, enabling a second camera among the plurality of cameras; while acquiring another image different from the image using the second camera, recognizing a second movement of the visual object for adjusting a magnification of the preview image; in response to identifying the second movement, displaying the preview image based on at least a portion of the other image; The first movement is different from the second movement, and the first movement and the second movement are predetermined movements.
2. The electronic device according to claim 1, wherein: The second camera includes a magnification range that is at least partially different from the magnification range of the first camera, and The instructions can also be executed by the at least one processor to cause the electronic device to: In response to recognizing that the magnification of the preview image is within the magnification range of the second camera after the second movement adjustment, the preview image is changed from being acquired by the first camera to being acquired by the second camera.
3. The electronic device according to claim 1, wherein: The instructions are also executable by the at least one processor to cause the electronic device to: Based on at least a portion of the image acquired using the first camera and based at least in part on receiving the second movement, display of the preview image is interrupted.
4. The electronic device according to claim 1, wherein: The instructions are also executable by the at least one processor to cause the electronic device to: While displaying the preview image based on at least a portion of the other image acquired by the second camera, acquisition of the image by the first camera is maintained while the preview image is displayed.
5. The electronic device according to claim 1, wherein: The instructions are also executable by the at least one processor to cause the electronic device to: In response to detecting an interruption of the second movement, the first camera is disabled.
6. The electronic device according to claim 5, wherein: The instructions are also executable by the at least one processor to cause the electronic device to: In response to interruption of the second movement, the image is deleted from the memory.
7. The electronic device according to claim 1, wherein: The instructions are also executable by the at least one processor to cause the electronic device to: In response to enabling of the second camera, the image and the another image are stored in at least one buffer in the memory.
8. The electronic device according to claim 1, wherein: The second camera is enabled before any movement of the visual object is detected for adjusting the magnification of the preview image.
9. The electronic device according to claim 1, wherein: The instructions are also executable by the at least one processor to cause the electronic device to: while the preview image acquired by the first camera is displayed, recognizing a voice signal of the first user; In response to recognizing a voice signal of the first user, enabling the second camera among the plurality of cameras; while acquiring the other image different from the image using the second camera, recognizing a voice signal of a second user for adjusting a magnification of the preview image; In response to recognizing a voice signal of the second user, displaying the preview image based on at least a portion of the other image; The voice signal of the first user is different from the voice signal of the second user, and the voice signal of the first user and the voice signal of the second user are predetermined voice signals.
10. The electronic device according to claim 1, wherein: The first movement includes an action of opening the palm of the visual object, and the second movement includes an action of palm up or down.
11. The electronic device according to claim 1, wherein: The instructions are also executable by the at least one processor to cause the electronic device to: A user interface for adjusting the magnification is displayed on a portion of the display, wherein the user interface includes a plurality of marks of a scale indicating the magnification, or at least one text box adjacent to the preview image and displaying magnification and / or scaling information.
12. A method of an electronic device, the method comprising: displaying a preview image on a display of the electronic device based on using at least a portion of an image acquired from a first camera among a plurality of cameras of the electronic device; while the preview image acquired by the first camera is displayed, identifying a first movement of a visual object included in the preview image; In response to identifying the first movement, enabling a second camera among the plurality of cameras; while acquiring another image different from the image using the second camera, recognizing a second movement of the visual object for adjusting a magnification of the preview image; in response to identifying the second movement, displaying the preview image based on at least a portion of the other image; The first movement is different from the second movement, and the first movement and the second movement are predetermined movements.
13. The method according to claim 12, wherein: The second camera includes a magnification range that is at least partially different from the magnification range of the first camera, and the method further includes: In response to recognizing that the magnification of the preview image is within the magnification range of the second camera after the second movement adjustment, the preview image is changed from being acquired by the first camera to being acquired by the second camera.
14. The method according to claim 12, further comprising: Based on at least a portion of the image acquired using the first camera and based at least in part on receiving the second movement, display of the preview image is interrupted.
15. The method according to claim 12, further comprising: While displaying the preview image based on at least a portion of the other image acquired by the second camera, acquisition of the image by the first camera is maintained while the preview image is displayed.
16. The method according to claim 12, further comprising: In response to detecting an interruption of the second movement, the first camera is disabled.
17. The method according to claim 16, further comprising: In response to the interruption of the second movement, the image is deleted from a memory of the electronic device.
18. The method according to claim 12, further comprising: In response to activation of the second camera, the image and the other image are stored in at least one buffer of a memory of the electronic device.
19. The method according to claim 12, wherein: The second camera is enabled before any movement of the visual object is detected for adjusting the magnification of the preview image.
20. The method according to claim 12, further comprising: while the preview image acquired by the first camera is displayed, recognizing a voice signal of the first user; In response to recognizing a voice signal of the first user, enabling the second camera among the plurality of cameras; while acquiring the other image different from the image using the second camera, recognizing a voice signal of a second user for adjusting a magnification of the preview image; In response to recognizing a voice signal of the second user, displaying the preview image based on at least a portion of the other image; The voice signal of the first user is different from the voice signal of the second user, and the voice signal of the first user and the voice signal of the second user are predetermined voice signals.