Electronic device including camera module and method operating the electronic device

Abstract

In an electronic device according to one embodiment of the present document, the electronic device comprises: a first camera module including a first lens module and having a first angle of view; a second camera module including a second lens module and having a second angle of view; a first OIS driving module that moves the first lens module within a first OIS driving range; a second OIS driving module that moves the second lens module within a second OIS driving range; a processor electrically connected to the first camera module, the second camera module, the first OIS driving module, and the second OIS driving module; wherein, when a camera application is executed, the processor detects an event in which the first camera module is activated as a main camera, the center of the first lens module is positioned at a first point by controlling the first OIS driving module, the center of the second lens module is positioned at a point on a first axis passing through the first point, and the second camera module is set as a main camera, and in response to the detection of the event, the second camera module is activated as the main camera, and the second By controlling the OIS driving module, the center of the second lens module can be moved to a second point, and by controlling the first OIS driving module, the center of the first lens module can be moved to a point on a second axis that is parallel to the first axis and passes through the second point. According to various embodiments of this document, assembly deviations between camera modules and / or misalignment of the lens modules due to OIS performance can be resolved. Additionally, the OIS driving range can be stably secured when performing OIS during camera switching, magnification changes, and when shake is detected.

Description

Technology Field

[0001] Various embodiments of this document relate to a technology that can secure a stable OIS driving range during camera switching in an electronic device including a camera module. Background Technology

[0002] Various technologies are being developed to acquire high-quality images when acquiring images using cameras of electronic devices. For example, improved images can be obtained by applying technologies such as zoom, AF (auto focusing), AE (auto exposure), AWB (auto white balance), and OIS (optical image stabilization) to electronic devices.

[0003] The electronic device may include multiple cameras having different viewing angles, and can acquire images corresponding to various fields of view by switching between the cameras.

[0004] The electronic device can simultaneously perform OIS to stabilize images acquired while performing operations such as zoom, AF, AE, AWB, and camera switching. The problem to be solved

[0005] According to the prior art, when arranging multiple camera modules in an electronic device, assembly deviations between the multiple camera modules can cause unnecessary time differences between lens modules.

[0006] According to the prior art, when an electronic device performs OIS, the OIS driving range may be reduced during camera switching due to deviation occurring at the center of the lens modules. means of solving the problem

[0007] In an electronic device according to one embodiment of the present document, the electronic device comprises: a first camera module including a first lens module and having a first angle of view; a second camera module including a second lens module and having a second angle of view; a first OIS driving module that moves the first lens module within a first OIS driving range; a second OIS driving module that moves the second lens module within a second OIS driving range; a processor electrically connected to the first camera module, the second camera module, the first OIS driving module, and the second OIS driving module; wherein, when a camera application is executed, the processor detects an event in which the first camera module is activated as a main camera, the center of the first lens module is positioned at a first point by controlling the first OIS driving module, the center of the second lens module is positioned at a point on a first axis passing through the first point, and the second camera module is set as a main camera, and in response to the detection of the event, the second camera module is activated as the main camera, and the second By controlling the OIS driving module, the center of the second lens module can be moved to a second point, and by controlling the first OIS driving module, the center of the first lens module can be moved to a point on a second axis that is parallel to the first axis and passes through the second point.

[0008] In a method of operation of an electronic device according to one embodiment of the present document, the method of operation may include: an operation of activating a first camera module as a main camera when a camera application is executed; an operation of controlling a first OIS driving module to position the center of a first lens module at a first point; an operation of controlling a second OIS driving module to position the center of a second lens module at a point on a first axis passing through the first point; an operation of detecting an event to set the second camera module as a main camera; an operation of activating the second camera module as the main camera in response to the detection of the event; an operation of controlling the second OIS driving module to move the center of the second lens module to a second point; and an operation of controlling the first OIS driving module to move the center of the first lens module to a point on a second axis parallel to the first axis and passing through the second point. Effects of the invention

[0009] According to various embodiments of this document, assembly deviations between camera modules and / or the misalignment of the lens modules due to OIS performance can be resolved.

[0010] According to various embodiments of this document, the OIS driving range can be reliably secured when performing OIS while camera switching, magnification changing, and shaking are detected.

[0011] The effects obtainable based on various embodiments are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this disclosure pertains from the description below. Brief explanation of the drawing

[0012] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment. FIG. 2 is a block diagram illustrating a camera module according to one embodiment. FIG. 3 is a schematic diagram briefly showing the configuration of an electronic device according to one embodiment. FIG. 4 is a diagram of the alignment state of lens modules that may occur when performing OIS of an electronic device according to one embodiment. FIG. 5 is a flowchart illustrating the flow of aligning the centers of lens modules when an electronic device switches cameras, according to one embodiment. FIG. 6 is a diagram showing the state in which the centers of the lens modules are aligned when the electronic device switches cameras, according to one embodiment. FIG. 7 is a graph showing the flow of aligning the centers of lens modules when an electronic device switches cameras, according to one embodiment. FIG. 8 is a graph showing the flow of aligning the centers of lens modules when an electronic device switches cameras, according to one embodiment. FIG. 9 is a flowchart showing a flow for securing an OIS driving range when an electronic device detects shaking, according to one embodiment. FIG. 10 is a graph showing the flow of securing the OIS driving range when an electronic device detects shaking according to one embodiment. FIG. 11 is a flowchart illustrating a flow for securing an OIS driving range when an electronic device detects an input (e.g., touch input) according to one embodiment. FIG. 12 is a graph showing a flow for securing an OIS driving range when an electronic device detects an input (e.g., touch input) according to one embodiment. Specific details for implementing the invention

[0013] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0014] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0015] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0016] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0017] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0018] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0019] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0020] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0021] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0022] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0023] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0024] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0025] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0026] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0027] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0028] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0029] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0030] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0031] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0032] An antenna module (197) can transmit a signal or power to an external source (e.g., an external electronic device) or receive it from an external source. According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0033] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0034] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0035] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0036] FIG. 2 is a block diagram (200) illustrating a camera module (180) according to one embodiment.

[0037] Referring to FIG. 2, the camera module (180) may include a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250) (e.g., a buffer memory), or an image signal processor (260). The lens assembly (210) may collect light emitted from a subject that is the target of image capture. The lens assembly (210) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (210). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (210) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from the lens properties of other lens assemblies. The lens assemblies (210) may include, for example, a wide-angle lens or a telephoto lens.

[0038] A flash (220) may emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (220) may include one or more light-emitting diodes (e.g., RGB (red-green-blue) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. An image sensor (230) may acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through a lens assembly (210) into an electrical signal. According to one embodiment, the image sensor (230) may include, for example, one image sensor selected from image sensors with different properties such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (230) can be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0039] The image stabilizer (240) may move at least one lens or image sensor (230) included in the lens assembly (210) in a specific direction or control the operational characteristics of the image sensor (230) (e.g., adjusting read-out timing) in response to the movement of the camera module (180) or the electronic device (101) containing it. This allows for compensating for at least some of the negative effects caused by the movement on the image being captured. According to one embodiment, the image stabilizer (240) may detect such movement of the camera module (180) or the electronic device (101) using a gyroscope sensor (not shown) or an accelerometer sensor (not shown) placed inside or outside the camera module (180). According to one embodiment, the image stabilizer (240) may be implemented, for example, as an optical image stabilizer. The memory (250) may temporarily store at least a portion of the image acquired through the image sensor (230) for the next image processing operation. For example, if image acquisition by the shutter is delayed or multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in the memory (250), and the corresponding copy image (e.g., a low-resolution image) can be previewed through the display device (160). Subsequently, when a specified condition is satisfied (e.g., user input or system command), at least a portion of the original image stored in the memory (250) may be acquired and processed, for example, by an image signal processor (260). According to one embodiment, the memory (250) may be configured as at least a portion of the memory (130) or as a separate memory that operates independently thereof.

[0040] The image signal processor (260) can perform one or more image processing operations on an image obtained through the image sensor (230) or an image stored in memory (250). The above one or more image processing methods may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softing). Additionally or generally, the image signal processor (260) may perform control (e.g., exposure time control, or readout timing control, etc.) over at least one of the components included in the camera module (180) (e.g., image sensor (230)). The image processed by the image signal processor (260) may be stored back in memory (250) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display device (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (260) may be composed of at least a part of the processor (120), or It may be configured as a separate processor that operates independently of the processor (120). If the image signal processor (260) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (260) may be displayed through the display device (160) as is or after additional image processing by the processor (120).

[0041] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180) each having different attributes or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera and at least another may be a rear camera.

[0042] FIG. 3 is a schematic diagram briefly showing the configuration of an electronic device according to one embodiment.

[0043] According to one embodiment, the electronic device (101) may include at least a camera module (180) and a processor (320).

[0044] In one embodiment, the camera module (180) may include a plurality of camera modules. For example, the camera module (180) may include a first camera module (301) having a first angle of view, a second camera module (302) having a second angle of view, and / or a third camera module (303) having a third angle of view.

[0045] In one embodiment, the first camera module (301) may include a first lens module (306) and a first OIS driving module (311). For example, the first lens module (306) may include at least one lens, and the first OIS driving module (311) may perform OIS by controlling the movement of the first lens module (306) under the control of a processor (320) and / or an OIS control module (330).

[0046] In one embodiment, the second camera module (302) may include a second lens module (307) and a second OIS driving module (312). For example, the second lens module (307) may include at least one lens, and the second OIS driving module (312) may perform OIS by controlling the movement of the second lens module (307) under the control of a processor (320) and / or an OIS control module (330).

[0047] In one embodiment, the third camera module (303) may include a third lens module (308) and a third OIS driving module (313). For example, the third lens module (308) may include at least one lens, and the third OIS driving module (313) may perform OIS by controlling the movement of the third lens module (308) under the control of the processor (320) and / or the OIS control module (330).

[0048] In one embodiment, the processor (320) can control the operations of the camera module (180) and the components included in the camera module (180) (e.g., first camera module (301), second camera module (302), third camera module (303), first OIS driving module (311), second OIS driving module (312), and third OIS driving module (313)).

[0049] In one embodiment, the processor (320) may control the operations of the components included in the camera module (180) (e.g., first camera module (301), second camera module (302), third camera module (303), first OIS driving module (311), second OIS driving module (312), and third OIS driving module (313)) through the OIS control module (330).

[0050] In one embodiment, the processor (320) can control the operations of the OIS control module (330), sensor module (340), memory (350), and display (360) described below.

[0051] According to one embodiment, the electronic device (101) may further include an OIS control module (330), a sensor module (340), a memory (350), and a display (360).

[0052] In one embodiment, the OIS control module (330) can control the movement of each of the first lens module (306), the second lens module (307), and the third lens module (308) by controlling each of the first OIS driving module (311), the second OIS driving module (312), and / or the third OIS driving module (313).

[0053] In one embodiment, the sensor module (340) may include a gyroscope sensor, an accelerometer sensor and / or an attitude sensing sensor. The sensor module (340) may at least detect shaking of the electronic device (101) or an external force applied to the electronic device (101) (e.g., touch input).

[0054] In one embodiment, the memory (350) can store OIS information performed by the electronic device (101) (e.g., information regarding the position of the lens module, the axis on which the center of the lens module is placed, the movement of the lens module, and the OIS driving range), and information detected through the sensor module (340) (e.g., information regarding shaking and external forces).

[0055] In one embodiment, the display (360) can display an image acquired by the electronic device (101) through a camera module (e.g., camera module (180)). Additionally, the display (360) can acquire user input (e.g., touch input) and transmit it to the processor (320).

[0056] FIG. 4 is a diagram of the alignment state of lens modules that may occur when performing OIS of an electronic device according to one embodiment.

[0057] According to one embodiment, Figure 4-1 shows the alignment state of ideal lens modules (e.g., first lens module (306), second lens module (307), third lens module (308)) when an electronic device (e.g., electronic device (101)) performs OIS.

[0058] In one embodiment, ideally, the center of the first lens module (306), the center of the second lens module (307), and the center of the third lens module (308) can be arranged side by side on the central axis line.

[0059] According to one embodiment, Figure 4-2 shows the alignment state of possible lens modules (e.g., first lens module (306), second lens module (307), third lens module (308)) when an electronic device (e.g., electronic device (101)) performs OIS.

[0060] In one embodiment, during the process of placing the camera module (180) on the electronic device (101), a deviation may occur in the center of the lens module between the first camera module (301), the second camera module (302), and the third camera module (303). For example, the center of the first lens module (306), the center of the second lens module (307), and the center of the third lens module (308) may be located at points on the first axis, the second axis, and the third axis, respectively.

[0061] According to one embodiment, Figure 4-3 shows that if a deviation occurs in the center of the lens module between the first camera module (301), the second camera module (302), and the third camera module (303), the OIS driving range may be limited.

[0062] In one embodiment, referring to Figure 4-3, when the second camera module (302) is activated as the main camera, the OIS driving range may be reduced after performing OIS on the second lens module (307).

[0063] FIG. 5 is a flowchart illustrating the flow of aligning the centers of lens modules when an electronic device switches cameras, according to one embodiment.

[0064] In operation 510 according to one embodiment, an electronic device (e.g., electronic device (101)) can execute a camera application under the control of a processor (e.g., processor (320)).

[0065] In one embodiment, when the electronic device (101) detects an event to execute an application, it can execute a camera application under the control of the processor (320).

[0066] In operation 520 according to one embodiment, an electronic device (e.g., electronic device (101)) can activate one camera module (e.g., first camera module (301)) as a main camera under the control of a processor (e.g., processor (320)).

[0067] In one embodiment, when a camera application is executed, the electronic device (101) can activate one of a plurality of camera modules (e.g., a first camera module (301), a second camera module (302), a third camera module (303)) as a main camera under the control of the processor (320).

[0068] In operation 530 according to one embodiment, an electronic device (e.g., electronic device (101)) can position the center of a first lens module (e.g., first lens module (306)) at a first point under the control of a processor (e.g., processor (320)).

[0069] In one embodiment, the electronic device (101) can position the center of a lens module (e.g., a first lens module (306)) included in a camera module (e.g., a first camera module (301)) that is activated as a main camera at a first point under the control of the processor (320).

[0070] In one embodiment, the first point may be a point where the maximum OIS driving range of a camera module (e.g., the first camera module (301)) activated as a main camera can be secured. For example, the first point may be a position at the center of the first lens module (306) corresponding to the center of the first angle of view when acquiring an image through the first camera module (301). As another example, the first point may be a center point of the first OIS driving module (311) that physically implements the OIS of the first lens module (306).

[0071] In one embodiment, the electronic device (101) may identify a first point in advance under the control of the processor (320). For example, the electronic device (101) may identify the first point when a camera application is executed under the control of the processor (320), or may identify the first point when one camera is activated as a main camera.

[0072] In operation 540 according to one embodiment, an electronic device (e.g., electronic device (101)) can position the center of a second lens module (e.g., second lens module (307)) at a point on a first axis passing through a first point, under the control of a processor (e.g., processor (320)).

[0073] In one embodiment, the electronic device (101) can position the center of a lens module (e.g., a second lens module (307)) included in a camera module (e.g., a second camera module (302)) that is not activated as a main camera at a point on a first axis passing through a first point, under the control of a processor (320).

[0074] In one embodiment, the electronic device (101) can identify in advance a point on a first axis passing through a first point under the control of the processor (320). For example, the electronic device (101) may identify a point on a first axis passing through a first point when a camera application is executed under the control of the processor (320), or may identify a point on a first axis passing through a first point when one camera is activated as a main camera.

[0075] In operation 550 according to one embodiment, an electronic device (e.g., electronic device (101)) can detect an event in which a second camera module (e.g., second camera module (302)) is set as the main camera under the control of a processor (e.g., processor (320)).

[0076] In one embodiment, the electronic device (101) can detect an event that switches the main camera under the control of the processor (320). For example, the event that switches the main camera may be an input requesting a user to switch, or an automatic event that responds to a change in the viewing angle.

[0077] In operation 560 according to one embodiment, an electronic device (e.g., electronic device (101)) can activate a second camera module (e.g., second camera module (302)) as a main camera under the control of a processor (e.g., processor (320)).

[0078] In one embodiment, the electronic device (101) can activate another camera module (e.g., a second camera module (302)) as the main camera in response to the detection of an event that switches the main camera, under the control of the processor (320).

[0079] In operation 570 according to one embodiment, an electronic device (e.g., electronic device (101)) can move the center of a second lens module (e.g., second lens module (307)) to a second point under the control of a processor (e.g., processor (320)).

[0080] In one embodiment, the electronic device (101) can move the center of the lens module (307) included in the switched main camera (e.g., second camera module (302)) to a second point under the control of the processor (320).

[0081] In one embodiment, the second point may be a point where the OIS driving range of the camera module (e.g., the second camera module (302)) activated as the main camera can be maximized. For example, the second point may be a position at the center of the second lens module (307) corresponding to the center of the second angle of view when acquiring an image through the second camera module (302). As another example, the second point may be a center point of the second OIS driving module (312) that physically implements the OIS of the second lens module (307).

[0082] In one embodiment, the electronic device (101) may identify a second point in advance under the control of the processor (320). For example, the electronic device (101) may identify the second point when a camera application is executed under the control of the processor (320), may identify the second point when one camera (e.g., the first camera module (301)) is activated as the main camera, or may identify the second point in response to the detection of an event that switches the main camera to the second camera module (302).

[0083] In operation 580 according to one embodiment, an electronic device (e.g., electronic device (101)) can move the center of a first lens module (e.g., first lens module (306)) to a point on a second axis parallel to the first axis and passing through a second point, under the control of a processor (e.g., processor (320)).

[0084] In one embodiment, the electronic device (101) can move the center of the first lens module (306), which was located at a first point, to a point on a second axis that is parallel to the first axis and passes through an identified second point, under the control of the processor (320).

[0085] In one embodiment, the electronic device (101) may move the center of the first lens module (306) to a point on the second axis that is parallel to the first axis and passes through an identified second point, under the control of the processor (320), gradually over a certain period of time.

[0086] In one embodiment, the electronic device (101) can maintain the center of the first lens module (306) at the position of the first point during the switching in response to the detection of an event that switches the main camera to the second camera module (302) under the control of the processor (320).

[0087] In one embodiment, the electronic device (101) may, under the control of the processor (320), respond to the detection of an event that switches the main camera to the second camera module (302), and after the switch, move the center of the first lens module (306) to a point on the second axis that is parallel to the first axis and passes through the identified second point.

[0088] In one embodiment, the description of the operations of the electronic device (101) described above may not be limited to the first lens module (306) included in the first camera module (301) and the second lens module (307) included in the second camera module (302).

[0089] In one embodiment, the description of the operations of the electronic device (101) described above may also apply to the first lens module (306) included in the first camera module (301), the second lens module (307) included in the second camera module (302), and the third lens module (308) included in the third camera module (303). A detailed description thereof will be provided later with reference to FIG. 6.

[0090] FIG. 6 shows a state in which the centers of the lens modules are aligned when the electronic device switches cameras, according to one embodiment.

[0091] According to one embodiment, with reference to Drawing 6-1, when the first camera module (301) is activated as the main camera module, the electronic device (101) can move the centers of the second lens module (307) and the third lens module (308) along a first axis passing through a first point where the center of the first lens module (306) is located, under the control of the processor (320).

[0092] According to one embodiment, with reference to Drawing 6-2, when the second camera module (302) is activated as the main camera module, the electronic device (101) can move the centers of the first lens module (306) and the third lens module (308) along a second axis passing through a second point where the center of the second lens module (307) is located, under the control of the processor (320).

[0093] According to one embodiment, with reference to Drawing 6-3, when the third camera module (303) is activated as the main camera module, the electronic device (101) can position the centers of the first lens module (306) and the second lens module (307) on a third axis passing through a third point where the center of the third lens module (308) is located, under the control of the processor (320).

[0094] FIG. 7 is a graph showing the flow of aligning the centers of lens modules when an electronic device switches cameras, according to one embodiment.

[0095] According to one embodiment, Figure 7-1 shows the flow when the main camera is switched from a first camera module (e.g., first camera module (301)) having a first angle of view to a second camera module (e.g., second camera module (302)) having a second angle of view.

[0096] In one embodiment, the electronic device (101) may activate the first camera module (301) as a main camera under the control of the processor (320).

[0097] In one embodiment, the electronic device (101) can position the center of the first lens module (306) of the first camera module (301) at a first point under the control of the processor (320).

[0098] In one embodiment, the electronic device (101) can position the center of the second lens module (307) of the second camera module (302) at a point on a first axis passing through a first point, under the control of the processor (320).

[0099] In one embodiment, the electronic device (101) can switch the main camera to the second camera module (302) in response to the detection of the event when it detects an event to switch the main camera from the first camera module (301) to the second camera module (302) under the control of the processor (320).

[0100] In one embodiment, the electronic device (101) can maintain the center of the first lens module (306) included in the first camera module (301) at the position of the first point while switching the main camera to the second camera module (302) under the control of the processor (320).

[0101] In one embodiment, the electronic device (101), under the control of the processor (320), can gradually move the center of the first lens module (306) included in the first camera module (301) from the position of the first point to a position on the second axis passing through the second point over a certain period of time after switching the main camera to the second camera module (302).

[0102] According to one embodiment, Figure 7-2 shows the flow when the main camera is switched from a second camera module having a second angle of view (e.g., second camera module (302)) to a third camera module having a third angle of view (e.g., third camera module (303)).

[0103] In one embodiment, the electronic device (101) may activate the second camera module (301) as the main camera under the control of the processor (320).

[0104] In one embodiment, the electronic device (101) can position the center of the second lens module (307) of the second camera module (302) at a second point under the control of the processor (320).

[0105] In one embodiment, the electronic device (101) can position the center of the first lens module (306) of the first camera module (301) at a point on a second axis passing through a second point, under the control of the processor (320).

[0106] In one embodiment, the electronic device (101) can switch the main camera to the third camera module (303) in response to the detection of the event when it detects an event to switch the main camera from the second camera module (302) to the third camera module (303) under the control of the processor (320).

[0107] In one embodiment, the electronic device (101) can maintain the center of the second lens module (307) included in the second camera module (302) at the position of the second point while switching the main camera to the third camera module (303) under the control of the processor (320).

[0108] In one embodiment, the electronic device (101), under the control of the processor (320), can gradually move the center of the second lens module (307) included in the second camera module (302) from the position of the second point to a position on the third axis passing through the third point over a certain period of time after switching the main camera to the third camera module (303).

[0109] According to one embodiment, Figure 7-3 shows the flow when the main camera is switched from a third camera module having a third angle of view (e.g., third camera module (303)) to a second camera module having a second angle of view (e.g., second camera module (302)).

[0110] In one embodiment, the electronic device (101) may activate the third camera module (301) as the main camera under the control of the processor (320).

[0111] In one embodiment, the electronic device (101) can position the center of the third lens module (308) of the third camera module (303) at a third point under the control of the processor (320).

[0112] In one embodiment, the electronic device (101) can position the center of the second lens module (307) of the second camera module (302) on a third axis passing through a third point, under the control of the processor (320).

[0113] In one embodiment, the electronic device (101) can switch the main camera to the second camera module (302) in response to the detection of the event when it detects an event of switching the main camera from the third camera module (303) to the second camera module (302) under the control of the processor (320).

[0114] In one embodiment, the electronic device (101) can maintain the center of the third lens module (308) included in the third camera module (303) at the position of the third point while switching the main camera to the second camera module (302) under the control of the processor (320).

[0115] In one embodiment, the electronic device (101), under the control of the processor (320), can gradually move the center of the third lens module (308) included in the third camera module (303) from the position of the third point to a position on the second axis passing through the second point over a certain period of time after switching the main camera to the second camera module (302).

[0116] The above-described embodiments are not limited to Figures 7-1 to 7-3, and there may be other embodiments when switching cameras.

[0117] FIG. 8 is a graph showing the flow of aligning the centers of lens modules when an electronic device switches cameras, according to one embodiment.

[0118] According to one embodiment, Figure 8-1 shows the flow when the main camera is switched from a first camera module (e.g., first camera module (301)) having a first angle of view to a third camera module (e.g., third camera module (303)) having a third angle of view.

[0119] In one embodiment, the electronic device (101) can activate the first camera module (301) as a main camera under the control of the processor (320).

[0120] In one embodiment, the electronic device (101) can position the center of the first lens module (306) included in the first camera module (301) at a first point under the control of the processor (320).

[0121] In one embodiment, the electronic device (101) can position the center of the second lens module (307) included in the second camera module (302) and the center of the third lens module (308) included in the third camera module (303) on a first axis passing through a first point, under the control of the processor (320).

[0122] In one embodiment, the electronic device (101) can activate the third camera module (303) as the main camera when it detects an event to switch the main camera to the third camera module (303) under the control of the processor (320).

[0123] In one embodiment, the electronic device (101) can move the center of the third lens module (308) of the third camera module (303) to a third point under the control of the processor (320).

[0124] In one embodiment, the electronic device (101) can maintain the center of the first lens module (306) included in the first camera module (301) and the center of the second lens module (307) included in the second camera module (302) at a position on a first axis passing through a first point while switching the main camera to the third camera module (303) under the control of the processor (320).

[0125] In one embodiment, the electronic device (101), under the control of the processor (320), can gradually move the center of the third lens module (308) included in the third camera module (303) from a position on a first axis passing through a first point to a position on a third axis passing through a third point over a certain period of time after switching the main camera to the second camera module (302).

[0126] According to one embodiment, Figure 8-2 shows the flow when the main camera is switched from a third camera module having a third angle of view (e.g., third camera module (303)) to a first camera module having a first angle of view (e.g., first camera module (301)).

[0127] In one embodiment, the electronic device (101) can activate the third camera module (303) as the main camera under the control of the processor (320).

[0128] In one embodiment, the electronic device (101) can position the center of the third lens module (308) included in the third camera module (303) at a third point under the control of the processor (320).

[0129] In one embodiment, the electronic device (101) can position the center of the first lens module (306) included in the first camera module (301) and the center of the second lens module (307) included in the second camera module (302) on a third axis passing through a third point, under the control of the processor (320).

[0130] In one embodiment, the electronic device (101) can activate the first camera module (301) as the main camera when it detects an event to switch the main camera to the first camera module (301) under the control of the processor (320).

[0131] In one embodiment, the electronic device (101) can move the center of the first lens module (306) of the first camera module (301) to a first point under the control of the processor (320).

[0132] In one embodiment, the electronic device (101) can maintain the center of the second lens module (307) included in the second camera module (302) and the center of the third lens module (308) included in the third camera module (303) at a position on a third axis passing through a third point while switching the main camera to the first camera module (301) under the control of the processor (320).

[0133] In one embodiment, the electronic device (101), under the control of the processor (320), can gradually move the center of the second lens module (307) included in the second camera module (302) and the center of the third lens module (308) included in the third camera module (303) from a position on a third axis passing through a third point to a position on a first axis passing through a first point over a certain period of time after switching the main camera to the first camera module (301).

[0134] FIG. 9 is a flowchart showing a flow for securing an OIS driving range when an electronic device detects shaking, according to one embodiment.

[0135] In operation 910 according to one embodiment, an electronic device (e.g., electronic device (101)) can detect shaking of the electronic device (e.g., electronic device (101)) under the control of a processor (e.g., processor (320)).

[0136] In one embodiment, the electronic device (101) can detect shaking of the electronic device (101) based on the sensor module (340) under the control of the processor (320).

[0137] In operation 920 according to one embodiment, an electronic device (e.g., electronic device (101)) can perform OIS in a way that suppresses shaking under the control of a processor (e.g., processor (320)).

[0138] In one embodiment, the electronic device (101) may perform OIS in a direction that suppresses (or absorbs) shaking by controlling OIS driving modules (e.g., first OIS driving module (311), second OIS driving module (312), third OIS driving module (313)) under the control of the processor (320) to suppress shaking of the lens modules (e.g., first lens module (306), second lens module (307), third lens module (308)).

[0139] In operation 930 according to one embodiment, an electronic device (e.g., electronic device (101)) can gradually secure an OIS driving range under the control of a processor (e.g., processor (320)).

[0140] In one embodiment, the electronic device (101) can identify the center position of the lens modules (e.g., first lens module (306), second lens module (307), third lens module (308)) after performing OIS according to operation 920 under the control of the processor (320).

[0141] In one embodiment, the electronic device (101) identifies the center position of the lens modules (e.g., first lens module (306), second lens module (307), third lens module (308)) under the control of the processor (320), and can maintain the identified position when the distance from the center of the lens module (e.g., first lens module (306), second lens module (307), third lens module (308)) included in the camera module (e.g., first camera module (301), second camera module (302), third camera module (303)) activated as the main camera is reduced.

[0142] In one embodiment, when the electronic device (101) detects an event of switching the main camera under the control of the processor (320), it can secure an OIS driving range by gradually moving from a maintained identification position to a point on an axis passing through the center of the lens module (e.g., first lens module (306), second lens module (307), third lens module (308)) included in the camera module (e.g., first camera module (301), second camera module (302), third camera module (303)) activated as the main camera.

[0143] FIG. 10 is a graph showing the flow of securing the OIS driving range when an electronic device detects shaking according to one embodiment.

[0144] According to one embodiment, Drawings 10-1 to 10-4 show the flow when the electronic device (101) detects shaking while the main camera is being switched.

[0145] In one embodiment, referring to Figure 10-1, when the main camera switches from the first camera module (301) to the third camera module (303), the electronic device (101) can detect shaking under the control of the processor (320).

[0146] In one embodiment, the electronic device (101) can perform OIS in a direction that suppresses (or absorbs) shaking with respect to the first lens module (306) of the first camera module (301) and / or the second lens module (307) of the second camera module (302), under the control of the processor (320).

[0147] In one embodiment, the electronic device (101) can maintain the position of the center of the first lens module (306) of the first camera module (301) and / or the second lens module (307) of the second camera module (302) that has been moved by performing OIS in a direction that suppresses (or absorbs) shaking when the distance from a point on a third axis passing through the center (e.g., a third point) of the third lens module (308) included in the third camera module (303) activated as a main camera is reduced, under the control of the processor (320).

[0148] In one embodiment, the electronic device (101) can secure an OIS driving range by gradually moving the center of the first lens module (306) and / or the center of the second lens module (307) from a maintained center position to a point on a third axis passing through the center (e.g., a third point) of the third lens module (308) included in the third camera module (303) activated as the main camera, under the control of the processor (320).

[0149] In one embodiment, referring to Figure 10-2, when the main camera switches from the third camera module (303) to the first camera module (301), the electronic device (101) can detect shaking under the control of the processor (320).

[0150] In one embodiment, the electronic device (101) can perform OIS in a way that suppresses (or absorbs) shaking with respect to the second lens module (307) of the second camera module (302) and / or the third lens module (308) of the third camera module (303), under the control of the processor (320).

[0151] In one embodiment, the electronic device (101) can maintain the position of the center of the second lens module (307) of the second camera module (302) and / or the third lens module (308) of the third camera module (303) that has been moved by performing OIS in a direction that suppresses (or absorbs) shaking when the distance from a point on a first axis passing through the center (e.g., a first point) of the first lens module (306) included in the first camera module (301) activated as a main camera is reduced, under the control of the processor (320).

[0152] In one embodiment, the electronic device (101) can secure an OIS driving range by gradually moving the center of the second lens module (307) and / or the center of the third lens module (308) from a maintained center position to a point on a first axis passing through the center (e.g., a first point) of the first lens module (306) included in the first camera module (301) activated as the main camera, under the control of the processor (320).

[0153] In one embodiment, FIG. 10-3 is a graph showing the flow when shaking of the electronic device (101) is detected while switching the main camera from the second camera module (302) to the third camera module (303), and FIG. 10-4 is a graph showing the flow when shaking of the electronic device (101) is detected while switching the main camera from the third camera module (303) to the second camera module (302). In the flow of FIG. 10-3 to FIG. 10-4 according to one embodiment, the same or similar description as the description of the operations of FIG. 10-1 to FIG. 10-2 may be applied.

[0154] FIG. 11 is a flowchart illustrating a flow for securing an OIS driving range when an electronic device detects an input (e.g., touch input) according to one embodiment.

[0155] In operation 1110 according to one embodiment, an electronic device (e.g., electronic device (101)) can detect an input (e.g., touch input) through a display (e.g., display (160)) under the control of a processor (e.g., processor (320)).

[0156] In one embodiment, the electronic device (101) can detect user input (e.g., touch input) through the display (160) under the control of the processor (320). The touch input may be an input to switch the main camera, or an input to touch a user interface such as an icon displayed on the display (160).

[0157] In operation 1120 according to one embodiment, an electronic device (e.g., electronic device (101)) can identify the intensity of an input under the control of a processor (e.g., processor (320)).

[0158] In one embodiment, the electronic device (101) can identify the intensity of a user input (e.g., touch input) detected through a display (160) under the control of a processor (320). For example, the electronic device (101) can determine that the input is a strong input if the intensity is above a threshold value, and can determine that the input is a weak input if the intensity is below a threshold value.

[0159] In one embodiment, the electronic device (101) may not perform OIS or maintain the center of the lens modules when it determines, under the control of the processor (320), that the input intensity is a weak input below a threshold value.

[0160] In operation 1130 according to one embodiment, an electronic device (e.g., electronic device (101)) can perform OIS in a way that suppresses shaking when the intensity of the input is greater than a threshold value, under the control of a processor (e.g., processor (320)).

[0161] In one embodiment, the electronic device (101) can perform OIS in a way that suppresses shaking of the electronic device (101) due to the input when it is determined that the intensity of the input is a strong input greater than or equal to a threshold value, under the control of the processor (320).

[0162] In operation 1140 according to one embodiment, an electronic device (e.g., electronic device (101)) can gradually secure an OIS driving range under the control of a processor (e.g., processor (320)).

[0163] In one embodiment, the electronic device (101) can maintain the position of the center of the lens module of another camera module that has been moved by performing OIS in a direction that suppresses (or absorbs) shaking when the distance from a point on an axis passing through the center of the lens module included in the camera module activated as the main camera is reduced, under the control of the processor (320).

[0164] In one embodiment, the electronic device (101) can secure an OIS driving range by gradually moving the center of another lens module from a maintained center position to a point on an axis passing through the center of a lens module included in a camera module activated as a main camera, under the control of a processor (320).

[0165] FIG. 12 is a graph showing a flow for securing an OIS driving range when an electronic device detects an input (e.g., touch input) according to one embodiment.

[0166] According to one embodiment, Figure 12-1 is a graph showing a state in which the electronic device (101) does not perform OIS or center movement of the lens modules when it determines that the input detected under the control of the processor (320) is a weak input.

[0167] According to one embodiment, Figure 12-2 is a graph showing the state in which OIS is performed or the center of the lens modules is shifted when the electronic device (101) determines, under the control of the processor (320), that the input detected is a strong input.

[0168] In an electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) comprises: a first camera module (e.g., first camera module (301)) having a first angle of view including a first lens module (e.g., first lens module (306)), a second camera module (e.g., second camera module (302)) having a second angle of view including a second lens module (e.g., second lens module (307)), a first OIS driving module (e.g., first OIS driving module (311)) for moving the first lens module (e.g., first lens module (306)) within a first OIS driving range, a second OIS driving module (e.g., second OIS driving module (312)) for moving the second lens module (e.g., second lens module (307)) within a second OIS driving range, the first camera module (e.g., first camera module (301)), the second camera module (e.g., A second camera module (302)), a first OIS driving module (e.g., first OIS driving module (311)), and a processor (e.g., processor (320)) electrically connected to the second OIS driving module (e.g., second OIS driving module (312)), wherein when a camera application is executed, the processor (e.g., processor (320)) activates the first camera module (e.g., first camera module (301)) as a main camera, controls the first OIS driving module (e.g., first OIS driving module (311)) to position the center of the first lens module (e.g., first lens module (306)) at a first point, controls the second OIS driving module (e.g., second OIS driving module (312)) to position the center of the second lens module (e.g., second lens module (307)) at a point on a first axis passing through the first point, and the second camera module (e.g., second camera Detecting an event that switches the module (302)) to the main camera, and in response to the detection of said event, activating the second camera module (e.g., the second camera module (302)) as the main camera, andThe center of the second lens module (e.g., second OIS driving module (312)) can be moved to a second point by controlling the second OIS driving module (e.g., second lens module (307)), and the center of the first lens module (e.g., first OIS driving module (311)) can be moved to a point on the second axis that is parallel to the first axis and passes through the second point.

[0169] In the electronic device (e.g., electronic device (101)) according to one embodiment, the processor (e.g., processor (320)) can maintain the center of the first lens module (e.g., first lens module (306)) at the first point during the switching.

[0170] In the electronic device (e.g., electronic device (101)) according to one embodiment, the processor (e.g., processor (320)) can gradually move the center of the first lens module (e.g., first lens module (306)) over a certain period of time to move the center of the first lens module (e.g., first lens module (306)) to a point on a second axis parallel to the first axis and passing through the second point after the switching.

[0171] In the electronic device (e.g., electronic device (101)) according to one embodiment, the processor (e.g., processor (320)) can identify the first point and the second point in response to activating the first camera module (e.g., first camera module (301)) as a main camera.

[0172] In the electronic device (e.g., electronic device (101)) according to one embodiment, the processor (e.g., processor (320)) can identify the first point and the second point based on an image obtained using the first camera module (e.g., first camera module (301)) and the second camera module (e.g., second camera module (302)).

[0173] In the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further comprises an OIS control module (e.g., OIS control module (330)), and the processor (e.g., processor (320)) can control the first OIS driving module (e.g., first OIS driving module (311)) and the second OIS driving module (e.g., second OIS driving module (312)) using the OIS control module (e.g., OIS control module (330)).

[0174] In the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further comprises a memory (e.g., memory (350)), and the memory (e.g., memory (350)) can store information about the first point and the second point.

[0175] In the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further includes a sensor module (e.g., sensor module (340)), and the processor (e.g., processor (320)) can detect shaking of the electronic device (e.g., electronic device (101)) using the sensor module (e.g., sensor module (340)) and perform OIS in a direction that suppresses said shaking.

[0176] In the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further includes a display (e.g., display (360)), and the processor (e.g., processor (320)) detects an input through the display (e.g., display (360)), identifies the intensity of the input, and if the intensity is greater than or equal to a threshold value, can perform OIS in a manner that suppresses shaking according to the input.

[0177] In the electronic device (e.g., electronic device (101)) according to one embodiment, the processor (e.g., processor (320)) may not perform OIS for the first lens module (e.g., first lens module (306)) and / or the second lens module (e.g., second lens module (307)) when the intensity is below a threshold value.

[0178] In a method of operation of an electronic device (e.g., electronic device (101)) according to one embodiment, the method of operation comprises, when a camera application is executed, activating the first camera module (e.g., first camera module (301)) as a main camera; controlling the first OIS driving module (e.g., first OIS driving module (311)) to position the center of the first lens module (e.g., first lens module (306)) at a first point; controlling the second OIS driving module (e.g., second OIS driving module (312)) to position the center of the second lens module (e.g., second lens module (307)) at a point on a first axis passing through the first point; detecting an event to set the second camera module (e.g., second camera module (302)) as a main camera; in response to the detection of the event, activating the second camera module (e.g., second camera module (302)) as the main camera; and the second OIS driving The method may include controlling a module (e.g., a second OIS driving module (312)) to move the center of the second lens module (e.g., a second lens module (307)) to a second point, and controlling the first OIS driving module (e.g., a first OIS driving module (311)) to move the center of the first lens module (e.g., a first lens module (306)) to a point on a second axis that is parallel to the first axis and passes through the second point.

[0179] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the method of operation may include an operation of maintaining the center of the first lens module (e.g., first lens module (306)) at the first point during the switching.

[0180] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the method of operation may include, after the switching, an operation of moving the center of the first lens module (e.g., first lens module (306)) to a point on a second axis parallel to the first axis and passing through the second point, an operation of gradually moving the center of the first lens module (e.g., first lens module (306)) over a certain period of time.

[0181] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the method of operation may include an operation of identifying the first point and the second point in response to activating the first camera module (e.g., first camera module (301)) as a main camera.

[0182] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the method of operation may include an operation of identifying the first point and the second point based on an image obtained using the first camera module (e.g., first camera module (301)) and the second camera module (e.g., second camera module (302)).

[0183] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further comprises an OIS control module (e.g., OIS control module (330)), and the method of operation may include an operation of controlling the first OIS driving module (e.g., first OIS driving module (311)) and the second OIS driving module (e.g., second OIS driving module (312)) using the OIS control module (e.g., OIS control module (330)).

[0184] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further includes a memory (e.g., memory (350)), and the memory (e.g., memory (350)) can store information about the first point and the second point.

[0185] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further comprises a sensor module (e.g., sensor module (340)), and the method of operation may include an operation of detecting shaking of the electronic device (e.g., electronic device (101)) using the sensor module (e.g., sensor module (340)), and an operation of performing OIS in a direction that suppresses said shaking.

[0186] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the electronic device (e.g., electronic device (101)) further comprises a display (e.g., display (360)), and the method of operation may include an operation of detecting an input through the display (e.g., display (360)), an operation of identifying the intensity of the input, and an operation of performing OIS in a direction that suppresses shaking according to the input when the intensity is greater than or equal to a threshold value.

[0187] In the method of operation of the electronic device (e.g., electronic device (101)) according to one embodiment, the method of operation may include not performing OIS for the first lens module (e.g., first lens module (306)) and / or the second lens module (e.g., second lens module (307)) when the intensity is below a threshold value.

[0188] The electronic device according to the various embodiments disclosed in this document may be a device of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0189] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any component (e.g., the first) is referred to as "coupled" or "connected" to another component (e.g., the second), with or without the terms "functionally" or "communicationally," it means that said component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0190] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0191] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0192] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0193] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

Claim 1 In an electronic device, a first camera module including a first lens module and having a first angle of view; a second camera module including a second lens module and having a second angle of view; a first OIS driving module configured to move the first lens module within a first OIS driving range; and a second OIS driving module configured to move the second lens module within a second OIS driving range. An electronic device comprising: a first camera module, a second camera module, a first OIS driving module, and a processor electrically connected to the second OIS driving module, wherein the processor is configured to: when a camera application is executed: activate the first camera module as a main camera, control the first OIS driving module to position the center of the first lens module at a first point within the first OIS driving range, control the second OIS driving module to position the center of the second lens module at a point on a first axis passing through the first point, detect an event of switching the second camera module to a main camera, and in response to the detection of the event: activate the second camera module as the main camera, control the second OIS driving module to move the center of the second lens module to a second point within the second OIS driving range, and control the first OIS driving module to move the center of the first lens module to a point on a second axis parallel to the first axis and passing through the second point. Claim 2 An electronic device according to claim 1, wherein the processor is configured to maintain the center of the first lens module at the first point during the switching. Claim 3 An electronic device according to claim 1, wherein the processor is configured to gradually move the center of the first lens module over a certain period of time, in order to move the center of the first lens module to a point on a second axis parallel to the first axis and passing through the second point after the switching. Claim 4 An electronic device according to claim 1, wherein the processor is configured to identify the first point and the second point in response to activating the first camera module as a main camera. Claim 5 An electronic device according to claim 1, wherein the processor is configured to identify the first point and the second point based on an image acquired using the first camera module and the second camera module. Claim 6 An electronic device according to claim 5, further comprising an OIS control module, wherein the processor is configured to control the first OIS driving module and the second OIS driving module using the OIS control module. Claim 7 An electronic device according to claim 1, further comprising a memory, wherein the memory stores information regarding the first point and the second point. Claim 8 An electronic device according to claim 1, further comprising a sensor module, wherein the processor is configured to detect shaking of the electronic device using the sensor module and perform OIS in a direction that suppresses said shaking. Claim 9 An electronic device according to claim 1, further comprising a display, wherein the processor is configured to detect an input through the display, identify the intensity of the input, and, when the intensity is greater than or equal to a threshold value, perform OIS in a manner that suppresses shaking according to the input. Claim 10 An electronic device according to claim 9, wherein the processor is configured not to perform OIS for at least one of the first lens module or the second lens module when the intensity is below a threshold value. Claim 11 A method of operation of an electronic device comprising: a first camera module including a first lens module; a second camera module including a second lens module; a first OIS driving module configured to move the first lens module within a first OIS driving range; and a second OIS driving module configured to move the second lens module within a second OIS driving range, wherein, when a camera application is executed: an operation of activating the first camera module as a main camera; an operation of controlling the first OIS driving module to position the center of the first lens module at a first point within the first OIS driving range; an operation of controlling the second OIS driving module to position the center of the second lens module at a point on a first axis passing through the first point; an operation of detecting an event of switching the second camera module to a main camera; and in response to the detection of the event: an operation of activating the second camera module as the main camera; and an operation of controlling the second OIS driving module to move the center of the second lens module to a second point within the second OIS driving range. A method comprising controlling the first OIS driving module to move the center of the first lens module to a point on a second axis parallel to the first axis and passing through the second point. Claim 12 A method according to claim 11, comprising an operation of maintaining the center of the first lens module at the first point during the switching. Claim 13 A method according to claim 11, wherein, after the conversion, the center of the first lens module is moved to a point on a second axis parallel to the first axis and passing through the second point, the method comprises the operation of gradually moving the center of the first lens module over a certain period of time. Claim 14 A method according to claim 11, comprising an operation of identifying the first point and the second point in response to activating the first camera module as a main camera. Claim 15 A method according to claim 11, comprising the operation of identifying the first point and the second point based on an image obtained using the first camera module and the second camera module. Claim 16 A method according to claim 15, wherein the electronic device further comprises an OIS control module and includes an operation of controlling the first OIS driving module and the second OIS driving module using the OIS control module. Claim 17 A method according to claim 16, wherein the electronic device further comprises a memory, and the memory stores information about the first point and the second point. Claim 18 A method according to claim 11, wherein the electronic device further comprises a sensor module, and the method comprises: an operation of detecting shaking of the electronic device using the sensor module; and an operation of performing OIS in a direction that suppresses the shaking. Claim 19 A method according to claim 11, wherein the electronic device further comprises a display, and includes the operation of detecting an input through the display; the operation of identifying the intensity of the input; and the operation of performing OIS in a direction that suppresses shaking according to the input when the intensity is greater than or equal to a threshold value. Claim 20 A method according to claim 19, comprising an operation of not performing OIS for at least one of the first lens module or the second lens module when the intensity is below a threshold value.

Images