Electronic device and method for controlling camera motion

By using the camera module position information and motion control system configured by the processor in a small electronic device, the problem of limited motion space of the camera tilt-type optical image stabilizer is solved, and effective jitter compensation and image stability improvement are achieved.

CN114762314BActive Publication Date: 2025-04-15SAMSUNG ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080084352.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-12-06
Filing Date
2020-12-01
Publication Date
2025-04-15
Estimated Expiration
2040-12-01

Smart Images

  • Figure CN114762314B_ABST
    Figure CN114762314B_ABST
Patent Text Reader

Abstract

In an embodiment, the electronic device may include a processor and a camera module functionally connected to the processor. The camera module may include a lens assembly including at least one lens, and an image sensor for processing light acquired through the lens assembly. The processor may be configured to identify position information of the lens assembly, move the camera module within a first range to correct jitter in an image acquired through the image sensor when the position information of the lens assembly corresponds to a first position, and move the camera module within a second range to correct jitter in an image acquired through the image sensor when the position information of the lens assembly corresponds to a second position.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to electronic devices and methods for controlling camera motion. Background Art

[0002] There are a variety of electronic devices that can be equipped with cameras to capture images, including smartphones, tablet personal computers (PCs), portable multimedia players (PMPs), personal digital assistants (PDAs), laptop PCs, and wearable devices such as wristwatches or head-mounted displays (HMDs).

[0003] In order to obtain a clear image, the camera of the electronic device needs to stabilize and focus the image.

[0004] The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with respect to the present disclosure. Summary of the invention

[0005] Technical issues

[0006] In order to obtain a clear image, the camera of the electronic device needs to perform image stabilization and focus adjustment. For image stabilization, an optical image stabilizer (OIS) based on lens shift type stabilization or camera tilt type stabilization is often used.

[0007] Lens shift stabilization uses a technique that moves a lens to compensate for the jitter of an optical module. For example, the lens can perform linear motion on a plane parallel to the imaging surface of the image sensor.

[0008] Camera tilt-type stabilization uses a technique for correcting an image by moving a camera lens and an image sensor together. For example, camera tilt-type stabilization matches an optical axis with a virtual axis connecting a target object and a center of a camera module. That is, as the optical axis is tilted to compensate for shake, the virtual axis and the optical axis always coincide with each other, and the image sensor captures an image without blur. However, when camera tilt-type stabilization is used for a camera included in an electronic device with a reduced size, the space for camera movement may be limited.

[0009] Solution to the problem

[0010] According to certain embodiments, an electronic device includes: a processor; and a camera module functionally connected to the processor, wherein the camera module includes: a lens assembly including at least one lens; and an image sensor for processing light acquired through the lens assembly, and wherein the processor is configured to: determine position information of the lens assembly, move the camera module within a first range to correct jitter in an image acquired through the image sensor when the position information of the lens assembly corresponds to a first position, and move the camera module within a second range to correct jitter in the image when the position information of the lens assembly corresponds to a second position.

[0011] According to some embodiments, the camera module further includes a focus control module configured to determine position information of the lens assembly.

[0012] According to some embodiments, the position information of the lens assembly is determined based on at least one of a focal distance calculated to be focused on the target object, a focus position, or a physical position of the lens assembly.

[0013] According to some embodiments, the electronic device further comprises: a gyro sensor or an acceleration sensor disposed inside or outside the camera module, wherein the processor is configured to move the camera module within a first range or a second range when movement of the electronic device is detected by the gyro sensor or the acceleration sensor.

[0014] According to some embodiments, the electronic device further includes: a housing, wherein the camera module is disposed in the housing; an image stabilizer actuator configured to move the camera module, wherein the image stabilizer is disposed in the housing; and a rotation guide coupled to the housing and providing guidance for a rotation angle of the camera module.

[0015] According to some embodiments, the electronic device further includes at least one camera module stopper configured to limit movement of the camera module.

[0016] According to some embodiments, the processor is further configured to move the camera module within a third range to correct shake in the image when the position information of the lens assembly corresponds to a third position.

[0017] According to some embodiments, the processor is further configured to move the camera module within a first range when the position information of the lens assembly corresponds to an infinite focus position.

[0018] According to some embodiments, the processor is further configured to move the camera module within a second range when the position information of the lens assembly corresponds to an intermediate focus position.

[0019] According to some embodiments, the processor is further configured to move the camera module within a third range when the position information of the lens assembly corresponds to a macro focus position.

[0020] According to certain embodiments, an electronic device includes: a camera; at least one memory; and a processor functionally connected to the camera and the at least one memory, wherein the camera includes: a camera module including an image sensor and a lens assembly, wherein the image sensor is configured to capture an image, and wherein the lens assembly is configured to move, and wherein movement of the lens assembly causes a focusing operation of the image; and an image stabilizer actuator for moving the lens assembly, wherein the processor is configured to: activate the camera, move the position of the lens assembly in a focusing operation, determine a movement angle range of the module corresponding to the movement position of the lens assembly, and move the camera module within the determined movement angle range.

[0021] According to some embodiments, the electronic device further comprises a gyro sensor or an acceleration sensor disposed inside or outside the camera, wherein the processor is configured to move the camera module within a determined movement angle range when movement of the electronic device is detected by the gyro sensor or the acceleration sensor.

[0022] According to some embodiments, the electronic device further includes: a housing in which the camera module and the image stabilizer actuator are disposed; and a rotation guide receiving the housing and providing a guide for a rotation angle of the camera module.

[0023] According to some embodiments, the electronic device further includes at least one camera module stopper capable of limiting movement of the camera module.

[0024] According to certain embodiments, the processor is also configured to: identify a moving position of the lens assembly, move the camera module within a first moving angle range when the moving position is a first position, move the camera module within a second moving angle range when the moving position is a second position, and move the camera module within a third moving angle range when the moving position is a third position.

[0025] According to some embodiments, the electronic device further includes a processor further configured to move the camera module within a first movement angle range when the movement position of the lens assembly corresponds to an infinite focus position.

[0026] According to some embodiments, the electronic device further includes a processor further configured to move the camera module within a second movement angle range when the movement position of the lens assembly corresponds to an intermediate focus position.

[0027] According to some embodiments, the electronic device further includes a processor further configured to move the camera module within a third movement angle range when the movement position of the lens assembly corresponds to a macro focus position.

[0028] According to some embodiments, the electronic device further includes a camera module, the camera module further including a focus control module configured to determine a movement position of the lens assembly.

[0029] According to certain embodiments, a control method of an electronic device includes: identifying position information of a lens assembly included in a camera module functionally connected to the electronic device; when the position information of the lens assembly corresponds to a first position, determining a moving range of the camera module as a first range; when the position information of the lens assembly corresponds to a second position, determining a moving range of the camera module as a second range; and controlling movement of the camera module based on the first range or the second range.

[0030] Advantageous Effects of the Invention

[0031] Various embodiments of the present disclosure provide an electronic device and method for controlling the motion of a camera at various angles within a limited space to compensate for shaking. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

[0033] Figure 1 is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure.

[0034] Figure 2 is a block diagram illustrating a camera according to some embodiments.

[0035] Figure 3 is a perspective view showing a front surface of an electronic device according to an embodiment of the present disclosure.

[0036] Figure 4 It is shown Figure 3 A perspective view of the rear surface of an electronic device is shown.

[0037] Figure 5 is a diagram illustrating the operation of a camera including a camera tilt-type optical image stabilizer according to certain embodiments of the present disclosure.

[0038] Figure 6 is a perspective view partially transparently illustrating a camera included in an electronic device according to some embodiments of the present disclosure.

[0039] Figure 7 is a cross-sectional view illustrating a camera included in an electronic device according to some embodiments of the present disclosure.

[0040] Figure 8 to Figure 1 0B is shown Figure 6 An exploded perspective view of the camera.

[0041] 11A and 11B are diagrams illustrating one or more camera module stoppers according to certain embodiments of the present disclosure.

[0042] 11C and 11D are diagrams illustrating movement of a lens assembly for matching focal length to an object, according to certain embodiments of the present disclosure.

[0043] Fig.12 is a flowchart illustrating a method for controlling motion of a camera included in an electronic device according to certain embodiments of the present disclosure.

[0044] Fig.13 is a flowchart illustrating a method for controlling motion of a camera included in an electronic device according to certain embodiments of the present disclosure.

[0045] 14A to 14C are diagrams illustrating a method for controlling motion of a camera module included in an electronic device according to certain embodiments of the present disclosure.

[0046] Fig.15 is a flowchart illustrating a method for controlling motion of a camera included in an electronic device according to certain embodiments of the present disclosure.

[0047] Fig.16 is a diagram illustrating first to third movement positions of a lens assembly included in a camera according to certain embodiments of the present disclosure.

[0048] 17A and 17B are diagrams illustrating movement of a camera module included in an electronic device according to certain embodiments of the present disclosure. DETAILED DESCRIPTION

[0049] To stabilize the image, the camera may use an optical image stabilizer (OIS) based on lens shift type stabilization or camera tilt type stabilization.

[0050] Lens shift stabilization is a technique that uses a moving lens to compensate for the jitter of an optical module. For example, the lens can perform linear motion on a plane parallel to the imaging surface of the image sensor.

[0051] Camera tilt-type stabilization uses a technique for correcting an image by moving a camera lens and an image sensor together. For example, camera tilt-type stabilization matches an optical axis with a virtual axis connecting a target object and a center of a camera module. That is, as the optical axis is tilted to compensate for shake, the virtual axis and the optical axis always coincide with each other, and the image sensor captures an image without blur. However, when camera tilt-type stabilization is used for a camera included in an electronic device of reduced size, such as a smartphone, there may be difficulties due to the small amount of space for camera movement.

[0052] Certain embodiments of the present disclosure provide an electronic device and method for controlling the motion of a camera using camera tilt type stabilization. In addition, certain embodiments of the present disclosure provide an electronic device and method for controlling the motion of a camera at various angles within a limited space to compensate for shaking.

[0053] Hereinafter, certain embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0054] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit.For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).

[0055] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented separate from the main processor 121, or as part of the main processor 121. The term "" should be understood to refer to the singular context as well as the plural context.

[0056] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123, rather than the main processor 121, may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) among the components of the electronic device 101, or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) that is functionally related to the auxiliary processor 123.

[0057] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0058] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0059] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0060] The sound output device 155 can output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as a part of the speaker.

[0061] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of a force caused by a touch.

[0062] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0063] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0064] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0065] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0066] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0067] The camera 180 may capture still images or moving images. According to an embodiment, the camera 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0068] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0069] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0070] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0071] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module 197.

[0072] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0073] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the external electronic device 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute the requested at least part of the function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

[0074] The electronic device according to some embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0075] It should be understood that some embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each phrase in the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0076] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0077] Some embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0078] According to an embodiment, the method according to some embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or the computer program product may be published online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM), or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a manufacturer's server, an application store's server, or a memory of a forwarding server).

[0079] According to certain embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities. According to certain embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to certain embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to certain embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0080] As described above, in order to capture a stable image, the camera module 180 may use an optical image stabilizer (OIS) based on a lens shift type stabilization or a camera tilt type stabilization.

[0081] In case of camera tilt type stabilization, the camera module 180 may have a very small amount of space.

[0082] Figure 2 2 is a block diagram 200 showing a camera module 180 according to some embodiments. The camera module 180 may include a lens assembly 210 and an image sensor 230. In order to correct the shaking in the image acquired by the image sensor 230, the processor 120 in the electronic device 101 may identify the position of the lens assembly and move the camera module 180 within a first range or a second range based on the position information.

[0083] Reference Figure 2 , the camera 180 may include a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (e.g., a buffer memory), and / or an image signal processor 260. The lens assembly 210 may collect light reflected from an object that is a target to be captured by an image. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera 180 may include a plurality of lens assemblies 210. The camera 180 may be, for example, a dual camera, a 360-degree camera, or a spherical camera. The plurality of lens assemblies 210 may have the same lens properties (e.g., viewing angle, focal length, autofocus, f-number, and / or optical zoom), or at least one lens assembly may have one or more lens properties that are different from the lens properties of other lens assemblies. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens.

[0084] The flashlight 220 may emit light to enhance the light reflected from the object. The flashlight 220 may include one or more light emitting diodes (LEDs) (e.g., red-green-blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or xenon lamps. The image sensor 230 may convert the light collected from the object through the lens assembly 210 into an electrical signal, thereby acquiring an image corresponding to the object. According to an embodiment, the image sensor 230 may include one image sensor selected from image sensors with different properties (such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors with the same properties, or a plurality of image sensors with different properties. The image sensor 230 may be implemented as, for example, a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

[0085] In response to the movement of the camera 180 or the electronic device 101, the image stabilizer 240 may move the image sensor 230 or at least one lens included in the lens assembly 210 in a specific direction, or control the operating characteristics of the sensor 230 (e.g., adjust the readout timing). This may at least partially compensate for the image blur caused by such movement. According to an embodiment, the image stabilizer 240 may detect the movement of the camera 180 or the electronic device 101 by using a gyroscope sensor (not shown) or an acceleration sensor (not shown) provided inside or outside the camera 180. The memory 250 may at least temporarily store at least a portion of the image acquired by the image sensor 230 for subsequent image processing tasks. For example, if image acquisition is delayed due to shutter lag, or if multiple images are acquired quickly, the acquired original image (e.g., an image of a Bayer pattern or a high-resolution image) may be stored in the memory 250, and the corresponding copy image (e.g., a low-resolution image) may be previewed through the display device 160. When a specified condition is met (e.g., when a predetermined user input or system command is received), at least a portion of the original image may be acquired and processed. According to an embodiment, the memory 250 may be configured as at least a portion of the memory 130 or as a separate memory that operates independently of the memory 130 .

[0086] The image signal processor 260 may perform image processing on an image acquired by the image sensor 230 or an image stored in the memory 250. Image processing may include, for example, depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesis, and / or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor 260 may perform control (e.g., exposure time control or readout timing control) on at least one component (e.g., image sensor 230) included in the camera 180. The image processed by the image signal processor 260 may be stored again in the memory 250 for further processing or transmitted to an external component (e.g., memory 130, display device 160, electronic device 102, electronic device 104, or server 108) outside the camera 180. According to an embodiment, the image signal processor 260 may be configured as at least a part of the processor 120 or as a separate processor that operates independently of the processor 120. In the latter case, the image processed by the image signal processor 260 may be displayed through the display device 160 as is or after being further processed by the processor 120 .

[0087] According to an embodiment, the electronic device 101 may include a plurality of cameras 180 having different properties (e.g., different viewing angles) or functions. In this case, the plurality of cameras 180 may include, for example, at least one of a wide-angle camera, a telephoto camera, or an IR camera (such as a time-of-flight camera or a structured light camera). For example, a plurality of camera modules including lenses having different viewing angles may be configured, and the electronic device may control the change of the viewing angle in response to a user's selection. According to an embodiment, at least one of the plurality of cameras 180 may be a front camera, and at least one of the other cameras 180 may be a rear camera.

[0088] Figure 3 is a perspective view showing a front surface of the electronic device 101 according to an embodiment of the present disclosure. Figure 4 It is shown Figure 3 A perspective view of the rear surface of electronic device 101 is shown.

[0089] Reference Figure 3 and Figure 4, the electronic device 101 according to the embodiment may include a housing 110 having a first surface (or front surface) 110A, a second surface (or rear surface) 110B, and a side surface 110C surrounding a space between the first surface 110A and the second surface 110B. In another embodiment (not shown), the housing may refer to a structure forming some of the first surface 110A, the second surface 110B, and the side surface 110C. According to an embodiment, the first surface 110A may be at least partially formed by a substantially transparent front plate 301 (e.g., a polymer plate or a glass plate including various coatings). The second surface 110B may be formed by a substantially opaque rear plate 302. The rear plate 302 may be formed by, for example, coated or colored glass, ceramics, polymers, metals (e.g., aluminum, stainless steel (STS) or magnesium) or a combination of at least two of the above materials. The side surface 110C can be connected to the front panel 301 and the back panel 302 and formed by a side frame structure (or "component" 118 having metal and / or polymer. In some embodiments, the back panel 302 and the side frame structure 118 can be integrally formed and have the same material (e.g., a metal material such as aluminum).

[0090] According to an embodiment, the electronic device 101 may include a display device 160, audio modules 103, 107, and 114, sensor modules 304 and 119, cameras 105 and 112 (eg, Figure 1 and Figure 2 180), key input devices 115, 116, and 117, indicator 106, and at least one of connector ports 308 and 309. In some embodiments, the electronic device 101 may omit at least one of the above components (e.g., key input devices 115, 116, or 217 or indicator 106), or may further include other components.

[0091] Display device 160 may be exposed through a portion of front panel 301. For example, display device 160 may be disposed adjacent to or in conjunction with a touch sensing circuit, a pressure sensor capable of measuring the intensity (or pressure) of a touch, and / or a digitizer capable of detecting a magnetic field type stylus.

[0092] The audio modules 103, 107, and 114 may include a microphone hole 103 and speaker holes 107 and 114. The microphone hole 103 may include a microphone therein for obtaining external sound, and in some embodiments, multiple microphones are included to detect the direction of the sound. The speaker holes 107 and 114 may include an external speaker hole 107 and a call receiver hole 114. In some embodiments, the speaker holes 107 and 114 and the microphone hole 103 may be implemented as one hole, or a speaker (e.g., a piezoelectric speaker) may be included without the speaker holes 107 and 114.

[0093] The sensor modules 304 and 119 may generate an electrical signal or data value corresponding to an internal operating state or an external environmental state of the electronic device 101. The sensor modules 304 and 119 may include, for example: a first sensor module 304 (e.g., a proximity sensor) and / or a second sensor module (not shown) (e.g., a fingerprint sensor), which is disposed near the first surface 110A of the housing 110; and / or a third sensor module 119 (e.g., a heart rate monitor (HRM) sensor), which is disposed near the second surface 110B of the housing 110. The fingerprint sensor may be disposed near the second surface 110B of the housing 110 and the first surface 110A (e.g., the home key button 115). The electronic device 101 may also include any other sensor modules (not shown), such as a gesture sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR sensor, a biometric sensor, a temperature sensor, a humidity sensor, and / or an illumination sensor 304.

[0094] The cameras 105 and 112 may include a first camera device 105 (eg, Figure 1 and Figure 2 180), and a second camera device 112 disposed near the second surface 110B (e.g., Figure 1 and Figure 2 Each camera 105 or 112 may include multiple lenses (e.g., Figure 2 lens assembly 210 in), flash 113 (e.g., Figure 2 220 in the flash), an image sensor (e.g., Figure 2 230) and / or an image signal processor (e.g., Figure 2 The image signal processor 260 in the electronic device 101. The flash 213 may include, for example, a light emitting diode or a xenon lamp. In some embodiments, a lens (eg, a wide-angle lens and a telephoto lens) and an image sensor may be provided in the electronic device 101. It can be seen that the camera occupies a small area.

[0095] The key input devices 115, 116, and 117 may include a home key button 115 disposed on the first surface 110A of the housing 110, a touch pad 116 disposed near the home key button 115, and / or a side key button 117 disposed on a side surface 110C of the housing 110. In another embodiment, the electronic device 101 may not include some or all of the above-mentioned key input devices 115, 116, and 117, and the key input device(s) not included may be implemented in any other form (such as soft keys on the display device 160).

[0096] The indicator 106 may be provided on the first surface 110A of the housing 110. The indicator 106 may include a light emitting diode (LED), and may provide, for example, status information of the electronic device 101 in an optical form.

[0097] Connector ports 308 and 309 may include: a first connector port 308 that can receive a connector for sending power and / or data to an external electronic device and receiving power and / or data from an external electronic device; and / or a second connector port 309 that can receive a connector for sending audio signals to an external electronic device and receiving audio signals from an external electronic device.

[0098] Figure 5 1 is a diagram illustrating the operation of the camera 180 including camera tilt according to some embodiments of the present disclosure. The electronic device 101 may include the camera 180. When the user's hand 501 shakes the electronic device 101 (arrow 510), the camera 180 moves, tilts, and moves within the electronic device in a direction opposite to the shaking. As a result, although the electronic device 101 moves relative to the virtual axis 520, the camera 180 maintains a position where the optical axis 521 (the center of the camera 180 to the object 502) coincides with the virtual axis 520.

[0099] It can be seen that the camera 180 has little room for movement. Therefore, there may be limited space for movement of the camera 180 to make the optical axis coincide with the vertical axis. Figure 6 is a perspective view partially transparently illustrating the camera 180 included in the electronic device 101 according to some embodiments of the present disclosure. Figure 7 is a cross-sectional view illustrating a camera 180 included in the electronic device 101 according to some embodiments of the present disclosure. Figure 8 to Figure 1 0B is shown Figure 6 An exploded perspective view of camera 180 is shown.

[0100] Reference Figure 6 to Figure 1 0B, the camera 180 according to some embodiments may include a camera module 610, an image stabilizer actuator 620, a rotation guide 630, and a module housing 640.

[0101] The camera module 610 may include, for example, a lens assembly 611 (eg, Figure 2 The camera module 610 may further include a lens assembly 611 (eg, Figure 2 The image sensor (eg, Figure 2 or Figure 7 230 in the image sensor).

[0102] The lens assembly 611 of the camera module 610 may have an optical axis 601 that is orthogonal to the image sensor 230 .

[0103] The focal length can be adjusted by, for example, the zoom magnification. That is, the focal length can be determined differently depending on the zoom magnification.

[0104] The electronic device 101 may identify the position of a focus lens (e.g., lens assembly 611) for focusing on a target object as a focus position. The focus position refers to a position where a lens (e.g., lens assembly 611) moves in response to proximity, telephoto, etc. and is then placed to focus on a target object.

[0105] To perform the auto focus function, the camera module 610 may be configured to perform the auto focus function on the image signal processor ( Figure 2 260) and / or processor ( Figure 1 A controller of the image sensor 230 (120) uses a motor to move the lens assembly 611 included therein toward or away from the image sensor 230. According to some embodiments, a separate autofocus module can directly control the lens assembly 611 to quickly perform an autofocus function. The autofocus module directly connected to the lens assembly 611 can calculate a focus position based on light acquired through the lens assembly 611, thereby controlling the lens assembly 611. The focus control module may include, for example, an autofocus module. The autofocus module may include a sensor that senses a focus position for a subject and a motor that moves the lens assembly relative to the image sensor to achieve focusing.

[0106] The camera module 610 may further include a lens carrier 612 for moving the lens assembly 611 (see Figure 7 ). The lens assembly 611 is coupled to the lens carrier 612 and can be moved in the direction of the optical axis 601 by movement of the lens carrier 612.

[0107] The lens carrier 612 may include, for example, a magnet and a coil. Under the control of the image signal processor 260 and / or the processor 120, the lens carrier 612 may control the electromagnetic force by controlling the current passing through the coil, and may also move the lens assembly 611 in the direction of the optical axis 601 by using the Lorentz force generated by the electromagnetic force.

[0108] Based on the position of lens assembly 611 during focusing, the range of camera rotation about axes 601 , 602 , and 603 is determined.

[0109] The image stabilizer actuator 620 may include, for example, a first actuator 621 (see Figure 8 ) and the second actuator 622 (see Figure 8 ).

[0110] The camera 180 may detect a motion (eg, shake) of the camera 180 or the electronic device 101 by using a gyro sensor (not shown) or an acceleration sensor (not shown) provided inside or outside the camera.

[0111] Using the first actuator 621 and / or the second actuator 622, the image stabilizer actuator 620 can actuate the camera module 610 to perform a rotational motion relative to a first transverse axis 602 orthogonal to the optical axis 601 and / or a second transverse axis 603 orthogonal to the optical axis 601. The first transverse axis 602 and the second transverse axis 603 may intersect each other substantially perpendicularly on a plane orthogonal to the optical axis 601. The rotational motion of the camera module 610 is not limited to a 2-axis rotational motion relative to the first transverse axis 602 and the second transverse axis 603. In some embodiments, a 3-axis rotational motion around the first transverse axis 602 and the second and 603 and a third axis corresponding to the optical axis 601 may also be possible.

[0112] Each of the first actuator 621 and the second actuator 622 may be composed of a magnet and a coil, and thus move according to a magnetic field. Under the control of the image signal processor 260 and / or the processor 120, the first actuator 621 and the second actuator 622 may control the electromagnetic force by controlling the current passing through the coil, and drive the camera module 610 to rotate around the first horizontal axis 602 and / or the second horizontal axis 603 by using the Lorentz force generated by the electromagnetic force.

[0113] According to some embodiments, the 3-axis rotational motion associated with the motion of the camera module 610 may include yaw motion, pitch motion, and roll motion. For example, the motion associated with the first transverse axis 602 may be referred to as yaw motion, and the motion associated with the second transverse axis 603 may be referred to as pitch motion. In addition, the motion associated with the third axis (e.g., optical axis 601) may be referred to as roll motion. According to some embodiments, the third axis may be an axis perpendicular to the orthogonal plane associated with the yaw motion and the pitch motion.

[0114] According to some embodiments, the electronic device 101 may be implemented to utilize various image stabilization techniques. In one example, the electronic device 101 may control the movement of the camera module 610 through the image stabilizer actuator 620. In another example, the electronic device 101 may also apply lens shift techniques. In yet another example, the electronic device 101 may also apply both lens shift techniques and image sensor shift techniques.

[0115] Reference Figure 8 The camera module 610 may further include a flexible printed circuit board (FPCB) 801, which may transmit an image acquired by the image sensor 230 or transmit an image to / from the image signal processor ( Figure 2 260) and / or processor ( Figure 1 For example, the position information of the lens assembly during focusing can be provided to the processor from the camera module 610. The processor can then determine the range of rotational motion allowed for correcting the shake of the camera module 610.

[0116] Reference Fig. 9 , the rotation guide 630 can be connected with the module housing ( Figure 6 The rotation guide 630 may be combined with the image stabilizer actuator 620 and may provide a rotation guide for the camera module 610 moved by the image stabilizer actuator 620. The rotation guide 630 may include an opening 631 and one or more support portions 632, 633, 634, and 635.

[0117] The opening 631 may prevent the rotating camera module 610 from escaping to the outside of the rotation guide 630. The support portions 632, 633, 634, and 635 may be combined with the module housing 640, and may enable the rotation guide 630 to prevent the camera module 610 from being separated.

[0118] 10A and 10B , the module housing 640 may provide a structure for accommodating the camera module 610, the image stabilizer actuator 620, and the rotation guide 630. The module housing 640 may be combined with at least a portion of the electronic device 101. The module housing 640 may include, for example, a container housing 641 and a connector housing 642. The container housing 641 may be at least partially open and may at least partially accommodate the camera module 610. The connector housing 642 may accommodate and protect the FPCB 801 connected to the camera module 610. Although the FPCB 801 is actually Figure 8 10A is shown connected to the camera module 610 , but in order to clearly show that the connector housing 642 accommodates the FPCB 801 , FIG. 10A shows only a portion of the FPCB 801 without the camera module 610 .

[0119] FIGS. 11A and 11B are diagrams showing one or more camera module stoppers 1101 and 1102 according to certain embodiments of the present disclosure. FIGS. 11C and 11D are diagrams showing movement of the lens assembly 611 for matching the focal length to an object according to certain embodiments of the present disclosure. The camera module stoppers 1101 and 1102 of the camera module 610 shown in FIGS. 11A and 11B may also be included in Figure 5 to Figure 1 In the camera module shown in 0B.

[0120] As the lens assembly 611 moves toward the cover glass 1190 for focusing, the range of movement 1110, 1120 decreases to avoid contact between the camera module 611 and the cover glass 1190. Therefore, the processor selects a different range of movement to correct for shake. Therefore, based on the position of the lens assembly, the processor determines the range to which the camera module 611 can move to correct for shake.

[0121] When the camera module 610 performs a rotational motion by the image stabilizer actuator 620 , the camera module stoppers 1101 and 1102 may contact at least a portion of the rotation guide 630 , thereby limiting a movement angle of the camera module 610 .

[0122] The first camera module stopper 1101 may be provided as at least a portion of the lens assembly 611. When the lens assembly 611 is away from the image sensor 230 along the optical axis 601 (e.g., close-up shooting mode), and when the camera module 610 is rotated around the first lateral axis 602 or the second lateral axis 603 by the image stabilizer actuator 620 to compensate for shake, the first camera module stopper 1101 may contact at least a portion of the rotation guide 630, thereby limiting the moving angle 1110 of the camera module 610. In order to adjust the focus of the target object in the close-up shooting mode, the electronic device 101 may move the lens assembly 611 as far away from the image sensor 230 as possible. Referring to FIG. 11B , the second camera module stopper 1102 may be provided as at least a portion of the side surface of the camera module 610. When the lens assembly 611 is close to the image sensor 230 along the optical axis 601 (for example, a telephoto mode), and when the camera module 610 is rotated around the first lateral axis 602 or the second lateral axis 603 via the image stabilizer actuator 620 to compensate for shake, the second camera module stop 1102 can contact at least a portion of the rotating guide 630, thereby limiting the movement angle 1120 of the camera module 610.

[0123] 11C , when the camera module 610 photographs a nearby object 1150 (ie, a close-up photography mode), the lens assembly 611 moves toward the object 1150 to focus more on the object 1150. That is, the lens assembly 611 moves away from the image sensor 230 and closer to the transparent cover or cover glass 1190.

[0124] Because the lens group 611 is located relatively close to the object 1150, in order to perform a focusing operation in a specific shooting mode, the distance 1151 between the lens assembly 611 and the transparent cover or cover glass 1190 is relatively small. In this disclosure, this distance will be referred to as a first distance 1151.

[0125] If the movement angle of the camera module 610 is large, in the close-up shooting mode, the lens assembly 611 may contact the transparent cover or cover glass 1190 due to the relatively small first distance 1151. Therefore, in order to compensate for the shake, the movement of the camera module 610 may be limited.

[0126] 11D, when the camera module 610 photographs a distant object 1160 (i.e., a telephoto mode), the lens assembly 611 moves away from the object 1160 so as to focus on the object 1160. That is, the lens assembly 611 moves toward the image sensor 230, and the distance 1152 between the lens assembly 611 and the transparent cover or cover glass 1190 is relatively large. In the present disclosure, this distance will be referred to as a second distance 1152. The second distance 1152 is greater than the first distance 1151. Therefore, the movement angle of the camera module 610 is greater in the telephoto mode than in the specific shooting mode. Therefore, the movement angle of the camera module 610 (e.g., 1110 or 1120 in FIG. 11A or FIG. 11B) can be determined differently depending on the position of the lens assembly 611.

[0127] Fig.12 is a flowchart illustrating a method for controlling the motion of the camera 180 included in the electronic device 101 according to some embodiments of the present disclosure.

[0128] Reference Fig.12 , at operation 1201 , the electronic device 101 may activate the camera 180 under the control of the image signal processor 260 and / or the processor 120 .

[0129] At operation 1203, the electronic device 101 may move the position of the lens assembly 611 based on the distance between the object and the image sensor 230 to perform a focusing operation focusing on the target object under the control of the image signal processor 260 and / or the processor 120. According to an embodiment, the camera module 610 may be moved to compensate for shaking.

[0130] According to some embodiments, at operation 1203, the electronic device 101 may move the lens assembly 611 along the optical axis 601 to be closer to or farther from the image sensor 230 under the control of the image signal processor 260 and / or the processor 120. This is a focusing operation of focusing on an object to obtain a clear image of the object.

[0131] At operation 1205 , the electronic device 101 may determine a movement angle range of the camera module 610 corresponding to a movement position of the lens assembly 611 in a focusing operation under the control of the image signal processor 260 and / or the processor 120 .

[0132] According to some embodiments, at operation 1205 , the electronic device 101 may determine a moving position of the lens assembly 611 in a focusing operation based on predefined sections under the control of the image signal processor 260 and / or the processor 120 .

[0133] According to some embodiments, the moving position of the lens assembly 611 may be determined by itself or based on the position of the camera module 610 including the lens assembly 611 or the position of the camera 180. In addition, the moving position of the lens assembly 611 may be determined from the moving speed of the lens assembly 611. In addition, the moving position of the lens assembly 611 may be determined based on a user input such as zooming in or out. For example, when the user inputs a zoom-in input, the electronic device 101 may predetermine the moving position of the lens assembly 611 based on the zoom-in input before the lens assembly 611 moves.

[0134] According to some embodiments, when the user directly selects a specific zoom, the electronic device 101 may pre-acquire a movement position of the lens assembly 611 corresponding to the selected specific zoom. Then, based on the acquired position of the lens assembly 611, the electronic device 101 may determine a movement angle of the camera module 610 (e.g., 1110 in FIG. 11A or 1120 in FIG. 11B ).

[0135] When the moving position of the lens assembly 611 is determined to be one of the predefined segments in the focusing operation, the electronic device 101 can determine the moving angle range of the camera module 610 corresponding to the determined segment under the control of the image signal processor 260 and / or the processor 120 at operation 1205.

[0136] According to some embodiments, at operation 1205 , the electronic device 101 may determine a maximum movement angle of the camera module 610 corresponding to a movement position of the lens assembly 611 in a focusing operation under the control of the image signal processor 260 and / or the processor 120 .

[0137] For example, the maximum movement angle of the camera module 610 may be a maximum angle to which the lens assembly 611 may be movable without contacting a camera window (not shown).

[0138] For example, the maximum movement angle of the camera module 610 can be the maximum angle to which at least a portion of the camera module 610 can move within the electronic device 101 without contacting at least a portion of the mechanical structure (e.g., the module housing 640 or the container housing 641 in Figure 10A).

[0139] According to some embodiments, at operation 1205, information about the position of the lens assembly 611 may be determined based on at least one of a focus position determined by a focus adjustment operation, a physical position of at least one lens in the lens assembly 611, or a numerical value determined by a specified focal length. Based on the determined position information of the lens assembly 611, the electronic device 101 may predict the position of a portion where the lens assembly 611 collides with some components of the camera 180.

[0140] According to some embodiments, at operation 1205, information regarding the position of the lens assembly 611 may be determined based on the focal length determined by the focus adjustment operation.

[0141] At operation 1207 , the electronic device 101 may start camera photography under the control of the image signal processor 260 and / or the processor 120 .

[0142] According to some embodiments, at operation 1207, under the control of the image signal processor 260 and / or the processor 120, the electronic device 101 may move the camera module 610 and then move the camera module 610 when the virtual axis 520 (see FIG. 5 ) connecting the target object and the camera 180 is aligned with the virtual axis 520 (see FIG. 5 ). Figure 5 ) and the optical axis 521 of the camera 180 (see Figure 5 ) coincides with the virtual axis 520. If the virtual axis 520 does not coincide with the optical axis 521 due to shaking, a blurred image may be captured. Therefore, at operation 1207, the electronic device 101 may tilt the optical axis 521 to match the virtual axis 520 to compensate for the shaking, so that the image sensor 230 can capture an image without blur due to the shaking.

[0143] For example, the operation of starting camera photography may include an operation of displaying an image acquired from the camera 180 as a preview image on a display of the electronic device 101 (eg, the display device 160 ).

[0144] Under the control of the image signal processor 260 and / or the processor 120, the electronic device 101 may detect a shake of the camera 180, move the camera module 610 to compensate for the detected shake, and capture an image while minimizing the influence of the shake.

[0145] According to some embodiments, at operation 1207, the electronic device 101 may, under the control of the image signal processor 260 and / or the processor 120, use a sensor module (eg, Figure 1 The movement of the camera 180 or the electronic device 101 is detected by using a sensor (e.g., a gyro sensor, an acceleration sensor) included in the sensor module 176 in the electronic device 101.

[0146] At operation 1207 , under the control of the image signal processor 260 and / or the processor 120 , when any shaking of the camera 180 is detected, the electronic device 101 may move the camera module 610 within the determined movement angle range.

[0147] According to some embodiments, to prevent an image from being blurred due to shaking of the camera 180 , the electronic device 101 may move the camera module 610 in a direction to compensate for the shaking of the camera 180 (eg, in a direction opposite to the shaking of the electronic device 101 ).

[0148] According to some embodiments, the camera module 610 may be moved so that the image of the target object is not blurred due to the shaking of the camera 180 or the electronic device 101. When the shaking of the camera 180 is detected, the electronic device 101 may control the image stabilizer actuator 620 within the determined movement angle range at operation 1207. The image stabilizer actuator 620 may drive the camera module 610 to perform a rotational motion relative to a first transverse axis 602 orthogonal to the optical axis 601 and / or a second transverse axis 603 orthogonal to the optical axis 601 under the control of the image signal processor 260 and / or the processor 120.

[0149] According to some embodiments, at operation 1207, the electronic device 101 may move the camera module 610 based on a movement angle determined depending on the focal length. For example, the electronic device 101 may identify the focal length of the target object and move the camera module 610 in response to the identified focal length. Specifically, if the focal length is a first focal length, the camera module 610 may move within a first movement angle range to compensate for shaking. If the focal length is a second focal length, the camera module 610 may move within a second movement angle range to compensate for shaking. The focal length is the distance between a reference point and a focus where a light beam passing through a lens intersects. For example, when the zoom magnification is in a first magnification state, the distance between the lens and the focus may be referred to as a first focal length, and when the zoom magnification is in a second magnification state, the distance between the lens and the focus may be referred to as a second focal length. The electronic device 101 may identify the focal length of the target object in real time and adjust the movement angle of the camera module 610 differently depending on the identified focal length. The focal length may be changed in response to user input or may be automatically calculated by the camera 180.

[0150] Fig.13 is a flowchart illustrating a method for controlling the motion of the camera 180 included in the electronic device 101 according to some embodiments of the present disclosure.

[0151] Reference Fig.13, at operation 1301, the electronic device 101 may activate the camera 180 under the control of the image signal processor 260 and / or the processor 120. When the camera 180 is activated at operation 1301, the electronic device 101 may capture an image.

[0152] In some embodiments, the operation of capturing an image may be an operation of obtaining an image through the camera 180 of the electronic device 101 .

[0153] In some embodiments, the operation of capturing an image may be an operation of displaying an image acquired from the camera 180 as a preview image on a display of the electronic device 101 (eg, the display device 160 ).

[0154] At operation 1303, the electronic device 101 may move the position of the lens assembly 611 based on the distance between the object and the image sensor 230 to perform a focusing operation focusing on the target object under the control of the image signal processor 260 and / or the processor 120. According to an embodiment, the camera module 610 may be moved to compensate for shaking.

[0155] According to some embodiments, at operation 1303, the electronic device 101 may move the lens assembly 611 along the optical axis 601 to be closer to or farther from the image sensor 230 under the control of the image signal processor 260 and / or the processor 120. This is a focusing operation of focusing on an object to obtain a clear image of the object.

[0156] At operation 1305 , the electronic device 101 may determine a movement angle range of the camera module 610 corresponding to a movement position of the lens assembly 611 in a focusing operation under the control of the image signal processor 260 and / or the processor 120 .

[0157] According to some embodiments, at operation 1305 , the electronic device 101 may determine the movement position of the lens assembly 611 in the focusing operation based on predefined segments under the control of the image signal processor 260 and / or the processor 120 , thereby determining the corresponding movement angle range of the camera module 610 .

[0158] According to some embodiments, the moving position of the lens assembly 611 may be determined by itself or based on the position of the camera module 610 including the lens assembly 611 or the position of the camera 180. In addition, the moving position of the lens assembly 611 may be determined from the moving speed of the lens assembly 611. In addition, the moving position of the lens assembly 611 may be determined based on a user input such as zooming in or out. For example, when the user inputs a zoom-in input, the electronic device 101 may predetermine the moving position of the lens assembly 611 based on the zoom-in input before the lens assembly 611 moves. According to some embodiments, when the user directly selects a specific zoom, the electronic device 101 may pre-obtain the moving position of the lens assembly 611 corresponding to the selected specific zoom. Then, based on the obtained position of the lens assembly 611, the electronic device 101 may determine the moving angle of the camera module 610 (e.g., 1110 in FIG. 11A or 1120 in FIG. 11B).

[0159] When the moving position of the lens assembly 611 is determined to be one of the predefined segments in the focusing operation, the electronic device 101 can determine the moving angle range of the camera module 610 corresponding to the determined segment under the control of the image signal processor 260 and / or the processor 120 at operation 1305.

[0160] According to some embodiments, at operation 1305 , the electronic device 101 may determine a maximum movement angle of the camera module 610 corresponding to a movement position of the lens assembly 611 in a focusing operation under the control of the image signal processor 260 and / or the processor 120 .

[0161] For example, the maximum movement angle of the camera module 610 may be a maximum angle to which the lens assembly 611 may be movable without contacting a camera window (not shown).

[0162] For example, the maximum movement angle of the camera module 610 can be the maximum angle to which at least a portion of the camera module 610 can move within the electronic device 101 without contacting at least a portion of the mechanical structure (e.g., the module housing 640 or the container housing 641 in Figure 10A).

[0163] According to some embodiments, at operation 1305, information about the position of the lens assembly 611 may be determined based on at least one of a focus position determined by a focus adjustment operation, a physical position of at least one lens in the lens assembly 611, or a numerical value determined by a specified focal length. Based on the determined position information of the lens assembly 611, the electronic device 101 may predict the position of a portion where the lens assembly 611 collides with some components of the camera 180.

[0164] According to some embodiments, at operation 1305, information regarding the position of the lens assembly 611 may be determined based on the focal length determined by the focus adjustment operation.

[0165] At operation 1307 , the electronic device 101 may control the camera module 610 under the control of the image signal processor 260 and / or the processor 120 .

[0166] Reference Figure 5 11A to 11D , in some embodiments, the electronic device 101 may control the camera module 610 at operation 1307 so that a virtual axis 520 connecting the target object and the center of the camera 180 coincides with an optical axis 521 of the camera 180 .

[0167] According to some embodiments, at operation 1307 , under the control of the image signal processor 260 and / or the processor 120 , the electronic device 101 may move the camera module 610 to match the virtual axis 520 connecting the object and the camera 180 with the optical axis 521 of the camera 180 .

[0168] If the virtual axis 520 does not coincide with the optical axis 521 due to shaking, a blurred image may be captured. Therefore, at operation 1307, the electronic device 101 can tilt the optical axis 521 to match the virtual axis 520 to compensate for the shaking so that the image sensor 230 can capture an image without blur due to the shaking.

[0169] Under the control of the image signal processor 260 and / or the processor 120, the electronic device 101 may detect a shake of the camera 180, move the camera module 610 to compensate for the detected shake, and capture an image while minimizing the influence of the shake.

[0170] According to some embodiments, at operation 1307, the electronic device 101 may, under the control of the image signal processor 260 and / or the processor 120, use a sensor module (eg, Figure 1 The movement of the camera 180 or the electronic device 101 is detected by using a sensor (e.g., a gyro sensor, an acceleration sensor) included in the sensor module 176 in the electronic device 101.

[0171] At operation 1307 , under the control of the image signal processor 260 and / or the processor 120 , when any shaking of the camera 180 is detected, the electronic device 101 may move the camera module 610 within the determined movement angle range.

[0172] According to some embodiments, to prevent an image from being blurred due to shaking of the camera 180 , the electronic device 101 may move the camera module 610 in a direction to compensate for the shaking of the camera 180 (eg, in a direction opposite to the shaking of the electronic device 101 ).

[0173] According to some embodiments, the camera module 610 may be moved so that an image of a target object is not blurred due to shaking of the camera 180 or the electronic device 101 .

[0174] When the shaking of the camera 180 is detected, the electronic device 101 may control the image stabilizer actuator 620 within the determined movement angle range at operation 1307. The image stabilizer actuator 620 may drive the camera module 610 to perform a rotational movement relative to a first transverse axis 602 orthogonal to the optical axis 601 and / or a second transverse axis 603 orthogonal to the optical axis 601 under the control of the image signal processor 260 and / or the processor 120.

[0175] According to some embodiments, at operation 1307, the electronic device 101 may move the camera module 610 based on a movement angle determined depending on the focal length. For example, the electronic device 101 may identify the focal length of the target object and move the camera module 610 in response to the identified focal length. Specifically, if the focal length is a first focal length, the camera module 610 may move within a first movement angle range to compensate for shaking. If the focal length is a second focal length, the camera module 610 may move within a second movement angle range to compensate for shaking. The focal length is the distance between a reference point and a focus where a light beam passing through a lens intersects. For example, when the zoom magnification is in a first magnification state, the distance between the lens and the focus may be referred to as a first focal length, and when the zoom magnification is in a second magnification state, the distance between the lens and the focus may be referred to as a second focal length. The electronic device 101 may identify the focal length of the target object in real time and adjust the movement angle of the camera module 610 differently depending on the identified focal length. The focal length may be changed in response to user input or may be automatically calculated by the camera 180.

[0176] 14A to 14C are diagrams illustrating a method for controlling a motion of a camera module 610 included in an electronic device 101 according to certain embodiments of the present disclosure.

[0177] FIG. 14A illustrates an image capturing operation using the camera module 610 when the electronic device 101 does not shake.

[0178] According to some embodiments, the electronic device 101 may capture an image of the target object 1410 through the camera module 610. When the electronic device 101 is not shaken, an unblurred image may be captured through the image sensor 230 of the camera module 610. That is, a virtual axis 1420 (e.g., Figure 5 ) and the optical axis 1421 of the lens assembly 611 (e.g., Figure 5 The optical axis 521 and Figure 6 In addition, the optical axis 1421 of the lens assembly 611 is orthogonal to the image sensor 230. Meanwhile, referring to FIG. 14B and FIG. 14C , under the control of the image signal processor 260 and / or the processor 120, any shaking of the electronic device 101 may be detected.

[0179] 14B , according to some embodiments, a virtual axis 1420 connecting the center of the object 1410 and the camera module 610 may not coincide with an optical axis 1421 of the component 611 due to the shaking of the electronic device 101. When the virtual axis 1420 and the optical axis 1421 do not coincide with each other due to the shaking of the electronic device 101, the image sensor 230 may capture a blurred image.

[0180] In FIG. 14C , according to some embodiments, the electronic device 101 may control the camera module 610 so that the virtual axis 1420 and the optical axis 1421 coincide with each other. That is, the electronic device 101 (e.g., the image signal processor 260 and / or the processor 120) may move the camera module 610 so that the optical axis 1421 of the lens assembly 611 matches the virtual axis 1420 connecting the center of the object 1410 and the camera module 610. When the optical axis 1421 of the lens assembly 611 is tilted due to the shaking of the electronic device 101, the electronic device 101 may control (e.g., move) the camera module 610 so that the optical axis 1421 coincides with the virtual axis 1420. Based on this control, the image sensor 230 may capture an image without blurring. That is, the electronic device 101 may detect the shaking of the camera module 610, move the camera module 610 to compensate for the detected shaking, and capture an image while minimizing the influence of the shaking. For example, when the electronic device 101 is shaken, the electronic device 101 may move at a determined movement angle (eg, Fig.12 or Fig.13 The image stabilizer actuator 620 is controlled within a movement angle in (in). Therefore, the image stabilizer actuator 620 can drive the camera module 610 to perform a rotational movement relative to a first transverse axis 602 orthogonal to the optical axis 601 and / or a second transverse axis 603 orthogonal to the optical axis 601.

[0181] However, it is noted that the range to which the camera module 610 can move to compensate for the shake of the electronic device 101 is based on the position of the lens assembly 611 .

[0182] Fig.15 is a flowchart illustrating a method for controlling the motion of the camera 180 included in the electronic device 101 according to some embodiments of the present disclosure. Fig.16 1 is a diagram illustrating first to third moving positions of a lens assembly 611 included in the camera 180 according to certain embodiments of the present disclosure.

[0183] Reference Fig.15 , at operation 1501, the electronic device 101 may activate the camera 180 under the control of the image signal processor 260 and / or the processor 120. When the camera 180 is activated at operation 1501, the electronic device 101 may capture an image.

[0184] In some embodiments, the operation of capturing an image may be an operation of obtaining an image through the camera 180 of the electronic device 101 .

[0185] In some embodiments, the operation of capturing an image may be an operation of displaying an image acquired from the camera 180 as a preview image on a display of the electronic device 101 (eg, the display device 160 ).

[0186] At operation 1503 , the electronic device 101 may move the position of the lens assembly 611 under the control of the image signal processor 260 and / or the processor 120 to perform a focusing operation of focusing on a target object.

[0187] According to some embodiments, at operation 1503, the electronic device 101 may move the lens assembly 611 along the optical axis 601 to be closer to or farther away from the image sensor 230 during a focusing operation under the control of the image signal processor 260 and / or the processor 120. In addition, the lens assembly 611 may be moved with a lens carrier (e.g., Figure 7 or Fig.16 The optical axis 601 is combined with a lens carrier 612 in the optical system and can be moved in the direction of the optical axis 601 by moving the lens carrier 612.

[0188] At operation 1505 , the electronic device 101 may recognize the position of the lens assembly 611 moved in the focusing operation under the control of the image signal processor 260 and / or the processor 120 .

[0189] According to some embodiments, at operation 1505, information about the position of the lens assembly 611 may be determined based on at least one of a focus position determined by a focus adjustment operation, a physical position of at least one lens in the lens assembly 611, or a numerical value determined by a specified focal length. Based on the determined position information of the lens assembly 611, the electronic device 101 may predict the position of a portion where the lens assembly 611 collides with some components of the camera 180.

[0190] According to some embodiments, at operation 1505 , information about the position of the lens assembly 611 may be determined based on the focal length determined by the focus adjustment operation under the control of the image signal processor 260 and / or the processor 120 .

[0191] At operation 1507, when the movement position of the lens assembly 611 caused by the focusing operation is the first position (eg, Fig.16 1601 in the electronic device 101), the electronic device 101 can correct the movement of the camera module 610 within a first movement angle range corresponding to the first position under the control of the image signal processor 260 and / or the processor 120. For example, the first movement angle can be preset and stored within a range where the lens assembly 611 does not collide with a mechanism disposed inside the electronic device 101. In order to compensate for any shaking of the electronic device 101, the electronic device 101 can move the camera module 610 at a certain angle. If the movement position of the lens assembly 611 is the first position (for example, Fig.16 1601), the camera module 610 can only move within the first moving angle range.

[0192] At operation 1507, when the movement position of the lens assembly 611 caused by the focusing operation is the second position (eg, Fig.16 1602 in the figure), the electronic device 101 can correct the movement of the camera module 610 within a second movement angle range corresponding to the second position under the control of the image signal processor 260 and / or the processor 120. For example, the second movement angle can be preset and stored within a range where the lens assembly 611 does not collide with a mechanism disposed inside the electronic device 101. In order to compensate for any shaking of the electronic device 101, the electronic device 101 can move the camera module 610 at a certain angle. If the movement position of the lens assembly 611 is the second position (for example, Fig.16 1602), the camera module 610 can only move within the second moving angle range.

[0193] At operation 1507, when the movement position of the lens assembly 611 caused by the focusing operation is the third position (eg, Fig.161603 in the figure), the electronic device 101 can correct the movement of the camera module 610 within a third movement angle range corresponding to the third position under the control of the image signal processor 260 and / or the processor 120. For example, the third movement angle can be preset and stored within a range where the lens assembly 611 does not collide with a mechanism disposed inside the electronic device 101. In order to compensate for any shaking of the electronic device 101, the electronic device 101 can move the camera module 610 at a certain angle. If the movement position of the lens assembly 611 is the third position (for example, Fig.16 1603), the camera module 610 can only move within the third moving angle range.

[0194] According to some embodiments, at operation 1507, under the control of the image signal processor 260 and / or the processor 120, the electronic device 101 may determine that the movement position of the lens assembly 611 caused by the focusing operation is an infinite focus position as a first position (e.g., Fig.16 1601 in).

[0195] According to some embodiments, at operation 1507, under the control of the image signal processor 260 and / or the processor 120, the electronic device 101 may determine that the movement position of the lens assembly 611 caused by the focusing operation is an intermediate focus position as the second position (e.g., Fig.16 1602 in ).

[0196] According to some embodiments, at operation 1507, under the control of the image signal processor 260 and / or the processor 120, the electronic device 101 may determine that the movement position of the lens assembly 611 caused by the focusing operation is a macro focus position as a third position (e.g., Fig.16 1603 in ).

[0197] According to some embodiments, at operation 1507, the electronic device 101 may move the camera module 610 based on a movement angle determined depending on the focal length. For example, the electronic device 101 may identify the focal length of the target object and move the camera module 610 in response to the identified focal length. Specifically, if the focal length is a first focal length, the camera module 610 may move within a first movement angle range to compensate for shaking. If the focal length is a second focal length, the camera module 610 may move within a second movement angle range to compensate for shaking. For example, when the target object is a near object, the electronic device 101 may determine the focal length of the target object as the first focal length. In this case, the electronic device 101 may move the camera module 610 within a first range by using the image stabilizer actuator 620 to compensate for shaking. The electronic device 101 may identify the focal length of the target object in real time and adjust the movement angle of the camera module 610 differently depending on the identified focal length. The focal length may be changed in response to user input or may be automatically calculated by the camera 180.

[0198] Fig.16 1 is a diagram illustrating first to third moving positions of a lens assembly 611 included in the camera 180 according to certain embodiments of the present disclosure.

[0199] Reference Fig.16 , when the point adjacent to the image sensor 230 is at the lowest position (eg, 0), the lens assembly 611 may be moved from the lowest position to a predetermined maximum height (eg, H).

[0200] For example, when the range from the lowest position (e.g., 0) to the maximum height (e.g., H) is divided into three sections, the first section (0 to 1 / 3H) ranging from the lowest position (e.g., 0) to one third of the maximum height (e.g., 1 / 3H) may be referred to as the first position 1601. When the movement position of the lens assembly 611 caused by the focusing operation is at an infinite focus position, the lens assembly 611 may be located at the first position 1601.

[0201] In addition, a second section (1 / 3H to 2 / 3H) ranging from one third of the maximum height (e.g., 1 / 3H) to two thirds of the maximum height (e.g., 2 / 3H) may be referred to as a second position 1602. The lens assembly 611 may be located at the second position 1602 when the movement position of the lens assembly 611 caused by the focusing operation is at an intermediate focus position.

[0202] In addition, a third section (2 / 3H to H) ranging from two-thirds of the maximum height (e.g., 2 / 3H) to the maximum height (e.g., H) may be referred to as a third position 1603. If the movement position of the lens assembly 611 caused by the focusing operation is in the macro focusing position, the lens assembly 611 may be located at the third position 1603.

[0203] 17A and 17B are diagrams illustrating movement of a camera module 610 included in the electronic device 101 according to some embodiments of the present disclosure.

[0204] FIG. 17A shows a case where there is no movement of the camera module 610 caused by the image stabilizer actuator 620. The lens assembly 611 is coupled to the lens carrier 612 and can be moved in the direction of the optical axis 601 by the movement of the lens carrier 612. The lens carrier 612 may include, for example, a magnet and a coil. Under the control of the image signal processor 260 and / or the processor 120, the lens carrier 612 may control the electromagnetic force by controlling the current passing through the coil, and may also move the lens assembly 611 in the direction of the optical axis 601 by using the Lorentz force generated by the electromagnetic force.

[0205] FIG. 17B shows the lens assembly 611 when it moves to the first, second, or third position (eg, Fig.16 1601, 1602 or 1603 in FIG. ...

[0206] According to some embodiments, the electronic device 101 may identify (or determine) a predetermined moving angle range 1701 based on a specified distance (A) from a surface of a module housing (e.g., 640 in FIG. 10A ) on which the camera module 610 is mounted. That is, when the camera module 610 is placed in the module housing 640, the specified distance (A) may be determined based on a first surface of the module housing on which the image sensor 230 is disposed. The specified distance (A) may include a distance from the first surface of the module housing to a transparent cover or cover glass (e.g., 1190 in FIG. 11C or FIG. 11D ). The electronic device 101 may determine the moving angle range 1701 based on the specified distance (A), and the camera module 610 may compensate for shake without contacting the transparent cover or cover glass 1190. According to some embodiments, the specified distance (A) may be preset in the electronic device 101 and may be variably changed depending on the replacement of the camera module 610.

[0207] According to some embodiments, information about the position of the lens assembly 611 may be determined based on at least one of a focus position determined by a focus adjustment operation, a physical position of at least one lens in the lens assembly 611, or a value determined by a specified focal length. Based on the determined position information of the lens assembly 611, the electronic device 101 may predict the position of a portion where the lens assembly 611 collides with some components of the camera 180.

[0208] According to some embodiments, an electronic device (e.g., electronic device 101) may include a processor (e.g., processor 120) and a camera module (e.g., camera module 610) functionally connected to the processor. The camera module may include a lens assembly (e.g., lens assembly 611) including at least one lens and an image sensor (e.g., image sensor 230) for processing light acquired through the lens assembly. The processor may be configured to recognize position information of the lens assembly, move the camera module within a first range to correct jitter in an image acquired through the image sensor when the position information of the lens assembly corresponds to a first position, and move the camera module within a second range to correct jitter in an image acquired through the image sensor when the position information of the lens assembly corresponds to a second position.

[0209] According to some embodiments, a camera module (eg, camera module 610 ) may further include a focus control module configured to determine position information of a lens assembly (eg, lens assembly 611 ).

[0210] According to some embodiments, position information of a lens assembly (eg, lens assembly 611 ) may be determined based on at least one of a calculated focal distance focused on a target object, a focus position, or a physical position of the lens assembly.

[0211] According to some embodiments, the electronic device (e.g., electronic device 101) may further include a gyro sensor (e.g., sensor module 176) or an acceleration sensor (e.g., sensor module 176) provided inside or outside the camera module (e.g., camera module 610). In this case, the processor (e.g., processor 120) may be configured to move the camera module within the first range or the second range when movement of the electronic device is detected by the gyro sensor or the acceleration sensor.

[0212] According to certain embodiments, the electronic device (e.g., electronic device 101) may also include: a module housing (e.g., module housing 640) in which a camera module and an image stabilizer actuator (e.g., image stabilizer actuator 620) associated with the movement of the camera module (e.g., camera module 610) are disposed; and a rotation guide (e.g., rotation guide 630) that is combined with the module housing and provides guidance for the rotation angle of the camera module.

[0213] According to some embodiments, the electronic device (eg, electronic device 101) may further include at least one camera module stopper (eg, camera module stopper 1101 or 1102) capable of limiting the movement of a camera module (eg, camera module 610).

[0214] In accordance with certain embodiments, the processor (e.g., processor 120) may also be configured to move the camera module (e.g., camera module 610) within a third range to correct jitter in an image acquired by the image sensor (e.g., image sensor 230) when position information of the lens assembly (e.g., lens assembly 611) corresponds to a third position.

[0215] According to certain embodiments, the processor (e.g., processor 120) may also be configured to move the camera module (e.g., camera module 610) within a first range when position information of the lens assembly (e.g., lens assembly 611) corresponds to an infinite focus position.

[0216] According to certain embodiments, the processor (e.g., processor 120) may also be configured to move the camera module (e.g., camera module 610) within a second range when position information of the lens assembly (e.g., lens assembly 611) corresponds to an intermediate focus position.

[0217] According to certain embodiments, the processor (e.g., processor 120) may also be configured to move the camera module (e.g., camera module 610) within a third range when position information of the lens assembly (e.g., lens assembly 611) corresponds to a macro focus position.

[0218] According to some embodiments, an electronic device (e.g., electronic device 101) may include a camera (e.g., camera 180), at least one memory (e.g., memory 130), and at least one processor (e.g., processor 120) functionally connected to the camera and the at least one memory. The camera may include: a camera module (e.g., camera module 610) that is combined with an image sensor (e.g., image sensor 230) and performs a focusing operation by moving a lens assembly (e.g., lens assembly 611); and an image stabilizer actuator (e.g., image stabilizer actuator 620) that is used to move the camera module. The processor may be configured to activate the camera, move the position of the lens assembly in the focusing operation, determine a movement angle range of the camera module corresponding to the movement position of the lens assembly, and move the camera module within the determined movement angle range.

[0219] According to some embodiments, the electronic device (e.g., electronic device 101) may further include a gyro sensor (e.g., sensor module 176) or an acceleration sensor (e.g., sensor module 176) disposed inside or outside the camera. In this case, the processor (e.g., processor 120) may be configured to move the camera module (e.g., camera module 610) within a determined movement angle range when movement of the electronic device is detected by the gyro sensor or the acceleration sensor.

[0220] According to certain embodiments, the electronic device (e.g., electronic device 101) may also include: a module housing (e.g., module housing 640) in which a camera module (e.g., camera module 610) and an image stabilizer actuator (e.g., image stabilizer actuator 620) are disposed; and a rotation guide (e.g., rotation guide 630) which is combined with the module housing and provides guidance for the rotation angle of the camera module.

[0221] According to some embodiments, the electronic device (eg, electronic device 101) may further include at least one camera module stopper (eg, camera module stopper 1101 or 1102) capable of limiting the movement of a camera module (eg, camera module 610).

[0222] According to certain embodiments, the processor (e.g., processor 120) may also be configured to identify a moving position of a lens assembly (e.g., lens assembly 611) to move a camera module (e.g., camera module 610) within a first moving angle range when the moving position is a first position, to move the camera module within a second moving angle range when the moving position is a second position, and to move the camera module within a third moving angle range when the moving position is a third position.

[0223] In accordance with certain embodiments, the processor (e.g., processor 120) may also be configured to move the camera module (e.g., camera module 610) within a first moving angle range when the moving position of the lens assembly (e.g., lens assembly 611) corresponds to an infinite focus position.

[0224] According to certain embodiments, the processor (e.g., processor 120) may also be configured to move the camera module (e.g., camera module 610) within a second moving angle range when the moving position of the lens assembly (e.g., lens assembly 611) corresponds to an intermediate focus position.

[0225] According to certain embodiments, the processor (e.g., processor 120) may also be configured to move the camera module (e.g., camera module 610) within a third moving angle range when the moving position of the lens assembly (e.g., lens assembly 611) corresponds to a macro focus position.

[0226] According to some embodiments, the camera module may further include a focus control module configured to determine a movement position of a lens assembly (eg, lens assembly 611 ).

[0227] According to certain embodiments, a control method of an electronic device (e.g., electronic device 101) may include identifying position information of a lens assembly (e.g., lens assembly 611) included in a camera module (e.g., camera module 610) functionally connected to the electronic device, determining a moving range of the camera module as a first range when the position information of the lens assembly corresponds to a first position, determining a moving range of the camera module as a second range when the position information of the lens assembly corresponds to a second position, and controlling movement of the camera module based on the first range or the second range.

[0228] The electronic device according to the embodiment may be one of various types of electronic devices. The electronic device may include a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. However, the electronic device is not limited to any of the above.

[0229] Certain embodiments of the present disclosure and the terms used herein are not intended to limit the technical features set forth herein to specific embodiments, and include various changes, equivalents or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. The nouns in the singular form corresponding to the terms may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each phrase in the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with a corresponding phrase in the multiple phrases.

[0230] The term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or part of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0231] Some embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0232] The method according to the embodiment of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., PlayStore). TM ) The computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0233] Each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities. One or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. The operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0234] While the present disclosure has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the subject matter defined by the appended claims.

Claims

1. An electronic device, comprising: case; processor; a camera module functionally connected to the processor and disposed within the housing; as well as a transparent cover member disposed in the housing, Among them, the camera module includes: an image stabilizer actuator disposed within the housing; a lens assembly comprising at least one lens; and an image sensor for processing light captured by the lens assembly, and The processor is configured as follows: determining focus position information of the lens assembly, wherein the focus position information indicates that the lens assembly is away from the image sensor along the optical axis, When the focus position information of the lens assembly corresponds to a first position, controlling the image stabilizer actuator to move the lens assembly and the image sensor within a first maximum tilt range to compensate for a shake of the camera module, wherein the first maximum tilt range is configured to avoid contact between the lens assembly and the transparent cover member, and when the focus position information of the lens assembly corresponds to a second position, controlling the image stabilizer actuator to move the lens assembly and the image sensor within a second maximum tilt range to compensate for a shake of the camera module, wherein the second maximum tilt range is configured to avoid contact between the lens assembly and the transparent cover member, in: The lens assembly is further away from the image sensor along the optical axis in the second position than in the first position; and The second maximum tilt range is smaller than the first maximum tilt range.

2. The electronic device according to claim 1, wherein: The camera module also includes a focus control module configured to determine focus position information of the lens assembly.

3. The electronic device according to claim 1, wherein: The focus position information of the lens assembly is determined based on at least one of a focal length calculated to focus on the target object, a focus position, or a physical position of the lens assembly.

4. The electronic device according to claim 1, further comprising: A gyroscope sensor or an acceleration sensor disposed inside or outside the camera module, The processor is configured to move the camera module within a first maximum tilt range or a second maximum tilt range when movement of the electronic device is detected by the gyro sensor or the acceleration sensor.

5. The electronic device according to claim 1, further comprising: The rotation guide is combined with the housing and provides a guide for the rotation angle of the camera module.

6. The electronic device according to claim 5, further comprising: At least one camera module stopper is configured to limit movement of the camera module.

7. The electronic device according to claim 1, wherein: The processor is also configured to: When the focus position information of the lens assembly corresponds to a third position, controlling the image stabilizer actuator to move the lens assembly and the image sensor within a third maximum tilt range to compensate for a shake of the camera module; controlling the image stabilizer actuator to move the lens assembly and the image sensor within a first maximum tilt range when the focus position information of the lens assembly corresponds to an infinite focus position; controlling the image stabilizer actuator to move the lens assembly and the image sensor within a second maximum tilt range when the focus position information of the lens assembly corresponds to an intermediate focus position; as well as Wherein, the processor is further configured to move the lens assembly and the image sensor within a third maximum tilt range when the focus position information of the lens assembly corresponds to a macro focus position.

8. The electronic device according to claim 1, wherein: The processor is also configured to: Activate the camera to turn on the power of the camera. Moving the lens assembly to a focus position during a focusing operation, determining a range of movement angles of the camera module corresponding to a focus position of the moving lens assembly, and The camera module is moved within the determined moving angle range.

9. The electronic device according to claim 8, further comprising: A gyroscope sensor or an acceleration sensor installed inside or outside the camera. The processor is configured to move the camera module within a determined movement angle range when movement of the electronic device is detected by the gyro sensor or the acceleration sensor.

10. The electronic device according to claim 8, further comprising: The rotation guide receives the housing and provides a guide for the rotation angle of the camera module.

11. The electronic device according to claim 10, further comprising: At least one camera module stopper capable of limiting the movement of the camera module.

12. The electronic device according to claim 8, wherein: The processor is also configured to: Identify the focus position of the moving lens assembly, When the moved focus position is a first position, controlling the image stabilizer actuator to move the lens assembly and the image sensor within a first movement angle range, When the moved focus position is a second position, controlling the image stabilizer actuator to move the lens assembly and the image sensor within a second movement angle range, and When the moved focus position is a third position, the image stabilizer actuator is controlled to move the lens assembly and the image sensor within a third movement angle range.

13. The electronic device according to claim 12, wherein: The processor is also configured to: controlling the image stabilizer actuator to move the lens assembly and the image sensor within a first movement angle range when the focus position of the moving lens assembly corresponds to an infinite focus position; controlling the image stabilizer actuator to move the lens assembly and the image sensor within a second movement angle range when the focus position of the moved lens assembly corresponds to an intermediate focus position; as well as When the focus position of the moved lens assembly corresponds to a macro focus position, the image stabilizer actuator is controlled to move the lens assembly and the image sensor within a third movement angle range.

14. The electronic device according to claim 8, wherein: The camera module also includes a focus control module configured to determine a focus position of the moving lens assembly.

15. A method for controlling an electronic device, wherein the method comprises: identifying focus position information of a lens assembly included in a camera module functionally connected to the electronic device, wherein the focus position information indicates that the lens assembly is away from the image sensor along an optical axis; determining a movement range of the lens assembly and the image sensor within a first maximum tilt range when the focus position information of the lens assembly corresponds to a first position, wherein the first maximum tilt range is configured to avoid contact between the lens assembly and the transparent cover member; determining a movement range of the lens assembly and the image sensor within a second maximum tilt range when the focus position information of the lens assembly corresponds to a second position, wherein the second maximum tilt range is configured to avoid contact between the lens assembly and the transparent cover member, in: The lens assembly is further away from the image sensor along the optical axis in the second position than in the first position; and The second maximum tilt range is smaller than the first maximum tilt range; and Movement of the lens assembly and the image sensor is controlled based on the first maximum tilt range or the second maximum tilt range.

Citation Information

Patent Citations

  • Camera module

    KR1020180135269A

  • Image processing apparatus and method of controlling image processing apparatus

    US20160057351A1