Image stabilization method and electronic device therefor

Abstract

An electronic device can include a camera, a display, and at least one processor. The at least one processor can drive the camera to acquire image data, output a preview image of the image data through the display based on a set magnification, detect at least one object included in the preview image acquired through the camera in a state in which the set magnification is greater than a reference magnification, and stabilize the preview image based on whether the at least one object is detected. Various other embodiments understood from the specification are also possible.

Description

TECHNICAL FIELD

[0001] Embodiments disclosed herein relate to an electronic device performing image stabilization during photographing by a camera and a method thereof. BACKGROUND

[0002] Image stabilization in a camera function is a fundamental and important function to obtain a clear photo. In general, image stabilization includes optical image stabilization (OIS) and digital image stabilization (DIS). Optical image stabilization (e.g., OIS) is a method of reducing shaking by moving a lens or a sensor, and digital image stabilization (e.g., DIS) is a method of reducing shaking by a portable terminal and through digital processing.

[0003] DISCLOSURE

[0004] TECHNICAL PROBLEM

[0005] As the zoom ratio supported by an electronic device increases, a user can magnify a preview screen at a very high magnification. However, in the case where digital zoom is applied to provide a high magnification image, the electronic device outputs only some of the image data obtained by an image sensor as preview data, or stores it as an image file. As the zoom ratio increases, the motion of a preview image caused by a mobile phone increases greatly, and in the case where digital image stabilization is performed in high magnification photographing, the image stabilization range is calculated as the size ratio of a preview image and image data obtained through a camera, and thus the performance of image stabilization is ultimately deteriorated.

[0006] In addition, since the above-described image stabilization is not intended to be implemented by distinguishing slight shaking and a user's fine adjustment, it can be performed without performing image stabilization against the user's intention, or can be performed with an unnecessary stabilization strength. For example, image stabilization can not be applied to image motion caused by a user intentionally moving an electronic device to change a field of view (FOV).

[0007] Various embodiments of the disclosure can provide an electronic device that performs image stabilization against a user's unintentional shaking to stably capture an object during high magnification photographing, and a method of controlling the electronic device.

[0008] The technical problems addressed by embodiments disclosed herein are not limited to the above technical problems, and other technical problems not mentioned above will become apparent to those skilled in the art from the following description.

[0009] SOLUTION TO PROBLEM

[0010] An electronic device according to embodiments disclosed herein can include a camera, a display, and at least one processor electrically connected to the camera and the display. The at least one processor can be configured to obtain image data by driving the camera, output a preview image of the image data through the display based on a configured magnification, detect at least one object included in the preview image obtained through the camera in a state in which the configured magnification is greater than a reference magnification, and stabilize the preview image based on whether the at least one object is detected.

[0011] Further, a method of operating an electronic device according to embodiments disclosed herein can include obtaining image data by driving a camera, outputting a preview image of the image data through a display based on a configured magnification, detecting at least one object included in the preview image obtained through the camera in a state in which the configured magnification is greater than a reference magnification, and performing image stabilization on the preview image based on whether the at least one object is detected.

[0012] Further, an electronic device according to embodiments disclosed herein can include a camera and at least one processor electrically connected to the camera. The at least one processor can obtain image data by driving the camera, determine a margin region for image stabilization in response to a zoom input of a user, and output a preview image of the image data through a display based on a configured magnification, in a state in which the configured magnification is greater than a reference magnification, increase an image stabilization strength in response to a first trigger event for increasing the image stabilization strength, and decrease the image stabilization strength in response to a second trigger event for decreasing the image stabilization strength if the second trigger event occurs in a state in which the image stabilization strength is increased.

[0013] Advantages of the present application

[0014] According to various embodiments disclosed herein, an image stabilization function can be automatically provided when an object to be photographed is recognized.

[0015] Further, according to various embodiments, a user can be provided with an image that is not shaky in a high magnification photographing environment.

[0016] Further, various effects determined directly or indirectly herein can be provided. BRIEF DESCRIPTION OF DRAWINGS

[0017] Figure 1 An electronic device according to embodiments is illustrated.

[0018] Figure 2 is a block diagram illustrating an operation of performing image stabilization in an electronic device according to embodiments.

[0019] Figure 3 is a flowchart illustrating an operation of performing image stabilization according to whether an object is detected in an electronic device according to an embodiment.

[0020] Figure 4 is a flowchart illustrating an operation of changing a parameter value related to image stabilization according to whether an object detection satisfies a predetermined condition in an electronic device according to an embodiment.

[0021] Figure 5 is a flowchart illustrating an operation of adjusting the intensity of image stabilization according to whether a trigger event related to image stabilization occurs in an electronic device according to an embodiment.

[0022] Figure 6 is a graph illustrating that the intensity of image stabilization changes depending on whether a trigger event related to image stabilization occurs in an electronic device according to an embodiment.

[0023] Figure 7 is a user interface related to a trigger event of increasing the intensity of image stabilization in an electronic device according to an embodiment.

[0024] Figure 8 is a user interface related to a trigger event of decreasing the intensity of image stabilization in an electronic device according to an embodiment.

[0025] Figure 9 is a margin area in an electronic device according to an embodiment.

[0026] Figure 10 is a flowchart illustrating an operation of changing the intensity of image stabilization by determining a motion of an electronic device according to an embodiment.

[0027] Figure 11 is a flowchart illustrating an operation of controlling a display when a trigger event related to image stabilization occurs in an electronic device according to an embodiment.

[0028] Figure 12 is a display that changes on a display as a trigger event related to image stabilization occurs in an electronic device according to an embodiment.

[0029] Figure 13 is a block diagram of an electronic device in a network environment according to various embodiments.

[0030] Figure 14 is a block diagram of a camera module according to various embodiments. DETAILED DESCRIPTION

[0031] Hereinafter, various embodiments herein will be described with reference to the accompanying drawings. However, this is not intended to limit the present disclosure to specific embodiments and should be understood to encompass various modifications, equivalents, and / or alternatives of embodiments of the present disclosure.

[0032] Figure 1 An electronic device according to an embodiment is illustrated.

[0033] Referring to Figure 1 , according to an embodiment, the display 110 can be disposed on a front surface of the electronic device 100 (e.g., the electronic device 1301 in Figure 13 . In an embodiment, the display 110 can occupy a large portion of the front surface of the electronic device 100. The display 110 and a bezel 120 area surrounding at least some edges of the display 110 can be disposed on the front surface of the electronic device 100. In an example of Figure 1 , the display 110 can include a flat area 111 and a curved area 112 extending from the flat area 111 toward a side edge of the electronic device 100. While only the curved area 112 is shown on one side (e.g., the left side) of Figure 1 , it can be understood that the curved area is also formed on the opposite side. Further, Figure 1 The electronic device 100 illustrated in is merely an example, and various embodiments are all possible. For example, the display 110 of the electronic device 100 can include only the flat area 111 without the curved area 112, or can include the curved area 112 only at one edge rather than two edges. Further, in an embodiment, the curved area can extend to a rear surface of the electronic device 100 such that the electronic device 100 can include an additional flat area.

[0034] In an embodiment, a fingerprint sensor 141 for recognizing a user's fingerprint can be included in the first area 140 of the display 110. The fingerprint sensor 141 can be disposed under the display 110 so as to be invisible or almost invisible to the user. In addition to the fingerprint sensor 141, a sensor for additional user / biometric authentication can be disposed in a partial area of the display 110. In another embodiment, a sensor for user / biometric authentication can be disposed in one area of the bezel 120. For example, an IR sensor for iris authentication can be exposed through one area of the display 110 or through one area of the bezel 120.

[0035] In an embodiment, sensor 143 may be included in at least one area of ​​the bezel 120 of electronic device 100 or at least one area of ​​display 110. Sensor 143 may be a sensor for distance detection and / or a sensor for object detection. Sensor 143 may be positioned at a short distance from a camera module (e.g., front camera 131 and rear camera 132), or may be formed as a module with the camera module. For example, sensor 143 may operate as at least part of an infrared (IR) camera (e.g., a time-of-flight (TOF) camera or a structured light camera), or as a sensor module (e.g., Figure 13 At least a portion of the operation of the sensor module 1376 in the sensor module.

[0036] In one embodiment, the front-facing camera 131 may be disposed on the front surface of the electronic device 100. Although in Figure 1 In one embodiment, the front-facing camera 131 is shown to be exposed through an area of ​​the display 110, but in another embodiment, the front-facing camera 131 may be exposed through the bezel 120.

[0037] In an embodiment, the display 110 may include a sensor module (e.g., located on the rear surface of the screen display area (e.g., flat area 111 or curved area 112)). Figure 13 (e.g., sensor module 1376), camera module (e.g., front camera 131, rear camera 132, or...) Figure 13 One or more of the camera module 1380 and the light-emitting device (e.g., LED).

[0038] In embodiments, the camera module may be disposed on the back side of at least one of the front, side, and / or rear surfaces of the electronic device 100, facing the front, side, and / or rear surfaces. For example, the front-facing camera 131 may be an under-display camera (UDC) that is not visually exposed to the screen display area (e.g., flat area 111 or curved area 112). In embodiments, the electronic device 100 may include one or more front-facing cameras 131. For example, the electronic device 100 may include two front-facing cameras, such as a first front-facing camera and a second front-facing camera. In embodiments, the first and second front-facing cameras may be cameras of the same type with the same specifications (e.g., pixels), but the first and second front-facing cameras may be implemented as cameras with different specifications. The electronic device 100 may support dual-camera related functions (e.g., 3D shooting, autofocus, etc.) through the two front-facing cameras.

[0039] In an embodiment, the rear camera 132 can be disposed on the rear surface of the electronic device 100. The rear camera 132 can be exposed through the camera region 130 of the rear cover 160. In an embodiment, the electronic device 100 can include a plurality of rear cameras disposed in the camera region 130. For example, the electronic device 100 can include two or more rear cameras. For example, the electronic device 100 can include a first rear camera, a second rear camera, and a third rear camera. The first rear camera, the second rear camera, and the third rear camera can have different specifications. For example, the first rear camera, the second rear camera, and / or the third rear camera can differ from each other in terms of FOV, pixels, aperture, whether optical zoom / digital zoom is supported, whether an image stabilization function is supported, the type of lens group included in each camera, and / or the arrangement thereof, etc. For example, the first rear camera can be a normal camera, the second rear camera can be a camera for wide-angle shooting (wide-angle camera), and the third rear camera can be a telephoto camera. In the embodiments herein, the description of the function or characteristics of the front camera can be applied to the rear camera, and vice versa.

[0040] In an embodiment, various types of hardware or sensors for assisting shooting, such as the flash 145, can also be disposed in the camera region 130. For example, various sensors, such as a distance sensor for detecting the distance between the object and the electronic device 100, can also be included.

[0041] In an embodiment, the distance sensor can be disposed at a short distance from the camera module (e.g., the front camera 131 or the rear camera 132), or formed as a single module with the camera module. For example, the distance sensor can operate as at least a part of an infrared (IR) camera (e.g., a time-of-flight (TOF) camera or a structured light camera), or as at least a part of a sensor module (e.g., the sensor module 1376 in FIG. 13B). Figure 13 For example, the TOF camera can operate as at least a part of a sensor module (e.g., the sensor module 1376 in FIG. 13B) for detecting the distance to the object. Figure 13 For example, the TOF camera can operate as at least a part of a sensor module (e.g., the sensor module 1376 in FIG. 13B) for detecting the distance to the object.

[0042] In an embodiment, at least one physical key can be disposed at the side of the electronic device 100. For example, a first function key 151 for turning on / off the display 110 or turning on / off the electronic device 100 can be disposed at the right edge of the electronic device 100 based on the front surface of the electronic device 100. In an embodiment, a second function key 152 for controlling the volume or screen brightness of the electronic device 100 can be disposed at the left edge of the electronic device 100 based on the front surface of the electronic device 100. In addition to this, an additional button or key can be disposed at the front surface or the rear surface of the electronic device 100. For example, a physical button or a touch button mapped to a specific function can be disposed in the lower area of the front bezel 120.

[0043] Figure 1 The electronic device 100 shown in FIG. 1 is merely an example and is not intended to limit the shape of a device to which the technical idea disclosed herein is applied. For example, the technical idea disclosed herein can be applied to a foldable electronic device capable of being folded horizontally or vertically by employing a flexible display 110 and a hinge structure, or a tablet or laptop computer. Also, although the electronic device 100 of the illustrated example shows a bar or plate-shaped appearance, various embodiments herein are not limited thereto. For example, the illustrated electronic device can be a part of a rollable electronic device. The "rollable electronic device" can indicate that the display 110 is capable of being bent and deformed such that at least a portion thereof can be wound or rolled up, or accommodated inside the electronic device 100. The rollable electronic device can unfold the display 110, or can expose a larger area of the display 110 to the outside according to a user's needs, such that a screen display area (e.g., the flat area 111 and the curved area 112) can be enlarged or used. The display 110 can be referred to as a slide-out display or an expandable display.

[0044] Hereinafter, for the convenience of description, various embodiments will be described based on the electronic device 100 shown in FIG. 1. Figure 1 Hereinafter, for the convenience of description, various embodiments will be described based on the electronic device 100 shown in FIG. 1.

[0045] Figure 2 is a block diagram illustrating an operation of performing image stabilization in an electronic device according to an embodiment. In the description of Figure 2 , a configuration and / or a function described in Figure 1 may be described briefly, or the description thereof can be omitted.

[0046] Referring to Figure 2 , the electronic device 100 can support functions for performing image stabilization using hardware and / or software modules. For example, the processor 210 (e.g., the processor 1320 in Figure 13 ) can drive the trigger module 201, the image stabilizer module 203, and the photographing control module 205 by executing instructions stored in the memory 230 (e.g., the memory 1330 in Figure 13 ). In various embodiments, software modules other than those shown in Figure 2 may be implemented. For example, at least two modules can be integrated into one module, or one module can be divided into two or more modules. Also, hardware and software modules can share a single function, thereby improving work performance. For example, the electronic device 100 can include both an encoder implemented as hardware and an encoder implemented as a software module, such that some data obtained through at least one camera module can be processed in the hardware encoder, and the remaining data can be processed in the software encoder.

[0047] In this embodiment, the triggering module 201 can generate a trigger signal based on user input and / or object detection. The triggering module 201 can provide the generated trigger signal to the image stabilizer module 203. The trigger signal may include a first trigger event and a second trigger event. The first trigger event can be understood as a trigger event used to increase the intensity of image stabilization. The second trigger event can be understood as a trigger event used to decrease the intensity of image stabilization. The first trigger event may be referred to as a lock trigger. The second trigger event may be referred to as an unlock trigger.

[0048] In this embodiment, user input may include at least user input via touch on the display and / or user input via buttons. Button input may include physical buttons and / or virtual buttons. Display touch input may share an autofocus (AF) signal. For example, display touch input may include user touch input on autofocus (AF) generated according to the execution of AF.

[0049] In an embodiment, object detection may include analyzing data transmitted through camera 220 (e.g., ...). Figure 13 The camera module 1380 in the image module obtains the image data to detect objects. For example, object detection can include natural object (e.g., moon and sun) detection, face detection, body detection, and gesture detection. Object detection can include simply detecting the basic shape of a natural object as well as detecting its deformed shape. For example, it can include detecting various types of moons, such as new moon, crescent moon, and full moon.

[0050] In embodiments, object detection may include detecting at least one object using various detection methods. The triggering module 201 may use artificial intelligence (AI), such as machine learning, to detect the object. For example, object detection may include detecting the object using segmentation techniques (e.g., segmentation) and / or edge detection methods. Edge detection methods can be understood as methods that detect objects using differences in color values ​​between pixels. Various detection methods are not limited to the segmentation techniques and edge detection methods described above, and may include various methods previously disclosed.

[0051] In one embodiment, if a specific gesture is detected, the triggering module 201 can send information about the specific gesture to the shooting control module 205.

[0052] In an embodiment, the image stabilizer module 203 can calculate the motion of the electronic device through a motion sensor included in the electronic device 100. The image stabilizer module 203 can calculate the position (e.g., the current position) of the electronic device 100 and / or the position at the time when the trigger occurs in order to fix the field of view (FOV) at the time when the trigger occurs. The image stabilizer module 203 can obtain the trigger signal transmitted from the trigger module 201 and adjust the strength of the image stabilization. For example, if a lock trigger event occurs, the image stabilizer module 203 can increase the strength of the image stabilization based on the position of the electronic device 100 at the time when the lock trigger occurs. When an unlock trigger event occurs, the image stabilizer module 203 can decrease the strength of the image stabilization.

[0053] In an embodiment, the motion sensor can include an acceleration sensor, a gyro sensor (gyroscope), a magnetic sensor, or a Hall sensor. However, these sensors are exemplary, and the motion sensor can further include at least one other type of sensor.

[0054] In an embodiment, the acceleration sensor is a sensor configured to measure acceleration acting on three axes (e.g., an X-axis, a Y-axis, or a Z-axis) of the electronic device 100, and can measure, estimate, and / or detect a force applied to the electronic device 100 using the measured acceleration.

[0055] In an embodiment, the gyro sensor is a sensor configured to measure an angular velocity acting on three axes (e.g., an X-axis, a Y-axis, or a Z-axis) of the electronic device 100, and can measure and / or detect an amount of rotation of the electronic device 100 with respect to each axis using the measured angular velocity information on each axis.

[0056] In an embodiment, the magnetic (geomagnetic or geomagnetic field) sensor and the Hall sensor can include a transmitter for generating a magnetic field of a specific frequency and a receiver for receiving the magnetic field generated by the transmitter, and obtain a motion direction and / or a motion distance of the electronic device 100. The magnetic (geomagnetic) sensor can measure a bearing using a magnetic field and a magnetic force line, and the Hall sensor can detect the strength of the magnetic field to identify the motion of the electronic device 100. The Hall sensor can be configured as at least a part of the camera module 1380 of the camera 220 (e.g., Figure 14 , thereby performing the function of the image stabilizer (e.g., Figure 14 ). For example, the camera 220 can use the coil and / or the magnet of the image stabilizer (e.g., Figure 14 ) to perform the image stabilization function, and identify the positional displacement of the magnet based on the change in the magnetic field identified through the Hall sensor.

[0057] In an embodiment, the photographing control module 205 can provide a user with a user interface (UI) / graphical UI (GUI) related to a camera through the display 110. Also, it can control a photographing operation in response to a user input provided through the UI / GUI output to the display 110. For example, the photographing control module 205 can obtain a recording start / stop input from a user and transmit the obtained recording start / stop input to the encoder. The input obtained from the user can include an input obtained through a voice recognition function or detection of a specific gesture. For example, if the processor 210 recognizes a voice such as "take a picture," "take a photo," and "stop taking a photo," it can start / stop photographing in response thereto. Or, if the processor 210 detects a gesture of showing a palm, it can start / stop photographing in response thereto.

[0058] In an embodiment, the display 110 can display an execution screen of an application program executed by the processor 210 or content such as an image and / or a video stored in the memory 230 on the display 110. In addition, the processor 210 can display image data obtained through the camera 220 on the display 110 in real time. The display 110 can output a preview area as a preview image, the preview area being cropped and / or resized to conform to a resolution of a current preview image.

[0059] In an embodiment, the image signal processor 240 (e.g., the image signal processor 1460 in Figure 14 In an embodiment, the image signal processor 240 (e.g., the image signal processor 1460 in

[0060] In Figure 2 In an embodiment of the electronic device 100, the functions performed by the trigger module 201, the image stabilizer module 203, and the photographing control module 205 can be understood as being performed by the processor 210 that executes instructions stored in the memory 230. In addition, in various embodiments, the electronic device 100 can use one or more hardware processing circuits to perform various functions and operations disclosed herein. For example, an application processor (AP) included in a mobile device, an image signal processor (ISP) mounted to a camera module, a display driver integrated circuit (DDIC), a touch IC, a communication processor (CP), a hardware encoder, etc. can be used to implement various embodiments disclosed herein. In addition, the electronic device 100 can use a combination of hardware and software to perform various functions and operations disclosed herein. Figure 2The connection between the illustrated hardware / software is provided for convenience only and is not intended to limit the flow / direction of data or instructions. The elements included in the electronic device 100 can have various electrical / operational connection relationships.

[0061] Figure 3 is a flowchart illustrating an operation of performing image stabilization according to whether an object is detected in an electronic device according to an embodiment. Figure 3 The embodiments described in the specification and their subsequent drawings can be applied to capturing a moving image as well as capturing a still image. In the following embodiments, the respective operations can be sequentially performed, but are not necessarily sequentially performed. For example, the order of the respective operations can be changed, and at least two operations can be performed in parallel. Figure 3 The operation entities of the illustrated flowcharts can be understood as a processor (for example, the processor 210 in Figure 2 ) or an image signal processor (for example, the image signal processor 240 in Figure 2 ).

[0062] According to an embodiment, in operation 310, the processor 210 can obtain image data by driving the camera 220.

[0063] In an embodiment, the processor 210 can execute a camera application. For example, the processor 210 can obtain a user input for executing the camera application. The user input can include touching an icon of the camera application, tapping the first function key 151 or the second function key 152, and inputting at least one of a voice such as "OOO, open the camera" or "OOO, execute the camera" through artificial intelligence (AI) voice recognition. The processor 210 can execute the camera application in response to at least one of the user input.

[0064] In an embodiment, the processor 210 can execute the camera application to drive the camera 220. The processor 210 can drive the camera 220 to obtain image data through an image sensor (for example, the image sensor 1430 in Figure 14 ). The image data can obtain various color values through a color filter array. The color filter array can include an RGB color filter array. RGB is only an example, and the color filter array can include a color filter array of a red, green, blue, and emerald green (RGBE) pattern, a cyan, yellow, and magenta (CYYM) pattern, a cyan, yellow, green, and magenta (CYGM) pattern, or a red, green, blue, and white (RGBW) pattern.

[0065] According to an embodiment, in operation 320, the processor 210 can output a preview image of the image data through the display 110 based on the configured magnification. The output of the preview image based on the configured magnification can be referred to or called a first mode. In other words, the first mode can be understood as a mode in which image processing is performed at a base value before the strength of image stabilization is improved.

[0066] In an embodiment, the processor 210 can display a preview image on the display based on a reference magnification (e.g., x1.0). For example, if a camera application is executed, the processor 210 can display a preview image on at least a portion of the display 110 based on a reference magnification (e.g., x1.0).

[0067] In an embodiment, the processor 210 can crop some of the obtained image data, thereby determining a region to be output as a preview image. In response to a zoom input (e.g., x1.5) from a user, the processor 210 can crop image data corresponding to the zoom input, thereby determining a region to be output as a preview image. The processor 210 can enlarge the determined region and output it as a preview image through the display 110.

[0068] According to an embodiment, in operation 330, the processor 210 can detect at least one object included in the preview image in a state in which the configured magnification is greater than a reference magnification. Here, a magnification greater than the reference magnification can be understood as a high magnification (e.g., x5.0 or more) and / or an ultra-high magnification (e.g., x50.0 or more). Here, detecting an object can be understood as including that the processor 210 detects an object through an object detection function by analyzing image data, and that a user selects an object displayed in a preview image.

[0069] In an embodiment, the processor 210 can detect at least one object through the camera 220. The processor 210 can analyze image data obtained through the camera 220, thereby detecting at least one object through an object detection function. The object detection can include detecting an object through a partitioning technique (e.g., segmentation) and / or an edge detection method. Alternatively, the processor 210 can determine an object based on data obtained through machine learning and / or deep learning. For example, the processor 210 can detect a crescent moon in a dark night sky through a function (e.g., a scene optimizer) of the electronic device 100. In the case of photographing a dark night sky, the processor 210 can determine an object (e.g., a moon) in consideration of an average shape of the object (e.g., the moon), an average color of the object (e.g., the moon), and the like.

[0070] In an embodiment, the processor 210 can detect the object in response to a user input of selecting the object displayed in the preview image. The user input can be understood as a user input through at least one touch input on the display. The processor 210 can display an auto focus (AF) on the object displayed in the preview image, and detect the object in response to a user input of selecting the AF.

[0071] According to an embodiment, in operation 340, the processor 210 can stabilize the preview image based on whether at least one object is detected. The processor 210 can control the intensity of image stabilization in response to detecting at least one object. For example, if at least one object is detected, the processor 210 can increase the intensity of image stabilization in order to stably photograph the detected object. The state in which the intensity of image stabilization is increased can be referred to or called as a second mode herein. In other words, the second mode can be understood as a mode in which image processing is performed by increasing the intensity of image stabilization in response to detecting an object.

[0072] In an embodiment, if the object is not detected from the preview image in a state in which the configured magnification is greater than the reference magnification, the processor 210 can operate in the first mode.

[0073] Figure 4 is a flowchart illustrating an operation of changing a parameter value related to image stabilization according to whether an object detection in an electronic device satisfies a predetermined condition according to an embodiment. In the following embodiment, the respective operations can be sequentially performed, but are not necessarily sequentially performed. For example, the respective operations can be sequentially performed, but are not necessarily sequentially performed. For example, the order of the respective operations can be changed, and at least two operations can be performed in parallel. Figure 4 The operation entity of the illustrated flowchart can be understood as a processor (for example, the processor 210 in Figure 2 ) or an image signal processor (for example, the image signal processor 240 in Figure 2 ).

[0074] According to an embodiment, in operation 410, the processor 210 can output a preview image of image data through the display 110 based on a configured magnification. Operation 410 can correspond to operation 320 in Figure 3 .

[0075] According to an embodiment, in operation 420, the processor 210 can perform stabilization by configuring a parameter value related to image stabilization to a first value. The processor 210 can perform stabilization while maintaining the parameter value related to image stabilization to a default value in a normal photographing mode.

[0076] According to an embodiment, in operation 430, the processor 210 can determine whether at least one object is detected within the designated area of the preview image for a predetermined time. For example, the processor 210 can identify whether a certain condition is satisfied to determine whether the user has an intention to photograph the object detected in the preview image. For example, if the object is continuously detected during N frames, the processor 210 can change a parameter related to image stabilization and output a stabilized preview image. As another example, if the object is not continuously detected during N frames, the processor 210 can not change the parameter related to image stabilization. The determined time can be calculated in units of frames or in units of seconds.

[0077] In an embodiment, the processor 210 can determine whether the detected object is detected within the designated area based on a center point of the detected object. For example, the processor 210 can determine whether the center point of the detected object falls within a certain ratio (e.g., 50%) of the preview image. If at least one object is detected within the designated area of the preview image for a predetermined time, the processor 210 can perform operation 440, and otherwise, operation 420.

[0078] According to an embodiment, in operation 440, the processor 210 can change a parameter value related to image stabilization to a second value different from the first value and then perform stabilization. The second value can be greater than the first value. For example, the processor 210 can minimize noise corresponding to shaking by increasing a coefficient of a low-pass filter. The low-pass filter can be included in a path through which the processor 210 obtains image data from an image sensor of the camera 220.

[0079] Figure 5 is a flowchart illustrating operations of adjusting the intensity of image stabilization according to whether a trigger event related to image stabilization occurs in an electronic device according to an embodiment. In the following embodiment, the respective operations can be sequentially performed, but are not necessarily sequentially performed. For example, the order of the respective operations can be changed, and at least two operations can be performed in parallel. Figure 5 The operation entities of the illustrated flowchart can be understood as a processor (e.g., the processor 210 in Figure 2 ) or an image signal processor (e.g., the image signal processor 240 in Figure 2 ).

[0080] According to an embodiment, in operation 510, the processor 210 can output a preview image of the obtained image data on the display 110. This can correspond to operation 320 in Figure 3 .

[0081] According to an embodiment, in operation 520, processor 210 can determine a margin area for image stabilization based on the obtained zoom ratio. The margin area can be understood as the difference between the input image obtained by camera 220 and the output image to be output as a preview image. References will follow. Figure 9 Further describe the margin area.

[0082] According to an embodiment, in operation 530, the processor 210 may determine whether a first triggering event has occurred. The first trigger may be referred to as a zoom lock trigger or a FoV fixation trigger. A zoom lock trigger may indicate an event that causes the electronic device 100 to perform an image stabilization function to stabilize the field of view of the output image.

[0083] In this embodiment, zoom lock triggering may include at least one of user touch input on the display, user button input, user voice input, and object detection. User touch input on the display may include a user touching an object they wish to photograph. Touching the object can be used in conjunction with autofocus (AF) functionality. For example, in the case of AF on the object, touching the object may include user input that the AF is being touched. User voice input may include input such as "OOO, fix camera" or "OOO, increase camera shake intensity" via artificial intelligence (AI) voice recognition.

[0084] In embodiments, zoom lock triggering can be performed based on changes in the state of electronic device 100 (e.g., unfolded or extended state). For example, based on changes in the unfolding or extension of display 110 (e.g., flexible display), electronic device 100 can display a preview image corresponding to zoom lock triggering, or display a user interface showing an area cropped from the original image data (e.g., ...). Figure 12 Highlighted portions (e.g., in the user interface 1210) and / or in the extended display area (e.g., the screen display area) Figure 12 The highlighted part in 1220).

[0085] In this embodiment, if a first triggering event occurs, the processor 210 may execute operation 540; otherwise, operation 510 is executed.

[0086] In one embodiment, zoom lock triggering may include detecting the object to be photographed (e.g., the moon).

[0087] According to an embodiment, in operation 540, processor 210 can increase the intensity of image stabilization. Processor 210 can increase the intensity of image stabilization in response to the occurrence of a first triggering event.

[0088] According to an embodiment, in operation 550, the processor 210 can output an image obtained by performing image stabilization through the display 110. The processor 210 can perform stabilization based on the strength of the image stabilization increased in operation 540. The processor 210 can output a preview image generated by the image stabilization to the display 110.

[0089] According to an embodiment, in operation 560, the processor 210 can determine whether a second trigger event occurs. The second trigger can be referred to or called as a zoom unlock trigger or a FoV movement trigger. The zoom unlock trigger can indicate an event that causes the electronic device 100 to stop the image stabilization function or to reduce the strength of the image stabilization function such that the field of view of the output image moves.

[0090] In an embodiment, the zoom unlock trigger can include a display touch input and a button input of the user in the second mode in which the zoom is locked. If an input of touching a subject being photographed and / or a button input (e.g., a zoom unlock button) is obtained in the second mode in which the zoom is locked, the processor 210 can identify the same as the zoom unlock trigger.

[0091] In an embodiment, the zoom unlock trigger can include a case in which the subject being detected is no longer detected in the second mode in which the zoom is locked. For example, if the subject being detected falls outside the preview image, the processor 210 can identify the same as the zoom unlock trigger. If analysis is performed on image data obtained by the camera 220 and if the subject being detected is not detected from the image data, the processor 210 can identify the same as the zoom unlock trigger.

[0092] In an embodiment, the zoom unlock trigger can include a case in which there is no longer a stabilization margin to be stabilized in the second mode in which the zoom is locked. In other words, the zoom unlock trigger can include a case in which the preview image of the current frame falls outside the margin region determined when the first trigger event occurs.

[0093] In an embodiment, the zoom unlock trigger can be performed based on a change in the state (e.g., a folded state or a reduced state) of the electronic device 100. For example, based on a change in the display 110 (e.g., a flexible display) being folded or reduced, the electronic device 100 can display a preview image corresponding to the zoom unlock trigger and / or a user interface (e.g., a user interface 1210 in FIG. 12B) displaying a region cropped from the original image data in a reduced display region (e.g., a screen display region). Figure 12

[0094] In an embodiment, the zoom unlock trigger can include a case in which the processor 210 analyzes the motion of the electronic device 100 in the second mode in which the zoom is locked and detects a motion greater than or equal to a threshold speed. Reference will be made to FIG. 13. Figure 10 ​A further description related thereto is made.

[0095] In an embodiment, the processor 210 can perform operation 570 if a second trigger event occurs, and otherwise, operation 550.

[0096] According to an embodiment, in operation 570, the processor 210 can perform the stabilization while reducing the intensity of the stabilization. The processor 210 can gradually reduce the intensity of the stabilization. For example, the processor 210 can reduce to a reference value during a first time. The processor 210 can output a preview image generated by the image stabilization for each frame while reducing the intensity of the image stabilization. For example, in various embodiments herein, a state in which the intensity of the stabilization is gradually reduced can be referred to or called a third mode.

[0097] According to an embodiment, in operation 580, the processor 210 can determine whether the intensity of the stabilization is lower than a reference value. The processor 210 can determine whether the intensity of the stabilization is lower than a reference value and gradually reduce the intensity of the stabilization until the intensity of the image stabilization is reduced to the reference value.

[0098] In an embodiment, the processor 210 can perform operation 590 if the intensity of the stabilization is lower than the reference value, and otherwise, operation 570.

[0099] According to an embodiment, in operation 590, the processor 210 can output a preview image of the obtained image data through the display 110. If the intensity of the image stabilization is reduced to the reference value in response to a zoom unlock trigger event (e.g., a second trigger event), the processor 210 can display a preview image obtained by performing the image stabilization corresponding to the reference value on the display 110.

[0100] Figure 6 A graph showing that the intensity of the image stabilization according to an embodiment changes depending on whether a trigger event related to the image stabilization occurs in the electronic device is illustrated. Figure 6 A graph illustrating the intensity of the image stabilization described in Figure 5 is described. Since the intensity of the image stabilization, the first trigger event, and the second trigger event mentioned in Figure 6 are the same as those described in Figure 5 , a description thereof is omitted in Figure 6 .

[0101] In an embodiment, the processor 210 can increase the intensity of the image stabilization to a maximum value if a first trigger event occurs. The first trigger event can be referred to or called a lock trigger. The processor 210 can maintain the intensity of the image stabilization at a minimum level until the first trigger event occurs, and increase the intensity of the image stabilization to a maximum level in response to the first trigger event, thereby outputting a preview image in which shaking is minimized.

[0102] In an embodiment, the processor 210 can reduce the intensity of image stabilization to a minimum value if a second trigger event occurs. The second trigger event can be referred to or called as an unlock trigger.

[0103] Figure 7 A user interface related to a trigger event for increasing the intensity of image stabilization in an electronic device according to an embodiment is illustrated.

[0104] Referring to Figure 7 When the application is executed, the processor 210 can output a user interface such as a screen <701> to the display 110 of the electronic device 100.

[0105] In an embodiment, the user interface of the application can include a first area 710 in which a photographing icon 711, a camera switching icon 712, a recent image icon 713, and the like are disposed. In the embodiments herein, an icon can be replaced with a term such as a button, a menu, an object, and the like. In addition, Figure 7 The icons illustrated in the first area 710 in <701> are exemplary, and four or more icons can be disposed, or some icons can be replaced or omitted by other icons.

[0106] In an embodiment, the user interface can include a second area 720 that displays various photographing modes (such as photographing, video recording, slow motion recording, and the like) supported by the application and / or a currently selected photographing mode. The user can change the photographing mode through a designated input. For example, although the screen <701> displays a photographing mode, if a user input of swiping the display 110 from right to left is detected, the processor 210 can change the photographing mode to a video recording mode. The electronic device 100 can support three or more photographing modes, and various photographing modes not illustrated can be switched through a user input and displayed in the second area 720 as described above.

[0107] In an embodiment, the user interface can include a third area 730 that displays an image being photographed, such as a preview image. However, in addition to the third area 730, a preview image or a real-time captured image can also be output to another area. For example, if the electronic device 100 starts recording a video, items displayed in the second area 720 or the fourth area 740 can not need to be exposed to the user until the recording ends, and thus, in addition to the third area 730, a real-time captured image can also be output to an area including the second area 720 or the fourth area 740. In addition, the real-time captured image can be extended to the first area 710. Some icons can remain displayed to be superimposed on the real-time photographed image.

[0108] In an embodiment, the user interface can include a fourth area 740 in which a setting menu capable of configuring settings, a flash, an aspect ratio, etc. is displayed. Parameters included in the configuration information can be configured through the fourth area 740. For example, a user can configure a resolution, a frame rate, a filter, or an aspect ratio of a video recorded by selecting a setting icon included in the fourth area or selecting an aspect ratio icon therein.

[0109] In an embodiment, the processor 210 can display a user interface 750 on the display 110, which shows an area to be cropped. The user interface 750 can be referred to or called as a zoom map.

[0110] In an embodiment, the processor 210 can display a zoom map of a certain zoom or a higher zoom ratio on the display 110. For example, the processor 210 can not display a zoom map of a first zoom ratio (e.g., a zoom ratio of x1), but if a zoom input greater than or equal to a second zoom ratio (e.g., a zoom ratio of x10) is obtained, a zoom map is displayed on the display 110.

[0111] In an embodiment, the processor 210 can display a zoom map based on an optical zoom input and a digital zoom input. For example, if a user input for zooming in is obtained after image data of a certain zoom ratio is obtained through optical zoom, the processor 210 can crop at least a portion of the image of the certain zoom ratio. The processor 210 can provide information about a ratio of the at least a portion cropped to the image data of the certain zoom ratio through the zoom map. For example, if the ratio is 1:10, the processor 210 can display the zoom map as cropped area: zoom map area = 1:10.

[0112] In an embodiment, the processor 210 can adjust a size of a cropped area displayed on a zoom map based on a zoom ratio. For example, in the case of a first ratio (e.g., a maximum zoom ratio), the processor 210 can display a cropped area having a first size (e.g., a minimum size) on the zoom map. In the case of a ratio (e.g., a second ratio) less than the first ratio (e.g., a maximum zoom ratio), the processor 210 can display a cropped area having a size (e.g., a second size) greater than the first size (e.g., a minimum size) on the zoom map.

[0113] In an embodiment, although Figure 7 Although an object shown in a preview image is displayed on a zoom map, the processor 210 can display a cropped area on the zoom map and can not display an object thereon.

[0114] Although, for the sake of convenience of description, Figure 7The first area 710, the second area 720, the third area 730, and the fourth area 740 are shown as being reserved in screens <701>, <702>, and <703> in the embodiment of FIGS. 7A and 7B, but some areas can be omitted, or modified before / after starting photographing during a switching operation of the camera, according to implementation of the application.

[0115] In the embodiment, the above description of the first area 710, the second area 720, the third area 730, the fourth area 740, and the user interface 750 can be equally applied to Figure 8 screens <801>, <802>, and <803> in the embodiment of FIGS. 8A and 8B, and Figure 12 screens <1201>, <1202>, <1203>, and <1204> in the embodiment of FIGS. 12A and 12B.

[0116] According to an embodiment, the screen <701> can indicate a screen in which the object 741 is detected in a case where the zoom ratio is increased to a certain zoom ratio or more in the photographing mode after the camera application is executed. For example, the screen <701> can indicate a screen in which the object (e.g., the moon) is detected in a state where the zoom-in operation is performed at a certain ratio (a zoom ratio of x20) or more by the zoom input of the user after the photographing mode is executed. If the object is detected, the processor 210 can display a region of interest around the object 741 to indicate that the object 741 has been detected. Displaying the region of interest can be used in common with displaying an auto focus (AF). The processor 210 can increase the intensity of the image stabilization in response to detecting the object 741.

[0117] According to an embodiment, the screen <702> can indicate that a user input 742 for selecting the object 741 shown in the preview image is obtained. The processor 210 can increase the intensity of the image stabilization in response to obtaining the user input 742.

[0118] According to an embodiment, the screen <703> can indicate that a user input 743 for selecting an item (e.g., a lock icon and / or a padlock icon) that enables the image stabilization function to be executed from the third area 730 of the display 110 is obtained. The processor 210 can increase the intensity of the image stabilization in response to obtaining the user input 743 that selects the item.

[0119] Figure 8 A user interface related to a triggering event of reducing the intensity of the image stabilization in an electronic device according to an embodiment is shown.

[0120] According to an embodiment, screen <801> can indicate that no object 810 detected in a photographing mode is detected from a preview image after a camera application is executed. If no object 810 is detected in the preview image, the processor 210 can determine not to photograph the object 810, thereby reducing the intensity of the image stabilization. If a condition that the object 810 detected in the preview image falls outside thereof to some degree or more is satisfied, the processor 210 can determine not to photograph the object 810, thereby reducing the intensity of the image stabilization. For example, if the object 810 falls outside the preview image for a first time, the processor 210 can reduce the intensity of the image stabilization. For example, if the object 810 leaves the preview image at a first speed, the processor 210 can determine that the user does not photograph the object, thereby reducing the intensity of the image stabilization.

[0121] According to an embodiment, screen <802> can indicate that a user input 820 for selecting an object 810 shown in a preview image is obtained. In response to the user input 820 being obtained in a state in which the intensity of the image stabilization is increased, the processor 210 can reduce the intensity of the image stabilization.

[0122] According to an embodiment, screen <803> can indicate that a user input 830 for selecting an item (e.g., a lock icon and / or a padlock icon) that enables the image stabilization function to be performed from a third area (e.g., a third area 730) of the display 110 is obtained. In response to the user input 830 for selecting the item in a state in which the intensity of the image stabilization is increased being obtained, the processor 210 can reduce the intensity of the image stabilization. Figure 7

[0123] According to an embodiment, the item (e.g., a lock icon and / or a padlock icon) that enables the image stabilization function to be performed (hereinafter, referred to as a zoom lock icon) is not limited to the illustrated example, and various changes can be made. For example, text displayed on the zoom lock icon can change when switching from the first mode to the second mode. For example, it can be displayed as unlocked in the first mode and / or the third mode, and as locked in the second mode. Furthermore, if the image stabilization function is performed, a color change indicating that the function is activated can be displayed. For example, a dark color (e.g., gray) related to an inactive state can be displayed in the first mode and / or the third mode, and a bright color (e.g., white or yellow) related to an active state can be displayed in the second mode.

[0124] Figure 9 ​A margin region in an electronic device according to an embodiment is illustrated. The processor 210 can obtain image data through the camera 220. The processor 210 can output a preview image based on the image data through the display 110. The processor 210 can crop the obtained image data in response to a zoom input of the user and output the cropped image data to the display 110 as a preview image. As Figure 9 illustrated, the processor 210 can compare a region difference between the original image data obtained through the camera and the preview image. The processor 210 can determine a difference generated in the region as a margin region.

[0125] Referring to Figure 9 , a first case 910 can indicate that the preview image region is included in the obtained image data, thereby guaranteeing a margin region. A second case 920 can indicate a case in which the preview image falls outside the obtained image data, thereby having no margin region for stabilization, i.e., a case in which an unlock trigger event occurs. If the second case 920 occurs, the processor 210 can operate in a third mode in which the intensity of image stabilization is reduced.

[0126] Figure 10 is a flowchart illustrating an operation of changing the intensity of image stabilization by determining a motion of an electronic device according to an embodiment. In the following embodiment, each operation can be sequentially performed, but is not necessarily sequentially performed. For example, the order of each operation can be changed, and at least two operations can be performed in parallel. Figure 10 The operation entity of the flowchart illustrated can be understood as a processor (e.g., the processor 210 in Figure 2 ) or an image signal processor (e.g., the image signal processor 240 in Figure 2 ).

[0127] According to an embodiment, in operation 1010, the processor 210 can determine a motion of the electronic device 100. The processor 210 can analyze the motion of the electronic device 100 to determine whether a motion greater than or equal to a threshold speed is detected. The processor 210 can determine the motion of the electronic device 100 using at least one or more sensors (e.g., a motion sensor).

[0128] In an embodiment, the electronic device 100 can include at least one or more of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. The processor 210 can measure an azimuth, a pitch, and a roll value of the electronic device 100 by motion data obtained from at least one sensor, thereby determining the motion of the electronic device 100. The motion data can include 3-axis motion data (x1, y1, z1) obtained from the acceleration sensor or 9-axis motion data further obtained using the gyro sensor and the geomagnetic sensor.

[0129] In an embodiment, the processor 210 can form a virtual coordinate space based on a measured azimuth angle (e.g., yaw, pitch, and / or roll value) in 9-axis motion data. The processor 210 can designate one area of the virtual coordinate space as a landscape range and designate another area as a portrait range. For example, if a state of the electronic device 100 is included in the landscape range, the processor 210 can determine that the electronic device 100 is in a landscape state in which a parallel long side of the electronic device 100 is supported with a horizontal axis parallel to the ground. For example, if the state of the electronic device 100 is included in the portrait range, the processor 210 can determine that the electronic device 100 is in a portrait state in which the parallel long side of the electronic device 100 is supported with a vertical axis perpendicular to the ground.

[0130] In an embodiment, the processor 210 can determine a motion of the electronic device 100 to identify a photographing intention of the user. For example, if the motion of the electronic device 100 changes rapidly, it can be determined that the user wants to change an object to be photographed or stop photographing, thereby reducing the intensity of image stabilization.

[0131] According to an embodiment, in operation 1020, the processor 210 can determine whether a motion of the electronic device 100 is greater than or equal to a threshold (e.g., a threshold speed). For example, if the electronic device 100 moves by a first angle or more around a panning axis of the camera 220 during N frames, the processor 210 can determine that the motion is greater than or equal to the threshold, thereby performing operation 1030. The first angle can vary according to a zoom ratio configured for a current frame and / or a size of an object. In an embodiment, if the motion of the electronic device 100 is not greater than or equal to the threshold (e.g., the threshold speed), the processor 210 can perform operation 1010.

[0132] According to an embodiment, in operation 1030, the processor 210 can reduce the intensity of image stabilization. Operation 1030 can correspond to operations 570 to 590 in FIG. 5. Figure 5

[0133] Figure 11 is a flowchart illustrating an operation of controlling a display when a trigger event related to image stabilization occurs in an electronic device according to an embodiment. Figure 11 The operation entities of the flowchart illustrated can be understood as a processor (e.g., the processor 210 in FIG. 2) or an image signal processor (e.g., the image signal processor 240 in FIG. 2). Figure 2 Figure 2 Figure 11 in relation to the screens illustrated below. Figure 12 ​​​​

[0134] According to an embodiment, in operation 1110, the processor 210 can display a user interface showing a region to be cropped on one region (e.g., the third region 730 in FIG. 7B) of the display 110. If a zoom-in input is obtained from the user, the processor 210 can display a user interface showing a region to be cropped from the obtained original image data on one region of the display 110. For example, if a x100 zoom-in input is obtained from the user, the processor 210 can display, through the display 110, image data obtained by the camera 220 and image data cropped to 1 / 100 of the image data. Figure 7

[0135] According to an embodiment, in operation 1120, the processor 210 can determine whether a first trigger event occurs. Operation 1120 can correspond to operation 530 in FIG. 5B. Figure 5 In an embodiment, if the first trigger event occurs, the processor 210 can perform operation 1130, and otherwise, operation 1110.

[0136] According to an embodiment, in operation 1130, the processor 210 can display a highlight portion on the user interface. The processor 210 can display the highlight portion on the user interface in response to the occurrence of the first trigger event. The processor 210 can display the highlight portion on the user interface, thereby providing a notification indicating an increase in the intensity of image stabilization to the user.

[0137] According to an embodiment, in operation 1140, the processor 210 can determine whether a second trigger event occurs. Operation 1140 can correspond to operation 560 in FIG. 5B. Figure 5 In an embodiment, if the second trigger event occurs, the processor 210 can perform operation 1150, and otherwise, operation 1130.

[0138] According to an embodiment, in operation 1150, the processor 210 can release the highlight portion display from the user interface. The processor 210 can release the highlight portion display from the user interface in response to the occurrence of the second trigger event. The processor 210 can release the highlight portion display, thereby providing a notification indicating a decrease in the intensity of image stabilization to the user.

[0139] Figure 12 FIGS. 7A to 7D illustrate a display changing on the display as a trigger event related to image stabilization occurs in an electronic device according to an embodiment. Figure 12 FIGS. 7A to 7D illustrate a display changing on the display as a trigger event related to image stabilization occurs in an electronic device according to an embodiment. Figure 11 FIGS. 7A to 7D illustrate a display changing on the display as a trigger event related to image stabilization occurs in an electronic device according to an embodiment.

[0140] ​Screen according to an embodiment <1201> The screen can output a preview image via display 110 based on a configured magnification (e.g., a magnification of x1.0). For example, processor 210 can output a preview image including an object (e.g., the moon) via display 110 at a zoom magnification of x1.0.

[0141] Screen according to an embodiment <1202> It can be with Figure 11 The screen corresponding to operation 1110 in the text. (Screen) <1202> It can be on the screen <1201> In this state, processor 210 responds to zoom input (e.g., x100x) received from the user and outputs a screen showing a preview image corresponding to the zoom input. If zoom input is received from the user, processor 210 can display a user interface 1210 on a region of display 110 showing the area to be cropped from the acquired raw image data.

[0142] Screen according to an embodiment <1203> It can correspond to Figure 11 Operation 1130. Refer to the screen. <1203> The processor 210 can display a highlighted portion 1220 on the user interface 1210 that shows the area to be cropped. For example, the processor 210 can display at least the outer line of the user interface 1210 in yellow and bold.

[0143] In the embodiments, besides on the screen <1203> In addition to the highlighting method shown, it can also be applied to a region of the display 110 (e.g., Figure 7 A specific icon is displayed on the third area 730. For example, if the first trigger event occurs while shooting at a high magnification (e.g., x10x or higher zoom), the processor 210 may display a lock icon indicating that the preview is fixed without shaking.

[0144] In the embodiments, besides on the screen <1203> In addition to the highlighting method shown in the figure, it can also be displayed in a certain area of ​​the display 110 (e.g., Figure 7 The current mode (e.g., locked mode) is displayed in a second area 720 of the display 110. For example, if a first trigger event occurs while shooting at a high magnification (e.g., x100x zoom) in photo mode, the processor 210 can display the current mode (e.g., locked mode) in a second area 720 of the display 110. Figure 7 In the second area (720), the photo mode display is changed to the locked mode display.

[0145] Screen according to an embodiment <1204> It can correspond to Figure 11 Operation 1150 in the middle. Processor 210 can release the highlighted parts and output such as the screen. <1202> Preview image.

[0146] Figure 13is a block diagram illustrating an electronic device 1301 in a network environment 1300 according to various embodiments. Referring to FIG. 13, Figure 13 The electronic device 1301 in the network environment 1300 can communicate with an electronic device 1302 via a first network 1398 (e.g., a short-range wireless communication network), or an electronic device 1304 or a server 1308 via a second network 1399 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 1301 can communicate with the electronic device 1304 via the server 1308. According to an embodiment, the electronic device 1301 can include a processor 1320, memory 1330, an input module 1350, a sound output module 1355, a display module 1360, an audio module 1370, a sensor module 1376, an interface 1377, a connection terminal 1378, a haptic module 1379, a camera module 1380, a power management module 1388, a battery 1389, a communication module 1390, a subscriber identification module (SIM) 1396, or an antenna module 1397. In some embodiments, at least one (e.g., the connection terminal 1378) of the components can be omitted from the electronic device 1301, or one or more other components can be added in the electronic device 1301. In some embodiments, some (e.g., the sensor module 1376, the camera module 1380, or the antenna module 1397) of the components can be implemented as a single integrated circuit (IC) or a plurality of ICs (e.g., the display module 1360).

[0147] The processor 1320 can execute, for example, software (e.g., a program 1340) to control at least one other component (e.g., a hardware or software component) of the electronic device 1301 coupled with the processor 1320 and can perform various data processing or computation. According to one embodiment, as at least part of the data processing or computation, the processor 1320 can store a command or data received from another component (e.g., the sensor module 1376 or the communication module 1390) in the volatile memory 1332, process the stored command or data in the volatile memory 1332, and store results in the non-volatile memory 1334. According to an embodiment, the processor 1320 can include a main processor 1321 (e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor 1323 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor 1321. For example, when the electronic device 1301 includes the main processor 1321 and the auxiliary processor 1323, the auxiliary processor 1323 can be adapted to consume less power than the main processor 1321, or to be specialized in a specific function. The auxiliary processor 1323 can be implemented as separate from or as part of the main processor 1321.

[0148] The auxiliary processor 1323, instead of the main processor 1321, can control at least some of the functions or states related to at least one component (e.g., the display module 1360, the sensor module 1376, or the communication module 1390) among the components of the electronic device 1301, when the main processor 1321 is in an inactive (e.g., sleep) state, or together with the main processor 1321, when the main processor 1321 is in an active state (e.g., executing an application), or control at least some of the functions or states related to at least one component (e.g., the display module 1360, the sensor module 1376, or the communication module 1390) among the components of the electronic device 1301. According to an embodiment, the auxiliary processor 1323 (e.g., an image signal processor or a communication processor) can be implemented as a part of another component functionally related to the auxiliary processor 1323 (e.g., the camera module 1380 or the communication module 1390). According to an embodiment, the auxiliary processor 1323 (e.g., a neural processing unit) can include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model can be generated through machine learning. For example, such learning can be performed by the electronic device 1301 where the artificial intelligence is executed or via a separate server (e.g., the server 1308). The learning algorithm can include, but is not limited to, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model can include multiple artificial neural network layers. The artificial neural network can be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q-network, or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model can include a software structure other than a hardware structure.

[0149] The memory 1330 can store various data used by at least one component (e.g., the processor 1320 or the sensor module 1376) of the electronic device 1301. The various data can include, for example, software (e.g., the program 1340) and input data or output data for commands related thereto. The memory 1330 can include the volatile memory 1332 or the nonvolatile memory 1334.

[0150] The program 1340 can be stored in the memory 1330 as software, and can include, for example, an operating system (OS) 1342, middleware 1344, or an application 1346.

[0151] The input module 1350 can receive a command or data to be used by other component (e.g., the processor 1320) of the electronic device 1301, from the outside (e.g., a user) of the electronic device 1301. The input module 1350 can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0152] The sound output module 1355 can output sound signals to the outside of the electronic device 1301. The sound output module 1355 can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as playing multimedia or playing record. The receiver can be used to receive an incoming call. According to an embodiment, the receiver can be implemented as separate from the speaker, or implemented as part of the speaker.

[0153] The display module 1360 can visually provide information to the outside (e.g., a user) of the electronic device 1301. The display module 1360 can include, for example, a display, a hologram device, or a projection device, and a control circuit for controlling a corresponding one of the display, the hologram device, and the projection device. According to an embodiment, the display module 1360 can include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.

[0154] The audio module 1370 can convert a sound into an electrical signal and vice versa. According to an embodiment, the audio module 1370 can obtain sound from a microphone, or output sound through a speaker, a receiver, or an earphone.

[0155] The sensor module 1376 can detect an operational state (e.g., power or temperature) of the electronic device 1301 or an environmental state (e.g., a state of a user) external to the electronic device 1301, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 1376 can include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0156] The interface 1377 can support one or more specified protocols to be used for the electronic device 1301 to be coupled with the external electronic device (e.g., the electronic device 1302) directly (e.g., wiredly) or wirelessly. According to an embodiment, the interface 1377 can include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0157] The connection terminal 1378 can include a connector via which the electronic device 1301 can be physically connected with the external electronic device (e.g., the electronic device 1302). According to an embodiment, the connection terminal 1378 can include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).

[0158] The haptic module 1379 can convert electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or electrical stimulus that can be recognized by users through their tactile sensation or kinesthetic sensation. According to an embodiment, the haptic module 1379 can include, for example, a motor, a piezoelectric element, or an electrical stimuluser.

[0159] The camera module 1380 can capture still images or moving images. According to an embodiment, the camera module 1380 can include one or more lenses, image sensors, image signal processors, or flashes.

[0160] The power management module 1388 can manage power supplied to the electronic device 1301. According to an embodiment, the power management module 1388 can be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0161] The battery 1389 can supply power to at least one component of the electronic device 1301. According to an embodiment, the battery 1389 can include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.

[0162] The communication module 1390 can support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 1301 and an external electronic device (e.g., the electronic device 1302, the electronic device 1304, or the server 1308) and performing communication between the electronic devices 1301 and the external electronic device via the established communication channel. The communication module 1390 can include one or more communication processors that are operable independently from the processor 1320 (e.g., an application processor (AP)) and supports a direct (e.g., wired) communication or a wireless communication. According to an embodiment, the communication module 1390 can include a wireless communication module 1392 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1394 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with the external electronic device via the first network 1398 (e.g., a short-range communication network, such as Bluetooth, wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or the second network 1399 (e.g., a long-range communication network, such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN)). These various types of communication modules can be implemented as a single component (e.g., a single chip) or multiple components (e.g., multiple chips) separate from each other. The wireless communication module 1392 can identify and authenticate the electronic device 1301 in a communication network, such as the first network 1398 or the second network 1399, using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module 1396.

[0163] The wireless communication module 1392 can support 5G networks and next-generation communication technologies (e.g., new radio (NR) access technology) after 4G networks. The NR access technology can support enhanced mobile broadband (eMBB), massive machine-type communications (mMTC), or ultra-reliable low-latency communications (URLLC). The wireless communication module 1392 can support a high frequency band (e.g., a millimeter wave band) to achieve, for example, high data transmission rates. The wireless communication module 1392 can support various technologies for securing performance on high frequency bands, such as, for example, beamforming, massive multiple input multiple output (massive MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beamforming, or large scale antenna. The wireless communication module 1392 can support various requirements designated in the electronic device 1301, an external electronic device (e.g., an electronic device 1304), or a network system (e.g., a second network 1399). According to an embodiment, the wireless communication module 1392 can support a peak data rate for implementing eMBB (e.g., 20 Gbps or more), a loss coverage for implementing mMTC (e.g., 164 dB or less), or a U-plane latency for implementing URLLC (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or 1 ms or less for round trip).

[0164] The antenna module 1397 can transmit or receive a signal or power to or from the outside (e.g., an external electronic device) of the electronic device 1301. According to an embodiment, the antenna module 1397 can include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a base (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 1397 can include a plurality of antennas (e.g., array antennas). In this case, at least one antenna suitable for a communication scheme used in a communication network, such as the first network 1398 or the second network 1399, can be selected from the plurality of antennas by, for example, the communication module 1390 (e.g., the wireless communication module 1392). Then, a signal or power can be transmitted or received between the communication module 1390 and an external electronic device via the selected at least one antenna. According to an embodiment, in addition to the radiating element, another component (e.g., a radio frequency integrated circuit (RFIC)) can be additionally formed as part of the antenna module 1397.

[0165] According to various embodiments, the antenna module 1397 can form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module can include a printed circuit board, an RFIC, and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., a bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high frequency band (e.g., a millimeter wave band), and the plurality of antennas is disposed on a second surface (e.g., a top surface or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving a signal of the designated high frequency band.

[0166] At least some of the above-described components can be connected to each other via an inter-chip communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicate information (e.g., a command or data) between them.

[0167] According to an embodiment, commands or data can be transmitted or received between the electronic device 1301 and the external electronic device 1304 via the server 1308 connected with the second network 1399. Each of the electronic devices 1302 and 1304 can be the same type as or different from the electronic device 1301. According to an embodiment, all or some of the operations to be executed at the electronic device 1301 can be executed at one or more of the external electronic devices 1302, 1304, or server 1308. For example, if the electronic device 1301 is to automatically perform a function or service or is to perform a function or service in response to a request from a user or another device, the electronic device 1301, instead of, or in addition to, executing the function or service, can request that one or more of the external electronic devices perform at least part of the function or service. The one or more external electronic devices receiving the request can execute the at least part of the function or service requested, or perform another function or service related to the request, and transfer a result of the execution to the electronic device 1301. The electronic device 1301 can provide the result, with or without further processing of the result, as a reply to the request. To this end, a cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used, for example. The electronic device 1301 can use, for example, distributed computing or mobile edge computing to provide an ultra-low-latency service. In another embodiment, the external electronic device 1304 can include an Internet of Things (IoT) device. The server 1308 can be an intelligent server using machine learning and / or a neural network. According to an embodiment, the external electronic device 1304 or the server 1308 can be included in the second network 1399. The electronic device 1301 can be applied to intelligent services (e.g., smart home, smart city, smart car, or health care), based on 5G communication technologies or IoT-related technologies.

[0168] An electronic device according to various embodiments can be one of various types of electronic devices. The electronic devices can include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the disclosure, the electronic devices are not limited to those described above.

[0169] It should be understood that various embodiments of the present disclosure and the terms used therein are not intended to limit technically described features to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, like reference numerals can be used to refer to like or similar elements. It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. As used herein, each of the phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include all possible combinations of the items listed in the corresponding one of the phrases. As used herein, the terms such as "1st" and "2nd," or "first" and "second" can be used to simply distinguish a corresponding component from another, and do not limit the components in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being "operatively or communicatively connected" to or with another element (e.g., a second element), or as being "connected" to or with the other element without using the term "operatively" or "communicatively," it means that the element can be connected to the other element directly (e.g., with a wired line) or wirelessly, or connected to the other element via a third element.

[0170] As used in connection with various embodiments of the present disclosure, the term "module" can include a unit implemented in hardware, software, or firmware, and can interchangeably be used with other terms such as "logic," "logic block," "part," or "circuitry." A module can be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, a module can be implemented in a form of an application-specific integrated circuit (ASIC).

[0171] Various embodiments as set forth herein can be implemented as software (e.g., the program 1340) including one or more instructions that are stored in a storage medium (e.g., internal memory 1336 or external memory 1338) that are readable by a machine (e.g., electronic device 1301). For example, a processor (e.g., processor 1320) of the machine (e.g., electronic device 1301) can invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor. This allows the machine to be operated as a special purpose machine to perform at least one function. The one or more instructions can include a code generated by a compiler or a code that forms at least a part of a binary large object (BLO) that is executed during the execution of the operating system. The machine can include a memory controller, and the internal memory 1336 and the external memory 1338 can communicate data with each other via the memory controller. The machine can further include a plurality of components including a processor. The plurality of components (e.g., processor) and the at least one instruction can form at least a part of a system for performing a function.

[0172] According to the embodiments, a method according to various embodiments of the disclosure can be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed online via an application store (e.g., PlayStore®). If distributed online, at least part of the computer program product can be temporarily generated or at least temporarily stored in the machine-readable storage medium such as a manufacturer's server, an application store's server, or a relay server. TM ) online (e.g., downloaded or uploaded), or can be directly distributed (e.g., downloaded or uploaded) between two user devices (e.g., smart phones). If distributed online, at least part of the computer program product can be temporarily generated or at least temporarily stored in a machine-readable storage medium such as a manufacturer's server, an application store's server, or a relay server.

[0173] According to various embodiments, each component (e.g., a module or a program) of the above-described components can include a single entity or multiple entities, and some of the multiple entities can be separately positioned in different components. According to various embodiments, one or more of the above-described components can be omitted, or one or more other components can be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) can be integrated into a single component. In such a case, according to various embodiments, the integrated component can still perform one or more functions of each of the plurality of components in the same or similar manner as when each of the plurality of components performs the one or more functions. According to various embodiments, operations performed by the module, the program, or another component can be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more operations of the operations can be executed in a different order or omitted, or one or more other operations can be added.

[0174] Figure 14 is a block diagram 1400 illustrating a camera module 1380 according to various embodiments. Referring to Figure 14 , the camera module 1380 can include a lens assembly 1410, a flash 1420, an image sensor 1430, an image stabilizer 1440, a memory 1450 (e.g., a buffer memory), or an image signal processor 1460. The lens assembly 1410 can collect light emitted or reflected from an object of an image to be photographed. The lens assembly 1410 can include one or more lenses. According to an embodiment, the camera module 1380 can include a plurality of lens assemblies 1410. In this case, the camera module 1380 can form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies 1410 can have the same lens attributes (e.g., angle of view, focal length, auto focus, f number, or optical zoom), or at least one lens assembly can have one or more lens attributes different from the lens attributes of the other lens assembly. The lens assembly 1410 can include, for example, a wide-angle lens or a telephoto lens.

[0175] The flash 1420 can emit light, wherein the emitted light is used to enhance light reflected from an object. According to an embodiment, the flash 1420 can include one or more light emitting diodes (LEDs) (e.g., red-green-blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or a xenon lamp. The image sensor 1430 can acquire an image corresponding to an object by converting light emitted or reflected from the object and transmitted via the lens assembly 1410 into an electrical signal. According to an embodiment, the image sensor 1430 can include one image sensor selected from among a plurality of image sensors having different properties (e.g., an RGB sensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same property, or a plurality of image sensors having different properties. Each of the image sensors included in the image sensor 1430 can be implemented using, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide semiconductor (CMOS) sensor.

[0176] The image stabilizer 1440 can move the image sensor 1430 or at least one lens included in the lens assembly 1410 in a certain direction or control an operable property of the image sensor 1430 (e.g., adjust a readout timing) in response to a movement of the camera module 1380 or the electronic device 1301 including the camera module 1380. In doing so, at least a portion of a negative effect (e.g., image blur) resulting from a movement of an image being captured is allowed to be compensated for. According to an embodiment, the image stabilizer 1440 can sense such a movement of the camera module 1380 or the electronic device 1301 using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 1380. According to an embodiment, the image stabilizer 1440 can be implemented as, for example, an optical image stabilizer. The memory 1450 can at least temporarily store at least a portion of an image acquired via the image sensor 1430 for a subsequent image processing task. For example, if a plurality of images are captured quickly or image capture is delayed due to a shutter lag, an acquired raw image (e.g., a Bayer pattern image, a high-resolution image) can be stored in the memory 1450, and a corresponding copy image (e.g., a low-resolution image) thereof can be previewed via the display module 1360. Then, if a specified condition (e.g., by a user's input or a system command) is satisfied, at least a portion of the raw image stored in the memory 1450 can be acquired and processed by, for example, the image signal processor 1460. According to an embodiment, the memory 1450 can be configured as at least a portion of the memory 1330, or the memory 1450 can be configured as a separate memory operating independently of the memory 1330.

[0177] The image signal processor 1460 can perform one or more image processes on an image acquired via the image sensor 1430 or an image stored in the memory 1450. The one or more image processes can include, for example, depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor 1460 can perform control (e.g., exposure time control or readout timing control) on at least one of the components included in the camera module 1380 (e.g., the image sensor 1430). An image processed by the image signal processor 1460 can be stored back to the memory 1450 for further processing, or can be provided to an external component (e.g., the memory 1330, the display module 1360, the electronic device 1302, the electronic device 1304, or the server 1308) outside the camera module 1380. According to an embodiment, the image signal processor 1460 can be configured as at least part of the processor 1320, or can be configured as a separate processor operating independently of the processor 1320. If the image signal processor 1460 is configured as a separate processor from the processor 1320, at least one image processed by the image signal processor 1460 can be displayed as it is via the display module 1360 by the processor 1320, or can be displayed after being further processed.

[0178] According to an embodiment, the electronic device 1301 can include a plurality of camera modules 1380 having different attributes or functions. In this case, at least one of the plurality of camera modules 1380 can form, for example, a wide-angle camera, and at least another of the plurality of camera modules 1380 can form a telephoto camera. Similarly, at least one of the plurality of camera modules 1380 can form, for example, a front camera, and at least another of the plurality of camera modules 1380 can form a rear camera.

[0179] In an embodiment, the electronic device 100 can include a camera 220, a display 110, and at least one processor (e.g., the processor 210 in the electronic device 101 and / or the image signal processor 240 in the electronic device 102) electrically connected to the camera 220 and the display 110. Figure 2 Figure 2 In an embodiment, the electronic device 100 can include a camera 220, a display 110, and at least one processor (e.g., the processor 210 in the electronic device 101 and / or the image signal processor 240 in the electronic device 102) electrically connected to the camera 220 and the display 110.

[0180] ​In an embodiment, the at least one processor can obtain image data by driving the camera 220, and output a preview image of the image data through the display 110 based on a configured magnification. The at least one processor can detect at least one object included in the preview image obtained through the camera 220 in a state in which the configured magnification is greater than a reference magnification, and stabilize the preview image based on whether the at least one object is detected.

[0181] In an embodiment, the at least one processor can increase the intensity of the image stabilization in response to the detection of the at least one object by changing a parameter for performing the image stabilization.

[0182] In an embodiment, the at least one processor can increase the intensity of the image stabilization in response to a state in which the at least one object is detected within a designated area of the preview image being maintained for a predetermined time.

[0183] In an embodiment, the at least one processor can decrease the intensity of the image stabilization when a trigger event for decreasing the intensity of the image stabilization occurs.

[0184] In an embodiment, the at least one processor can gradually decrease the intensity of the image stabilization in response to the trigger event.

[0185] In an embodiment, the at least one processor can determine a margin area for the image stabilization in response to a zoom input of the user.

[0186] In an embodiment, the margin area can be an area obtained by excluding a second area included in the preview image from a first area included in the image data.

[0187] In an embodiment, the at least one processor can determine a motion of the electronic device using at least one sensor, and decrease the intensity of the image stabilization if the motion is greater than or equal to a threshold value.

[0188] In an embodiment, the trigger event can include at least one of a user input for stopping the image stabilization being received, a case in which the at least one object is not included in the image data, or a case in which a preview area falls outside the margin area.

[0189] In an embodiment, the at least one processor can increase the intensity of the image stabilization by increasing a coefficient of a low-pass filter included in a path for obtaining image data from an image sensor (for example, the image sensor 1430) of the camera 220. Figure 14

[0190] ​In an embodiment, the operation method of the electronic device 100 can include obtaining image data by driving the camera 220, outputting a preview image of the image data through the display 110 based on a configured magnification, detecting at least one object included in the preview image obtained through the camera 220 in a state in which the configured magnification is greater than a reference magnification, and performing image stabilization on the preview image based on whether the at least one object is detected.

[0191] In an embodiment, the operation method of the electronic device 100 can include, in response to detecting the at least one object, increasing the intensity of the image stabilization by changing a parameter for performing the image stabilization.

[0192] In an embodiment, the operation method of the electronic device 100 can include, in response to a state in which the at least one object is detected within a designated area of the preview image being maintained for a predetermined time, increasing the intensity of the image stabilization.

[0193] In an embodiment, the operation method of the electronic device 100 can include, if a trigger event for decreasing the intensity of the image stabilization occurs, gradually decreasing the intensity of the image stabilization. The trigger event can include at least one of receiving a user input for stopping the image stabilization, a case in which the at least one object is not included in the image data, or a case in which the preview area falls outside a margin area.

[0194] In an embodiment, if the trigger event occurs, the operation method of the electronic device 100 can gradually decrease the intensity of the image stabilization to a reference value within a predetermined time in response to the trigger event.

[0195] In an embodiment, the electronic device 100 can include the camera 220, the display 110, and at least one processor (e.g., the processor 210 of the Figure 2 and / or the image signal processor 240 of the Figure 2 ). The at least one processor can obtain image data by driving the camera 220, determine a margin area for image stabilization in response to a zoom input of a user, and output a preview image of the image data through the display 110 based on a configured magnification. The at least one processor can increase the intensity of the image stabilization in response to a first trigger event for increasing the intensity of the image stabilization in a state in which the configured magnification is greater than a reference magnification. If a second trigger event for decreasing the intensity of the image stabilization occurs in a state in which the intensity of the image stabilization is increased, the at least one processor can decrease the intensity of the image stabilization in response to the second trigger event.

[0196] In an embodiment, the first trigger event can include detecting at least one object, and the at least one processor can increase the intensity of the image stabilization in response to a state in which the at least one object is detected within a designated area of the preview image being maintained for a predetermined time.

[0197] In an embodiment, the at least one processor can gradually reduce the intensity of the image stabilization to the reference value within a predetermined time in response to a second trigger event.

[0198] In an embodiment, the first trigger event can include at least one of receiving a user input for increasing the intensity of the image stabilization or a case in which the at least one object is included in the image data.

[0199] In an embodiment, the second trigger event can include at least one of receiving a user input for stopping the image stabilization, a case in which the at least one object is not included in the image data, or a case in which the preview area falls outside the margin area.

Claims

1. An electronic device comprising: a camera; a display; and at least one processor electrically connected to the camera and the display, wherein the at least one processor is configured to: obtain image data by driving the camera; output, based on a configured magnification, a preview image of the image data through the display; detect at least one object included in the preview image obtained through the camera in a state where the configured magnification is greater than a reference magnification; when the configured magnification is greater than the reference magnification, increase an intensity of image stabilization by a parameter for performing the image stabilization in response to a first trigger event, wherein the first trigger event is a zoom lock trigger or a field of view fixation trigger; perform the image stabilization on the preview image based on the increased intensity of the image stabilization; and perform the image stabilization while gradually decreasing the intensity of the image stabilization in response to a second trigger event occurring after the first trigger event, wherein the second trigger event is a zoom unlock trigger or a field of view movement trigger. The at least one processor is configured to determine a margin area for the image stabilization in response to a zoom input of a user. 2.The electronic device of claim 1, wherein, The margin area is an area obtained by excluding a second area included in the preview image from a first area included in the image data. 3.The electronic device of claim 2, wherein, The at least one processor is configured to determine a motion of the electronic device using at least one sensor, and to decrease the intensity of the image stabilization in case that the motion is greater than or equal to a threshold value. 4.The electronic device of claim 1, wherein The second trigger event further includes at least one of a case that a user input for stopping the image stabilization is received, a case that the at least one object is not included in the image data, or a case that a preview area falls outside a margin area. 5.The electronic device of claim 1, wherein The at least one processor is configured to increase the intensity of the image stabilization by increasing a coefficient of a low pass filter included in a path for obtaining the image data from an image sensor of the camera. 6.The electronic device of claim 1, wherein 7.A method of operating an electronic device, the method comprising: obtaining image data by driving a camera included in the electronic device; outputting, based on a configured magnification, a preview image of the image data through a display included in the electronic device; detecting at least one object included in the preview image obtained through the camera in a state where the configured magnification is greater than a reference magnification; when the configured magnification is greater than the reference magnification, increasing an intensity of image stabilization by a parameter for performing the image stabilization in response to a first trigger event, wherein the first trigger event is a zoom lock trigger or a field of view fixation trigger; performing the image stabilization on the preview image based on the increased intensity of the image stabilization; and performing the image stabilization while gradually decreasing the intensity of the image stabilization in response to a second trigger event occurring after the first trigger event, wherein the second trigger event is a zoom unlock trigger or a field of view movement trigger. ​ 8. The method of claim 7, wherein, The second trigger event further includes at least one of the following: receiving a user input for stopping the image stabilization, a case where the at least one object is not included in the image data, or a case where a preview area falls outside a margin area.

9. The method of claim 8, further comprising: In a case where the second trigger event occurs, in response to the second trigger event, gradually reducing the intensity of the image stabilization to a reference value within a predetermined time.

Images