Electronic device and method for correcting output frame of electronic device

The electronic device compensates for posture changes using correction values based on overall zoom magnification, enabling accurate capture of moving objects and effective optical image stabilization at high zoom levels.

WO2026010090A1PCT designated stage Publication Date: 2026-01-08SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2025/005110
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-07-30
Filing Date
2025-04-15
Publication Date
2026-01-08

AI Technical Summary

Technical Problem

Users face difficulties in accurately capturing moving objects at high zoom levels due to the need for precise camera rotations, which are often misinterpreted as unintended movements by optical image stabilization systems, leading to ineffective stabilization at high zoom ratios.

Method used

An electronic device determines a correction value for compensating for posture changes based on overall zoom magnification, allowing for accurate rotation angles and enabling optical image stabilization even at high zoom levels.

Benefits of technology

Enables accurate capture of moving objects by allowing larger rotation angles and effective optical image stabilization, overcoming the limitations of small rotation angles and misinterpretation at high zooms.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025005110_08012026_PF_FP_ABST
    Figure KR2025005110_08012026_PF_FP_ABST
Patent Text Reader

Abstract

In an electronic device and an operating method of the electronic device according to one embodiment, the electronic device comprises: a camera; a display; a memory for storing at least one computer program; and at least one processor. The at least one computer program, when the at least one processor is individually or collectively executed, causes the electronic device to: identify a total zoom magnification determined on the basis of an optical zoom magnification and a digital zoom magnification of the camera; determine, on the basis of the total zoom magnification, a correction value for correcting the amount of change in the posture of the electronic device for determining an output frame that is at least a part of an input frame captured on the basis of the optical zoom magnification; detect a change in the posture of the electronic device; and display, on the display, the output frame on the basis of the amount of change in the posture of the electronic device, wherein the amount of change in the posture of the electronic device can be corrected on the basis of the correction value.
Need to check novelty before this filing date? Find Prior Art

Description

Methods for calibrating electronic devices and their output frames

[0001] The present disclosure relates to an electronic device and an operating method of the electronic device, and relates to a technique for correcting an output frame.

[0002] Advances in camera technology for portable electronic devices (hereinafter referred to as "electronic devices") have significantly improved the zoom capabilities available in camera systems. Electronic devices can acquire images with higher zoom ratios by applying optical zoom, which magnifies images by adjusting the position of the lens, and / or digital zoom, which electronically magnifies portions of the image without adjusting the position of the lens.

[0003] An electronic device can determine a portion of an input frame acquired by a camera as an output frame to be displayed on a display. The electronic device can determine an output frame based on various criteria for correcting the output frame to determine the output frame according to the user's intention, and display the determined output frame on the display.

[0004] An electronic device may be required to translate and / or rotate an object so that the object can be included in the output frame when the zoom factor is set low, as the object moves. The user may translate and / or rotate the electronic device so that the object can be included in the output frame. As the zoom factor of the electronic device increases, the degree of change in the relative position of the output frame may increase with the translation and / or rotation of the electronic device.

[0005] To capture moving objects at low zoom levels, a user may need to rotate the camera by a relatively large angle. As the zoom levels available on electronic devices increase, the degree to which the output frame shifts with each camera rotation angle may increase.

[0006] As the degree of shift in the output frame increases with the angle of rotation of the electronic device at a high zoom factor, the user may need to rotate the electronic device by a relatively small angle compared to a low zoom factor to include the object in the output frame. Since the user may have difficulty accurately rotating the camera below a certain angle, the user may not be able to accurately capture moving objects. The same problem may occur not only in situations where the electronic device is tracking an object, but also in situations where the object included in the output frame changes while capturing multiple objects, or when capturing a stationary object.

[0007] In electronic devices that perform optical image stabilization (OIS), rotations below a certain angular velocity may be recognized as unintended rotations by the user and thus subject to OIS. Rotations for photographing moving objects at high zoom ratios may not be able to perform OIS at high zoom levels because their angular velocities are small and may be recognized as unintended rotations by the user.

[0008] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0009] An electronic device according to one embodiment may include at least one camera. The electronic device may include a display. The electronic device may include a memory storing at least one computer program. The electronic device may include at least one processor. The at least one computer program may include instructions, when the at least one processor is individually or collectively executed, to cause the electronic device to determine an overall zoom ratio determined based on an optical zoom ratio and a digital zoom ratio of the camera. The at least one computer program may include instructions to determine a correction value for compensating for a change in the posture of the electronic device for determining an output frame, which is at least a portion of an input frame captured based on the optical zoom ratio, based on the overall zoom ratio. The at least one computer program may include instructions for detecting a change in the posture of the electronic device. The at least one computer program may include instructions for displaying an output frame based on the change in the posture of the electronic device on the display. The detected change in the posture of the electronic device may be corrected based on the correction value.

[0010] A method of operating an electronic device according to one embodiment may include an operation of checking an overall zoom magnification determined based on an optical zoom magnification and a digital zoom magnification of a camera. The method of operating an electronic device may include an operation of determining, based on the overall zoom magnification, a correction value for correcting a change in a posture of the electronic device for determining an output frame, which is at least a portion of an input frame captured based on the optical zoom magnification. The method of operating an electronic device may include an operation of detecting a change in a posture of the electronic device. The method of operating an electronic device may include an operation of displaying, on the display, an output frame based on the change in a posture of the electronic device. The detected change in a posture of the electronic device may be corrected based on the correction value.

[0011] An electronic device and an operating method of the electronic device according to one embodiment can determine a correction value for correcting a change in the posture of the electronic device for determining an output frame, which is at least a part of an input frame photographed based on the optical zoom magnification, based on the overall zoom magnification, can detect a change in the posture of the electronic device, and can display an output frame based on the change in the posture of the electronic device corrected by the correction value on a display.

[0012] An electronic device and an operating method thereof according to one embodiment determine an output frame based on a change in the attitude of the electronic device and the determined correction value, thereby enabling a camera rotation angle required to photograph a moving object or another object not included in the output frame to be set high. A user can rotate a larger angle than in the prior art to photograph a moving object at a high zoom ratio. Compared to the prior art, which requires a small angle of rotation, the user can accurately photograph a moving object by rotating a large angle.

[0013] The electronic device can apply optical image stabilization (OIS) even at high magnification zoom by setting a large rotation angle required to capture a moving object.

[0014] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0015] FIG. 1 is a block diagram of an exemplary electronic device (100) capable of performing the operations described in this document.

[0016] FIG. 2 is a diagram for explaining input frames and output frames according to various embodiments.

[0017] Figure 3 is a drawing showing the rotation angle of an electronic device that photographs a moving object.

[0018] Figure 4 is a drawing illustrating an example of excessive rotation of an electronic device.

[0019] FIG. 5 is a graph showing the angular velocity of an electronic device required to photograph a moving object according to the overall zoom magnification.

[0020] FIG. 6 is a block diagram illustrating an electronic device according to various embodiments of the present invention.

[0021] FIG. 7 is a drawing for explaining the operation of an electronic device according to various embodiments of the present invention.

[0022] FIG. 8A and FIG. 8B are drawings for explaining the operation of an electronic device according to various embodiments of the present invention.

[0023] FIG. 9 is a drawing for explaining an operation of changing the configuration of the overall zoom ratio according to various embodiments of the present invention.

[0024] FIG. 10 is a diagram illustrating an operation of receiving a user input regarding whether to perform correction of movement of an output frame of an electronic device according to various embodiments of the present invention.

[0025] FIG. 11 is a diagram for explaining conditions for performing correction of movement of an output frame in an electronic device according to various embodiments of the present invention.

[0026] FIG. 12 is a diagram for explaining an operation of reducing a shake correction threshold according to various embodiments of the present invention.

[0027] FIG. 13 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention simultaneously applies an operation for performing correction of movement of an output frame and an operation for reducing a shake correction threshold.

[0028] FIG. 14 is a drawing illustrating an example of performing output frame correction according to one embodiment of the present invention.

[0029] FIG. 15 is a flowchart illustrating an operation method of an electronic device according to various embodiments of the present invention.

[0030] FIG. 1 is a block diagram of an exemplary electronic device (100) capable of performing the operations described in this document.

[0031] Referring to FIG. 1, the electronic device (100) may be one of various forms of electronic devices, such as a notebook (190), smartphones (191) having various form factors (e.g., a bar-type smartphone (191-1), a foldable-type smartphone (191-2), or a sliderable (or rollable) type smartphone (191-3)), a tablet (192), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 1 are exemplary only and do not limit the implementations described or claimed in this document. The electronic device (100) may be referred to as a mobile device, a user device, a multi-function device, a portable device, or a server.

[0032] The electronic device (100) may include components including at least one processor (110) (hereinafter referred to as processor (110)), at least one memory (120) (hereinafter referred to as memory (120)), at least one display (140) (hereinafter referred to as display (140)), at least one image sensor (150) (hereinafter referred to as image sensor (150)), at least one communication circuit (160) (hereinafter referred to as communication circuit (160)), and / or at least one sensor (170) (hereinafter referred to as sensor (170)). The above components are merely exemplary. For example, the electronic device (100) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuitry, an antenna, a rechargeable battery, or an input / output interface). For example, some components may be omitted from the electronic device (100). For example, some components may be integrated into one component.

[0033] The processor (110) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing. The processor (110) may include at least one electrical circuit and may individually or collectively perform distributed processing of instructions (or programs, data, etc.) stored in the memory (120). The processor (110) may include a processor assembly including one or more processing circuits. The processor (110) may include any processing circuit operative to control the performance and operations of one or more components (e.g., the memory (120), the display (140), the image sensor (150), the communication circuit (160), and / or the sensor (170)) of the electronic device (100). For example, the processor (110) (e.g., the application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (110) may be implemented with multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (110) may include one or more processing circuits. For example, the processor (110) may include one or more processing circuits configured to individually and / or collectively perform various functions of the present disclosure. As a non-limiting example, at least a portion of the processor (110) may be included in a first chip of the electronic device (100), and at least another portion of the processor (110) may be included in a second chip of the electronic device (100) that is different from the first chip of the electronic device (100).

[0034] For example, the processor (110) may include a central processing unit (CPU) (111), a graphics processing unit (GPU) (112), a neural processing unit (NPU) (113), an image signal processor (ISP) (114), a display controller (115), a memory controller (116), a storage controller (117), a communication processor (CP) (118), and / or a sensor interface (119). These components of the processor (110) are merely exemplary. For example, one processor (110) may further include other components. For example, some components of the processor (110) may be omitted from one processor (110). For example, some components of the processor (110) may be included as separate components of the electronic device (100) outside of one processor (110). For example, some components of the processor (110) (e.g., memory controller (116)) may be included within other components (e.g., at least a portion of memory (120), an interface (e.g., available for connection to at least one component of the electronic device (100)), a display (140) and / or an image sensor (150)).

[0035] The processor (110) may cause other components of the electronic device (100) to perform various operations by executing instructions stored in the memory (120). The CPU (111) (or central processing circuit) may be configured to control components of the processor (110) based on the execution of instructions stored in the memory (120) (e.g., volatile memory (121) and / or non-volatile memory (122)). The GPU (112) (or graphics processing circuit) may be configured to execute parallel operations (e.g., rendering). The NPU (113) (or neural processing circuit, or artificial intelligence (AI) chip) may be configured to execute operations for an artificial intelligence model (e.g., convolution computation). The ISP (114) (or image signal processing circuit) may be configured to process a raw image acquired through the image sensor (150) into a format suitable for a component within the electronic device (100) or a component of the processor (110). The display controller (115) (or display control circuit, or display processing unit (DPU)) may be configured to process an image acquired from the CPU (111), the GPU (112), the ISP (114), or the memory (120) (e.g., the volatile memory (121)) into a format suitable for the display (140). The memory controller (116) (or memory control circuit) may be configured to control reading data from the volatile memory (121) and writing data to the volatile memory (121). The storage controller (117) (or storage control circuit) may be configured to control reading data from the nonvolatile memory (122) and writing data to the nonvolatile memory (122).The CP (118) (communication processing circuit) may be configured to process data acquired from a component of the processor (110) into a format suitable for transmission to another electronic device via the communication circuit (160), or to process data acquired from another electronic device via the communication circuit (160) into a format suitable for processing by the component of the processor (110). For example, the communication circuit (160) may include one or more communication circuits. The sensor interface (119) (or sensing data processing circuit, sensor hub) may be configured to process data about the state of the electronic device (100) and / or the state of the surroundings of the electronic device (100), acquired via the sensor (170), into a format suitable for the component of the processor (110).

[0036] The memory (120) may include one or more storage media (or one or more storage devices). For example, the memory (120) may include a memory assembly including one or more storage media. For example, the one or more storage media may include permanent memory (e.g., non-volatile memory (122)) such as a hard drive, flash memory, read-only memory (ROM), semi-permanent memory (e.g., volatile memory (121)) such as random access memory (RAM), any other suitable type of storage (or storage assembly), or any combination thereof. The memory (120) may include cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (100). As a non-limiting example, the cache memory may be included within the processor (110). The memory (120) may be fixedly embedded within the electronic device (100) or incorporated into one or more suitable types of components (e.g., a subscriber identity module (SIM) card and / or a secure digital (SD) card) that may be repeatedly inserted into and removed from the electronic device (100).

[0037] For example, the memory (120) may store one or more software applications, such as an operating system (or system) software application, a firmware software application, a driver software application, a plug-in (e.g., add-in, add-on, and / or applet) software application, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (110). For example, the memory (120) may store instructions callable by an application programming interface (API). For example, the memory (120) may store instructions within a library.

[0038] FIG. 2 is a diagram for explaining input frames and output frames according to various embodiments.

[0039] In the descriptions from FIGS. 2 to 14, the units indicating angles may refer to degrees unless otherwise specified, but it should be understood that this does not limit the scope of the invention described in the present disclosure.

[0040] The electronic device (101) of FIGS. 2 to 5 may refer to an electronic device (101) that is distinct from the electronic device (100) of the present invention.

[0041] The electronic device (101) may receive a user input regarding the overall zoom ratio during a shooting operation. The electronic device (101) may adjust the digital zoom ratio and the optical zoom ratio of the camera to configure the overall zoom ratio. The overall zoom ratio may be determined based on the digital zoom ratio and the optical zoom ratio of the camera. In one example, the overall zoom ratio may be a product of the digital zoom ratio and the optical zoom ratio of the camera. In one example, the electronic device (101) may determine the optical zoom ratio and the digital zoom ratio of the camera based on the user input for setting the overall zoom ratio. For example, the electronic device (101) may set the overall zoom ratio by activating the optical zoom without activating the digital zoom if the overall zoom ratio set by the user is lower than the maximum optical zoom ratio that the camera can support. For another example, the electronic device (101) can control the camera to capture an image using the maximum optical zoom magnification that the camera can support, if the overall zoom magnification set by the user is equal to or greater than the maximum optical zoom magnification that the camera can support, and activate digital zoom to enlarge the captured image. If the overall zoom magnification is set to 10x, the electronic device (101) can set the optical zoom magnification of the camera to 5x and the digital zoom magnification to 2x, thereby setting the overall zoom magnification to 10x.

[0042] The electronic device (101) can acquire input frames (210, 240) based on a set optical zoom ratio. The angle of view of the input frame (210, 240) acquired by the camera may become smaller as the optical zoom ratio of the camera increases. The size of the input frame (210, 240) may become smaller as the angle of view of the input frame (210, 240) becomes smaller. The angle of view of the input frame (210, 240) acquired by the camera may become larger as the optical zoom ratio of the camera decreases. The size of the input frame (210, 240) may become larger as the angle of view of the input frame (210, 240) becomes larger.

[0043] The electronic device (101) can determine an output frame (220), which is at least a part of an input frame (210), based on a digital zoom ratio, and display the determined output frame (220) on a display. The electronic device (101) can determine the size of the output frame (220) based on the digital zoom ratio. For example, when set to n times digital zoom, the output frame (220) is 1 / ( of the input frame (210). ) can be determined as a size, and an output frame (220) having the determined size can be displayed on a display. The output frame (220) can be an image in which an area excluding a part of the input frame (210) is cropped based on a digital zoom ratio.

[0044] The electronic device (101) can cut out and delete an area other than an area determined as an output frame (220) in an input frame (210), and display the output frame (220) on a display (230) by enlarging it by a digital zoom factor.

[0045] The electronic device (101) can determine output frames differently from the same input frames (210, 240). The electronic device (101) can determine the output frame based on various criteria for performing output frame correction. For example, the criteria for performing output frame correction may be a shake correction threshold for maintaining the output frame even when an input frame change occurs due to an angular velocity of the electronic device (101) below a threshold value.

[0046] According to one example, the electronic device (101) can determine an output frame (220) from an input frame (210) and display it on a display (230). According to another example, the processor can determine another output frame (250) from an equally acquired input frame (240) and display it on a display (260).

[0047] Figure 3 is a drawing showing the rotation angle of an electronic device that photographs a moving object.

[0048] An electronic device (101) (e.g., 310, 320, 330) can capture an image by zooming in on a moving object (300) using a camera according to a set overall zoom ratio. The electronic device (101) (e.g., 310, 320, 330) can be rotated by a user to capture a moving object (300).

[0049] In the descriptions from FIGS. 3 to 14, the camera can rotate independently or be attached to an electronic device (101) (e.g., 310, 320, 330) and rotate simultaneously with the rotation of the electronic device (101) (e.g., 310, 320, 330).

[0050] In a situation where an object (300) moves, the electronic device (101) (e.g., 310, 320, 330) may rotate at different angles to capture the object (300) according to the set overall zoom magnification. The electronic device (101) (e.g., 310, 320, 330) may rotate in the moving direction of the object (300) to obtain an output image including the moving object (300). The angle at which the electronic device (101) rotates may vary depending on the overall zoom magnification. For example, in a situation where the electronic device (e.g., 310, 320, 330) rotates to capture an object (300) that moves by 1 m, the angle at which the electronic device rotates may vary depending on the set overall zoom magnification.

[0051] FIG. 3 (a) is a drawing illustrating an example of an electronic device (310) photographing a moving object (300) without activating the zoom function, according to an example.

[0052] An electronic device (310) can capture an object (300) moving from a first location (301) to a second location (302) using a camera without activating a zoom function. In a situation where the zoom function of the electronic device (101) is not activated, the moving object (300) may be an object located at a close distance to the electronic device (101).

[0053] For example, the distance between an electronic device (310) and an object (300) that does not have the zoom function activated may be 1 m (311). When the object (300) that is 1 m (311) away from the electronic device (310) moves 1 m in the +x direction, the electronic device (310) may need to rotate 45 degrees (312) to capture the object (300) that has moved to the second location (302). In FIG. 3A, since the electronic device (310) is rotated 45 degrees (312) to capture the moving object (300), the user can easily track the moving object (300).

[0054] FIG. 3 (b) is a drawing showing an example of an electronic device (320) taking a picture of a moving object (300) by enlarging it with 10x zoom.

[0055] An electronic device (320) can capture an object (300) moving from a first location (301) to a second location (302) by using a camera, with a 10x zoom. In a situation where the electronic device (101) captures an object by using a 10x zoom, the moving object (300) may be an object located at a long distance from the electronic device (101).

[0056] For example, the distance between the electronic device (320) and the object (300) may be 10 m (321). When the object (300) that is 10 m (321) away from the electronic device (320) moves 1 m in the +x direction, the electronic device (320) may need to rotate by about 6 degrees (322), which is an angle less than 45 degrees (312), to capture the object (300) that has moved to the second location (302).

[0057] The movement distance of an object can be calculated as shown in mathematical expression 1 below.

[0058]

[0059] (L = distance traveled by the object, r = distance between the electronic device and the object, = rotation angle (in radians)

[0060] Referring to mathematical expression 1 and the previous example, , and when 0.1 rad is converted to a degree unit, the rotation angle (322) may be approximately 6 degrees. In FIG. 3 (b), it may be required to rotate the electronic device (320) by approximately 6 degrees (322) to capture a moving object (300). The required rotation amount of the electronic device (320) (e.g., approximately 6 degrees) may be relatively small compared to the rotation amount (e.g., 45 degrees) shown in FIG. 3 (a), and some users may have difficulty easily tracking the moving object (300).

[0061] FIG. 3 (c) is a drawing showing an example of an electronic device (330) photographing a moving object (300) by applying 60x zoom.

[0062] An electronic device (330) can capture an object (300) moving from a first location (301) to a second location (302) by applying a 60x zoom. In a situation where a 60x zoom magnification of the electronic device (330) is applied, the moving object (300) may be an object (300) located at a very long distance from the electronic device (330).

[0063] For example, the distance between the electronic device (330) and the object (300) may be 60 m (331). When the object (300) that is 60 m (331) away from the electronic device (330) moves 1 m in the +x direction, the electronic device (330) may need to rotate about 1 degree (332) to capture the object (300) that has moved to the second location (302).

[0064] The distance the object moves is given by Equation 1 and the previous example. Therefore, if 1 / 60 radian is converted to a degree unit, the rotation angle (332) can be approximately 1 degree. In FIG. 3(c), since the camera (330) is rotated approximately 1 degree (332) to capture a moving object (300), it may be very difficult for most users to track the moving object (300).

[0065] As described in FIGS. 3(a), 3(b), and 3(c), as the zoom magnification of the electronic device (101) increases, the rotation angle of the electronic device (301) required to track a moving object (300) may decrease. In order to track a moving object (300) at a high zoom magnification, a user must rotate the electronic device (101) by a smaller angle (e.g., 1 degree) than at a low zoom magnification. A user may have difficulty accurately rotating a small angle (e.g., 1 degree).

[0066] Figure 4 is a drawing illustrating an example of excessive rotation of an electronic device.

[0067] FIG. 4 (a) is a drawing showing an example in which an electronic device (101) photographs an object (400) at the point in time when the object (400) starts moving.

[0068] The electronic device (101) may be positioned in a direction facing the object (400). The camera may acquire an input frame (410) in which the object (400) located at the first position (401) is present at the center of the input frame (410). The output frame (411) may be determined as the center of the input frame (410). In (a) of FIG. 4, the object (400) may be displayed on the display while being included in the output frame (411).

[0069] Figure 4 (b) is a drawing showing an example of rotating an electronic device (101) to photograph a moving object (400).

[0070] An electronic device (101) can be rotated to capture an object (400) that has moved from a first location (401) to a second location (402). The electronic device (101) can obtain an input frame (420) that captures the second location (402) at the center by rotating by a first angle (491). An output frame (421) can be selected as the center of the input frame that captures the second location (402) at the center.

[0071] The first angle (491), which is the rotation angle required for the electronic device (101) to capture an object (400) located at a second location (402), may be an angle that is difficult for a user to rotate accurately (e.g., 1 degree (332) in FIG. 3 (c)). Even if the user attempts to rotate accurately, the electronic device (101) may be rotated excessively beyond the first angle (491). As the electronic device (101) is excessively rotated by the user, the second angle (492), which is the angle at which the camera is actually rotated, may be an angle greater than the first angle (491).

[0072] The camera can obtain an input frame (430) that is centered on a third position (403) that is not reached by the object (400) by rotating by a second angle (492). Since there is no standard for correcting the movement of the output frame, the output frame (431) may be selected as the center of the input frame (430) that is obtained by excessive rotation. Since an area that does not include the object (400) is selected as the output frame (431), the user cannot obtain the desired shooting result.

[0073] Figure 4 (c) is a drawing showing an example of an output frame for photographing an object (400).

[0074] Figure 4 (c) is an example of determining the output frame differently in a situation where the frame is rotated by a second angle (492), which is an excessive rotation angle compared to the first angle (491), which is the required rotation angle, as in Figure 4 (b).

[0075] The input frame (430) obtained by rotating by the second angle is an image that includes a third position (403) at the center, which is a position that the object (400) has not reached, but may include a second position (402) where the object (400) is located in an area (432) that is not the center.

[0076] The electronic device (101) cannot move the output frame to a non-central area (432) because it does not perform compensation for the movement of the output frame.

[0077] In an input frame containing an object (400), a separate criterion may be additionally required to perform correction of the movement of the output frame in order to move the output frame to a non-central area (432).

[0078] According to various embodiments of the present invention, the electronic device (100) may obtain an input frame including an object (400). The electronic device (100) may display, on a display, a non-central area (432) including the object (400) among the areas included in the input frame. A method for performing correction of movement of an output frame according to various embodiments of the present invention is described with reference to FIGS. 6 and 7.

[0079] FIG. 5 is a diagram illustrating a graph showing the angular velocity of an electronic device required to photograph a moving object according to the overall zoom magnification. A first coordinate plane (500) is a coordinate plane illustrated to represent the angular velocity of an electronic device (101) required to photograph a moving object. The y-axis of the first coordinate plane (500) may refer to an axis representing the angular velocity of the electronic device (101) required to photograph an object moving at a speed of 1 m / s. The x-axis of the first coordinate plane (500) may refer to the overall zoom magnification set in the electronic device (101). According to one example, in the first coordinate plane (500), when the overall zoom magnification set in the electronic device is a magnification, the distance between the electronic device and the object may refer to a case where a (meter) is used.

[0080] The first graph (501) depicted on the first coordinate plane (500) may be a graph representing the angular velocity of the electronic device (101) required for photographing a moving object according to a predetermined zoom ratio. According to one embodiment, the first graph (501) may be a graph representing the angular velocity of the electronic device (101) required for photographing an object moving at 1 m / s. In FIG. 5, an electronic device (101) for photographing an object moving at a speed of 1 m / s is described, but the coordinates expressed in the graph may vary depending on the speed of the moving object.

[0081] Each coordinate (e.g., 510, 520, 530) displayed on the first graph (501) may refer to the angular velocity of the electronic device (101) required for photographing an object moving at a speed of 1 m / s according to the overall zoom magnification.

[0082] The coordinates (510) at 1x may be coordinates that express that the angular velocity of the electronic device (101) required when an object moves at a speed of 1 m / s at 1x may be 45 degrees / 1 second. For example, the distance between the electronic device (electronic device (310) of FIG. 3(a)) with the overall zoom magnification set to 1x and the object may be 1 m. When an object 1 m away from the electronic device (electronic device (310) of FIG. 3(a)) moves 1 m in the +x direction, the electronic device (electronic device (310) of FIG. 3(a)) may need to rotate 45 degrees to capture the object that has moved to a second location (the second location (302) of FIG. 3).

[0083] The coordinates (520) at 10x magnification may be coordinates that express that the angular velocity of the electronic device (101) required when an object moves at a speed of 1 m / s at 10x magnification is 6 degrees / 1 second. For example, the distance between the electronic device (electronic device (320) of FIG. 3(b)) with the overall zoom magnification set to 10x and the object may be 10 m. When the object 10 m away from the electronic device moves 1 m in the +x direction, the electronic device (electronic device (320) of FIG. 3(b)) may need to rotate about 6 degrees to capture the object that has moved to the second location (the second location (302) of FIG. 3). When the object moves at a speed of 1 m / s, the electronic device (electronic device (320) of FIG. 3(b)) may need to have an angular velocity of about 6 degrees / 1 second to capture the object.

[0084] Referring to mathematical expression 1 and the previous example, It can be, and if 0.1 radian is converted to a degree unit, the required rotation angle can be 6 degrees. Therefore, the angular velocity of the electronic device (electronic device (320) of FIG. 3(b)) required to photograph an object moving at 1 m / s can be approximately 6 degrees / 1 second.

[0085] The coordinates (510) at 60x magnification may be coordinates expressing that the angular velocity of the electronic device (101) required when an object moves at a speed of 1 m / s at 60x magnification is 1 degree / 1 second. For example, the distance between the electronic device (electronic device (330) of FIG. 3(c)) with the overall zoom magnification set to 60x and the object may be 60 m. When an object 1 m away from an electronic device (electronic device (330) of FIG. 3(c)) moves 1 m in the +x direction, the electronic device (electronic device (330) of FIG. 3(c)) may need to rotate about 1 degree to capture the object that has moved to a second location (the second location (302) of FIG. 3). When the object moves at a speed of 1 m / s, the electronic device (electronic device (330) of FIG. 3(c)) may need to have an angular velocity of about 6 degrees / 1 second to capture the object. Referring to mathematical expression 1 and the previous example, It can be, and if 1 / 60 radian is converted to a degree unit, the required rotation angle can be 1 degree. Therefore, the angular velocity of the electronic device (electronic device (330) of FIG. 3(c)) required to photograph an object moving at 1 m / s can be approximately 1 degree / 1 second.

[0086] The values ​​shown in the first graph (501) are exemplary values, and the angles that must be rotated according to the overall zoom magnification are not limited to the values ​​shown in the first graph (501). For example, if an object located 0.5 m away from the electronic device moves 1 m even when shooting at a magnification of 1, the required rotation angle may be 60 degrees, and the angular velocity may be 60 degrees / 1 second.

[0087] Referring to the first graph (501), as the overall zoom ratio increases, the angular velocity of the electronic device (101) required to capture a moving object may decrease. The decrease in the required angular velocity of the electronic device (101) may indicate that the electronic device (101) needs to be rotated only a relatively small angle to capture a moving object. The user may rotate the electronic device (101) at a relatively larger angular velocity than the angular velocity required to capture a moving object. Therefore, in a situation where the overall zoom ratio is high, a new method may be required to display the output frame on the display by compensating for an angular velocity that may be excessive compared to the user's intention.

[0088] Below, we describe an issue where optical image stabilization (OIS) cannot be used at full zoom magnification set to high magnification.

[0089] The shake correction threshold value (503) illustrated in the first coordinate plane (500) may be a threshold value for correcting an unintended rotational motion of the electronic device (101) during the rotational motion of the electronic device (101). In a situation where a stationary object is being photographed, the user may intend to hold the electronic device (101) still, but unintended hand tremors may occur. The shake correction threshold value (503) may be a threshold value for correcting an error that may occur when displaying an output frame on a display due to the rotational motion of the electronic device (101) caused by the unintended hand tremors of the user. The electronic device (100) may perform optical image stabilization (OIS) on the output frame based on the shake correction threshold value, which is a value related to the angular velocity of the electronic device (100).

[0090] The shake correction threshold (503) may be a threshold that corrects for changes in the output frame caused by the angular velocity of the electronic device (101) when the angular velocity of the electronic device (101) is less than the shake correction threshold. For example, when the shake correction threshold is 1 degree / 1 second, the electronic device (101) selects an output frame so that a rotation of the electronic device (101) of less than 1 degree / 1 second does not cause changes in the output frame.

[0091] As an example, when the electronic device (101) is set to a high overall zoom ratio, it may be difficult for the electronic device (101) to distinguish between the shake correction threshold (503) and the angular velocity of the electronic device (101) required to capture a moving object. For example, referring to the first graph (501), when the electronic device (101) is set to a zoom ratio of 60x or higher, the angular velocity of the electronic device (101) required to capture an object moving at a speed of 1 m / s may be less than the shake correction threshold (503). For example, the shake correction threshold (503) may be set to 1 degree / 1 second, and the overall zoom ratio may be set to 60x. At a 60x zoom ratio, the angular velocity of the electronic device for capturing an object moving at a speed of 1 m / s may be, for example, 1 degree / 1 second. The electronic device (101) cannot determine whether the rotation of the electronic device (101) corresponding to an angular velocity of 1 degree / 1 second is for optical image stabilization (OIS) or for photographing a moving object. The electronic device (101) cannot perform optical image stabilization (OIS) because it cannot determine whether the rotation of the electronic device (101) is for optical image stabilization (OIS) or for photographing a moving object at a high overall zoom ratio of the user. Therefore, in a situation where the overall zoom ratio is high, a method may be required that can distinguish between a shake correction threshold and the angular velocity of the electronic device (101) required for photographing a moving object.

[0092] FIG. 6 is a block diagram illustrating an electronic device according to various embodiments of the present invention.

[0093] According to one embodiment, the electronic device (100) may include a processor (e.g., processor (110) of FIG. 1) (610), a camera (620), a display (e.g., display (140) of FIG. 1) (630), and / or a memory (e.g., memory (120) of FIG. 1) (640).

[0094] The processor (610) is operatively connected to the camera (620) and the display (630) and can control the operation of the camera (620). The processor (610) can include at least one processing circuitry, and the processor (610) can include at least one processor. The operations described below can be individually or collectively performed by at least one processor included in the processor (610).

[0095] The memory (640) can store at least one computer program, and the at least one computer program can include instructions that can be executed by the processor (610). The operations of the processor (610) described below can be performed according to the execution of the instructions contained in the memory (640).

[0096] A processor (e.g., processor (110) of FIG. 1) (610) can execute an application that supports a photographing function. In addition, the processor (610) can execute at least one camera module and set and support a designated photographing mode so that at least one camera module (e.g., a camera including an image sensor (150) of FIG. 1) can perform an operation intended by a user. An application associated with at least one camera module (e.g., a camera including an image sensor (150) of FIG. 1) can be stored in a memory (640). The camera module (e.g., a camera including an image sensor (150) of FIG. 1) can include at least one lens and at least one image sensor (e.g., the image sensor (150) of FIG. 1). For example, the electronic device (100) can obtain an image corresponding to a subject by using an image sensor (e.g., the image sensor (150) of FIG. 1) that converts light emitted from a subject or reflected by the subject and transmitted through at least one lens into an electrical signal. For example, a camera module (e.g., a camera including an image sensor (150) of FIG. 1) may include at least one camera (e.g., a camera (620) of FIG. 6).

[0097] The display (620) may include a display having a fixed shape, and / or a deformable display such as a foldable display or a rollable (or slidable) display.

[0098] In the following, correction of movement of an output frame may refer to detecting a change in the attitude of an electronic device, correcting it with a correction value, and determining an output frame based on the change in the attitude of the corrected electronic device.

[0099] The processor (610) can check the overall zoom ratio determined based on the optical zoom ratio and digital zoom ratio of the camera (620).

[0100] The processor (610) can apply optical zoom of the camera (620) that magnifies the image by adjusting the position of the lens and / or digital zoom that electronically magnifies a portion of the image without adjusting the position of the lens to the image acquired by the camera (620), thereby obtaining an image with a higher zoom magnification.

[0101] The processor (610) can receive user input regarding the overall zoom ratio during a shooting operation. The processor (610) can adjust the digital zoom ratio and the optical zoom ratio of the camera (620) to configure the overall zoom ratio.

[0102] The overall zoom ratio can be determined based on the digital zoom ratio and the optical zoom ratio of the camera (620). In one example, the overall zoom ratio can be a product of the digital zoom ratio and the optical zoom ratio of the camera (620).

[0103] The processor (610) can determine the optical zoom ratio and digital zoom ratio of the camera (620) based on a user input that sets the overall zoom ratio. For example, the processor (610) can set the overall zoom ratio by activating the optical zoom without activating the digital zoom when the overall zoom ratio set by the user is lower than or equal to the maximum optical zoom ratio that the camera (620) can support. As another example, the processor (610) can control the camera (620) to capture an image using the maximum optical zoom ratio that the camera (620) can support when the overall zoom ratio set by the user is equal to or greater than (or exceeds) the maximum optical zoom ratio that the camera (620) can support, and can activate the digital zoom to enlarge the captured image.

[0104] The processor (610) can determine a correction value for compensating for a change in the posture of the electronic device (100) for determining an output frame that is at least a portion of an input frame captured based on an optical zoom ratio, based on the overall zoom ratio.

[0105] The processor (610) can determine a correction value for correcting the degree to which an output frame, which is at least a portion of an input frame captured based on the optical zoom magnification, moves according to the amount of change in the posture of the electronic device (100), based on the overall zoom magnification.

[0106] The camera (620) included in the electronic device (100) can change its posture independently or can be attached to the electronic device (100) and change its posture in response to a change in the posture of the electronic device (100). Hereinafter, an example will be described in which, when the posture of the electronic device (100) changes, the posture of the camera (620) included in the electronic device (100) changes in the same manner as the posture of the electronic device (100).

[0107] The posture of the electronic device (100) may change depending on the parallel movement of the electronic device (100) and / or the rotation of the electronic device (100). The parallel movement of the electronic device (100) may refer to the electronic device (100) moving parallel to the up-down and left-right directions. The rotation of the electronic device (100) may refer to the electronic device (100) rotating around an axis.

[0108] The amount of change in the posture of the electronic device (100) may refer to the degree to which the posture of the electronic device (100) changes due to the parallel translation and / or rotation of the electronic device (100). The electronic device (100) may be parallel translated and / or rotated by the user to capture a moving object. The rotation of the electronic device (100) will be described below.

[0109] The processor (610) can acquire an input frame based on a set optical zoom ratio. The angle of view of the input frame may decrease as the optical zoom ratio of the camera (620) increases. The size of the input frame may decrease as the angle of view of the input frame decreases. The angle of view of the input frame may increase as the optical zoom ratio of the camera (620) decreases. The size of the input frame may increase as the angle of view of the input frame increases.

[0110] The processor (610) can display an output frame, which is at least a portion of an input frame, on a display (e.g., the display (630) of FIG. 6) based on a digital zoom ratio. The output frame may be an image in which an area excluding a portion of the input frame is cropped based on the digital zoom ratio.

[0111] The output frame can move based on the movement of the input frame, and the input frame can move based on a change in the posture of the electronic device (100). Movement of the input frame and the output frame can refer to changes in the input frame and the output frame depending on the rotation of the electronic device.

[0112] The input frame can move in response to the change in the posture of the electronic device (100). In one example, the change in the posture of the electronic device (100) can match the degree to which the input frame moves.

[0113] An output frame, which is part of an input frame, can move in response to the movement of the input frame when the input frame moves in response to the amount of change in the posture of the electronic device (100).

[0114] According to one example, the amount of change in the attitude of the electronic device (100) may match the amount of movement of the output frame, which is a part of the input frame, but when the processor (610) performs correction of the movement of the output frame, the amount of movement of the output frame may not match the amount of change in the attitude of the electronic device (100). The output frame may be determined by the amount of change in the attitude of the electronic device corrected with the correction value. The amount of movement of the output frame may correspond to the amount of change in the attitude of the electronic device corrected with the correction value.

[0115] The amount of change in the attitude of the electronic device (100) may have a unit of angle, the degree to which the input frame corresponding to the attitude of the electronic device (100) moves may have a unit of angle, and the degree to which the output frame moves may have a unit of angle.

[0116] The processor (610) may perform correction of the movement of the output frame. Correcting the movement of the output frame may refer to determining the degree to which the output frame moves based on the change in the attitude of the electronic device (100) and the correction value. Correcting the movement of the output frame may refer to determining the output frame based on the change in the attitude of the electronic device corrected by the correction value.

[0117] The change in the attitude of the electronic device can be corrected based on a correction value. According to one embodiment, when correction of the movement of the output frame is performed, the degree to which the output frame is moved can be an angle proportional to the change in the attitude of the electronic device (100). Correcting the movement of the output frame can include moving the output frame based on the change in the attitude of the electronic device (100). Correcting the movement of the output frame can include determining the output frame based on the change in the attitude of the electronic device corrected by the correction value.

[0118] The correction value may be a reference for correcting the movement of the output frame. The processor (610) may perform correction of the movement of the output frame based on the correction value, and may move the output frame based on the correction value.

[0119] The correction value may be a value for compensating for a change in the attitude of the electronic device. The processor may determine an output frame based on the change in attitude of the electronic device corrected by the correction value.

[0120] The correction value may refer to a value that corrects the degree to which an output frame, which is at least a portion of an input frame captured based on an optical zoom ratio, moves according to the amount of change in the posture of the electronic device (100).

[0121] According to one embodiment, the correction value may include a value indicating a ratio of the degree to which the output frame moves to the amount of change in the attitude of the electronic device (100). For example, the correction value may be set to determine the degree to which the output frame moves (e.g., a magnitude expressed in degrees) by multiplying the correction value by the amount of change in the attitude of the electronic device (100) (e.g., an angle by which the electronic device (100) is rotated).

[0122] The processor (610) may determine a compensation value based on a predetermined zoom ratio. The processor (610) may identify a preset compensation value corresponding to the overall zoom ratio. The processor (610) may be configured to apply the identified compensation value to the movement of the output frame.

[0123] The memory (640) can store values ​​corresponding to each of the total zoom ratios that the electronic device (100) can set. The processor (610) can determine a correction value using the values ​​stored in the memory.

[0124] The correction value may be set to perform a correction that reduces the amount of change in the posture of the electronic device as the total zoom scale increases. The correction value may be set to reduce the degree to which the output frame moves according to the movement of the electronic device (100) as the total zoom scale increases.

[0125] The compensation value can be set to reduce the amount of change in the attitude of the electronic device as the total zoom scale increases.

[0126] The processor (610) can use the correction value to reduce the degree to which the output frame moves according to the movement of the electronic device (100) as the total zoom scale increases.

[0127] The compensation value may be set to perform a compensation that increases the amount of change in the posture of the electronic device as the total zoom scale decreases. The processor (610) may be set to increase the degree to which the output frame moves according to the movement of the electronic device (100) as the total zoom scale decreases using the compensation value.

[0128] The correction value may include a value indicating a ratio of the change in attitude of the corrected electronic device to the change in attitude of the detected electronic device.

[0129] The processor (610) can detect a change in the attitude of the electronic device (100). The processor (610) can detect a change in the attitude of the electronic device (100) using at least one sensor (e.g., a gyro sensor). According to one example, the gyro sensor can detect (or sense) an angle by which the electronic device (100) is rotated, which is an amount of change in the attitude of the electronic device (100).

[0130] The processor (610) can display an output frame based on the amount of change in the attitude of the electronic device on the display (630). Displaying the output frame based on the amount of change in the attitude of the electronic device on the display (630) can include displaying an output frame that is moved based on the amount of change in the attitude of the electronic device (100) and the determined correction value on the display (630).

[0131] The processor (610) can display an output frame that is moved based on the change in posture of the electronic device (100) and the determined correction value on the display (630).

[0132] The processor (610) can perform correction of the movement of the output frame based on the correction value and the change in the attitude of the electronic device (100). The processor can determine the degree to which the output frame moves based on the correction value and the change in the attitude of the electronic device (100). According to one example, the processor (610) can perform correction of the movement of the output frame based on the correction value (e.g., 0.5) determined based on the overall zoom magnification and the change in the attitude of the detected electronic device (100) (e.g., 4 degrees). The processor (610) can determine a value (e.g., 2 degrees) obtained by multiplying the correction value (e.g., 0.5) and the change in the attitude of the electronic device (100) (e.g., 4 degrees) as the degree to which the output frame moves. The processor can display the output frame that is moved based on the degree to which the output frame moves on the display (630).

[0133] Since the degree to which the input frame moves corresponds to the amount of change in the attitude of the electronic device (100), the degree to which the output frame that is corrected and determined moves may be a value smaller than the degree to which the input frame moves.

[0134] According to one embodiment, the processor (610) may perform optical image stabilization (OIS) on the output frame based on a shake compensation threshold, which is a value related to the angular velocity of the camera (620). The shake compensation threshold may be set to decrease as the overall zoom magnification increases. The operation of the processor setting the shake compensation threshold is described in FIG. 13.

[0135] According to one embodiment, the processor (610) can determine whether the output frame includes an area close to the boundary of the input frame, and if so, increase the digital zoom factor while maintaining the overall zoom factor, and decrease the optical zoom factor.

[0136] According to one embodiment, the processor (610) may, after increasing the digital zoom factor and decreasing the optical zoom factor, determine whether the output frame includes an area close to the boundary of the input frame, and if it does not include the close area, decrease the digital zoom factor constituting the total zoom scale and increase the optical zoom factor while maintaining the total zoom factor. The operation of the processor (610) to determine whether the output frame includes an area close to the boundary of the input frame will be described with reference to FIG. 9.

[0137] According to one embodiment, the processor (610) may receive a user input for setting a correction value, and display an output frame that is moved based on the amount of change in the posture of the electronic device (100) and the correction value set by the user input on the display (630).

[0138] According to one embodiment, the processor (610) receives a user input that sets a correction value, and the change in posture of the electronic device can be corrected based on the correction value corresponding to the user input.

[0139] The operation of the processor (610) receiving user input for setting a correction value is described in FIG. 10.

[0140] According to one embodiment, the processor (610) may receive a user input as to whether to perform correction of a change in attitude of the electronic device, and, when receiving a user input instructing to perform correction of a movement of an output frame, determine whether the electronic device satisfies a specified condition, and perform correction of a change in attitude of the electronic device based on determining that the electronic device satisfies the specified condition, or may not perform correction of a change in attitude of the electronic device based on determining that the electronic device does not satisfy the specified condition.

[0141] According to one embodiment, the processor (610) may receive a user input indicating whether to perform a correction for the movement of the output frame. The operation of the processor (610) receiving a user input indicating whether to perform a correction for the movement of the output frame is described in FIG. 10.

[0142] According to one embodiment, the processor (610) determines whether the electronic device (100) satisfies a specified condition, and performs correction of the movement of the output frame based on determining that the electronic device (100) satisfies the specified condition, or

[0143] Based on determining that the electronic device (100) does not satisfy the specified condition, correction of the movement of the output frame may not be performed.

[0144] According to one example, the processor (610) may include at least one of the following conditions: a condition in which the angular velocity of the electronic device (100) is less than a specified value; and a condition in which at least one object exists in an output frame displayed on the display (630). The operation of the processor (610) to check the specified condition will be described in FIG. 11.

[0145] FIG. 7 is a diagram illustrating the operation of an electronic device according to various embodiments of the present invention. Although FIG. 7 describes a situation in which a moving object (700) is photographed, it should be understood that this does not limit the scope of the invention described in the present disclosure. The electronic device can perform movement correction of an output frame regardless of the presence or absence of a target object to be photographed (e.g., a moving object (700)) or the number of objects. For example, the electronic device can perform movement correction of an output frame even in a situation in which a pose is changed to change an object included in the output frame while performing a photographing operation.

[0146] FIG. 7(a) is a diagram for explaining an outgoing frame moved according to a correction value in an electronic device in which the overall zoom magnification is set to 20x according to various embodiments of the present invention. FIG. 7(b) is a diagram for explaining an operation of selecting an outgoing frame moved according to a correction value in an electronic device in which the overall zoom magnification is set to 60x according to various embodiments of the present invention. In FIG. 7(b), the electronic device can move an output frame in the same manner as in FIG. 7(a), and in order to avoid duplication of explanation, in FIG. 7(b), the same explanation as in FIG. 7(a) is omitted and the differences are described.

[0147] In the following, correction of the movement of the output frame may refer to correcting the change in the posture of the detected electronic device as a correction value, and determining the output frame based on the change in the posture of the corrected electronic device.

[0148] The electronic device (100) can check the overall zoom magnification (e.g., 20x in FIG. 7(a) and 60x in FIG. 7(b)) determined based on the optical zoom magnification and digital zoom magnification of the camera (620).

[0149] The electronic device (100) can receive user input for the overall zoom ratio (e.g., 20x in FIG. 7(a) and 60x in FIG. 7(b)) during a shooting operation. The electronic device (100) can adjust the digital zoom ratio and the optical zoom ratio of the camera (620) to configure the overall zoom ratio.

[0150] The electronic device (100) can determine a correction value (791) for correcting the degree to which an output frame (711), which is at least a part of an input frame (710) captured based on an optical zoom magnification, moves according to a change in the posture of the electronic device (100) (e.g., a second angle (722)), based on the overall zoom magnification (781).

[0151] The electronic device (100) can determine the correction value (791) based on the predefined zoom ratio (781). According to one example, the memory (640) can store values ​​corresponding to each of the overall zoom ratios that the electronic device (100) can set (e.g., the overall zoom ratio (781) of FIG. 7(a) and the overall zoom ratio (782) of FIG. 7(b)), and the processor (610) can use the values ​​stored in the memory (640) to determine the correction value (e.g., the correction value (791) of FIG. 7(a) and the correction value (792) of FIG. 7(b)).

[0152] An electronic device (100) can capture a moving object (700) using a camera (620). The object (700) moves from a first position (701) to a second position (702), and the electronic device (100) can capture the object (700) while rotating. However, to avoid duplication of explanation, the description will focus on a situation where a moving object is captured, and the operation of the electronic device described below to correct the movement of an output frame can be performed in the same manner even in a situation where an object included in the output frame changes or the object does not move.

[0153] The camera (620) included in the electronic device (100) can change its posture independently or can be attached to the electronic device (100) and change its posture in response to a change in the posture of the electronic device (100). Hereinafter, an example will be described in which, when the posture of the electronic device (100) changes, the posture of the camera (620) included in the electronic device (100) changes in the same manner as the posture of the electronic device (100).

[0154] The electronic device (100) can obtain an input frame (720) that captures the object (700) at a second location (702) of the object (700). While the moving object (700) moves from the first location (701) to the second location (702), the user can rotate the electronic device (100) by a second angle (722) to track the object (700).

[0155] The electronic device (100) can detect a change in the attitude of the electronic device (e.g., a second angle (722)). The electronic device (100) can detect a change in the attitude of the electronic device (100) (e.g., a second angle (722)) using at least one sensor (e.g., a gyro sensor).

[0156] The amount of change in the posture of the electronic device (100) (e.g., the second angle (722)) may refer to the degree to which the posture of the electronic device (100) changes according to the rotation of the electronic device (100) (e.g., the second angle (722)).

[0157] The electronic device (100) may include at least one sensor. The at least one sensor may detect (or sense) a change in the attitude of the electronic device (100) (e.g., a second angle (722)). In one example, a gyro sensor may detect (or sense) a second angle (722) by which the electronic device (100) is rotated.

[0158] The electronic device (100) can check the result (e.g., second angle (722)) of at least one sensor detecting (or sensing) a change in the posture of the electronic device (100).

[0159] The electronic device (100) can determine the degree (7002) by which the output frame moves based on the correction value (791) and the change in the attitude of the electronic device (100) (e.g., the second angle (722)). The degree (7002) by which the output frame moves can have a unit of angle. The degree (7002) by which the output frame moves can refer to an angle (e.g., the first angle (712)) between the center (7111) of the area displayed on the display before the attitude of the electronic device changes and the center (7211) of the area displayed on the display after the attitude of the electronic device (100) changes, based on the position of the electronic device.

[0160] According to one example, the electronic device (100) may determine the amount by which the output frame moves (7002) as a value (e.g., a first angle (712) (6 degrees)) obtained by multiplying a correction value (e.g., 0.75) and the amount of change in the attitude of the electronic device (100) (e.g., a second angle (722) (8 degrees)).

[0161] The degree to which the input frame moves (7001) may have a unit of angle and may refer to an angle (e.g., a first angle (712)) between the center (7101) of the area to be photographed before the attitude of the electronic device (100) changes, the position of the electronic device (100), and the center (7201) of the area to be photographed after the attitude of the electronic device (100) changes.

[0162] The electronic device (100) can display an output frame (721) that moves based on the change in the posture of the electronic device (100) (e.g., second angle (722)) and the determined correction value (e.g., 0.75) on the display (630).

[0163] Since the degree to which the input frame moves (7001) corresponds to the amount of change in the attitude of the electronic device (100) (e.g., the second angle (722)), the electronic device (100) can determine the degree to which the output frame moves (7002) to be a value smaller than the degree to which the input frame moves (7001).

[0164] According to one example, the electronic device may reduce the degree to which the output frame moves according to the movement of the electronic device (100) as the total zoom scale (e.g., the total zoom scale (781) of FIG. 7(a) and the total zoom scale (782) of FIG. 7(b)) increases. The correction value (e.g., the correction value (791) of FIG. 7(a) and the correction value (792) of FIG. 7(b)) may include a value that reduces the degree to which the output frame moves according to the movement of the electronic device (100) as the total zoom scale increases.

[0165] For example, the electronic device (100) may check a total zoom ratio (e.g., total zoom ratio (X60 magnification) (782) of FIG. 7(b)) that is set higher than a previous total zoom ratio (e.g., total zoom ratio (X20 magnification) (781) of FIG. 7(a)), and determine a correction value (e.g., correction value (0.5) (792) of FIG. 7(b)) to be lower than a previous correction value (e.g., correction value (0.75) (791) of FIG. 7(a)).

[0166] In one example, if a correction value (e.g., correction value (0.5) (792) of FIG. 7(b)) is determined to be lower than a previous correction value (e.g., correction value (0.75) (791) of FIG. 7(a)), the degree to which the output frame moves (7004) determined by the product of the correction value (e.g., 0.5) and the change in attitude of the electronic device (e.g., second angle (742) (8 degrees)) (e.g., first angle (732) (4 degrees)) may be lower than the degree to which the previous output frame moves (7002).

[0167] The user can set the degree to which the output frame moves according to the change in the posture of the electronic device (100) to be lower as the overall magnification increases. The user can easily capture a moving object by moving the output frame displayed on the display (630) less as the overall zoom magnification increases.

[0168] FIG. 8A is a drawing for explaining the operation of an electronic device according to various embodiments of the present invention.

[0169] The second coordinate plane (810) may be a coordinate plane on which the angular velocity of the electronic device (100) required for photographing a moving object is displayed. The y-axis of the second coordinate plane (810) may refer to an axis representing the angular velocity of the electronic device (100, 101) required for photographing an object moving at a speed of 1 m / s. The x-axis of the second coordinate plane (810) may refer to the overall zoom magnification set in the electronic device (100, 101). According to one example, in the second coordinate plane (810), when the overall zoom magnification set in the electronic device (100, 101) is a magnification, this may refer to a case where the distance between the electronic device (100, 101) and the object is a (meter).

[0170] The first graph (811) illustrated on the second coordinate plane (810) may be a graph representing the angular velocity of the electronic device (101) required for photographing a moving object. Since the first graph (811) is a graph for an electronic device (101) that does not perform correction for the movement of an output frame, it may be a graph that matches the first graph (501) described in FIG. 5. The values ​​indicated in the first graph are exemplary values, and the angular velocity of the electronic device (101) required for photographing an object moving at a speed of 1 m / s according to the overall zoom magnification is not limited to the values ​​indicated in the first graph.

[0171] The second graph (812) illustrated on the second coordinate plane (810) may be a graph representing the angular velocity of the electronic device (100) required to photograph an object moving at a speed of 1 m / s in the electronic device (100) that determines the degree to which the output frame moves based on the change in posture and the correction value of the electronic device (100). Each coordinate (e.g., the second coordinate (8121)) displayed on the second graph (812) may refer to the angular velocity of the electronic device (100) required to photograph an object moving at a speed of 1 m / s according to the overall zoom magnification. In FIG. 8A, an electronic device (100) that photographs an object moving at a speed of 1 m / s is described, but the coordinates expressed in the graph may vary depending on the speed of the moving object. The values ​​displayed on the second graph are exemplary values, and the angle that must be rotated according to the overall zoom magnification is not limited to the values ​​displayed on the second graph.

[0172] The first graph (811) and the second graph (812) may match in an area excluding the correction performing area (820). For example, the coordinates at 1x are coordinates that express that the angular velocity of the electronic device (100, 101) required when an object moves at a speed of 1 m / s at 1x is 45 degrees / 1 second, and the first graph (811) and the second graph (812) have the same coordinates.

[0173] The correction performing area (820) may be an area displaying coordinates at the full zoom ratio set to perform correction of the movement of the output frame. For example, the correction performing area (820) may be an area displaying coordinates at the full zoom ratio at which correction of the movement of the output frame begins to be performed, up to the maximum zoom ratio.

[0174] The first graph (811) and the second graph (812) may not match in the correction performance area (820).

[0175] Since the electronic device (100) can determine a correction value for determining the degree to which an output frame, which is at least a portion of an input frame captured based on an optical zoom magnification, moves according to the amount of change in the posture of the electronic device (100), based on the overall zoom magnification, the second graph (812) may not match the first graph (811).

[0176] The electronic device (100) can determine a correction value based on a predefined zoom ratio. The electronic device (100) can determine a correction value (e.g., 0.5) corresponding to the overall zoom ratio (e.g., 60x). The electronic device (100) can move the output frame based on the determined correction value (e.g., 0.5).

[0177] The correction value may refer to a value that corrects the degree to which an output frame, which is at least a portion of an input frame captured based on an optical zoom ratio, moves according to the amount of change in the attitude of the electronic device (100). According to one embodiment, since the correction value may refer to a ratio of angles, it may refer to a ratio of angular velocity that is the same as the ratio of angles. According to one embodiment, the correction value may refer to a value that corrects the degree to which an output frame moves per second (e.g., angular velocity) according to the amount of change in the attitude of the electronic device (100) per second (e.g., angular velocity).

[0178] The electronic device (100) can determine the degree to which the output frame moves (e.g., 1 degree / 1 second) by multiplying the correction value (e.g., 0.5) and the amount of change in the attitude of the electronic device (e.g., the Y value of the second coordinate (8121) (2 degrees / 1 second)).

[0179] As an example, a correction value (e.g., 0.5) determined based on the overall zoom ratio (e.g., 60x) may match the value obtained by dividing the y-coordinate of the first graph (811) by the y-coordinate of the second graph (812) at the same x-coordinate (overall zoom ratio).

[0180] For example, in the first graph (811), if the overall zoom magnification is 60x, it can be shown that the angular velocity of the electronic device required to capture an object moving at a speed of 1 m / s is 1 degree / 1 second. The electronic device (100) can determine the degree to which the output frame moves according to the amount of change in the posture of the electronic device to be a value lower than the amount of change in the posture of the electronic device. Therefore, if the degree to which the output frame moves is the same in the electronic device (100) that performs correction for the movement of the output frame and the electronic device (101) that does not perform correction for the movement of the output frame, the amount of change in the posture of the electronic device can be greater in the electronic device (100) that performs correction for the movement of the output frame.

[0181] The ratio of the change in attitude of the electronic device per second (2 degrees / 1 second) at the second coordinate (8121) of the second graph and the change in attitude of the electronic device per second (1 degree / 1 second) at the first coordinate (8111) of the first graph may correspond to a correction value (e.g., an exemplary correction value of 0.5 at 60x magnification).

[0182] Although the angular velocity of the electronic device requiring rotation after compensation has been described for 60x magnification, the angular velocity of the electronic device requiring rotation after compensation can be determined in the same way for all full zoom magnifications depending on the compensation value.

[0183] Below, an example is described in which an electronic device (100) that performs correction of movement of an output frame uses optical image stabilization (OIS) at a full zoom ratio set to a high magnification.

[0184] The shake correction threshold value (813) illustrated in the second coordinate plane (810) may be a threshold value for correcting an unintended rotational motion of the electronic device (100) during the rotational motion of the electronic device. For example, in a situation where a stationary object is being photographed, the user may intend to hold the electronic device (100) still, but unintended hand tremors may occur. The shake correction threshold value (813) may be a threshold value for correcting an error that may occur when displaying an output frame on a display due to the rotational motion of the electronic device (100) caused by the unintended hand tremors of the user.

[0185] The shake correction threshold value (813) may be a threshold value that corrects changes in the output frame caused by the angular velocity of the electronic device (100) when the angular velocity of the electronic device (100) is less than the shake correction threshold value (813). For example, when the shake correction threshold value (813) is 1 degree / 1 second, the processor (e.g., the processor (610) of FIG. 6) corrects the output frame so as not to cause an error in the angular velocity output frame of the electronic device (100) of less than 1 degree / 1 second.

[0186] As described in FIG. 5, when the electronic device (100) is set to a high overall zoom ratio, the processor (e.g., the processor (610) of FIG. 6) may have difficulty distinguishing between the shake correction threshold (813) and the angular velocity of the electronic device (100) required for capturing a moving object. For example, the coordinates included in the first graph (811) may be less than the shake correction threshold (813).

[0187] When the electronic device (100) that performs correction of the movement of the output frame is set to a high-magnification full zoom ratio, the processor (e.g., the processor (610) of FIG. 6) can distinguish between the shake correction threshold (813) and the angular velocity of the electronic device (100) required for photographing a moving object. The degree to which the output frame moves (e.g., 1 degree) required for photographing a moving object can be determined by the product of the correction value (e.g., 0.5) and the amount of change in the attitude of the electronic device (e.g., 2 degrees). Therefore, if the degree to which the output frame moves (e.g., 1 degree) required for photographing a moving object is a fixed value, the electronic device (100) that performs correction of the movement of the output frame can have a larger value of the amount of change in attitude than the electronic device (101) that does not perform correction.

[0188] For example, the shake correction threshold (813) may be set to 1 degree / 1 second, and the overall zoom magnification may be set to 60x. At 60x zoom, the angular velocity (y-coordinate of the second coordinate (8121)), which is the change in the attitude of the electronic device for photographing an object moving at a speed of 1 m / s, may be 2 degrees / 1 second. The processor (e.g., the processor (610) of FIG. 6) may determine whether the rotation of the electronic device (100) corresponding to the angular velocity of 2 degrees / 1 second is a target of optical image stabilization (OIS) or a rotation for photographing a moving object. The processor (e.g., the processor (610) of FIG. 6) may determine the rotation of the electronic device (100) corresponding to the angular velocity of 2 degrees / 1 second as a rotation for photographing a moving object. A processor (e.g., processor (610) of FIG. 6) can determine whether the rotation of the electronic device (100) is a target for optical image stabilization (OIS) or a rotation for photographing a moving object, so that optical image stabilization (OIS) can be performed even when the full zoom ratio is set to a high magnification.

[0189] FIG. 8b is a drawing for explaining the operation of an electronic device according to various embodiments of the present invention.

[0190] The electronic device (100, 101) can capture (830) an object at its initial location. For example, the electronic device (100, 101) can be positioned to face the initial location directly, and obtain an input frame in which the object located at the initial location is included at the center.

[0191] According to one example, an electronic device (100, 101) that photographs an initial position (830) can obtain the same input frame from an electronic device (832) that applies the present invention and an electronic device (831) that does not apply the present invention.

[0192] According to one example, an electronic device (100, 101) that photographs an initial position (830) can display the same output frame on a display (display (630) of FIG. 6) in an electronic device (832) that applies the present invention (electronic device (100) of FIG. 6) and an electronic device (831) that does not apply the present invention (electronic device (101) of FIG. 4). For example, an electronic device (832) that applies the present invention and an electronic device (831) that does not apply the present invention can display an area included in the center of an input frame as an output frame on the same display (display (630) of FIG. 6).

[0193] According to one example, when the posture of the electronic device (100, 101) changes due to rotation of the electronic device, the electronic device that photographs (840) the position where the object has finished moving can obtain the input frame (8411, 8421) after rotation.

[0194] According to one example, an electronic device (100, 101) that photographs (840) the position where an object has finished moving can obtain the same input frame (8411, 8421) from an electronic device (842) that applies the present invention and an electronic device (841) that does not apply the present invention.

[0195] According to one example, an electronic device (841) that does not apply the present invention may determine a portion of an input frame (8411) as an output frame (8412) after rotation. For example, an area included in the center of the input frame (8411) after rotation may be displayed on a display (display (630) of FIG. 6) as an output frame (8412) after rotation.

[0196] According to one example, an electronic device (842) applying the present invention can determine a portion of an input frame (8421) after rotation as an output frame (8422) after rotation.

[0197] An electronic device (842) applying the present invention can determine a correction value for correcting the degree to which an output frame, which is at least a part of an input frame, moves according to the amount of change in the attitude of the electronic device.

[0198] The electronic device (842) can compensate for the degree to which the output frame moves to a size smaller than the amount of change in the attitude of the electronic device (842).

[0199] The electronic device (842) can determine the degree to which the output frame moves to be a smaller value than the degree to which the input frame moves, which matches the amount of change in the attitude of the electronic device.

[0200] Since the output frame moves less than the input frame, the relative position of the output frame within the input frame may change in the opposite direction to the direction of change in the attitude of the electronic device (842).

[0201] An electronic device (842) applying the present invention can display an output frame that moves based on the amount of change in the posture of the electronic device (842) and the determined correction value on the display (630).

[0202] The user can obtain an output frame that can be obtained when the electronic device (842) (electronic device (100) of FIG. 6) is rotated by an angle smaller than the rotation angle.

[0203] FIG. 9 is a drawing for explaining an operation of changing the configuration of the overall zoom ratio according to various embodiments of the present invention.

[0204] The electronic device (100) can adjust the digital zoom ratio and the optical zoom ratio of the camera to configure the overall zoom ratio. The overall zoom ratio can be determined based on the digital zoom ratio and the optical zoom ratio of the camera. In one example, the overall zoom ratio can be a product of the digital zoom ratio and the optical zoom ratio of the camera. In one example, the electronic device (100) can determine the optical zoom ratio and the digital zoom ratio of the camera based on a user input that sets the overall zoom ratio. For example, the electronic device (100) can set the overall zoom ratio by activating the optical zoom without activating the digital zoom if the overall zoom ratio set by the user is lower than the maximum optical zoom ratio that the camera can support. For another example, the electronic device (100) may control the camera to capture an image using the maximum optical zoom magnification that the camera can support, if the overall zoom magnification set by the user is equal to or greater than the maximum optical zoom magnification that the camera can support, and activate digital zoom to enlarge the captured image. If the overall zoom magnification is set to 10x, the electronic device (100) may set the optical zoom magnification of the camera to 5x and the digital zoom magnification to 2x, thereby setting the overall zoom magnification to 10x.

[0205] The electronic device (100) can adjust the optical zoom ratio and the digital zoom ratio while maintaining the overall zoom ratio. The overall zoom ratio can be determined as a product of the digital zoom ratio and the optical zoom ratio. The electronic device (100) can adjust the optical zoom ratio and the digital zoom ratio while maintaining the overall zoom ratio. For example, the electronic device (100) can decrease the optical zoom ratio from 5x to 1x and increase the digital zoom ratio from 2x to 10x while maintaining the overall zoom ratio at 10x.

[0206] The size of an input frame acquired by a camera (e.g., camera (620) of FIG. 6) may be determined according to the optical zoom magnification of the camera (e.g., camera (620) of FIG. 6). The angle of view of the input frame acquired by the camera (e.g., camera (620) of FIG. 6) may become smaller as the optical zoom magnification of the camera (e.g., camera (620) of FIG. 6) becomes higher. The size of the input frame may become smaller as the angle of view of the input frame becomes smaller. The angle of view of the input frame acquired by the camera (e.g., camera (620) of FIG. 6) may become larger as the optical zoom magnification of the camera (e.g., camera (620) of FIG. 6) becomes lower. The size of the input frame may become larger as the angle of view of the input frame becomes larger.

[0207] The electronic device (100) can increase the size of the acquired input frame by reducing the optical zoom magnification of the camera (e.g., the camera (620) of FIG. 6) while maintaining the overall zoom magnification. For example, the size of the input frame (920) acquired by the camera (e.g., the camera (620) of FIG. 6) set to an optical zoom of 1x in FIG. 9 (b) may be larger than the size of the input frame (930) acquired by the camera (e.g., the camera (620) of FIG. 6) set to an optical zoom of 5x in FIG. 9 (c).

[0208] The electronic device (100) can determine the degree to which the output frame moves based on the amount of change in the attitude of the electronic device and the determined correction value, and can display the output frame by moving it on the display. The electronic device (100) can display the output frame (e.g., the output frame (911) of FIG. 9 (a)) on the display (the display (630) of FIG. 6) in an area included in the input frame (e.g., the input frame (910) of FIG. 9 (a)). When the electronic device (100) is performing correction for the movement of the output frame, if the output frame (e.g., the output frame (911) of FIG. 9 (a)) exceeds the range of the input frame (e.g., the input frame (910) of FIG. 9 (a)), the electronic device (100) may not be able to perform correction for the movement of the output frame. For example, an output frame (e.g., an output frame (911) of FIG. 9(a)) may include an area close to the boundary of an existing input frame (e.g., an input frame (910) of FIG. 9(a)). When a user rotates the electronic device (100) by some angle (901) to capture an object (900) moving to the right, the output frame (e.g., an output frame (911) of FIG. 9(a)) may exceed the area of ​​the existing input frame (e.g., an input frame (910) of FIG. 9(a)), and thus correction of the movement of the output frame may no longer be performed. In order to continuously use the correction value, the electronic device (100) needs to set the size of the input frame (e.g., an input frame (910) of FIG. 9(a)) to be larger.

[0209] The electronic device (100) can decrease the optical zoom magnification of a camera (e.g., camera (620) of FIG. 6) and increase the digital zoom magnification while maintaining the overall zoom magnification when an output frame (e.g., output frame (911) of FIG. 9 (a)) includes an area close to the boundary of an input frame (e.g., input frame (910) of FIG. 9 (a)).

[0210] The electronic device (100) can check whether the output frame (e.g., the output frame (921) of FIG. 9(b)) includes an area close to the boundary of the input frame before the change (e.g., the input frame (9100) before the change of FIG. 9(b)). If the output frame (e.g., the output frame (921) of FIG. 9(b)) includes an area close to the boundary of the input frame before the change (e.g., the input frame (9100) before the change of FIG. 9(b)), the electronic device (100) can lower the optical zoom magnification of the camera (e.g., the camera (620) of FIG. 6). The electronic device (100) can decrease the optical zoom magnification of the camera (e.g., the camera (620) of FIG. 6) (from 5x to 1x) and increase the digital zoom magnification (from 2x to 10x) while maintaining the set zoom magnification (e.g., 10x). In response to an operation of the electronic device (100) to decrease the optical zoom magnification of a camera (e.g., camera (620) of FIG. 6), the size of an input frame (e.g., input frame (9100) before change of FIG. 9 (b)) acquired by the camera (e.g., camera (620) of FIG. 6) may increase. For example, the size of the input frame before change (e.g., input frame (9100) before change of FIG. 9 (b)) may increase to an input frame acquired in response to a change in the optical zoom magnification (e.g., input frame (920) of FIG. 9 (b)).

[0211] The electronic device (100) can compensate for the movement of an output frame (e.g., an output frame (921) of FIG. 9 (b)) by increasing the size of an input frame (e.g., an input frame (9100) before change of FIG. 9 (b)), and can increase an area included in an input frame (e.g., an input frame (920) of FIG. 9 (b)) that can be displayed on a display (a display (630) of FIG. 6).

[0212] The electronic device (100) may perform movement correction of an output frame (e.g., an output frame (921) of FIG. 9 (b)) in an input frame (e.g., an input frame (920) of FIG. 9 (b)) that is wider than the input frame before change (e.g., an input frame (9100) of FIG. 9 (b)) by increasing the size of the input frame, and display the correction on a display (a display (630) of FIG. 6). For example, the output frame (e.g., an output frame (921) of FIG. 9 (b)) may not include an area close to the boundary of the enlarged input frame (e.g., an input frame (920) of FIG. 9 (b)). Even if a user rotates a camera (e.g., camera (620) of FIG. 6) further to the right than the current angle to capture an object (900) moving to the right, an output frame (e.g., output frame (921) of FIG. 9 (b)) may not exceed the area of ​​an input frame (e.g., input frame (920) of FIG. 9 (b)). The electronic device (100) may obtain an output frame in which the user has continuously performed correction for the movement of the output frame by setting the optical zoom magnification of the camera (e.g., camera (620) of FIG. 6) low.

[0213] The electronic device (100) may increase the optical zoom magnification of the camera (e.g., the camera (620) of FIG. 6) and decrease the digital zoom magnification while maintaining the overall zoom magnification when the output frame (e.g., the output frame (931) of FIG. 9(c)) is spaced from the boundary of the input frame (e.g., the frame before change (9200) of FIG. 9(c)). In response to the operation of the electronic device (100) increasing the optical zoom magnification of the camera (e.g., the camera (620) of FIG. 6), the size of the input frame (e.g., the frame before change (9200) of FIG. 9(c)) may decrease. For example, the electronic device (100) may determine whether the output frame (e.g., the output frame (931) of FIG. 9(c)) includes an area close to the boundary of the input frame (e.g., the frame before change (9200) of FIG. 9(c)). The electronic device (100) can increase the optical zoom magnification of the camera (e.g., the camera (620) of FIG. 6) and decrease the digital zoom magnification while maintaining the overall zoom magnification, if the output frame (e.g., the output frame (931) of FIG. 9 (c)) does not include an area included in the boundary of the input frame (e.g., the frame before change (9200) of (c)). The electronic device (100) can increase the optical zoom magnification of the camera (e.g., the camera (620) of FIG. 6) (e.g., from 1x to 5x) and decrease the digital zoom magnification (e.g., from 10x to 2x) while maintaining the set overall zoom magnification (e.g., from 1x to 5x).

[0214] The electronic device (100) can increase the image quality of an output frame (e.g., the output frame (931) of (c) of FIG. 9) by reducing the digital zoom ratio while maintaining the overall zoom ratio. When the overall zoom ratio is the same, the image quality of the output frame (e.g., the output frame (921) of (b) of FIG. 9) may decrease as the digital zoom ratio increases. When the output frame (e.g., the output frame (931) of (c) of FIG. 9) does not include an area close to the boundary of the input frame (e.g., the frame before change (9200) of (c) of FIG. 9)), the electronic device (100) can decrease the digital zoom ratio to increase the image quality of the output frame (e.g., the output frame (931) of (c) of FIG. 9) displayed on the display.

[0215] FIG. 10 is a diagram illustrating an operation of receiving a user input regarding whether to perform correction of movement of an output frame of an electronic device according to various embodiments of the present invention.

[0216] Figure 10 (a) is a drawing showing a screen for receiving user input on whether to perform correction of movement of an output frame.

[0217] The electronic device (100) can receive user input for setting the overall zoom ratio.

[0218] The electronic device (100) may be configured to perform correction of the movement of the output frame in response to confirming that the overall zoom magnification is set to be greater than or equal to a predetermined magnification. The predetermined magnification may refer to a magnification indicating the overall zoom magnification at which correction of the movement of the output frame begins. A memory (e.g., memory (640) of FIG. 6) may store the predetermined magnification set by the user, and a processor (e.g., processor (610) of FIG. 6) may confirm the predetermined magnification stored in the memory. The processor (e.g., processor (610) of FIG. 6) may confirm whether the set overall zoom magnification is greater than or equal to a predetermined magnification (e.g., 10x).

[0219] The electronic device (100) may display an input window (1011) that allows selection of whether to perform correction of movement of an output frame in at least a portion of a display (e.g., display (630) of FIG. 6) in response to determining that the overall zoom magnification is greater than or equal to a predetermined magnification. The display (e.g., display (630) of FIG. 6) may display the input window (1011) simultaneously with displaying the output frame (1010). The input window (1011) may include an area (YES) indicating to perform correction of movement of the output frame and an area (NO) indicating not to perform correction of movement of the output frame.

[0220] The electronic device (100) may receive a user input as to whether to perform correction of the movement of the output frame in response to confirming that the overall zoom magnification is greater than or equal to a predetermined magnification. The electronic device (100) may use at least one sensor (e.g., a touch sensor) to confirm a user input indicating whether to perform correction of the movement of the output frame. The electronic device (100) may receive a user input touching an area (YES) indicating to perform correction of the movement of the output frame. The electronic device (100) may perform correction of the movement of the output frame in response to the user input indicating to perform correction of the movement of the output frame. The processor (e.g., the processor (610) of FIG. 6) may display an output frame according to the amount of change in the attitude of the electronic device and a correction value on a display (e.g., the display (630) of FIG. 6) in response to the user input indicating to perform correction of the movement of the output frame. The electronic device (100) may receive a user input that touches an area (NO) indicating that no correction of the movement of the output frame is to be performed. The electronic device (100) may not perform correction of the movement of the output frame in response to a user input indicating that no correction of the movement of the output frame is to be performed.

[0221] The memory (e.g., the memory (640) of FIG. 6) can store a user's preset on whether to perform correction of the movement of the output frame. The electronic device (100) can check the preset on whether to perform correction of the movement of the output frame stored in the memory (e.g., the memory (640) of FIG. 6).

[0222] In one example, the electronic device (100) may not display an input window (1011) for selecting whether to perform correction of the movement of the output frame on the display (e.g., the display (630) of FIG. 6) in response to confirming that the user has previously set the correction of the movement of the output frame to be performed. The electronic device (100) may perform correction of the movement of the output frame without delay and display the output frame on the display (e.g., the display (630) of FIG. 6) in response to confirming that the overall zoom magnification is equal to or greater than the set magnification.

[0223] In one example, the electronic device (100) may not display an input window (1011) for selecting whether to perform correction of the movement of the output frame on the display (e.g., the display (630) of FIG. 6) in response to confirming that the user has previously set not to perform correction of the movement of the output frame. The electronic device (100) may not perform correction of the movement of the output frame even if it confirms that the overall zoom magnification is greater than or equal to the set magnification.

[0224] Figure 10 (b) is a drawing showing a screen displayed on a display in a situation where an electronic device performs correction of movement of an output frame.

[0225] The electronic device (100) may display a notification window (1021) indicating whether to perform correction of movement of the output frame on at least a portion of the display (e.g., the display (630) of FIG. 6).

[0226] In one example, the notification window (1021) may include information related to a correction value. For example, the notification window (1021) may include information about the applied correction value or information about the overall zoom ratio.

[0227] In one example, the notification window (1021) may include an input area that can be set not to perform correction of the movement of the output frame. A processor (e.g., processor (610) of FIG. 6) may stop performing correction of the movement of the output frame in response to receiving a user input touching the input area that can be set not to perform correction of the movement of the output frame.

[0228] According to one embodiment, the electronic device (100) may receive a user input for setting a correction value, and display an output frame that is moved based on the amount of change in the posture of the electronic device and the correction value set by the user input on a display (e.g., display (630) of FIG. 6).

[0229] The electronic device (100) may include an area (1022) for receiving user input for setting a correction value in at least a portion of a display (e.g., display (630) of FIG. 6). The area (1022) for receiving user input for setting a correction value may include at least one operation key (1023) capable of setting the correction value. The electronic device (100) may receive a user input for the operation key (1023) and set a correction value in response to the user input.

[0230] FIG. 11 is a diagram for explaining conditions for performing correction of movement of an output frame in an electronic device according to various embodiments of the present invention.

[0231] Figure 11 (a) is a drawing illustrating a situation in which an electronic device (100) does not satisfy a specified condition. Figure 11 (b) is a drawing for explaining the operation of an electronic device while not performing correction for output frame movement.

[0232] The electronic device (100) may be set to perform correction of the movement of the output frame in response to the overall zoom ratio being set to be greater than a predetermined magnification.

[0233] The electronic device (100) may receive a user input regarding whether to perform correction of the movement of the output frame. For example, the electronic device (100) may receive a user input of touching an area instructing to perform correction of the movement of the output frame through an input window (e.g., an input window (1011) of FIG. 10), and may perform correction of the movement of the output frame in response to the user input instructing to perform correction of the movement of the output frame.

[0234] When the electronic device (100) receives a user input instructing it to perform correction of the movement of the output frame, the electronic device can determine whether the specified condition is satisfied.

[0235] According to one embodiment, the specified condition may include a condition in which the angular velocity of the electronic device (100) is less than a specified value. When the electronic device (100) receives a user input instructing correction of the movement of the output frame, the electronic device (100) may measure the angular velocity of the electronic device (100) using a sensor (e.g., a gyro sensor). The electronic device (100) may determine whether the measured angular velocity of the electronic device is less than the specified value.

[0236] According to one embodiment, the specified condition may include a condition that at least one object exists in an output frame output to a display (e.g., display (630) of FIG. 6). When the electronic device (100) receives a user input instructing correction of movement of the output frame, the electronic device (100) may determine whether at least one object exists in the output frame.

[0237] The electronic device (100) performs correction of the movement of the output frame based on confirmation that the electronic device (100) satisfies the specified condition, or

[0238] Based on determining that a specified condition is not satisfied, correction of the movement of the output frame may not be performed. The electronic device (100) may delay correction of the movement of the output frame if it receives a user input instructing application of a correction value if the specified condition is not satisfied.

[0239] According to one embodiment, the electronic device (100) may not perform correction of the movement of the output frame in response to determining that the measured angular velocity of the electronic device is greater than or equal to a specified value.

[0240] According to one embodiment, the electronic device (100) may not perform correction of movement of the output frame in response to determining that at least one object does not exist in the output frame displayed on the display.

[0241] Below, we describe an example where an electronic device delays applying correction values ​​in a situation where the output frame does not contain an object.

[0242] The initial output frame (the initial output frame (1111) of (a) of FIG. 11) may be an image that does not include an object. The initial input frame (the initial input frame (1110) of (a) of FIG. 11) may be an input frame that a camera (e.g., the camera (620) of FIG. 6) acquires immediately after the correction of the movement of the output frame is set to be performed. The initial output frame (1111) may be a part of an image included in the initial input frame (the initial input frame (1110) of FIG. 11) that is displayed on a display (e.g., the display (630) of FIG. 6) immediately after the correction of the movement of the output frame is set to be performed.

[0243] In one example, while the electronic device receives user input through an input window (e.g., input window (1011) of FIG. 10), an object (400) tracked by a camera (e.g., camera (620) of FIG. 6) may deviate from its initial position. In another example, a rotation of the camera (e.g., camera (620) of FIG. 6) unintentionally caused by an impact accompanying a user input entered into the input window (e.g., input window (1011) of FIG. 10) of FIG. 10 (a) may occur.

[0244] The electronic device (100) may, after receiving a user input instructing correction of the movement of an output frame, determine whether a specified condition is satisfied. The specified condition may include at least one of a condition in which the angular velocity of the electronic device is less than a specified value and a condition in which at least one object is present in the output frame displayed on the display.

[0245] According to one embodiment, the electronic device (100) can determine whether the angular velocity of the electronic device (e.g., the electronic device (100) of FIG. 1) exceeds a specified angular velocity. According to one embodiment, the electronic device (100) can determine whether at least one object is included in the initial output frame (1111) after being set to perform correction of the movement of the output frame.

[0246] The electronic device (100) performs correction of the movement of the output frame based on the confirmation that the electronic device satisfies the specified conditions, or

[0247] Based on determining that a specified condition is not satisfied, correction of the movement of the output frame may not be performed. According to one embodiment, the electronic device (100) may not perform correction of the movement of the output frame in response to determining that at least one object does not exist in the output frame (the initial output frame (1111) of (a) of FIG. 11) output to the display (e.g., the display (630) of FIG. 6).

[0248] The electronic device (100) may display at least one indication (1101) in a portion of a display (e.g., display (630) of FIG. 6) to indicate that correction of movement of an output frame is not performed. According to one embodiment, the notification window (1021) may include at least one indication (1101) to indicate that correction of movement of an output frame is not performed.

[0249] According to one embodiment, the electronic device (100) may reset whether to perform movement compensation of the output frame if a specified period of time elapses without satisfying a specified condition. For example, if a specified period of time elapses without at least one object being included in the output frame, the electronic device (100) may reset whether to perform movement compensation of the output frame.

[0250] Figure 11 (b) is a drawing for explaining the operation of re-applying the correction value of the electronic device to the output frame movement.

[0251] The electronic device (100) may perform correction of the movement of the output frame based on confirming that a specified condition is satisfied while not performing correction of the movement of the output frame. When the processor (e.g., the processor (610) of FIG. 6) receives a user input instructing to perform correction of the movement of the output frame, if the specified condition is not satisfied, the processor may delay the operation of performing correction of the movement of the output frame, and may perform correction of the movement of the output frame based on confirming that the specified condition is satisfied.

[0252] According to one embodiment, the electronic device (100) can perform correction of the movement of the output frame in response to determining that the measured angular velocity of the electronic device is less than a specified value.

[0253] According to one embodiment, the electronic device (100) may perform correction of movement of the output frame in response to confirming that at least one object (400) exists in the output frame (output frame (1121) of (b) of FIG. 11) output to the display (display (630) of FIG. 6).

[0254] The electronic device (100) can continuously check whether a specified condition is satisfied while not performing correction of the movement of the output frame.

[0255] According to one example, the electronic device (100) can check whether at least one object is included in the output frame (the output frame (1121) of (b) of FIG. 11) while not performing correction of the movement of the output frame. The electronic device (100) can perform correction of the movement of the output frame in response to confirming that at least one object is included in the output frame (the output frame (1121) of (b) of FIG. 11).

[0256] The electronic device (100) may display at least one indication (1102) in a portion of the display to indicate that correction of the movement of the output frame is performed. The notification window (notification window (1021) of (b) of FIG. 11) may include at least one indication (1102) indicating that correction of the movement of the output frame is performed.

[0257] In FIG. 11, a case is described where a user input is received instructing correction of the movement of an output frame to be performed, but a processor (e.g., processor (610) of FIG. 6) may determine whether an electronic device satisfies a specified condition even while performing correction of the movement of an output frame. The processor (e.g., processor (610) of FIG. 6) may perform correction of the movement of an output frame based on determining that the electronic device does not satisfy the specified condition even while performing correction of the movement of an output frame, without performing correction of the movement of an output frame, and may perform correction of the movement of an output frame based on determining that the specified condition is satisfied.

[0258] FIG. 12 is a diagram for explaining an operation of reducing a shake correction threshold according to various embodiments of the present invention.

[0259] The third coordinate plane (1200) may be a coordinate plane on which the angular velocity of the electronic device (100) required for photographing a moving object is displayed. The y-axis of the third coordinate plane (1200) may refer to an axis representing the angular velocity of the electronic device (100) required for photographing an object moving at a speed of 1 m / s. The x-axis of the third coordinate plane (1200) may refer to the overall zoom magnification set in the electronic device (100). According to one example, in the third coordinate plane (1200), when the overall zoom magnification set in the electronic device is a magnification, the distance between the electronic device and the object may refer to a case where a (meter) is used.

[0260] The first graph (1201) depicted on the third coordinate plane (1200) may be a graph showing the angular velocity of an electronic device (101) required for photographing a moving object.

[0261] The pre-change shake correction threshold value (1203) shown in the third coordinate plane (1200) may be a threshold value for correcting rotational motions that are not intended by the user during rotational motions of the electronic device (100).

[0262] The third graph (1204) depicted in the third coordinate plane (1200) may be a graph showing the shake correction threshold after the change of the electronic device (100).

[0263] The electronic device (100) may not be able to correct the movement of the output frame if the output frame exceeds the range of the input frame while performing the correction of the movement of the output frame. According to one embodiment, the electronic device (100) may stop the operation of correcting the movement of the output frame if the output frame includes an area close to the boundary of the input frame. For example, if the optical zoom magnification of a camera (e.g., the camera (620) of FIG. 6) can no longer be lowered while maintaining the overall zoom magnification, the electronic device (100) may stop the operation of correcting the movement of the output frame if the output frame includes an area close to the boundary of the input frame.

[0264] The electronic device (100) can perform optical image stabilization (OIS) on the second output image based on a shake correction threshold value (1203), which is a value related to the angular velocity of the electronic device during a change in the electronic device's posture. The electronic device (100) can adjust the position of the output frame to correct shake within the input frame.

[0265] When the electronic device (100) is set to a high full zoom ratio while not performing compensation for the movement of the output frame, it may be difficult for the electronic device (100) to distinguish between the shake correction threshold (503) and the angular velocity of the electronic device required to capture a moving object. For example, in an electronic device set to a 60x full zoom ratio, if an object 60 m away from the electronic device moves at a speed of 1 m / s, the user may need to rotate the electronic device (100) by an angular velocity of 1 degree / 1 second to capture the moving object. Since the angular velocity of the camera (e.g., the camera (620) of FIG. 6) for capturing the moving object by the user is less than the shake correction threshold (e.g., 1 degree / 1 second) and a specified value, the electronic device (100) may not be able to distinguish between the rotation of the camera (e.g., the camera (620) of FIG. 6) intended by the user and unintended shaking.

[0266] The electronic device (100) can change the shake correction threshold (1203) when the overall zoom ratio is set to be greater than or equal to a certain zoom ratio (1211). The electronic device (100) can reduce the shake correction threshold in order to perform optical image stabilization (OIS) when the zoom ratio is set to be greater than or equal to a certain zoom ratio (1211). In response to confirming that the set overall zoom ratio is greater than or equal to the certain zoom ratio (1211), the electronic device (100) can reduce the shake correction threshold as shown in the third graph (1204).

[0267] The shake correction threshold may be set to decrease as the total zoom scale increases. For example, the electronic device (100) may decrease the shake correction threshold as the total zoom scale increases.

[0268] An electronic device can perform optical image stabilization (OIS) even when it cannot compensate for the movement of an output frame. Even when the output frame exceeds the range of an input frame and thus cannot compensate for the movement of the output frame, the electronic device can distinguish between a shake correction threshold (1204) and an angular velocity (1201) of a camera (e.g., camera (620) of FIG. 6) required for capturing a moving object.

[0269] FIG. 13 is a diagram illustrating an example in which an electronic device according to various embodiments of the present invention simultaneously applies an operation for performing correction of movement of an output frame and an operation for changing a shake correction threshold.

[0270] The fourth coordinate plane (1300) may be a coordinate plane on which the angular velocity of the electronic device (100, 101) required for photographing a moving object is displayed. The y-axis of the fourth coordinate plane (1300) may refer to an axis representing the angular velocity of the electronic device (100, 101) required for photographing an object moving at a speed of 1 m / s. The x-axis of the fourth coordinate plane (1300) may refer to an overall zoom magnification set in the electronic device (100, 101). According to one example, in the fourth coordinate plane (1300), when the overall zoom magnification set in the electronic device is a magnification, the distance between the electronic device and the object may refer to a case where a (meter) is used.

[0271] The first graph (1302) depicted on the fourth coordinate plane (1300) may be a graph showing the angular velocity of an electronic device (100) required for photographing a moving object.

[0272] The second graph (1301) depicted on the fourth coordinate plane (1300) may be a graph showing the angular velocity of the electronic device (100) required for photographing a moving object in an electronic device that performs correction of the movement of the output frame.

[0273] The correction performance area (1310) may be an area that displays coordinates at the full zoom ratio set to perform correction of the movement of the output frame.

[0274] The first graph (1302) and the second graph (1301) may not match in the correction performance area (1310). Since the first graph (1302) and the second graph (1301) match the first graph (811) and the second graph (812) described in FIG. 8A, a duplicate description is omitted.

[0275] The pre-change shake correction threshold value (1303) illustrated in the fourth coordinate plane (1300) may be a threshold value for correcting a rotational motion that is not intended by the user during the rotational motion of the electronic device (100).

[0276] The third graph (1304) depicted on the fourth coordinate plane (1300) may be a graph representing the shake correction threshold value (1204) after change in an electronic device.

[0277] The shake correction threshold value (1303) before the change may not match the third graph. The shake correction threshold value may be set to decrease as the overall zoom magnification increases. The electronic device (100) may change the shake correction threshold value (1303) when the overall zoom magnification is set to be greater than or equal to a certain zoom magnification (1313). When the overall zoom magnification is set to be greater than or equal to a certain zoom magnification (1313), the electronic device (100) may decrease the shake correction threshold value in order to perform optical image stabilization (OIS). In response to confirming that the set overall zoom magnification is greater than or equal to a certain zoom magnification, the electronic device (100) may decrease the shake correction threshold value according to the third graph (1304).

[0278] The shake correction threshold may be set to decrease as the total zoom scale increases. For example, the electronic device (100) may set the shake correction threshold to decrease as the total zoom scale increases. The third graph (1304) may be a graph representing a shake correction threshold set to decrease as the total zoom scale increases.

[0279] The operation of reducing the shake correction threshold value described in FIG. 12 and the operation of performing compensation for the movement of the output frame described in FIG. 8 may be performed simultaneously. The electronic device (100) may simultaneously reduce the compensation value and the shake correction threshold value in response to an increase in the set zoom ratio. For example, when the set zoom ratio increases, the electronic device (100) may reduce the compensation value and the shake correction threshold value.

[0280] The zoom factor (1311) at which the correction value starts to be applied and the zoom factor (1313) at which the shake correction threshold starts to change can be set to different overall zoom factors.

[0281] The electronic device (100) can distinguish between the angular velocity of the electronic device (100) and the shake correction threshold required for photographing a moving object by simultaneously performing an operation of reducing a shake correction threshold and an operation of performing compensation for the movement of an output frame. The electronic device (100) can perform a compensation value and optical image stabilization (OIS) for all settable overall zoom magnifications.

[0282] FIG. 14 is a drawing illustrating an example of performing output frame correction according to one embodiment of the present invention.

[0283] The electronic device can perform correction of the movement of the output frame based on the correction value and the change in the posture of the electronic device (100). The electronic device (100) can perform correction of the movement of the output frame when the overall zoom magnification is set to a specified magnification or higher or when the user sets the correction of the movement of the output frame. The electronic device (100) can perform correction of the movement of the output frame regardless of the presence or absence of an object or the number of objects acquired using the camera. The electronic device (100) can perform correction of the output frame even in a situation where the object being photographed does not move. In addition, the electronic device (100) can perform correction of the output frame even in a situation where the posture of the electronic device (100) changes in order to photograph another object among a plurality of objects that is not included in the output frame.

[0284] According to one embodiment, the electronic device (100) may perform correction of the movement of the output frame while photographing (1410) a stationary object (e.g., the moon) (1411). The user of the electronic device (100) may maintain the posture of the electronic device (100) to maintain the position of the object (1411) on the output frame while photographing the stationary object (1411). Alternatively, the user may change the posture of the electronic device (100) to partially change the position of the object on the output frame while photographing the stationary object (1411). The electronic device (100) may perform correction of the movement of the output frame in response to the overall zoom magnification exceeding a specified magnification even when photographing the stationary object (1411).

[0285] According to one embodiment, the electronic device (100) can perform correction of the movement of the output frame while photographing a plurality of objects (1420). The user of the electronic device (100) can change the posture of the electronic device (100) while photographing a plurality of objects (1421, 1422, 1423). For example, the posture of the electronic device (100) can be changed to change an object (1421, 1422) included in the output frame among the plurality of objects (1421, 1422, 1423). The electronic device (100) can correct the movement of the output frame even in a situation where the posture of the electronic device changes so as to include an object (1423) that is not included in the output frame in the output frame.

[0286] FIG. 15 is a flowchart illustrating an operation method of an electronic device according to various embodiments of the present invention.

[0287] The illustrated method can be performed by the electronic device described through FIGS. 6 to 14, and the description of the technical features described above will be omitted below.

[0288] According to various embodiments of the present invention, in operation 1510, an electronic device (e.g., electronic device (100) of FIG. 6) can check an overall zoom ratio determined based on an optical zoom ratio and a digital zoom ratio of a camera.

[0289] According to various embodiments of the present invention, in operation 1520, the electronic device (e.g., the electronic device (100) of FIG. 6) may determine a correction value for compensating for a change in the attitude of the electronic device for determining an output frame that is at least a portion of an input frame captured based on an optical zoom magnification, based on an overall zoom magnification.

[0290] According to various embodiments of the present invention, in operation 1530, an electronic device (e.g., the electronic device (100) of FIG. 6) may detect a change in the posture of the electronic device.

[0291] According to various embodiments of the present invention, in operation 1540, an electronic device (e.g., the electronic device (100) of FIG. 6) may display an output frame based on a change in the posture of the electronic device on the display (630).

[0292] According to various embodiments of the present invention, the amount of change in the posture of the detected electronic device can be corrected based on the correction value.

[0293] According to various embodiments of the present invention, an electronic device (e.g., the electronic device (100) of FIG. 6) may be configured to reduce the amount of change in the posture of the electronic device as the total zoom scale increases.

[0294] According to various embodiments of the present invention, the correction value can be set to reduce the amount of change in the attitude of the electronic device as the total zoom scale increases.

[0295] According to various embodiments of the present invention, an electronic device (e.g., the electronic device (100) of FIG. 6) can increase the amount of change in the posture of the electronic device as the total zoom scale decreases.

[0296] According to various embodiments of the present invention, the correction value may be set to increase the amount of change in the attitude of the electronic device as the total zoom scale decreases.

[0297] According to various embodiments of the present invention, the correction value may include a value indicating a ratio of a change in the posture of the corrected electronic device to a change in the posture of the sensed electronic device.

[0298] According to various embodiments of the present invention, an electronic device (e.g., the electronic device (100) of FIG. 6) performs optical image stabilization (OIS) on an output frame based on a shake correction threshold value that is a value related to an angular velocity of the electronic device, and the shake correction threshold value may be set to decrease as the overall zoom magnification increases.

[0299] According to various embodiments of the present invention, an electronic device (e.g., electronic device (100) of FIG. 6) can determine whether an output frame includes an area close to a boundary of an input frame, and if so, increase a digital zoom factor while maintaining an overall zoom factor, and decrease the optical zoom factor.

[0300] According to various embodiments of the present invention, an electronic device (e.g., the electronic device (100) of FIG. 6) may increase a digital zoom scale and decrease an optical zoom scale, and then check whether an output frame includes an area close to a boundary of an input frame, and if it does not include an area close to the boundary, decrease a digital zoom scale constituting a total zoom scale and increase an optical zoom scale while maintaining the total zoom scale.

[0301] According to various embodiments of the present invention, an electronic device (e.g., electronic device (100) of FIG. 6) receives a user input for setting a correction value, and a change in the posture of the electronic device can be corrected based on the correction value corresponding to the user input.

[0302] According to various embodiments of the present invention, an electronic device (e.g., the electronic device (100) of FIG. 6) receives a user input as to whether to perform correction of a change in the posture of the electronic device, and when receiving a user input instructing to perform correction of a movement of an output frame, the electronic device may determine whether a specified condition is satisfied, and perform correction of a change in the posture of the electronic device based on determining that the electronic device satisfies the specified condition, or may not perform correction of a change in the posture of the electronic device based on determining that the electronic device does not satisfy the specified condition.

[0303] According to various embodiments of the present invention, the specified condition may include at least one of a condition in which the angular velocity of the electronic device is less than a specified value and a condition in which at least one object is present in an output frame displayed on the display.

[0304] Electronic devices according to various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the aforementioned devices.

[0305] The various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” each include all possible combinations of the items listed together in that phrase. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0306] The term "module" as used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0307] Various embodiments of the present document may be implemented as software (e.g., a program) including one or more instructions stored in a storage medium (e.g., an internal memory or an external memory) readable by a machine (e.g., an electronic device (100)). For example, a processor (e.g., a processor (110)) of the machine (e.g., an electronic device (100)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0308] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0309] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single or multiple entities. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, At least one camera; display; A memory storing at least one computer program; and Contains at least one processor, The at least one computer program, when executed individually or collectively by the at least one processor, causes the electronic device to: Check the overall zoom ratio determined based on the optical zoom ratio and digital zoom ratio of the above camera, A correction value for compensating for a change in the posture of the electronic device for determining an output frame that is at least a part of an input frame photographed based on the optical zoom ratio is determined based on the overall zoom ratio, Detecting changes in the posture of the above electronic device, An instruction for displaying an output frame based on a change in the posture of the electronic device on the display, An electronic device in which the change in posture of the electronic device detected above is corrected based on the correction value.

2. In the first paragraph, the correction value is An electronic device configured to reduce the amount of change in the posture of the detected electronic device as the total zoom scale increases.

3. In the first paragraph, the correction value is An electronic device set to increase the amount of change in the posture of the detected electronic device as the total zoom scale decreases.

4. In the first paragraph, the correction value is, An electronic device comprising a value indicating a ratio of a change in the posture of the corrected electronic device to a change in the posture of the detected electronic device.

5. In the first paragraph, the at least one computer program, when the at least one processor is individually or collectively executed, the electronic device, Perform optical image stabilization (OIS) on the output frame based on a shake compensation threshold value related to the angular velocity of the electronic device, An electronic device wherein the shake correction threshold is set to decrease as the overall zoom magnification increases.

6. In the first paragraph, the at least one computer program, when the at least one processor is individually or collectively executed, the electronic device, Check whether the above output frame includes an area close to the boundary of the above input frame, An electronic device further comprising instructions for increasing the digital zoom factor and decreasing the optical zoom factor while maintaining the overall zoom factor, when the output frame includes an area close to the boundary of the input frame.

7. In paragraph 6, The at least one computer program, when executed individually or collectively by the at least one processor, causes the electronic device to: After increasing the digital zoom ratio and decreasing the optical zoom ratio, it is checked whether the output frame includes an area close to the boundary of the input frame, An electronic device further comprising instructions for decreasing the digital zoom factor and increasing the optical zoom factor while maintaining the overall zoom factor, if the output frame does not include an area close to the boundary of the input frame.

8. In the first paragraph, the at least one computer program, when the at least one processor is individually or collectively executed, the electronic device, Further comprising instructions for receiving user input for setting the above correction value, An electronic device in which the change in posture of the electronic device detected above is corrected based on a correction value corresponding to the user input.

9. In the first paragraph, the at least one computer program, when the at least one processor is individually or collectively executed, the electronic device, Receive user input indicating whether to perform a correction for the change in posture of the electronic device; When receiving the above user input, check whether the electronic device satisfies the specified condition, Based on the confirmation that the electronic device satisfies the above-mentioned conditions, correction of the change in the attitude of the electronic device is performed, or An electronic device further comprising an instruction for not performing correction of a change in the attitude of the electronic device based on determining that the electronic device does not satisfy the specified condition.

10. In paragraph 9, the specified conditions are: An electronic device comprising at least one of the following conditions: an angular velocity of the electronic device is less than a specified value; and an output frame displayed on the display has at least one object present.

11. In the method of operating an electronic device, An action to determine the overall zoom ratio determined based on the optical zoom ratio and digital zoom ratio of the camera; An operation of determining, based on the overall zoom magnification, a correction value for compensating for a change in the posture of the electronic device for determining an output frame that is at least a portion of an input frame photographed based on the optical zoom magnification; Detecting changes in the posture of the above electronic device, Including an action of displaying an output frame based on the amount of change in the posture of the electronic device on a display, A method of operating an electronic device in which the change in posture of the electronic device is corrected based on the correction value.

12. In paragraph 11, The above correction value is An operating method of an electronic device, wherein the amount of change in the posture of the electronic device is set to decrease as the total zoom scale increases.

13. In paragraph 11, In the first paragraph, the correction value is A method of operating an electronic device, wherein the amount of change in the attitude of the electronic device is set to increase as the total zoom scale decreases.

14. In the 11th paragraph, the correction value is, A method of operating an electronic device, comprising a value indicating a ratio of a change in the posture of the corrected electronic device to a change in the posture of the detected electronic device.

15. In the 11th paragraph, the method, Further comprising an operation of performing optical image stabilization (OIS) on the output frame based on a shake compensation threshold value which is a value related to the angular velocity of the electronic device, A method of operating an electronic device, wherein the shake correction threshold is set to decrease as the overall zoom magnification increases.

Citation Information

Patent Citations

  • Camera location controlling method

    JP1995044679A

  • Imaging support device, imaging support system, imaging system, imaging support method, and program

    JP2023052365A

  • Image processing method and image processing device

    JP6708490B2

  • Apparatus and method of controlling the zoom using thedistance between user and camera

    KR1020060104606A

  • Method and electronic apparatus for stabilizing video

    KR1020170013102A