Method or electronic device providing image shooting guide

Abstract

An electronic device according to one embodiment of the present document may include a camera, a distance sensor, a display, and a processor. The processor may acquire an image including a subject through the camera, acquire distance data regarding the distance between the subject and the electronic device through the distance sensor, determine that de-focus has occurred based on the distance data, detect a region of interest including at least a part of the subject within the image, crop an area including at least the region of interest within the image, and enlarge and display the cropped area on the display along with a message indicating the de-focus.

Description

Technology Field

[0001] The present disclosure relates to a technology that provides a video shooting guide to a user using a camera and a distance sensor equipped in an electronic device. Background Technology

[0002] The minimum focus distance refers to the minimum distance between the image sensor and the subject required to focus on the subject. If the subject is located within the minimum focus distance from a shooting device, such as a camera, a defocused image is captured due to optical limitations. The problem to be solved

[0003] Recently, as the size of image sensors installed in mobile devices increases, the minimum focus distance of cameras is also increasing. Consequently, the problem of capturing defocused images of subjects located within the minimum focus distance is becoming more common.

[0004] Furthermore, electronic devices according to conventional technology did not consider the inherent characteristics of the subject when analyzing blur contained in an image, and utilized only low-level features such as frequency analysis of the image. means of solving the problem

[0005] An electronic device according to one embodiment of the present document may include a camera, a distance sensor, a display, and at least one processor electrically connected to the camera, the distance sensor, and the display, and configured to acquire an image including a subject through the camera, acquire distance data regarding the distance between the subject and the electronic device through the distance sensor, determine that de-focus has occurred based on the distance data, detect a region of interest including at least a part of the subject within the image, crop a region including at least the region of interest within the image, and enlarge and display the cropped region along with a message indicating the de-focus on the display.

[0006] A method of operation of an electronic device according to one embodiment of the present document may include: acquiring an image including a subject through a camera included in the electronic device; acquiring distance data regarding the distance between the subject and the electronic device through a distance sensor included in the electronic device; determining that defocus has occurred based on the distance data; detecting a region of interest including at least a part of the subject within the image; cropping a region including at least the region of interest within the image; and magnifying and displaying the cropped region on the display along with a message indicating the defocus.

[0007] An electronic device according to one embodiment of the present document may include a camera, a distance sensor, a display, and at least one processor electrically connected to the camera, the distance sensor, and the display, and may include a processor that acquires an image containing a subject through the camera, acquires distance data regarding the distance between the subject and the electronic device through the distance sensor, determines that defocus has occurred based on the distance data, and displays a message on the display that induces the distance between the subject and the electronic device to be greater than or equal to a minimum focal distance. Effects of the invention

[0008] According to various embodiments disclosed in this document, a user can recognize that the blur contained in an image is a blur caused by defocus resulting from photographing a subject located within the minimum focal distance. Additionally, the electronic device according to the present disclosure can analyze the characteristics of the subject and suggest optimal shooting conditions to the user, and the user can obtain an image without defocus by changing the shooting conditions according to the conditions suggested by the electronic device.

[0009] In addition, since the electronic device according to the present disclosure utilizes not only low-level features but also high-level features such as object detection and texture check when analyzing an image, it can propose optimal shooting conditions based on the unique characteristics of the subject.

[0010] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects can be clearly understood by those skilled in the art to which the present disclosure belongs from the description below. Brief explanation of the drawing

[0011] FIG. 1 shows an electronic device according to one embodiment. FIG. 2 is a block diagram of an electronic device according to one embodiment. FIG. 3 is a flowchart illustrating a method, according to one embodiment, in which an electronic device crops and enlarges an area of ​​interest and provides an image capture guide while displaying it on a display. FIG. 4 is a flowchart illustrating a method of providing an image capture guide when user input for a first visual affordance is received according to one embodiment. FIG. 5 is a flowchart illustrating the operation when user input for a second visual affordance is received according to one embodiment. FIG. 6 is a flowchart illustrating a method for analyzing image and distance data according to one embodiment. FIG. 7 illustrates an example of providing an image capture guide according to one embodiment. FIG. 8 illustrates an example of a region of interest that is cropped and enlarged within an image as the distance between the subject and the electronic device increases, according to one embodiment. FIG. 9 illustrates an example of a UI that induces a region of interest to be located in the center of an image according to one embodiment. FIG. 10 is a flowchart illustrating a method of providing an image capture guide through a message indicating defocus according to one embodiment. FIG. 11 illustrates an example of a message indicating defocus according to one embodiment. FIG. 12 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 13 is a block diagram illustrating a camera module according to various embodiments. Specific details for implementing the invention

[0012] FIG. 1 shows an electronic device according to one embodiment.

[0013] Referring to FIG. 1, a display (110) may be disposed on the front of an electronic device (100) according to one embodiment. In one embodiment, the display (110) may occupy most of the front of the electronic device (100). On the front of the electronic device (100), a display (110) and a bezel (120) area surrounding at least some edges of the display (110) may be disposed. In the example of FIG. 1, the display (110) may include a flat area (111) and a curved area (112) extending from the flat area (111) toward the side of the electronic device (100). In FIG. 1, the curved area (112) is shown only on one side (e.g., the left), but it can be understood that the same curved area is formed on the opposite side as well. Furthermore, the electronic device (100) shown in FIG. 1 is one example, and various embodiments are possible. For example, the display (110) of the electronic device (100) may include only a flat area (111) without a curved area (112), or may have a curved area (112) only on one edge rather than on both sides. In addition, in one embodiment, the curved area may extend to the rear of the electronic device (100), so that the electronic device (100) may have an additional flat area.

[0014] In one embodiment, a fingerprint sensor (141) for user fingerprint recognition may be included in a first area (140) of the display (110). The fingerprint sensor (141) may be placed on the lower layer of the display (110) so that it is not visible to the user or is difficult to see. Additionally, in addition to the fingerprint sensor (141), a sensor for additional user / biometric authentication may be placed in a part of the display (110). In another embodiment, the sensor for user / biometric authentication may be placed in a part of the bezel (120). For example, an IR sensor for iris authentication may be exposed through a part of the display (110) or through a part of the bezel (120).

[0015] In one embodiment, a sensor (143) may be included in at least one area of ​​the bezel (120) of the electronic device (100) or at least one area of ​​the display (110). The sensor (143) may be positioned at a distance adjacent to a camera module (e.g., front camera (131), rear camera (132)) or may be formed as a single module with the camera module.

[0016] In one embodiment, a front camera (131) may be positioned on the front of the electronic device (100). In the embodiment of FIG. 1, the front camera (131) is shown as being exposed through a portion of the display (110), but in another embodiment, the front camera (131) may be exposed through a bezel (120).

[0017] In one embodiment, the display (110) may include at least one of a sensor module, a camera module (e.g., a front camera (131), a rear camera (132)), and a light-emitting element (e.g., an LED) on the back of a screen display area (e.g., a flat area (111), a curved area (112)).

[0018] In one embodiment, a camera module may be positioned on the back surface of at least one of the front, side, and / or rear surfaces of the electronic device (100) so as to face the front, side, and / or rear surface. For example, the front camera (131) may not be visually exposed to the screen display area (e.g., flat area (111), curved area (112)) and may include a hidden under-display camera (UDC). In one embodiment, the electronic device (100) may include one or more front cameras (131). For example, the electronic device (100) may include two front cameras, such as a first front camera and a second front camera. In one embodiment, the first front camera and the second front camera may be cameras of the same type having equivalent specifications (e.g., pixels), but the first front camera and the second front camera may be implemented as cameras of different specifications. The electronic device (100) can support dual camera-related functions (e.g., 3D shooting, auto focus, etc.) through two front cameras.

[0019] In one embodiment, a rear camera (132) may be disposed on the rear of the electronic device (100). The rear camera (132) may be exposed through a camera area (130) of the rear cover (160). In one embodiment, the electronic device (100) may include a plurality of rear cameras disposed in the camera area (130). For example, the electronic device (100) may include two or more rear cameras. For example, the electronic device (100) may include a first rear camera, a second rear camera, and a third rear camera. The first rear camera, the second rear camera, and the third rear camera may have different specifications. For example, the FOV, pixels, aperture, support for optical zoom / digital zoom, support for image shake correction function, and the type and / or arrangement of lens sets included in each camera may differ from each other. For example, the first rear camera may be a standard camera, the second rear camera may be a camera for wide shooting (e.g., a wide-angle camera), and the third rear camera may be a camera for telephoto shooting. In the embodiments of this document, the description of the function or characteristics of the front camera may apply to the rear camera, and vice versa.

[0020] In one embodiment, various hardware that assists in shooting, such as a distance sensor (145) for detecting the distance between a subject and an electronic device (100), a sensor for object detection, and / or a flash, may be additionally placed in the camera area (130).

[0021] In one embodiment, the distance sensor (145) may be positioned at a distance adjacent to a camera module (e.g., front camera (131), rear camera (132)) or formed as a single module with the camera module. For example, the distance sensor (145) may operate as at least part of an IR (infrared) camera (e.g., TOF (time of flight) camera, structured light camera) or as at least part of a sensor module. For example, a TOF camera may operate as at least part of a sensor module for detecting the distance to a subject.

[0022] In one embodiment, at least one physical key may be disposed on the side of the electronic device (100). For example, a first function key (151) for turning the display (110) ON / OFF or turning the power of the electronic device (100) ON / OFF may be disposed on the right edge relative to the front of the electronic device (100). In one embodiment, a second function key (152) for controlling the volume of the electronic device (100) or controlling screen brightness, etc., may be disposed on the left edge relative to the front of the electronic device (100). In addition, additional buttons or keys may be disposed on the front or rear of the electronic device (100). For example, a physical button or touch button mapped to a specific function may be disposed in the lower area of ​​the front bezel (120).

[0023] The electronic device (100) illustrated in FIG. 1 is an example and does not limit the form of the device to which the technical concept disclosed in this document applies. The technical concept disclosed in this document is applicable to various user devices. For example, the technical concept disclosed in this document may be applied to a foldable electronic device that can be folded horizontally or vertically by employing a flexible display (110) and a hinge structure, or to a tablet or a laptop. For example, the electronic device (100) illustrated in the example is shown with a bar type or plate type appearance, but the various embodiments of this document are not limited thereto. For example, the illustrated electronic device may be part of a rollable electronic device. A rollable electronic device can be understood as an electronic device in which the display (110) can be bent and deformed so that at least a part of it can be wound or rolled or stored inside the electronic device (100). The rollable electronic device can be used by expanding the screen display area (e.g., flat area (111), curved area (112)) by unfolding the display (110) or by exposing a larger area of ​​the display (110) to the outside, depending on the user's needs. The display (110) may also be referred to as a slide-out display or an expandable display.

[0024] For convenience of explanation, various embodiments will be described below based on the electronic device (100) shown in FIG. 1.

[0026] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0027] Referring to FIG. 2, the electronic device (100) may include a camera (210), a distance sensor (145), a processor (220), and a display (110).

[0028] According to one embodiment, the camera (210) may include the rear camera (132) or the front camera (131) shown in FIG. 1.

[0029] According to one embodiment, the camera (210) can focus on a subject located further away than the minimum focus distance, so the processor (220) can obtain an image in which the subject is clearly expressed when the subject is located further away than the minimum focus distance. The camera (210) cannot focus on a subject located closer than the minimum focus distance, so defocus may occur. For example, if the minimum focus distance of the camera (210) is 50 cm, the camera (210) can focus on a subject located 70 cm away from the image sensor, but cannot focus on a subject located 30 cm away from the image sensor.

[0030] According to one embodiment, the distance sensor (145) may detect an object in a non-contact manner or measure the distance to the object using ultrasound. For example, the distance sensor (145) may measure the distance between a subject and an electronic device (100). The processor (220) may use the distance data obtained through the distance sensor (145) to determine whether the subject is located at a position farther or closer than the minimum focal distance of the camera (210).

[0031] According to one embodiment, the processor (220) may be understood to include at least one processor. For example, the processor (220) may include at least one of an application processor (AP), an image signal processor (ISP), and a communication processor (CP). In this regard, the processor (220) may be referred to as at least one processor or one or more processors.

[0032] In one embodiment, the processor (220) can execute / control various functions supported by the electronic device (100). For example, the processor (220) can execute an application and control various hardware by executing code written in a programming language stored in memory. For example, the processor (220) can execute an application that supports a shooting function stored in memory. In addition, the processor (220) can execute the camera (210) and set and support an appropriate shooting mode so that the camera (210) can perform an action intended by the user.

[0033] According to one embodiment, the processor (220) can analyze an image acquired through the camera (210) and distance data acquired through the distance sensor (145). When analyzing the image, the processor (220) may use low-level features that analyze frequency components within the image. Additionally, the processor (220) may analyze the image using high-level features such as object detection, texture check, and extract high-level features. Further details will be described later in FIG. 6.

[0034] In one embodiment, the display (110) may display at least one of an execution screen of an application executed by the processor (220), an image acquired through the camera (210), an image cropped and enlarged by the processor (220), a message inducing user action, or a visual affordance. Additionally, the processor (220) may display image data acquired through the camera (210) on the display (110) in real time.

[0035] In one embodiment, the display (110) may be implemented integrally with the touch panel. The display (110) may support touch functions and may detect user input, such as a touch using a finger, and transmit it to the processor (220). The display (110) may be connected to a display driver integrated circuit (DDIC) for driving the display (110), and the touch panel may be connected to a touch IC that detects touch coordinates and processes touch-related algorithms. In one embodiment, the display driver circuit and the touch IC may be formed integrally, and in another embodiment, the display driver circuit and the touch IC may be formed separately. The display driver circuit and / or the touch IC may be electrically connected to the processor (220).

[0037] FIG. 3 is a flowchart illustrating, according to one embodiment, a method in which an electronic device (100) crops and enlarges an area of ​​interest and displays it on a display (110) while providing an image capture guide. The method described in FIG. 3 may be executed by the electronic device (100) or the processor (220) of the electronic device (100).

[0038] According to one embodiment, in operation 310, the processor (220) can acquire an image including a subject through the camera (210) and acquire distance data regarding the distance between the subject and the electronic device (100) through the distance sensor (145).

[0039] According to one embodiment, in operation 320, the processor (220) can determine that defocus has occurred based on the distance data.

[0040] According to one embodiment, defocus may occur when the distance between the subject and the electronic device (100) is within the minimum focal distance. At this time, the processor (220) can determine that defocus has occurred by analyzing distance data obtained through the distance sensor (145). Additionally, the processor (220) can use the amount of blur included in the image as a supplementary method to determine that defocus has occurred. The processor (220) can use the image analysis results to correct errors that may occur in the analysis results of the distance data. Based on the distance data, the processor (220) can determine that the blur included in the image is due to defocus caused by shooting at a distance less than the minimum focal distance.

[0041] According to one embodiment, in operation 330, the processor (220) can detect a region of interest that includes at least a part of the subject within the image.

[0042] According to one embodiment, the processor (220) can detect a region of interest through object detection. The processor (220) can identify an area corresponding to a subject within the entire image and designate it as a region of interest. The region of interest may include the entire subject or a part of the subject. Further details are described later in FIG. 6.

[0043] According to one embodiment, when the processor (220) detects a region of interest, it may display a line surrounding the region of interest on the display (110). For example, the processor (220) may display a box surrounding the region of interest on the display (110).

[0044] According to one embodiment, in operation 340, the processor (220) can crop an area within the image that includes at least the region of interest. The processor (220) can crop only the region of interest or crop a wider area that includes the region of interest.

[0045] According to one embodiment, in operation 350, the processor (220) can enlarge and display the cropped area along with a message instructing the display (110) to defocus.

[0046] According to one embodiment, the message may include a message stating that defocus has occurred because the electronic device (100) is positioned closer than the minimum focal distance from the subject, or a message instructing the electronic device (100) to be moved away from the subject. For example, the message may be a message instructing the electronic device (100) to be moved at least 30 cm away from the subject.

[0047] According to one embodiment, the processor (220) can notify the user that defocus has occurred in an area of ​​interest within the image by performing an action of enlarging the cropped area and displaying it on the display (110). Additionally, the processor (220) can induce the user to move the electronic device (100) away from the subject to resolve the defocus by displaying a message indicating defocus on the display (110). The user can recognize the situation where defocus has occurred and that the electronic device (100) must be moved away from the subject from the defocusing message displayed on the electronic device (100) and the image where the subject is out of focus. The user can move the electronic device (100) away from the subject, and when the distance between the subject and the electronic device (100) becomes greater than or equal to the minimum focus distance, the processor (220) can obtain a clear image with the subject in focus.

[0048] According to one embodiment, when the processor (220) detects the region of interest in operation 330, it may display a first visual affordance on the display (110). When user input regarding the first visual affordance is present, the processor (220) may crop an area within the image that includes at least the region of interest, and enlarge and display the cropped area along with a message instructing the display (110) to defocus. Further details are described later in FIG. 4.

[0049] According to one embodiment, when the processor (220) detects the region of interest in operation 330, it can automatically crop an area within the image that includes at least the region of interest, even without separate user input, and enlarge and display the cropped area along with a message instructing the display (110) to defocus.

[0051] FIG. 4 is a flowchart illustrating a method of providing an image capture guide when user input for a first visual affordance is received according to one embodiment.

[0052] According to one embodiment, in operation 410, the processor (220) can detect a region of interest that includes at least a portion of a subject within an image. Operation 410 may correspond to operation 330 of FIG. 3.

[0053] According to one embodiment, in operation 420, the processor (220) may display a first visual affordance on the display. The first visual affordance may be in the form of a soft button displayed on the display (110).

[0054] According to one embodiment, the electronic device (100) can induce the user to take a picture at a magnification suitable for taking a picture of a subject. For example, the processor (220) can display a first visual affordance on the display that can adjust the magnification of the camera lens to a specific magnification when defocus occurs.

[0055] According to one embodiment, in operation 430, the processor (220) can determine that user input for the first visual affordance has been received. For example, the processor (220) can receive a touch input or a voice command that touches the touch screen with a finger or a manipulator.

[0056] According to one embodiment, in operation 440, when user input for the first visual affordance is received, the processor (220) may crop an area within the image that includes at least the region of interest. Operation 440 may correspond to operation 340 of FIG. 3.

[0057] According to one embodiment, in operation 450, the processor (220) may enlarge and display the cropped area along with a message instructing the display (110) to defocus. Operation 450 may correspond to operation 350 of FIG. 3.

[0058] According to one embodiment, the processor (220) can display a cropped and enlarged image on the display (110) according to the user's selection by displaying a first visual affordance on the display (110). For example, the user can touch the first visual affordance to view the cropped and enlarged image displayed on the display (110) and accurately recognize the situation in which defocus has occurred. As another example, the user can be provided with an uncropped and unenlarged image without touching the first visual affordance.

[0060] FIG. 5 is a flowchart illustrating the operation when user input for a second visual affordance is received according to one embodiment.

[0061] According to one embodiment, in operation 510, the processor (220) can display a second visual affordance on the display (110) while displaying a cropped area enlarged with a message indicating defocus. The second visual affordance may be in the form of a soft button displayed on the display (110).

[0062] According to one embodiment, the processor (220) may detect a region of interest and then, when user input regarding a first visual affordance displayed on the display (110) is received, or automatically upon detecting the region of interest, enlarge a cropped region and display it on the display (110) along with a message indicating defocus. At this time, the processor (220) may display a second visual affordance on the display (110) along with the message and the cropped and enlarged image.

[0063] According to one embodiment, in operation 520, the processor (220) can determine that user input for the second visual affordance has been received. For example, the processor (220) can receive touch input by touching the touch screen with a finger or an operating device (e.g., an electronic pen).

[0064] According to one embodiment, in operation 530, the processor (220) may display an image on the display (110) without cropping or enlarging. When user input regarding a second visual affordance is received, the processor (220) may stop the operation of cropping an area including at least a region of interest within the image, and the operation of enlarging and displaying the cropped area on the display (110). The processor (220) may display an image acquired through the camera (210) on the display (110) without cropping or enlarging.

[0065] According to one embodiment, the processor (220) may stop displaying a message instructing defocus on the display (110) when user input regarding a second visual affordance is received. For example, when user input regarding the second visual affordance is received while the electronic device (100) is located further away from the subject than the minimum focal distance, the processor (220) may not display a message instructing defocus on the display (110). According to another embodiment, the processor (220) may not stop displaying a message instructing defocus even when user input regarding the second visual affordance is received. For example, even when user input regarding the second visual affordance is received, if the distance between the subject and the electronic device (100) is within the minimum focal distance and the defocus is maintained accordingly, the processor (220) may continue to display a message instructing defocus on the display (110).

[0067] FIG. 6 is a flowchart illustrating a method for analyzing image and distance data according to one embodiment.

[0068] According to one embodiment, in operation 610, the processor (220) can acquire an image through the camera (210) and acquire distance data regarding the distance between the subject and the electronic device (100) through the distance sensor (145). Operation 610 may correspond to operation 310 of FIG. 3.

[0069] According to one embodiment, in operation 620, the processor (220) can analyze an image obtained through the camera (210) to determine whether the blur contained in the image is motion blur caused by the movement of the subject.

[0070] According to one embodiment, in operation 630, if the processor (220) determines that the blur in the image is not motion blur, it determines that defocus has occurred based on the distance data and can determine whether the blur in the image is a blur caused by defocus. In one embodiment, the processor (220) can analyze the amount of blur contained in the image and use the analyzed result to determine whether defocus has occurred.

[0071] According to one embodiment, when the distance between the subject and the electronic device (100) is within the minimum focal distance, the processor (220) can determine that defocus has occurred based on distance data obtained through the distance sensor (145), and can determine that the blur in the image is a blur caused by defocus.

[0072] According to one embodiment, in operation 640, if the processor (220) determines that the blur contained in the image is a blur caused by defocus, it can detect a region of interest containing at least a part of the subject through object detection in the image.

[0073] According to one embodiment, the object detection operation of the processor (220) may include an operation of recognizing that there is an object in a specific part of the image by analyzing an image acquired through a camera (210), an operation of determining what the object is (object classification), and an operation of finding the exact location of the object within the image (object localization).

[0074] According to one embodiment, in operation 650, the processor (220) can perform texture checking and high-level feature extraction within the image.

[0075] According to one embodiment, the processor (220) can determine the texture of the subject through a texture check and determine how much clarity the subject requires. For example, since the subject containing text or an image must be captured clearly, the electronic device (100) may determine that the distance between the subject and the electronic device (100) needs to be adjusted if there is blur in the image of the subject. As another example, if the blur is caused by the subject being a wall or a surface without a pattern, the electronic device (100) may determine that the distance between the subject and the electronic device (100) does not need to be adjusted.

[0076] According to one embodiment, the processor (220) can determine the characteristics of the blur contained in the image through high-level feature extraction. For example, the processor (220) can determine that the blur contained in the image was caused by the user's intention. For another example, the processor (220) can determine that the blur contained in the image is a blur caused by defocus.

[0077] According to one embodiment, operations 620 to 650 may correspond to operations 320 to 330 of FIG. 3.

[0079] FIG. 7 illustrates an example of providing an image capture guide according to one embodiment.

[0080] According to one embodiment, reference numerals 710 to 730 illustrate an example of providing an image shooting guide as illustrated in FIGS. 3 to 6.

[0081] According to one embodiment, reference numeral 710 illustrates a screen displayed on a display (110) when defocus occurs.

[0082] According to one embodiment, the processor (220) can analyze an image acquired through the camera (210) to determine whether the blur is motion blur caused by the movement of the subject (711). Based on the analysis of the image, the processor (220) can determine that the blur around the subject has no directionality and determine that the blur in the image is not motion blur. If the blur around the subject (711) has a certain directionality, the processor (220) can determine that the blur in the image is blur caused by the movement of the subject (711).

[0083] According to one embodiment, if the processor (220) determines that the blur contained in the image is not motion blur, it can determine whether the blur contained in the image is a blur caused by defocus based on distance data. The processor (220) can determine that defocus has occurred because the distance between the subject (711) and the electronic device (100) is within the minimum focus distance, and can determine that the blur in the image is a blur caused by defocus.

[0084] According to one embodiment, reference numeral 720 illustrates a screen displayed on a display (110) when a region of interest containing at least a portion of a subject (711) is detected within an image. The region of interest may include a portion of the subject (711).

[0085] According to one embodiment, if the processor (220) determines that the blur contained in the image is due to defocus, it can detect a region of interest through object detection in the image. The processor (220) can detect that there is a subject (711) in a specific part of the image and determine that the subject (711) is a business card, and can detect an area containing at least a part of the subject (711) as a region of interest.

[0086] According to one embodiment, the processor (220) can determine the texture of the subject (711) through a texture check and determine that the subject (711) contains text and therefore must be captured clearly. The processor (220) can determine through high-level feature extraction that the blur included in the image is due to defocus rather than the user's intention, and therefore distance adjustment between the subject (711) and the electronic device (100) is necessary.

[0087] According to one embodiment, when the processor (220) detects a region of interest, it may display a line (721) surrounding the region of interest on the display (110). The processor (220) may display the line (721) displayed on the display (110) in a color and thickness that is easily visible within the image.

[0088] According to one embodiment, when the processor (220) detects a region of interest, it may display a first visual affordance (725) on the display (110). The first visual affordance (725) may include a phrase to zoom in on the region of interest.

[0089] According to one embodiment, reference numeral 730 illustrates a screen displayed on a display (110) when user input for a first visual affordance (725) is received.

[0090] According to one embodiment, when user input regarding the first visual affordance (725) is received, the processor (220) may crop the area of ​​interest and enlarge the cropped area to display it on the display (110). The processor (220) may also display a message (733) instructing defocus on the display (110). The message (733) may include instructions to move the electronic device (100) away from the subject.

[0091] According to one embodiment, the processor (220) can detect a region of interest within an image and then automatically display an enlarged image such as reference number 730 without displaying a first visual affordance (725) on the display (110). At this time, the electronic device (100) can provide an image cropped and enlarged of the region of interest through the display (110) even without user input.

[0092] According to one embodiment, the processor (220) may display a second visual affordance (735) on the display (110) along with an image of the cropped area enlarged and a message (733) indicating defocus. When user input regarding the second visual affordance (735) is received, the processor (220) may stop the operation of cropping the area of ​​interest and the operation of enlarging the cropped area. The processor (220) may display an image that is not cropped or enlarged on the display (110).

[0093] According to one embodiment, when there is user input regarding the second visual affordance (735) after moving the electronic device (100) further away from the subject than the minimum focal distance, the processor (220) may stop displaying the message (733) indicating defocus while displaying the uncropped or unenlarged image on the display (110). According to another embodiment, when there is user input regarding the second visual affordance (735) while the electronic device (100) is positioned within the minimum focal distance from the subject and defocus is maintained, the processor (220) may continue displaying the message (733) indicating defocus on the display (110). In this document, visual affordances may be replaced / referenced with visual objects, UI items, icons, menus, indicators, etc.

[0095] FIG. 8 illustrates an example of a region of interest that is cropped and enlarged within an image as the distance between the subject and the electronic device increases, according to one embodiment.

[0096] According to one embodiment, FIG. 8 illustrates an example in which an uncropped or unenlarged image (810, 820, 830) and a cropped and enlarged image of a region of interest (815, 825, 835) are shown when an electronic device (100) moves away from a subject.

[0097] According to one embodiment, reference numeral 810 illustrates an image in which defocus occurs because the electronic device (100) is positioned closer than the minimum focal distance from the subject.

[0098] According to one embodiment, reference numeral 815 illustrates an image in which a region of interest (811) detected by a processor (220) within an image of reference numeral 810 is cropped, and the cropped area is enlarged and displayed on a display (110). Since the distance between the subject and the electronic device (100) is less than the minimum focal distance, defocus occurs on the subject (812), and strong blur may appear in the image.

[0099] According to one embodiment, reference numeral 820 illustrates an image in which the electronic device (100) moves away from the subject, but the distance between the subject and the electronic device (100) is closer than the minimum focal distance.

[0100] According to one embodiment, reference numeral 825 illustrates an image in which a region of interest (821) detected by a processor (220) within the image of reference numeral 820 is cropped, and the cropped area is enlarged and displayed on a display (110). Since the distance between the subject and the electronic device (100) is greater than in the case of reference numeral 810, less defocus occurs on the subject (822) than in the case of reference numeral 815, so a weak blur may appear in the image.

[0101] According to one embodiment, reference numeral 830 illustrates an image in which the distance between the subject and the electronic device (100) is greater than or equal to the minimum focal length.

[0102] According to one embodiment, reference numeral 835 illustrates an image in which a region of interest (831) detected by a processor (220) within an image of reference numeral 830 is cropped, and the cropped area is enlarged and displayed on a display (110). Since the electronic device (100) is positioned further away from the subject than the minimum focal distance, the subject (832) is in focus and the image may be clear.

[0103] According to one embodiment, while the user moves the electronic device (100) away from the subject, the size of the subject (812, 822, 832) displayed on the display (110) can be maintained at a constant size. As the electronic device (100) moves away from the subject, the size of the region of interest (811, 821, 831) among the images (810, 820, 830) acquired through the camera (210) decreases, but the electronic device (100) detects and crops the region of interest (811, 821, 831) among the images (810, 820, 830), and enlarges the cropped area to display it on the display (110). Thus, the size of the image (815, 825, 835) of the region of interest displayed on the display (110) can be maintained at a constant size.

[0105] FIG. 9 illustrates an example of a UI that induces a region of interest to be located in the center of an image according to one embodiment.

[0106] According to one embodiment, the processor (220) can detect a region of interest that includes at least a portion of a subject within an image. In this case, the region of interest may not be located at the center of the image but at the edge. The processor (220) can display a UI (910), such as an arrow, on the display (110). The user can adjust the position of the electronic device (100) through the UI (910) displayed on the display (110) so that the region of interest is located at the center of the image.

[0108] FIG. 10 is a flowchart illustrating a method of providing an image capture guide through a message indicating defocus according to one embodiment. The method described in FIG. 10 may be executed by an electronic device (100) or a processor (220) of the electronic device (100).

[0109] According to one embodiment, in operation 1010, the processor (220) can acquire an image through the camera (210) and acquire distance data regarding the distance between the subject and the electronic device (100) through the distance sensor (145). Operation 1010 may correspond to operation 310 of FIG. 3.

[0110] According to one embodiment, in operation 1020, the processor (220) can determine that defocus has occurred based on the distance data.

[0111] According to one embodiment, defocus may occur when the distance between the subject and the electronic device (100) is within the minimum focal distance. At this time, the processor (220) can determine that defocus has occurred by analyzing distance data obtained through the distance sensor (145). Additionally, the processor (220) can use the amount of blur included in the image as a supplementary method to determine that defocus has occurred. The processor (220) can use the image analysis results to correct errors that may occur in the analysis results of the distance data. Based on the distance data, the processor (220) can determine that the blur included in the image is due to defocus caused by shooting at a distance less than the minimum focal distance.

[0112] According to one embodiment, in operation 1030, the processor (220) may display a message on the display (110) that induces the distance between the subject and the electronic device (100) to be greater than or equal to the minimum focal distance. The user may recognize through the message displayed on the display (110) that the defocus can be resolved by moving the electronic device (100) away from the subject.

[0113] According to one embodiment, the processor (220) may additionally use at least one output device, such as a speaker or a light-emitting device (e.g., an LED lamp), to indicate that defocus has occurred while displaying the message on the display (110). According to another embodiment, instead of displaying the message on the display (110), the processor (220) may use at least one output device, such as a speaker or a light-emitting device, to indicate to the user that defocus has occurred.

[0114] According to one embodiment, in operation 1040, the processor (220) can determine that the distance between the subject and the electronic device (100) is greater than or equal to the minimum focus distance. After the user recognizes that defocus has occurred through a message displayed on the display (110), the user can move the electronic device (100) away from the subject. The electronic device (100) can analyze distance data and determine that the distance between the subject and the electronic device (100) is greater than or equal to the minimum focus distance, so that defocus does not occur.

[0115] According to one embodiment, in operation 1050, the processor (220) may remove the message from the display (110) in response to the distance between the subject and the electronic device (100) being greater than or equal to the minimum focus distance. Since no defocus occurs when the user positions the electronic device (100) further away from the subject than the minimum focus distance, the processor (220) may not display the message on the display (110).

[0117] FIG. 11 illustrates an example of a message indicating defocus according to one embodiment.

[0118] According to one embodiment, the processor (220) can determine that defocus has occurred based on distance data obtained through the distance sensor (145). The processor (220) can display a message (1110) on the display (110) that induces the distance between the subject and the electronic device (100) to be greater than or equal to the minimum focus distance from the subject.

[0119] According to one embodiment, the processor (220) may display a message (1110) on the display (110) instructing the electronic device (100) to be moved away from the subject. According to another embodiment, the processor (220) may suggest the exact distance the electronic device (100) should be moved away from the subject through the message (1110).

[0120] According to one embodiment, the processor (220) may additionally use at least one output device, such as a speaker or a light-emitting device (e.g., an LED lamp), to indicate that defocus has occurred while displaying a message (1110) on the display (110).

[0122] FIG. 12 is a block diagram of an electronic device (1201) in a network environment (1200) according to various embodiments. Referring to FIG. 12, in the network environment (1200), the electronic device (1201) may communicate with an electronic device (1202) through a first network (1298) (e.g., a short-range wireless communication network) or may communicate with an electronic device (1204) or a server (1208) through a second network (1299) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1201) may communicate with an electronic device (1204) through a server (1208). According to one embodiment, the electronic device (1201) may include a processor (1220), memory (1230), input module (1250), sound output module (1255), display module (1260), audio module (1270), sensor module (1276), interface (1277), connection terminal (1278), haptic module (1279), camera module (1280), power management module (1288), battery (1289), communication module (1290), subscriber identification module (1296), or antenna module (1297). In some embodiments, at least one of these components (e.g., connection terminal (1278)) may be omitted from the electronic device (1201), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1276), camera module (1280), or antenna module (1297)) may be integrated into a single component (e.g., display module (1260)).

[0123] The processor (1220) can, for example, execute software (e.g., program (1240)) to control at least one other component (e.g., hardware or software component) of the electronic device (1201) connected to the processor (1220) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1220) can store commands or data received from other components (e.g., sensor module (1276) or communication module (1290)) in volatile memory (1232), process the commands or data stored in volatile memory (1232), and store the resulting data in non-volatile memory (1234). According to one embodiment, the processor (1220) may include a main processor (1221) (e.g., a central processing unit or an application processor) or an auxiliary processor (1223) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1201) includes a main processor (1221) and an auxiliary processor (1223), the auxiliary processor (1223) may be configured to use less power than the main processor (1221) or to be specialized for a specified function. The auxiliary processor (1223) may be implemented separately from the main processor (1221) or as part thereof.

[0124] The auxiliary processor (1223) may control at least some of the functions or states associated with at least one component of the electronic device (1201) (e.g., display module (1260), sensor module (1276), or communication module (1290)) on behalf of the main processor (1221) while the main processor (1221) is in an inactive (e.g., sleep) state, or together with the main processor (1221) while the main processor (1221) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1223) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1280) or communication module (1290)). According to one embodiment, the auxiliary processor (1223) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1201) itself where the artificial intelligence is performed, or through a separate server (e.g., server (1208)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0125] The memory (1230) can store various data used by at least one component of the electronic device (1201) (e.g., processor (1220) or sensor module (1276)). The data may include, for example, input data or output data for software (e.g., program (1240)) and related commands. The memory (1230) may include volatile memory (1232) or non-volatile memory (1234).

[0126] The program (1240) may be stored as software in memory (1230) and may include, for example, an operating system (1242), middleware (1244), or an application (1246).

[0127] The input module (1250) can receive commands or data to be used for a component of the electronic device (1201) (e.g., processor (1220)) from outside the electronic device (1201) (e.g., user). The input module (1250) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0128] The sound output module (1255) can output a sound signal to the outside of the electronic device (1201). The sound output module (1255) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0129] The display module (1260) can visually provide information to an external (e.g., user) of the electronic device (1201). The display module (1260) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0130] The audio module (1270) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1270) can acquire sound through the input module (1250) or output sound through the sound output module (1255) or an external electronic device (e.g., electronic device (1202)) (e.g., speaker or headphones) that is directly or wirelessly connected to the electronic device (1201).

[0131] The sensor module (1276) can detect the operating state of the electronic device (1201) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1276) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0132] The interface (1277) may support one or more specified protocols that can be used for the electronic device (1201) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1202)). According to one embodiment, the interface (1277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0133] The connection terminal (1278) may include a connector through which the electronic device (1201) can be physically connected to an external electronic device (e.g., electronic device (1202)). According to one embodiment, the connection terminal (1278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0134] The haptic module (1279) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (1279) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0135] The camera module (1280) can capture still images and video. According to one embodiment, the camera module (1280) may include one or more lenses, image sensors, image signal processors, or flashes.

[0136] The power management module (1288) can manage power supplied to the electronic device (1201). According to one embodiment, the power management module (1288) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0137] The battery (1289) can supply power to at least one component of the electronic device (1201). According to one embodiment, the battery (1289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0138] The communication module (1290) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1201) and an external electronic device (e.g., electronic device (1202), electronic device (1204), or server (1208)), and the performance of communication through the established communication channel. The communication module (1290) may include one or more communication processors that operate independently of the processor (1220) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1290) may include a wireless communication module (1292) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1294) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1204) through a first network (1298) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1299) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1292) can identify or authenticate the electronic device (1201) within a communication network such as the first network (1298) or the second network (1299) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1296).

[0139] The wireless communication module (1292) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1292) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1292) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1292) can support various requirements specified in the electronic device (1201), external electronic device (e.g., electronic device (1204)), or network system (e.g., second network (1299)). According to one embodiment, the wireless communication module (1292) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0140] An antenna module (1297) can transmit a signal or power to an external source (e.g., an external electronic device) or receive it from an external source. According to one embodiment, the antenna module (1297) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1298) or a second network (1299), may be selected from the plurality of antennas, for example, by a communication module (1290). A signal or power may be transmitted or received between the communication module (1290) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1297).

[0141] According to various embodiments, the antenna module (1297) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0142] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0143] According to one embodiment, commands or data may be transmitted or received between the electronic device (1201) and an external electronic device (1204) through a server (1208) connected to a second network (1299). Each of the external electronic devices (1202, or 1204) may be the same or a different type of device as the electronic device (1201). According to one embodiment, all or part of the operations performed on the electronic device (1201) may be performed on one or more of the external electronic devices (1202, 1204, or 1208). For example, if the electronic device (1201) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1201) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1201). The electronic device (1201) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1201) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1204) may include an Internet of Things (IoT) device. The server (1208) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1204) or server (1208) may be included within the second network (1299). The electronic device (1201) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0144] The electronic device according to the various embodiments disclosed in this document may be a device of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0145] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any component (e.g., the first) is referred to as "coupled" or "connected" to another component (e.g., the second), with or without the terms "functionally" or "communicationally," it means that said component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0146] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0147] Various embodiments of the present document may be implemented as software (e.g., program (1240)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1236) or external memory (1238)) readable by a machine (e.g., electronic device (1201)). For example, a processor (e.g., processor (1220)) of the machine (e.g., electronic device (1201)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0148] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0149] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0151] FIG. 13 is a block diagram (1300) illustrating a camera module (1280) according to various embodiments. Referring to FIG. 13, the camera module (1280) may include a lens assembly (1310), a flash (1320), an image sensor (1330), an image stabilizer (1340), a memory (1350) (e.g., a buffer memory), or an image signal processor (1360). The lens assembly (1310) may collect light emitted from a subject that is the target of image capture. The lens assembly (1310) may include one or more lenses. According to one embodiment, the camera module (1280) may include a plurality of lens assemblies (1310). In this case, the camera module (1280) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (1310) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from the lens properties of other lens assemblies. The lens assemblies (1310) may include, for example, wide-angle lenses or telephoto lenses.

[0152] A flash (1320) may emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (1320) may include one or more light-emitting diodes (e.g., RGB (red-green-blue) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. An image sensor (1330) may acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through a lens assembly (1310) into an electrical signal. According to one embodiment, the image sensor (1330) may include, for example, one image sensor selected from image sensors with different properties such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (1330) can be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0153] The image stabilizer (1340) may move at least one lens or image sensor (1330) included in the lens assembly (1310) in a specific direction in response to the movement of the camera module (1280) or the electronic device (1201) containing it, or control the operational characteristics of the image sensor (1330) (e.g., adjusting read-out timing). This allows for compensating for at least some of the negative effects caused by the movement on the image being captured. According to one embodiment, the image stabilizer (1340) may detect such movement of the camera module (1280) or the electronic device (1201) using a gyroscope sensor (not shown) or an accelerometer sensor (not shown) placed inside or outside the camera module (1280). According to one embodiment, the image stabilizer (1340) may be implemented, for example, as an optical image stabilizer. The memory (1350) may temporarily store at least a portion of the image acquired through the image sensor (1330) for the next image processing operation. For example, if image acquisition by the shutter is delayed or multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) may be stored in the memory (1350), and the corresponding copy image (e.g., a low-resolution image) may be previewed through the display device (1260). Subsequently, when a specified condition is satisfied (e.g., user input or system command), at least a portion of the original image stored in the memory (1350) may be acquired and processed, for example, by an image signal processor (1360). According to one embodiment, the memory (1350) may be configured as at least a portion of the memory (1230) or as a separate memory that operates independently thereof.

[0154] The image signal processor (1360) can perform one or more image processing operations on an image acquired through the image sensor (1330) or an image stored in memory (1350). The above one or more image processing methods may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softing). Additionally or generally, the image signal processor (1360) may perform control (e.g., exposure time control, or readout timing control, etc.) over at least one of the components included in the camera module (1280) (e.g., image sensor (1330)). The image processed by the image signal processor (1360) may be stored back in memory (1350) for further processing or provided to an external component of the camera module (1280) (e.g., memory (1230), display device (1260), electronic device (1202), electronic device (1204), or server (1208)). According to one embodiment, the image signal processor (1360) It may be configured as at least part of the processor (1220) or as a separate processor that operates independently of the processor (1220). If the image signal processor (1360) is configured as a separate processor from the processor (1220), at least one image processed by the image signal processor (1360) may be displayed through the display device (1260) as is or after additional image processing by the processor (1220).

[0155] According to one embodiment, the electronic device (1201) may include a plurality of camera modules (1280), each having different attributes or functions. In this case, for example, at least one of the plurality of camera modules (1280) may be a wide-angle camera and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (1280) may be a front camera and at least another may be a rear camera.

[0157] An electronic device according to one embodiment of the present document may include a camera, a distance sensor, a display, and at least one processor electrically connected to the camera, the distance sensor, and the display. The at least one processor may acquire an image including a subject through the camera, acquire distance data regarding the distance between the subject and the electronic device through the distance sensor, determine that defocus has occurred based on the distance data, detect a region of interest including at least a part of the subject within the image, crop an area including at least the region of interest within the image, and enlarge and display the cropped area on the display along with a message indicating the defocus.

[0158] In an electronic device according to one embodiment of the present document, the at least one processor, in response to detecting the region of interest, displays a first visual affordance on the display, and if there is user input regarding the first visual affordance, crops an area within the image that includes at least the region of interest, and can enlarge and display the cropped area on the display along with a message indicating the defocus.

[0159] In an electronic device according to one embodiment of the present document, the at least one processor may, in response to detecting the region of interest, automatically crop an area within the image that includes at least the region of interest, and enlarge and display the cropped area along with a message indicating the defocus on the display.

[0160] In an electronic device according to one embodiment of the present document, the at least one processor displays a second visual affordance along with a message indicating the defocus on the display and an image of the cropped area enlarged, and if there is user input regarding the second visual affordance, the uncropped or unenlarged image may be displayed on the display.

[0161] In an electronic device according to one embodiment of the present document, the at least one processor displays a second visual affordance along with a message indicating the defocus on the display and an image of the cropped area enlarged, and if there is user input regarding the second visual affordance, the uncropped or unenlarged image may be displayed on the display.

[0162] In an electronic device according to one embodiment of the present document, the at least one processor can detect the region of interest through object detection.

[0163] In an electronic device according to one embodiment of the present document, the at least one processor can analyze the texture of the subject through a texture check and analyze the characteristics of the blur included in the image through extracting high-level features.

[0164] In an electronic device according to one embodiment of the present document, the at least one processor may display a line surrounding the region of interest on the display in response to detecting the region of interest.

[0165] In an electronic device according to one embodiment of the present document, the at least one processor can display a UI that guides a user to the display such that the region of interest is located in the center of the image.

[0166] A method for providing an image capture guide for an electronic device according to one embodiment of the present document may include: acquiring an image including a subject through a camera included in the electronic device; acquiring distance data regarding the distance between the subject and the electronic device through a distance sensor included in the electronic device; determining that defocus has occurred based on the distance data; detecting a region of interest including at least a part of the subject within the image; cropping a region including at least the region of interest within the image; and displaying an enlarged version of the cropped region on a display included in the electronic device along with a message indicating the defocus.

[0167] A method for providing an image capture guide for an electronic device according to one embodiment of the present document may include: an operation of displaying a first visual affordance on a display in response to detecting the region of interest; and, when there is user input regarding the first visual affordance, an operation of cropping an area within the image that includes at least the region of interest, and an operation of magnifying and displaying the cropped area on the display along with a message indicating the defocus.

[0168] A method for providing an image capture guide for an electronic device according to one embodiment of the present document may include, in response to detecting the region of interest, automatically cropping an area within the image that includes at least the region of interest, and magnifying and displaying the cropped area on the display along with a message indicating the defocus.

[0169] A method for providing an image capture guide for an electronic device according to one embodiment of the present document may include an operation of displaying a second visual affordance along with a message indicating the defocus and an image of the cropped area enlarged on the display, and an operation of displaying an image that is not cropped or enlarged on the display when there is user input regarding the second visual affordance.

[0170] A method for providing an image capture guide for an electronic device according to one embodiment of the present document may include an operation of displaying a second visual affordance along with a message indicating the defocus and an image of the cropped area enlarged on the display, and an operation of displaying an image that is not cropped or enlarged on the display when there is user input regarding the second visual affordance.

[0171] In a method for providing an image capture guide for an electronic device according to one embodiment of the present document, the operation of detecting the region of interest may include the operation of detecting the region of interest through object detection.

[0172] An electronic device according to one embodiment of the present document may include a camera, a distance sensor, a display, and at least one processor electrically connected to the camera, the distance sensor, and the display. The at least one processor may acquire an image containing a subject through the camera, acquire distance data regarding the distance between the subject and the electronic device through the distance sensor, determine that defocus has occurred based on the distance data, and display a message on the display that induces the distance between the subject and the electronic device to be greater than or equal to the minimum focal distance.

[0173] In an electronic device according to one embodiment of the present document, the at least one processor can remove the message from the display in response to the distance between the subject and the electronic device being greater than or equal to the minimum focal distance.

[0174] An electronic device according to one embodiment of the present document includes at least one of a speaker and a light-emitting device electrically connected to the at least one processor, and the at least one processor can output at least one of the speaker and the light-emitting device together when displaying the message on the display.

[0175] In an electronic device according to one embodiment of the present document, the at least one processor can detect a region of interest within the image through object detection.

[0176] An electronic device according to one embodiment of the present document, wherein at least one processor analyzes the texture of the subject through texture checking and analyzes the characteristics of the blur included in the image through high-level feature extraction.

Claims

Claim 1 An electronic device comprising: a camera; a distance sensor; a display; and at least one processor electrically connected to the camera, the distance sensor, and the display, wherein the at least one processor: acquires an image including a subject through the camera; acquires distance data regarding the distance between the subject and the electronic device through the distance sensor; determines, based on the distance data, whether a blur in the image is caused by de-focus; determines at least one of the characteristics of the subject or the characteristics of the blur based on whether the blur is caused by de-focus; determines, based on at least one of the characteristics of the subject or the characteristics of the blur, whether focus adjustment is required based on the at least one of the characteristics of the subject or the characteristics of the blur; and, based on whether focus adjustment is required: detects a region of interest including at least a part of the subject within the image; crops a region including at least the region of interest within the image; and enlarges and displays the cropped region with a message indicating the de-focus on the display. Claim 2 An electronic device according to claim 1, wherein the at least one processor: in response to detecting the region of interest, displays a first visual affordance on the display, and if there is user input regarding the first visual affordance, crops an area within the image that includes at least the region of interest, and enlarges and displays the cropped area on the display along with a message indicating the defocus. Claim 3 An electronic device according to claim 1, wherein the at least one processor automatically crops an area including at least the area of ​​interest within the image in response to detecting the area of ​​interest, and enlarges and displays the cropped area along with a message indicating the defocus on the display. Claim 4 An electronic device according to claim 2, wherein the at least one processor: displays a second visual affordance with a message indicating the defocus on the display and an image of the cropped area enlarged, and, if there is user input regarding the second visual affordance, displays an image of the cropped or unenlarged area on the display. Claim 5 An electronic device according to claim 3, wherein the at least one processor: displays a second visual affordance with a message indicating the defocus on the display and an image of the cropped area enlarged, and, if there is user input regarding the second visual affordance, displays an image of the cropped or unenlarged area on the display. Claim 6 An electronic device according to claim 1, wherein at least one processor detects the region of interest through object detection. Claim 7 An electronic device according to claim 6, wherein at least one processor analyzes the texture of the subject through a texture check and analyzes the characteristics of the blur included in the image through extract high-level features. Claim 8 An electronic device according to claim 1, wherein the at least one processor displays a line surrounding the region of interest on the display in response to detecting the region of interest. Claim 9 An electronic device according to claim 1, wherein the at least one processor displays a UI capable of guiding a user to the display such that the region of interest is located in the center of the image. Claim 10 A method for providing an image capture guide for an electronic device, comprising: acquiring an image including a subject through a camera included in the electronic device; acquiring distance data regarding the distance between the subject and the electronic device through a distance sensor included in the electronic device; determining whether blur in the image is caused by defocus based on the distance data; determining at least one of the characteristics of the subject or the characteristics of the blur based on whether the blur is caused by defocus; determining whether focus adjustment is required based on at least one of the characteristics of the subject or the characteristics of the blur based on whether focus adjustment is required; detecting a region of interest including at least a part of the subject within the image based on whether focus adjustment is required; cropping a region including at least the region of interest within the image; and displaying the cropped region enlarged on a display included in the electronic device along with a message indicating the defocus. Claim 11 ◈Claim 11 was abandoned upon payment of the registration fee.◈ A method for providing an image capture guide for an electronic device, comprising: an operation of displaying a first visual affordance on a display in response to detecting the region of interest according to Claim 10; and, when there is user input regarding the first visual affordance, an operation of cropping an area within the image that includes at least the region of interest, and magnifying and displaying the cropped area on the display along with a message indicating the defocus. Claim 12 ◈Claim 12 was abandoned upon payment of the registration fee.◈ A method for providing an image capture guide for an electronic device according to Claim 10, comprising, in response to detecting the region of interest, automatically cropping an area within the image that includes at least the region of interest, and magnifying and displaying the cropped area on the display along with a message indicating the defocus. Claim 13 ◈Claim 13 was abandoned upon payment of the registration fee.◈ A method for providing an image capture guide for an electronic device, comprising: an operation of displaying a second visual affordance on the display along with a message indicating the defocus and an image of the cropped area enlarged; and an operation of displaying an image that is not cropped or enlarged on the display when there is user input regarding the second visual affordance. Claim 14 ◈Claim 14 was abandoned upon payment of the registration fee.◈ A method for providing an image capture guide for an electronic device, comprising: an operation of displaying a second visual affordance on the display along with a message indicating the defocus and an image of the cropped area enlarged; and an operation of displaying an image that is not cropped or enlarged on the display when there is user input regarding the second visual affordance. Claim 15 ◈Claim 15 was abandoned upon payment of the registration fee.◈ A method for providing an image capture guide for an electronic device, wherein the operation of detecting the region of interest according to Claim 10 includes the operation of detecting the region of interest through object detection. Claim 16 delete Claim 17 delete Claim 18 delete Claim 19 delete Claim 20 delete

Images