Method or device for providing an image shooting guide

Abstract

An electronic device according to an embodiment of the present disclosure may include a camera, a distance sensor, a display, and a processor. The processor may obtain an image including a subject through the camera, obtain distance data on the distance between the subject and the electronic device through the distance sensor, determine defocus based on the distance data, sense a region of interest including at least a portion of the subject in the image, crop a region including at least the region of interest in the image, and magnify and display the cropped region on the display together with a message indicating defocus.

Description

Technical Field

[0001] The present disclosure relates to a technique for providing an image shooting guide to a user by using a camera and a distance sensor provided in an electronic device. Background Art

[0002] The minimum focal length refers to the minimum distance between an image sensor and a subject required for focusing on the subject. When the subject is located within the minimum focal length from a shooting device such as a camera, a defocused image is captured due to optical limitations. Summary of the Invention

[0003] Recently, as the size of the image sensor installed in a mobile device has increased, the minimum focal length of the camera has increased. As a result, the problem of capturing a defocused image of a subject located within the minimum focal length is increasing.

[0004] In addition, when analyzing blur included in an image according to the prior art, an electronic device does not consider the inherent characteristics of the subject and only uses low-level features such as frequency analysis of the image.

[0005] An electronic device according to an embodiment of the present disclosure may include: a camera, a distance sensor, a display, and at least one processor, the at least one processor being electrically connected to the camera, the distance sensor, and the display, the at least one processor obtaining an image including a subject through the camera, obtaining distance data on the distance between the subject and the electronic device through the distance sensor, determining defocus based on the distance data, sensing a region of interest including at least a part of the subject in the image, cropping a region including at least the region of interest in the image, and magnifying and displaying the cropped region on the display together with a message indicating the defocus.

[0006] An operation method of an electronic device according to an embodiment of the present disclosure may include: an operation of obtaining an image including a subject through a camera included in the electronic device; an operation of obtaining distance data on the distance between the subject and the electronic device through a distance sensor included in the electronic device; an operation of determining defocus based on the distance data; an operation of sensing a region of interest including at least a part of the subject in the image; an operation of cropping a region including at least the region of interest in the image; and an operation of magnifying and displaying the cropped region on the display together with a message indicating the defocus.

[0007] An electronic device according to an embodiment of the present disclosure may include: a camera, a distance sensor, a display, and at least one processor. The at least one processor is electrically connected to the camera, the distance sensor, and the display. The at least one processor obtains an image including a subject through the camera, obtains distance data on the distance between the subject and the electronic device through the distance sensor, determines defocus based on the distance data, and displays a message on the display guiding the distance between the subject and the electronic device to be above the minimum focal length.

[0008] According to various embodiments disclosed herein, a user may recognize that the blur included in an image is caused by defocus resulting from photographing a subject located within the minimum focal length. Additionally, the electronic device according to the present disclosure may propose optimal shooting conditions to the user by analyzing the characteristics of the subject. The user may change the shooting conditions according to the conditions proposed by the electronic device to obtain an image without defocus.

[0009] In addition, when analyzing an image, the electronic device according to the present disclosure utilizes not only low-level features but also high-level features such as object detection and texture check. Therefore, it is possible to propose optimal shooting conditions according to the inherent characteristics of the subject.

[0010] The effects that can be obtained in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those of ordinary skill in the technical field to which the present disclosure pertains through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 Shows an electronic device according to an embodiment.

[0012] Figure 2 Is a block diagram of an electronic device according to an embodiment.

[0013] Figure 3 Is a flowchart showing a method in which an electronic device crops and enlarges a region of interest and displays it on a display, while providing an image shooting guide according to an embodiment.

[0014] Figure 4 Is a flowchart showing a method of providing an image shooting guide when a user input for a first visual affordance is received according to an embodiment.

[0015] Figure 5 Is a flowchart showing an operation when a user input for a second visual affordance is received according to an embodiment.

[0016] Figure 6 is a flowchart showing a method of analyzing an image and distance data according to an embodiment.

[0017] Figure 7 is an example showing an image capture guide according to an embodiment.

[0018] Figure 8 is an example showing a region of interest (ROI) that is cropped and enlarged within an image as the distance between a subject and an electronic device increases according to an embodiment.

[0019] Figure 9 is an example showing a user interface (UI) that guides the ROI to be centered within an image according to an embodiment.

[0020] Figure 10 is a flowchart showing a method of providing an image capture guide by a message indicating defocus according to an embodiment.

[0021] Figure 11 is an example showing a message indicating defocus according to an embodiment.

[0022] Figure 12 is a block diagram of an electronic device within a network environment according to various embodiments.

[0023] Figure 13 is a block diagram of a camera module according to various embodiments by way of example. DETAILED DESCRIPTION

[0024] Figure 1 is a diagram showing an electronic device according to an embodiment.

[0025] Reference Figure 1 , a display 110 may be disposed in front of an electronic device 100 according to an embodiment. In an embodiment, the display 110 may occupy most of the front of the electronic device 100. A display 110 and a bezel 120 region surrounding at least a portion of an edge of the display 110 may be disposed in front of the electronic device 100. In Figure 1 's example, the display 110 may include a flat area 111 and a curved area 112 that extends from the flat area 111 toward a side surface of the electronic device 100. Figure 1 Only one side (e.g., the left side) of the curved area 112 is shown in Figure 1The electronic device 100 illustrated in the figure is an example and can be implemented in various embodiments. For example, the display 110 of the electronic device 100 may include only the flat area 111 without the curved area 112, or may have the curved area 112 only at one side edge instead of both sides. Additionally, in one embodiment, the curved area may also extend towards the back of the electronic device 100, such that the electronic device 100 further includes a flat area.

[0026] In one embodiment, a fingerprint sensor 141 for identifying a user's fingerprint may be included in the first area 140 of the display 110. The fingerprint sensor 141 may be disposed under the display 110 so as not to be visible to the user or be arranged to be difficult to see. Additionally, in addition to the fingerprint sensor 141, sensors for authenticating the user / biology may be further disposed in a part of the area of the display 110. In other embodiments, the sensors for authenticating the user / biology may be disposed in an area of the bezel 120. For example, an IR (infrared) sensor for authenticating the iris may be exposed through an area of the display 110 or through an area of the bezel 120.

[0027] In one embodiment, a sensor 143 may be included in at least one area of the bezel 120 of the electronic device 100 or at least one area of the display 110. The sensor 143 may be disposed at a distance adjacent to the camera module (e.g., the front camera 131, the rear camera 132) or formed as a single module with the camera module.

[0028] In one embodiment, a front camera 131 may be disposed in the front of the electronic device 100. In Figure 1 the illustrated embodiment, the front camera 131 is exposed through an area of the display 110, however, in other embodiments, the front camera 131 may be exposed through the bezel 120.

[0029] In one embodiment, the display 110 may include at least one of a sensor module, a camera module (e.g., the front camera 131, the rear camera 132), and a light-emitting element (e.g., an LED) on the back of the screen display area (e.g., the flat area 111, the curved area 112).

[0030] In one embodiment, the camera module can be arranged on the back of at least one of the front, side, and / or back of the electronic device 100 to face the front, the side, and / or the back. For example, the front camera 131 may not be visually exposed towards the screen display area (e.g., the flat area 111, the curved area 112), and may include a hidden under-display camera (UDC). In one embodiment, the electronic device 100 may include more than one front camera 131. For example, the electronic device 100 may include two front cameras such as a first front camera and a second front camera. In one embodiment, the first front camera and the second front camera may be the same type of camera with the same design structure (e.g., pixels), however, the first front camera and the second front camera may be implemented by cameras with different design structures. The electronic device 100 can support functions related to dual cameras (e.g., 3D shooting, auto focus, etc.) through two front cameras.

[0031] In one embodiment, a rear camera 132 can be arranged on the back of the electronic device 100. The rear camera 132 can be exposed through the camera area 130 of the back cover 160. In one embodiment, the electronic device 100 may include a plurality of rear cameras arranged in the camera area 130. For example, the electronic device 100 may include more than two rear cameras. For example, the electronic device 100 may include a first rear camera, a second rear camera, and a third rear camera. The first rear camera, the second rear camera, and the third rear camera may have different design structures from each other. For example, the FOV (field of view), pixels, aperture, whether optical zoom / digital zoom is supported, whether image stabilization technology is supported, the type and / or arrangement of the lens groups included in each camera, etc. of the first rear camera, the second rear camera, and / or the third rear camera may be different from each other. For example, the first rear camera may be a general camera, the second rear camera may be a camera for wide-angle shooting (e.g., a wide-angle camera), and the third rear camera may be a camera for telephoto shooting. In the embodiments herein, the description of the functions or characteristics of the front camera can be applied to the rear camera, and vice versa.

[0032] In one embodiment, a distance sensor 145 for sensing the distance between the subject and the electronic device 100, a sensor for target detection, and / or various hardware such as a flash for assisting shooting can be further arranged in the camera area 130.

[0033] In one embodiment, the distance sensor 145 may be disposed at a distance adjacent to the camera module (e.g., the front camera 131, the rear camera 132) or formed as a single module with the camera module. For example, the distance sensor 145 may operate as at least a part of an IR (infrared) camera (e.g., a TOF (time of flight) camera), a structured light camera, or as at least a part of a sensor module. For example, the TOF camera may operate as at least a part of a sensor module for sensing the distance to a subject.

[0034] In one embodiment, at least one physical button may be disposed on a side surface of the electronic device 100. For example, based on the front surface of the electronic device 100, a first function key 151 for turning on / off the display 110 or turning on / off the power of the electronic device 100 may be disposed on the right edge. In one embodiment, based on the front surface of the electronic device 100, a second function key 152 for controlling the volume of the electronic device 100 or controlling the screen brightness, etc., may be disposed on the left edge. In addition, a button or a key may be further disposed on the front or the rear of the electronic device 100. For example, a physical button or a touch button mapping a specific function may be disposed in a lower end region of the front bezel 120.

[0035] Figure 1The electronic device 100 illustrated in the figure is an example and does not limit the form of the device to which the technical idea disclosed in this document is applied. The technical idea disclosed in this document can be applied to various user devices. For example, the technical idea disclosed in this document can also be applied to a foldable electronic device that adopts a flexible display 110 and a hinge structure and can be folded horizontally or vertically, or a tablet computer or a laptop computer. For example, the illustrated electronic device 100 of the example shows a bar type or a plate type appearance, however, various embodiments of this document are not limited thereto. For example, the illustrated electronic device can be a part of a rollable electronic device. A rollable electronic device can be understood as an electronic device in which the display 110 can be bent and deformed so that at least a part of it can be wound or rolled or can be received inside the electronic device 100. According to the needs of the user, the rollable electronic device can unfold the display 110 or expose a wider area of the display 110 to the outside, so as to expand the screen display area (for example: a flat area 111, a curved area 112) for use. The display 110 can also be referred to as a slide-out display or an expandable display.

[0036] For the convenience of explanation below, Figure 1 taking the illustrated electronic device 100 as a reference, various embodiments will be described.

[0037] Figure 2 is a block diagram of an electronic device according to an embodiment.

[0038] Referring to Figure 2 , the electronic device 100 may include a camera 210, a distance sensor 145, a processor 220, and a display 110.

[0039] According to an embodiment, the camera 210 may include Figure 1 the rear camera 132 or the front camera 131 illustrated in the figure.

[0040] According to an embodiment, the camera 210 can focus on a subject located farther than the minimum focal length. Therefore, when the subject is located farther than the minimum focal length, the processor 220 can obtain an image of the subject with clear representation. The camera 210 cannot focus on a subject located closer than the minimum focal length, so defocusing may occur. For example, when the minimum focal length of the camera 210 is 50 cm, the camera 210 can focus on a subject separated from the image sensor by 70 cm, but cannot focus on a subject separated from the image sensor by 30 cm.

[0041] According to an embodiment, the distance sensor 145 may sense an object in a non-contact manner or measure the distance to an object using ultrasonic waves. For example, the distance sensor 145 may measure the distance between the subject and the electronic device 100. The processor 220 may use the distance data obtained through the distance sensor 145 to determine whether the subject is located at a position farther or closer than the minimum focal length of the camera 210.

[0042] According to an embodiment, it may be understood that the processor 220 includes at least one processor. For example, the processor 220 may include at least one of an AP (application processor), an ISP (image signal processor), and a CP (communication processor). In this regard, it may be referred to that the processor 220 is at least one processor or more than one processor.

[0043] In an embodiment, the processor 220 may run / control various functions supported in the electronic device 100. For example, the processor 220 may run an application program by running code written in a programming language stored in the memory, thereby controlling various hardware. For example, the processor 220 may run an application program stored in the memory that supports the shooting function. In addition, the processor 220 may set and support an appropriate shooting mode to run the camera 210 and cause the camera 210 to perform an action intended by the user.

[0044] According to an embodiment, the processor 220 may analyze the image obtained through the camera 210 and the distance data obtained through the distance sensor 145. When analyzing the image, the processor 220 may use low-level features that analyze the frequency components within the image. In addition, the processor 220 may analyze the image using high-level features such as object detection, texture check, and high-level feature extraction. The detailed content will be described later in Figure 6 It will be described later.

[0045] In an embodiment, the display 110 may display at least one of a running screen of an application program run by the processor 220, an image obtained through the camera 210, an image cropped (cropped) and enlarged by the processor 220, a message guiding the user's action, or a visual affordance. In addition, the processor 220 may display the image data obtained through the camera 210 on the display 110 in real time.

[0046] In one embodiment, the display 110 may be integrated with a touchpad. The display 110 may support a touch function, sense user input such as a touch using a finger, and transmit it to the processor 220. The display 110 may be connected to a display driver integrated circuit (DDIC) for driving the display 110, and the touchpad may be connected to a touch IC (integrated circuit) that senses touch coordinates and processes touch-related algorithms. In one embodiment, the display driver circuit and the touch IC may be formed as one body, and in other embodiments, the display driver circuit and the touch IC may be separately formed. The display driver circuit and / or the touch IC may be electrically connected to the processor 220.

[0047] Figure 3 It is a flowchart showing a method in which an electronic device 100 crops and enlarges a region of interest and displays it on the display 110 while providing an image capture guide according to an embodiment. Figure 3 The method described in may be run by the electronic device 100 or the processor 220 of the electronic device 100.

[0048] According to an embodiment, in operation 310, the processor 220 may obtain an image including a subject through the camera 210 and obtain distance data on the distance between the subject and the electronic device 100 through the distance sensor 145.

[0049] According to an embodiment, in operation 320, the processor 220 may determine that defocus has occurred based on the distance data.

[0050] According to an embodiment, when the distance between the subject and the electronic device 100 is within the minimum focal length, defocus occurs. At this time, the processor 220 may analyze the distance data obtained through the distance sensor 145 to determine that defocus has occurred. In addition, the processor 220 may analyze the amount of blur included in the image and supplement and utilize it when determining that defocus has occurred. The processor 220 may utilize the image analysis result in order to correct an error that may occur in the analysis result of the distance data. The processor 220 may determine that the blur included in the image is due to defocus caused by shooting within the minimum focal length.

[0051] According to an embodiment, in operation 330, the processor 220 may sense a region of interest including at least a part of the subject in the image.

[0052] According to an embodiment, the processor 220 may sense the region of interest through object detection. The processor 220 may identify a region belonging to the subject in the entire image and designate it as the region of interest. The region of interest may include the entire subject or a part of the subject. For details, seeFigure 6 As described later.

[0053] According to an embodiment, when the processor 220 senses the region of interest, it may display a line around the region of interest on the display 110. For example, the processor 220 may display a box around the region of interest on the display 110.

[0054] According to an embodiment, in operation 340, the processor 220 may crop a region in the image that at least includes the region of interest. The processor 220 may crop only the region of interest, or a wider region that includes the region of interest.

[0055] According to an embodiment, in operation 350, the processor 220 may magnify and display the cropped region on the display 110 together with a message indicating defocus.

[0056] According to an embodiment, the message may include content indicating that the electronic device 100 is out of focus because the subject is located closer than the minimum focal length, or content instructing the electronic device 100 to move away from the subject. For example, the message may be content instructing the electronic device 100 to move away from the subject by more than 30 cm.

[0057] According to an embodiment, the processor 220 may notify the user of the fact that defocus has occurred in the region of interest in the image by magnifying and displaying the cropped region on the display 110. In addition, the processor 220 may display a message indicating defocus on the display 110 to guide the user to move the electronic device 100 away from the subject to eliminate the defocus. The user may recognize the defocus situation and the need to move the electronic device 100 away from the subject from the message indicating defocus displayed on the electronic device 100 and the image that is not in focus on the subject. The user may move the electronic device 100 away from the subject, and when the distance between the subject and the electronic device 100 becomes greater than or equal to the minimum focal length, the processor 220 may obtain a clear image in focus on the subject.

[0058] According to an embodiment, when the processor 220 senses the region of interest in operation 330, it may display a first visual availability on the display 110. When there is a user input for the first visual availability, the processor 220 may crop a region in the image that at least includes the region of interest, and magnify and display the cropped region on the display 110 together with a message indicating defocus. The detailed content will be described Figure 4 As described later.

[0059] According to one embodiment, when the processor 220 senses the region of interest in operation 330, even without additional user input, it can automatically crop an area including at least the region of interest within the image and magnify and display the cropped area on the display 110 together with a message indicating defocus.

[0060] Figure 4 It is a flowchart showing a method of providing an image shooting guide when a user input for a first visual availability is received according to one embodiment.

[0061] According to one embodiment, in operation 410, the processor 220 may sense a region of interest including at least a part of the subject within the image. Operation 410 may correspond to Figure 3 operation 330 thereof.

[0062] According to one embodiment, in operation 420, the processor 220 may display a first visual availability on the display. The first visual availability may be in the form of a soft button displayed on the display 110.

[0063] According to one embodiment, the electronic device 100 may guide the user to take a picture at a magnification suitable for photographing the subject. For example, the processor 220 may display on the display a first visual availability for adjusting the magnification of the camera lens to a specific magnification when defocus occurs.

[0064] According to one embodiment, in operation 430, the processor 220 may determine that a user input for the first visual availability is received. For example, the processor 220 may receive a touch input using a finger or an operation tool to touch the touch screen or a voice command.

[0065] According to one embodiment, in operation 440, when the processor 220 receives a user input for the first visual availability, it may crop an area including at least the region of interest within the image. Operation 440 may correspond to Figure 3 operation 340 thereof.

[0066] According to one embodiment, in operation 450, the processor 220 may magnify and display the cropped area on the display 110 together with a message indicating defocus. Operation 450 may correspond to Figure 3 operation 350 thereof.

[0067] According to one embodiment, the processor 220 may display a first visual affordance on the display 110, and thus display a cropped and enlarged image on the display 110 according to the user's selection. For example, the user may touch the first visual affordance to view the cropped and enlarged image displayed on the display 110, thereby accurately recognizing the defocus situation. As another example, the user may not touch the first visual affordance to obtain an uncropped and unenlarged image.

[0068] Figure 5 FIG. is a flowchart showing operations when a user input for a second visual affordance is received according to one embodiment.

[0069] According to one embodiment, in operation 510, the processor 220 may enlarge the cropped area together with a message indicating defocus and display it on the display 110, and at the same time display a second visual affordance on the display 110. The second visual affordance may be in the form of a soft button displayed on the display 110.

[0070] According to one embodiment, after the processor 220 senses the region of interest, when receiving a user input for the first visual affordance displayed on the display 110, or along with the sensing of the region of interest, the processor 220 may automatically enlarge the cropped area together with a message indicating defocus and display it on the display 110. At this time, the processor 220 may display the second visual affordance on the display 110 together with the message and the cropped and enlarged image.

[0071] According to one embodiment, in operation 520, the processor 220 may determine that a user input for the second visual affordance is received. For example, the processor 220 may receive a touch input of touching the touch screen with a finger or an operation tool (e.g., a stylus).

[0072] According to one embodiment, in operation 530, the processor 220 may display an uncropped or unenlarged image on the display 110. When receiving a user input for the second visual affordance, the processor 220 may stop the operations of cropping at least the area including the region of interest in the image and enlarging and displaying the cropped area on the display 110. The processor 220 may not crop or enlarge the image acquired by the camera 210 and display it on the display 110.

[0073] According to one embodiment, when the processor 220 receives a user input for the second visual availability, it may stop displaying a message indicating defocus on the display 110. For example, when the electronic device 100 receives a user input for the second visual availability while the subject is located farther than the minimum focal length, the processor 220 may not display a message indicating defocus on the display 110. According to other embodiments, the processor 220 may also not stop displaying the message indicating defocus when receiving a user input for the second visual availability. For example, even when receiving a user input for the second visual availability, as long as the distance between the subject and the electronic device 100 is within the minimum focal length, thus maintaining a defocused state, the processor 220 may continue to display a message indicating defocus on the display 110.

[0074] Figure 6 is a flowchart showing a method of analyzing an image and distance data according to one embodiment.

[0075] According to one embodiment, in operation 610, the processor 220 may acquire an image through the camera 210 and acquire distance data on the distance between the subject and the electronic device 100 through the distance sensor 145. Operation 610 may correspond to Figure 3 operation 310.

[0076] According to one embodiment, in operation 620, the processor 220 may analyze the image acquired through the camera 210 and determine whether the blur included in the image is motion blur caused by subject movement.

[0077] According to one embodiment, in operation 630, when the processor 220 determines that the blur in the image is not motion blur, it may determine defocus based on the distance data and determine whether the blur in the image is defocus-induced blur. In one embodiment, the processor 220 may analyze the amount of blur included in the image and use the analysis result in the determination of whether defocus occurs.

[0078] According to one embodiment, when the distance between the subject and the electronic device 100 is within the minimum focal length, the processor 220 may determine defocus based on the distance data acquired through the distance sensor 145 and determine that the blur in the image is defocus-induced blur.

[0079] According to one embodiment, in operation 640, when the processor 220 determines that the blur included in the image is defocus-induced blur, it may sense a region of interest including at least a part of the subject through object detection within the image.

[0080] According to one embodiment, the object detection operation of the processor 220 may include: analyzing an image acquired through the camera 210, and identifying an operation of the presence of an object in a specific part of the image (object recognition); an operation of determining what kind of object the object is (object classification); an operation of finding an accurate position of the object within the image (object localization).

[0081] According to one embodiment, in operation 650, the processor 220 may perform texture inspection and advanced feature extraction within the image.

[0082] According to one embodiment, the processor 220 may grasp the texture of the subject through texture inspection, thereby determining the degree of sharpness required for the subject. For example, when the subject is a subject including text or an image, clear shooting is required. Therefore, when there is blur in the image of the subject, the electronic device 100 may determine that the distance between the subject and the electronic device 100 needs to be adjusted. As another example, when the blur is caused by the subject being a wall or a surface without texture, the electronic device 100 may determine that there is no need to adjust the distance between the subject and the electronic device 100.

[0083] According to one embodiment, the processor 220 may grasp the characteristics of the blur included in the image through advanced feature extraction. For example, the processor 220 may determine that the blur included in the image is caused by the user's intention. As another example, the processor 220 may determine that the blur included in the image is defocus blur.

[0084] According to one embodiment, operations 620 to 650 may be Figure 3 corresponding to operations 320 and 330 of

[0085] Figure 7 It is an example showing an image shooting guide according to one embodiment.

[0086] According to one embodiment, reference numerals 710 to 730 illustrate examples of providing Figures 3 to 6 the image shooting guide illustrated in

[0087] According to one embodiment, reference numeral 710 shows a screen displayed on the display 110 when defocus occurs.

[0088] According to an embodiment, the processor 220 may analyze an image obtained through the camera 210 to determine whether the blur is caused by the movement of the subject 711. As a result of analyzing the image, the processor 220 confirms that there is no directionality in the blur around the subject, and thus determines that the blur in the image is not a motion blur. Assuming that the subject 711 and the surrounding blur have a predetermined directionality, the processor 220 may determine that the blur in the image is caused by the movement of the subject 711.

[0089] According to an embodiment, when the processor 220 determines that the blur included in the image is not a motion blur, it may determine whether the blur included in the image is a defocus blur based on the distance data. Since the distance between the subject 711 and the electronic device 100 is within the minimum focal length, the processor 220 may determine that defocus occurs and may determine that the blur in the image is a defocus blur.

[0090] According to an embodiment, the reference numeral 720 denotes a screen displayed on the display 110 when a region of interest including at least a part of the subject 711 is sensed in the image. The region of interest may include a part of the subject 711.

[0091] According to an embodiment, when the processor 220 determines that the blur included in the image is a defocus blur, it may sense the region of interest through object detection in the image. The processor 220 may sense the presence of the subject 711 in a specific part of the image, determine that the subject 711 is a business card, and thus sense the region including at least a part of the subject 711 as the region of interest.

[0092] According to an embodiment, the processor 220 may grasp the texture of the subject 711 through texture inspection. Since the subject 711 includes characters, it is determined that a clear shot is required. The processor 220 may determine through advanced feature extraction that since the blur included in the image is caused by defocus rather than the user's intention, the distance between the subject 711 and the electronic device 100 needs to be adjusted.

[0093] According to an embodiment, when the processor 220 senses the region of interest, it may display a line 721 around the region of interest on the display 110. The processor 220 may represent the line 721 displayed on the display 110 in a color and thickness that are easily visible in the image.

[0094] According to an embodiment, when the processor 220 senses the region of interest, it may display a first visual affordance 725 on the display 110. The first visual affordance 725 may include a sentence for magnifying the region of interest.

[0095] According to an embodiment, the reference numeral 730 denotes a screen displayed on the display 110 when a user input for the first visual affordance 725 is received.

[0096] According to one embodiment, when the processor 220 receives a user input for the first visual availability 725, it may crop the region of interest and magnify and display the cropped region on the display 110. The processor 220 may display a message 733 indicating defocus on the display 110 together. The message 733 may include content for moving the electronic device 100 away from the subject.

[0097] According to one embodiment, after the processor 220 senses the region of interest within the image, it may not display the first visual availability 725 on the display 110 and automatically display a magnified image such as the reference numeral 730. At this time, even without a user input, the electronic device 100 may provide an image of the cropped and magnified region of interest through the display 110.

[0098] According to one embodiment, the processor 220 may display a second visual availability 735 on the display 110 together with the image of the magnified cropped region and the message 733 indicating defocus. When the processor 220 receives a user input for the second visual availability 735, it may stop the actions of cropping the region of interest and magnifying the cropped region. The processor 220 may display an uncropped or unmagnified image on the display 110.

[0099] According to one embodiment, after the electronic device 100 is moved farther from the subject than the minimum focal length and there is a user input for the second visual availability 735, the processor 220 may stop displaying the message 733 indicating defocus while displaying an uncropped or unmagnified image on the display 110. According to other embodiments, when the electronic device 100 receives a user input for the second visual availability 735 while remaining defocused with the subject within the minimum focal length, the processor 220 may continue to display the message 733 indicating defocus on the display 110. Herein, the visual availability may replace / reference visual objects, UI items, icons, menus, indicators, etc.

[0100] Figure 8 is an example showing the cropped and magnified region of interest within the image as the distance between the subject and the electronic device becomes farther according to one embodiment.

[0101] According to one embodiment, Figure 8 shows the uncropped or unmagnified images 810, 820, 830 and the cropped and magnified images 815, 825, 835 of the region of interest when the electronic device 100 moves away from the subject.

[0102] According to one embodiment, the reference numeral 810 shows an image in which the electronic device 100 is defocused with the subject closer than the minimum focal length.

[0103] According to one embodiment, reference numeral 815 shows a region of interest 811 sensed by the cropping processor 220 within the image of reference numeral 810, and an image of the cropped region is enlarged and displayed on the display 110. Since the distance between the subject and the electronic device 100 is less than the minimum focal length, the subject 812 is out of focus, and thus strong blurring can be displayed within the image.

[0104] According to one embodiment, reference numeral 820 shows an image of a case where, although the electronic device 100 moves in a direction away from the subject, the distance between the subject and the electronic device 100 is closer than the minimum focal length.

[0105] According to one embodiment, reference numeral 825 shows a region of interest 821 sensed by the cropping processor 220 within the image of reference numeral 820, and an image of the cropped region is enlarged and displayed on the display 110. As compared with the case of reference numeral 810, the distance between the subject and the electronic device 100 becomes farther, and thus, as compared with the case of reference numeral 815, less defocus occurs in the subject 822, and thus weak blurring can be displayed within the image.

[0106] According to one embodiment, reference numeral 830 shows an image of a case where the distance between the subject and the electronic device 100 is equal to or greater than the minimum focal length.

[0107] According to one embodiment, reference numeral 835 shows a region of interest 831 sensed by the cropping processor 220 within the image of reference numeral 830, and an image of the cropped region is enlarged and displayed on the display 110. Since the electronic device 100 is located farther from the subject than the minimum focal length, the subject 832 is in focus and a clear image can be obtained.

[0108] According to one embodiment, while the user moves the electronic device 100 in a direction away from the subject, the sizes of the subjects 812, 822, and 832 displayed on the display 110 can be kept constant. The farther the electronic device 100 is from the subject, the smaller the sizes of the regions of interest 811, 821, and 831 in the images 810, 820, and 830 acquired by the camera 210. However, the electronic device 100 senses the regions of interest 811, 821, and 831 in the images 810, 820, and 830 and crops them, and the cropped regions are enlarged and displayed on the display 110. Therefore, the sizes of the images 815, 825, and 835 of the regions of interest displayed on the display 110 can be kept constant.

[0109] Figure 9 This is an example of a UI showing that, according to one embodiment, the region of interest is located at the center of the image.

[0110] According to an embodiment, the processor 220 may sense a region of interest including at least a part of a subject within an image. At this time, the region of interest may be located at an edge instead of in the center of the image. The processor 220 may display a UI (user interface) 910 such as an arrow on the display 110. The user may adjust the position of the electronic device 100 through the UI 910 displayed on the display 110 so that the region of interest is located in the center of the image.

[0111] Figure 10 is a flowchart showing a method of providing an image capture guide through a message indicating defocus according to an embodiment. Figure 10 The method described in may be run by the electronic device 100 or the processor 220 of the electronic device 100.

[0112] According to an embodiment, in operation 1010, the processor 220 may obtain an image through the camera 210 and obtain distance data on the distance between the subject and the electronic device 100 through the distance sensor 145. Operation 1010 may correspond to Figure 3 operation 310 of.

[0113] According to an embodiment, in operation 1020, the processor 220 may determine that defocus has occurred based on the distance data.

[0114] According to an embodiment, defocus may occur when the distance between the subject and the electronic device 100 is within the minimum focal length. At this time, the processor 220 may analyze the distance data obtained through the distance sensor 145 to determine that defocus has occurred. In addition, the processor 220 may analyze the amount of blur included in the image and thus supplement and utilize it when determining that defocus has occurred. The processor 220 may utilize the image analysis result in order to correct an error that may occur in the analysis result of the distance data. The processor 220 may determine that the blur included in the image is caused by defocus resulting from shooting within the minimum focal length.

[0115] According to an embodiment, in operation 1030, the processor 220 may display a message on the display 110 to guide the distance between the subject and the electronic device 100 to be above the minimum focal length. The user may recognize, through the message displayed on the display 110, that defocus can be eliminated when moving the electronic device 100 in a direction away from the subject.

[0116] According to an embodiment, while the processor 220 displays a message on the display 110, the processor 220 may further use at least one output device such as a speaker or a light emitting device (e.g., an LED lamp) to notify that defocus has occurred. According to other embodiments, the processor 220 may use at least one output device such as a speaker or a light emitting device to notify the user that defocus has occurred instead of displaying the message on the display 110.

[0117] According to an embodiment, in operation 1040, the processor 220 may determine that the distance between the subject and the electronic device 100 is equal to or greater than the minimum focal length. After the user recognizes that defocusing has occurred through the message displayed on the display 110, the user may move the electronic device 100 away from the subject. The electronic device 100 may analyze the distance data to determine that the distance between the subject and the electronic device 100 becomes equal to or greater than the minimum focal length without defocusing.

[0118] According to an embodiment, in operation 1050, the processor 220 may remove the message from the display 110 in response to the distance between the subject and the electronic device 100 being equal to or greater than the minimum focal length. When the user moves the electronic device 100 away from the subject such that the subject is located farther than the minimum focal length, defocusing does not occur, and thus the processor 220 may not display the message on the display 110.

[0119] Figure 11 This is an example of a message indicating defocusing according to an embodiment.

[0120] According to an embodiment, the processor 220 may determine that defocusing has occurred based on the distance data obtained through the distance sensor 145. The processor 220 may display, on the display 110, a message 1110 guiding the distance between the subject and the electronic device 100 to become equal to or greater than the minimum focal length from the subject.

[0121] According to an embodiment, the processor 220 may display, on the display 110, a message 1110 for moving the electronic device 100 away from the subject. According to other embodiments, the processor 220 may suggest, through the message, an accurate distance by which the electronic device 100 needs to be moved away from the subject.

[0122] According to an embodiment, while the processor 220 is displaying the message 1110 on the display 110, the processor 220 may further use at least one output device, such as a speaker or a light-emitting device (e.g., an LED lamp), to notify that defocusing has occurred.

[0123] Figure 12 This is a block diagram showing an electronic device 1201 in a network environment 1200 according to various embodiments. Refer to Figure 12, in a network environment 1200, an electronic device 1201 can communicate with an electronic device 1202 via a first network 1298 (e.g., a short-range wireless communication network), or communicate with at least one of an electronic device 1204 or a server 1208 via a second network 1299 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 1201 can communicate with the electronic device 1204 via the server 1208. According to an embodiment, the electronic device 1201 can include a processor 1220, a memory 1230, an input module 1250, a sound output module 1255, a display module 1260, an audio module 1270, a sensor module 1276, an interface 1277, a connection end 1278, a haptic module 1279, a camera module 1280, a power management module 1288, a battery 1289, a communication module 1290, a subscriber identity module (SIM) 1296, or an antenna module 1297. In some embodiments, at least one of the above components (e.g., the connection end 1278) can be omitted from the electronic device 1201, or one or more other components can be added to the electronic device 1201. In some embodiments, some of the above components (e.g., the sensor module 1276, the camera module 1280, or the antenna module 1297) can be implemented as a single integrated component (e.g., the display module 1260).

[0124] The processor 1220 can run software (e.g., a program 1240) to control at least one other component (e.g., a hardware component or a software component) connected to the processor 1220 of the electronic device 1201, and can perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 1220 can store a command or data received from another component (e.g., the sensor module 1276 or the communication module 1290) in the volatile memory 1232, process the command or data stored in the volatile memory 1232, and store the result data in the non-volatile memory 1234. According to an embodiment, the processor 1220 can include a main processor 1221 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 1223 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent of or combined with the main processor 1221. For example, when the electronic device 1201 includes the main processor 1221 and the auxiliary processor 1223, the auxiliary processor 1223 can be adapted to consume less power than the main processor 1221, or be adapted to be dedicated to a specific function. The auxiliary processor 1223 can be implemented as separate from the main processor 1221, or as part of the main processor 1221.

[0125] When the main processor 1221 is in an inactive (e.g., sleep) state, the auxiliary processor 1223 (instead of the main processor 1221) may control at least some of the functions or states related to at least one of the components of the electronic device 1201 (e.g., the display module 1260, the sensor module 1276, or the communication module 1290). Or when the main processor 1221 is in an active state (e.g., running an application), the auxiliary processor 1223 may control, together with the main processor 1221, at least some of the functions or states related to at least one of the components of the electronic device 1201 (e.g., the display module 1260, the sensor module 1276, or the communication module 1290). According to an embodiment, the auxiliary processor 1223 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 1280 or the communication module 1290) that is functionally related to the auxiliary processor 1223. According to an embodiment, the auxiliary processor 1223 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. An artificial intelligence model may be generated through machine learning. For example, such learning may be performed by the electronic device 1201 where the artificial intelligence is executed or via a separate server (e.g., the server 1208). The learning algorithm may include, but is not limited to, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q-network, or a combination of two or more of them, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to the hardware structure.

[0126] The memory 1230 may store various data used by at least one component of the electronic device 1201 (e.g., the processor 1220 or the sensor module 1276). The various data may include, for example, software (e.g., the program 1240) and input data or output data for commands related thereto. The memory 1230 may include a volatile memory 1232 or a non-volatile memory 1234.

[0127] The program 1240 may be stored as software in the memory 1230, and the program 1240 may include, for example, an operating system (OS) 1242, middleware 1244, or an application 1246.

[0128] The input module 1250 can receive commands or data from outside the electronic device 1201 (e.g., from a user) to be used by other components of the electronic device 1201 (e.g., the processor 1220). The input module 1250 can include, for example, a microphone, a mouse, a keyboard, keys (e.g., buttons), or a digital pen (e.g., a stylus).

[0129] The sound output module 1255 can output a sound signal to the outside of the electronic device 1201. The sound output module 1255 can include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing a record. The receiver can be used to receive incoming calls. According to an embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0130] The display module 1260 can visually provide information to the outside of the electronic device 1201 (e.g., to a user). The display device 1260 can include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 1260 can include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the intensity of the force caused by the touch.

[0131] The audio module 1270 can convert sound into an electrical signal and vice versa. According to an embodiment, the audio module 1270 can obtain sound via the input module 1250, or output sound via the sound output module 1255 or headphones of an external electronic device (e.g., the electronic device 1202) directly (e.g., wired) or wirelessly connected to the electronic device 1201.

[0132] The sensor module 1276 can detect the operating state of the electronic device 1201 (e.g., power or temperature) or the environmental state outside the electronic device 1201 (e.g., the state of a user), and then generate an electrical signal or a data value corresponding to the detected state. According to an embodiment, the sensor module 1276 can include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0133] The interface 1277 can support one or more specific protocols for directly (e.g., wired) or wirelessly connecting the electronic device 1201 to an external electronic device (e.g., the electronic device 1202). According to an embodiment, the interface 1277 can include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0134] The connection terminal 1278 may include a connector, and the electronic device 1201 may be physically connected to an external electronic device (e.g., the electronic device 1202) via the connector. According to an embodiment, the connection terminal 1278 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0135] The haptic module 1279 may convert an electrical signal into a mechanical stimulus (e.g., vibration or motion) or an electrical stimulus that can be recognized by the user via his sense of touch or kinesthesia. According to an embodiment, the haptic module 1279 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0136] The camera module 1280 may capture a still image or a moving image. According to an embodiment, the camera module 1280 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0137] The power management module 1288 may manage the power supply to the electronic device 1201. According to an embodiment, the power management module 1288 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0138] The battery 1289 may supply power to at least one component of the electronic device 1201. According to an embodiment, the battery 1289 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0139] The communication module 1290 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 1201 and an external electronic device (e.g., the electronic device 1202, the electronic device 1204, or the server 1208), and perform communication via the established communication channel. The communication module 1290 may include one or more communication processors capable of operating independently of the processor 1220 (e.g., an application processor (AP)), and support direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 1290 may include a wireless communication module 1292 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1294 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). Each corresponding one of these communication modules may communicate with an external electronic device via a first network 1298 (e.g., a short-range communication network, such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 1299 (e.g., a long-range communication network, such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or these various types of communication modules may be implemented as multiple separate components (e.g., multiple chips). The wireless communication module 1292 may identify and authenticate the electronic device 1201 in a communication network (such as the first network 1298 or the second network 1299) using user information (e.g., an international mobile subscriber identity (IMSI)) stored in the user identification module 1296.

[0140] The wireless communication module 1292 may support 5G networks after 4G networks and next-generation communication technologies (e.g., New Radio (NR) access technology). The NR access technology may support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 1292 may support high frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transfer rates. The wireless communication module 1292 may support various technologies for ensuring performance in high frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 1292 may support various requirements specified in the electronic device 1201, an external electronic device (e.g., the electronic device 1204), or a network system (e.g., the second network 1299). According to an embodiment, the wireless communication module 1292 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), a loss coverage for implementing mMTC (e.g., 164 dB or less), or a U-plane latency for implementing URLLC (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or a round trip of 1 ms or less).

[0141] The antenna module 1297 may transmit a signal or power to the outside of the electronic device 1201 (e.g., an external electronic device) or receive a signal or power from the outside of the electronic device 1201 (e.g., an external electronic device). According to an embodiment, the antenna module 1297 may include an antenna, and the antenna may include a radiating element formed of a conductive material or a conductive pattern formed in a substrate (e.g., a printed circuit board (PCB)) or formed on the substrate. According to an embodiment, the antenna module 1297 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme to be used in a communication network (such as the first network 1298 or the second network 1299) may be selected from the plurality of antennas by, for example, the communication module 1290 (e.g., the wireless communication module 1292). Subsequently, a signal or power may be transmitted or received between the communication module 1290 and an external electronic device via the selected at least one antenna. According to an embodiment, additional components (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 1297.

[0142] According to various embodiments, the antenna module 1297 may form a millimeter-wave antenna module. According to an embodiment, the millimeter-wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., an array antenna), wherein the RFIC is disposed on a first surface (e.g., a bottom surface) of the printed circuit board or adjacent to the first surface and capable of supporting a specified high-frequency band (e.g., a millimeter-wave band), and the plurality of antennas are disposed on a second surface (e.g., a top surface or a side surface) of the printed circuit board or adjacent to the second surface and capable of transmitting or receiving signals of the specified high-frequency band.

[0143] At least some of the above components may be interconnected via an inter-peripheral communication scheme (e.g., a bus, a general-purpose input / output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0144] According to an embodiment, commands or data may be sent or received between the electronic device 1201 and an external electronic device 1204 via a server 1208 connected to a second network 1299. Each of the electronic devices 1202 or 1204 may be a device of the same type as the electronic device 1201 or a device of a different type from the electronic device 1201. According to an embodiment, all or some of the operations running on the electronic device 1201 may run on one or more of the external electronic device 1202, the external electronic device 1204, or the server 1208. For example, if the electronic device 1201 is to automatically perform a function or service or is to perform a function or service in response to a request from a user or another device, the electronic device 1201 may request one or more of the external electronic devices to perform at least part of the function or service instead of running the function or service, or in addition to running the function or service, the electronic device 1201 may also request one or more of the external electronic devices to perform at least part of the function or service. The one or more external electronic devices that receive the request may perform the requested at least part of the function or service, or perform additional functions or additional services related to the request, and transmit the result of the execution to the electronic device 1201. The electronic device 1201 may provide the result as at least part of a reply to the request with or without further processing of the result. To this end, for example, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology may be used. The electronic device 1201 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 1204 may include an Internet of Things (IoT) device. The server 1208 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 1204 or the server 1208 may be included in the second network 1299. The electronic device 1201 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology or IoT-related technology.

[0145] An electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the present disclosure, the electronic device is not limited to the electronic devices described above.

[0146] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for the corresponding embodiments. For the description of the drawings, like reference numerals may be used to refer to like or related elements. It will be understood that a singular noun corresponding to a term may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B or C" may include any one or all possible combinations of the items listed together in the corresponding one of the plurality of phrases. As used herein, terms such as "first" and "second" or "1st" and "2nd" may be used to simply distinguish a corresponding component from another component and do not limit the component in other respects (e.g., importance or order). It will be understood that, in the case where the terms "operably" or "communicatively" are used or where the terms "operably" or "communicatively" are not used, if an element (e.g., a first element) is referred to as "coupled with another element (e.g., a second element)", "coupled to another element (e.g., a second element)", "connected with another element (e.g., a second element)" or "connected to another element (e.g., a second element)", it means that the one element can be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0147] As used in connection with the various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software or firmware and may be used interchangeably with other terms (e.g., "logic", "logic block", "portion" or "circuit"). A module may be a single integrated component adapted to perform one or more functions or the smallest unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0148] The various embodiments described herein can be implemented as software (e.g., program 1240) including one or more instructions readable by a machine (e.g., electronic device 1201) and stored in a storage medium (e.g., internal memory 1236 or external memory 1238). For example, under the control of a processor, a processor (e.g., processor 1220) of the machine (e.g., electronic device 1201) can call at least one of the one or more instructions stored in the storage medium and run the at least one instruction with or without using one or more other components. This enables the machine to operate to perform at least one function in accordance with the at least one instruction called. The one or more instructions can include code generated by a compiler or code that can be run by an interpreter. The machine-readable storage medium can be provided in the form of a non-transitory storage medium. Herein, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being stored temporarily in the storage medium.

[0149] According to an embodiment, a method according to various embodiments of the present disclosure can be included and provided in a computer program product. The computer program product can be traded between a seller and a purchaser as a product. The computer program product can be distributed (e.g., downloaded or uploaded) online via an application store (e.g., Play StoreTM) in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or can be directly distributed (e.g., downloaded or uploaded) between two user devices (e.g., smart phones). If it is distributed online, at least part of the computer program product can be generated temporarily, or at least part of the computer program product can be stored at least temporarily in a machine-readable storage medium (such as the memory of a manufacturer's server, an application store's server, or a forwarding server).

[0150] According to various embodiments, each of the above components (e.g., a module or a program) may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding one of the multiple components performed one or more functions before integration. According to various embodiments, operations performed by a module, a program, or another component may be performed sequentially, in parallel, repeatedly, or in a heuristic manner, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

[0151] Figure 13 is a block diagram 1300 showing a camera module 1280 according to various embodiments. Referring to Figure 13 , the camera module 1280 may include a lens assembly 1310, a flash 1320, an image sensor 1330, an image stabilizer 1340, a memory 1350 (e.g., a buffer memory), or an image signal processor 1360. The lens assembly 1310 may collect light emitted or reflected from an object whose image is to be captured. The lens assembly 1310 may include one or more lenses. According to an embodiment, the camera module 1280 may include multiple lens assemblies 1310. In this case, the camera module 1280 may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the multiple lens assemblies 1310 may have the same lens properties (e.g., viewing angle, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from those of another lens assembly. The lens assembly 1310 may include, for example, a wide-angle lens or a telephoto lens.

[0152] The flash 1320 can emit light, and the emitted light is used to enhance the light reflected from an object. According to an embodiment, the flash 1320 can include one or more light-emitting diodes (LEDs) (e.g., red, green, blue (RGB) LEDs, white LEDs, infrared (IR) LEDs, or ultraviolet (UV) LEDs) or xenon lamps. The image sensor 1330 can acquire an image corresponding to an object by converting the light emitted or reflected from the object and transmitted through the lens assembly 1310 into an electrical signal. According to an embodiment, the image sensor 1330 can include one image sensor selected from a plurality of image sensors having different attributes (e.g., an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same attribute, or a plurality of image sensors having different attributes. Each image sensor included in the image sensor 1330 can be implemented using, for example, a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor.

[0153] The image stabilizer 1340 can move the image sensor 1330 or at least one lens included in the lens assembly 1310 in a specific direction, or control the operable attributes (e.g., adjust the readout timing) of the image sensor 1330 in response to the movement of the camera module 1280 or the electronic device 1201 including the camera module 1280. In this way, at least a part of the negative effects (e.g., image blurring) caused by the movement of the image being captured can be compensated for. According to an embodiment, the image stabilizer 1340 can use a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 1280 to sense such movement of the camera module 1280 or the electronic device 1201. According to an embodiment, the image stabilizer 1340 can be implemented as, for example, an optical image stabilizer.

[0154] The memory 1350 can at least temporarily store at least a part of the image acquired via the image sensor 1330 for subsequent image processing tasks. For example, if a plurality of images are captured quickly or there is a delay in image capture due to shutter lag, the acquired original images (e.g., Bayer pattern images, high-resolution images) can be stored in the memory 1350, and a corresponding copy image (e.g., low-resolution image) can be previewed via the display module 1260. Then, if a specified condition is satisfied (e.g., by a user input or a system command), at least a part of the original image stored in the memory 1350 can be acquired and processed by, for example, the image signal processor 1360. According to an embodiment, the memory 1350 can be configured as at least a part of the memory 1230, or the memory 1350 can be configured as a separate memory that operates independently of the memory 1230.

[0155] The image signal processor 1360 may perform one or more image processes on an image acquired via the image sensor 1330 or an image stored in the memory 1350. The one or more image processes may include, for example, depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor 1360 may control at least one component (e.g., the image sensor 1330) included in the components of the camera module 1280 (e.g., exposure time control or readout timing control). The image processed by the image signal processor 1360 may be stored back in the memory 1350 for further processing, or the image may be provided to an external component outside the camera module 1280 (e.g., the memory 1230, the display module 1260, the electronic device 1202, the electronic device 1204, or the server 1208). According to an embodiment, the image signal processor 1360 may be configured as at least a part of the processor 1220, or the image signal processor 1360 may be configured as a separate processor that operates independently of the processor 1220. If the image signal processor 1360 is configured as a processor separate from the processor 1220, at least one image processed by the image signal processor 1360 may be displayed as is by the processor 1220 via the display module 1260, or the at least one image may be displayed after being further processed.

[0156] According to an embodiment, the electronic device 1201 may include a plurality of camera modules 1280 having different attributes or functions. In this case, at least one of the plurality of camera modules 1280 may form, for example, a wide-angle camera, and at least another one of the plurality of camera modules 1280 may form a telephoto camera. Similarly, at least one of the plurality of camera modules 1280 may form, for example, a front camera, and at least another one of the plurality of camera modules 1280 may form a rear camera.

[0157] An electronic device according to an embodiment of the present disclosure may include a camera, a distance sensor, a display, and at least one processor electrically connected to the camera, the distance sensor, and the display. The at least one processor may acquire an image including a subject through the camera, acquire distance data on the distance between the subject and the electronic device through the distance sensor, determine that defocus has occurred based on the distance data, sense a region of interest including at least a part of the subject in the image, crop a region including at least the region of interest in the image, and magnify and display the cropped region on the display together with a message indicating the defocus.

[0158] The at least one processor may display a first visual affordance on the display in response to sensing the region of interest, and when there is a user input to the first visual affordance, crop a region including at least the region of interest in the image, and magnify and display the cropped region on the display together with a message indicating the defocus.

[0159] In an electronic device according to an embodiment of the present disclosure, the at least one processor may automatically crop a region including at least the region of interest in the image in response to sensing the region of interest, and magnify and display the cropped region on the display together with a message indicating the defocus.

[0160] In an electronic device according to an embodiment of the present disclosure, the at least one processor may display a second visual affordance on the display together with a message indicating the defocus and an image magnifying the cropped region, and when there is a user input to the second visual affordance, display an uncropped or un-magnified image on the display.

[0161] In an electronic device according to an embodiment of the present disclosure, the at least one processor may display a second visual affordance on the display together with a message indicating the defocus and an image magnifying the cropped region, and when there is a user input to the second visual affordance, display an uncropped or un-magnified image on the display.

[0162] In an electronic device according to an embodiment of the present disclosure, the at least one processor may sense the region of interest through object detection.

[0163] In an electronic device according to an embodiment of the present disclosure, the at least one processor may analyze the texture of the subject through a texture check and analyze the characteristics of blur included in the image through extract high level feature.

[0164] In an electronic device according to an embodiment of the present disclosure, the at least one processor may display a line around the region of interest on the display in response to sensing the region of interest.

[0165] In an electronic device according to an embodiment of the present disclosure, the at least one processor may display a UI capable of guiding a user on the display so that the region of interest is located at the center of the image.

[0166] A method for providing an image capture guide of an electronic device according to an embodiment of the present disclosure may include: an operation of obtaining an image including a subject through a camera included in the electronic device; an operation of obtaining distance data on a distance between the subject and the electronic device through a distance sensor included in the electronic device; an operation of determining defocus based on the distance data; an operation of sensing a region of interest including at least a part of the subject in the image; an operation of cropping a region including at least the region of interest in the image; and an operation of magnifying and displaying the cropped region on a display included in the electronic device together with a message indicating the defocus.

[0167] A method for providing an image capture guide of an electronic device according to an embodiment of the present disclosure may include: an operation of displaying a first visual affordance on the display in response to sensing the region of interest; and an operation of cropping a region including at least the region of interest in the image and magnifying and displaying the cropped region on the display together with a message indicating the defocus when there is a user input to the first visual affordance.

[0168] A method for providing an image capture guide of an electronic device according to an embodiment of the present disclosure may include: an operation of automatically cropping a region including at least the region of interest in the image in response to sensing the region of interest and magnifying and displaying the cropped region on the display together with a message indicating the defocus.

[0169] A method for providing an image capture guide of an electronic device according to an embodiment of the present disclosure may include: an operation of displaying a second visual affordance on the display together with a message indicating the defocus and an image magnifying the cropped region; and an operation of displaying an uncropped or un-magnified image on the display when there is a user input to the second visual affordance.

[0170] A method for providing an image shooting guide of an electronic device according to an embodiment of the present disclosure may include: displaying an action of a second visual availability on the display together with a message indicating the defocus and an image of an enlarged cropped area; and displaying an uncropped or unenlarged image on the display when there is a user input for the second visual availability.

[0171] In a method for providing an image shooting guide of an electronic device according to an embodiment of the present disclosure, the action of sensing the region of interest may include: sensing the region of interest through object detection.

[0172] An electronic device according to an embodiment of the present disclosure may include a camera, a distance sensor, a display, and at least one processor, and the at least one processor is electrically connected to the camera, the distance sensor, and the display. The at least one processor may obtain an image including a subject through the camera, obtain distance data of a distance between the subject and the electronic device through the distance sensor, determine that defocus occurs based on the distance data, and display a message on the display guiding the distance between the subject and the electronic device to be above the minimum focal length.

[0173] In an electronic device according to an embodiment of the present disclosure, the at least one processor may remove the message from the display in response to the distance between the subject and the electronic device being above the minimum focal length.

[0174] An electronic device according to an embodiment of the present disclosure may include at least one of a speaker and a light emitting device electrically connected to the at least one processor, and when the at least one processor displays the message on the display, the at least one processor may cause at least one of the speaker and the light emitting device to perform an output together.

[0175] In an electronic device according to an embodiment of the present disclosure, the at least one processor may sense a region of interest in the image through object detection.

[0176] In an electronic device according to an embodiment of the present disclosure, the at least one processor may analyze the texture of the subject through texture inspection and analyze the characteristics of blurriness included in the image through advanced feature extraction.

Claims

1. An electronic device, the electronic device comprising: Camera; Distance sensor; Memory storing instructions; Display; And At least one processor, wherein the instructions, when executed by the at least one processor, cause the electronic device to: Obtain an image including a subject through the camera; Obtain distance data of the distance between the subject and the electronic device through the distance sensor; Determine whether the distance is less than the minimum focal length of the camera based on the distance data; Based on determining that the distance is less than the minimum focal length, determine that the blur in the image is caused by defocus; Based on determining that the blur is caused by the defocus, analyze the texture of the subject through texture inspection and analyze the characteristics of the blur included in the image through advanced feature extraction; Based on the characteristics of the blur, determine whether focus adjustment is required; and When the focus adjustment is required: Determine a region of interest including at least a part of the subject in the image; Crop a region corresponding to the region of interest in the image; and Together with a message instructing to move the electronic device so that the distance becomes greater than the minimum focal length, magnify and display a preview screen constructed from the cropped region on the display, When the electronic device is being moved, maintain the size of at least a part of the subject within the magnified cropped region, When the distance is greater than the minimum focal length, display a preview screen constructed from a region of the image larger than the region of interest.

2. The electronic device according to claim 1, wherein, The instructions, when executed by the at least one processor, cause the electronic device to: In response to sensing the region of interest, display a first visual availability on the display, When there is a user input to the first visual availability, crop a region corresponding to the region of interest in the image and, together with a message indicating defocus, magnify and display the cropped region on the display.

3. The electronic device according to claim 1, wherein, The instructions, when executed by the at least one processor, cause the electronic device to: In response to sensing the region of interest, automatically crop a region corresponding to the region of interest in the image and, together with the message, magnify and display the cropped region on the display.

4. The electronic device according to claim 2, wherein, The instructions, when executed by the at least one processor, cause the electronic device to: Display a second visual availability on the display together with a message indicating defocus and an image of the magnified cropped region, and When there is a user input to the second visual availability, display the uncropped or unmagnified image on the display.

5. The electronic device according to claim 3, wherein, The instructions, when executed by the at least one processor, cause the electronic device to: Display a second visual availability on the display together with a message indicating defocus and an image of the magnified cropped region, When there is a user input to the second visual availability, display the uncropped or unmagnified image on the display.

6. The electronic device according to claim 1, wherein, The instructions, when executed by the at least one processor, cause the electronic device to sense the region of interest through object detection.

7. The electronic device according to claim 1, wherein, The instructions, when executed by the at least one processor, cause the electronic device to: In response to sensing the region of interest, a line surrounding the region of interest is displayed on the display.

8. The electronic device according to claim 1, wherein, When executed by at least one processor, the instructions cause the electronic device to display a user interface on the display that can guide the user to center the region of interest in the image.

9. A method for providing an image shooting guide for an electronic device, the method comprising the following operations: Obtaining an image including a subject through a camera included in the electronic device; Obtaining distance data of the distance between the subject and the electronic device through a distance sensor included in the electronic device; Based on the distance data, determine whether the distance is less than the minimum focal length of the camera; Based on determining that the distance is less than the minimum focal length, determine that the blur in the image is caused by defocus; Based on determining that the blur is caused by the defocus, analyze the texture of the subject through texture inspection and analyze the characteristics of the blur included in the image through advanced feature extraction; Based on the characteristics of the blur, determine whether a focus adjustment is required; And When the focus adjustment is required: Determine a region of interest in the image that includes at least a portion of the subject; Crop a region corresponding to the region of interest in the image; and Together with a message indicating to move the electronic device so that the distance becomes greater than the minimum focal length, a preview screen constructed from the cropped region is magnified and displayed on a display included in the electronic device, While the electronic device is being moved, maintain the size of at least a portion of the subject within the magnified cropped region, When the distance is greater than the minimum focal length, display a preview screen constructed from a region of the image that is larger than the region of interest.

10. The method for providing an image shooting guide for the electronic device according to claim 9, further comprising the following operations: In response to sensing the region of interest, displaying a first visual availability on the display; and When there is a user input for the first visual availability, cropping at least a region including the region of interest in the image, and magnifying and displaying the cropped region on the display together with a message indicating defocus.

11. The method for providing an image shooting guide for the electronic device according to claim 9, further comprising the following operation: In response to sensing the region of interest, automatically cropping at least a region including the region of interest in the image, and magnifying and displaying the cropped region on the display together with a message indicating the defocus.

12. The method for providing an image shooting guide for the electronic device according to claim 10, further comprising the following operations: Displaying a second visual availability on the display together with a message indicating the defocus and an image magnifying the cropped region; and When there is user input for the second visual availability, display an uncropped or unzoomed image on the display.

13. The method for providing an image capture guide for the electronic device according to claim 11, further comprising the following operations: An operation of displaying second visual availability on the display together with a message indicating the defocus and an image of the enlarged cropped area; and An operation of displaying an uncropped or unzoomed image on the display when there is user input for the second visual availability.

14. The method for providing an image capture guide for the electronic device according to claim 9, wherein, The action of sensing the region of interest includes: the action of sensing the region of interest through object detection.

Images