Image processing device, control method thereof, imaging apparatus, and program

Abstract

To provide an image processing device capable of setting a detection region of a desired subject to a target region for processing.SOLUTION: An imaging apparatus is configured to detect a plurality of portions of a subject from a captured image (S301 to S303). The imaging apparatus is configured to set a region that is related to a detection region of the subject as a related region (S305), and to set an arbitrary region in the image as a search region (S306). In a case where the search region overlaps with at least one of a detection region or a related region of the subject, even if the related region is a region that does not include the detection region, the search region is configured to be set as an AF (autofocus) target region (S307), and AF target region notification processing is executed (S308).SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a technique for detecting and setting a subject based on a captured image. [Background technology]

[0002] There is a technology in which an imaging device detects a subject from an image captured by an image sensor and focuses on the subject using autofocus (AF) control. On the other hand, there is a technology that displays a rectangular frame (hereinafter also referred to as an AF fixed frame) in part of the captured image to assist the user in focusing on a desired position in the image, and focuses on the rectangular frame area in response to a user's operation instruction. By combining these two technologies, it is possible to display both a subject detection frame and an AF fixed frame, and determine which one to focus on based on the position information and area information of each frame. By notifying the user of the result, it is possible to improve the rate at which the focusing target matches the user's intended target.

[0003] Patent Document 1 discloses a technology for accurately recognizing a subject. A touch acceptance frame with a wider range than the subject frame is set depending on the image conditions or imaging mode, and when a position on the image designated by the user is detected, the subject to be tracked is recognized based on the touch acceptance frame and the designated position. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-15889 Summary of the Invention [Problem to be solved by the invention]

[0005] However, depending on the subject to be detected, for example, if the subject is small in size or moves quickly, it may be difficult for a user holding the imaging device to keep the subject detection frame within the range of the AF fixed frame.Even if the user intends to use a desired subject as the AF target, it may be difficult to maintain an overlap between the subject detection frame and the AF fixed frame, making it difficult to select the desired subject as the AF target.An object of the present invention is to provide an image processing device that can set the detection area of ​​the desired subject as the processing target area. [Means for solving the problem]

[0006] An image processing device according to one embodiment of the present invention is an image processing device that processes captured images, and comprises: a detection means that detects a subject from the image and acquires first and second detection areas; a related area setting means that sets the first detection area as a related area that is related to the second detection area; a search area setting means that sets a search area related to the subject in the image; and a target setting means that sets any area of ​​the image as a target area for processing, wherein the target setting means sets the second detection area as the target area when the search area overlaps with the second detection area or the related area. [Effects of the Invention]

[0007] According to the image processing device of the present invention, it is possible to set a detection area of ​​a desired subject as a processing target area. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an imaging apparatus according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the configuration of a person detection unit in the present embodiment. [Figure 3] 4 is a flowchart illustrating an operation in the present embodiment. [Figure 4] 10 is a flowchart of an associated region setting process. [Figure 5]10 is a flowchart of an AF target area setting process. [Figure 6] FIG. 2 is a schematic diagram showing an example of a display screen. DETAILED DESCRIPTION OF THE INVENTION

[0009] An embodiment of the present invention will be described in detail below with reference to the drawings. As an example of an apparatus to which an image processing apparatus is applied, an imaging apparatus will be shown that detects the eyes, head, and torso of a person in an image, sets a related area for each detected subject, sets a search area and an AF target area, and notifies the user of the AF target area.

[0010] For example, in the process of determining which of the subject detection frame and the AF fixed frame corresponds to which area to set as the AF target area, it is possible to determine whether the subject detection frame and the AF fixed frame overlap. If the subject detection frame and the AF fixed frame overlap, the subject detection frame is set as the AF target area, and if they do not overlap, the AF fixed frame is set as the AF target area.

[0011] To address the issue of difficulty in selecting a subject as an AF target when the subject is small or moving quickly, one method of making it easier to select the subject as an AF target is to enlarge the subject detection frame. Another method is to widen the overlap determination range between the subject detection frame and the AF fixed frame. However, for small or fast-moving subjects, the user still needs to keep track of the area around the subject. Furthermore, excessive widening of the subject detection frame or overlap determination range can cause problems. Widening the range more than necessary can prevent the user from setting an area where the subject is not detected as an AF target area. Therefore, the following embodiment describes a method of making it easier for the user to set a subject as an AF target when it is difficult for the user to keep the subject detection frame within the AF fixed frame.

[0012] FIG. 1 is a diagram showing an example of the configuration of an imaging device according to this embodiment. The diagram shows an example of the configuration of a mirrorless camera equipped with a pupil AF function. An interchangeable lens 100 is one of the optical devices that can be attached to a main body 120 of the imaging device. A photographing lens unit 101 of the interchangeable lens 100 includes a main imaging optical system 102, an aperture 103 that adjusts the amount of light, and a focus lens group 104 that adjusts the focus.

[0013] A lens system control microcomputer (hereinafter referred to as the lens control unit) 111 controls the interchangeable lens 100. An aperture control unit 112 controls the operation of the aperture 103, and a focus lens control unit 113 controls the operation of the focus lens group 104. For example, the focus lens control unit 113 controls the focus of the imaging optical system by driving the focus lens group 104 in the optical axis direction of the photographing lens unit 101 based on focus lens drive information acquired from the main body unit 120. The focus lens group 104 may have multiple focus lenses or only one focus lens. For simplicity of illustration, FIG. 1 shows a fixed-focus lens as an example of an interchangeable lens, but it may also be a lens with a variable focal length (zoom lens). In this case, the lens control unit 111 acquires focal length information from an encoder output that detects the zoom lens position. In addition, in the case of an interchangeable lens with an image stabilization function, the lens control unit 111 controls a shift lens group for image stabilization.

[0014] The main body 120 includes a shutter 121 used for exposure control and an imaging element 122 such as a CMOS (complementary metal-oxide semiconductor) sensor. An imaging signal output from the imaging element 122 is processed by an analog signal processing circuit 123 and then transmitted to a camera signal processing circuit 124. A camera system control microcomputer (hereinafter referred to as a camera control unit) 131 controls the entire imaging device. For example, the camera control unit 131 controls a shutter drive motor (not shown) and controls the drive of the shutter 121.

[0015] The memory card 125 is a recording medium for recording data of captured images, etc. The camera control unit 131 performs processing for recording captured image data on the memory card 125 based on the pressing state of a release switch 181 operated by the photographer.

[0016] The image display unit 171 includes a display device such as a liquid crystal panel (LCD). The image display unit 171 displays on a monitor an image of a subject that the photographer is about to photograph with the camera, as well as photographed images. The touch panel 172 is an operation unit used by the photographer when specifying coordinates on the image display unit 171 with a finger, a touch pen, or the like, and can be configured integrally with the image display unit 171. For example, the touch panel 172 is configured so that its light transmittance does not interfere with the display on the image display unit 171, and there is an in-cell type device in which the touch panel 172 is incorporated into the display surface of the image display unit 171. Input coordinates on the touch panel 172 correspond to display coordinates on the image display unit 171. This allows for the configuration of a GUI (Graphical User Interface) that makes it appear as if the user can directly operate the screen displayed on the image display unit 171. The operation state of the touch panel 172 is managed by the camera control unit 131.

[0017] The main body 120 has a mount contact 161, which is a communication terminal for communicating with the interchangeable lens 100, on its mount surface with the interchangeable lens 100. On the other hand, the interchangeable lens 100 has a mount contact 114, which is a communication terminal for communicating with the main body 120, on its mount surface with the main body 120.

[0018] The lens control unit 111 and the camera control unit 131 can perform serial communication at a predetermined timing via the mount contact units 114 and 161. Through this communication, focus lens driving information, aperture driving information, etc. are sent from the camera control unit 131 to the lens control unit 111, and optical information such as focal length is sent from the lens control unit 111 to the camera control unit 131.

[0019] The camera signal processing circuit 124 acquires a signal from the analog signal processing circuit 123 and performs signal processing. The camera signal processing circuit 124 includes a person detection unit 141. The person detection unit 141 detects multiple body parts of a person from an image and outputs detection information. Details of the person detection unit 141 will be described with reference to FIG. 2. The person detection result by the person detection unit 141 is sent to the camera control unit 131.

[0020] The camera control unit 131 has a search area setting unit 150, a related area setting unit 151, a display frame setting unit 152, an AF target setting unit 153, and a focus detection unit 154. Each unit is realized by a CPU (Central Processing Unit) included in the camera control unit 131 executing a program.

[0021] The search area setting unit 150 sets a search area based on the AF fixed frame displayed on the image display unit 171 or the coordinates when the touch panel 172 is touched. Any area within the image can be set as the search area. The associated area setting unit 151 sets an associated area for each subject included in the detection result obtained from the person detection unit 141.

[0022] The display frame setting unit 152 performs settings for displaying the AF fixed frame, the subject detection frame, and information about the AF target area on the image display unit 171. The AF target setting unit 153 performs processing for notifying the focus detection unit 154 of the set area as the AF target area.

[0023] The focus detection unit 154 performs focus detection processing based on the image signal corresponding to the subject to be focused, which has been notified by the AF target setting unit 153. The focus detection processing is performed using a phase difference detection method, a contrast detection method, or the like. In the case of the phase difference detection method, the amount of image shift is calculated by a correlation calculation of a pair of image signals having parallax. A process is performed to convert the amount of image shift into a defocus amount. The defocus amount can be further converted into a focus lens drive amount by taking into account the sensitivity of the interchangeable lens 100 when driving the lens, etc. In the case of the contrast detection method, the focus position can be detected based on the contrast evaluation information of the acquired image.

[0024] The camera control unit 131 transmits the focus detection result (image shift amount or defocus amount) acquired by the focus detection unit 154 or drive information such as the focus lens drive amount calculated based on the focus detection result to the lens control unit 111. The focus lens control unit 113 controls the drive of the focus lens based on the focus lens drive information received from the camera control unit 131. In other words, the camera control unit 131 controls the drive of the focus lens via the focus lens control unit 113.

[0025] 2 is a block diagram showing an example of the configuration of the person detection unit 141. The person detection unit 141 includes a head detection unit 201, an eye detection unit 202, and a body detection unit 203.

[0026] The head detection unit 201 detects the head region of a person from a captured image. For head detection, known methods can be used, such as a method based on the results of detecting characteristic edges or patterns, or a method based on an algorithm that learns face regions through machine learning.

[0027] The pupil detection unit 202 detects pupil regions from the captured image based on the head region output from the head detection unit 201. For pupil detection, known methods can be used, such as a pattern matching method or a method using an algorithm that learns pupil regions through machine learning.

[0028] The torso detection unit 203 detects a torso region from the captured image. The torso region is a rectangular region that includes the torso portion of a human body from below the neck to above the waist, but does not include the arms. As with the head detection unit 201 and the pupil detection unit 202, torso detection can use known methods such as a pattern matching method or a method using an algorithm that learns the torso region through machine learning.

[0029] The operation from subject detection to AF target notification will be described with reference to Fig. 3 to Fig. 5. Fig. 3 is a flowchart explaining the overall operation from when the person detection unit 141 detects a person to when the camera control unit 131 notifies the user of the AF target. Fig. 4 is a flowchart explaining the related region setting process performed by the related region setting unit 151 in Fig. 3. Fig. 5 is a flowchart explaining the AF target region setting process performed by the AF target setting unit 153 in Fig. 3.

[0030] 3, the head detection unit 201 performs head detection from the captured image and proceeds to processing in S302. In S302, the pupil detection unit 202 performs pupil detection using the captured image and the head detection results acquired in S301. At this time, if no head detection results are acquired in S301, pupil detection is not performed and the process proceeds to processing in S303.

[0031] After S302, in S303, the torso detection unit 203 detects a torso from the captured image, and the process proceeds to S304. In S304, the person detection unit 141 combines the detection results obtained in S301, S302, and S303 to obtain a person detection result. Information on the person detection result is sent to the camera control unit 131. Note that if no detection result is obtained in any of the detections in S301, S302, and S303, information on an empty person detection result is sent to the camera control unit 131. After S304, the process proceeds to S305.

[0032] In S305, the associated region setting unit 151 sets an associated region for each detected subject included in the person detection result. The associated region setting process will be described in detail later. Next, in S306, the search region setting unit 150 sets a search region based on the AF fixed frame displayed on the image display unit 171. The position and range of the AF fixed frame are determined by settings made by the user. The display frame setting unit 152 notifies the image display unit 171 of the AF fixed frame, and the image display unit 171 displays the AF fixed frame superimposed on the captured image.

[0033] In S307, the AF target setting unit 153 sets the AF target area. Details of the AF target area setting process will be described later. Thereafter, in S308, the display frame setting unit 152 notifies the image display unit 171 of the AF target area information.

[0034] 3 (associated region setting process) will be described in detail with reference to Fig. 4. In S401, the associated region setting unit 151 determines whether or not the person detection results include a head detection result. If it is determined that a head detection result exists, the process proceeds to S402, and if it is determined that a head detection result does not exist, the associated region setting process ends.

[0035] In S402, the associated region setting unit 151 determines whether or not the person detection result includes an iris detection result. If it is determined that an iris detection result exists, the process proceeds to S403, and if it is determined that an iris detection result does not exist, the process proceeds to S404.

[0036] In S403, the associated region setting unit 151 sets the head detection region as the associated region of the pupil detection result, and proceeds to processing in S404. In S404, the associated region setting unit 151 determines whether or not the person detection result includes a torso detection result. If it is determined that a torso detection result exists, the process proceeds to processing in S405, and if it is determined that a torso detection result does not exist, the associated region setting process ends.

[0037] In S405, the associated region setting unit 151 sets the torso detection region as the associated region of the head detection result, and proceeds to processing in S406. In S406, the associated region setting unit 151 determines whether or not the person detection result includes an eye detection result. If it is determined that an eye detection result exists, the process proceeds to processing in S407, and if it is determined that an eye detection result does not exist, the associated region setting process ends. Note that the person detection unit 141 may retain information indicating the determination result in S402, and use this information in the subsequent processing in S406.

[0038] In S407, the associated region setting unit 151 adds the body detection region to the associated region of the pupil, and ends the associated region setting process.

[0039] 3 (AF target area setting process) will be described in detail with reference to Fig. 5. In S501, the AF target setting unit 153 determines whether or not the person detection result includes an eye detection result. If it is determined that an eye detection result exists, the process proceeds to S502, and if it is determined that an eye detection result does not exist, the process proceeds to S503.

[0040] In S502, the AF target setting unit 153 sets the pupil as a detection target area (hereinafter also simply referred to as a detection target area) in the AF target area setting process, and proceeds to S505. In S503, the AF target setting unit 153 determines whether or not the person detection result includes a head detection result. If it is determined that a head detection result exists, the process proceeds to S504, and if it is determined that a head detection result does not exist, the process proceeds to S505.

[0041] In S504, the AF target setting unit 153 sets the head as the detection target area, and proceeds to the processing of S505. In S505, the AF target setting unit 153 acquires information about the search area set by the search area setting unit 150 in S306 of FIG.

[0042] In S506, the AF target setting unit 153 determines whether the search area and the detection target area overlap. If it is determined that the search area and the detection target area overlap, the process proceeds to S507, and if it is determined that the search area and the detection target area do not overlap, the process proceeds to S508. However, if the detection target area has not been set in the processes up to this point, it is determined that the search area and the detection target area do not overlap, and the process proceeds to S508.

[0043] In S507, the AF target setting unit 153 sets the detection target area as the AF target area, and ends the AF target area setting process. Furthermore, in S508, the AF target setting unit 153 determines whether the search area overlaps with a related area of ​​the detection target that has been set as the detection target area. If it is determined that the search area and the related area of ​​the detection target overlap, the process proceeds to S507, and if it is determined that they do not overlap, the process proceeds to S509. However, if a detection target area has not been set in the processes up to this point, or if a related area has not been set for the detection target, it is determined that the search area and the related area of ​​the detection target do not overlap, and the process proceeds to S509.

[0044] In S509, the AF target setting unit 153 sets the search area as the AF target area, and ends the AF target area setting process.

[0045] Display examples will be described with reference to Fig. 6. Fig. 6(A) is a schematic diagram showing a display screen example 600 when photographing the upper body of a person who is a subject. Fig. 6(B) is a schematic diagram showing a display screen example 610 when photographing the head of a person who is a subject.

[0046] In FIG. 6A, a display frame 601 is a frame (such as an AF frame or tracking frame) based on the subject search area. A body detection area 602 of the subject person is an associated area related to a head detection area 603 of the subject person. The body detection area 602 is indicated by a dotted line as a non-display area. The body detection area 602 is set as an associated area that does not include the head detection area 603. In this case, the display frame 601 and the head detection area 603 of the subject person do not overlap on the screen. Therefore, the process proceeds from S506 to S508 in FIG. 5. Because the display frame 601 and the body detection area 602 overlap on the screen, the process proceeds from S508 to S507 in FIG. 5. The head detection area 603 is set as the AF target area, and a frame corresponding to the head detection area 603 is displayed on the screen.

[0047] In FIG. 6(B), a display frame 611 is a frame (AF frame, tracking frame, etc.) based on the subject search area. A head detection area 612 of the subject person is a related area related to an eye detection area 613 of the subject person. The dotted line indicates that the head detection area 612 is a non-display area. In this case, the display frame 611 and the eye detection area 613 of the subject person do not overlap on the screen. Therefore, the process proceeds from S506 to S508 in FIG. 5. Because the display frame 611 and the head detection area 612 overlap on the screen, the process proceeds from S508 to S507 in FIG. 5. The eye detection area 613 is set as the AF target area, and a frame corresponding to the eye detection area 613 is displayed on the screen.

[0048] In conventional technology, when a portion of a subject is detected within a display frame, the detection target area cannot be selected as the AF target area unless the display frame and the detection target area overlap. For example, even if a portion of the subject is captured within the AF fixed frame, the subject cannot be selected as the AF target unless the subject detection frame is captured. In contrast, in this embodiment, a priority order (higher or lower) is set for each part (including the entire subject) of each detected subject. When an operation is performed to set any area as the AF target area, the AF target area is set to the subject part with the highest priority detected at that time. In other words, when a portion of a subject is detected within the display frame, if the display frame and a related area of ​​the detection target area overlap, the detection target area can be selected as the AF target area. In other words, it is possible to obtain the detection area of ​​the subject from an image, set its related area, and then determine whether the search area overlaps with the detection area or related area to set the target area for processing. This allows the user to easily specify the desired subject.

[0049] In this embodiment, when the detection target is the pupil or head, the torso region is set as the relevant region and used in the AF target region setting process. The torso region does not include the area above the neck, so it has a wider detection area than the pupil or head, and the subject moves more slowly than the pupil or head. Furthermore, because the torso region does not include the pupil or head, which are detection targets, the torso region is less affected even when the detection target is moving vigorously. This makes it easier for the user holding the imaging device to capture the subject within the AF fixed frame.

[0050] Furthermore, even if the subject has a small detection area size and tends to move quickly, such as the eyes or head, it can be selected as the AF target by moving the AF fixed frame closer to the torso. This addresses the issue of users finding it difficult to select the desired subject as the AF target. Furthermore, because parts of the same person are set as related areas, there is no interference with operation when the user wants to set a different area that is not a person as the AF target.

[0051] Furthermore, in the processing based on the algorithm described using Figures 3 to 5, the user moves the AF fixed frame closer to the subject and selects the AF target. After that, the user performs a process to confirm the AF target through further operation. When the AF target is confirmed, the subject to be the AF target is fixed (hereinafter, the subject that is the fixed AF target will also be referred to as the fixed AF target). Subjects other than the fixed AF target will no longer be selected as the AF target. The confirmation of the AF target continues until the user cancels it or the imaging device loses sight of the corresponding subject.

[0052] The AF target confirmation process is initiated by the user pressing the release switch 181 or performing a touch operation on the touch panel 172. The subject fixed as the AF target differs depending on which method is used to start the process. For example, when the AF target confirmation process is performed by pressing the release switch 181, a pre-set AF target area is confirmed as the fixed AF target. On the other hand, when the AF target confirmation process is performed by a touch operation on the touch panel 172, the fixed AF target is determined based on the coordinates specified by the touch operation. If the coordinates specified by the touch operation are within the detection target area or a related area of ​​the detection target, the detection target area is confirmed as the fixed AF target area. If the coordinates specified by the touch operation are not within the detection target area or a related area of ​​the detection target, an area with a similar saliency around the coordinates specified by the touch operation is confirmed as the fixed AF target area. Saliency is an index that indicates how similar the color, brightness, and depth of each pixel are. Depth is information that represents the depth direction of an image, and can be obtained using known methods from information such as the distribution of image shift amounts and defocus amounts for multiple images taken from different viewpoints, distance images, and distance maps. An exception to this rule is that when the detection target is a person's eye or face and the relevant area is the person's torso area, the coordinates specified by touch operation may be within the person's torso area. In this case, an area with a similar degree of salience around the touch position, rather than the detection target area, is determined as the fixed AF target area.

[0053] According to the embodiment, an associated area related to a detection target area of ​​a subject in a captured image is set, and if the area of ​​the AF fixed frame overlaps with the detection target area or its associated area, the detection target area can be set as the AF target area.

[0054] [Other embodiments] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications within the scope of the present invention are also included within the technical scope of the present invention. For example, the subject does not have to be a person, but may be an animal such as a dog or cat, or an inanimate object, and is not limited to a specific type.

[0055] In the above embodiment, an example was shown in which two regions, the head region and the torso region, are set as related regions for the pupil region, but the detection target and the related region do not have to correspond one-to-one. Also, there may be a detection target that does not have a related region, such as when there is no related region for the torso.

[0056] In the above embodiment, an example has been shown in which the detection results of parts of the same person are used as the related area for the detected subject. However, the detected subject and the related area may be different types of subjects. For example, a person and an accessory may be used. If the subject person is wearing an accessory, etc., and the search area overlaps with the detection area of ​​the accessory, etc., which is the related area, the detection area corresponding to the subject person can be set as the AF target area.

[0057] The use of detection results to set related regions as in the above embodiment is merely an example, and detection results may not be used. For example, related regions may be set to regions within a fixed range that are in a certain positional relationship with the detection target region, or regions acquired by calculating ranges with similar color information or depth information. Alternatively, related regions may be set to regions acquired by an algorithm trained to calculate related regions of the detection target by machine learning.

[0058] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0059] 122 Image sensor 124 Camera signal processing circuit 131 Camera control unit 141 Person detection unit 150 Search area setting section 151 Related Area Setting Section 152 Display frame setting section 153 AF target setting section 154 Focus detection unit 171 Image display unit

Claims

1. An image processing device that processes a captured image, a detection means for detecting a subject from the image and acquiring first and second detection areas; an associated region setting means for setting the first detection region as an associated region associated with the second detection region; a search area setting means for setting a search area relating to a subject in the image; a target setting means for setting an arbitrary region of the image as a target region for processing; When the search area overlaps with the second detection area or the related area, the target setting means sets the second detection area as the target area.

1. An image processing device comprising:

2. the related region setting means sets an area that does not include the second detection area as the related region; The target setting means performs a process of notifying the set target area.

2. The image processing device according to claim 1, wherein:

3. The target setting means sets the search area to the target area when the search area does not overlap with the second detection area and when the search area does not overlap with the related area.

3. The image processing device according to claim 1, wherein the image processing device is a computer.

4. the first detection area is an area corresponding to a first part of the subject, The second detection area is an area corresponding to a second part of the subject.

4. The image processing device according to claim 1, wherein the image processing device is a computer.

5. the detecting means detects first and second objects; the first detection area is an area corresponding to the first subject, The second detection area is an area corresponding to the second subject.

4. The image processing device according to claim 1, wherein the image processing device is a computer.

6. The target setting means does not notify the related area when the set target area has been notified.

3. The image processing device according to claim 2.

7. a display unit for displaying a display frame corresponding to the search area and a display frame corresponding to the target area; 7. The image processing device according to claim 1, wherein the image processing device is a computer.

8. An image processing device according to any one of claims 1 to 7; an imaging means for imaging a subject via an imaging optical system; and a display means for displaying the captured image. An imaging device characterized by:

9. The target setting means performs a process of notifying the determined target area as a target area for focus adjustment control of the imaging optical system by the display means.

9. The imaging device according to claim 8.

10. A designation means for designating a subject in an image is provided, The target setting means determines whether the position in the image designated by the designation means is within the target area or the related area, and determines the target area.

10. The imaging device according to claim 9.

11. A control method executed in an image processing device that processes a captured image, comprising: detecting a subject from the image and obtaining first and second detection areas; a related region setting step of setting the first detection region as a related region related to the second detection region; a search area setting step of setting a search area relating to a subject in the image; a target area setting step of setting an arbitrary area of ​​the image as a target area for processing, In the target region setting step, when the search region overlaps with the second detection region or the related region, a process of setting the second detection region as the target region is performed.

2. A method for controlling an image processing apparatus comprising:

12. The steps according to claim 11 are executed by a computer of an image processing device. A program characterized by:

Images