Image processing apparatus, method for controlling an image processing apparatus, storage medium, and computer program product

Abstract

The present disclosure relates to an image processing apparatus, a method for controlling an image processing apparatus, a storage medium, and a computer program product. In the image processing apparatus, range information indicating a range of amounts of defocus corresponding to a plurality of subject sites being subjected to image capturing is acquired; a plurality of image capturing conditions for capturing an image in which the plurality of subject sites are in focus are set based on the range information; and image capturing is performed a plurality of times based on the plurality of image capturing conditions.

Description

Technical Field

[0001] This disclosure relates to image processing apparatus, methods for controlling image processing apparatus, storage media, computer program products, etc. Background Technology

[0002] In related technologies, there are techniques for setting the focus position based on the amount of defocus on a portion of the subject. Japanese Patent Application Publication No. 2016-40578 discloses a technique for performing focus bracketing exposure image capture by providing multiple ranging points within the captured image and setting the focus position during image capture based on the defocus value at the ranging points.

[0003] In the configuration described in Japanese Patent Application Publication No. 2016-40578, if the focus position is set from the defocus amount corresponding to a point on the subject, then when the defocus amount depends on a partial change in the subject, image capture may be performed in a state where there is an out-of-focus part in that subject.

[0004] In this way, if image capture is performed while there are out-of-focus parts in the subject, it becomes difficult to capture images with multiple such subject parts in focus when multiple subject parts are the targets of image capture. Summary of the Invention

[0005] To address the aforementioned problems, the image processing apparatus of this disclosure acquires range information indicating the range of defocus amounts corresponding to multiple subject parts undergoing image capture; sets multiple image capture conditions for capturing an image based on the range information, focuses on the multiple subject parts in the image; and performs multiple image captures based on the multiple image capture conditions.

[0006] Further features of this disclosure will become clear from the following description of embodiments with reference to the accompanying drawings. Attached Figure Description

[0007] Figure 1 This is a diagram illustrating an example of the hardware configuration of an image capture device.

[0008] Figure 2 This is an explanatory diagram illustrating an example of the relationship between the defocus amount of the image capture optical system in an image capture device and the phase difference of the focus detection signal obtained from the image capture element.

[0009] Figure 3A This is a diagram illustrating an example of the relationship between an image capture device and a subject, and Figure 3B This is an example diagram showing the defocused range of a person's pupils, face, and torso.

[0010] Figure 4This is a diagram illustrating an example of the functional configuration of an image capture device.

[0011] Figure 5A This is a diagram showing an example configuration of all subject information, and Figure 5B This is a diagram illustrating an example of the configuration of the subject information.

[0012] Figure 6 This is a flowchart illustrating an example of the conditional image capture processing flow.

[0013] Figure 7 This is a flowchart illustrating an example of the process for handling condition settings.

[0014] Figure 8 This is a flowchart illustrating an example of the process for bracket exposure image capture.

[0015] Figure 9 This is a diagram showing an example of a captured image.

[0016] Figure 10 This is a diagram illustrating an example of the relationship between the subject and the image capture conditions set in the condition setting unit for encompassing exposure image capture.

[0017] Figure 11 This is a flowchart illustrating another example of the process for handling condition settings.

[0018] Figure 12 This is a flowchart illustrating another example of the process of enclosing the exposure image capture process.

[0019] Figure 13 This is another example of a diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit to surround the exposure image capture.

[0020] Figure 14 This is another example of a diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit to surround the exposure image capture.

[0021] Figure 15 This is a flowchart illustrating another example of the process for handling condition settings.

[0022] Figure 16 This is a flowchart illustrating another example of the process for handling condition settings.

[0023] Figure 17 This is a flowchart illustrating another example of the process for handling condition settings.

[0024] Figure 18 This is a flowchart illustrating an example of a change process.

[0025] Figure 19 This is a diagram illustrating an example of the relationship between the focus position set for an adult male and the focus position set for a child in a captured image.

[0026] Figure 20 This is an example image showing the settings screen.

[0027] Figure 21 This is a flowchart illustrating another example of the process for handling condition settings.

[0028] Figure 22 This is a flowchart illustrating another example of the process of enclosing the exposure image capture process.

[0029] Figure 23 This is a flowchart illustrating another example of the process for handling condition settings.

[0030] Figure 24 This is a flowchart illustrating another example of the process of enclosing the exposure image capture process.

[0031] Figure 25 This is another example of a diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit to surround the exposure image capture.

[0032] Figure 26 This is a flowchart illustrating another example of the conditional image capture processing flow.

[0033] Figure 27 This is a flowchart illustrating another example of the process for handling condition settings.

[0034] Figure 28 This is a flowchart illustrating another example of the process of enclosing the exposure image capture process.

[0035] Figure 29 This is another example of a diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit to surround the exposure image capture. Detailed Implementation

[0036] In the following description, advantageous modes of the present disclosure will be used with reference to the accompanying drawings. In each drawing, the same reference numerals are applied to the same components or elements, and repeated descriptions will be omitted or simplified.

[0037] <First Embodiment>

[0038] In the following description, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0039] Figure 1This diagram illustrates an example of the hardware configuration of the image capture device 10. The image capture device 10 of this embodiment performs image capture by estimating the defocus range of each part of the subject and setting the focus position based on the estimated defocus range. The defocus range is the range of the amount of defocus. It is assumed that the image capture device 10 of this embodiment is a mirrorless single-lens reflex camera.

[0040] Image capture device 10, as an example of an image processing device, includes a camera body 1000 and a lens unit 1100. The camera body 1000 and the lens unit 1100 are connected via a lens base mechanism 1015.

[0041] The camera body 1000 includes an image capture element 1001, a system control unit 1002, a shutter 1003, a ROM 1004, a RAM 1005, a memory 1006, a power switch 1007, a mode switching section 1008, a rear monitor 1009, and a touch panel 1010.

[0042] In addition, the camera body 1000 has a viewfinder display section 1011, an eyepiece 1012, and an eyepiece detection section 1013.

[0043] Image capturing element 1001 converts optical signals (optical images) into electrical signals. Examples of image capturing element 1001 include CMOS type imaging sensors.

[0044] The system control unit 1002 controls the camera body 1000. The system control unit 1002 performs image processing on the video signal generated by the image capture element 1001. Furthermore, the system control unit 1002 performs focus detection processing using a phase difference detection method based on the image used for focus detection (the signal used for phase difference AF).

[0045] More specifically, the system control unit 1002 generates a pair of image data formed by a beam of light passing through a pair of pupil regions of the image capture optics system as an image for focus detection. The system control unit 1002 detects the focus deviation based on the deviation between the pair of image data.

[0046] In this way, the system control unit 1002 performs phase difference AF (image capture plane phase difference AF) based on the output of the image capture element 1001 without using a dedicated AF sensor. The system control unit 1002 has a CPU.

[0047] ROM 1004 records the program used to control the operation of the camera body 1000, the machine learning model after learning, etc. RAM 1005 records variables required for the operation of the camera body 1000, various parameter and ISO sensitivity settings; preset thresholds for image selection; live view images acquired during control; image capture modes; various correction data; etc.

[0048] The memory 1006 is a removable flash memory that records captured images, accompanying information linked to the captured images, etc. The power switch 1007 toggles between the power-on and power-off modes of the camera body 1000. The mode switching section 1008 is a switch for toggling between various image capture modes, such as live view image capture and video image capture.

[0049] The rear monitor 1009 displays operational status information such as text, captured images, and audio, as well as image capture information of messages, in response to the execution of a program by the system control unit 1002. Examples of rear monitors 1009 include LCD devices and LEDs.

[0050] The touch panel 1010 is deployed in an area substantially equal to that of the rear monitor 1009, detects contact with a finger or pen, and notifies the system control unit 1002 of the contact position on the rear monitor 1009, thereby performing an operation or function associated with the contact position.

[0051] The viewfinder display section 1011, similar to the rear monitor 1009, displays image capture information in response to the execution of a program by the system control unit 1002, and together with the eyepiece 1012, constitutes an electronic viewfinder (EVF).

[0052] When an image capturer is detected approaching the eyepiece, the eyepiece detection unit 1013, via the system control unit 1002, causes the rear monitor 1009 or the viewfinder display unit 1011 to selectively display the aforementioned image capture information based on the detected eyepiece status.

[0053] The lens unit 1100 guides incident light to the image capturing element 1001. The lens unit 1100 is removable relative to the camera body 1000. The lens unit 1100 includes an image capturing lens 1101, an aperture 1102, a lens driving circuit 1103, an aperture control circuit 1104, and a lens control section 1105.

[0054] Light incident on the image capturing lens 1101 passes through the aperture 1102 and the shutter 1003 of the camera body 1000, and forms an image (optical image) in the image capturing element 1001. Figure 1Only one image capture lens 1101 is shown, but the lens unit 1100 can be provided with any number of image capture lenses 1101.

[0055] The lens control unit 1105 controls the entire lens unit 1100. The lens control unit 1105 includes a memory that stores various constants, variables, programs, etc., used for lens operation. Furthermore, the lens control unit 1105 includes a non-volatile memory that maintains information specific to the lens unit 1100, such as the maximum aperture value, minimum aperture value, and focal length.

[0056] The system control unit 1002 of the camera body 1000 calculates the defocus amount using the output information of the image capture element 1001. Furthermore, the system control unit 1002 performs communication via the lens control section 1105 of the lens unit 1100 based on the calculated defocus amount, and adjusts the focus by controlling the lens drive circuit 1103.

[0057] Next, the amount of defocus will be described. Figure 2 This is an explanatory diagram illustrating an example of the relationship between the defocus amount of the image capture optical system in the image capture device 10 and the phase difference (image deviation amount) of the focus detection signal obtained from the image capture element 1001.

[0058] Figure 2 The image capture plane 200 of the image capture element 1001, the subject 203, the subject 204, and the image forming position C of the light beam from the subject are shown. Furthermore, the exit pupil of the image capture optics system is divided into a first pupil region 201 and a second pupil region 202.

[0059] The defocus amount d is the distance from the image forming position C to the image capturing plane 200. Furthermore, when the image forming position C is in front-focus relative to the image capturing plane 200 on the subject side, the defocus amount is represented by a negative value (d<0).

[0060] Furthermore, in the back-focus state where the image forming position C is on the opposite side of the subject relative to the image capture plane 200, the amount of defocus is represented by a positive value (d>0). Conversely, in the focus state where the image forming position C is on the image capture plane 200, the amount of defocus d is zero.

[0061] Either the aforementioned foreground or background focus state (in other words, a state where the amount of defocus is not zero) will be referred to as a defocus state. Figure 2 In the example shown, the image capture optics is in focus relative to subject 203 and in front focus relative to subject 204.

[0062] In the front focus state, the light beams from the subject 204 that have passed through the first pupil region 201 (second pupil region 202) first converge, and then diffuse to a width Γ1 (Γ2) centered on the centroid position G1 (G2) of the light beam, forming a blurred image on the image capture plane 200.

[0063] This blurred image is received by each of the first focus detection pixels (second focus detection pixels) in the image capture element 1001, and a first focus detection signal (second focus detection signal) is generated. That is, the first focus detection signal (second focus detection signal) is a signal representing the subject image of the subject 204, which is blurred with a blur width Γ1 (Γ2) at the centroid position G1 (G2) of the beam on the image capture plane 200.

[0064] The blur width Γ1 (Γ2) of the subject image increases approximately proportionally to the increase in the absolute value of the defocus amount d. Similarly, the magnitude of the image deviation p (the difference between the centroid positions G1 and G2 of the beam) between the first and second focus detection signals also increases approximately proportionally to the increase in the absolute value of the defocus amount d.

[0065] Furthermore, in the back focus state, the direction of the image deviation between the first focus detection signal and the second focus detection signal is opposite to that in the front focus state. However, the relationship between the blur width Γ1 (Γ2) of the subject image and the defocus amount d, as well as the relationship between the image deviation amount p and the defocus amount d, are the same as those in the front focus state.

[0066] In this embodiment, the system control unit 1002 performs focus detection using a so-called image capture plane phase difference detection method, wherein the defocus amount d is calculated from the aforementioned image deviation amount p.

[0067] For this reason, the system control unit 1002 converts the image deviation p into the defocus amount d from the relationship between the defocus amount d and the image deviation amount p of the image capture signal using a conversion coefficient calculated based on the reference line length.

[0068] Furthermore, in this embodiment, the product of the aperture F-value and the diameter δ of the permitted circle of confusion in the image capture optical system during image capture [Fδ] is used as the unit of defocusing.

[0069] Next, the defocus range will be described. Figure 3A This is a diagram illustrating an example of the relationship between the image capture device 10 and the subject 301. Figure 3A The horizontal direction corresponds to the depth direction relative to camera 100. For this reason, Figure 3A The horizontal direction in the text can be simply referred to as the depth direction in the following text.

[0070] Figure 3A The pupil 302, face 303, and torso 304, which are parts of the person 301, are shown. The pupil 302, face 303, and torso 304 are all parts with a range in the depth direction.

[0071] also, Figure 3A The focus position 305 of the image capture device 10 is shown. In the example shown, the focus position 305 corresponds to the pupil 302 of the person 301.

[0072] Figure 3B This is a diagram showing an example of the defocus range of the pupil 302, face 303, and torso 304 of a person 301. Figure 3B In Chinese, "focus position" means Figure 3A The focus position 305 shown is "closer" to the image capture device 10 than the "focus position", and "farther" to the opposite side of the image capture device 10 relative to the "focus position".

[0073] In addition, Figure 3B In the diagram, the horizontal axis relative to the "focus position" indicates the amount of defocus, and the length of the arrow extending in the horizontal direction indicates the range of defocus.

[0074] In the depth direction, the closest part of the torso 304 is the tip of the nose of the person 301, and the furthest part of the torso 304 is the shoulder of the person 301. For this reason, the maximum amount of defocus in the torso 304 is the amount of defocus in the tip of the nose of the person 301, and the minimum amount of defocus in the torso 304 is the amount of defocus in the shoulder of the person 301.

[0075] In addition, in this case, the range of defocus from the tip of the nose of person 301 to the shoulder of person 301 is the defocus range of the torso 304 of person 301.

[0076] Figure 3B Not only is the defocus range of the torso 304 shown, but also the defocus range of the pupil 302 and the face 303. Here, the face 303 has a smaller defocus range than the torso 304.

[0077] Furthermore, the defocus range of the face 303 is smaller than that of the torso 304 by an amount corresponding to a smaller range in the depth direction. Additionally, the pupil 302 has a smaller defocus range than the face 303.

[0078] The portion of the subject from which the defocused area is identified is not limited to the portions mentioned above. Furthermore, the subject from which the defocused area is identified is not limited to people.

[0079] Figure 4This is a diagram illustrating an example of the functional configuration of the image capture device 10. (See diagram for example.) Figure 4 As shown, the image capture device 10 includes a range estimation unit 401, an image capture judgment unit 402, a condition setting unit 403, and an image capture unit 404.

[0080] As an example of an acquisition component, the range estimation unit 401 estimates the defocus range of the subject based on the captured image recorded in the memory 1006. For this reason, the range estimation unit 401 can also be regarded as an estimation component for estimating the range of defocus amount.

[0081] The range estimation unit 401 transmits information indicating the estimated defocus range to the condition setting unit 403. The information indicating the defocus range estimated by the range estimation unit 401 may be referred to as range information below.

[0082] As an example of a decision-making component, the image capture decision unit 402 determines whether to use the image capture device 10 to perform bracketing exposure image capture based on the range information generated by the range estimation unit 401.

[0083] As an example of a setting component, the condition setting unit 403 sets the image capture conditions of the image capture device 10 based on information indicating the defocus range obtained from the range estimation unit 401. The condition setting unit 403 transmits information indicating the set image capture conditions to the image capture unit 404. The information indicating the image capture conditions set by the condition setting unit 403 may be referred to hereinafter as image capture condition information.

[0084] Image capture unit 404, as an example of an image capture component, performs image capture based on image capture condition information obtained from condition setting unit 403. For example, range estimation unit 401, image capture determination unit 402, and condition setting unit 403 are implemented by system control unit 1002.

[0085] Figure 5A This is a diagram illustrating an example configuration of All Subject Information 8000. All Subject Information 8000 is information about all subjects appearing in the captured image. All Subject Information 8000 includes subject information.

[0086] exist Figure 5A In the example shown, since the number of subjects appearing in the captured image is N, all subject information 8000 includes N subject information from subject information 8001 to subject information 800N.

[0087] Figure 5B It is shown Figure 5AThe diagram shows an example configuration of the subject information 800n. The subject information 800n indicates the subject ID 800n1, the subject type 800n2, and the part information 800n3.

[0088] Subject ID 800n1 indicates information identifying the subject. Subject Type 800n2 indicates the type of subject. Part Information 800n3 indicates information related to the part of the subject.

[0089] Subject information 800n is provided for each part of the subject that is the target of range information. Each piece of part information 800n3 indicates part ID 800nz1, part type 800nz2, and range information 800nz3.

[0090] The target location indicated in the location information 800n3 may be referred to as the target location hereinafter. The target location may also be considered as the target location whose defocus range is estimated by the range estimation unit 401.

[0091] Location ID 800nz1 indicates information identifying the target location. Location Type 800nz2 indicates the type of the target location. Range Information 800nz3 indicates information derived from the range estimation unit 401 (reference). Figure 4 The range information of the target area generated.

[0092] In the example shown, in the range information 800nz3, the amount of defocus in the closest portion of the target area is indicated as the minimum value Dmin, and the amount of defocus in the farthest portion of the target area is indicated as the maximum value Dmax. Furthermore, this range from the minimum value Dmin to the maximum value Dmax is indicated as the defocus range D.

[0093] The amount of defocus on each part of the subject varies depending on the focus point. For this reason, the range information 800nz3 may include information indicating the focus point.

[0094] Furthermore, instead of information indicating the focus position, range information 800nz3 can include information indicating the image formation position. By doing so, it identifies the positions corresponding to the portions where the defocus amount is at its minimum (Dmin) and the portions where the defocus amount is at its maximum (Dmax).

[0095] Figure 6 This is a flowchart illustrating an example of the conditional image capture process. Conditional image capture processing is the process in which the image capture device 10 performs image capture based on image capture conditions set based on range information. In this embodiment, conditional image capture processing begins when the camera body 1000 is powered on and the image capture device 10 is started.

[0096] Image capture unit 404 acquires captured images through image capture (step (hereinafter referred to as "S") 101). Examples of captured images acquired in step 101 include live view images. Furthermore, the acquired captured images are recorded in memory 1006.

[0097] The range estimation unit 401 inputs the captured image, which has been captured by the image capture device 10 and recorded in the memory 1006, into the defocus range estimation model recorded in the ROM 1004. In addition, the range estimation unit 401 estimates the defocus range of each part of the subject appearing in the captured image by obtaining the output from the defocus range estimation model, thereby generating range information of each part of the subject (S102).

[0098] The range estimation unit 401 transmits each range information indicating the defocus range of each part to the condition setting unit 403.

[0099] Here, the defocus range estimation model is obtained through machine learning. In this embodiment, deep learning, which utilizes neural networks to generate feature quantities and joint weighting coefficients for learning, is used as the specific algorithm for machine learning.

[0100] This section describes machine learning using neural networks. Machine learning is performed using images and learning data as input, including the correct defocus range and the correct labels for the subject and parts.

[0101] Furthermore, in machine learning, error detection and weight update processes are performed. In error detection, the error between the output data from the output layer of the neural network in response to the input data fed into the input layer and the teacher's data is obtained.

[0102] In this context, information indicating the correct defocus range is used as teacher data. Furthermore, in error detection processing, a loss function can be used to calculate the error between the output data from the neural network and the teacher data.

[0103] In the weight update process, based on the error obtained in the error detection process, the joint weighting coefficients between nodes in the neural network are updated to reduce the error.

[0104] In this weight update process, for example, the joint weighting coefficients are updated using the error backpropagation method. The error backpropagation method is a technique that adjusts the joint weighting coefficients between nodes in each neural network to reduce the aforementioned error.

[0105] The defocus range estimation model is not limited to the aforementioned example and can use any machine learning model. Furthermore, instead of using machine learning models, the range estimation unit 401 can calculate the defocus range using known image processing methods.

[0106] The image capture determination unit 402 determines whether to use the image capture device 10 to perform bracketing exposure image capture based on the range information generated in step 102 (S103).

[0107] The image capture determination unit 402 focuses on the defocus amount of the part of the subject closest to the image capture device 10 and the defocus amount of the part of the subject furthest from the image capture device 10, which are identified from each generated range information.

[0108] Furthermore, when the position of the larger absolute value of the two defocus amounts of interest is the focus position, the image capture determination unit 402 determines whether the position of the image capture lens 1101 corresponding to this focus position is included within the focus range of the image capture lens 1101.

[0109] When the position of the image capture lens 1101 corresponding to the focus position is included within the focus range of the image capture lens 1101, the image capture determination unit 402 determines that the image capture device 10 should be used to perform bracketing exposure image capture.

[0110] Furthermore, when the position of the image capture lens 1101 corresponding to the focus position is not included in the focus range of the image capture lens 1101, the image capture determination unit 402 determines that the bracketing exposure image capture will not be performed using the image capture device 10.

[0111] When the image capture determination unit 402 determines that the bracketing exposure image capture will not be performed using the image capture device 10 ("No" in S103), the conditional image capture process ends.

[0112] Furthermore, when the image capture determination unit 402 determines that the image capture device 10 should be used to perform bracketing exposure image capture ("Yes" in S103), the condition setting unit 403 performs condition setting processing based on the range information of each part of the subject generated in step 101 (S104).

[0113] As will be described in detail below, the condition setting process is the process in which the condition setting unit 403 sets the conditions for bracketed exposure image capture of the image capture device 10. The condition setting unit 403 transmits image capture condition information indicating the set image capture conditions to the image capture unit 404.

[0114] Image capture unit 404 performs bracketing exposure image capture processing (S105) based on the image capture condition information generated in step 104. As will be described in detail below, bracketing exposure image capture processing is the process in which image capture unit 404 performs bracketing exposure image capture based on image capture condition information.

[0115] The system control unit 1002 causes the rear monitor 1009 to display an image showing the movement of the subject during the bracketing exposure image capture (S106).

[0116] The system control unit 1002 determines in S106 whether a part of the subject that was the focus position during bracketing exposure image capture in the image displayed by the rear monitor 1009 has been selected in the touch panel 1010 (S107). If the result is negative ("No" in S107), the process in step 107 is repeated.

[0117] Furthermore, when a part of the subject that has been selected as the focus position during bracketing exposure image capture is selected ("Yes" in S107), the process proceeds to the next step. The system control unit 1002 causes the rear monitor 1009 to display an image of the selected part in step 107 in the captured image generated during bracketing exposure image capture (S108).

[0118] Figure 7 This shows the condition setting process (see reference). Figure 6 The flowchart of an example of the process (S104) is shown below. The condition setting unit 403 determines whether the time interval between the end of one image capture process and the start of the next image capture is selected during the bracketing exposure image capture to be performed (S201).

[0119] In this embodiment, image capture is performed at user-selected time intervals during bracketing exposure image capture. The time interval selected in step 201 may be referred to below as the bracketing exposure interval.

[0120] The image capture device 10 receives the selection of the bracketing exposure interval via user operation of the touch panel 1010, etc. Furthermore, if the negative result continues in step 201 ("No" in S201), the processing in step 201 is repeated.

[0121] Furthermore, when a time interval is selected during bracketed exposure image capture ("Yes" in S201), the process proceeds to the next step. The range estimation unit 401 estimates the range that occurs during the conditional image capture process (see reference). Figure 6 In step 101, the defocus range of each part of the subject in the captured image is obtained, thereby generating range information of each part of the subject (S202).

[0122] The processing in step 202 is the same as that in step 102 of the conditional image capture processing. For this reason, when the defocus range has already been estimated in the conditional image capture processing, the processing in step 202 can be omitted in the conditional setting processing.

[0123] The condition setting unit 403 sets other image capture conditions for bracketing exposure image capture besides the time interval selected in step 201 (S203). Examples of other image capture conditions include the driving amount and position of the image capture lens 1101 under the bracketing exposure interval, the number of image captures, and the position of the image capture lens 1101 at the end of the bracketing exposure image capture.

[0124] For this reason, the condition setting unit 403 can also be regarded as a calculation unit for calculating the driving range of the image capture lens 1101 used to surround the exposure image capture. In addition, the number of image captures can also be regarded as the number of captured images.

[0125] Here, the condition setting unit 403 determines the driving amount of the image capture lens 1101 under the bounding exposure interval for each image capture process so as to focus on the target part of each subject.

[0126] Furthermore, when the focus position is set to the position of the target part of the subject that is closest to the image capture device 10 or even closer to it, the condition setting unit 403 sets the drive position of the image capture lens 1101 corresponding to this focus position within the drive range of the image capture lens 1101.

[0127] Furthermore, when the focus position is set to the position of the target part of the subject located at the farthest side relative to the image capture device 10, or even further away, the condition setting unit 403 sets the drive position of the image capture lens 1101 corresponding to this focus position within the drive range of the image capture lens 1101.

[0128] The driving position of the image capturing lens 1101 corresponding to the target part of the subject located on the closest side relative to the image capturing device 10 may be referred to below as the corresponding position of the closer part.

[0129] Furthermore, when the focus position is set to the position of the target part of the subject that is closest to the image capture device 10 or even closer to it, the drive position of the image capture lens 1101 corresponding to this focus position may be referred to as the margin position of the closer side below.

[0130] Furthermore, the driving position of the image capturing lens 1101 corresponding to the target part of the subject located at the farthest side relative to the image capturing device 10 may be referred to below as the corresponding position of the more distant part.

[0131] Furthermore, when the focus position is set to the position of the target part of the subject located at the farthest side relative to the image capture device 10, or even further away, the drive position of the image capture lens 1101 corresponding to this focus position may be referred to as the farthest edge position below.

[0132] The condition setting unit 403 identifies the driving amount of the image capturing lens 1101 under the bracketing exposure interval. The driving amount of the image capturing lens 1101 under the bracketing exposure interval may be referred to as the interval driving amount below.

[0133] Furthermore, the condition setting unit 403 sets a position that is closer to the corresponding position of the proximal portion by an advance interval drive amount, or even a position closer to the proximal portion, as a proximal edge position. Additionally, the condition setting unit 403 sets a position that is farther from the corresponding position of the distal portion by an advance interval drive amount, or even a position farther from the distal portion, as a distal edge position.

[0134] Therefore, even if errors occur in the estimated defocus range and the drive of the image capturing lens 1101, it becomes easier to acquire an image in which the target area is in focus.

[0135] The condition setting unit 403 sets each of the image capture conditions used to surround the exposure image capture based on the range information.

[0136] Figure 8 This illustrates the bracketed exposure image capture process (reference). Figure 6 The flowchart of an example of the process (S105 in the example).

[0137] The lens control section 1105 drives the image capturing lens 1101 to a closer edge position (S301).

[0138] The range estimation unit 401 estimates the defocus range of each part of the subject. Furthermore, the condition setting unit 403 adjusts the range of the enclosing exposure image capture based on the estimated defocus range (S302). More specifically, the image capture element 1001 performs image capture and generates an image with the image capture lens 1101 positioned at the closer edge.

[0139] The range estimation unit 401 estimates the defocus range of each part of the subject based on the generated image, thereby generating range information for each part of the subject. Additionally, the condition setting unit 403 adjusts the interval driving amount, etc., set as image capture conditions based on the latest range information.

[0140] Image capture unit 404 performs the first image capture in bracketed exposure image capture (S303).

[0141] When the first image capture ends, the lens control section 1105 drives the image capture lens 1101 toward a more distant side relative to the image capture device 10 by a driving interval amount that surrounds the exposure interval (S304). Therefore, the focus position in the next image capture is set to a position more distant relative to the image capture device 10 than in the first image capture.

[0142] Image capture unit 404 performs the next image capture (S305).

[0143] The lens control section 1105 determines whether the image capture lens 1101 has been driven to a more distant edge position (S306).

[0144] When the image capture lens 1101 has not yet been driven to the more distant edge position ("No" in S305), the process from step 304 is repeated. Therefore, the image capture lens 1101 is driven to the more distant edge position by the exposure interval and the image capture is repeated until the image capture lens 1101 is driven to the more distant edge position.

[0145] Furthermore, when the image capture lens 1101 is driven to a more distant edge position ("Yes" in S305), the bracketing exposure image capture process ends.

[0146] Next, a specific example of bracketed exposure image capture processing will be described. Figure 9 This is an example image showing a captured image. Furthermore, Figure 10 This is a diagram illustrating an example of the relationship between the subject and the image capture conditions set by the condition setting unit 403 for surrounding the exposure image capture. The following will describe the process of obtaining... Figure 9 The captured image shown is a bounding exposure image capture process performed during the capture process.

[0147] Figure 9 The captured images shown include an adult male 901, an adult female 902, a child 903, and a dog 904. Furthermore, it is assumed that... Figure 9 The captured image shown is captured with the face of an adult male 901 in focus, and the child 903, adult male 901, adult female 902 and dog 904 are positioned sequentially from the closer side relative to the image capture device 10.

[0148] Furthermore, when the face of the adult male 901 is in focus, the image capturing lens 1101 is located at position P0 corresponding to this focus position.

[0149] In this case, firstly, in the conditional image capture processing or conditional setting processing, the range estimation unit 401 estimates the defocus range (reference). Figure 6 S102 and Figure 7 (S202 in the example). In this example, as... Figure 10 As shown, it is assumed that the defocus range of the child 903's face is between "10" and "12".

[0150] Furthermore, assume that the defocus range of the face of the adult male 901 is from "-1" to "1". Also assume that the defocus range of the adult female 902 is from "-6" to "-4". Furthermore assume that the defocus range of the dog 904 is from "-7" to "-9".

[0151] Next, the condition setting unit 403 sets the image capture conditions for enclosing the exposure image capture (see reference). Figure 7 (S203 in the example). In this example, the condition setting unit 403 sets the interval drive amount to A1. In addition, the condition setting unit 403 sets the position of the closer edge to P1 and the position of the farther edge to P2.

[0152] Here, both the distance from the corresponding position P3 of the closer side to the edge position P1 and the distance from the corresponding position P4 of the farther side to the edge position P2 are greater than the interval driving amount A1. Furthermore, the condition setting unit 403 sets the number of image captures during bracketing exposure image capture to X times.

[0153] When image capture conditions are set, in bracketed exposure image capture processing (see reference) Figure 8 During this period, the lens control unit 1105 drives the image capturing lens 1101 from the position P0 corresponding to the face of the person 901 which has been in focus to the more nearby edge position P1 (S301).

[0154] Additionally, when the first image capture in bracketing exposure image capture is performed (S303), the image capture lens 1101 is driven by the bracketing exposure interval by the interval drive A1 (S304), and then the second image capture is performed (S305).

[0155] In this way, image capture is performed each time the image capture lens 1101 is driven by an interval drive A1 from the closer edge position P1 to the farther side with a bracketing exposure interval.

[0156] Therefore, image capture is performed with the face of the child 903 as the focus point, the face of the adult male 901 as the focus point, the face of the adult female 902 as the focus point, and the face of the dog 904 as the focus point. Additionally, when the image capture lens 1101 is driven to the more distant edge position P2 ("Yes" in S306), the bracketing exposure image capture process ends.

[0157] The driving amount of the image capture lens 1101 required during the period from the first image capture of the bracketing exposure image capture process until the end of the bracketing exposure image capture process is the distance from the closer edge position P1 to the farther edge position P2.

[0158] Here, when the driving amount of the image capture lens 1101 after the first image capture in bracketing exposure image capture reaches the distance from the closer edge position P1 to the farther edge position P2, the lens control unit 1105 can determine that the conditions for ending the bracketing exposure image capture process are met.

[0159] <Second Embodiment>

[0160] Next, the image capture device 10 of the second embodiment will be described. In the second embodiment, during bracketing exposure image capture, the image capture lens 1101 is driven such that each pre-set part of the subject is a focus position.

[0161] Regarding the image capture device 10 of the second embodiment, a configuration different from that of the first embodiment will be described, and descriptions of configurations identical to those in the first embodiment will be omitted.

[0162] Figure 11 This is a flowchart illustrating another example of the condition setting process in the second embodiment. Condition setting unit 403 acquires the conditional image capture process (see reference). Figure 6 In step 102, the range information of each part of the subject generated by the range estimation unit 401 is (S601).

[0163] The condition setting unit 403 determines a range information related to the part that has not yet been set to focus position from the range information obtained in step 601, and uses it as the range information of the part that is the target for setting the focus position (S602). The part that is determined to be the target for setting the focus position in step 602 may be referred to as the part that is the target for setting in the following text.

[0164] The condition setting unit 403 sets the focus position of the part that is the target of the setting based on the range information of the part that is the target of the setting (S603). More specifically, the condition setting unit 403 sets the focus position of the part that is the target of the setting to the position of the part with the minimum value of defocus and the position of the part with the maximum value of defocus identified from the range information of the part that is the target of the setting.

[0165] The condition setting unit 403 writes information about the amount of defocus at the set focus position into a database of defocus amounts stored in RAM 1005.

[0166] The condition setting unit 403 determines whether the focus position has been set for all parts that provide range information (S604).

[0167] If the focus position has not yet been set for all parts ("No" in S604), the process from step 602 is repeated. Therefore, the processes in steps 602 and 603 are performed for each part for which the focus position has not yet been set, until the focus position is set for all parts.

[0168] Furthermore, when the focus position has been set for all parts ("Yes" in S604), the condition setting process ends in response to the condition setting unit 403 transmitting information indicating the focus position of each part to the image capture unit 404. The information indicating the focus position may be referred to as focus position information below.

[0169] Figure 12 This is a flowchart illustrating another example of the enclosing exposure image capture process in the second embodiment.

[0170] The lens control unit 1105 drives the image capture lens 1101 to a position corresponding to the focus position set in the condition setting process relative to the closest side of the image capture device 10 (S701). The image capture unit 404 performs the first image capture in bracketed exposure image capture (S702).

[0171] The lens control unit 1105 drives the image capture lens 1101 to a position corresponding to the closest focus position to the image capture device 10 among the focus positions set in the condition setting process and not yet used during the bracketing exposure image capture being performed (S703).

[0172] Image capture unit 404 performs the next image capture (S704). Lens control section 1105 determines whether there are any focus positions that have not been used during the bracketing exposure image capture being performed, among the focus positions set in the condition setting process (S705).

[0173] If there is a focus position that has not been used during the ongoing bracketing exposure image capture ("No" in S705), the process from step 703 is repeated. Therefore, the image capture lens 1101 is repeatedly driven to the position corresponding to the focus position closest to the image capture device 10 among the unused focus positions, and image capture is performed until image capture is performed at all focus positions set in the condition setting process.

[0174] Furthermore, the bracketing image capture process ends when there is no focus position that has not been used during the bracketing image capture process being performed ("Yes" in S705).

[0175] Next, a specific example of the bracketing exposure image capture process in this embodiment will be described. Figure 13 This is another example of a diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit 403 for surrounding the exposure image capture.

[0176] The following text will describe the process of obtaining... Figure 9 The captured image shown is the result of bracketed exposure image capture processing. Furthermore, in this embodiment, it is assumed that the target areas are the subject's pupils, face, and torso.

[0177] First, in the conditional image capture processing, the range estimation unit 401 estimates the defocus range (reference). Figure 6 (S102 in the example). Figure 13 As shown, for child 903, the range of defocus of the pupil is estimated as “903B” to “903A”, the range of defocus of the face is estimated as “903C” to “903A”, and the range of defocus of the torso is estimated as “903D” to “903A”.

[0178] Furthermore, for adult males 901, the range of defocus of the pupil was estimated as “901B” to “901A”, the range of defocus of the face was estimated as “901C” to “901A”, and the range of defocus of the torso was estimated as “901D” to “901A”.

[0179] Furthermore, for adult females 902, the range of defocus of the pupil was estimated as “902B” to “902A”, the range of defocus of the face was estimated as “902C” to “902A”, and the range of defocus of the torso was estimated as “902D” to “902A”.

[0180] Furthermore, for dog 904, the defocus range of the pupil was estimated as “904B” to “904A”, the defocus range of the face was estimated as “904C” to “904A”, and the defocus range of the torso was estimated as “904D” to “904A”.

[0181] Next, the condition setting unit 403 sets the focus position for each image capture process and the position of the image capture lens 1101 corresponding to the focus position. Figure 11 S603 in the example is used as an image capture condition for enclosing the exposure image capture. In this example, the condition setting unit 403 sets the focus position of the pupil of the child 903 to the position of the portion with defocus amount 903A and the position of the portion with defocus amount 903B.

[0182] Furthermore, the condition setting unit 403 sets the focus position of the child 903's face to the position of the portion with a defocus amount of 903A and the portion with a defocus amount of 903C. Additionally, the condition setting unit 403 sets the focus position of the child 903's torso to the position of the portion with a defocus amount of 903A and the portion with a defocus amount of 903D.

[0183] Furthermore, the condition setting unit 403 sets the focus position of the pupil of the adult male 901 to the position of the portion with defocus amount 901A and the position of the portion with defocus amount 901B. Additionally, the condition setting unit 403 sets the focus position of the face of the adult male 901 to the position of the portion with defocus amount 901A and the position of the portion with defocus amount 901C.

[0184] In addition, the condition setting unit 403 sets the focus position of the torso of the adult male 901 to the position of the part with a defocus amount of 901A and the position of the part with a defocus amount of 901D.

[0185] Furthermore, the condition setting unit 403 sets the focus position of the pupil of the adult woman 902 to the position of the portion with defocus amount 902A and the portion with defocus amount 902B. Additionally, the condition setting unit 403 sets the focus position of the face of the adult woman 902 to the position of the portion with defocus amount 902A and the portion with defocus amount 902C.

[0186] In addition, the condition setting unit 403 sets the focus position of the torso of the adult female 902 to the position of the part with a defocus amount of 902A and the position of the part with a defocus amount of 902D.

[0187] Furthermore, the condition setting unit 403 sets the focus position of the dog 904's pupil to the position of the portion with a defocus amount of 904A and the portion with a defocus amount of 904B. Additionally, the condition setting unit 403 sets the focus position of the dog 904's face to the position of the portion with a defocus amount of 904A and the portion with a defocus amount of 904C.

[0188] Furthermore, the condition setting unit 403 sets the focus position of the dog 904's torso to the position of the portion with defocus amount 904A and the portion with defocus amount 904D. Additionally, the condition setting unit 403 sets the position of the image capturing lens 1101 corresponding to each of the set focus positions to the position after the image capturing lens 1101 is driven.

[0189] Next, in the bracketed exposure image capture processing (reference) Figure 12 During this period, the lens control section 1105 drives the image capturing lens 1101 to the position corresponding to the portion with a defocus amount of 903A (S701).

[0190] Additionally, when the first image capture in bracketed exposure image capture is performed (S702), the image capture lens 1101 is driven to a position corresponding to the portion with a defocus amount of 903B (S703), and then the second image capture is performed (S704).

[0191] In this manner, focus positions are sequentially set from the target portion closest to the image capture device 10, and image capture is performed. Therefore, image capture is performed with the pupils, face, and torso of a child 903 as focus positions; with the pupils, face, and torso of an adult male 901 as focus positions; with the pupils, face, and torso of an adult female 902 as focus positions; and with the pupils, face, and torso of a dog 904 as focus positions.

[0192] In addition, for each target area, the portion of the defocus amount with the minimum value in the defocus range is captured as the focus position for image capture, and the portion of the defocus amount with the maximum value in the defocus range is captured as the focus position for image capture.

[0193] In the second embodiment, it has been described that the portion with the minimum defocus amount and the portion with the maximum defocus amount within the defocus range of the target area are set as focus positions, but this is not a limitation. Any position can be set as a focus position, as long as it is a portion corresponding to the defocus range of the target area.

[0194] Figure 14 This is another example diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit to surround the exposure image capture. For example, as... Figure 14 As shown, a predetermined number of k focus positions can be set at equal intervals within the defocus range of each target location.

[0195] In this case, when the defocusing amount is D, the x-th focus position Px in a target area is calculated from the following equation 1.

[0196] ... (Equation 1)

[0197] Here, position Pb is the location of the part of the target area where the defocusing amount is at its maximum. Furthermore, position Pk is the location of the part of the target area where the defocusing amount is at its minimum.

[0198] In this case, the position closest to the image capture device 10 in the target area is position Pb, and the position farthest from the image capture device 10 in the target area is position Pk. Furthermore, the defocus amount Dmin is the defocus amount with the minimum value in the target area.

[0199] In addition, the defocus amount Dmax is the defocus amount with the maximum value in the target area.

[0200] The number of focus positions k set for each target part can be set by the user.

[0201] Furthermore, positions Pa, which are closer to position Pb than the image capture device 10, and positions P1, which are farther from position Pk than the image capture device 10, can be set as focus positions. That is, positions different from the target area can be set as focus positions.

[0202] In this case, the interval between position Pb and position Pa, and the interval between position Pk and position Pl, can be set by the user to any interval, as long as it is within the range allowed by the configuration of the lens unit 1100.

[0203] (Modified Example 1)

[0204] Next, a modified example 1 of the second embodiment will be described. In this embodiment, it has been described that all target parts are set to focus positions, but this is not a limitation. For example, among the target parts, only the parts selected by the user can be set to focus positions. The parts selected by the user as targets to be set to focus positions may be referred to as selected parts below.

[0205] Figure 15 This is a flowchart illustrating another example of the process for modifying the condition settings in Example 1.

[0206] Condition setting unit 403 acquires the conditional image capture process (see reference). Figure 6 In step 102, the range information of each part of the subject generated by the range estimation unit 401 (S801). The processing in step 801... Figure 11 The process in step 601 of the condition setting process shown is the same.

[0207] The condition setting unit 403 determines the range information related to a selected part that has not yet been set to focus position from the range information obtained in step 801, and uses it as the range information of the part that is the target for setting the focus position (S802).

[0208] The condition setting unit 403 sets the focus position of the target part based on the range information of the target part (S803). The processing in step 803 is similar to... Figure 11 The process in step 603 of the condition setting process shown is the same.

[0209] The condition setting unit 403 determines whether the focus position has been set for all selected parts that provide range information (S804).

[0210] If the focus position has not yet been set for all selected parts ("No" in S804), the process from step 802 is repeated. Therefore, the processes in steps 802 and 803 are performed for each selected part for which the focus position has not yet been set, until the focus position is set for all selected parts.

[0211] Furthermore, when the focus position has been set for all selected parts ("Yes" in S804), the condition setting process ends in response to the condition setting unit 403 transmitting focus position information indicating the focus position of each selected part to the image capture unit 404.

[0212] This section will describe a specific example of modifying Example 1. It assumes that when the selected area is only the subject's face, the image will be captured... Figure 9 The captured image is shown. In this case, the condition setting unit 403 sets the focus position of the child 903's face to a defocus amount of 903A (reference). Figure 13 The location of the part with a defocus amount of 903C and the location of the part with a defocus amount of 903C.

[0213] Furthermore, the condition setting unit 403 sets the focus position of the face of the adult male 901 to the position of the portion with a defocus amount of 901A and the portion with a defocus amount of 901C. Similarly, the condition setting unit 403 sets the focus position of the face of the adult female 902 to the position of the portion with a defocus amount of 902A and the portion with a defocus amount of 902C.

[0214] In addition, the condition setting unit 403 sets the focus position of the face of the dog 904 to the position of the part with a defocus amount of 904A and the position of the part with a defocus amount of 904C.

[0215] The part of the subject to be focused is not limited to the part selected by the user. For example, the part to be focused can be preset for each type of subject. As an example, when the subject is a human, the pupil and torso can be set as the focus points, and when the subject is an animal other than a human, only the torso can be set as the focus point.

[0216] Furthermore, the part of the target to be used as the focus position can be set according to the image capture mode of the image capture device 10. As an example, when the image capture mode of the image capture device 10 is portrait mode, the face of the organism (subject) can be set as the focus position, and when the image capture mode of the image capture device 10 is motion mode, the torso of the organism (subject) can be set as the focus position.

[0217] In this case, the image capture mode can be set by the user or according to the condition of the subject included in the field of view. Furthermore, information indicating the part of the target to be focused can be stored in the ROM 1004 of the image capture device 10.

[0218] (Modified Example 2)

[0219] Next, a modified example 2 of the second embodiment will be described. In modified example 2, only the portion of the subject selected by the user that appears in the captured image can be set as the focus position. The subject selected by the user as the target for setting the focus position may be referred to as the selected subject below.

[0220] Figure 16 This is a flowchart illustrating another example of the process for modifying the condition settings in Example 2.

[0221] Condition setting unit 403 acquires the conditional image capture process (see reference). Figure 6 In step 102, the range information of each part of the subject generated by the range estimation unit 401 (S901). The processing in step 901 is related to... Figure 11 The process in step 601 of the condition setting process shown is the same.

[0222] The condition setting unit 403 determines the range information related to a part of a selected subject that has not yet been set to focus position from the range information obtained in step 901, and uses it as the range information of the part that is the target for setting the focus position (S902).

[0223] The condition setting unit 403 sets the focus position of the target part based on the range information of the target part (S903). The processing in step 903 is similar to... Figure 11The process in step 603 of the condition setting process shown is the same.

[0224] The condition setting unit 403 determines whether the focus position has been set for all parts of the subject selected with range information (S904).

[0225] If the focus position has not yet been set for all parts of the selected subject ("No" in S904), the process from step 902 is repeated. Therefore, the processes in steps 902 and 903 are performed for each part of the selected subject for which the focus position has not yet been set, until the focus position is set for all parts of the selected subject.

[0226] Furthermore, when the focus position has been set for all parts of the selected subject ("Yes" in S904), the condition setting process ends in response to the condition setting unit 403 transmitting focus position information indicating the focus position of each part of the selected subject to the image capture unit 404.

[0227] This section will describe a specific example of modifying Example 2. It assumes that the image is captured when the selected subject is only a human. Figure 9 The captured image shown.

[0228] In this case, the condition setting unit 403 sets the focus position of the child 903's pupil to a defocus amount of 903A (reference). Figure 13 The location of the part with a defocus amount of 903B and the location of the part with a defocus amount of 903B.

[0229] Furthermore, the condition setting unit 403 sets the focus position of the child 903's face to the position of the portion with a defocus amount of 903A and the portion with a defocus amount of 903C. Additionally, the condition setting unit 403 sets the focus position of the child 903's torso to the position of the portion with a defocus amount of 903A and the portion with a defocus amount of 903D.

[0230] Furthermore, the condition setting unit 403 sets the focus position of the pupil of the adult male 901 to the position of the portion with defocus amount 901A and the position of the portion with defocus amount 901B. Additionally, the condition setting unit 403 sets the focus position of the face of the adult male 901 to the position of the portion with defocus amount 901A and the position of the portion with defocus amount 901C.

[0231] In addition, the condition setting unit 403 sets the focus position of the torso of the adult male 901 to the position of the part with a defocus amount of 901A and the position of the part with a defocus amount of 901D.

[0232] Furthermore, the condition setting unit 403 sets the focus position of the pupil of the adult woman 902 to the position of the portion with defocus amount 902A and the portion with defocus amount 902B. Additionally, the condition setting unit 403 sets the focus position of the face of the adult woman 902 to the position of the portion with defocus amount 902A and the portion with defocus amount 902C.

[0233] Furthermore, the condition setting unit 403 sets the focus position of the torso of the adult female 902 to the position of the portion with a defocus amount of 902A and the portion with a defocus amount of 902D. However, no focus position is set for the dog 904.

[0234] The subject that can be used as the focus point is not limited to subjects selected by the user. For example, the subject to be used as the focus point can be preset. As an example, a human can be set as the subject to be used as the focus point, and other organisms can be set as the focus point without human beings.

[0235] Furthermore, the subject to be used as the focus point can be set according to the image capture mode of the image capture device 10. For example, when the image capture mode of the image capture device 10 is portrait mode or sports mode, a human can be set as the focus point, and when the image capture mode of the image capture device 10 is dog mode, a dog can be set as the focus point.

[0236] In this case, the image capture mode can be set by the user or according to the condition of the subject included in the field of view. Furthermore, information indicating the subject to be focused can be stored in the ROM 1004 of the image capture device 10.

[0237] Furthermore, modified example 1 and modified example 2 of the second embodiment can be combined. That is, the subject to be the focus point and the part of the subject to be the focus point can be set by the user or can be preset.

[0238] (Modified Example 3)

[0239] Next, a modified example 3 of the second embodiment will be described. Figure 17 This is a flowchart illustrating another example of the process for modifying the condition settings in Example 3.

[0240] Figure 17 The processing in steps 1001 to 1004 of the condition setting process shown is similar to... Figure 11 The processes in steps 601 to 604 of the condition setting process shown are the same. However, the focus position can be set using any of the techniques described above.

[0241] When the focus position of all parts is set ("Yes" in S604), the condition setting unit 403 determines whether the distance between all focus positions is equal to or greater than the change threshold (S1005). The distance between focus positions is the distance between adjacent focus positions among the set focus positions.

[0242] Furthermore, the change threshold is a threshold used by the condition setting unit 403 to determine whether to change the set focus position. In this embodiment, the distance between the focus position and the shortest distance that can be driven by the configuration constraints of the image capture lens 1101 is set as the change threshold.

[0243] When the distance between all focus positions is equal to or greater than the change threshold ("Yes" in S1005), the condition setting process ends without changing the focus position. Furthermore, when there are two focus positions whose interval is less than the change threshold ("No" in S1005), the change process is executed (S1006).

[0244] Figure 18 This shows the change process (reference). Figure 17 The flowchart of an example of the process (S1006) is shown. The change process is the process in which the condition setting unit 403 changes the focus position. Furthermore, Figure 19 It is shown in Figure 9 This is a diagram illustrating an example of the relationship between the focus position set for an adult male 901 and the focus position set for a child 903 in the captured image shown. In the following text, in Figure 19 In the example shown, it is assumed that a change process is performed.

[0245] exist Figure 19 In the example shown, for child 903, positions 903A, 903B, 903C, and 903D are set as focus positions. Here, position 903A is the position where the amount of defocus in the pupil has the maximum value.

[0246] Furthermore, position 903A is the location of the portion of the face where the amount of defocus is at its maximum. Additionally, position 903A is the location of the portion of the torso where the amount of defocus is at its maximum. Furthermore, position 903B is the location of the portion of the pupil where the amount of defocus is at its minimum.

[0247] Furthermore, position 903C is the location of the portion of the face with the minimum amount of defocus. Additionally, position 903D is the location of the portion of the torso with the minimum amount of defocus.

[0248] In addition, Figure 19In the example shown, for an adult male 901, positions 901A, 901B, 901C, and 901D are set as focus positions. Here, position 901A is the location where the amount of defocus in the pupil has the maximum value.

[0249] Furthermore, position 901A is the location of the portion of the face where the amount of defocus is at its maximum. Additionally, position 901A is the location of the portion of the torso where the amount of defocus is at its maximum. Furthermore, position 901B is the location of the portion of the pupil where the amount of defocus is at its minimum.

[0250] Furthermore, position 901C is the location of the portion of the face with the minimum amount of defocus. Furthermore, position 901D is the location of the portion of the torso with the minimum amount of defocus. Furthermore, in Figure 19 In the example shown, it is assumed that the interval between position 903D and position 901A is less than the change threshold.

[0251] In changing the process (reference) Figure 18 In the condition setting unit 403, attention is paid to a pair of focus positions whose interval is less than the change threshold (S1101). Figure 19 In the example shown, the condition setting unit 403 focuses on a pair of focus positions consisting of position 903D and position 901A.

[0252] The condition setting unit 403 determines whether the focus position that is closer to the image capture device 10 in a pair of focus positions of interest can be changed to a position that is even closer to the image capture device 10 (S1102).

[0253] More specifically, consider the case where the condition setting unit 403 changes the focus position of the pair of focus positions closer to the image capture device 10 to a position even closer to it, such that the interval between the focus positions of interest becomes equal to or greater than the change threshold.

[0254] Additionally, in this case, the determination in step 1102 depends on whether a pair of focus positions with an interval smaller than the changed threshold has been newly formed. Figure 19 In the example shown, consider the case where the condition setting unit 403 changes position 903D to position 903DA, which is even closer to the side of the image capture device 10, such that the interval between position 901A and position 903D becomes equal to or greater than the change threshold.

[0255] In addition, in this case, when the interval between position 903DA and position 903C is equal to or greater than the change threshold, a positive result is obtained in step 1102, and when the interval between position 903DA and position 903C is less than the change threshold, a negative result is obtained in step 1102.

[0256] When the focus position relative to the image capture device 10 can be changed to a position that is even closer to it ("Yes" in S1102), the condition setting unit 403 changes the focus position relative to the image capture device 10 to a position that is even closer to it (S1103).

[0257] Furthermore, when the focus position relative to the image capture device 10 cannot be changed to a position that is even closer to it ("No" in S1102), the process proceeds to the next step. The condition setting unit 403 determines whether the focus position located farthest from the image capture device 10 in the pair of focus positions of interest can be changed to a position that is even further away from the image capture device 10 (S1104).

[0258] More specifically, consider the case where the condition setting unit 403 changes the focus position of the pair of focus positions that is farther away from the image capture device 10 to a position that is even farther away from it, such that the interval between the focus positions of interest becomes equal to or greater than the change threshold.

[0259] Additionally, in this case, the determination in step 1104 depends on whether a pair of focus positions with an interval smaller than the changed threshold has been newly formed. Figure 19 In the example shown, consider the case where the condition setting unit 403 changes position 901A to position 901AA, which is even further away from the image capture device 10, such that the interval between position 901A and position 903D becomes equal to or greater than the change threshold.

[0260] In addition, in this case, when the interval between position 901AA and position 901B is equal to or greater than the change threshold, a positive result is obtained in step 1104, and when the interval between position 901AA and position 901B is less than the change threshold, a negative result is obtained in step 1104.

[0261] When the focus position relative to the image capture device 10 can be changed to a position that is even further away from it ("Yes" in S1104), the condition setting unit 403 changes the focus position relative to the image capture device 10 to a position that is even further away from it (S1105).

[0262] Furthermore, when the focus position on the far side relative to the image capture device 10 cannot be changed to a position on the side that is even further away ("No" in S1104), the process proceeds to the next step. The condition setting unit 403 excludes the focus position that is closer to the image capture device 10 from the pair of focus positions of interest that are to be set during bracketing exposure image capture (S1106).

[0263] exist Figure 19 In the example shown, the condition setting unit 403 excludes position 903D from the targets of the focus position to be set during the bracketing exposure image capture.

[0264] After step 1103, step 1105 or step 1106, the process proceeds to the next step. The condition setting unit 403 determines whether there are two focus positions whose interval is less than the change threshold (S1107).

[0265] When there are two focus positions whose interval is less than the change threshold ("Yes" in S1107), the process from step 1101 is repeated. In this way, the process from steps 1101 to 1106 is repeated until there are no longer two focus positions whose interval is less than the change threshold.

[0266] Furthermore, when there are no two focus positions whose interval is less than the change threshold (in S1107, "No"), the change process ends.

[0267] The example above describes performing change processing on all focus positions whose intervals are less than the change threshold, but it is not limited to this.

[0268] For example, you can set subjects with priority focus positions and subjects without priority focus positions. Additionally, when the interval between the focus positions of the priority subjects and the non-priority subjects is less than a change threshold, the focus position of the non-priority subjects can be changed or excluded during the change process.

[0269] In addition, priority can be set for all focus positions, and the target focus positions to be changed or excluded can be determined based on the priority during the change process.

[0270] Furthermore, the presence or absence of a focus position and the priority order of focus positions can be preset by the image capture device 10, can be set by the user, or can be determined according to the image capture mode of the image capture device 10.

[0271] In this way, even when there are constraints on the driving of the image capturing lens 1101 due to the configuration limitations of the image capturing lens 1101, the image in which the user-desired part is focused is acquired because a change processing is performed.

[0272] Next, an example of a target selected by the user as the focus position, as described in the second embodiment, will be described.

[0273] Figure 20 This is a diagram illustrating an example of a settings screen 150. Settings screen 150 is a screen used to receive a user's selection of a target to be set as the focus position. For example, the system control unit 1002 of the image capture device 10 causes the rear monitor 1009 of the image capture device 10 to display settings screen 150.

[0274] The settings screen 150 shows the target settings image 151, the position settings image 154, the determination section 157, and the captured image 158.

[0275] The target setting image 151 receives the user's selection of the target to be set as the focus position. The target setting image 151 shows the subject setting section 152 and the part setting section 153.

[0276] The subject setting section 152 receives the user's selection of the type of target subject to be set as the focus position. In the example shown, in the subject setting section 152, human has been selected as the type of target subject to be set as the focus position.

[0277] The part setting section 153 receives the user's selection of the type of part of the target subject to be set as the focus position. In the example shown, the face has been selected as the type of part of the target subject to be set as the focus position in the part setting section 153.

[0278] Position setting image 154 is an image used to receive user settings for the method used to determine the focus position. Position setting image 154 shows position setting section 155 and mode setting section 156.

[0279] The position setting section 155 receives user settings for the method used to determine the focus position. In the example shown, in the position setting image 154, the positions of the parts of the target area with the maximum amount of defocus and the parts with the minimum amount of defocus are selected as the focus positions.

[0280] The mode setting section 156 receives the user's settings for the mode corresponding to the focus position. When the confirmation section 157 is selected, the details selected in the target setting image 151 and the position setting image 154 are set as image capture conditions for enclosing the exposure image capture.

[0281] Captured image 158 illustrates the conditional image capture processing (reference). Figure 6 The captured image obtained in step 101. In the example shown, Figure 9 The captured image shown is referred to as captured image 158.

[0282] Furthermore, captured image 158 displays a high-contrast image 159. High-contrast image 159 is an image with high contrast for a portion of the subject set to the focus position. In the example shown, in adult male 901 (reference...) Figure 9 In each of the faces of an adult woman 902, a child 903, and another child 903, a dashed box is displayed as a high-contrast image 159. Thus, the user can identify the human face as the focus point.

[0283] In this way, since the target of the focus position is set by the user via the settings screen 150, it becomes easier for the user to set the target of the focus position. In addition, it is easier for the user to recognize the result of the user's setting of the target of the focus position.

[0284] exist Figure 20 In the example shown, the target setting image 151, the position setting image 154, and the captured image 158 are depicted displayed on one screen, but this is not the only possibility. The target setting image 151, the position setting image 154, and the captured image 158 can be displayed on separate screens.

[0285] Furthermore, the target setting image 151, the location setting image 154, and the captured image 158 can be displayed not only by the image capture device 10, but also by a computer device used by the user, such as a PC or smartphone.

[0286] (Modified Example 4)

[0287] Next, a modified example 4 of the second embodiment will be described. Figure 21 This is a flowchart illustrating another example of the process for modifying the condition settings in Example 4.

[0288] The condition setting unit 403 determines whether a subject and a part of the subject have been selected as the target for setting the focus position (S1201). The subject and the part of the subject can be set using any of the techniques described above.

[0289] Furthermore, if the negative result continues ("No" in S1201), the processing in step 1201 is repeated.

[0290] Furthermore, when a target for the focus position setting is selected ("Yes" in S1201), the condition setting unit 403 initiates the conditional image capture process (see reference). Figure 6In step 101, the captured image is identified as the number of subjects that are the target set at the focus position (S1202).

[0291] The range estimation unit 401 estimates the defocus range of the part of the subject selected as the focus position from the captured image, thereby generating range information for each part of the subject (S1203).

[0292] The condition setting unit 403 sets the image capture conditions for surrounding the exposure image capture based on the defocus range estimated in step 1203 (S1204).

[0293] Examples of image capture conditions include focus position, bracketing exposure interval, the amount of drive of the image capture lens 1101 under the bracketing exposure interval and its position after drive, the number of image captures, and the position of the image capture lens 1101 at the end of the bracketing exposure image capture. Furthermore, the position of the region selected in step 1201 is set as the focus position.

[0294] Figure 22 This is a flowchart illustrating another example of the process for modifying the bracketing exposure image capture process in Example 4.

[0295] The lens control unit 1105 drives the image capture lens 1101 to a position corresponding to the focus position set in the condition setting process relative to the closest side of the image capture device 10 (S1301). The image capture unit 404 performs the first image capture in bracketing exposure image capture (S1302).

[0296] The lens control unit 1105 drives the image capture lens 1101 to a position corresponding to the closest focus position to the image capture device 10 among the focus positions set in the condition setting process and not yet used during the bracketing exposure image capture being performed (S1303).

[0297] The image capture unit 404 performs the next image capture (S1304).

[0298] The lens control unit 1105 determines whether the condition setting process has been completed (see reference). Figure 21 Image capture of the number of subjects identified in step 1202 (S1305).

[0299] If image capture of the number of subjects identified has not yet been completed ("No" in S1305), the process from step 1303 is repeated. Therefore, the image capture lens 1101 is repeatedly driven to a position corresponding to the focus position relative to the nearest side of the image capture device 10, and image capture is repeated until image capture of the number of subjects identified in the condition setting process is completed.

[0300] Furthermore, when the image capture of a number of subjects that have not yet been identified is completed ("Yes" in S1305), the bracketing exposure image capture process ends.

[0301] Next, a specific example of modifying the bracketed exposure image capture process in Example 4 will be described. The following text will describe the process of obtaining... Figure 9 The captured image shown is the result of bracketed exposure image capture processing. Furthermore, in the following text, it is assumed that the subject, set as the focus position in the condition setting process, is a human being, and the part of the subject set as the focus position is the pupil.

[0302] In this case, during bracketed exposure image capture processing (reference) Figure 22 During this period, the lens control section 1105 drives the image capturing lens 1101 to a position corresponding to the portion of the pupil of the child 903 (S1301).

[0303] Additionally, the first image capture in bracketing exposure image capture is performed with the focus position set to the portion of the pupil of the child 903 (S1302). Next, the image capture lens 1101 is driven to a position corresponding to the portion of the pupil of the adult male 901 (S1303), and then a second image capture is performed with the focus position set to the portion of the pupil of the adult male 901 (S1304).

[0304] In this manner, focus positions are sequentially set from the parts of the subject closest to the image capture device 10, which are the target subjects set as focus positions, and image capture is performed. Therefore, image capture is performed with the pupils of a child 903, an adult male 901, and an adult female 902 as focus positions. On the other hand, image capture is not performed with the dog 904 as the focus position.

[0305] <Third Embodiment>

[0306] Next, the image capture device 10 of the third embodiment will be described. In the third embodiment, during bracketing exposure image capture, the image capture lens 1101 is driven such that image capture is performed with a predetermined number of subjects in focus positions.

[0307] Regarding the image capture device 10 of the third embodiment, a configuration different from that of the first and second embodiments will be described, and descriptions of configurations identical to those in the first or second embodiments will be omitted.

[0308] Figure 23 This is a flowchart illustrating another example of the condition setting process in the third embodiment. The condition setting unit 403 determines whether the user has selected a bracketing exposure interval (S1401). If the result is negative ("No" in S1401), the process in step 1401 is repeated.

[0309] In addition, when the bracketing exposure interval is selected ("Yes" in S1401), the condition setting unit 403 determines whether the user has selected the number of subjects that are the target for setting the focus position (S1402).

[0310] In this embodiment, during bracketing exposure image capture, image capture is performed with a number of subjects selected by the user set to focus positions. Furthermore, if the negative result continues in step 1402 ("No" in S1402), the processing in step 1402 is repeated.

[0311] Furthermore, when the number of subjects selected as the focus position is chosen ("Yes" in S1402), the processing proceeds to the next step. The range estimation unit 401 estimates the range that appears in the conditional image capture process (see reference). Figure 6 In step 101, the defocus range of each part of the subject in the captured image is obtained, thereby generating range information of each part of the subject (S1403).

[0312] The condition setting unit 403 sets image capture conditions for enclosing the exposure image capture based on the estimated defocus range (S1404). Examples of image capture conditions include focus position, interval drive amount, position of the image capture lens 1101 after drive, position of the closer edge, position of the farther edge, number of image captures, and position of the image capture lens 1101 at the end of the enclosing exposure image capture.

[0313] In this embodiment, a focus position is set for the number of subjects selected in step 1402. Furthermore, the focus position set for the number of subjects selected in step 1402 may be referred to as the setting position below.

[0314] Figure 24 This illustrates the bracketing exposure image capture process in the third embodiment (see reference). Figure 6 The flowchart of another example of the process (S105 in the process).

[0315] The lens control section 1105 drives the image capturing lens 1101 to a closer edge position (S1501).

[0316] The range estimation unit 401 estimates the defocus range of each part of the subject. Furthermore, the condition setting unit 403 adjusts the range of the bracketed exposure image capture based on the estimated defocus range (S1502). The processing in step 1502... Figure 8 The process in step 302 of the bracketed exposure image capture process shown is the same.

[0317] Image capture unit 404 performs the first image capture in bracketing exposure image capture (S1503). When the first image capture ends, lens control unit 1105 sets the subject located closest to the subject that is set to focus position and is not set as the image capture target as the new image capture target (S1504).

[0318] The lens control section 1105 drives the image capture lens 1101 toward the more distant side by driving the interval drive amount in a way that surrounds the exposure interval (S1505).

[0319] The range estimation unit 401 estimates the defocus range of each part of the subject. Furthermore, the condition setting unit 403 adjusts the range of the bracketed exposure image capture based on the estimated defocus range (S1506). The processing in step 1506 is the same as the processing in step 1502. The image capture unit 404 performs the next image capture (S1507).

[0320] The lens control section 1105 determines whether the image capture lens 1101 has been driven to a position corresponding to the setting position of the image capture target subject (S1508).

[0321] If the image capture lens 1101 has not yet been driven to the position corresponding to the set position ("No" in S1508), the process from step 1505 is repeated.

[0322] Therefore, the image capture lens 1101 is driven further away by the bracketing exposure interval and the image capture is repeated until the image capture lens 1101 reaches the position corresponding to the setting position of the image capture target subject.

[0323] Furthermore, when the image capture lens 1101 has been driven to the position corresponding to the set position ("Yes" in S1508), the lens control section 1105 determines that the image capture of the target subject has been completed (S1509).

[0324] The lens control unit 1105 determines whether the condition setting process has been completed (see reference). Figure 23Step 1402: Image capture of the selected number of subjects (S1510).

[0325] If the number of subjects selected has not been captured ("No" in S1510), the process from step 1504 is repeated. Therefore, image capture is performed sequentially from the subjects located closer to the image capture device 10 until the number of subjects selected has been captured.

[0326] Furthermore, when the image capture of the selected number of subjects is completed ("Yes" in S1510), the bracketing exposure image capture process ends.

[0327] Next, a specific example of bracketed exposure image capture processing will be described. Figure 25 This is another example diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit 403 for surrounding the exposure image capture. In the following, the process of obtaining... Figure 9 The captured image shown is a bounding exposure image capture process performed during the capture process.

[0328] Furthermore, in the following text, it is assumed that the number of subjects selected by the user as the focus position setting in the conditional setting process is "3". Also, it is assumed that the defocus range estimated before the bracketing exposure image capture process begins is... Figure 10 The range shown in the example is the same as the range.

[0329] That is, before the bracketing exposure image capture process begins, the face of the adult male 901 is in focus. At this time, the image capture lens 1101 is located at position P0.

[0330] Condition setting unit 403 sets image capture conditions for bracketing exposure image capture during condition setting processing (see reference). Figure 23 (S1404 in the example). In this example, the condition setting unit 403 sets the interval drive amount to A2. Furthermore, the condition setting unit 403 sets the closer edge position to P5 and the farther edge position to position P6.

[0331] Furthermore, the condition setting unit 403 sets the number of image captures during the bracketing exposure image capture period to X times. Additionally, the condition setting unit 403 sets the position of the image capture lens 1101 corresponding to the focus position of the child 903 to position P7.

[0332] Furthermore, the condition setting unit 403 sets the position of the image capturing lens 1101 corresponding to the focus position of the adult male 901 to position P0. Additionally, the condition setting unit 403 sets the position of the image capturing lens 1101 corresponding to the focus position of the adult female 902 to position P8.

[0333] When image capture conditions are set, in bracketed exposure image capture processing (see reference) Figure 24 During this period, the lens control section 1105 drives the image capturing lens 1101 from position P0 to the closer edge position P5 (S1501).

[0334] Next, when the first image capture in bracketing exposure image capture is performed (S1503), the child 903 is set as the image capture target (S1504). In addition, the image capture lens 1101 is driven by the interval drive A2 by the bracketing exposure interval (S1505), and then the second image capture is performed (S1507).

[0335] Subsequently, the image capture lens 1101 is driven by the interval drive A2 (S1505) and the image is captured (S1507) repeatedly. When the image capture lens 1101 reaches position P7 ("Yes" in S1508), it is determined that the image capture of the child 903 has been completed (S1509).

[0336] In addition, since the image capture of the number of subjects selected by the user has not yet been completed ("No" in S1510), the adult male 901 is newly set as the image capture target (S1504), and the image capture lens 1101 is driven by the interval drive A2 repeatedly (S1505) and the image is captured (S1507).

[0337] Furthermore, after the image capture of the adult male 901 is completed, the adult female 902 is newly set as the image capture target (S1504), and the image capture lens 1101 is driven by the interval drive A2 (S1505) and the image capture is repeated (S1507).

[0338] Additionally, when the image capture lens 1101 reaches position P8 ("Yes" in S1508), it is determined that image capture of the adult woman 902 has been completed (S1509). Furthermore, since image capture of the number of subjects selected by the user has been completed ("Yes" in S1510), the bracketing exposure image capture process ends, and image capture is not performed when the dog 904 is in the focus position.

[0339] exist Figure 25 In the example shown, it has been described that the bracketing exposure image capture process ends when the image capture lens 1101 reaches position P8, but it is not limited to this. The condition for ending the bracketing exposure image capture process could be that the image capture lens 1101 reaches a more distant edge position P6.

[0340] <Fourth Embodiment>

[0341] Next, the image capture device 10 of the fourth embodiment will be described. In the fourth embodiment, during bracketing exposure image capture, the F-value (aperture value) in the image capture device 10 is adjusted so that image capture is performed with a pre-set part of the subject in focus.

[0342] Regarding the image capture device 10 of the fourth embodiment, a configuration different from that of the first to third embodiments will be described, and descriptions of configurations identical to those in any of the first to third embodiments will be omitted.

[0343] Figure 26 This is a flowchart illustrating another example of the conditional image capture processing flow in the fourth embodiment. Figure 26 The processing in steps 1601 and 1602 of the conditional image capture process shown is similar to... Figure 6 The processing in steps 101 and 102 of the conditional image capture process shown is the same.

[0344] The image capture determination unit 402 determines whether to use the image capture device 10 to perform bracketing exposure image capture based on the range information generated in step 1602 (S1603).

[0345] The image capture determination unit 402 focuses on the defocus amount of the part of the subject closest to the image capture device 10 and the defocus amount of the part of the subject furthest from the image capture device 10, which are identified from each generated range information.

[0346] Furthermore, when the location of the portion with the larger absolute value of the two defocus amounts of interest is the focus position, the image capture determination unit 402 determines whether this focus position is within the focus range of the image capture lens 1101 included in the depth of field.

[0347] When the focus position is within the focus range of the image capture lens 1101, which is included in the depth of field, the image capture determination unit 402 determines that bracketing exposure image capture using the image capture device 10 should be performed. Furthermore, when the focus position is not within the focus range of the image capture lens 1101, which is included in the depth of field, the image capture determination unit 402 determines that bracketing exposure image capture will not be performed using the image capture device 10.

[0348] The image capture determination unit 402 can determine whether to use the image capture device 10 to perform bracketing exposure image capture by identifying the F-value of the focus position of the target to be determined that is included in the depth of field and determining whether it is within the focus range of the image capture lens 1101 that can be adjusted to the identified F-value.

[0349] The condition setting unit 403 determines whether the user has selected multiple focus target areas on the subject (S1604). In this embodiment, bracketing exposure image capture is performed while the user is focusing on the selected areas on the subject.

[0350] In step 1604, the multiple parts that are the targets for judgment can be multiple parts of a single subject or individual parts of multiple subjects. Furthermore, if the negative result continues in step 1604 ("No" in S1604), the processing in step 1604 is repeated.

[0351] Furthermore, when multiple locations are selected ("Yes" in S1604), condition setting processing is performed (S1605). Details of the condition setting processing will be described below.

[0352] Next, bracketing exposure image capture processing is performed (S1606). Details of the bracketing exposure image capture processing will be described below. Furthermore, Figure 6 The processes in steps 1607 and 1608 shown are the same as those in steps 106 and 108 of the conditional image capture process.

[0353] Figure 27 This illustrates the condition setting process in the fourth embodiment (see reference). Figure 26 The flowchart of another example of the process (S1605 in the process).

[0354] The condition setting unit 403 determines whether a target part of the subject with an estimated defocus range has been selected (S1701). Similar to the selection of a target part of the subject that is set as the focus position, the target part of the subject with an estimated defocus range can be selected using any technique. Furthermore, if the negative result continues ("No" in S1701), the process in step 1701 is repeated.

[0355] When the target area for estimating the defocus range is selected ("Yes" in S1701), the condition setting unit 403 starts from the conditional image capture processing (reference). Figure 26 In step 1601, the number of subjects that are targets set at the focus position in the captured image is identified (S1702). Here, for example, the subjects that are targets set at the focus position can be limited to organisms, etc.

[0356] The range estimation unit 401 estimates the defocus range of the part of the subject selected as the defocus range estimation target from the captured image, thereby generating range information for each part of the subject (S1703).

[0357] The condition setting unit 403 sets the image capture conditions for surrounding the exposure image capture based on the estimated defocus range in step 1703 (S1704).

[0358] Examples of image capture conditions include focus position, position of image capture lens 1101 corresponding to focus position, bracketing exposure interval, depth of field range for each image capture process, F-value for each image capture process, number of image captures, and position of image capture lens 1101 at the end of bracketing exposure image capture. For this reason, condition setting unit 403 can also be considered as a calculation unit for calculating the depth of field range or F-value during bracketing exposure image capture.

[0359] Figure 28 This illustrates the bracketing exposure image capture process in the fourth embodiment (see reference). Figure 26 The flowchart is another example of the process in S1606.

[0360] The lens control section 1105 drives the image capture lens 1101 to a position corresponding to the focus position by setting a part of the subject that is the target of image capture during bracketing exposure image capture processing, which has a defocus range size corresponding to the median value, as the focus position (S1801).

[0361] The size of the defocused area to be judged can be the average of the maximum and minimum values ​​within the defocused area, or it can be the median value within the defocused area. Furthermore, the part with a defocused area size corresponding to the median value can be referred to as the central part in the following text.

[0362] Furthermore, at this time, the lens control unit 1105 adjusts the F-value so that the portion of the subject that is the target of image capture during the bracketing exposure image capture process, which differs from the central portion, is not included in the depth of field. The image capture unit 404 performs the first image capture (S1802).

[0363] The lens control section 1105 determines the part of the subject whose defocus range is closest to the center of the part that is not included in the depth of field as the target to be included in the depth of field (S1803).

[0364] The lens control unit 1105 adjusts the F-value so that the part of the subject identified as the target in step 1803 is included in the depth of field (S1804). That is, the lens control unit 1105 adjusts the F-value to make the image capture target part newly included in the depth of field without re-driving the image capture lens 1101.

[0365] Furthermore, in this case, the F-number required to include this part in the depth of field depends on the defocus range of the subject's part. The image capture unit 404 performs the next image capture (S1805).

[0366] The lens control section 1105 determines whether image capture of all image capture target areas has been performed on the subject (S1806).

[0367] If image capture of all areas is not performed ("No" in S1806), the process from step 1803 is repeated. Therefore, F-value adjustment and image capture are performed sequentially on areas with a defocus range closer to the center of the image capture target area until image capture of all image capture target areas is performed.

[0368] Furthermore, when image capture of all parts has been performed ("Yes" in S1806), the bracketing exposure image capture process ends.

[0369] Next, a specific example of bracketed exposure image capture processing will be described. Figure 29 This is another example diagram illustrating the relationship between the subject and the image capture conditions set by the condition setting unit 403 for surrounding the exposure image capture. In the following, the process of obtaining... Figure 9 The captured image shown is a bounding exposure image capture process performed during the capture process.

[0370] Furthermore, in the following text, it is assumed that the parts of the subject selected by the user as the focus target during condition setting processing are the face of an adult male 901, the face of an adult female 902, and the face of a child 903. Furthermore, it is assumed that the defocus range estimated before the bracketing exposure image capture process begins is... Figure 10 The range shown in the example is the same as the range.

[0371] In bracketing exposure image capture processing (reference) Figure 28 During this period, the lens control unit 1105 sets the face of the adult male 901 as the central part as the focus position and drives the image capture lens 1101 to the position P0 corresponding to this focus position (S1801).

[0372] In addition, the first (first) image capture is performed (S1802) with the F value adjusted so that the face of the adult male 901 is included in the depth of field and the face of the adult female 902 and the face of the child 903 are not included in the depth of field.

[0373] Next, the lens control section 1105 identifies the face of the adult woman 902, which is closer to the defocused area of ​​the adult male 901's face, as the target to be included in the depth of field (S1803), and adjusts the F-value so that the faces of the adult male 901 and the adult woman 902 are included in the depth of field (S1804).

[0374] When the second (second image) capture is performed in this state (S1805), the lens control unit 1105 identifies the face of the child 903 as the target to be included in the depth of field (S1803). Furthermore, after adjusting the F-value so that the faces of the adult male 901, the adult female 902, and the child 903 are included in the depth of field (S1804), the third (third image) capture is performed (S1805).

[0375] Therefore, since image capture of all image capture target areas has been performed ("Yes" in S1806), the bracketing exposure image capture process ends.

[0376] That is, in Figure 29 In the example shown, three (three) image captures are performed. During these three image captures, the position of the image capture lens 1101 is position P0.

[0377] In this embodiment, it has been described that the image capture lens 1101 is not driven after the first image capture is performed during the bracketing exposure image capture process, but it is not limited thereto.

[0378] For example, in Figure 29 In the example shown, after the second image capture is performed, the child 903's face can be set as the focus position, and the image capture lens 1101 can be driven to the position corresponding to this focus position. Alternatively, a third image capture can be performed with the F-value adjusted so that the child 903's face is included in the depth of field, while the faces of the adult male 901 and the adult female 902 are not included.

[0379] Next, a fourth image capture can be performed with the F-value adjusted so that the image capture lens 1101 is driven, the faces of the child 903 and the adult male 901 are included in the depth of field, and the face of the adult female 902 is not included in the depth of field.

[0380] Subsequently, the face of the adult woman 902 can be set as the focus position, and the image capture lens 1101 can be driven to the position corresponding to this focus position. Additionally, a fifth image capture can be performed with the F-value adjusted so that the faces of the adult woman 902 and the adult man 901 are included in the depth of field, while the face of the child 903 is not included.

[0381] Next, a sixth image capture can be performed with the F-value adjusted so that the face of the adult woman 902 is included in the depth of field, while the faces of the child 903 and the adult man 901 are not. Furthermore, in this case, a second image capture can be performed with the F-value adjusted so that the faces of the adult man 901, the adult woman 902, and the child 903 are included in the depth of field.

[0382] Furthermore, this disclosure describes how the lens control section 1105 sequentially drives the image capture lens 1101 from the closer side to the farther side relative to the image capture device 10 during the bracketing exposure image capture process, but is not limited thereto.

[0383] The lens control section 1105 can sequentially drive the image capture lens 1101 from the more distant side to the more near side relative to the image capture device 10.

[0384] Furthermore, in this disclosure, conditional image capture processing (see reference) has been described. Figure 6 The image capture judgment unit 402 in the image capture judgment unit determines whether to perform bracketing exposure image capture.

[0385] Here, the system control unit 1002 can notify the user whether to perform bracketing exposure image capture by displaying information indicating the judgment result of the image capture judgment unit 402 on the rear monitor 1009 or the like of the image capture device 10.

[0386] As described above, in this disclosure, the range estimation unit 401 acquires range information indicating the range of defocus amounts corresponding to multiple subject parts undergoing image capture. Examples of subject parts include target parts.

[0387] Furthermore, examples of multiple subject parts undergoing image capture include multiple target parts in a live view image. Additionally, examples of the range of defocus corresponding to multiple subject parts include the defocus range of multiple corresponding target parts.

[0388] Furthermore, the condition setting unit 403 sets multiple image capture conditions based on range information for capturing images of multiple subject parts in focus. Additionally, the image capture unit 404 performs multiple image captures based on these multiple image capture conditions.

[0389] In this case, even when the amount of defocus varies depending on the part of the subject, images of multiple parts of the subject in focus are captured.

[0390] Furthermore, the range estimation unit 401 estimates the range of defocus amounts corresponding to multiple subject parts. In this case, even when the defocus amount varies depending on the subject part, images of multiple subject parts in focus are captured based on the estimation results of the range estimation unit 401.

[0391] Furthermore, the image capture determination unit 402 determines whether to perform multiple image captures based on range information, and the multiple image captures are bracketing exposure image captures in which the focus position changes depending on the image capture. In this case, the range switching depends on the amount of defocus corresponding to multiple subject parts to determine whether to perform bracketing exposure image captures in which the focus position changes depending on the image capture.

[0392] In addition, the condition setting unit 403 calculates the driving range of the image capturing lens based on the amount of defocus corresponding to the nearest side and the amount of defocus corresponding to the farthest side during bracketed exposure image capture.

[0393] The closest part is the part of the subject that is closest to the image capture device 10. The farthest part is the part of the subject that is furthest from the image capture device 10.

[0394] In addition, the image capture determination unit 402 determines whether to perform bracketing exposure image capture based on the relationship between the driving range of the image capture lens 1101 and the focusing range of the image capture lens 1101 calculated by the condition setting unit 403.

[0395] In this case, the relationship between the driving range of the image capture lens 1101 and the focusing range of the image capture lens 1101 calculated by the condition setting unit 403 is used to switch whether to perform bracketing exposure image capture.

[0396] Furthermore, the image capture determination unit 402 determines whether to perform multiple image captures based on the range information, and the multiple image captures are bracketed exposure image captures in which the F value varies depending on the image capture.

[0397] In this case, whether to perform bracketing exposure image capture, where the F-value varies depending on the range of defocus corresponding to multiple subject parts, depends on the range of defocus.

[0398] In addition, the condition setting unit 403 calculates the range of depth of field or F-value during the capture of the bracketed exposure image based on the amount of defocus corresponding to the nearest part and the amount of defocus corresponding to the farthest part.

[0399] The closest part is the part of the subject that is closest to the image capture device 10. The farthest part is the part of the subject that is furthest from the host device.

[0400] In addition, the image capture determination unit 402 determines whether to perform bracketing exposure image capture based on the relationship between the depth of field range or F-value calculated by the condition setting unit 403 and the focus range of the image capture lens 1101.

[0401] In this case, the relationship between the depth of field range or F-value calculated by the condition setting unit 403 and the focus range of the image capture lens 1101 is used to switch whether to perform bracketing exposure image capture.

[0402] In addition, multiple image capture conditions include at least one of the following: the driving amount of the image capture lens 1101, the number of image captures, the position of the image capture lens 1101 at the end of multiple image captures, the bracketing exposure interval, and the F-value.

[0403] In this case, even when the amount of defocus varies depending on the part of the subject, since the above conditions are set as at least one of multiple image capture conditions based on the range information, images of multiple subject parts in focus are captured.

[0404] Furthermore, the multiple image captures are bracketed exposure image captures, and the multiple image capture conditions include the driving amount of the image capture lens 1101. In addition, the condition setting unit 403 sets the driving amount of the image capture lens 1101 based on the defocus amount corresponding to the position closest to the image capture device 10 among the multiple subject parts or the position furthest from the image capture device 10 among the multiple subject parts.

[0405] In this case, an image is captured that is the part of the subject closest to the image capture device 10 or the part of the subject furthest from the image capture device 10.

[0406] Furthermore, multiple subject areas are pre-selected, and multiple image capture conditions include the drive amount of the image capture lens. Additionally, the condition setting unit 403 sets the drive amount of the image capture lens 1101 based on the defocus amount corresponding to either the position closest to the image capture device 10 among the multiple subject areas or the position furthest from the image capture device 10 among the multiple subject areas. In this case, an image is captured with the pre-selected areas in focus.

[0407] Furthermore, multiple image capture conditions include the position of the image capture lens 1101 or the number of image captures at the end of multiple image captures. Additionally, the condition setting unit 403 sets the position of the image capture lens 1101 or the number of image captures at the end of multiple image captures based on the number of target subjects at multiple subject locations and the amount of defocus corresponding to the nearest or farthest location.

[0408] The closest part is the part of the subject that is closest to the image capture device 10. The farthest part is the part of the subject that is furthest from the image capture device 10.

[0409] In this case, since the image capture conditions are set based on the number of target subjects at multiple subject locations and the amount of defocus corresponding to the nearest or farthest location, images of multiple subject locations in focus are captured.

[0410] Furthermore, multiple subject parts are pre-selected, and multiple image capture conditions include the bracketing exposure interval or F-value when multiple image captures are bracketing exposure image captures. In addition, the condition setting unit 403 (setting component) sets the bracketing exposure interval or F-value based on the range information.

[0411] In this case, because the bracketing exposure interval or F-value is set as the image capture condition based on range information, images in focus of multiple parts of the subject are captured.

[0412] Furthermore, multiple image capture conditions include the number of image captures. Additionally, the condition setting unit 403 sets the number of image captures based on the defocus amount corresponding to the nearest part and the defocus amount corresponding to the farthest part. The nearest part is the part of the multiple subject parts that is closest to the image capture device 10.

[0413] Furthermore, the farthest part is the part of the multiple subject parts that is furthest from the image capture device 10. In this case, since the number of image captures is set based on the defocus amount corresponding to the nearest part and the defocus amount corresponding to the farthest part, images of multiple subject parts in focus are captured.

[0414] Furthermore, the multiple image captures are bracketed exposure image captures, and the multiple image capture conditions include the subject range during the bracketed exposure image capture. Additionally, the condition setting unit 403 sets the closer edge position or the farther edge position based on the interval drive amount.

[0415] In other words, the condition setting unit 403 sets the area closer to the host device than the nearest part or farther away from the host device than the farthest part as the subject range during the exposure image capture based on the interval drive amount.

[0416] The closest part is the part of the multiple subject parts that is closest to the image capturing device 10. Conversely, the farthest part is the part of the multiple subject parts that is furthest from the image capturing device 10. In this case, even if errors occur in the defocus range or in the driving of the image capturing lens 1101, it becomes easier to capture an image with multiple subject parts in focus.

[0417] While this disclosure has been described with reference to embodiments, it is to be understood that this disclosure is not limited to the disclosed embodiments. The scope of the appended claims is to be given the broadest interpretation in order to cover all such modifications and equivalent structures and functions.

[0418] Furthermore, as part or all of the control according to the embodiments, a computer program that implements the functions of the above embodiments can be supplied to an image processing device or the like via a network or various storage media. The computer (or CPU, MPU, etc.) of the image processing device or the like can then be configured to read and execute the program. In such a case, the program and the storage medium storing the program constitute this disclosure.

[0419] Furthermore, this disclosure includes those implemented using at least one processor or circuitry configured to perform the functions of the embodiments explained above. For example, multiple processors can be used for distributed processing to perform the functions of the embodiments explained above.

[0420] This application claims the benefit of Japanese Patent Application No. 2025-020340, filed on February 10, 2025, which is hereby incorporated herein by reference in its entirety.

Claims

1. An image processing apparatus, comprising: Acquisition component, used to acquire range information indicating the range of defocus amount corresponding to multiple subject parts undergoing image capture; Setting component, used to set multiple image capture conditions for capturing an image based on the range information, and to focus on the multiple subject parts in the image; as well as An image capture component is used to perform multiple image captures based on the plurality of image capture conditions.

2. The image processing apparatus according to claim 1, further comprising: An estimation component is used to estimate the range of defocus amount corresponding to the plurality of subject parts.

3. The image processing apparatus according to claim 1, further comprising: The determination component is used to determine, based on the range information, whether to perform the multiple image captures. The multiple image captures mentioned above are bracketing exposure image captures, in which the focus position varies depending on the image capture.

4. The image processing apparatus according to claim 3, further comprising: A calculation unit is used to calculate the driving range of the image capture lens during the bracketing exposure image capture based on the defocus amount corresponding to the position closest to the host device among the plurality of subject parts and the defocus amount corresponding to the position furthest from the host device among the plurality of subject parts. The determination component determines whether to perform the bracketing exposure image capture based on the relationship between the driving range of the image capture lens and the focusing range of the image capture lens calculated by the calculation component.

5. The image processing apparatus according to claim 1, further comprising: The determination component is used to determine, based on the range information, whether to perform the multiple image captures. The aforementioned multiple image captures are bracketed exposure image captures, in which the F-value varies depending on the image capture.

6. The image processing apparatus according to claim 5, further comprising: The calculation unit is used to calculate the range of depth of field or F-value during the bracketing exposure image capture based on the defocus amount corresponding to the position closest to the host device among the plurality of subject parts and the defocus amount corresponding to the position furthest from the host device among the plurality of subject parts. The determination component determines whether to perform the bracketing exposure image capture based on the relationship between the depth of field range or F-value calculated by the calculation component and the focus range of the image capture lens.

7. The image processing apparatus according to claim 1, The plurality of image capture conditions include at least one of the following: the driving amount of the image capture lens, the number of image captures, the position of the image capture lens after the plurality of image captures have ended, the time interval between the end of one image capture process and the start of the next image capture when the plurality of image captures are enclosing exposure image captures, and the F value.

8. The image processing apparatus according to claim 7, The multiple image captures mentioned above refer to the bracketed exposure image capture. The plurality of image capture conditions include the driving amount of the image capture lens, and The setting component sets the driving amount of the image capture lens based on the defocus amount corresponding to the part of the plurality of subject parts that is closest to the host device or the part of the plurality of subject parts that is furthest from the host device.

9. The image processing apparatus according to claim 7, The multiple subject parts mentioned above are pre-selected parts. The plurality of image capture conditions include the driving amount of the image capture lens, and The setting component sets the driving amount of the image capture lens based on the defocus amount corresponding to the part of the plurality of subject parts that is closest to the host device or the part of the plurality of subject parts that is furthest from the host device.

10. The image processing apparatus according to claim 7, The multiple image capture conditions include the position of the image capture lens after the multiple image captures have ended, or the number of image captures, and The setting component sets the position of the image capturing lens or the number of image captures at the end of the multiple image captures based on the number of target subjects among the multiple subject parts and the defocus amount corresponding to the position closest to the host device or the position furthest from the host device among the multiple subject parts.

11. The image processing apparatus according to claim 7, The multiple subject parts mentioned above are pre-selected parts. The plurality of image capture conditions include the time interval or F value when the plurality of image captures are the bracketed exposure image captures, and The setting component sets the time interval or F value based on the range information.

12. The image processing apparatus according to claim 7, The multiple image capture conditions include the number of image captures, and The setting component sets the number of image captures based on the defocus amount corresponding to the part of the plurality of subject parts closest to the host device and the defocus amount corresponding to the part of the plurality of subject parts furthest from the host device.

13. The image processing apparatus according to claim 1, The multiple image captures mentioned above are enclosed exposure image captures. The plurality of image capture conditions include the subject range during the bracketed exposure image capture, and The setting component sets the subject range during the bracketing exposure image capture based on the driving amount of the image capture lens between the end of one image capture process and the beginning of the next image capture. This area is closer to the host device than the area of ​​the subject closest to the host device, or farther from the host device than the area of ​​the subject furthest from the host device.

14. A method for controlling an image processing device, the method comprising: The step of obtaining range information indicating the range of defocus amount corresponding to multiple subject parts undergoing image capture; The step of setting multiple image capture conditions for capturing an image based on the range information, and focusing on the multiple subject parts in the image; as well as The step of performing multiple image captures based on the multiple image capture conditions.

15. The method of claim 14, further comprising: Estimate the range of defocus amount corresponding to the plurality of subject parts.

16. The method of claim 14, further comprising: Based on the range information, determine whether to perform the multiple image captures. The multiple image captures mentioned above are bracketing exposure image captures, in which the focus position varies depending on the image capture.

17. A computer-readable storage medium for storing a computer program, said computer program including instructions for performing the following processes: Obtain range information indicating the range of defocus corresponding to multiple subject parts undergoing image capture. Based on the range information, multiple image capture conditions are set for capturing the image, and the multiple subject parts in the image are focused on. Multiple image captures are performed based on the aforementioned multiple image capture conditions.

18. A computer program product comprising a computer program, said computer program including instructions for performing the following processes: Obtain range information indicating the range of defocus corresponding to multiple subject parts undergoing image capture. Based on the range information, multiple image capture conditions are set for capturing the image, and the multiple subject parts in the image are focused on. Multiple image captures are performed based on the aforementioned multiple image capture conditions.

19. The computer program product of claim 18, further comprising instructions for: Estimate the range of defocus amount corresponding to the plurality of subject parts.

20. The computer program product of claim 18, further comprising instructions for: Based on the range information, determine whether to perform the multiple image captures. The multiple image captures mentioned above are bracketing exposure image captures, in which the focus position varies depending on the image capture.

Images