Imaging apparatus, method for controlling imaging apparatus, program, and storage medium

Abstract

To provide an imaging apparatus capable of allowing a user to easily acquire a photographing condition in a desired focusing range.SOLUTION: An imaging apparatus (100) includes acquisition means (17) for acquiring a first photographing condition when performing first photographing and a second photographing condition when performing second photographing, display means (23 and 101) for displaying a subject and an AF candidate frame in a superimposing manner, first determination means (26) for determining whether or not a position corresponding to the AF candidate frame is settled within a focusing range at a first depth of field obtained by the first photographing in the first photographing condition, and second determination means (27) for determining whether or not the position corresponding to the AF candidate frame is settled within the focusing range at a second depth of field obtained by the second photographing in the second photographing condition. The display means displays a focusing state related to the position corresponding to the AF candidate frame according to the determination results of the first determination means and the second determination means.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus, a control method for an imaging apparatus, a program, and a storage medium. [Background technology]

[0002] Conventionally, a technique for controlling focusing by autofocus (AF) is known. Patent Document 1 discloses a device that notifies a user of a focusable area within a depth of field and enables the user to set a desired focus area from the focusable area. Conventionally, a depth stacking technique is known that synthesizes multiple images obtained by focus bracketing, which controls the drive of a focus adjustment lens to shoot multiple images while shifting the focus position, to obtain a depth of field that exceeds the optical characteristics that cannot be obtained by one-time focus shooting. Patent Document 2 discloses a device that re-synthesizes the shooting range by extracting and synthesizing the focus range of multiple images of the same shooting range with different focus positions, thereby generating a multi-focus image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-165997 A [Patent Document 2] Japanese Patent Application Publication No. 10-290389 Summary of the Invention [Problem to be solved by the invention]

[0004] Even if a user wants to set the focus range within the angle of view to a desired setting, it is difficult for the user to immediately grasp the required depth of field. Also, when the user is notified of the focusable area and sets the desired focus area as in Patent Document 1, the area outside the focusable area cannot be focused.

[0005] Even if it is difficult to ensure the necessary depth of field due to optical characteristics or the distance to the subject, an imaging device that can prepare for single focus shooting and focus bracket shooting in parallel is needed in consideration of focus bracket shooting for depth stacking as in Patent Document 2. In that case, a decision to select between single focus shooting and focus bracket shooting is required, and a user interface that notifies the focus range under each shooting condition is required.

[0006] SUMMARY OF THE PRESENT EMBODIMENTS An object of the present invention is to provide an imaging apparatus that enables a user to easily obtain shooting conditions within a desired focus range. [Means for solving the problem]

[0007] An imaging device as one aspect of the present invention has an acquisition means for acquiring first shooting conditions when a first shooting is performed and second shooting conditions when a second shooting is performed, a display means for superimposing and displaying a subject and an AF candidate frame, a first determination means for determining whether a position corresponding to the AF candidate frame falls within a focus range at a first depth of field obtained by the first shooting under the first shooting conditions, and a second determination means for determining whether the position corresponding to the AF candidate frame falls within the focus range at a second depth of field obtained by the second shooting under the second shooting conditions, and the display means displays a focus state for the position corresponding to the AF candidate frame in accordance with determination results of the first determination means and the second determination means.

[0008] Other objects and features of the present invention are illustrated in the following examples. Effect of the Invention

[0009] According to the present invention, it is possible to provide an imaging apparatus that enables a user to easily obtain shooting conditions in a desired focus range. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is an external view of an imaging device in each embodiment. [Diagram 2]1 is a block diagram of an imaging system according to a first embodiment. [Diagram 3] 5 is a flowchart showing a control method of the imaging apparatus in each embodiment. [Figure 4] 6 is a flowchart showing an LV display process in each embodiment. [Figure 5(a)] 6 is a flowchart showing a process of single-focus shooting in each embodiment. [Figure 5(b)] 6 is a flowchart showing a process of single-focus shooting in each embodiment. [Figure 6(a)] 5 is a flowchart showing a process of two-condition photographing in the first embodiment. [Figure 6(b)] 5 is a flowchart showing a process of two-condition photographing in the first embodiment. [Figure 6(c)] 5 is a flowchart showing a process of two-condition photographing in the first embodiment. [Figure 7] 5 is a flowchart showing a reproduction and display process in each embodiment. [Figure 8] 4 is a flowchart showing the process of photographing under photographing condition 1 in each embodiment. [Figure 9] 13 is a flowchart showing the process of focus bracketing under shooting condition 2 in each embodiment. [Figure 10] FIG. 11 is a block diagram of an imaging system according to a second embodiment. [Figure 11(a)] 13 is a flowchart showing a process of two-condition photographing in the second embodiment. [Figure 11(b)] 13 is a flowchart showing a process of two-condition photographing in the second embodiment. [Figure 11(c)] 13 is a flowchart showing a process of two-condition photographing in the second embodiment. [Figure 12] FIG. 4 is a diagram showing an example of an AF candidate frame in the first embodiment. [Figure 13] FIG. 11 is a diagram showing an example of an AF candidate frame in the second embodiment. [Figure 14] FIG. 4 is a diagram showing the relationship between the subject distance and the defocus amount. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. EXAMPLES

[0012] First, a digital camera (imaging device) 100 according to a first embodiment of the present invention will be described with reference to Figs. 1(a) and (b). Figs. 1(a) and (b) are external views of the digital camera 100, with Fig. 1(a) showing a front perspective view of the digital camera 100 and Fig. 1(b) showing a rear perspective view of the digital camera 100. The digital camera 100 is a mirrorless camera, but this embodiment is not limited to this and can be applied to other imaging devices. In addition, a lens device is detachable from the digital camera 100, but this embodiment is not limited to this and can be applied to an imaging device in which a camera body and a lens device are integrally configured.

[0013] Reference numeral 101 denotes a display unit provided on the rear surface of the digital camera 100 for displaying images and various information. Reference numeral 102 denotes a shutter button for issuing a shooting instruction. Reference numeral 103 denotes a power switch for turning on the power of the digital camera 100 to issue a start instruction and for turning off the power to issue a stop instruction. Reference numeral 104 denotes a communication terminal for communicating with a lens device that is detachable from the digital camera 100 or an adapter for connecting a lens device. Reference numeral 105 denotes an eyepiece unit of an eyepiece finder (a peer-in type finder), and a user can view an image displayed on an internal electronic viewfinder (see FIG. 2) through the eyepiece unit 105. Reference numeral 106 denotes an eyepiece detection sensor for detecting whether or not a user has placed his or her eye on the eyepiece unit 105. Reference numeral 107 denotes a cover for a slot for storing a recording medium 25 (see FIG. 2).

[0014] The digital camera 100 includes, as operation members, a main electronic dial 112, a sub electronic dial 113, a cross key 114, and a SET button 115. The digital camera 100 also includes, as operation members, a second shutter button 116, an AE lock button 117 (AE is Auto Exposure), a magnification button 118, a playback button 119, a menu button 120, a mode switch 121, and an INFO button 122.

[0015] Reference numeral 112 denotes a main electronic dial as a rotary operation member, which is used to change settings such as shutter speed and aperture value. Reference numeral 113 denotes a sub electronic dial as a rotary operation member, which may be used to move the selection position of the AF frame during shooting, or to advance images during playback. Reference numeral 114 denotes a cross key. The cross key is illustrated as a four-way key whose up, down, left, and right portions can be pressed, and operations can be assigned according to the portion pressed. Reference numeral 115 in FIG. 1 denotes a SET button, which is a push button used mainly to confirm a selection item. Reference numeral 116 denotes a second shutter button, which may be used to instruct the start of focus bracket shooting (second shooting) in a two-condition shooting mode described later. In a shooting mode other than the above, the cross key may be used to instruct the start and end of video shooting.

[0016] 117 is an AE lock button, and in one shooting mode (one-time focus shooting, first shooting) when S2 is pressed from the S1 state (S1 and S2 will be described later), the exposure state is fixed by pressing it in the shooting standby state. In the two-condition shooting mode (described later), it functions as a switch button for starting and completing the addition / exclusion within the depth of the selected AF candidate frame.

[0017] Reference numeral 118 denotes a magnification button, which is used to turn on / off the magnification mode in, for example, a live view display (LV display). For example, the LV display image can be enlarged / reduced by operating the main electronic dial 112 after turning on the magnification mode. The same applies to the playback display image during playback display. The playback button 119 is an operation button for switching between shooting and playback display processing. By pressing the playback button 119 during any shooting mode, the mode is shifted to playback mode, and the latest image, for example, among the images recorded in the recording medium 25, can be displayed on the display unit 101. Reference numeral 120 denotes a menu button, which is pressed when a menu display for performing various settings is to be displayed on the display unit 101. The user can intuitively perform various settings using the menu screen displayed on the display unit 101, the cross key 114, and the SET button 115.

[0018] Reference numeral 121 denotes a mode switch for switching between various modes. The mode switch 121 can be used to select a two-condition shooting mode, which will be described later. The INFO button 122 is used to switch the information displayed on a display member such as the display unit 101. The INFO button 122 can be used to switch between in-depth addition / exclusion input for the AF candidate frame selected in the two-condition shooting mode, which will be described later.

[0019] When the user holds the digital camera 100, it has a grip shape that is easy to hold in the right hand, and the shutter button 102 is located at a position that can be operated by the index finger of the right hand when the user grips and holds the digital camera 100 with the little finger, ring finger, and middle finger of the right hand. In the same state, the main electronic dial 112 and the second shutter button 116 are located at positions that can be operated by the index finger of the right hand. In the same state, the sub electronic dial 113 is located at a position that can be operated by the thumb of the right hand.

[0020] Next, an imaging system 200 in this embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram of the imaging system 200. The imaging system 200 includes a digital camera 100 and a lens device (interchangeable lens) 13 that is detachable from the digital camera.

[0021] In the digital camera 100, 10 denotes a CPU that controls the digital camera 100. 11 denotes a non-volatile memory such as a flash memory that stores a control program for the CPU 10. 12 denotes a large-capacity memory such as a dynamic random access memory (DRAM) that temporarily stores intermediate processing data such as image data. DRAM can access large amounts of data faster than flash memory. After the power supply (not shown) is turned on, the CPU 10 reads and executes a program from the non-volatile memory 11 as a startup process. The program may be expanded from the non-volatile memory 11 to the large-capacity memory 12 for high-speed processing before being executed.

[0022] Reference numeral 13 denotes a lens device serving as an interchangeable lens mounted on the digital camera 100. The lens device 13 has a lens 132. The lens 132 is usually composed of a plurality of lenses, and an aperture (aperture diaphragm) 131 is disposed between the plurality of lenses. Note that in FIG. 2, only one lens is shown as the lens 132 for the sake of simplicity, and the aperture 131 is also shown diagrammatically in front of the lens 132.

[0023] Reference numeral 135 denotes a communication terminal for the lens device 13 to communicate with the digital camera 100, and is connected to the communication terminal 104 on the digital camera 100 side when the lens device 13 is attached to the digital camera 100. The lens device 13 communicates with the digital camera 100 using a lens system control circuit 130. An aperture drive circuit 133 drives the aperture 131, and a lens drive circuit 134 drives the lens 132, and instructions and requests from the digital camera 100 are transmitted via the lens system control circuit 130. An encoder (not shown) or a potentiometer linked to an actuator (not shown) in the lens drive circuit 134 may be provided to grasp the control position of the focus adjustment lens and convert it into a subject distance. A non-volatile memory 136 may be provided in the lens device 13 to hold optical characteristic information of the lens device 13. The optical characteristic information may include parameters for optical correction by a correction means 15 described later.

[0024] Reference numeral 14 denotes an imaging means, which has an imaging element such as a CMOS sensor having an array section in which pixels including photoelectric conversion are arranged in a grid pattern. The imaging means 14 may include an AD converter that converts an analog signal output photoelectrically converted by the pixel section of the imaging element into a digital signal, an IF that transfers the digital data to subsequent processing, and a timing control section for capturing an image as one piece of image data. The light receiving section of the pixel of the imaging means 14 may be pupil-divided into one pixel so that parallax images (for the left eye and the right eye) can be acquired to perform AF using the image plane phase difference method, enabling the accumulation and reading of electric charges for each.

[0025] A correction means 15 performs correction for the imaging means 14 and correction for the lens device 13. The correction for the imaging means 14 includes, but is not limited to, shading correction, removal of noise due to dark current, or correction of pixel defects. The correction for the lens device 13 includes, but is not limited to, peripheral light amount correction, magnification chromatic aberration correction, removal of the effect of diffraction, or distortion correction. The RAW data processed by the correction means 15 may be temporarily stored in the large-capacity memory 12, and then image processing and evaluation value acquisition may be performed. An image processing means 16 performs image processing such as white balance (WB) adjustment, Bayer data synchronization, YUV conversion, noise suppression processing, false color reduction processing, or gamma processing. The above-mentioned correction processing and image processing are not features of this embodiment, so detailed explanations will be omitted. At least one of the correction means 15 and the image processing means 16 may include image data reduction processing means (not shown).

[0026] Reference numeral 17 denotes an evaluation means, which acquires an evaluation value (integral value, etc.) for light control and white balance. The evaluation means 17 functions as an acquisition means for acquiring shooting conditions (first shooting condition and second shooting condition) for shooting an object with appropriate exposure. Reference numeral 18 denotes a focusing means, which detects the amount of image shift in each of the parallax images and obtains the defocus amount (the amount of deviation from focus). The CPU 10 determines the lens drive amount by multiplying the defocus amount by a conversion coefficient in the focusing operation of the AF control. Reference numeral 19 denotes a lens communication means, which transfers information on the lens drive amount in the focusing operation to the lens system control circuit 130 of the lens device 13 via the communication terminals 104 and 135. The lens system control circuit 130 transfers the object distance after focusing from the lens device 13 to the digital camera 100.

[0027] Reference numeral 20 denotes a codec that compresses and / or encodes image data, and may decode and / or expand the compressed image when it is played back in the digital camera 100. In this embodiment, the image data processed by the image processing means 16 and temporarily stored in the large capacity memory 12 is compressed, but the RAW image processed by the correction means 15 may also be compressed. The format of the compressed image data may be, for example, in compliance with the JPEG standard.

[0028] Reference numeral 21 denotes a display control means, 22 a video RAM (VRAM) that temporarily stores images, 23 an electronic viewfinder (EVF), and 101 a display unit 101. The image on the EVF 23 is viewed by the user through an eyepiece 105. A resizing circuit for enlarging and reducing the display may also be installed. Reference numeral 24 denotes a recording control means that executes file access to the recording media 25. The user can open the cover 107 to insert and remove the recording media 25.

[0029] Reference numeral 26 denotes a first determination means which determines whether or not the AF candidate frame falls within the focusing range at the depth of field (first depth of field) obtained under the shooting conditions (shooting condition 1, first shooting condition) for single focus shooting. Reference numeral 27 denotes a second determination means which determines whether or not the AF candidate frame falls within the focusing range at the depth of field (second depth of field) at each focusing position obtained under the shooting conditions (shooting condition 2, second shooting condition) for focus bracket shooting in two-condition shooting described later.

[0030] Here, the AF candidate frames in this embodiment will be described with reference to FIG. 12(a). FIG. 12(a) is an example of the AF candidate frames. In FIG. 12(a), an arrangement of a plurality of AF candidate frames is illustrated as an arrangement of five columns (A) to (E) and six rows (1) to (6). However, this embodiment is not limited to this arrangement. FIG. 12(a) is an example of the AF candidate frames superimposed on the LV display image confirmed by the EVF 23. The pixel data is read and processed so that the processing image area related to the correlation determination of the parallax image and the defocus amount estimation, which will be described later, maintains a positional relationship equivalent to the position of the AF candidate frame (with respect to the subject on the display image) in FIG. 12(a). Note that FIG. 12(a) explicitly draws the frame large, but the size of the frame is not limited.

[0031] Any processing means of the digital camera 100 may be implemented as one LSI (for example, the CPU 10 and each of the means 15 to 27 in FIG. 2 (excluding 23 and 25) may be configured as a SOC). However, this embodiment is not limited to these forms.

[0032] Next, an overall control method for digital camera 100 in this embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the overall control method for digital camera 100. This flowchart starts in response to the power switch 103 of digital camera 100 being turned from OFF to ON.

[0033] First, in step S301, the CPU 10 executes a startup process in response to the start of power supply from a power source (not shown). In the startup process of the CPU 10, the CPU 10 reads a control program from the non-volatile memory 11. Then, the CPU 10 executes startup processes set in the control program (for example, internal clock setting, port setting, reset processing, starting and connection check of the large-capacity memory 12, register setting of internal modules, etc.).

[0034] Next, in step S302, the CPU 10 executes a startup process for the digital camera 100. For example, the CPU 10 reflects various preset menu settings, starts a timer (not shown), and checks the state of components (for example, checks the state of the mode changeover switch 121). Starting the timer (not shown) is a measure to prevent the battery from being consumed while the power is left ON, and is used to turn off the power of the digital camera 100 if no operation is performed for a certain period of time. During the startup process, the CPU 10 also receives information (correction parameters, etc.) about the connected lens from the lens device 13 via the contacts 135 and 104.

[0035] Next, in step S303, CPU 10 determines whether or not pressing of playback button 119 (instruction to perform playback display) has been detected. If pressing of playback button 119 has been detected, digital camera 100 transitions to playback mode, and the process proceeds to playback display processing in step S309. On the other hand, if pressing of playback button 119 has not been detected, the process proceeds to step S304.

[0036] In step S304, the CPU 10 determines whether the shutter button 102 is in the S1 state (S1 pressed state). The shutter button 102 has two states: the S1 state (S1 pressed state) in which the button is ON when pressed halfway, and the S2 state (S2 pressed state) in which the button is ON when pressed all the way. In the S1 state, a focusing operation is performed as a shooting preparation state, and shooting conditions (aperture value, shutter speed, ISO sensitivity, etc.) are determined. When the shutter button 102 transitions from the S1 state to the S2 state after focusing and the shooting conditions are determined, still image shooting is performed. If the S1 state is detected in step S304, the process transitions to step S305. On the other hand, if the S1 state is not detected, the process transitions to step S306, and the CPU 10 performs LV display processing.

[0037] In addition, if the camera moves to the S2 state without passing through the S1 state, the camera may ignore the move and proceed to step S306. If a setting that allows out-of-focus shooting is provided in the menu settings and the setting is selected, normal shooting may be performed (proceed to step S307).

[0038] In step S305, the CPU 10 determines the shooting mode. The shooting mode can be set by the mode changeover switch 121. In this embodiment, either a one-time focus shooting mode (first mode) in which only one-time focus shooting is performed, or a two-condition shooting mode (second mode) in which one-time focus shooting or focus bracketing shooting can be selected immediately before shooting can be selected. However, in this embodiment, the selectable shooting modes are not limited to these two modes. There may be a plurality of shooting modes, such as shutter speed priority, aperture priority, program AE, and fully automatic shooting, and they are not limited in this embodiment. In this embodiment, for the sake of simplicity, one-time focus shooting will be described as a representative, but it is not limited to this, and other modes such as program AE mode may be used. In addition, there is a shooting method in which multiple images are shot in one shooting operation to avoid saturation of pixel values ​​in dark and bright areas, but if the focus state does not change, this is also included in one-time focus shooting.

[0039] In step S305, if it is determined that the shooting mode is the single focus shooting mode, the process proceeds to step S307. On the other hand, if it is determined that the shooting mode is the two-condition shooting mode, the process proceeds to step S308. After any one of steps S306 to S309 is completed, the process proceeds to step S310. In step S310, CPU 10 determines whether or not a timer (not shown) has completed counting a predetermined period (whether or not the predetermined period has elapsed). If it is determined that the predetermined period has elapsed, the process proceeds to step S311. On the other hand, if it is determined that the predetermined period has not elapsed, the process proceeds to step S303 to continue the process.

[0040] In step S311, the CPU 10 performs a process of stopping the digital camera 100 (saving the current settings of the digital camera 100 in the non-volatile memory 11 and shutting off the power). The stop process in step S311 is a sleep state from which the CPU 10 can be restored by operating a member. Note that the restoration process is not a feature of this embodiment and is therefore not shown. The power to the digital camera 100 is completely turned off by operating the power switch 103. In this case, the shutoff may be performed in the background as an exception process (not shown), which is a similar measure to the stop process in step S311. However, the CPU 10 can only be restarted by operating the power switch 103. The pressed state of the playback button 119 and the completion of timer (not shown), which are shown here as a series of processing flows, may be interrupt processes.

[0041] Next, the LV display process (S306) of the digital camera 100 in this embodiment will be described with reference to Fig. 4(a) and (b). Fig. 4(a) is a flowchart showing the pre-processing in the LV display process, and shows the processes related to imaging, correction, and acquisition of evaluation values. Fig. 4(b) is a flowchart showing the entire LV display process including the pre-processing shown in Fig. 4(a).

[0042] First, in step S401 in FIG. 4(a), the CPU 10 performs drive control settings for the imaging means 14. Since the LV display is for capturing moving images, for example, imaging processing is performed at 60 frames per second (60 fps). The settings here include, but are not limited to, settings for the accumulation time of the pixel section of the imaging means 14, analog amplifier gain, the slope of the reference voltage (ramp input) of the AD converter, readout line, etc. Also, settings that follow the previous imaging control may be omitted. The setting values ​​are transferred from the CPU 10 to the imaging means 14 (communication means not shown).

[0043] Next, in step S402, the CPU 10 executes sensor readout. The sensor readout is a process in which the pixel charge obtained by photoelectric conversion is output to an AD converter as a voltage value by the pixel transistor, and acquired as a digital value. For example, the pixel array is read out for each horizontal line, and one frame of data is acquired by scanning in the vertical direction.

[0044] Next, in step S403, the CPU 10 executes a sensor correction process on the pixel data of the digital signal read out in step S402. The process in Fig. 4(a) may be performed by transferring pixels that have been processed to the next step, instead of starting the next step after each step completes the processing of the frame. In this case, the total processing delay is the sum of the latencies of each step.

[0045] Steps S404 and S405 in FIG. 4(a) are shown to be processed in parallel. Step S404 is a process flow for acquiring evaluation values ​​for exposure adjustment (AE) and white balance adjustment. In step S404, the CPU 10 acquires an integral value of any block of a luminance signal or color signal for acquiring the evaluation value, or a histogram, as an evaluation value. Based on the acquired evaluation value, the CPU 10 calculates the aperture value (F value) of the aperture 131 and a gain value for white balance (WB) adjustment of the image processing means 16. The gain value for WB adjustment is transferred to the image processing means 16. When the aperture 131 is open for a focusing operation, the aperture value is transferred from the lens communication means 19 to the lens device 13 at the time of shooting. When the LV display image is reproduced with the actual aperture, it is transferred to the lens device 13 at any time. In step S405, the CPU 10 uses the correction means 15 to execute optical correction processes such as peripheral illumination correction, magnification chromatic aberration correction, and diffraction effect removal.

[0046] Next, FIG. 4(b) will be described. Step S400 in FIG. 4(b) is the pre-processing in FIG. 4(a), and as described above, the CPU 10 captures, corrects, and obtains an evaluation value for an image for LV display. Then, in step S406, the CPU 10 executes a development process for an image for LV display. Here, the CPU 10 executes WB adjustment using a gain value for WB adjustment and the process described with reference to FIG. 2. Then, in step S407, the CPU 10 corrects the LV display image as necessary. For example, this is compensation for shading that a display device such as an organic EL display has. Then, in step S408, the CPU 10 executes an LV display process for LV display on the display means (at least one of the EVF 23 and the display unit 101). The display control means 21 prepares an image for display in the VRAM 22, and outputs a video signal to at least one of the EVF 23 and the display unit 101 in accordance with a display synchronization signal. Since it is not desirable to have an LV display in which the entire screen is out of focus, the main subject may be estimated arbitrarily during the LV display process and the focusing operation may be performed (not shown in Figs. 4(a) and (b)). In this case, the lens drive does not need to be steep.

[0047] Next, the single focus shooting (step S307) of the digital camera 100 in this embodiment will be described with reference to Figures 5(a) and 5(b). Figures 5(a) and 5(b) are flowcharts of the single focus shooting of the digital camera 100.

[0048] First, in step S500, the CPU 10 performs pre-processing shown in Fig. 4(a). Next, in step S501, the CPU 10 determines the shooting conditions (shooting conditions 1). The CPU 10 determines shooting conditions such as aperture value, shutter speed, and ISO sensitivity so as to obtain suitable exposure based on the evaluation value acquired in the pre-processing in step S500. Note that if this flow has already been repeated and the shooting conditions have been determined and the camera is in focus, this flow may be skipped (determination process is not shown).

[0049] Next, in step S502, the CPU 10 determines whether or not the focus has been achieved. If it is determined that the focus has been achieved, the process proceeds to step S507. On the other hand, if it is determined that the focus has not been achieved, the process proceeds to step S503.

[0050] In step S503, the CPU 10 executes estimation of the main subject. The estimation of the main subject may refer to the contrast in the image, or may adopt the detection result of a human body, face, pupil, animal, arbitrary object, etc. by a recognition means (not shown). In this embodiment, the estimation method is not limited. Next, in step S504, the CPU 10 performs correlation determination of the parallax input for focusing on the estimated main subject, and obtains the image shift amount on the imaging surface of the imaging element. Note that, although details will not be described because it is not a feature of this embodiment, the obtained image shift amount can be multiplied by a conversion coefficient specific to the device to calculate the defocus amount on the optical axis. Next, in step S505, the CPU 10 performs focus determination. If it is determined that there is no image shift amount and the images of the parallax input match, the process proceeds to step S507. On the other hand, if it is determined that the image is not considered to be in focus, the process proceeds to step S506.

[0051] In step S506, the digital camera 100 issues a lens drive instruction to the lens device 13 to move the focus adjustment lens. In the lens device 13 in FIG. 2, a plurality of lens groups are collectively shown as lens 132, but the focus adjustment lens refers to a lens among the plurality of lens groups that is involved in focus adjustment. Calculation of the lens drive amount from the image shift amount may be executed by the CPU 10. As described above, the defocus amount is calculated by multiplying the image shift amount of the parallax input by a conversion coefficient. In the image plane phase difference method, the conversion coefficient can be defined by determining the baseline length from the positional relationship of the exit pupil at each AF candidate frame position of the captured image, but since this is not a feature of this embodiment, detailed explanation thereof will be omitted.

[0052] The relationship between the defocus amount and the focus adjustment lens movement amount differs depending on the lens configuration. In the case of a single focal length lens with full extension, the relationship is approximately 1:1. However, since the functional relationship differs depending on the configuration of the lens 132 of the lens device 13, such as rear focus or front group extension, it is sufficient to have a function within the lens and calculate the lens movement amount from the defocus amount at that time. There are no particular limitations on the lens movement calculation, and as it is not a feature of this embodiment, a detailed explanation will be omitted.

[0053] Fig. 12(b) shows an example of a focusing frame in this embodiment. As mentioned above, the example shows a case where the frame in column D, row 3 is focused on out of the 6 rows and 5 columns of AF candidate frames. However, this is for the purpose of explanation, and in reality, the frame is displayed on the EVF 23 in the state shown in Fig. 12(c) which will be described later.

[0054] In step S507 in Fig. 5(a), the CPU 10 acquires the subject distance of the main subject from the lens device 13. As described above, the subject distance information is acquired by a mechanism (encoder, etc., not shown) within the lens drive circuit 134. Note that the method of acquiring the subject distance (shooting distance) from the lens device 13 is well known, so a description thereof will be omitted. In this embodiment, as described above, the subject position in column D, row 3 in Fig. 12(b) is acquired.

[0055] 5A, the CPU 10 estimates the defocus amount for the in-focus plane for all AF candidate frames. If the imaging means 14 mounted on the digital camera 100 has pupil-divided pixels, it can execute AF processing using the image plane phase difference method. If the pupil is divided by all pixels on the entire screen, the defocus amount for the entire screen can be calculated to create a defocus map, but in this embodiment, it is sufficient to calculate the defocus amount at the position of the AF candidate frame.

[0056] When the defocus amount is large, the accuracy of the calculation result is low. In the process of focusing and light adjustment, the lens aperture 131 may be open, so the defocus amount may be large except near the focus point. Furthermore, the accuracy of the calculation result decreases even if there is an effect of perspective conflict or occlusion near the AF candidate frame. For AF candidate frames with low reliability of the defocus amount calculation, a control may be applied to exclude them from the selection of the focus range. In this embodiment, the reliability of the defocus amount calculation result is not particularly limited.

[0057] Next, in step S509, the CPU 10 uses the first determination means 26 to determine whether the positional relationship (actual distance relationship) between the subject on the AF candidate frame and the main subject falls within the depth of field under the photographing condition 1. This determination is made based on the relationship between the subject distance at the in-focus position, the image distance on the imaging element, and the defocus amount of each of the AF candidate frames.

[0058] 14 is a diagram showing the relationship between the subject distance and the defocus amount. Here, the lateral magnification of the lens is M, the focal length is f, the subject distance is A+f, the image distance is B+f, the height of the subject-side object is X, and the height of the image is Y. In this case, the following formula (1) is established.

[0059] M=Y / X=f / A=B / f …(1) Multiplying equation (1) by (fA) gives the following equation (2).

[0060] f / A·(fA)=B / f·(fA) …(2) Therefore, the following equation (3) holds:

[0061] f 2 =A·B …(3) Furthermore, if the object movement amount is a and the corresponding defocus amount is b, the following equation (4) holds.

[0062] (A+a)·(B+b)=f 2 …(4) Then, using equations (3) and (4), the following equation (5) is obtained.

[0063] (A+a)=(A·B) / (B+b) …(5) The relationship between the subject distance (A+a) and the defocus amount b is expressed by formula (5). The depth of field can be calculated using the aperture value, subject distance, focal length, and permissible circle of confusion as parameters. Note that this is a well-known formula, so a detailed explanation is omitted. The permissible circle of confusion applies the larger of the sensor pixel pitch or the Airy disk diameter (optical imaging limit), but a value that takes into account the influence of the display size, image reduction, and the like may also be applied. There are no limitations here. The depth of field requires calculation of the front depth of field and the rear depth of field for the main subject, and is expressed as follows:

[0064] Depth of field = Front depth of field + Back depth of field In parallel with the process flow of steps S501 to S509, the CPU 10 also prepares an image for LV display. In step S511 of FIG. 5(a), similar to step S406 of FIG. 4(b), a development process of the captured image is performed. Conversion from the captured image size to the LV display image size may be performed by the correction means 15 or the image processing means 16, and is not particularly limited in this embodiment. Next, in step S512, the CPU 10 executes shading correction for LV display, similar to step S407 of FIG. 4(b).

[0065] 5B, the CPU 10 determines whether the depth determination in step S509 has been performed. If the subject is not in focus and the depth of field determination has not been completed, the process proceeds to step S521 without informing the user of the in-focus state, and only the subject is displayed in LV. On the other hand, if the main subject is in focus, the process proceeds to step S523, and the subject depth evaluation result is superimposed on the AF candidate frame.

[0066] In step S521, if the subject is not in focus, the in-focus frame of Fig. 12(b) cannot be displayed on the display screen of the EVF 23. For this reason, the AF candidate frames are not superimposed on the subject image as in Fig. 12(e), or are displayed in the state of Fig. 12(a). Note that the display form is not limited.

[0067] In step S523, the CPU 10 superimposes information on the AF candidate frames that are the focusing range determined in step S509 on the state of FIG. 12(b). FIG. 12(c) is an example of notifying the user of the AF candidate frames of the focusing range in step S523. In addition to the focusing frame in column D, row 3, AF candidate frames within the depth of field obtained by shooting under shooting condition 1 are superimposed and displayed in a manner that is understandable to the user. In FIG. 12(c), rows 2 to 5 of column B, rows 2 to 5 of column C, rows 4 to 5 of column D, and row 5 of column F are exemplified as within the depth of field (focusing range). The superimposed display may be performed by changing the color scheme of the frame from the others, or by flashing the frame, and the display form is not limited.

[0068] In step S524, the CPU 10 determines whether or not the user has changed the shooting conditions. For example, if the user has operated the electronic dial 112 to change the shutter speed, the aperture value, or the like, the process proceeds to step S525, where the CPU 10 changes the setting of the shooting condition 1. On the other hand, if the CPU 10 has not detected a user operation, the process proceeds to step S526.

[0069] In step S526, the CPU 10 determines whether the shutter button 102 is in the S2 pressed state. If it is determined that the shutter button 102 is in the S2 pressed state, the process proceeds to step S527 as a shooting request. On the other hand, if it is determined that the shutter button 102 is not in the S2 pressed state, the process proceeds to step S528.

[0070] In step S527, the CPU 10 performs shooting under the shooting condition 1. Here, shooting under the shooting condition 1 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing shooting under the shooting condition 1.

[0071] First, in step S801, the CPU 10 performs pre-processing including image capture processing, correction processing, and acquisition of evaluation values, as in Fig. 4(a). However, the sensor drive setting is different from the LV display. That is, the CPU 10 determines the pixel accumulation time from the shutter speed of the shooting condition 1 set in step S501 in Fig. 5(a), and the analog gain value (including the ramp slope of the reference voltage of the AD converter) from the aperture value and ISO sensitivity, and executes drive control of the image capture means 14.

[0072] Next, in step S802, the CPU 10 executes a process for the still image recording similar to the development process for the LV display image in step S406 (development process). Next, in step S803, the CPU 10 compresses the developed image data for still image recording by the codec 20 (image compression process). Next, in step S804, the CPU 10 uses the recording control means 24 to record the compressed recording data as a file in the recording medium 25 (recording control).

[0073] If it is determined in step S526 in FIG. 5(b) that the shutter button 102 is not in the S2 pressed state, the CPU 10 determines in step S528 whether the shutter button 102 is released from the S1 state. If it is determined that the shutter button 102 is holding the S1 state, the process proceeds to step S500 to continue the LV display and prepare for capturing the next frame data. On the other hand, if it is determined that the state of the shutter button 102 has been released from the S1 state, the process of one-time focus shooting is completed. That is, in FIG. 3, the process of step S307 is completed and the process proceeds to step S310.

[0074] Next, with reference to Fig. 6(a), Fig. 6(b), and Fig. 6(c), the two-condition shooting of the digital camera 100 in this embodiment will be described. Fig. 6(a), Fig. 6(b), and Fig. 6(c) are flowcharts showing the processing of the two-condition shooting of the digital camera 100. As described with reference to Fig. 3, in the two-condition shooting mode, shooting conditions are prepared for one-time focusing (under shooting condition 1) and multiple shots accompanied by focus position movement by focus bracketing (under shooting condition 2), and the user is prompted to select between them when shooting.

[0075] First, in step S601, the CPU 10 initializes the selection of AF candidate frames. In the two-condition shooting mode, the user's desired selection of the focus range for the subject at the position of the AF candidate frame is accepted. In this step, the initial state is set to a state in which all AF candidate frames are selected. Next, in step S602, the CPU 10 performs pre-processing, similar to step S500 in FIG. 5(a). Note that steps S611 to S618 in FIG. 6(a) are similar to steps S501 to S508 in FIG. 5(a), respectively, and therefore their description will be omitted. Also, steps S641 and S642 in FIG. 6(c) are similar to steps S511 and S512 in FIG. 5(a), and therefore their description will be omitted.

[0076] Steps S621 to S624 in Fig. 6(b) are a processing flow related to shooting condition 1, and steps S631 to S638 in Fig. 6(b) are a processing flow related to shooting condition 2, which are executed in parallel. The AF candidate frames in Fig. 12(b) are also examples in the two-condition shooting mode. In the explanation of Fig. 6(a), Fig. 6(b), and Fig. 6(c), the in-focus position is exemplified as the position in column D, row 3 in Fig. 12(b).

[0077] In step S621 in FIG. 6(b), the CPU 10 judges whether the photographing conditions are the initial photographing conditions. That is, the CPU 10 detects whether the photographing conditions 1 at the time of passing through this flow are the initial photographing conditions (first obtained photographing conditions) or later. If it is judged to be the initial photographing conditions, the process proceeds to step S624 since the target depth of field is not available. If the photographing conditions have been updated at the user's request, the focal range in the photographing conditions initially presented by the device is considered to have been changed, and the target depth of field is updated and the aperture value is redefined in step 622.

[0078] Next, in step S623, the CPU 10 reviews the shutter speed and ISO sensitivity so that the updated aperture value provides optimal exposure, and determines the shooting condition 1. If the shutter speed and ISO sensitivity are not satisfied with the redefined aperture value, the aperture value is adjusted. At this time, the device may be configured so that the ISO sensitivity and shutter speed can also be set within an adjustment range as settings for this mode of the digital camera 100.

[0079] Next, in step S624, the CPU 10 uses the first determination means 26 to determine whether or not the subject at the position of each AF candidate frame is within the depth of field (focus range) for the subject distance of the main subject.

[0080] In step S631, the CPU 10 obtains the subject distance of each of the AF candidate frames to be included in the focus range as the required depth of field from the main subject distance and the defocus amount for each frame. The relationship between the defocus amount and the subject distance (actual distance) may be obtained by equation (5). Next, in step S632, the CPU 10 sets the shooting condition 2 for focus bracketing. The focus bracketing shooting of this embodiment is executed to later extract the focus range from multiple captured images and combine them into one image (depth stacking). The depth stacking may be performed within the digital camera 100 (for example, the image processing means 16) or another device (such as a PC), and is not particularly limited. In this shooting condition 2, the aperture value, shutter speed, and ISO sensitivity may be common in each of the multiple images.

[0081] The depth of field obtained by the depth stacking of focus bracketed images in this embodiment is a continuous in-focus range, and is achieved by compositing any number of shots. For this reason, it is necessary to calculate an aperture value such that the range of the depth of field for the subject distance (shooting distance) does not become discrete in continuous shooting when focus bracketing is performed by moving the focus adjustment lens little by little.

[0082] Next, in step S633, the CPU 10 obtains the depth of field obtained for each focus bracketing shooting. Here, it is known how many images are required for the focus bracketing shooting to obtain the required depth of field by depth stacking. Hereinafter, this is referred to as the "number of divisions" for depth stacking. As described above, when the aperture value is common, if the focus adjustment lens moves, the depth of field for the focus position in each shooting changes (it becomes shallower the closer it is). With the current aperture setting, the number of divisions is determined so that there is no gap in the depth of field for each focus adjustment lens position in consecutive shooting (so that depth stacking does not break down). To simplify the calculation, the number of divisions may be determined by dividing the required depth of field by the depth of field at the frontmost position with the shallowest depth.

[0083] Next, in step S634, CPU 10 determines whether the number of divided sheets is at its limit. The number of images captured in focus bracketing photography in this embodiment is the number of divided sheets described above. The number of images allowed in focus bracketing photography differs between taking a still object using a tripod and taking a handheld shot or a moving subject. For this reason, the upper limit of the number of divided sheets in digital camera 100 may be set in a separate menu. If the number of divided sheets determined in step S633 exceeds the preset upper limit of the number of divided sheets, the process proceeds to step S635. On the other hand, if the number of divided sheets does not exceed the upper limit, the process proceeds to step S637.

[0084] In step S635, the CPU 10 narrows the aperture value of the photographing condition 2 by one step, deepens the depth of field for each photographing, and controls in a direction to reduce the number of photographs. Next, in step S636, the CPU 10 determines whether the updated aperture value is greater than the preset limit value. The limit value of the aperture is defined to avoid the effect of diffraction (resolution reduction). The aperture start value and limit value may be set in a separate menu as the initial value of the photographing condition 2. They may be defined on the device side for each lens. In this embodiment, these are not particularly limited. If the aperture value exceeds the limit value, the process proceeds to step S637. If the aperture can be changed, the process returns to step S632, and the setting of the photographing condition 2 is updated.

[0085] In step S637, CPU 10 calculates the movement distance on the image side from the subject distance (shooting distance) set for each focus bracketing shooting, using the relationship in formula (5). Then, CPU 10 calculates the lens movement amount for each shooting from the functional relationship for each lens, as described above (if the number of divided frames is determined simply, as described above, the intervals for each shooting will be equal). Next, in step S638, CPU 10 uses second determination means 27 to perform a depth of field determination for the focus adjustment lens position for each shooting, in the same manner as in step S624.

[0086] 6C, step S641 is similar to step S511, and step S642 is similar to step S512, and is an LV display process while S1 is pressed, so a description of these will be omitted. Next, in step S651, CPU 10 determines whether or not depth determination after focusing is completed. If it is determined in step S615 that the focus is not achieved and the process has transitioned to step S651 via step S616, the process transitions to step S652, where the same LV display process as step S521 is executed. If the focus is achieved and the depth has been determined in each of steps S624 and S638, the process transitions to step S653.

[0087] In step S653, CPU 10 displays AF candidate frames superimposed on the subject in LV display, and notifies the user of the current depth state (focus range). Fig. 12(d) is an example of the AF candidate frames of the focus range notified to the user in step S653. The focus frame is the frame in column D, row 3. The AF candidate frames within the depth of field obtained by one focus shooting under shooting condition 1 are column B, rows 2 to 5, column C, rows 2 to 5, column D, and row 5.

[0088] When performing focus bracketing shooting under shooting condition 2, the AF candidate frames within the depth of field for each shot (which become the in-focus range as a result of depth stacking) are in column A, row 3, column B, rows 2 to 5, column C, rows 2 to 5, column D, rows 4 to 5, column F, and rows 2 to 3, column E in Fig. 12(d). In the superimposed display, whether shooting under shooting condition 1 or shooting under shooting condition 2, the frames that become the in-focus range on the captured image are displayed in the same way as the AF candidate frames within the depth of field obtained when shooting under shooting condition 1.

[0089] AF candidate frames that correspond to the focus range that can only be obtained by shooting under shooting condition 2 in Fig. 12(d) are shown with the frame filled in. These frames are in column A, row 3 and column E, rows 2 and 3 in Fig. 12(d). The user checks this display state and selects whether to shoot under shooting condition 1 or shooting condition 2, change shooting condition 1, or select (add, delete) AF candidate frames to be used as the focus range.

[0090] In step S654, if the user requests the addition or deletion of any AF frame candidate to or from the focusing range notified in step S653, the process proceeds to step S655. Otherwise, the process proceeds to step S656. For example, in the two-condition shooting mode, the state transition to step S655 may be assigned to pressing the AE lock button 117.

[0091] In step S655, the selection position of the AF candidate frame is changed and the selection is confirmed using the cross key 114 and the SET button 115, and the process proceeds to step S662. Since switching between adding to and deleting from the focusing range is limited to this mode, the INFO button 122 may be assigned to this function. The selected frame to be added or deleted may be notified to the user by changing the frame color or blinking, etc. Note that in this embodiment, the display form related to this change is not limited.

[0092] When a focus range frame is added, for shooting condition 1, the aperture value is adjusted to be larger. If in step S623 the aperture value is outside the adjustment range, the aperture value is set to the upper limit within the optimum exposure range. For shooting condition 2, the number of shots taken in focus bracketing is increased (the amount of movement of the focus adjustment lens is increased). If the upper limit is reached, the change is not made and the focus range remains the same. When a focus range frame is released, for shooting condition 1, the aperture value is adjusted to be smaller. If it is not made due to light control, the change is left the same. For shooting condition 2, the number of shots taken in focus bracketing is reduced.

[0093] As mentioned above, there are cases where the adjustment of the focus range frame is not successful. The results of adjustment to the limit values ​​of the aperture value, etc. are reevaluated in steps S624 and S638, and the content of the notification to the user is updated in step S653. If the user wishes to abandon the current settings, the user should simply release the S1 pressed state of the shutter button 102.

[0094] In step S656, the CPU 10 determines whether or not the user has changed the photographing condition 1. For example, if the settings of the shutter speed, the aperture value, etc. have been changed with the main electronic dial 112 or the like, the process proceeds to step S657, where the process of changing the photographing condition 1 is executed. If not, the process proceeds to step S658. In step S657, the set values ​​of the photographing condition 1 are updated, and the shutter speed, the aperture value, the ISO sensitivity, etc. are changed so as to obtain an appropriate exposure (other values ​​are changed in addition to those changed by member operation). The set values ​​related to the imaging means 14 are also updated (transferred to the imaging means 14 in the imaging means control S401 in the pre-processing S602).

[0095] In step S658, the CPU 10 determines whether or not a shooting request has been made by pressing S2 of the shutter button 102. If S2 is pressed, the process proceeds to step S659. If not, the process proceeds to step S660. In step S659, the CPU 10 executes shooting under shooting condition 1. Note that this step is similar to step S527, and therefore a duplicated explanation will be omitted. After the process of step S659 is completed, the flow of two-condition shooting is completed. In step S660, the CPU 10 determines whether or not a shooting request has been made by pressing the shutter button 116. If the shutter button 116 is pressed, the process proceeds to step S661. If not, the process proceeds to step S662.

[0096] In step S661, the CPU 10 executes focus bracketing photographing under shooting condition 2. Now, with reference to Fig. 9(a), focus bracketing photographing under shooting condition 2 will be described. Fig. 9(a) is a flowchart showing the process of focus bracketing photographing under shooting condition 2.

[0097] First, in step S901, the CPU 10 determines whether all the imaging operations required in this flow have been completed. If it is determined that all the imaging operations have been completed, the process proceeds to step S904. If not, the process proceeds to step S902.

[0098] In step S902, the CPU 10 judges whether the next image capture can be accepted. If it is judged that the next image capture cannot be accepted, the process proceeds to step S904. On the other hand, if it is judged that the next still image can be captured, the process proceeds to step S903. In step S903, the execution of the next image capture process shown in FIG. 9B is kicked off.

[0099] The imaging process in Fig. 9(b) is executed in parallel with the processing routine in Fig. 9(a). In the processing in Fig. 9(a), in order to perform multiple shooting at high speed by focus bracketing, shooting and subsequent processing are performed in parallel, so the imaging process is a separate processing routine.

[0100] FIG. 9B is an imaging process flow chart when focus bracketing imaging is performed under the imaging condition 2. First, in step S920, the CPU 10 controls the driving of the imaging means 14 (setting of the driving means 14). Since step S920 is the same as step S401 in FIG. 4, its description will be omitted. Next, in step S921, the CPU 10 performs sensor reading. Since step S921 is the same as step S402 in FIG. 4, its description will be omitted. Next, in step S922, the CPU 10 performs sensor correction processing. Since step S922 is the same as step S403 in FIG. 4, its description will be omitted. The captured and corrected RAW image data may be temporarily stored in the large-capacity memory 12. The timing of the temporary storage of the data is not limited. The image data related to FIG. 9B may be controlled by the CPU 10 using a semaphore, for example. The imaging acceptance determination in step S902 can be performed by this.

[0101] In step S904 in FIG. 9(a), the CPU 10 determines whether the number of images to be compressed has been completed. If the number of images to be compressed has been completed, the process proceeds to step S908. If the number of images to be compressed has not been completed, the process proceeds to step S905. In this embodiment, FIG. 9(a) shows that the RAW image file resulting from focus bracketing photography in the two-condition photography mode is losslessly compressed (losslessly compressed) and then recorded as a file. The depth stacking itself may be realized by a PC or the like outside the digital camera 100. Alternatively, the multi-focus image mentioned in Patent Document 2 may be generated inside the digital camera 100. When processing inside the digital camera 100, the RAW image data may be temporarily stored in the large-capacity memory 12 without being losslessly compressed. In this embodiment, the storage / recording of the RAW image and / or the depth stacking means are not limited.

[0102] In step S905, the CPU 10 determines whether or not there is RAW image data to be processed at this time. If there is RAW image data that can be lossless compressed, the process proceeds to step S906. If not, the process proceeds to step S908. Next, in step S906, the CPU 10 determines the process acceptance status of the codec 20. If the codec 20 can accept data, the process proceeds to step S907. If the codec 20 is already in the process of compressing RAW data that was previously captured, the process proceeds to step S908.

[0103] Next, in step S907, the CPU 10 kicks off the execution of lossless compression processing (lossless compression processing is used because the image is before focus stacking, but lossy compression may also be used. There is no particular limitation). The processing itself can be executed in parallel with the flow by starting the codec 20 separately, but since there is no other processing, it is not shown. The compressed image data may be temporarily stored in the large-capacity memory 12 and semaphore-managed by the CPU 10. Next, in step S908, the CPU 10 determines whether or not all the image files acquired in the focus bracketing shooting in the two-condition shooting mode have been recorded in the recording media 25. If all the images have been recorded, this flowchart is completed, and the two-condition shooting flow shown in FIG. 6(a), FIG. 6(b), and FIG. 6(c) is also completed. If not, the process proceeds to step S909.

[0104] In step S909, the CPU 10 determines whether or not there is compressed image data that can be recorded on the recording medium 25. If there is compressed image data, the process proceeds to step S910. If not, the process proceeds to step S901.

[0105] In step S910, the CPU 10 kicks off the execution of the recording control process. Under the control of the recording control means 24, the compressed image data is recorded as a file on the recording medium 25. In this embodiment, the file format and the recording medium are not limited. Note that inserting and removing the recording medium 25 and checking the free space are not features of this embodiment and are not limited thereto, so are not shown. Completion of the recording control may be achieved by issuing an interrupt to the CPU 10 when writing to the recording medium 25 is completed. After completion of the process of step S910, the process transitions to step S901.

[0106] After completing the process of step S661 in FIG. 6(c), the flow of two-condition photography is completed. In step S662 in FIG. 6(c), the CPU 10 judges whether the shutter button 116 is pressed. If the S1 is pressed, the flow transitions to step S602 in FIG. 6(a). If the S1 is released, the flow of two-condition photography is completed. The flow of judgments S654, S656, S658, and S660 is instantaneous, and the user's operation may not keep up. In that case, the flow transitions from the judgment of step S662 to step S602, and the same process is repeated. In this embodiment, the flow is such that the focus adjustment lens is fixed after one focusing, but the process may be configured not to have step S612 (such that the processes S613 to S616 are performed for each flow) as an AF mode that tracks the subject.

[0107] CPU 10 detects pressing of playback button 119 during playback display determination in step S303 of Fig. 3, and executes playback display processing in step S309. Fig. 7 is a flowchart showing the playback display processing of digital camera 100 in this embodiment.

[0108] First, in step S701, the CPU 10 selects an image to be displayed and played back. As an example, a thumbnail image of an image file recorded in the recording medium 25 is displayed on the display unit 101 to allow the user to select an image to be played back. The thumbnail image may be recorded in the image file together with the actual image data as image data for display. A plurality of thumbnail images may be displayed on the display unit 101, and the selection state of the image may be changed using the cross key 114, and the selection may be confirmed using the SET button 115. After the image is selected, the process proceeds to step S702.

[0109] Next, in step S702, the CPU 10 executes a compressed image read process. That is, the CPU 10 reads the file data of the selected image from the recording medium 25 by the recording control means 24, and temporarily stores it in the large capacity memory 12 as compressed image data. Next, in step S703, the CPU 10 executes an expansion process of the read compressed image. That is, the CPU 10 expands the compressed image data temporarily stored in the large capacity memory 12 by the codec 20. Next, in step S704, the CPU 10 executes a display control process. That is, the CPU 10 displays the expanded image data on the display unit 101. The display control means 21 reads the image data from the large capacity memory 12, and develops it on the VRAM 22. If pressing of the INFO button 122 is detected, the image information is developed on the VRAM 22 in a form superimposed thereon, but since this is not a feature of this embodiment, details thereof will be omitted.

[0110] Next, in step S705, the CPU 10 determines whether the display time has elapsed. For timing, a timer (not shown) may be provided as a peripheral means of the CPU 10. The timer may be started in step S704. If the display is completed (timer completed), the process proceeds to step S708. On the other hand, if the display is to continue, the process proceeds to step S706.

[0111] In step S706, the CPU 10 determines whether the mode has been changed. If it is detected that the mode change switch 121 has been operated while the selected image is being displayed, the process proceeds to step S708 to interrupt the playback display process. If not, the process proceeds to step S707.

[0112] In step S707, CPU 10 determines whether or not a change in the displayed image has been requested by the user. If, for example, pressing of playback button 119 is detected while the currently selected image is being displayed, the process proceeds to step S701, where a thumbnail image is displayed and the displayed image can be changed by selecting a new image. If not, the process proceeds to step S705, where the current image display is continued.

[0113] In addition to the above, the display image may be changed by detecting the pressing of the left (right) button on the cross key 114, for example, and updating the file before (after) the currently selected file number as the selected file. The file number at this time may depend on the OS, or may be managed by consecutive file names. It may also be managed by the creation time instead of the number. There is no limitation here. In this case, since the file selection has already been made, the process may transition to step S702 in FIG. 7 (not shown).

[0114] In step S708, the CPU 10 executes a control process to stop display. That is, the CPU 10 stops the power supply to the display unit 101. The recording control means 24 may also stop file access to the recording medium 25 at this point. The event processes in steps S705, S706, and S707 may be interrupt processes to the CPU 10. This is not limited here.

[0115] The first determination means 26 and the second determination means 27 may include a register (not shown) that temporarily stores the defocus amount calculated for each AF candidate frame, and a means (based on the relationship of formula (5), not shown) that calculates the subject distance (actual distance) from the defocus amount for each AF candidate frame. The determination may be made based on whether the subject distance (actual distance) calculated for each AF candidate frame falls within the actual distance range of the depth of field for the focus position (main subject distance). A register (not shown) that temporarily holds the determination result may be included. This may be realized by software using the CPU 10, and the implementation form is not limited.

[0116] The device may be configured not to include the second determination means 27 (without executing step S638 in FIG. 6B), and to notify the user in step S653 with an EVF display similar to that in FIG. 12C. In that case, in the state where the depth of field in single focus shooting under shooting condition 1 is notified to the user, the user determines whether to perform single focus shooting or focus bracket shooting for depth stacking.

[0117] If the pixels of the image sensor (image sensor) of the imaging means 14 are implemented with pupil-divided pixels (not shown) to support image plane phase difference AF, and if they are deployed in front of the pixel array, for example, the arrangement of the AF candidate frames shown in Fig. 12(a) can be set to any position. In this embodiment, the arrangement and arrangement of the AF candidate frames are not limited. Furthermore, in this embodiment, the AF method is not limited either. EXAMPLES

[0118] Next, a second embodiment of the present invention will be described. In the first embodiment, a configuration example was described in which shooting conditions of one-time focusing shooting and focus bracketing shooting with depth stacking are prepared, and a choice of shooting modes is provided from a user interface. On the other hand, in this embodiment, a configuration example will be described in which shooting conditions of one-time focusing shooting and focus bracketing shooting are prepared as in the first embodiment, but the imaging device itself decides which shooting mode to adopt in the process.

[0119] In this embodiment, the object recognition means is used to perform the recognition process of the subject. The subject's unique depth of field is linked as information to the subject's recognition target, and when the recognition target appears in the subject during shooting, the linked depth of field data is used to calculate the target depth of field (target focusing range) during shooting. When determining whether the recognition target is the main subject or another subject, the handling of the focusing range may be changed depending on whether the recognition target is the main subject or another subject. For example, if it is not necessary to focus on anything other than the main subject, it is necessary to set the linking value of the main subject (first subject) and the linking value of the other subject (second subject) separately.

[0120] For example, assume that the recognition target is a car photographed from the front and has a depth of about 3m. If you want to focus only on the main subject, set the DOF (DOF stands for Depth Of Field) of the main subject to 3m, and the DOF of other subjects to 0m (DOF = 0m can be outside or inside the depth of field). There are front and rear depth of field for DOF, but it is easy for users to understand if they set it as the depth of the object. Since the calculation is simple, such as "how many meters should be secured behind the focal position," it is acceptable to define only the rear depth of field. The linking of depth information to this recognition target can be registered by the user using a menu.

[0121] In this embodiment, the object recognition means can recognize a recognition subject including a first subject and a second subject. The storage means (for example, the non-volatile memory 11 or the large-capacity memory 12) stores the first depth information for the recognition subject when the recognition subject is a main subject (first subject) and the second depth information for the recognition subject as a subject other than the main subject (second subject) in association with each other. Depending on whether the subject existing at the position corresponding to the AF candidate frame is the first subject or the second subject, the information read from the storage means is switched between the first depth information and the second depth information. That is, when a recognition target of the object recognition means appears as a main subject or a subject other than the main subject on an image area corresponding to the AF candidate frame, the associated depth information is called from the storage means and the depth of field at the time of shooting is determined based on the information. The storage means may also store depth information for each different recognition subject.

[0122] An imaging system 200a in this embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram of the imaging system 200a. The imaging system 200a is configured to include a digital camera 100a and a lens device (interchangeable lens) 13 that is detachable from the digital camera. The digital camera 100a differs from the digital camera 100 in the first embodiment in that it includes a motion detection means 30, an object recognition means 31, and a selection means 32. In Fig. 10, the same functions as those in Fig. 2 are designated by the same reference numerals, and descriptions thereof will be omitted if there is no difference in operation.

[0123] The motion detection means 30 is a detection means for detecting the motion of a subject (moving object). In this embodiment, the method of motion detection is not limited. For example, the CPU 10 can determine the direction and magnitude of the movement of the subject by using the result of a motion vector detection unit that detects the magnitude and direction of the motion vector of the subject image included in the entire image, which is a known technology.

[0124] The object recognition means 31 is a recognition means for estimating a subject (recognizing a subject). In this embodiment, the algorithm is not limited. It may capture geometric features, or may digitize an image and statistically compare it with a template. In the latter case, it may be implemented as a general-purpose deep learning means, and the object recognition result may be obtained in coordinates, or may be a map digitized for each block.

[0125] The selection means 32 selects either the photographing condition 1 or the photographing condition 2. In this embodiment, the selection means 32 receives the judgment result of the first judgment means 26, the detection result of the motion detection means 30, the recognition result of the object recognition means 31, and the result of the photographing condition 1 determined in step S1141 of FIG. 11(b) described later. Then, the selection means 32 executes the judgment process of steps S1143 to S1146 of FIG. 11(b) described later. The selection means 32 may be software processed by the CPU 10. The selection result by the selection means 32 may be displayed on the display means as shown in FIG. 13(a) to (f).

[0126] The operation of the digital camera 100a in this embodiment will be described below. Note that the overall flowchart is the same as in Fig. 3, the LV display processing flowchart is the same as in Fig. 4, the single focus shooting flowchart is the same as in Fig. 5, and the playback display processing flowchart is the same as in Fig. 7, so descriptions of them will be omitted.

[0127] Figures 11(a), 11(b), and 11(c) are flowcharts showing the process of two-condition photographing of the digital camera 100a in this embodiment. First, in step S1101 in Figure 11(a), the CPU 10 initializes the AF candidate frame selection state. Here, the CPU 10 sets all of the AF candidate frames to be included in the focus range under photographing condition 2 in the initial state of selection. This step is equivalent to step S601 in Figure 6(a).

[0128] The AF candidate frames in this embodiment are shown in Fig. 13(b). In Fig. 13(b), the frames are illustrated as an arrangement of five columns (A) to (E) and six rows (1) to (6). As in Fig. 12(a), the AF candidate frames are illustrated as being superimposed on the LV display image, and this embodiment is not limited to this arrangement.

[0129] Next, in step S1102 in Fig. 11(a), the CPU 10 performs pre-processing. This step is equivalent to step S602 in Fig. 6(a).

[0130] In step S1131 in FIG. 11(c), the CPU 10 performs development processing of an LV display image. This step is equivalent to step S641 in FIG. 6(c). Next, in step S1132, the CPU 10 performs correction processing for the display device. This step is equivalent to step S642 in FIG. 6(c). Note that each processing content has been mentioned above, so the description thereof will be omitted. As described later, the LV display image is superimposed with an AF candidate frame on the VRAM 22, and is displayed on the EVF 23 at the timing of step S1163. Steps S1131 and S1132 are processed in parallel with the processing flow system from step S1111 in FIG. 11(a). Steps S1111 to S1115 are focusing operations, and are equivalent to steps S612 to S616 in FIG. 6(a), respectively. Step S1116 is for obtaining main subject distance information from the lens device 13, and is equivalent to step S617 in FIG. 6(a).

[0131] Fig. 13(c) is an example of the in-focus frame position, and is not displayed in LV in this state. In this embodiment, the in-focus position in step S1116 is shown as an example at the position in column D, row 5 in Fig. 13(c). In step S1116, main subject distance information at this position is obtained.

[0132] 11(a), the CPU 10 executes object recognition using the object recognition means 31. Note that the implementation of the process is not limited to this, and it may be executed in the background in parallel with the focusing process after obtaining the imaging result in step S1102. If necessary, the developed image by the image processing means 16 may be used for the recognition process. The execution timing of the recognition process in this embodiment is not limited to this flowchart. It may be a flowchart in which the recognition result can be referenced in the main subject estimation in step S1112.

[0133] FIG. 13(a) is an example of a recognition result when the recognition target (subject) of the object recognition means 31 is a car. The example shows how two objects (Obj_1 and Obj_2 in FIG. 13(a)) are recognized for the subject within the shooting angle of view. In FIG. 13(a), rectangular frames are superimposed on Obj_1 and Obj_2, but this is for explanation purposes and does not need to be displayed in the LV image. The recognition result may be obtained as coordinate and size information, or may be obtained as map data as in the example (Obj_map) in the lower left of the figure (an area with a high recognition rate as a car will be the high score. The example shows this as frame data displayed like a brightness image). The interface of the recognition result is not limited.

[0134] Next, in step S1118 of Fig. 11(a), the CPU 10 executes motion detection using the motion detection means 30 to obtain the movement result of the subject. Note that the execution timing of the motion detection process of this embodiment is not limited to this flowchart. Next, in step S1119, the CPU 10 determines the presence or absence of a registered subject from the recognition result by the object recognition means 31. If an object with depth information associated therewith exists among the subjects, the process proceeds to step S1120. If not, the process proceeds to step S1122.

[0135] In step S1120, CPU 10 applies the depth information of the registered object that appears in the object recognition result. In this step, the positional relationship between the main subject frame position and the recognized object position is matched. If any recognized object overlaps the position of the main subject frame, the DOF value of the main subject (first object) in the depth information for that object is referenced. If it is not the main subject, the DOF value of another object (second object) is referenced.

[0136] As shown in Fig. 13(c), in this embodiment, the focus is on the headlights (right side) of the car Obj_1 shown in Fig. 13(a), so the DOF value of the main subject is applied to Obj_1. The DOF value of another subject is applied to Obj_2 in Fig. 13(a).

[0137] 11A, the CPU 10 updates the selected AF candidate frame. A target image area is set from the object recognition result, and the position of the AF candidate frame is matched. An AF candidate frame related to a registered object that appears in the object recognition result and has a DOF value specified (other than 0m) may be set as the selected frame.

[0138] Fig. 13(d) is an example for explaining the updated selection candidate frame, and is not displayed in LV. For Obj_1, the ranges of column C, rows 3 to 6, column D, rows 3 to 6 (however, D5 is the focus frame), and column E, rows 4 to 6 are shown as selection frames. The object rectangles are for explanation purposes, and the frame in column E, row 3 is not selected in area specification such as the map data (Obj_map) in Fig. 13(a). Similarly, for Obj_2, the ranges of column B, rows 1 to 2, and column C, rows 1 to 2 are shown as selection frames.

[0139] Next, in step S1122 in Fig. 11A, the CPU 10 executes defocus amount estimation. This step is equivalent to step S618 in Fig. 6A. The CPU 10 calculates the defocus amount of each AF candidate frame. In consideration of the reliability of the defocus amount calculation result as described above, in this step, any frame may be excluded from the selected AF candidate frame selected in step S1121.

[0140] Next, in step S1141 in FIG. 11B, CPU 10 determines shooting condition 1 for one-time focus shooting. Shooting condition 1 reflects the shutter speed, aperture value, ISO sensitivity, etc. set by the user operating electronic dial 112. Next, in step S1142, CPU 10 determines whether or not the subject at the position of the AF candidate frame selected using first determination means 26 is within the depth of field (focus range) for the subject distance of the main subject. This step is equivalent to step S624 in FIG. 6B.

[0141] Next, in step S1143, similarly to step S1119, the CPU 10 determines the recognition result by the object recognition means 31. If an object associated with depth information has been recognized, the process proceeds to step S1144. If not, the process proceeds to step S1147 to perform one-time focused shooting.

[0142] In step S1144, CPU 10 determines whether the amount of movement of the moving object is equal to or less than a limit value (predetermined amount of movement) (whether or not there is a moving object restriction) based on the motion detection result of step S1118. If the amount of movement of the moving object is equal to or less than the limit value, it determines that focus stacking using focus bracketing shooting with about a few shots is possible based on the relationship between the shutter speed and the continuous shooting speed, and transitions to step S1145. If not, transitions to step S1147 to perform one-time focus shooting. Note that in this embodiment, there is no limitation on the moving object restriction. If a moving object is detected, transitions to step S1147 may be made.

[0143] In step S1145, the CPU 10 determines whether the aperture value of the shooting condition 1 for single focus shooting determined in step S1141 is large or small. The large or small determination is performed based on a predetermined value, and the predetermined value is determined in advance taking into consideration the influence of diffraction of the aperture (for example, the aperture value exceeding F11 is not selected for single focus shooting). The aperture value (predetermined value) may be a fixed value set by the lens device 13, or may be determined by the user from a menu screen, and there is no limitation regarding the setting. If it is determined that the aperture value is larger than the predetermined value, the process proceeds to step S1148 to execute focus bracketing shooting. If not, the process proceeds to step S1146.

[0144] In step S1146, the CPU 10 performs depth determination based on the determination result of step S1142. If the first determination means 26 determines that all of the subjects at the selected AF candidate frame positions are within the focus range of the focus position, the process proceeds to step S1147 to perform one-time focus shooting. If not, the process proceeds to step S1148 to perform focus bracketing shooting.

[0145] In step S1147, the CPU 10 selects the use of shooting condition 1 to perform single focus shooting, and prepares for pressing S2. The CPU 10 performs control settings so that shooting is performed under shooting condition 1 when S2 is pressed. In step S1148, the CPU 10 selects shooting condition 2 to perform focus bracketing shooting, and prepares for pressing S2. The CPU 10 performs control settings so that multiple shots are taken under shooting condition 2 when S2 is pressed.

[0146] Next, a process for preparing for focus bracketing photography in the two-condition photography mode will be described. In step S1150, the CPU 10 judges the recognition result by the object recognition means 31, similarly to step S1143. If an object associated with depth information is recognized, the process proceeds to step S1151. If not, focus bracketing photography is not selected, and the process proceeds to step S1161. At this time, since the in-depth-of-field judgment of the AF candidate frame for photography condition 2 is not executed, the second judgment means output may be controlled to be an out-of-depth judgment for all frames (processing flow not shown).

[0147] In step S1151, the CPU 10 calculates the depth of field so that the subject at the position of the AF candidate frame selected in steps S1101 and S1121 falls within the focus range for the current focus position. If the object recognition result overlaps with the main subject frame, a depth of field of the DOF setting value of the main subject is requested from the focus position (subject distance obtained from the lens). If the object recognition result is determined to be not the main subject, the DOF setting value of the other subject is applied. Since the defocus amount of the (selected) AF candidate frame other than the main subject is calculated in step S1122, the DOF setting value of the other subject is applied as the rear depth of field for that position. The conversion from the defocus amount to the subject distance uses the relationship of the above-mentioned formula (5). The nearest subject distance and the farthest subject distance required as the focus range during depth stacking are calculated as described above (depth information by the DOF setting value and subject distance information converted from the defocus amount), and the difference between them becomes the required depth of field. In this embodiment, as shown in FIG. 13(d), Obj_1 is selected as the main subject, and Obj_2 is selected as the other subject.

[0148] Next, in step S1152, CPU 10 determines shooting condition 2 for focus bracket shooting. In digital camera 100a, the aperture value to be used as a default in focus bracket shooting in the two-condition shooting mode and the maximum number of images to be bracketed for focus stacking may be set in advance in the menu settings.

[0149] The default value of the aperture value for focus bracketing may be defined as, for example, an aperture value with good MTF for the lens (e.g., F5.6, etc.). If the aperture value is small, the number of bracketed shots will increase. Also, if the aperture value is large, the image will be affected by diffraction, reducing image resolution. In this embodiment, the default value of the aperture value is not limited. The shutter speed, ISO sensitivity, etc. are determined from the aperture value and the photometric value of the evaluation means 17.

[0150] Next, in step S1153, the CPU 10 calculates the depth of field for each of the multiple shots. In step S1105, since the subject distance to the device in the required focus range has been obtained as described above, the depth of field when shooting from the front is calculated. The forward depth of field becomes deeper as the subject distance increases. Therefore, the position obtained by adding the forward depth of field obtained in the same manner to the distance deeper by the rear depth of field of the current depth of field calculation result is set as the focus position obtained by the next movement of the focus adjustment lens. The forward depth of field and rear depth of field for this new focus position are calculated to determine the next focus position. This calculation is repeated backward by the required depth of field. The number of times this is repeated is the number of shots in focus bracketing. Next, in step S1154, the CPU 10 determines whether the number of shots obtained in step S1153 exceeds the maximum number set (whether the number of divided shots is at the limit). If it is determined that the number of shots exceeds the maximum number, the process proceeds to step S1155. If it is determined that the number of shots is within the allowable range, the process proceeds to step S1157.

[0151] In step S1155, the CPU 10 updates the aperture value setting of shooting condition 2 to narrow it down by one step. Next, in step S1156, the CPU 10 determines whether the aperture value has reached the set value (whether the aperture value is at its limit). If it is determined that the aperture value has reached the set value, the limit of depth acquisition by focus bracketing shooting has been reached, and the process proceeds to step S1157. If not, the process returns to step S1152. The set value of the aperture value limit here may be the maximum value of the lens aperture value, or may be a value that can be set in advance by a menu taking into account the effects of diffraction. In this embodiment, the setting method and range are not limited.

[0152] In step S1157, CPU 10 determines the movement control amount of the focusing lens. Each of the in-focus positions by the movement of the focusing lens determined in step S1153 is set as the subject distance (the previous in-focus position and the next in-focus position are set as the object movement amount a), and the defocus amount on the image side is calculated from the relationship in formula (5). As explained in step S637 in FIG. 6(b), the defocus amount is converted to the lens movement amount from the functional relationship of each lens. Next, in step S1158, CPU 10 uses the second determination means 27 to perform a determination of whether the focusing lens position is within the depth of field for each shooting, similar to step S638.

[0153] In step S1161 of FIG. 11C, the CPU 10 determines whether or not the in-depth-of-field determination has been performed for each of the AF candidate frames in step S1142 (whether or not the depth has been determined). If it is determined to be in focus in step S1114, the process proceeds to step S1162. If not, the process proceeds to step S1163. In step S1162, the CPU 10 executes LV display processing, similar to step S652. In step S1163, the CPU 10 notifies the user of the current depth state (focus range), similar to step S653.

[0154] FIG. 13(e) is an example of LV display of the focus range frame when the DOF of the main subject is set to 3 m and the DOF of other subjects is set to 0 m for the recognized object "car", and is notified to the user as a display result of the EVF 23 via the eyepiece unit 105. In FIG. 13(e), the desired depth of field is obtained by one-time focus shooting for the Obj_1 selection frame, so shooting condition 1 is selected at the time of shooting. 1301 in FIG. 13(e) is an icon display notifying the user that one-time focus shooting under shooting condition 1 has been selected for shooting at this time. 1302 in FIG. 13(e) is an icon indicating that the device itself is in a shooting mode in which the device itself selects which shooting mode (one-time focus shooting or focus bracket shooting) to determine and obtains the desired depth of field, as described at the beginning of this embodiment. In this embodiment, this shooting mode is called depth of field (DOF) automatic (AUTO) mode, but the name is not limited to this.

[0155] FIG. 13(f) is an example of LV display of the focus range when the DOF of the main subject is set to 3m and the DOF of other subjects is set to 3m for the recognized object "car". The same setting is made for Obj_1, which is the main subject. In this figure, since the DOF value is set for Obj_2, it is necessary to fit the rear car in FIG. 13(f) within the depth of field to make it the focus range. In the example of FIG. 13(f), for Obj_2, the AF candidate frame (rows 1-2 of column B, rows 1-2 of column C) is notified to the user so that it can be made the focus range in the depth synthesis image by focus bracketing. An icon 1303 in FIG. 13(f) is an example of notifying the user that the digital camera 100 has selected focus bracketing. FIG. 13(g) is an enlarged view of the icon 1301. FIG. 13(h) is an enlarged view of the icon 1302. FIG. 13( i ) is an enlarged view of the icon 1303 .

[0156] The DOF value associated with the recognition target varies depending on the angle from which the user wants to photograph the subject. In this embodiment, the user intends to photograph the car from almost the front, and the depth is set to 3 m in advance. The method of determining the DOF value is not limited to this embodiment. The DOF value may be set from a menu screen (not shown).

[0157] 11C, the CPU 10 determines whether or not the photographing condition 1 has been changed on the main electronic dial 112 or the like, similarly to step S656. If it is determined that the photographing condition 1 has been changed, the process proceeds to step S1165, where the CPU 10 changes and updates the photographing setting values, similarly to step S657. If not, the process proceeds to step S1166.

[0158] In step S1166, the CPU 10 determines whether or not a shooting request has been made by pressing the S2 button of the shutter button 102. If the shutter button 102 is in the S2 pressed state, the process proceeds to step S1167. If not, the process proceeds to step S1168.

[0159] In step S1167, CPU 10 executes photography. In this subroutine, processing is determined according to the selection result of whether the photography condition is photography condition 1 or photography condition 2. If it is the former, the photography execution flow for photography condition 1 shown in Fig. 8 is executed, and if it is the latter, the focus bracket photography execution flow for photography condition 2 shown in Fig. 9(a) is executed. After execution, the two-condition photography flow is completed.

[0160] In step S1168, the CPU 10 determines the pressed state of the shutter button 116. If the shutter button 116 is in the S1 pressed state, the process proceeds to step S1102. If the shutter button 116 is in the S1 released state, the present flow of two-condition photographing is completed.

[0161] In this embodiment, an automobile is exemplified as an object to be recognized. However, in this embodiment, the object to be recognized is not limited, and multiple different objects may be recognized at the same time. In addition, for example, when a human body is the object to be recognized, the DOF setting value may be switched between adults and children. Assuming that children are more mobile than adults, the depth may be given more space in consideration of the state in which the limbs are stretched. A DOF value to be linked may be set separately for each type of animal (dog, cat) (each type of dog). In this embodiment, the specification of the object recognition means 31 is not limited. The object to be recognized may have individual DOF values ​​as appropriate. A representative DOF value may be preset at the time of shipment from the factory, etc.

[0162] Focus bracketing is applied when, for example, multiple images are taken by moving the focus adjustment lens, for example, in 10 pieces, so that the entire product to be listed in a catalogue is in the focus range, and the images in the focus range from each captured image are selected and combined into one image using a depth stacking algorithm. In this embodiment, taking into consideration the shooting of moving objects, the upper limit of the number of divided images may be determined (by the user from the menu screen) so that, for example, only 2 to 4 images are required to avoid the depth stacking result from failing. As described above, when deciding shooting condition 2, the upper limit of the number of divided images is determined in step S1154.

[0163] The continuous shooting speed for focus bracketing photography in this embodiment is related to the drive speed of the lens used, but for lenses that are slow to respond to drive requests, adjustments must be made at the design stage to make the motion restriction in step S1144 more sensitive. Since this also depends on the specifications of each individual product, adjustments for each lens will not be discussed here.

[0164] Although the formula (5) is introduced and used to convert the defocus amount into the subject distance based on the relationship of the lateral magnification of the lens, the reliability of the defocus amount estimation decreases depending on the subject conditions and / or the shooting conditions (occlusion, perspective conflict, etc.). For this reason, for example, the digital camera 100 may be provided with a separate dedicated distance measuring means. A technology called LiDAR (short for Light Detection And Ranging) may be used, which measures the distance by irradiating light and measuring the time it takes for the reflected light to bounce back. In this embodiment, the method of calculating the subject distance is not limited.

[0165] (Other Examples) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0166] According to each embodiment, the user can obtain the shooting conditions in the desired focus range without considering the relationship between the depth of field or the subject distance and the hyperfocal distance. Therefore, according to each embodiment, it is possible to provide an imaging device, a control method for the imaging device, a program, and a storage medium that allow the user to easily obtain the shooting conditions in the desired focus range.

[0167] The disclosure of each embodiment includes the following configurations and methods. (Configuration 1) An acquisition means for acquiring a first photographing condition when the first photographing is performed and a second photographing condition when the second photographing is performed; a display means for displaying the subject and the AF candidate frames in a superimposed manner; a first determination means for determining whether or not a position corresponding to the AF candidate frame falls within a focus range with a first depth of field obtained by the first photographing under the first photographing condition; and a second determination means for determining whether or not the position corresponding to the AF candidate frame falls within the focusing range at a second depth of field obtained by the second photographing under the second photographing condition, the display means displays a focus state for the position corresponding to the AF candidate frame in accordance with determination results of the first determination means and the second determination means. (Configuration 2) The first photographing is a single-focus photographing, 2. The imaging apparatus according to configuration 1, wherein the second shooting is focus bracketing shooting. (Configuration 3) The imaging device according to configuration 2, wherein the second depth of field is a value calculated based on a depth of field at each focus position obtained by the focus bracketing shooting under the second shooting condition. (Configuration 4) 4. The imaging device according to configuration 2 or 3, further comprising image processing means for performing focus stacking using a plurality of images acquired by the focus bracketing imaging. (Configuration 5) 5. The imaging apparatus according to any one of configurations 1 to 4, further comprising an operation member for changing at least one of the first shooting condition or the second shooting condition in response to a user's operation. (Configuration 6) Further comprising a selection means for selecting the first photographing condition or the second photographing condition, 5. The imaging apparatus according to any one of configurations 1 to 4, wherein the selection means selects the second photographing condition when the aperture value of the first photographing condition is larger than a predetermined value. (Configuration 7) Further comprising a selection means for selecting the first photographing condition or the second photographing condition, 5. The imaging device according to any one of configurations 1 to 4, wherein the selection means selects the second shooting condition when the AF candidate frame does not fall within the focus range under the first shooting condition. (Configuration 8) A selection means for selecting the first photographing condition or the second photographing condition; and a detection unit for detecting an amount of movement of the subject, 5. The imaging apparatus according to any one of configurations 1 to 4, wherein the selection means selects the first shooting condition when the amount of movement of the subject is greater than a predetermined amount of movement. (Configuration 9) 9. The imaging device according to any one of configurations 6 to 8, wherein the display means displays a result of the selection made by the selection means. (Configuration 10) The imaging device according to configuration 9, further comprising an operating member for changing the first shooting condition or the second shooting condition in response to a user's operation after the selection result is displayed on the display means. (Configuration 11) A recognition means capable of recognizing a recognition subject including a first subject and a second subject; a storage unit that stores, for each of the recognized objects, the first depth information of the first object and the second depth information of the second object in association with each other, An imaging device according to any one of configurations 1 to 10, characterized in that when the subject present at the position corresponding to the AF candidate frame is the first subject or the second subject, the first depth information or the second depth information is read out from the storage means. (Configuration 12) A recognition means capable of recognizing a recognition subject; 11. The imaging device according to any one of configurations 1 to 10, further comprising: a storage means for storing depth information for each of the recognized subjects. (Configuration 13) the first photographing condition is a photographing condition for performing the first photographing of the subject with an appropriate exposure, 13. The imaging apparatus according to any one of configurations 1 to 12, wherein the second photographing conditions are photographing conditions for performing the second photographing of the subject with an appropriate exposure. (Configuration 14) 14. The imaging device according to any one of configurations 1 to 13, wherein the first shooting condition and the second shooting condition each include conditions related to an aperture value, a shutter speed, and an ISO sensitivity. (Method 1) An acquisition step of acquiring a first photographing condition when performing the first photographing and a second photographing condition when performing the second photographing; a display step of superimposing and displaying the subject and the AF candidate frames; a first determination step of determining whether or not a position corresponding to the AF candidate frame falls within a focus range with a first depth of field obtained by the first photographing under the first photographing condition; a second determination step of determining whether or not the position corresponding to the AF candidate frame falls within the focusing range at a second depth of field obtained by the second photographing under the second photographing condition, A method for controlling an imaging device, characterized in that in the display step, a focus state for the position corresponding to the AF candidate frame is displayed depending on the judgment results of the first judgment step and the second judgment step. (Configuration 15) A program for causing a computer to execute the imaging device control method according to Method 1. (Configuration 16) A computer-readable storage medium storing the program according to configuration 15.

[0168] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0169] 17 Evaluation means (acquisition means) 23 EVF (display means) 26 First determination means 27 Second judgment means 100, 100a Digital camera (imaging device) 101 Display section (display means)

Claims

1. an acquisition means for acquiring a first photographing condition when the first photographing is performed and a second photographing condition when the second photographing is performed; A display means for displaying the subject and the AF candidate frame in a superimposed manner; a first determination means for determining whether or not a position corresponding to the AF candidate frame falls within a focus range at a first depth of field obtained by the first photographing under the first photographing condition; and a second determination means for determining whether or not the position corresponding to the AF candidate frame falls within the focusing range at a second depth of field obtained by the second photographing under the second photographing condition, The imaging apparatus according to claim 1, wherein the display unit displays a focus state for the position corresponding to the AF candidate frame in accordance with the determination results of the first determination unit and the second determination unit.

2. The first photographing is a single-focus photographing, 2. The imaging apparatus according to claim 1, wherein the second photographing is focus bracketing photographing.

3. 3. The imaging apparatus according to claim 2, wherein the second depth of field is a value calculated based on a depth of field at each in-focus position obtained by the focus bracketing imaging under the second imaging condition.

4. 3. The imaging apparatus according to claim 2, further comprising an image processing unit that performs focus stacking using a plurality of images acquired by the focus bracketing imaging.

5. 5. The imaging apparatus according to claim 1, further comprising an operation member for changing at least one of the first photographing condition or the second photographing condition in response to a user's operation.

6. A selection unit is further provided for selecting the first photographing condition or the second photographing condition, 2. The image pickup apparatus according to claim 1, wherein the selection means selects the second photographing condition when the aperture value of the first photographing condition is greater than a predetermined value.

7. A selection unit is further provided for selecting the first photographing condition or the second photographing condition, 2. The imaging apparatus according to claim 1, wherein the selection means selects the second shooting condition when the AF candidate frame does not fall within the focusing range under the first shooting condition.

8. A selection means for selecting the first photographing condition or the second photographing condition; and a detection unit for detecting an amount of movement of the subject, 2. The imaging apparatus according to claim 1, wherein the selection means selects the first photographing condition when the amount of movement of the subject is greater than a predetermined amount of movement.

9. 9. The imaging apparatus according to claim 6, wherein the display unit displays a result of the selection made by the selection unit.

10. 10. The imaging apparatus according to claim 9, further comprising an operating member for changing the first shooting condition or the second shooting condition in response to a user's operation after the selection result is displayed on the display means.

11. a recognition means capable of recognizing a recognition subject including a first subject and a second subject; a storage unit that stores, for each of the recognized objects, the first depth information of the first object and the second depth information of the second object in association with each other, The imaging device according to any one of claims 1 to 4, characterized in that when the subject present at the position corresponding to the AF candidate frame is the first subject or the second subject, the first depth information or the second depth information is read out from the storage means.

12. A recognition means capable of recognizing a recognition subject; 5. The imaging apparatus according to claim 1, further comprising a storage unit for storing depth information for each of the recognized subjects.

13. the first photographing condition is a photographing condition for performing the first photographing of the subject with an appropriate exposure, 5. The imaging apparatus according to claim 1, wherein the second photographing condition is a photographing condition for performing the second photographing of the subject with an appropriate exposure.

14. 5. The image capturing apparatus according to claim 1, wherein the first photographing condition and the second photographing condition each include conditions related to an aperture value, a shutter speed, and an ISO sensitivity.

15. an acquisition step of acquiring a first photographing condition when the first photographing is performed and a second photographing condition when the second photographing is performed; a display step of superimposing and displaying the subject and the AF candidate frame; a first determination step of determining whether or not a position corresponding to the AF candidate frame falls within a focus range at a first depth of field obtained by the first photographing under the first photographing condition; a second determination step of determining whether or not the position corresponding to the AF candidate frame falls within the focusing range at a second depth of field obtained by the second photographing under the second photographing condition, The control method for an imaging apparatus, wherein the display step displays a focus state for the position corresponding to the AF candidate frame depending on the determination results of the first determination step and the second determination step.

16. A program for causing a computer to execute the method for controlling an image pickup apparatus according to claim 15.

17. A computer-readable storage medium storing the program according to claim 16.

Images