FOCUS CONTROL DEVICE, FOCUS CONTROL METHOD, AND PROGRAM

Abstract

To prevent a situation in which focus is not adjusted on a subject intended by a user.SOLUTION: A focus control device includes focusing means that performs focusing by one of auto-focusing and manual focusing; and control means that, according to whether there is a subject on which focus is adjusted by manual focusing when auto-focusing is switched to manual focusing and then switched to auto-focusing, controls whether to perform focusing with a setting of auto-focusing before switching to manual focusing or perform focusing with a setting of auto-focusing after switching from manual focusing.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The present invention relates to a focus control device, a focus control method, and a program. [Background technology]

[0002] Digital cameras have an autofocus (hereinafter, AF) function that performs focus control to automatically focus on a predetermined area on the screen. Various methods are used to select an area to be focused by AF. As related techniques, the techniques of Patent Documents 1 and 2 have been proposed. In the technique of Patent Document 1, when switching from AF to MF (manual focus), multiple small areas are set within an area set by AF. Then, when switching from MF to AF, an AF area determined to be in focus among the multiple areas set by MF is set. In the technique of Patent Document 2, focus control is performed by manual operation, and when the best focus is achieved on the subject, the focused range is divided into multiple areas, and the position of the AF frame is automatically set from the divided areas. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-206352 A [Patent Document 2] JP 2010-97167 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology of Patent Document 1, an area based on MF operation is set within the AF area set for the subject. If the subject to be focused is outside the AF area before MF operation, AF control cannot be performed on the subject to be focused, and the user cannot focus on the intended subject. In the technology of Patent Document 2, the AF position is set after MF operation. For this reason, the user needs to perform MF operation to focus on the intended subject in various scenes every time he takes a photograph, and a high level of skill is required of the user. As a result, the user may not be able to focus on the intended subject. Such a problem can occur in any device that controls a focus other than an imaging device such as a digital camera.

[0005] Therefore, an object of the present invention is to prevent a situation in which the subject intended by the user is not focused on. [Means for solving the problem]

[0006] In order to achieve the above object, the focus control device of the present invention comprises: A focus detection unit calculates a defocus amount based on a first focus detection signal and a second focus detection signal output from an image sensor, and automatically controls the position of the focus lens using the defocus amount. Autofocus and , and controls the position of the focus lens in response to user operation input. a focus adjustment means for adjusting the focus by either a manual focus or a manual focus; a first focus adjustment process for performing focus adjustment so as to give priority to a subject in an AF area near the center of the screen and close to the subject in the autofocus; After switching from the auto focus to the manual focus, From the manual focus When the autofocus is switched to, a second focus adjustment process for performing, when the manual focus is switched to autofocus in a state in which the subject focused in the manual focus has been switched to another subject, a focus adjustment process for performing a focus adjustment in the autofocus after the switching so as to keep the focus on the other subject focused in the manual focus. A control means. In the second focus adjustment process, when determining whether or not another subject focused by the manual focus is present, whether or not there is a subject that is in focus or close to being in focus is determined based on whether or not there is a detection result by the focus detection means within a predetermined depth within an AF area, and the predetermined depth is deeper than a depth at which the subject is determined to be in focus by the autofocus. . Effect of the Invention

[0007] According to the present invention, it is possible to prevent the subject intended by the user from being out of focus. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of a configuration of an imaging device. [Diagram 2] FIG. 4 is a diagram showing an example of each distance measurement target area. [Diagram 3]11 is a flowchart showing an example of the overall process flow of focus control. [Figure 4] 13 is a flowchart illustrating an example of an initialization monitoring process. [Diagram 5] 10 is a flowchart showing an example of the flow of a focus mode selection process. [Figure 6] 13 is a flowchart showing an example of the flow of MF processing. [Figure 7] 3A to 3C are diagrams illustrating the positional relationship of focus lenses and various examples of screens. [Figure 8] 13 is a flowchart showing an example of a process for setting a distance measurement target AF area and an AF control mode immediately after switching from the MF control mode to the AF control mode. [Figure 9] FIG. 11 is a diagram illustrating an example of a state transition of an AF process. [Figure 10] 6 is a flowchart showing an example of the flow of an AF process according to an AF control mode. [Figure 11] 11 is a flowchart continuing from FIG. 10. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in the embodiments.

[0010] FIG. 1 is a diagram showing an example of the configuration of an imaging device 100 according to the present embodiment. The imaging device 100 is, for example, an imaging device such as a digital camera or a video camera. The imaging device 100 corresponds to a focus control device that performs focus control. The focus control device may be, for example, an electronic device such as a smartphone or a tablet terminal. In addition, when the imaging device 100 has a communication function, the function of the focus control device may be performed by an external server (information processing device), and the control of the present embodiment may be realized by wireless communication between the external server and the imaging device 100.

[0011] The imaging device 100 has an imaging optical system for forming an image of light from a subject. In the example of FIG. 1, the imaging optical system is composed of a first group lens 101, a variable magnification lens 102, an aperture 103, a second group lens 104, and a focus lens 105 (focus compensator lens). The first group lens 101 and the second group lens 104 are fixed lenses. The variable magnification lens 102 moves in the optical axis direction to perform a variable magnification operation. The focus lens 105 has a function of correcting the movement of the focal plane accompanying the variable magnification operation and a function of focusing. The aperture 103 has a predetermined aperture function. The imaging optical system further includes a focus ring (not shown), and the focus lens 105 moves in the optical axis direction according to the amount of manual operation of the focus ring.

[0012] The imaging element 106 is a photoelectric conversion element such as a CCD sensor or a CMOS sensor. Light passing through an imaging optical system forms an image on the imaging element 106. The imaging element 106 performs photoelectric conversion on the formed light and outputs an electric signal. The CDS / AGC circuit 107 samples the electric signal output by the imaging element 106 and adjusts the gain. The camera signal processing circuit 108 performs image processing on the output signal from the CDS / AGC circuit 107 to generate an imaging signal (image). The monitor device 109 is a display such as an LCD, and displays the image from the camera signal processing circuit 108. The monitor device 109 also displays information on the shooting mode of the imaging device 100 and information such as an AF measurement frame serving as a guide for the set focus detection area, together with the imaging signal. The recording device 110 records the image output by the camera signal processing circuit 108 on a storage medium such as a magnetic tape, an optical disk, or a semiconductor memory.

[0013] The zoom lens driving source 111 is a driving source for moving the variable magnification lens 102 in the optical axis direction for a variable magnification operation. The focus lens driving source 112 is a driving source for moving the focus lens 105 in the optical axis direction for focus adjustment. The zoom lens driving source 111 and the focus lens driving source 112 are each constituted by an actuator such as a stepping motor, a DC motor, a vibration type motor, or a voice coil motor.

[0014] The phase difference AF gate 113 is a gate that passes a first focus detection signal and a second focus detection signal that correspond to a focus detection area in the AF frame and are detected by the phase difference AF method among the pixels set by the ranging area setting unit 118. The phase difference AF signal processing unit 114 performs correlation calculation based on the two focus detection signals that have passed through the phase difference AF gate 113, and calculates the amount of image shift for each focus detection area. The calculated amount of image shift is output to a focus position detection unit 119 of the camera microcomputer 115. The camera microcomputer 115 includes a focus position detection unit 119, a focus determination unit 120, a focus control unit 121, and a zoom control unit 122.

[0015] The focus position detection unit 119 calculates the amount of deviation (defocus amount) between the current focus position and the in-focus position on the imaging surface of the image sensor 106 based on the amount of image deviation calculated by the phase difference AF signal processing unit 114, using a focus detection method of the phase difference AF method. The focus position detection unit 119 transmits the calculated defocus amount to the focus control unit 121. The focus position detection unit 119 also converts the calculated defocus amount into a drive amount of the focus lens 105 and transmits it to the focus determination unit 120. The focus determination unit 120 transmits information on the drive amount of the focus lens 105 to the focus control unit 121. The focus control unit 121 controls the focus lens drive source 112 based on the received drive amount information to drive the focus lens 105, thereby executing AF control for automatic focus adjustment.

[0016] The TV-AF gate 116 and the TV-AF signal processor 117 are provided to realize the TV-AF method adopted as an AF method other than the phase difference AF method. The TV-AF gate 116 supplies only signals of an area used for focus detection by TV-AF among the output signals of all pixels from the CDS / AGC circuit 107 to the TV-AF signal processor 117. The TV-AF signal processor 117 applies a method such as extraction of a specific frequency component using a filter to the image signal in the TV-AF focal area (in the AF frame in this embodiment) supplied from the TV-AF gate 116. Then, the TV-AF signal processor 117 generates a TV-AF evaluation value such that the sharpness (degree of contrast) of the image is the highest at the in-focus position. The generated TV-AF evaluation value is transmitted to the in-focus determination unit 120. The generated TV-AF evaluation value is also transmitted to the focus control unit 121. Based on the received TV-AF evaluation value, the focus control unit 121 controls the focus lens driving source 112 to drive the focus lens 105, thereby performing AF control by the TV-AF method.

[0017] The ranging area setting unit 118 sets a pixel group from which the first focus detection signal and the second focus detection signal are to be input to the gate 113 for phase difference AF are read out from all pixels of the image sensor 106. The ranging area setting unit 118 can arbitrarily specify which area is to be read out for phase difference AF. The memory 123 stores a program executed by the focus control unit 121 of the camera microcomputer 115 and arbitrary information. The camera microcomputer 115 including the focus control unit 121 is realized by, for example, a CPU. The control of this embodiment is realized by the CPU of the camera microcomputer 115 executing the program stored in the memory 123. The camera microcomputer 115 may be realized by a predetermined programming circuit. The camera microcomputer 115 or the focus control unit 121 corresponds to a focus control device.

[0018] In this embodiment, it is possible to switch between two focus control modes: AF (autofocus) for automatic focus adjustment and MF (manual focus) for manual focus adjustment by the user. The focus control unit 121 of the camera microcomputer 115 can alternate between the AF mode and the MF mode based on a user operation.

[0019] Next, a description will be given of a method for setting the distance measurement area performed by the distance measurement area setting unit 118. In this embodiment, the focus control unit 121 sets one of the following two distance measurement target AF areas based on a user operation. -First focusing area (Standard) Second AF area (Wide) When the first AF area to be measured (Standard) is set, the imaging device 100 performs AF on a subject near the center of the screen. When the second AF area to be measured (Wide) is set, AF is also performed on a subject in a wide area including a range outside the first AF area to be measured (Standard). Basically, the main subject of the subject to be photographed is highly likely to be present near the center of the screen. Therefore, the first AF area to be measured (Standard) is an area set to exclude subjects in the peripheral area of ​​the screen (area other than the center of the screen). On the other hand, the main subject may be present outside the first AF area to be measured (Standard). The second AF area to be measured (Wide) is an area for performing AF on a subject located outside the first AF area to be measured (Standard). In other words, the second AF area to be measured (Wide) is an area obtained by enlarging the first AF area to be measured (Standard).

[0020] FIG. 2 is a diagram showing an example of each distance measurement target area. FIG. 2(a) is a diagram showing a maximum distance measurement area 201 for a captured image 200, which is an image signal acquired from the camera signal processing circuit 108. The distance measurement area 201 is divided into a plurality of distance measurement areas in a lattice pattern. Each of the following distance measurement target AF areas is also divided into a plurality of distance measurement areas in a lattice pattern. FIG. 2(b) is a diagram showing a first distance measurement target AF area (Standard) 202. FIG. 2(c) is a diagram showing a second distance measurement target AF area (Wide) 203. The first distance measurement target AF area (Standard) 202 is an area arranged near the center of the screen. The second distance measurement target AF area (Wide) 203 also includes an area outside the first distance measurement target AF area (Standard) 202 as a distance measurement target area. FIG. 2(d) is a diagram showing a third distance measurement target AF area (Catch) 204. The third AF area to be measured (Catch) 204 is an AF area to be measured when AF is started or for monitoring a new subject. The third AF area to be measured (Catch) 204 is an AF area to be used auxiliary when the first AF area to be measured (Standard) 202 is selected.

[0021] The imaging device 100 can change the maximum distance measurement area 201 to any one of the distance measurement target AF areas 202-204 depending on the state of the object and the AF state. This makes it possible to control so as to maintain a focused state on the object targeted by the user. During AF control, the focus control unit 121 issues a drive command to the focus lens drive source 112 using at least one or more distance measurement results among the multiple distance measurement results obtained from the distance measurement target areas 202-204.

[0022] Next, the AF control modes will be described. The imaging device 100 has the following two AF control modes. The imaging device 100 can arbitrarily select an AF control mode during AF from the following two AF control modes. First AF control mode (Normal) -Second AF control mode (Limit) When the first AF control mode (Normal) is set, the imaging device 100 performs AF control (center-priority AF control) by prioritizing an area near the center of the screen. When the first AF control mode (Normal) is set, AF control is performed on a nearby subject. When the first AF control mode (Normal) is set, the focus control unit 121 detects a subject present in the third distance measurement target AF area (Catch) 204 in the center of the screen based on the distance measurement result, and performs a focusing operation according to the distance measurement result. Once the detected subject moves within the screen, the focus control unit 121 continues AF control on the detected subject until the subject moves within the range of the first distance measurement target AF area (Standard) 202. This allows automatic tracking of the subject.

[0023] When a distance measurement result closer than the current focus lens position is detected in the third distance measurement target AF area (Catch) 204 near the center of the screen, the focus control unit 121 detects that a new main subject has appeared. The focus control unit 121 performs focus control according to the distance measurement result for the subject detected from the third distance measurement target AF area (Catch) 204.

[0024] When the first AF control mode (Normal) is set, the focus control unit 121 performs highly versatile AF control capable of focusing in various scenes in order to focus on subjects that appear close to the center one after another. The highly versatile AF control is AF control that selects an area to be focused on from within a range in which the proportion of the target area for AF control is somewhat limited to the screen. This prevents AF control from being erroneously performed on objects (e.g., walls, the ground, etc.) located on the periphery of the screen.

[0025] When the second AF control mode (Limit) is set, the focus control unit 121 performs AF control that prioritizes focusing (focus-priority AF control). In this case, the focus control unit 121 determines a subject that is in focus or close to being in focus at the current position of the focus lens 105 from the distance measurement result, and performs a focusing operation according to the distance measurement result. When the second AF control mode (Limit) is set, the focus control unit 121 does not change the subject targeted for AF even if a new subject appears in the third distance measurement target AF area (Catch) 204. This differs from the first AF control mode (Normal).

[0026] Therefore, in the second AF control mode (Limit), the focus control unit 121 does not switch the subject even if a new subject appears, and therefore performs a focusing operation only on the subject targeted by the user. In other words, the second AF control mode (Limit) is a highly dedicated AF control that performs a focusing operation only on the subject intended by the user. The setting of the first AF control mode (Normal) and the setting of the second AF control mode (Limit) are in an exclusive relationship. However, in the second AF control mode (Limit), when there is no subject near the focus point or when a specific condition is met, the mode transitions from the second AF control mode (Limit) to the first AF control mode (Normal).

[0027] Next, the relationship between the AF control mode and the AF area to be measured will be described. The imaging device 100 normally operates in a first AF control mode (Normal). The focus control unit 121 switches from the AF control mode to the MF control mode when the user performs an operation to switch from AF to MF. An example of an operation to switch from AF to MF is a focus ring operation by the user. The focus control unit 121 maintains the MF control mode while the focus ring operation continues, and switches from the MF control mode to the AF control mode when the focus ring operation ends. When the imaging device 100 switches from the MF control mode to the AF control mode, the focus control unit 121 identifies the position of the subject and determines the AF control mode and the AF area to be measured.

[0028] When the user operates the focus ring, the AF control mode is switched to the MF control mode. At this time, the user has performed an operation to the imaging device 100 requesting a change to the main subject automatically identified in the AF control mode. Therefore, at the timing of switching from the MF control mode to the AF control mode, in order to identify the subject targeted by the user by MF control, the focus control unit 121 performs the following determination. (1) Determine whether the AF control mode is the first AF control mode (Normal) or the second AF control mode (Limit) (2) Determine whether the AF area to be measured is the first AF area to be measured (Standard) or the second AF area to be measured (Wide). The above (1) is a judgment regarding the optical axis direction (Z axis). If the user does not focus on any subject other than the one he or she is aiming at, the first AF control mode (Normal) is changed to the second AF control mode (Limit). The above (2) is a judgment regarding the XY directions (vertical and horizontal movement within the screen) perpendicular to the optical axis direction (Z direction). When a user operation is triggered and the subject the user is aiming at is not in the center, the first AF area to be measured (Standard) is changed to the second AF area to be measured (Wide).

[0029] Next, focus control will be described. The following focus control process is basically realized by the focus control unit 121 of the camera microcomputer 115 executing a predetermined program. FIG. 3 is a flowchart showing an example of the overall process flow of focus control. The process of the flowchart in FIG. 3 is repeatedly executed, for example, at the read cycle of the imaging signal (image) from the imaging element 106. In S301, the focus control unit 121 executes a focus mode selection process. In the focus mode selection process, it is determined whether to set the AF control mode or the MF control mode. The focus mode selection process will be described in detail later.

[0030] In S302, the focus control unit 121 determines whether the focus mode selected in S301 is the AF control mode. If the focus control unit 121 determines Yes in S302 (if the AF control mode is selected), the process proceeds to S303. In S303, the focus control unit 121 determines whether the MF operation has just ended. If the mode of the imaging signal (image) read out immediately before is the MF control mode and the current mode (the mode one cycle later) is the AF control mode, the focus control unit 121 determines that the MF operation has just ended.

[0031] When the focus control unit 121 determines Yes in S303 (immediately after MF operation), the process proceeds to S304. In S304, the focus control unit 121 sets the AF area to be measured and the AF control mode according to the case immediately after MF operation. At this time, the focus control unit 121 sets either the first AF area to be measured (Standard) or the second AF area to be measured (Wide) as the AF area to be measured. In addition, the focus control unit 121 sets either the first AF control mode (Normal) or the second AF control mode (Limit) as the AF control mode.

[0032] In S305, the focus control unit 121 performs AF processing according to the setting contents set in S304. Details will be described later. In S306, the focus control unit 121 performs processing to monitor the initialization of the AF area to be measured and the AF control mode (initialization monitoring processing). At this time, the focus control unit 121 monitors the initialization conditions of the AF area to be measured and the AF control mode set in S304, and performs processing to set the initialization flag to ON / OFF. Details will be described later.

[0033] In S307, the focus control unit 121 determines whether the initialization flag is ON. If the focus control unit 121 determines Yes in S307 (if the initialization flag is ON), the process proceeds to S308. On the other hand, if the focus control unit 121 determines No in S307 (if the initialization flag is OFF), the focus control unit 121 ends the focus control process of FIG. 3. In S308, the focus control unit 121 returns the distance measurement target AF area to the first distance measurement target AF area (Standard). In S309, the focus control unit 121 returns the AF control mode to the first AF control mode (Normal). Then, the focus control unit 121 ends the focus control process of FIG. 3.

[0034] The focus operation in this embodiment is assumed to be a case where an AF operation is performed, followed by an MF operation, and then an AF operation is performed again. The AF setting (first setting) by the AF operation performed before the MF operation is a first AF area to be measured (Standard) and an AF control mode is a first AF control mode (Normal). The AF setting (second setting) by the AF operation performed after the MF operation may be a setting different from the first setting. Details will be described later.

[0035] When the focus control unit 121 determines No in S303 (when not immediately after MF operation), the process proceeds to S310. In S310, the focus control unit 121 sets a distance measurement target AF area and an AF control mode according to the case when not immediately after MF operation, and performs AF processing according to the settings. At this time, the focus control unit 121 sets the first distance measurement target AF area (Standard) as the distance measurement target AF area, and sets the first AF control mode (Normal) as the AF control mode. Then, the focus control unit 121 ends the focus control process of FIG. 3.

[0036] If the focus control unit 121 determines No in S302 (if the MF control mode is selected), the process proceeds to S311. In S311, the focus control unit 121 performs MF processing. Details of the MF processing will be described later. Then, the focus control unit 121 ends the focus control processing in FIG.

[0037] Next, the initialization monitoring process of S306 in FIG. 3 will be described. FIG. 4 is a flowchart showing an example of the initialization monitoring process. The initialization monitoring process is a process for monitoring whether or not the user has performed an operation to change the shooting scene. In this embodiment, at least one of the focal length, panning, MF operation, and distance measurement change is monitored to monitor whether or not the user has performed an operation to change the shooting scene. When an operation to change the shooting scene is performed, the focus control unit 121 sets a flag for returning to the initial value. As described above, the initial value is a setting in which the distance measurement target AF area is the first distance measurement target AF area (Standard) and the AF control mode is the first AF control mode (Normal). The following will be described along the flowchart in FIG. 4.

[0038] In S401, the focus control unit 121 monitors whether or not a zoom operation of a predetermined amount or more has occurred. The predetermined amount can be set arbitrarily. For example, when a zoom operation that changes the focal length by 10% or more has been performed, the focus control unit 121 determines Yes in S401. When the focus control unit 121 determines No in S401, the process proceeds to S402. In S402, the focus control unit 121 determines whether or not panning has been detected. For example, the determination in S402 may be made based on whether an output from an angular velocity sensor (not shown) provided in the imaging device 100 indicates that panning has occurred to the extent that the screen is switched.

[0039] If the focus control unit 121 determines No in S402, it advances the process to S403. In S403, the focus control unit 121 determines whether an MF operation has been performed. If the focus control unit 121 determines No in S403 (if an MF operation has not been performed), it advances the process to S404. In S404, the focus control unit 121 monitors the distance measurement results within the distance measurement target AF area, and determines whether the distance measurement results have fluctuated by a predetermined amount or more. For example, the focus control unit 121 determines whether the average of all distance measurement results within the second distance measurement target AF area (Wide) has fluctuated by 20% or more.

[0040] If the focus control unit 121 determines No in S404 (if there is no change in the distance measurement result by a predetermined amount or more), the process proceeds to S405. In S405, the focus control unit 121 determines that there has been no change in the subject, and sets the initialization flag to OFF. On the other hand, if the focus control unit 121 determines Yes in any of S401 to S404, the process proceeds to S406. In S406, the focus control unit 121 determines that there has been no change in the subject, and sets the initialization flag to ON. In other words, if the focus control unit 121 determines No in any of S401 to S404, the AF setting is changed to the first setting.

[0041] Next, the focus mode selection process of S301 in Fig. 3 will be described. Fig. 5 is a flowchart showing an example of the flow of the focus mode selection process. In S501, the focus control unit 121 determines whether the focus ring is operated by a user operation. If the result of the determination in S501 is Yes (if the focus ring is operated), the focus control unit 121 advances the process to S502. In S502, the focus control unit 121 sets the focus mode to the MF control mode.

[0042] When the result of the determination in S501 is No (when the focus ring is not operated), the focus control unit 121 advances the process to S503. In S503, the focus control unit 121 sets the focus mode to the AF control mode. After executing the process of S502 or S503, the focus control unit 121 ends the focus mode selection process of FIG. 5. Here, the change of the focus mode may be performed by switching between AF and MF before the operation of the focus lens 105. In this embodiment, the change between the AF control and the MF control is performed seamlessly, so that the AF control mode is changed depending on whether the focus lens 105 is operated or not. This control is also called full-time manual focus.

[0043] Next, the MF process of S311 in FIG. 3 will be described. The MF process is executed when the MF control mode is selected. FIG. 6 is a flowchart showing an example of the flow of the MF process. In S601, the focus control unit 121 controls the focus lens driving source 112 to drive the focus lens 105 in the optical axis direction according to the rotation of the focus ring based on the user operation (MF operation). In S602, the focus control unit 121 records the driving amount of the focus ring moved based on the user operation as the MF operation amount by the user. The MF operation amount may be the operation time of the MF operation. The MF operation amount continues to be accumulated and recorded while the MF control mode continues, and the accumulation of the MF operation amount ends at the stage of switching from the MF control mode to the AF control mode. Then, the MF operation amount recorded at the stage of switching from the AF control mode to the MF control mode is reset, and the accumulation of the MF operation amount starts again.

[0044] 6 shows an example in which focus lens 105 is driven in the optical axis direction based on the control of focus control unit 121, but the driving of focus lens 105 may be performed by other methods. For example, in a case where the focus ring and focus lens 105 are mechanically connected by gears or the like, the focus lens 105 can be driven by operating the focus ring. In this case, control by focus control unit 121 is not necessary.

[0045] Furthermore, the drive of focus lens 105 in the MF control mode may be performed based on an operation other than the operation of the focus ring. For example, the drive of focus lens 105 may be performed by an operating member such as a remote control connected to image capture device 100. Furthermore, in S602, information other than the MF operation amount may be recorded. For example, the drive amount of focus lens 105 driven in response to a user operation, the change in the defocus amount caused by driving focus lens 105, a value converted from the drive amount of focus lens 105 to the corresponding change in the defocus amount, etc. may be recorded.

[0046] Next, the process of setting the AF area to be measured and the AF control mode in S304 in Fig. 3 will be described. Fig. 7 is a diagram showing the positional relationship of the focus lens 105 and various screen examples. Fig. 8 is a flowchart showing an example of the process of setting the AF area to be measured and the AF control mode immediately after switching from the MF control mode to the AF control mode. In the process of the flowchart in Fig. 8, the focus control unit 121 sets the AF area to be measured and the AF control mode for each of the following three cases according to the MF operation and the distance measurement result.

[0047] The first case is a case where the main subject is changed from the subject focused by AF to a different subject near the center of the screen by a user operation. For example, it is assumed that AF control is performed with a subject different from the subject focused by AF as the main subject due to perspective conflict or the like. In the first case, the distance measurement target AF area is set to the first distance measurement target AF area (Standard), and the AF control mode is set to the second AF control mode (Limit).

[0048] The second case is a case where the main subject is changed to a subject that is not near the center of the screen by a user operation. For example, when the main subject is outside the AF area to be measured near the center of the screen, it is assumed that AF control is performed on the outside main subject. In the second case, the AF area to be measured is set to the second AF area to be measured (Wide), and the AF control mode is set to the second AF control mode (Limit).

[0049] The third case is a case where the user performs an MF operation by mistake, or a MF operation is performed but the subject is not changed. For example, the third case is assumed to be a case where an operation to adjust the focus is performed from a state where a blur has occurred. In the third case, the distance measurement target AF area is set to the first distance measurement target AF area (Standard), and the AF control mode is set to the first AF control mode (Normal). This setting is the first setting.

[0050] Fig. 7(a) is a diagram showing an example of the positional relationship between a subject and focus lens 105. In the example of Fig. 7(a), an infinite subject 702 and a close subject 703 are shown. Fig. 7(a) also shows a position 712 where focus lens 105 focuses on infinite subject 702, a position 714 where focus lens 105 focuses on close subject 703, and a position 713 where focus lens 105 focuses on an intermediate position. A range 715 indicates a predetermined range (focus range) for determining a focused subject.

[0051] FIG. 7B is a diagram showing an example of two distance measurement target AF areas. A first distance measurement target AF area (Standard) 704 is a distance measurement target AF area when the focus lens 105 is at a position 714. Since a close subject 703 is outside the first distance measurement target AF area (Standard) 704, the close subject 703 cannot be focused on by normal AF control. When a user performs MF operation by turning the focus ring of the imaging device 100 with the intention of focusing on the close subject 703, the focus lens 105 is driven to move to a position 715 in FIG. 7A. This allows the close subject 703 to be focused on.

[0052] In this state, when the MF operation by the user stops, the close subject 703 comes within the predetermined range 715 for determining the focused subject. Therefore, the focus control unit 121 can determine that the main subject has been changed to the close subject 703 based on the user operation. At this time, the focus control unit 121 changes the distance measurement target AF area from the first distance measurement target AF area (Standard) to the second distance measurement target AF area (Wide) 716 shown in Fig. 7(c). As a result, the close subject 703 comes within the second distance measurement target AF area (Wide) 716, so that the close subject 703 can be focused.

[0053] Then, in a state where the distance measurement target AF area is set to the second distance measurement target AF area (Wide) 716, the focus control unit 121 places a Track frame 718 at a focus position 717 of the closest subject 703. The Track frame 718 will be described later. The focus control unit 121 also changes the AF control mode from the first AF control mode (Normal) to the second AF control mode (Limit). This prevents the main subject from being changed from the closest subject 703 even if another subject appears in the center of the screen, so that the focus state at the focus position 717 can be maintained.

[0054] FIG. 7(d) is a diagram showing an example of a maximum distance measurement target AF area 718. The maximum distance measurement target AF area 718 corresponds to the distance measurement region 201 in FIG. 2. Here, it is assumed that the focus lens 105 is at the position 713 in FIG. 7(a). In this case, the main subject, that is, the closest subject 703, is not present in the predetermined range 715 for determining the focused subject. It is assumed that this case is the third case described above. Therefore, the distance measurement target AF area is set to the first distance measurement target AF area (Standard), and the AF control mode is set to the first AF control mode (Normal).

[0055] FIG. 8 is a flowchart showing an example of the flow of the setting process of S304 in FIG. 3. In S801, the focus control unit 121 determines a focused subject and selects a distance measurement result selection frame. The focus control unit 121 selects a frame with the smallest distance measurement result (frame closest to focus) from the largest distance measurement target AF area 718 in FIG. 7(d). When there are multiple frames with distance measurement results smaller than a predetermined value (frames close to focus), the focus control unit 121 may select a frame near the center of the screen, or may select the center of gravity of multiple frames with the same distance measurement result by referring to adjacent frames. Hereinafter, the selected frame is referred to as a distance measurement result selection frame. A distance measurement result selection frame is selected when there is a subject.

[0056] In S802, the focus control unit 121 judges whether the operation time of the manual focus (MF operation time) is equal to or longer than a predetermined time in the MF control mode. The judgment process in S802 is a process for judging whether the MF operation based on the user's intention has been performed. For example, if the MF operation time is less than the predetermined time (if the operation time is short), there is a possibility that an erroneous operation has been performed. In this case, the focus control unit 121 prohibits the change of the AF area to be measured and the AF control mode. The predetermined time can be set to any time such as "0.4 seconds". In S802, the focus control unit 121 may prohibit the change of the AF area to be measured and the AF control mode in the MF control mode when the operation amount of the manual focus (MF operation amount) is smaller than the predetermined operation amount. Since the MF operation amount is recorded in S602 in FIG. 6, the focus control unit 121 can judge whether to prohibit the change of the AF area to be measured and the AF control mode based on the recorded MF operation amount.

[0057] If the focus control unit 121 judges Yes in S802 (if the focus operation time is equal to or longer than a predetermined time), the process proceeds to S803. In S803, it is judged whether or not there is a ranging result selection frame within a predetermined depth inside the first ranging target AF area (Standard). If there is a ranging result selection frame within the predetermined depth, the subject is detected. On the other hand, if there is no ranging result selection frame within the predetermined depth, the subject is not detected. If the focus control unit 121 judges Yes in S803 (if there is a ranging result selection frame within a predetermined depth inside the first ranging target AF area (Standard)), the process proceeds to S804.

[0058] In S804, the focus control unit 121 sets the distance measurement target AF area to the first distance measurement target AF area (Standard). The process of S804 is a process of setting the distance measurement target AF area to the first distance measurement target AF area (Standard) because the position (position of the subject) of the distance measurement result selection frame determined in S801 is near the center. In S805, the focus control unit 121 sets the AF control mode to the second AF control mode (Limit). The process of S805 is performed when it is determined that a subject different from the subject detected in the AF control mode before the MF control mode was selected has been focused on by MF operation from the subject of the distance measurement result selection frame determined in S801. In this case, the focus control unit 121 can maintain focus on the subject targeted by the user by setting the AF control mode to the second AF control mode (Limit). In this case, automatic tracking is performed on the subject targeted by the user.

[0059] If the focus control unit 121 determines No in S803 (if there is no distance measurement result selection frame within the predetermined depth inside the first distance measurement target AF area (Standard)), the process proceeds to S806. In S806, the focus control unit 121 determines whether there is a distance measurement result selection frame within the predetermined depth outside the first distance measurement target AF area (Standard). At this time, the focus control unit 121 determines whether there is a distance measurement result selection frame determined in S801 outside the first distance measurement target AF area (Standard) and within the range of the second distance measurement target AF area (Wide). If the focus control unit 121 determines Yes in S806 (if there is a distance measurement result selection frame within the predetermined depth outside the first distance measurement target AF area (Standard)), the process proceeds to S807.

[0060] The predetermined depth in S803 and S806 can be set to any value (for example, three times the depth). If the predetermined depth is set large, there is a high possibility that AF will be started for a subject other than the one targeted by the user after the user performs MF operation. Conversely, if the predetermined depth is set small, the user needs to move the lens to a point close to the focus point for the subject targeted by the user. As a result, a high level of skill in user operation is required, and good visibility of the monitor is also required. For this reason, it is preferable that the predetermined depth is within a predetermined range from the appropriate depth.

[0061] In S807, the focus control unit 121 sets the distance measurement target AF area to the second distance measurement target AF area (Wide). In this case, since it is determined that the subject corresponding to the position of the distance measurement result selection frame determined in S801 is in a position that is not near the center, the focus control unit 121 performs the process of S807. In S808, the focus control unit 121 sets the AF control mode to the second AF control mode (Limit). If the focus control unit 121 determines Yes in S806, it determines that the subject based on the MF operation has been focused on, not the subject in the distance measurement result selection frame determined in S801. Therefore, the focus control unit 121 performs the process of S807. This makes it easier for the user to capture the subject he or she is aiming at.

[0062] When the focus control unit 121 judges NO in S802, it advances the process to S803. When the focus control unit 121 judges NO in S806, it advances the process to S809. In S809, the focus control unit 121 sets the distance measurement target AF area to the first distance measurement target AF area (Standard). The process of S809 is performed when the operation time of the focus is less than a predetermined time or when the subject is not detected. For example, when there is no distance measurement result selection frame judged in S801, the subject is not detected. When it is judged that the distance measurement result selection frame judged in S801 is not within a predetermined depth (when it is judged No in S803 and also judged No in S806), the subject is not detected. In S810, the focus control unit 121 sets the AF control mode to the first AF control mode (Normal). When the processes of S809 and S810 are executed, the AF setting is changed to the first setting. After the process of S805, S808, or S810 is executed, the setting process of FIG. 8 ends.

[0063] Next, the AF process according to the AF control mode set in S304 or S310 will be described. Fig. 9 is a diagram showing an example of the state transition of the AF process. In this embodiment, the AF process has the following three AF ​​states. Catch (the state in which the subject is brought into focus from a blurred state) Track (Maintains focus on the subject) Wait (The subject can no longer be kept in focus) When an AF start instruction 901 is received from Default 900 indicating an initial value, the AF state transitions to Catch 902. When the subject is outside the predetermined depth (903), the AF state of Catch 902 is maintained. When the subject enters the predetermined depth (904), the AF state transitions from Catch 902 to Track 906. When the subject is within the predetermined depth (905), the AF state of Track 906 is maintained. When the subject goes outside the predetermined depth from the AF state of Track 906 (907), the AF state transitions to Wait 909. Also, when the subject is changed from the AF state of Track 906 (912), the AF state transitions to Catch 902.

[0064] If the predetermined time has not elapsed (910), the AF state remains in Wait 909. If the predetermined time has elapsed (911), the AF state transitions to Catch 902. Also, if the subject returns to within the predetermined depth (908), the AF state transitions to Track 906.

[0065] As described above, the focus control unit 121 performs AF processing while transitioning between the three AF ​​states of Catch, Track, and Wait. Here, when the AF control mode is set to the first AF control mode (Normal), the focus control unit 121 transitions the AF state from Track 906 to Catch 902. On the other hand, when the AF control mode is set to the second AF control mode (Limit), the focus control unit 121 prohibits the transition of the AF state from Track 906 to Catch 902. That is, in this case, changing the subject to be focused on is prohibited. This maintains focus on the subject targeted by the user.

[0066] 10 and 11 are flowcharts showing an example of the flow of AF processing according to the AF control mode. In S901, the focus control unit 121 determines which of the AF states in FIG. 9 the AF state is. If the focus control unit 121 determines that the AF state is Catch, the process proceeds to S1002. If the focus control unit 121 determines that the AF state is Track, the process proceeds to S1007. If the focus control unit 121 determines that the AF state is Wait, the process proceeds to S1012.

[0067] In S1002, the focus control unit 121 sets a Catch frame. FIG. 7(e) is a diagram showing an example in which a Catch frame 705 is set near the center of the screen. As shown in FIG. 7(e), the screen includes an infinite object 702 and a close object 703. Also, a first distance measurement target AF area (Standard) 704 is shown by a dashed line. The Catch frame 705 includes a plurality of distance measurement areas. In S1003, the focus control unit 121 acquires the distance measurement results of each of the plurality of distance measurement areas from the Catch frame 705. In S1004, the closest distance measurement result is selected from the plurality of distance measurement results acquired in S1003. In the example of FIG. 7(e), the in-focus area 706 is selected as the closest distance measurement area.

[0068] In S1005, the focus control unit 121 determines whether the distance measurement result of the nearest distance measurement area selected in S1004 is in an approximately focused state. Even if the distance measurement result of the nearest distance measurement area selected in S1004 is not in a completely focused state, but is in a focused state within a certain range, the focus control unit 121 determines Yes in S1005 even if some deviation occurs. If the focus control unit 121 determines No in S1005, it advances the process to S1006. In S1006, the focus control unit 121 transitions the AF state to Catch. After executing the process of S1006, the focus control unit 121 transfers the process to S1018. If the focus control unit 121 determines Yes in S1005, it transfers the process to S1011.

[0069] Next, a process when it is determined that the AF state is Track will be described. In S1007, the focus control unit 121 sets a Track frame around the previous in-focus area. In the example of FIG. 7(f), a Track frame 707 is set around the in-focus area 706 (the in-focus area 706 in FIG. 7(e)). The Track frame 707 includes a plurality of distance measurement areas. In S1008, the focus control unit 121 acquires the distance measurement results of each of the plurality of distance measurement areas from the Track frame 707. In S1009, the focus control unit 121 selects the distance measurement result closest to the in-focus state from the acquired plurality of distance measurement results.

[0070] In S1010, the focus control unit 121 determines whether the distance measurement result selected in S1009 is in an approximately in-focus state. If the focus control unit 121 determines Yes in S1010, the process proceeds to S1011. In S1011, the focus control unit 121 transitions the AF state to Track. After executing the process of S1011, the focus control unit 121 transfers the process to S1018. If the focus control unit 121 determines No in S1010, the process transfers the process to S1017.

[0071] When the AF state is Track, a Track frame is set around the in-focus position of the subject, and the process (S1007 to S1011) is performed to select the distance measurement area that is closest to the in-focus position from the Track frame. By repeatedly performing the processes of S1007 to S1011, the focus can be made to track the movement of the subject even if the subject moves in the X and Y directions.

[0072] Next, a process when it is determined that the AF state is Wait will be described. In S1012, the focus control unit 121 sets a Wait frame around the in-focus position when the AF state is Track. FIG. 7(g) is a diagram showing an example of a case where the subject temporarily moves out of the Track frame 707. For example, when the user is performing an operation using the imaging device 100, if hand shake or unintentional panning occurs, the subject may temporarily move out of the Track frame. In this case, the subject may return to the Track frame again. Therefore, the focus control unit 121 sets a Wait frame 708 at the same position as the last Track frame 707 when the AF state is Track.

[0073] In S1013, the focus control unit 121 acquires the distance measurement results of each of the multiple distance measurement areas from the Wait frame 708. In S1014, the focus control unit 121 selects the distance measurement result that is closest to in-focus from the acquired multiple distance measurement results. In S1015, the focus control unit 121 determines whether the distance measurement result that is closest to in-focus and selected in S1014 is in an approximately in-focus state. If the focus control unit 121 determines Yes in S1015, the process proceeds to S1011. In S1011, the focus control unit 121 transitions the AF state to Track. If the focus control unit 121 determines No in S1010, the process proceeds to S1016.

[0074] In S1016, the focus control unit 121 determines whether the time during which the AF state is in Wait has exceeded a certain time. If the focus control unit 121 determines Yes in S1016, it shifts the process to S1006. If the AF state is in Wait and the time during which the camera is not in a substantially focused state continues for a certain time or more, it is assumed that the subject being tracked has disappeared from the screen, or the subject has disappeared from the screen due to panning or the like. In such a case, the focus control unit 121 changes the AF control so that the camera performs a focusing operation on a Catch frame near the center of the screen. On the other hand, if the focus control unit 121 determines No in S1016, it shifts the process to S1017. In this case, the AF state is maintained.

[0075] In S1018, the focus control unit 121 drives the lens according to the distance measurement result. At this time, the focus control unit 121 converts the distance measurement result selected in any one of S1004, S1009, or S1014 into a lens driving amount, and issues a drive command to the focus lens driving source 112 that drives the focus lens 105. After the process of S1018, the focus control unit 121 advances the process from "A" to S1019 in FIG. 11.

[0076] In S1019, the focus control unit 121 determines whether the AF control mode is the first AF control mode (Normal). If the focus control unit 121 determines Yes in S1019 (if the AF control mode is the first AF control mode (Normal)), the process proceeds to S1020. In S1020, the focus control unit 121 sets the monitoring area of ​​the closest subject to near the center of the screen. In the example of FIG. 7(h), the monitoring area 709 of the closest subject 710 is set to near the center of the screen.

[0077] The monitoring area includes a plurality of distance measurement regions. In S1021, the focus control unit 121 acquires distance measurement results from a plurality of distance measurement regions in the monitoring area of ​​a close subject. In S1022, the focus control unit 121 determines a distance measurement result closer than the current lens position (focused subject distance) from the plurality of distance measurement results acquired in S1021.

[0078] In S1023, the focus control unit 121 determines whether there is a close subject. At this time, if the focus control unit 121 determines in S1021 that there is a distance measurement result closer than the current lens position, it determines that a close subject has appeared. In this case, the focus control unit 121 determines Yes in S1023. If the focus control unit 121 determines Yes in S1023, it advances the process to S1204. In S1204, the focus control unit 121 transitions the AF state to Catch. If a close subject has appeared, the AF state transitions to Catch, so that it is possible to transition again to AF processing for tracking the subject. Then, the focus control unit 121 ends the AF processing according to the AF control mode.

[0079] When the focus control unit 121 judges No in S1019 and when the focus control unit 121 judges No in S1023, the focus control unit 121 ends the AF processing according to the AF control mode in Fig. 10 and Fig. 11. By performing the processes of S1019 to S1024, as shown in Fig. 7(h), a subject 710 closer than the infinity subject 702 is constantly monitored. This makes it possible to bring the close subject 710 into focus when the close subject 710 appears on the screen.

[0080] As described above, in this embodiment, the AF control mode is switched to the MF control mode by a user operation, and the AF control mode is changed immediately after switching from the MF control mode to the AF control mode. When a subject is detected in the MF control mode, focus on the detected subject is maintained, and when a subject is not detected in the MF control mode, control is performed to return to the AF control mode before switching to the MF control mode. This realizes highly versatile AF, and can realize highly specialized AF for a subject targeted by the user in the MF control mode. As a result, it is possible to prevent the subject intended by the user from being out of focus.

[0081] Furthermore, if a subject exists outside the AF area subject to distance measurement in the AF control mode before switching to the MF control mode, the AF area subject to distance measurement is expanded in the AF control mode switched from the MF control mode. This makes it possible to realize AF on a subject targeted by the user. It is also possible to prevent focusing on a subject unintended by the user. Then, when a subject targeted by the user is detected in the expanded target area for distance measurement, focusing on the detected subject is maintained. Therefore, even if a subject exists outside the AF area subject to distance measurement in the AF control mode before switching to the MF control mode, it is possible to realize highly versatile AF and highly specialized AF.

[0082] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or storage medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0083] 100 Imaging device 105 Focus Lens 112 Focus lens drive source 115 Camera microcomputer 121 Focus control section

Claims

1. A focus detection means for calculating a defocus amount based on a first focus detection signal and a second focus detection signal output from an image sensor; a focus adjustment unit that performs focus adjustment by either autofocusing that automatically controls the position of a focus lens using the defocus amount, or manual focusing that controls the position of a focus lens in response to an operation input by a user; a control means for controlling a first focus adjustment process in the autofocus to adjust focus with priority on a subject in an AF area near the center of a screen that is on the closest side; and a second focus adjustment process in which, when the manual focus is switched to the autofocus after the autofocus has been switched to the manual focus and the subject focused in the manual focus has been switched to another subject, the autofocus after the switching adjusts focus so as to keep the other subject focused in the manual focus in focus, In the second focus adjustment process, when determining whether or not another subject focused by the manual focus is present, whether or not there is a subject that is in focus or close to being in focus is determined based on whether or not there is a detection result by the focus detection means within a predetermined depth within an AF area; A focus control device, wherein the predetermined depth is deeper than a depth at which the autofocus determines that the object is in focus.

2. 2. The focus control device according to claim 1, wherein when the manual focus is switched to the autofocus while a subject focused in the manual focus has not been switched after the autofocus is switched to the manual focus, the control means controls focus adjustment so that the first focus adjustment process is performed in the autofocus after the switching.

3. 3. The focus control device according to claim 1, further comprising a display control unit that controls a display unit to display information indicating a target of the autofocus.

4. 3. The focus control device according to claim 1, further comprising a display control unit that controls a display unit to display a frame for identifying an area to be the target of the autofocus.

5. A focus control device as described in any one of claims 1 to 3, wherein the manual focus is performed on a subject outside the target area of ​​autofocus before switching to manual focus, and the manual focus is stopped in a state where the focus lens is moved within a predetermined range for determining the focused subject, thereby changing the target area of ​​the autofocus to an AF area that includes the subject outside the target area.

6. The focus control device according to claim 1 , wherein the control unit performs the first focus adjustment process when an operation for changing the photographing scene is performed in autofocus after switching.

7. 7. The focus control device according to claim 6, wherein whether an operation to change the shooting scene has been performed is determined based on whether a zoom operation of a predetermined amount or more has been performed, whether panning has been detected, or whether there has been a fluctuation in the focus detection result of a predetermined amount or more.

8. 8. The focus control device according to claim 1, wherein, when a time period during which the manual focus is operated is less than a predetermined time period, it is determined that a subject focused on in the manual focus mode has not been changed.

9. 9. The focus control device according to claim 1, wherein, when an operation amount of the manual focus is smaller than a predetermined operation amount, it is determined that a subject focused in the manual focus is not being switched.

10. A focus detection step of calculating a defocus amount based on a first focus detection signal and a second focus detection signal output from an image sensor; a focus adjustment step of performing focus adjustment by either autofocus, which automatically controls the position of a focus lens using the defocus amount, or manual focus, which controls the position of a focus lens in response to an operation input by a user; a control step of controlling a first focus adjustment process in the autofocus so as to give priority to a subject in an AF area near the center of a screen and on a close side; and a second focus adjustment process in which, when the autofocus is switched to the manual focus and then the manual focus is switched to the autofocus in a state in which a subject focused in the manual focus has been switched to another subject, the autofocus after the switching is continued to be focused on the other subject focused in the manual focus, In the second focus adjustment process, when determining whether or not another subject focused by the manual focus is present, whether or not there is a subject that is in focus or close to being in focus is determined based on whether or not there is a detection result by the focus detection step within a predetermined depth within an AF area; The focus control method, wherein the predetermined depth is deeper than a depth at which the autofocus determines that the object is in focus.

11. 10. A program for causing a computer to execute each of the means of the focus control device according to claim 1.

Images