Control apparatus, imaging apparatus, control method, and program

Abstract

To realize a technique that enables easy grasp of a main subject that is a target for AF control selected by a user operation.SOLUTION: A control apparatus includes: display control means that controls display means to display a captured image; control means that performs automatic focus control on a predetermined subject selected on the basis of a user operation for changing an in-focus state of a subject included in the image. The display control means controls to superimpose and display, on the predetermined subject, first information indicating that the predetermined subject is a target for the automatic focus control.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a focus control technique. [Background technology]

[0002] Patent Document 1 describes a method in which, after a user has completed a manual focus operation, the area closest to being in focus is determined to be the main subject area, and autofocus (AF) control is continuously performed on the main subject area. Patent Document 1 also describes a method in which, if a detected subject such as a person is present at the focus position, AF control is performed on the person, and if there are multiple people, AF control is performed on a person determined according to priority, and if no person is detected, AF control is performed using an area of ​​the same color within the focus position as a reference.

[0003] When shooting video, the user may operate the lens (focus, zoom, aperture, etc.) with their left hand and the camera (pan, tilt, start / stop recording, etc.) with their right hand. In this case, the user can manually focus the lens with their left hand to determine the area they want to shoot and select the main subject. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5474528 Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, the user cannot check the subject that will be the target of AF control during manual focus operation. Furthermore, in Patent Document 1, an AF frame or the like is not displayed on the main subject determined by the camera, making it difficult for the user to check the main subject after completing manual focus operation and determine which subject will be subject to AF.

[0006] The present invention has been made in view of the above-mentioned problems, and its purpose is to realize a technology that enables a user to easily grasp a main subject that is the target of AF control selected by a user operation. [Means for solving the problem]

[0007] In order to solve the above problems and achieve the object, the control device of the present invention has a display control means that controls the display means to display a captured image, and a control means that performs autofocus control on a specified subject determined by a user operation to change the focus state of a subject included in the image, and the display control means controls the display of the specified subject by superimposing first information indicating that the specified subject is the target of the autofocus control on the specified subject. [Effects of the Invention]

[0008] According to this embodiment, it is possible to easily grasp the main subject that is the target of AF control selected by a user operation. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram illustrating the configuration of an imaging apparatus according to an embodiment of the present invention. [Figure 2] 5A and 5B are diagrams illustrating a method for setting a ranging area on an imaging screen according to the present embodiment. [Figure 3] 4 is a flowchart illustrating a focus control process according to the present embodiment. [Figure 4] FIG. 10 is a diagram illustrating an example of a setting menu for an AF control mode when a focus operation is completed according to the present embodiment. [Figure 5] 4 is a flowchart illustrating a focus mode determination process according to the present embodiment. [Figure 6] 6 is a flowchart illustrating an example of an AF frame determination process when a subject is detected according to the present embodiment. [Figure 7] 6 is a flowchart illustrating an example of an AF frame determination process when a subject is not detected according to the present embodiment. [Figure 8]10 is a flowchart illustrating a focus threshold setting process when a subject is not detected according to the present embodiment. [Figure 9] 6 is a flowchart illustrating an example of an AF frame display process when a subject is detected according to the present embodiment. [Figure 10] 6 is a flowchart illustrating an example of an AF frame display process when a subject is not detected according to the present embodiment. [Figure 11] 5A to 5C are diagrams for explaining a subject region extraction method when a subject is not detected according to the present embodiment. [Figure 12] 5A to 5C are diagrams for explaining a method for setting a focus threshold when no subject is detected according to the present embodiment. [Figure 13] 5A to 5C are diagrams illustrating a method of displaying an AF frame when a subject is detected according to the present embodiment. [Figure 14] 5A to 5C are diagrams for explaining a method of displaying an AF frame when a subject is not detected according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] Below, an example in which the imaging device of the present invention is applied to a digital video camera will be described, but it may also be applied to other imaging devices such as a digital still camera.

[0012] <Device configuration> First, the hardware configuration of the imaging device of this embodiment will be described with reference to FIG.

[0013] FIG. 1 is a block diagram illustrating the hardware configuration of an imaging apparatus according to this embodiment.

[0014] The imaging device 100 includes an imaging optical system 150 for forming a subject image, which is light from a subject. The imaging optical system 150 includes a fixed first lens group 101, a variable magnification lens 102, an aperture 103, a fixed second lens group 104, and a focus compensator lens 105. A camera controller (hereinafter referred to as a camera microcomputer) 115 includes a focus position detection unit 119, a focus determination unit 120, a focus control unit 121, and a zoom control unit 122.

[0015] The variable magnification lens 102 moves in the optical axis direction to perform a magnification change operation. The focus compensator lens (hereinafter referred to as the focus lens) 105 has the function of correcting the movement of the focal plane that accompanies a magnification change operation and the function of adjusting the focus state. The imaging optical system 150 also has a focus lens operation unit 124 (hereinafter referred to as the focus ring). The focus ring 124 is rotatable around the optical axis of the imaging optical system 150 and is an operation member that can be operated by the user. When the user operates the focus ring 124 in the shooting mode, the focus lens 105 is moved in the optical axis direction by the focus lens driving unit 112 in accordance with the amount of operation of the focus ring 124. Note that operation information of the focus ring 124, such as the drive amount, drive speed, and drive direction of the focus lens 105 corresponding to the amount and direction of rotation of the focus ring 124, is output to the camera microcomputer 115. The imaging optical system 150 also has a control ring operation unit (hereinafter referred to as the control ring) 125. The control ring 125 is rotatable around the optical axis of the imaging optical system 150 and is an operation member that can be operated by the user. When the user operates the control ring 125, the detected subject is switched and the shooting settings (ISO / aperture / gain, etc.) are changed according to the operation information of the control ring 125. Note that the operation information of the control ring 125, such as the amount and direction of rotation of the control ring 125, is output to the camera microcomputer 115.

[0016] The imaging unit 106 includes an image sensor having a photoelectric conversion element such as a CCD or CMOS and peripheral circuits for driving the photoelectric conversion element and reading out signals, and photoelectrically converts an object image formed on the imaging surface by light passing through the imaging optical system 150 and outputs it as an electrical signal. The image sensor has a microlens that performs pupil division of the exit pupil of the imaging optical system 150, and the imaging device 100 performs autofocus (AF) control using an imaging surface phase difference method based on a pair of image signals obtained from light beams that have passed through different pupil regions.

[0017] The CSD / AGC circuit 107 has a CDS circuit that performs correlated double sampling to remove reset noise (low frequency) contained in the imaging signal output from the imaging unit 106, and an AGC circuit that amplifies the imaging signal output from the imaging unit 106 and controls the magnitude to a constant level.

[0018] The image signal processing unit 108 performs image processing on the imaging signal output from the CDS / AGC circuit 107 to generate image data.

[0019] The display unit 109 is equipped with a display device such as a liquid crystal panel or organic EL, and displays image data output from the image signal processing unit 108, as well as setting information at the time of shooting and an AF frame indicating the focus detection area at the start of AF control, which will be described later.

[0020] The recording unit 110 encodes the image data output from the image signal processing unit 108 using a video compression format such as MP4 and records the encoded video file on a recording medium, or decodes the video file read from the recording medium. The recording medium may be a magnetic tape, an optical disk, a semiconductor memory, or the like. Note that the imaging device 100 of this embodiment can generate not only video data, but also still image data and video data combined with audio data.

[0021] The zoom lens driver 111 includes an actuator such as a stepping motor, a DC motor, a vibration motor, or a voice coil motor for moving the variable magnification lens 102 in the optical axis direction. The focus lens driver 112 includes an actuator such as a stepping motor, a DC motor, a vibration motor, or a voice coil motor for moving the focus lens 105 in the optical axis direction.

[0022] The phase-difference AF gate 113 passes first and second focus detection signals from pixels in a ranging area set by a ranging area setting unit 118 for phase-difference AF (described later) that correspond to a focus detection area within an AF frame detected by the image-sensing-plane phase-difference AF method. Here, the ranging area is also referred to as a focus detection area. While this embodiment describes image-sensing-plane phase-difference AF, other focus detection methods may be used as long as they provide information about the subject distance. For example, a ToF (Time of Flight) method may be used, in which light (infrared light or laser) is emitted, hits the subject, reflects, and returns to calculate the distance. Another possible method involves attaching an RFID (Radio Frequency Identification) tag or a UWB (Ultra-Wideband) tag to the subject, receiving a signal from the tag via an antenna, and identifying the subject's location.

[0023] The phase difference AF signal processing unit 114 performs correlation calculations based on the two focus detection signals that have passed through the phase difference AF gate 113, calculates the amount of image shift for each focus detection area, and outputs the amount of image shift to the focus position detection unit 119 of the camera microcomputer 115.

[0024] The camera microcomputer 115 includes a processor (CPU) that performs arithmetic processing and control processing of the image capture device 100, a nonvolatile memory (ROM) that stores programs executed by the processor, and a work memory (RAM) into which programs read from the nonvolatile memory and constants and variables for executing the programs are loaded. The camera microcomputer 115 controls each component of the image capture device 100 by loading the programs stored in the ROM into the RAM and executing them.

[0025] The memory 123 is an external flash memory that is attached to the camera microcomputer 115 to expand its memory area.

[0026] The focus position detection unit 119 calculates a defocus amount, which is the amount of deviation between the current focus position and the in-focus position on the imaging plane of the imaging unit 106, from the image shift amount calculated by the phase difference AF signal processing unit 114, using an imaging plane phase difference AF method. Then, the focus position detection unit 119 outputs the defocus amount as a distance measurement result to the focus control unit 121. The focus position detection unit 119 also converts the defocus amount into a drive amount of the focus lens 105 and outputs it to the focus determination unit 120.

[0027] The focus determination unit 120 calculates control information for driving the focus lens 105 based on the drive amount of the focus lens 105 received from the focus position detection unit 119 , and outputs the control information to the focus control unit 121 .

[0028] The focus control unit 121 controls the focus lens driving unit 112 to drive the focus lens 105 based on the control information for the focus lens 105 received from the in-focus determination unit 120, thereby performing AF control.

[0029] The zoom control unit 122 controls the zoom lens driving unit 111 based on the driving amount and driving speed of the variable magnification lens 102 according to the zoom operation by the user to drive the variable magnification lens 102, thereby performing zoom control.

[0030] The AF method of this embodiment is not limited to the image plane phase difference AF method, and other AF methods may be applied.

[0031] The TV-AF gate 116 and the TV-AF signal processing unit 117 in FIG. 1 are components for realizing a TV-AF method other than the imaging surface phase difference AF method.

[0032] The TV-AF gate 116 outputs to a TV-AF signal processor 117 only the image pickup signal of the focus detection area for focus detection by the TV-AF method out of the image pickup signals of all pixels output from the CDS / AGC circuit 107 .

[0033] The TV-AF signal processing unit 117 applies known methods, such as extracting specific frequency components using a filter, to the image signal of the focus detection area for TV-AF (the AF frame in this embodiment) output from the TV-AF gate 116, and generates a TV-AF evaluation value that maximizes the sharpness (contrast) of the image at the in-focus position.

[0034] The TV-AF evaluation value is output to a focus determination unit 120. The TV-AF evaluation value is also output to a focus control unit 121. The focus control unit 121 controls a focus lens driving unit 112 based on the TV-AF evaluation value to drive the focus lens 105, thereby performing AF control using the TV-AF method.

[0035] The ranging area setting unit 118 for phase difference AF sets a pixel group from among all pixels of the imaging unit 106 that reads out the first and second focus detection signals that are input to the phase difference AF gate 113. The ranging area setting unit 118 can variably set the focus detection area that reads out the focus detection signals for focus detection using the phase difference AF method in accordance with the subject detection state.

[0036] The subject area detection unit 126 performs a known subject detection process on the imaging signal output from the CDS / AGC circuit 107 to detect a subject present within an imaging screen corresponding to the image data generated by the image signal processing unit 108. The subject detection process of this embodiment is face detection processing in which the detection target is a human face area. For example, the face area detection process may involve extracting a skin-color area from the gradation colors of each pixel represented by the image data and detecting a face based on the degree of match with a pre-prepared face outline plate. Other methods include face detection by extracting facial feature points such as the eyes, nose, and mouth using known pattern recognition technology. This embodiment is not limited to a specific subject detection process, and any method may be used. Furthermore, the subject to be detected is not limited to a person or a face, but may also be a non-human or non-face animal, insect, vehicle, or the like.

[0037] The imaging device 100 of this embodiment can be switched between multiple focus modes, including AF mode, MF mode, and MF / AF switching mode. AF mode is a mode in which the focus is automatically adjusted to bring a target subject (main subject) into focus through AF control. MF mode is a mode in which the user manually operates the focus ring 124 to adjust the focus to bring a desired subject (main subject) into focus. MF / AF switching mode is a mode in which the mode automatically switches to AF mode after MF mode operation is completed, and AF control continues to be performed on the subject that has been brought into focus through manual focus operation as the main subject.

[0038] <How to set the focusing area> Next, a method for setting a ranging area by the ranging area setting unit 118 of this embodiment will be described with reference to FIG.

[0039] 2(a) to 2(c) show examples of ranging areas set by the ranging area setting unit 118. FIG.

[0040] 2(a) illustrates an example of a ranging area 201 set in an imaging screen 200 corresponding to image data generated by the image signal processing unit 108. The ranging area 201 is configured by a plurality of rectangular areas arranged two-dimensionally. Note that FIG. 2(a) illustrates an example of the ranging area in a state where no subject is detected in the imaging screen 200, and the ranging area 201 is arranged as shown in FIG. 2(a) regardless of whether the focus mode of the imaging device 100 is AF mode, MF mode, or MF / AF switching mode.

[0041] FIG. 2(b) illustrates ranging areas 202-204 when a subject is detected. For each of detected subjects 205-207, multiple two-dimensional ranging areas are set according to the center and size of the face. Note that FIG. 2(b) illustrates ranging areas when a subject is detected, and is arranged when the focus mode of the imaging device 100 is AF mode or MF / AF switching mode. The ranging areas are arranged as shown in FIG. 2(b) in order to reduce out-of-focus during AF control for each detected subject.

[0042] FIG. 2(c) illustrates an example of a ranging area 208 when a subject is detected. In the example of FIG. 2(c), multiple two-dimensional ranging areas are set for all detected subjects 209 to 211. Note that FIG. 2(c) illustrates an example of ranging areas when a subject is detected, and is arranged when the focus mode of the image capture device 100 is MF mode. The ranging areas are arranged as in FIG. 2(c) so that the image capture device 100 can efficiently identify the subject that the user has targeted by performing a manual focus operation, and the arrangement is similar to that in the state of FIG. 2(a).

[0043] In this way, by changing the distance measurement range depending on the subject detection status and focus mode, it becomes possible to identify a subject that matches the user's intentions and maintain a focused state on the targeted subject during AF control.

[0044] The focus control unit 121 executes AF control based on at least one or more distance measurement results among a plurality of distance measurement results obtained from the distance measurement regions 201 to 204 illustrated in FIGS. 2(a) to 2(c).

[0045] <AF control mode> Next, the AF control mode will be described.

[0046] The imaging device 100 of the present embodiment can execute the following plurality of AF control modes. Further, the imaging device 100 of the present embodiment can be changed to the following first AF control mode, second AF control mode, or third AF control mode by a user operation. · First AF control mode: Center-nearest priority AF · Second AF control mode: Face AF · Third AF control mode: Tracking AF In the "First AF control mode: Center-nearest priority AF", AF control is performed with priority given to the subject located at the center and nearest on the imaging screen. The focus control unit 121 determines the presence or absence of a subject located at the center-nearest, which is the nearest to the center of the imaging screen and the nearest in the optical axis direction, based on the subject detection result detected by the subject region detection unit 126 and the like. When the distance measurement result of the subject located at the center-nearest can be obtained, AF control is performed according to the distance measurement result of the center-nearest subject. As a result, the subject that appears near the center of the imaging screen is successively focused, so that it is a highly versatile AF control that enables AF in various scenes

[0047] In the "Second AF control mode: Face AF", based on the subject detection result detected by the subject region detection unit 126 and the like, the position and size of the face region of a person as the main subject are determined, and AF control is performed while tracking the main subject so that the distance measurement result of the face region is always in focus. When there are a plurality of faces in the imaging screen, the prioritized face is, for example, the face that is closest to the center of the imaging screen and has the largest size. As a result, since the imaging device 100 automatically determines the priority order of the subjects according to the subject detection result in the imaging screen and performs AF control, it is effective when there is a detected subject such as a face.

[0048] In addition, "First AF control mode: Center closest focus priority AF" and "Second AF control mode: Face AF" are controlled exclusively, and if the detected subject disappears in "Second AF control mode: Face AF," the mode will switch to "First AF control mode: Center closest focus priority AF."

[0049] In "Third AF Control Mode: Tracking AF," AF control is performed while tracking a main subject selected by the user from among multiple detected subjects within the imaging screen so that the subject remains in focus. For example, the user may specify a position on the imaging screen, and the position and size of the subject may be determined from color information and ranging results for the specified position, or the position and size of a face may be determined from the detection results for a face selected by the user. Tracking AF is performed on the main subject so that the ranging results for the area corresponding to the position specified by the user are always in focus. This allows AF control to be maintained only on the subject targeted by the user, and imaging device 100 does not change the subject, resulting in highly specialized AF control.

[0050] In addition, "First AF control mode: Center closest subject priority AF" and "Third AF control mode: Tracking AF" are mutually exclusive controls, and if the detected subject no longer exists in "Third AF control mode: Tracking AF," the mode will switch to "First AF control mode: Center closest subject priority AF."

[0051] Since AF control is well known, a detailed description thereof will be omitted.

[0052] <Menu Settings> Next, the menu setting items of this embodiment will be described with reference to FIG.

[0053] The menu of this embodiment includes a menu name 301. The menu name 301 is "AF control at the end of MF operation," and AF control after the end of manual focus operation can be selected.

[0054] In this embodiment, the menu 301 includes three options 302, 303, and 304. The first option 302 is a setting for "No tracking AF." When the first option 302 is selected, tracking AF does not start after manual focus operation ends. In more detail, if the AF mode is set to "First AF control mode: Center closest focus priority AF" or "Second AF control mode: Face AF," the same AF control is maintained even after manual focus operation ends, or operation of the focus ring 124 is restricted.

[0055] The second option 303 is a setting for "Perform tracking AF (do not display tracking candidate frames)." When the second option 303 is selected, tracking AF starts after manual focus operation is completed. In more detail, if the AF mode is set to "First AF control mode: Center closest subject priority AF" or "Second AF control mode: Face AF," it switches to "Third AF control mode: Tracking AF" after manual focus operation is completed.

[0056] In the second option 303, when the user operates the focus ring 124 to change to one of multiple detected subjects at different distances from the imaging optical system 150, tracking AF is started for the targeted subject after the manual focus operation is completed. This eliminates the need for the user to change the AF control mode.

[0057] The third option 304 is a setting for "Perform tracking AF (display tracking candidate frame)." The third option 304 switches the AF control mode after a manual focus operation is completed in the same way as the second option 303. During and after a manual focus operation, a tracking candidate frame is displayed on the main subject to be tracked, selected by the user using the focus ring 124. As will be described later with reference to FIG. 14 , the tracking candidate frame is displayed in a different display format from the tracking frame indicating that tracking AF will be performed on the selected main subject after a manual focus operation is completed. The third option 304 allows the user to confirm whether the intended subject is substantially in focus while operating the focus ring 124. In this way, by presenting the user with a subject to be tracked after a manual focus operation is completed in advance during a manual focus operation, it is possible to reduce the number of failed photographs.

[0058] The first option 302, the second option 303, and the third option 304 will be described in detail later with reference to FIG.

[0059] <Method for determining the main subject from multiple detected subjects> In this embodiment, it is possible to determine a main subject to be the target of tracking AF from among multiple subjects detected by the subject area detection unit 126 using the following first subject determination method A or second subject determination method B. First Subject Determination Method A: Method for Changing Subject Priority Second Subject Determination Method B: Method of Changing the Focus State of the Subject "A: Method of changing the priority of subjects" is a method in which priorities are assigned to multiple detected subjects according to the position and size of each subject, and the user determines the main subject by changing the priority. The user can change the priority of subjects and determine the main subject by selecting a detected subject using a touch operation (not shown), a cross key operation, or operation input on the control ring 125. "B: Method of changing the focus state of the subject" is a method of changing the focus state of the subject using the focus ring 124, and determining an approximately focused subject from a plurality of detected subjects as the main subject.

[0060] The imaging device 100 of this embodiment can be operated for the first subject determination method A or the second subject determination method B using the following different operating members. First subject selection method A: Control ring 125 Second subject selection method B: Focus ring 124 <Focus ring 124 and control ring 125> As shown in FIG. 1, the imaging device 100 of this embodiment includes an imaging optical system 150 that includes a focus ring 124 and a control ring 125.

[0061] When switching the main subject using the focus ring 124, the imaging device 100 of this embodiment determines that the subject in a nearly in-focus state is the subject the user is aiming at and performs tracking AF. However, if there are multiple detected subjects at approximately the same distance from the imaging optical system 150, the multiple subjects will be in a nearly in-focus state, making it difficult for the user to determine the subject they are aiming at.

[0062] Therefore, in this embodiment, when there are multiple detected subjects at approximately the same distance, the main subject can be switched by operating the control ring 125 instead of the focus ring 124. This makes it possible to move the AF frame to the subject to the right or left of the subject on which the current AF frame is displayed, depending on the direction of rotation of the control ring 125, just like with other operating members (cross key, touch operation).

[0063] In this embodiment, it is recommended to operate the focus ring 124 when switching between multiple detected subjects with different distances, and to operate the control ring 125 when switching between subjects with no difference in distance.

[0064] This has two benefits.

[0065] The first advantage is that the user can select the target subject (subject with a distance difference or subject with no distance difference) using only the left hand. Conventionally, when there are multiple detected subjects at approximately the same distance, the user has had to operate a cross key or the like with the right hand to select the subject. In this embodiment, the imaging optical system 150 is provided with two operation members, the focus ring 124 and the control ring 125, so that the user can select the target subject (subject with a distance difference or subject with no distance difference) simply by operating the operation members of the imaging optical system 150 held in the left hand.

[0066] The second benefit is that the quality of the video is improved because the user can control the speed of focus shift when switching subjects by operating the focus ring 124, which is recommended when selecting subjects with a difference in distance. On the other hand, when selecting subjects with no difference in distance, focus shift quality is not necessary, so simply switching subjects by operating the control ring 125 does not affect the quality of the video.

[0067] <Focus control processing> Next, the focus control process of this embodiment will be described with reference to FIGS.

[0068] The focus control process of this embodiment is realized by the camera microcomputer 115 loading a program stored in the ROM into the RAM and executing it, and controlling each component as the focus control unit 121.

[0069] First, the main flow of the focus control process of this embodiment will be described with reference to FIG.

[0070] The process of FIG. 4 is repeatedly executed in accordance with a predetermined cycle, for example, a cycle at which an image signal is read from the image capturing unit 106.

[0071] In step S400, the focus control unit 121 acquires lens information of the imaging optical system 150, and proceeds to step S401. The lens information includes focal length information, subject distance information, aperture information, operation information of the focus ring 124, operation information of the control ring 125, and the like.

[0072] In step S401, the focus control unit 121 acquires information about "AF control at the end of focus operation" set by the user on the menu screen described with reference to FIG. 5, and the process proceeds to step S402.

[0073] In step S402, the focus control unit 121 sets the distance measurement area described with reference to FIG. 2, and the process proceeds to step S403.

[0074] In step S403, the focus control unit 121 acquires the distance measurement results from the in-focus position detection unit 119, and the process proceeds to step S404. In this embodiment, the results of all the distance measurement areas set in FIG. 2 are acquired.

[0075] In step S404, the focus control unit 121 determines whether the setting of "AF control after MF operation ends" acquired in step S401 is "tracking," and if it is "not tracking," proceeds to step S405; if it is "tracking," proceeds to step S408.

[0076] In step S405, the focus control unit 121 performs processing to determine an AF frame, and proceeds to step S406. If a face is detected, the focus control unit 121 performs face AF, setting the ranging area for the face as the AF frame. If a face is not detected, and ranging results for the area closest to the center of the imaging screen can be obtained, the focus control unit 121 sets the ranging area closest to the center as the AF frame; otherwise, the focus control unit 121 predicts the position of the subject from the current ranging results and sets the ranging area as the AF frame.

[0077] In step S406, the focus control unit 121 performs processing to display an AF frame, and proceeds to step S407. If a face is detected, the focus control unit 121 displays an AF frame around the face, and if not, the focus control unit 121 performs center-closest priority AF and does not display an AF frame.

[0078] In step S407, the focus control unit 121 performs AF control processing, and returns the processing to step S400 to repeat the processing. The focus control unit 121 outputs control information for driving the focus lens 105 to the focus lens driving unit 112 in accordance with the distance measurement result of the AF frame determined in step S405.

[0079] In step S408, the focus control unit 121 determines whether the focus mode is "AF mode," "MF mode," or "MF / AF switching mode," and proceeds to step S409. Details of the process will be described later with reference to FIG.

[0080] In step S409, the focus control unit 121 determines whether the focus mode is the "AF mode," and if it is the AF mode, the process proceeds to step S410; otherwise, the process proceeds to step S415.

[0081] In step S410, the focus control unit 121 determines whether an instruction to change the main subject has been received from the control ring 125, and if an operation has been received, the process proceeds to step S411; otherwise, the process proceeds to step S412.

[0082] In step S411, focus control unit 121 performs processing to change the subject, and proceeds to step S412. The user can issue a subject change instruction to camera microcomputer 115 by rotating control ring 125. When multiple subjects are detected by subject area detection unit 126, and a subject change instruction is received from control ring 125, focus control unit 121 changes the main subject in accordance with the instruction.

[0083] 2(b), when control ring 125 is rotated to the right, if the face for which the AF frame is currently displayed is detected subject 207, the AF frame moves to detected subject 206 located to the right. When control ring 125 is rotated to the left, if the face for which the AF frame is currently displayed is detected subject 207, the AF frame moves to detected subject 205 located to the left of the face for which the AF frame is displayed.

[0084] In step S412, the focus control unit 121 performs processing to determine an AF frame, and proceeds to step S413. When tracking AF is being performed, the focus control unit 121 sets the ranging area of ​​the tracking target as the AF frame. When tracking AF is not being performed, if ranging results can be obtained for the area closest to the center of the imaging screen, the focus control unit 121 sets the ranging area closest to the center as the AF frame; otherwise, the focus control unit 121 predicts the position of the subject from the current ranging results and sets the ranging area as the AF frame.

[0085] In step S413, the focus control unit 121 performs processing to display an AF frame, and proceeds to step S414. If tracking AF is being performed, the focus control unit 121 displays an AF frame in the ranging area of ​​the tracking target, and if not, center-closest-priority AF is being performed and no AF frame is displayed.

[0086] In step S414, the focus control unit 121 performs AF control processing, and returns the processing to step S400 to repeat the processing. The focus control unit 121 outputs control information for driving the focus lens to the focus lens driving unit 112 according to the distance measurement result of the AF frame determined in step S412.

[0087] In step S415, the focus control unit 121 determines whether or not a detected subject is present in the approximately in-focus range, and if a detected subject is present, the process proceeds to step S416; otherwise, the process proceeds to step S419.

[0088] In step S416, the focus control unit 121 performs an AF frame determination process when a subject is detected, and the process proceeds to step S417. Details of the process will be described later with reference to FIG.

[0089] In step S417, the focus control unit 121 performs an AF frame display process when a subject is detected, and the process proceeds to step S418. Details of the process will be described later with reference to FIGS.

[0090] In step S418, focus control unit 121 performs manual focus control processing, returns the processing to step S400, and repeats the processing. Focus control unit 121 outputs control information for driving the focus lens to focus lens driving unit 112 based on the amount of operation of focus ring 124 or the amount of focus operation by a remote control (not shown).

[0091] In step S419, the focus control unit 121 performs an AF frame determination process when a subject is not detected, and the process proceeds to step S420. Details of the process will be described later with reference to FIGS.

[0092] In step S420, the focus control unit 121 performs an AF frame display process when a subject is not detected, and the process proceeds to step S418. Details of the process will be described later with reference to FIGS.

[0093] <Focus mode determination process> Next, the focus mode determination process in step S408 in FIG. 3 will be described with reference to FIG.

[0094] In step S501, focus control unit 121 determines whether a manual focus operation is being performed using focus ring 124, or whether a manual focus operation is being performed using a remote control (not shown) to drive focus lens 105. If a manual focus operation is being performed, focus control unit 121 proceeds to step S502; otherwise, focus control unit 121 proceeds to step S503.

[0095] In step S502, the focus control unit 121 sets the focus mode to the "MF mode" and ends the process.

[0096] In step S503, the focus control unit 121 determines whether a predetermined time has elapsed since the manual focus operation ended. If the predetermined time has elapsed, the process proceeds to step S504; otherwise, the process proceeds to step S505. In this embodiment, the predetermined time is set to, for example, 0.6 seconds.

[0097] In step S504, the focus control unit 121 determines that the manual focus operation has ended, sets the focus mode to the "AF mode", and ends the process.

[0098] In step S505, the focus control unit 121 determines that the manual focus operation is in progress and sets the focus mode to the "MF / AF switching mode" as preparation for switching from the MF mode to the AF mode, and ends the process.

[0099] Regarding the change of the focus mode, there is also a method of switching the AF and MF switches before the manual focus operation. However, in this embodiment, in order to perform AF and MF seamlessly, the change to the AF mode is made depending on whether the manual focus operation has ended.

[0100] <AF frame determination process> Next, referring to FIG. 6, the AF frame determination process at the time of subject detection in step S416 of FIG. 3 will be described.

[0101] In step S601, the focus control unit 121 determines whether multiple detected subjects are present in the approximate-focus range. If multiple detected subjects are not present in the approximate-focus range, the focus control unit 121 proceeds to step S603, where it sets an AF frame for one detected subject in the approximate-focus range. If multiple detected subjects are present in the approximate-focus range, the focus control unit 121 proceeds to step S602, where it sets an AF frame for a detected subject that is closest to the center of the imaging screen. Note that the method for determining the AF frame is not limited to the example in FIG. 6, and if multiple detected subjects are present in the approximate-focus range, it may set an AF frame for a detected subject that is closest to the in-focus state or the detected subject that is closest to the center of the screen.

[0102] Next, the AF frame determination process when a subject is not detected in step S419 in FIG. 3 will be described with reference to FIG.

[0103] In step S700, the focus control unit 121 performs processing to set a first focus threshold and a second focus threshold, and then proceeds to step S701. The first focus threshold is a threshold of focus information for extracting a subject area from the distance measurement result acquired in step S403 of FIG. 4. The second focus threshold is a threshold of focus information for setting a representative area from the main subject area extracted based on the first focus threshold. The representative area is an area that is set when the user changes the in-focus subject using the focus ring 124, and is set, for example, as an AF frame for performing AF control after completing a manual focus operation. During a manual focus operation, the representative area is set as a tracking candidate frame at the start of AF in step S420 of FIG. 4. Details of how to set the first focus threshold and the second focus threshold will be described later with reference to FIG. 8.

[0104] In step S701, the focus control unit 121 performs processing to extract a subject area based on the first focus threshold set in step S700, and then proceeds to step S702. Here, with reference to FIG. 11(a), a method for extracting a subject area when a subject is not detected according to this embodiment will be described. In the example of FIG. 11(a), subjects 1100 to 1104 are objects and the ground. Objects 1100 and 1101 are located at approximately the same distance from the imaging optical system 150. Objects 1102 and 1103 are located close to the center of the screen as viewed from object 1100, and ground 1104 is located at approximately the same distance. First focus information 1105 is first focus information determined based on the first focus threshold set in step S700 from the distance measurement results acquired in step S403 of FIG. 4. Subject area 1106 is the extracted subject area. For example, when each focus information 1105 is adjacent, the object area is extracted as a single subject area. Other extraction methods may also be methods for extracting subject regions based on color, brightness, etc. When multiple objects exist within the range of the first focus threshold, such as object 1100 and object 1101, and the focus information 1105 is not adjacent, such as object region 1106 and object region 1107, they can be extracted as separate subject regions.

[0105] In step S702, the focus control unit 121 determines whether or not a non-subject area exists in the subject area extracted in step S701. If it is determined that a non-subject area exists, the process proceeds to step S703; otherwise, the process proceeds to step S704. Here, with reference to FIG. 11(b), a method for determining a non-subject area according to this embodiment will be described. FIG. 11(b) illustrates an example of a state in which, from the focus state of FIG. 11(a), the user operates the focus ring 124 toward the center of the screen, and the object 1102, the object 1103, and the ground 1104 are in focus. An area 1108 is a collection area of ​​the first focus information when the focus ring 124 is operated, and the object 1102, the object 1103, and the ground 1104 are extracted as a single subject area. In this way, for example, when the subject areas of different objects are connected with a ground area interposed therebetween, they are extracted as a single subject area. In order to extract this single subject area 1108 as a separate subject area, if the ground area portion of the subject area is larger than a predetermined ratio to the captured image, as in area 1109, it is determined to be a non-subject area and removed. This non-subject area is, for example, a ground area that is continuous with the subject area, but it may also be a wall or ceiling.

[0106] In step S703, the focus control unit 121 performs processing to remove the non-subject region, and the process proceeds to step S704. Here, with reference to FIG. 11(c), a method for removing the non-subject region of this embodiment will be described. FIG. 11(c) illustrates an example of a state in which the non-subject region 1109 determined in step S702 has been removed from the subject region 1108 of FIG. 11(b). By removing the non-subject region 1109 from the subject region 1108, the previously adjacent subject region 1108 is divided into non-adjacent subject regions 1110 and 1111, and these can be extracted as separate subject regions. In this way, removing the non-subject region improves the accuracy of extracting the subject region, and the non-subject region is no longer selected in the AF frame determination process.

[0107] In step S704, the focus control unit 121 performs processing to set a reference point from the subject area after the non-subject area has been removed in step S703, and then proceeds to step S705. Here, with reference to FIG. 11C, a method of setting a reference point from the subject area after the non-subject area has been removed according to this embodiment will be described. First, a main subject area is determined from the subject area 1110 and the subject area 1111 remaining after the non-subject area has been removed in step S703. When multiple subject areas are extracted, the main subject area may be determined, for example, by determining the largest subject area as the main subject area, or by determining the subject area at the center of the screen as the main subject area. When only one subject area is extracted, that subject area is determined as the main subject area. When no subject area is extracted, no main subject area is determined. Next, after the main subject area is determined, a reference point 1112 is set from the main subject area. The reference point 1112 may be set, for example, at the center of gravity of the main subject area, or at a position close to the center of the screen.

[0108] In step S705, the focus control unit 121 sets a representative area based on the reference point of the subject determined in step S704 and the second focus threshold set in step S700, and then proceeds to step S706. Here, with reference to FIG. 11(d), a method for setting a representative area in this embodiment will be described. Area 1113 is second focus information determined based on the second focus threshold set in step S700. Area 1114 is a representative area. First, since the representative area 1114 is selected from the second focus information 1113, which is the focus range, when the representative area 1114 is set as an AF frame in step S707, AF control can be started from a focus position within the focus range. This eliminates the need to consider the transition between the user's operation speed of the focus ring 124 and the AF control speed when starting AF control after completing manual focus operation. Furthermore, the amount of change in the focus position is small, so the quality of the video does not deteriorate. Next, a method for selecting the representative area 1114 from the second focus information 1113 will be described. The second focus information may be, for example, a region including a lot of background around the object 1102, as in focus information 1113, or a region included in the object 1103, as in focus information 1116. Therefore, when selecting the representative region 1114 from the second focus information, there is a possibility that a region outside the region of the object 1102, which is the main subject region set in step S704, will be selected. To avoid this, when selecting the representative region 1114 from the second focus information 1113, the region is set as the region that is the shortest distance on the xy plane to the reference point set in step S704. In this way, by setting the region that is the shortest distance to the reference point and that is included in the second focal depth as the representative region, it is possible to prevent a region different from the main subject region from being set as the representative region.

[0109] In step S706, the focus control unit 121 determines whether the representative area acquired in step S705 exists, and if it exists, the process proceeds to step S707, and if not, the process proceeds to step S709.

[0110] In step S707, the focus control unit 121 sets the representative area as the AF frame, and the process proceeds to step S708.

[0111] In step S709, the focus control unit 121 sets an AF frame when no representative area exists in step S706, and proceeds to step S710. If a face is detected, the focus control unit 121 sets the ranging area for the face as the AF frame and performs face AF. If a face is not detected and there is a closest ranging result in the center of the imaging screen, the focus control unit 121 sets that ranging area as the AF frame; otherwise, the focus control unit 121 predicts the position of the subject from the current ranging result and sets that ranging area as the AF frame.

[0112] In step S708, the focus control unit 121 sets the AF control mode to "tracking AF," and the process proceeds to step S420 in FIG.

[0113] In step S710, the focus control unit 121 sets the AF control mode to "face AF / center-closest-focus-priority AF control," and the process proceeds to step S420 in FIG.

[0114] <Processing for Setting the First and Second Focus Thresholds> Next, the process of setting the first and second focus thresholds in step S700 of FIG. 7 will be described with reference to FIG.

[0115] In step S800, the focus control unit 121 performs processing to set upper and lower limits, which are the width of the first focus threshold, based on the lens information acquired in step S400 of FIG. 4, and then proceeds to step S801. Here, with reference to FIG. 12, a method for setting the width of the first focus threshold in this embodiment will be described. In FIG. 12, the vertical axis indicates the depth of field, with 0 representing the in-focus position and larger numbers representing greater distances from the in-focus position. FΔ is a unit of focus, and in this embodiment, the depth of field ranges from -1FΔ to 1FΔ. Note that the in-focus range represents the range of the depth of field in which an image appears to be in focus, and is the range obtained by adding the front focus distance (close side) and the rear focus distance (infinity side) to the in-focus position (0F).

[0116] Region 1200 indicates the range of the first focus threshold, and regions 1201 and 1202 indicate areas outside the first focus threshold range. Regions 1203 to 1205 indicate objects, with objects 1203 and 1204 indicating objects within the range of the first focus threshold, and object 1205 indicating an object outside the range of the first focus threshold. In this embodiment, the first focus threshold is set to a range of -1FΔ to 3FΔ, and is set to include not only the in-focus range (-1FΔ to 1FΔ) but also the out-of-focus range (1FΔ to 3FΔ). Note that in this embodiment, the first focus threshold is the depth of field, but it may also be a value based on the subject distance. By setting the first focus threshold to include the out-of-focus range in this way, for example, an object such as object 1203, which is slightly out of the in-focus range but has a large presence, can be extracted as a large subject region in step S701 of FIG. 7. Extracting a large subject area increases the likelihood that the object will be selected when determining the main subject in step S704 of FIG. 7 . On the other hand, because an object extracted by enlarging the subject area is selected as the main subject area, it is possible to prevent an object like object 1204, which is within the focus range but is not desired to be selected as the main subject (e.g., a small object such as a stone), from being selected. Furthermore, by setting the first focus threshold to include an area outside the focus range, it is possible to extract the targeted object as a large subject area even if the focus position slightly deviates from the focus range when the user focuses on the targeted object using focus ring 124. In contrast, if the first focus threshold is set within the focus range (−1FΔ to 1FΔ) and the subject area is extracted, the size of the extracted subject area becomes small. Therefore, even if the focus position deviates slightly from the targeted object when the user finishes operating focus ring 124, the size relationship between the subject areas of the targeted object changes, and there is a possibility that the ground area or another small subject area at approximately the same distance will be selected as the main subject area.

[0117] In step S801, the focus control unit 121 determines the operation direction of the focus ring 124. If the focus ring 124 is operated toward the infinity side in the optical axis direction, the focus control unit 121 proceeds to step S802, and if the focus ring 124 is operated toward the close side in the optical axis direction, the focus control unit 121 proceeds to step S805.

[0118] In step S802, the focus control unit 121 sets a first focus threshold based on the operation direction (toward infinity) of the focus ring 124 in step S801 and the width of the first focus threshold set in step S800. Here, with reference to FIG. 12, a method for setting the first focus threshold of this embodiment will be described. An arrow 1206 indicates the operation direction of the focus ring 124. A region 1200 indicates the range of the first focus threshold. In the example of FIG. 12, the first focus threshold range 1200 is divided into a range on the closest side and a range on the infinity side, with the in-focus position (0F) as the boundary, and is set so that the ratio of the threshold on the infinity side, which is the operation direction 1206 of the focus ring 124, is larger than the threshold on the closest side. In this way, by increasing the ratio of the range of the first focus threshold for the operation direction 1206 of the focus ring 124, it is possible to exclude objects on the closest side from options for the focus position when the user finishes operating the focus ring 124. On the other hand, if AF control is performed on the main subject without excluding objects on the closest side, there is a possibility that the focus position will shift in the opposite direction to the operation direction 1206 of the focus ring 124. Therefore, by increasing the ratio of the first focus threshold to the operation direction 1206 of the focus ring 124, it is possible to extract a large subject area without the focus position shifting in the opposite direction to the operation direction 1206 of the focus ring 124.

[0119] In step S805, the focus control unit 121 sets the first focus threshold value based on the operation direction (close side) of the focus ring 124 in step S801 and the width of the first focus threshold value set in step S800. In this case, since the operation direction of the focus ring 124 is the close side, the range of the first focus threshold value is set so that the ratio of the close side is greater than the infinity side.

[0120] In step S803, focus control unit 121 determines whether the operation of focus ring 124 has ended, and if it determines that the operation of focus ring 124 has ended, proceeds to step S804, otherwise proceeds to step S806. Focus control unit 121 determines that the operation of focus ring 124 has ended if the operation speed of focus ring 124 is decelerating, and determines that the focus ring is being operated if the operation speed of focus ring 124 is accelerating or constant.

[0121] In step S804, if it is determined in step S803 that the operation of the focus ring 124 will end, the focus control unit 121 performs processing to set a second focus threshold and proceeds to step S701 in FIG. 7. In this case, the second focus threshold is set to, for example, a value smaller than the first focus threshold set in step S800. This is because, when the user ends the operation of the focus ring 124, the user performs an operation to focus on the intended subject, and it is expected that the focus position will not change after the operation of the focus ring 124 is ended. Therefore, by setting the representative area set in step S705 in FIG. 7 within the focusing range, the amount of change in the focus position after the operation of the focus ring 124 is ended is small, and AF control can be performed on the main subject without degrading the quality of the video.

[0122] In step S806, when the focus control unit 121 determines that the focus ring 124 is being operated in step S803, it performs a process of setting a second focus threshold value and advances the process to step S701 in FIG. 7. In this case, the second focus threshold value is set to the same value as the first focus threshold value set in step S800. During the operation of the focus ring 124, there is no need to set a representative area from within the in-focus range, and the reference point set in step S704 is set as the representative area. As a result, for example, when the reference point is the centroid of the subject area, it becomes possible to display a tracking candidate frame at the centroid position of the subject area at the start of AF in step S420 of FIG. 4. If the position of the tracking candidate frame at the start of AF displayed in step S420 of FIG. 4 is, for example, the centroid position of the subject area, the user can easily grasp the AF start position after the operation of the focus ring 124 is completed.

[0123] <AF Frame Display Process> Next, referring to FIG. 9, the AF frame display process at the time of subject detection in step S417 of FIG. 4 will be described.

[0124] In step S901, the focus control unit 121 determines the focus mode. If it is the "MF / AF Switching Mode", the process advances to step S902. Otherwise, the process advances to step S903.

[0125] In step S902, when the focus control unit 121 determines that the user has finished operating the focus ring 124, it displays a tracking face frame as illustrated in FIG. 13(a) for the detected subject for which the AF frame was set in step S416 of FIG. 4. In the example of FIG. 13(a), a tracking frame 1302 indicating that tracking AF is to be executed for the detected subject 1301 for which the AF frame was set in step S416 of FIG. 4 is displayed.

[0126] In step S903, the focus control unit 121 determines whether the tracking candidate frame display setting is valid. If it is valid, the process advances to step S904. If it is invalid, the process advances to step S905. <000045​ In step S904, the focus control unit 121 displays a face frame 1304 and a tracking candidate frame 1305, as illustrated in Fig. 13(b), for a detected subject for which an AF frame was set in step S416 of Fig. 4 while the user is operating the focus ring 124. In the example of Fig. 13(b), a face frame 1304 indicating that the detected subject 1303 for which an AF frame was set in step S416 of Fig. 4 is in an approximately in-focus range is displayed. In addition, a tracking candidate frame 1305 indicating that the detected subject is a tracking candidate is displayed for a main subject specified by the user by operating the control ring 125 among the multiple detected subjects 1303 in the approximately in-focus range.

[0128] In step S905, the focus control unit 121 displays a face frame 1304, as illustrated in Fig. 13(c), for the detected subject for which an AF frame was set in step S416 in Fig. 4. In the example of Fig. 13(c), a face frame 1304 indicating that the detected subject is in the approximate in-focus range is displayed for the detected subject 1303 for which an AF frame was set in step S416 in Fig. 4. Furthermore, because the tracking candidate frame display setting is not enabled, the tracking candidate frame 1305 is not displayed for the main subject that the user specified by operating the control ring 125 among the multiple detected subjects 1303.

[0129] The tracking frame, face frame, and tracking candidate frame are displayed in different forms so that they can be distinguished by the user.

[0130] 6, if there are multiple detected subjects in the approximate-focus range, icon 1306 is displayed as shown in FIGS. 13(b) and 13(c). This prompts the user to operate the control ring 125, and notifies the user that the main subject cannot be changed using the focus ring 124. Note that instead of notification using icon 1306, notification may be made by continuing to display a tracking candidate frame at the AF frame position determined in step S602 of FIG. 6, and restricting switching of subjects.

[0131] Next, the AF frame display process when no subject is detected in step S420 of FIG. 4 will be described with reference to FIG.

[0132] In step S1001, the focus control unit 121 determines the focus mode, and if it is the "MF / AF switching mode", the process proceeds to step S1002, and if not, the process proceeds to step S1005.

[0133] In step S1002, the focus control unit 121 determines whether the AF control mode is "tracking AF," and if it is "tracking AF," proceeds to step S1003; otherwise, proceeds to step S1004.

[0134] In step S1003, when the user has finished operating the focus ring 124, focus control unit 121 displays a tracking frame on the main subject designated by the user through manual focus operation in step S418 of FIG.

[0135] In step S1004, the focus control unit 121 does not display the tracking frame.

[0136] In step S1005, the focus control unit 121 determines whether the tracking candidate frame display setting is enabled, and if it is enabled, the process proceeds to step S1006, and if it is disabled, the process proceeds to step S1008.

[0137] In step S1006, the focus control unit 121 determines whether the AF control mode is "tracking AF," and if it is "tracking AF," proceeds to step S1007; otherwise, proceeds to step S1008.

[0138] In step S1007, the focus control unit 121 displays a tracking candidate frame indicating that the subject for which the AF frame was set in step S419 in FIG. 4 is a tracking target while the user is operating the focus ring 124.

[0139] In step S1008, the focus control unit 121 does not display the tracking frame.

[0140] FIG. 14 is a diagram illustrating a method for displaying an AF frame when no subject is detected in this embodiment.

[0141] 14(a) to 14(d) show examples of transitions in the display state of the AF frame from before, during, and after operation of the focus ring 124. Subjects 1401 to 1403 shown in Fig. 14 respectively indicate subjects not detected by the subject area detection unit 126, with subject 1401 being on the infinity side, subject 1402 being closer than subject 1401, and subject 1403 being closer than subject 1402.

[0142] Fig. 14(a) shows an example of the imaging screen before operation of the focus ring 124. In the example of Fig. 14(a), no subject has been detected and the camera is in AF mode, so the AF frame is not displayed as described in Fig. 2(a).

[0143] Fig. 14(b) shows an example of an imaging screen during operation of the focus ring 124. In the example of Fig. 14(b), an AF frame is set around the subject 1402 by the AF frame determination process in step S419 in Fig. 4, and a tracking candidate frame 1404 indicating that the subject 1402 is a candidate for a tracking target is displayed superimposed on the subject 1402 at the start of tracking.

[0144] Fig. 14(c) shows an example of an imaging screen during operation of the focus ring 124 when manual focus operation is performed to an even closer position than in Fig. 14(b). In Fig. 14(c), as in Fig. 14(b), an AF frame is set around the subject 1403 by the AF frame determination process in step S419 in Fig. 4, and a tracking candidate frame 1404 is displayed superimposed on the subject 1403.

[0145] In addition, when the subject in Figures 14(a) to 14(c) is not detected, icon 1306 may be displayed as shown in Figures 13(b) and 13(c) to notify the user that the main subject can be changed using focus ring 124.

[0146] Fig. 14(d) shows an example of an imaging screen after completion of operation of the focus ring 124. In the example of Fig. 14(d), the focus mode is set to "MF / AF switching mode," the AF control after completion of MF operation is "tracking AF," and a tracking frame 1405 is superimposed to indicate that tracking AF will be performed on the subject 1403 that was a tracking candidate in Fig. 14(c).

[0147] Note that, in this embodiment, an example has been shown in which the tracking candidate frame 1404 is a rectangular frame with dashed lines, and the tracking frame 1405 is a rectangular frame with solid lines, but this is not limiting, and the shape, color, size, etc. of the frame may be changed. For example, the tracking candidate frame 1404 may be an orange double lock frame displayed with a fixed size, and the tracking frame 1405 may be a white double rectangular frame with a variable size according to the size of the subject.

[0148] According to this embodiment, by superimposing a tracking frame or a tracking candidate frame on the AF frame position set by manual focus operation when a subject is not detected, the user can easily grasp the subject to be tracked during manual focus operation and after the manual focus operation is completed.

[0149] [Other embodiments] This embodiment can also be realized by supplying a program that realizes one or more functions of the above-described embodiment to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0150] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention.

[0151] The disclosure of this specification includes the following control device, imaging device, control method, and program. [Configuration 1] a display control means for controlling the display means to display the captured image; a control means for performing autofocus control on a predetermined subject selected based on a user operation for changing the focus state of a subject included in the image, The control device is characterized in that the display control means controls the display so that first information indicating that the specified subject is a target of the autofocus control is superimposed on the specified subject. [Configuration 2] 2. The control device according to configuration 1, wherein the display control means controls the display so that the first information is superimposed on the predetermined subject until the user operation is completed. [Configuration 3] The autofocus control can be switched to any one of a plurality of autofocus controls including a tracking AF that keeps a subject that is the target of the autofocus control in focus at all times, 3. The control device according to configuration 1 or 2, wherein, when the autofocus control is set to the tracking AF, the control means executes the tracking AF on the predetermined subject after the user operation is completed. [Configuration 4] a setting unit for setting whether or not to execute the tracking AF on the predetermined subject after the user operation is completed; The control device according to configuration 3, wherein, when the setting means has set the tracking AF to be performed, the control means performs the tracking AF on the predetermined subject after the user operation is completed. [Configuration 5] a detection means for detecting a subject from the captured image, 5. The control device according to any one of configurations 1 to 4, wherein, when the detection means has not detected a subject, the display control means controls the display so that the first information is displayed in a first form for the predetermined subject selected by the user operation while the user operation is being performed. [Configuration 6] The control device according to configuration 5, characterized in that after the user operation is completed, the display control means controls the display of the first information for the specified subject selected by the user operation in a second form different from the first form. [Configuration 7] 5. The control device according to configuration 3 or 4, wherein the first information is information indicating that the predetermined subject is a target of the tracking AF. [Configuration 8] It is possible to set whether or not to display the first information when it is set to perform the tracking AF on the predetermined subject after the user operation is completed, 5. The control device according to configuration 4, wherein the display control means controls the display of the first information so as to superimpose the first information on the predetermined subject when the display of the first information is set. [Configuration 9] 5. The control device according to configuration 3 or 4, wherein when the autofocus control is not set to the tracking AF, the display control means controls so as not to display the first information for the specified subject. [Configuration 10] 10. The control device according to any one of configurations 1 to 9, wherein the first information is a frame surrounding the subject. [Configuration 11] a detection means for detecting a subject from the captured image, 5. The control device according to any one of configurations 1 to 4, characterized in that, when a plurality of subjects are detected by the detection means and the setting is to display the first information, the display control means controls the display so that second information in a form different from the first information is superimposed on the plurality of subjects while the user operation is being performed, and the first information is superimposed in the first form together with the second information on a subject selected from the plurality of subjects. [Configuration 12] The control device according to configuration 11, characterized in that after the user operation is completed, the display control means controls the display of the first information for a subject selected from the plurality of subjects in a second form different from the first form. [Configuration 13] 13. The control device according to configuration 11 or 12, wherein the plurality of subjects include subjects having the same focal distance. [Configuration 14] 14. The control device according to any one of configurations 11 to 13, wherein the second information is a frame surrounding the subject. [Configuration 15] The control device described in configuration 5, characterized in that when a subject is not detected by the detection means, the control means extracts a subject area based on a first threshold value for focus information acquired from the image in response to the user operation, and determines the specified subject by setting a representative area from the subject area based on a second threshold value. [Configuration 16] the first threshold is set so that, when the user operation is on the infinity side in the optical axis direction, the range on the infinity side is larger than the range on the close range side; the first threshold is set such that, when the user operation is on the close side in the optical axis direction, the range on the close side is larger than the range on the infinity side; the second threshold is set to the same value as the first threshold until the user operation is terminated; 16. The control device according to configuration 15, wherein the second threshold is set to a value smaller than the first threshold after the user operation is completed. [Configuration 17] A control device according to any one of configurations 1 to 16; and an imaging means for capturing an object image formed by an optical system. [Configuration 18] a control step of performing autofocus control on a predetermined subject selected based on a user operation for changing the focus state of a subject included in a captured image; and a display control step of controlling the display of first information indicating that the specified subject is a target of the autofocus control by superimposing the first information on the specified subject. [Configuration 19] 17. A program for causing a computer to function as a control device according to any one of configurations 1 to 16. [Explanation of symbols]

[0152] 100...imaging device, 106...imaging section, 109...display section, 121...focus control section, 124...control ring operation section, 125...focus ring operation section, 126...subject area detection section, 150...imaging optical system

Claims

1. a display control means for controlling the display means to display the captured image; a control means for performing autofocus control on a predetermined subject selected based on a user operation for changing the focus state of a subject included in the image, The control device is characterized in that the display control means controls the display so that first information indicating that the specified subject is a target of the autofocus control is superimposed on the specified subject.

2. 2. The control device according to claim 1, wherein the display control means controls the display so that the first information is superimposed on the predetermined subject until the user operation is completed.

3. the autofocus control is switchable to one of a plurality of autofocus controls including a tracking AF that keeps a subject that is the target of the autofocus control in focus at all times; 2. The control device according to claim 1, wherein, when the autofocus control is set to the tracking AF, the control means executes the tracking AF on the predetermined subject after the user operation is completed.

4. a setting unit for setting whether or not to perform the tracking AF on the predetermined subject after the user operation is completed; 4. The control device according to claim 3, wherein, when the setting means sets the tracking AF to be performed, the control means performs the tracking AF on the predetermined subject after the user operation is completed.

5. a detection means for detecting a subject from the captured image, 2. The control device according to claim 1, wherein, when the detection means has not detected a subject, the display control means controls the display so that the first information is displayed in a first form for the specified subject selected by the user operation while the user operation is being performed.

6. The control device according to claim 5, characterized in that, after the user operation is completed, the display control means controls the display so that the first information is displayed in a second form different from the first form for the specified subject selected by the user operation.

7. 4. The control device according to claim 3, wherein the first information is information indicating that the predetermined subject is a target of the tracking AF.

8. It is possible to set whether or not to display the first information when it is set that the tracking AF is to be performed on the predetermined subject after the user operation is completed, 5. The control device according to claim 4, wherein the display control means controls the display of the first information so as to superimpose the first information on the predetermined subject when the display of the first information is set.

9. 4. The control device according to claim 3, wherein when the autofocus control is not set to the tracking AF, the display control means controls so as not to display the first information for the predetermined subject.

10. 2. The control device according to claim 1, wherein the first information is a frame surrounding the subject.

11. a detection means for detecting a subject from the captured image, The control device according to claim 1, characterized in that, when a plurality of subjects are detected by the detection means and the setting is to display the first information, the display control means controls the display so that second information in a form different from the first information is superimposed on the plurality of subjects while the user operation is being performed, and the first information is superimposed in the first form together with the second information on a subject selected from the plurality of subjects.

12. 12. The control device according to claim 11, wherein the display control means controls the display of the first information for a subject selected from the plurality of subjects in a second form different from the first form after the user operation is completed.

13. The control device according to claim 11 , wherein the plurality of subjects include subjects having the same focal distance.

14. 12. The control device according to claim 11, wherein the second information is a frame surrounding the subject.

15. The control device described in claim 5, characterized in that when the detection means does not detect a subject, the control means determines the specified subject by extracting a subject area based on a first threshold value for focus information acquired from the image in response to the user operation, and setting a representative area from the subject area based on a second threshold value.

16. the first threshold is set so that, when the user operation is on the infinity side in the optical axis direction, the range on the infinity side is larger than the range on the close range side; the first threshold is set such that, when the user operation is on the close side in the optical axis direction, the range on the close side is larger than the range on the infinity side; the second threshold is set to the same value as the first threshold until the user operation is terminated, The control device according to claim 15, wherein the second threshold is set to a value smaller than the first threshold after the user operation is completed.

17. A control device according to any one of claims 1 to 16; and an imaging means for capturing an object image formed by an optical system.

18. a control step of performing autofocus control on a predetermined subject selected based on a user operation for changing the focus state of a subject included in a captured image; a display control step of controlling the display of first information indicating that the specified subject is a target of the autofocus control by superimposing the first information on the specified subject.

19. A program for causing a computer to function as the control device according to any one of claims 1 to 16.

Images