Imaging apparatus, control method for the same, program, and storage medium

Abstract

To improve visibility of a subject being filmed in shooting product introduction video.SOLUTION: An imaging apparatus includes imaging means for capturing an image of a subject, subject detection means for detecting the subject from the image acquired by the imaging means, focusing means for focusing an optical system on the detected subject, and control means for displaying the image on display means and causing the display means to display an indication identifying the subject focused by the focusing means at a position not overlapping the subject.SELECTED DRAWING: Figure 17

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus and a control method thereof. [Background technology]

[0002] AF (autofocus) control is generally performed by selecting an object to be focused on and driving a focus lens based on the defocus amount detected for that object. Representative methods for selecting an object to be focused on include face priority AF as disclosed in Patent Document 1 and close-up priority AF as disclosed in Patent Document 2.

[0003] Face priority AF is a method in which the focus lens is driven using the defocus amount of a face detected using a method such as template matching, while nearest subject priority AF is a method in which multiple focus detection areas are set within the screen, and the focus lens is driven using the defocus amount of the nearest focus detection area.

[0004] In recent years, an increasing number of users are streaming videos in which they introduce products while filming themselves. In these product introduction videos, the scenes can be roughly classified into the following three types, as shown in Figures 7(a), (b), and (c). Details of each scene will be described later. (a) A scene in which only the introducer is filmed (b) A scene where the product is presented in front of the camera (c) Scenes in which the product is used The subject you want to focus on for each of the above scenes is different. Generally, you will want to focus on the presenter in (a), the product being introduced in (b), and the presenter in (c).

[0005] In these scenes, the presenter needs to shoot the video while looking at the display unit installed in the imaging device in order to check the imaging status and operation status. Therefore, imaging devices equipped with an AF control function display the imaging status on the display unit so that the subject to be focused on during AF control can be known, and in addition, displays showing the focus detection area and the driving status of the focus lens are displayed so as to be superimposed on the captured image.

[0006] For example, in Patent Document 1, an AF frame is superimposed on a captured image in a viewfinder or LCD. Also, in Patent Document 2, for example, a display showing a focus point is superimposed on an image and various information displayed on a display unit. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2010-230871 A [Patent Document 2] JP 2016-142779 A Summary of the Invention [Problem to be solved by the invention]

[0008] However, when the display showing the imaging status and the display showing the focus detection area during AF and the driving status of the focus lens are displayed superimposed on the display of the imaging device with AF function, there is a concern that the visibility of the target to be focused may be impaired. In particular, in a scene in which a product introducer introduces a product while photographing himself, as shown in Figures 7(a), (b), and (c), it is difficult for the product introducer, who also serves as the photographer, to clearly view the display of the imaging device at a distance. Therefore, even when information such as the focus detection area is displayed, it is desirable not to reduce the visibility of the target to be photographed.

[0009] The present invention has been made in consideration of the above-mentioned problems, and has as its object to improve the visibility of a subject being filmed when shooting a product introduction video. [Means for solving the problem]

[0010] The imaging device according to the present invention is characterized in comprising an imaging means for imaging a subject, a subject detection means for detecting the subject from an image acquired by the imaging means, a focus adjustment means for focusing an optical system on the detected subject, and a control means for causing a display means to display the image and for causing the display means to display an indication of the subject focused on by the focus adjustment means in a position not overlapping the subject. Effect of the Invention

[0011] According to the present invention, it is possible to improve the visibility of the subject being filmed when shooting a product introduction video. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram showing the overall configuration of an imaging apparatus according to a first embodiment of the present invention. [Diagram 2] 1 is a schematic diagram showing a pixel surface of an image sensor as viewed from the light incident side. [Diagram 3] 4 is a flowchart showing the procedure of a shooting process. [Figure 4] 4 is a flowchart showing the procedure of a video shooting process. [Diagram 5] 4 is a flowchart showing the procedure of a still image shooting process. [Figure 6] 11 is a flowchart showing the procedure of focus detection processing. [Figure 7] FIG. 1 is a schematic diagram showing a scene when a product is introduced. [Figure 8] 4 is a flowchart showing the procedure of face priority AF processing. [Figure 9] 5A to 5C are diagrams for explaining the operation of face priority AF processing. [Figure 10] 11 is a flowchart showing the procedure of AF processing for the review mode. [Figure 11] 6A to 6C are diagrams for explaining the operation of AF processing for review mode. [Figure 12]11 is a flowchart showing the procedure of a reference point determination process. [Figure 13] 11 is a flowchart showing the procedure of a focus point determination process. [Figure 14] 11 is a flowchart showing a procedure of a display process. [Figure 15] 11 is a flowchart showing the procedure of a shooting information synthesis process. [Figure 16] A diagram showing an image with a frame [Figure 17] FIG. 13 is a diagram showing an image in which a frame line is added to the periphery of the display image data. [Figure 18] FIG. 13 is a diagram showing an image in which a frame is combined with display image data. [Figure 19] FIG. 13 is a diagram showing an image in which a frame line is added to the periphery of the display image data. [Figure 20] FIG. 13 is a diagram showing an image in which a frame line is combined with display image data. [Figure 21] FIG. 13 is a diagram showing an image in which a graphic is combined with display image data. [Figure 22] FIG. 13 is a diagram showing an image in which a graphic is combined with display image data. [Figure 23] FIG. 13 is a diagram showing an image in which a graphic is combined with display image data. [Figure 24] FIG. 13 is a diagram showing an image in which a graphic is combined with display image data. [Diagram 25] FIG. 13 is a diagram showing the overall configuration of an imaging apparatus according to a second embodiment. [Figure 26] 10 is a flowchart showing the procedure of shooting information synthesis processing in the second embodiment. [Figure 27] 13 is a flowchart showing the procedure of shooting information synthesis processing in the third embodiment. [Figure 28] FIG. 13 is a diagram showing an image in which a frame line is added to the periphery of the display image data. [Figure 29] 13 is a flowchart showing the procedure of shooting information synthesis processing in the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0014] (First embodiment) FIG. 1 is a diagram showing the overall configuration of an image capturing apparatus 300 according to a first embodiment of the present invention.

[0015] 1, imaging device 300 is configured to include lens unit 100 and camera unit 200. Lens unit 100 is detachably attached to camera unit 200 via a lens attachment mechanism of a mount unit (not shown). An electrical contact unit 108 is provided in the mount unit, and lens unit 100 and camera unit 200 can communicate with each other via electrical contact unit 108.

[0016] The lens unit 100 is provided with a lens group 101 including a focus lens for focusing and a zoom lens for zooming, and an aperture 102 for adjusting the amount of light of an incident light beam. The lens group 101 and the aperture 102 control the incident light beam as an imaging optical system.

[0017] Lens unit 100 is also provided with a lens controller 104 consisting of a CPU that controls the overall operation of lens unit 100. Lens controller 104 is connected to lens drive unit 103 that controls the drive of the focus lens, lens position detection unit 105 that detects the position of the focus lens, and aperture control unit 106 that controls the opening of aperture 102. Lens unit 100 is also provided with optical information recording unit 107 in which various optical design values ​​such as zoom, focus, aperture, and a data table showing the relationship between the focus position and the subject distance of lens group 101 are recorded.

[0018] The camera unit 200 communicates with the lens unit 100 via the electrical contact unit 108, transmits control requests related to the zoom, focus, and aperture of the lens group 101, and receives the control results.

[0019] An incident light ray is guided to an imaging section 201 disposed in a camera section 200 via a lens group 101 and an aperture 102. The imaging section 201 has an image sensor 201a that photoelectrically converts the incident light ray, and a processor that performs various imaging controls such as charge accumulation time control and light receiving sensitivity control, and various image processing such as electronic development calculation and brightness correction.

[0020] 2 is a schematic diagram showing the pixel surface of the image sensor 201a as viewed from the light incident side. The image sensor 201a has h pixel sections 220 arranged in a matrix in the horizontal direction and v pixel sections 220 (h and v are natural numbers) arranged in the vertical direction. Each pixel section 220 has a first focus detection pixel A and a second focus detection pixel B into which a pair of light rays formed by dividing an object image on the exit pupil plane are incident. By adding up the charges of the first focus detection pixel A and the second focus detection pixel B, a charge as an imaging pixel can be obtained. A microlens ML is formed on the light incident side of the first focus detection pixel A and the second focus detection pixel B.

[0021] 1 calculates a defocus amount by an image plane phase difference detection method based on a signal from a first focus detection pixel A and a signal from a second focus detection pixel B obtained by the imaging unit 201. The focus detection unit 202 divides the imaging area into a plurality of rectangular areas, calculates a defocus amount corresponding to each rectangular area, and generates a defocus map for the entire imaging area.

[0022] The camera controller 203 is made up of a CPU that controls the operation of the entire camera unit 200, and transmits and receives control information to and from the lens controller 104 via the electrical contact unit 108. Based on the defocus amount calculated by the focus detection unit 202, the camera controller 203 transmits a drive request for the lens group 101, thereby controlling the focus position of the lens group 101. A focus adjustment operation is performed by the drive request for the lens group 101 from the camera controller 203, the control of the lens controller 104 provided in the lens unit 100, and the drive of the lens by the lens drive unit 103.

[0023] The subject detection unit 204 detects the type, part, and state of the subject (detection type), and the position and size of the subject (detection area) from the imaging signal obtained by the imaging unit 201 using a known pattern matching method or particle filter method.

[0024] The subject selection unit 205 selects a subject to be finally focused on, based on the defocus map corresponding to the imaging area obtained by the focus detection unit 202 and information on the detection type and detection area of ​​the subject obtained by the subject detection unit 204. When the subject selection unit 205 detects multiple subjects, the subject to be focused on is selected based on a predetermined priority, which will be described later.

[0025] Information on the subject detection area selected by the subject selection unit 205 is notified to the camera controller 203. The camera controller 203 determines a focus position to be a target of focus control based on the notified subject detection area information and the defocus map obtained by the focus detection unit 202.

[0026] The camera unit 200 also includes a recording unit 206 that compresses and encodes an image signal captured by the imaging unit 201, converts it into a predetermined format, and records it. The camera unit 200 also includes a display unit 207 that displays an image of a subject captured by the imaging unit 201 and various operation conditions. The camera unit 200 also includes an operation unit 208 for operating image capture settings such as the exposure time and light sensitivity of the imaging unit 201, and for operating a process of recording an image capture signal as a still image or a video. The operation unit 208 includes a switch 1 (hereinafter SW1) and a switch 2 (hereinafter SW2) that perform a release operation. When SW1 is on and SW2 is on during still image capture, still image capture is performed. When SW1 is on and SW2 is off, an AF operation is performed.

[0027] In addition, the focus position difference detection unit 209 detects the difference in the defocus amount between a plurality of rectangular areas in the imaging area obtained by the focus detection unit 202 .

[0028] The display control unit 210 generates images and figures to be displayed on the display unit 207 based on instructions from the camera controller 203 .

[0029] The memory 211 stores programs executed by the camera controller 203. The memory 211 is also used as a work area for the camera controller 203.

[0030] <Operation of the imaging device> Next, a description will be given of the operation of the imaging device 300. The operation of the imaging device 300 is realized by the camera controller 203 executing a control program stored in the memory 211.

[0031] The imaging device 300 has a moving image shooting mode in which moving image shooting processing is performed, and a still image shooting mode in which still image shooting processing is performed in response to an operation input. The camera controller 203 switches to one of the operation modes in response to an operation input to the operation unit 208. Fig. 3 is a flowchart showing the procedure of the shooting processing. S means a step.

[0032] In S301, the camera controller 203 performs initialization processing such as camera settings, and advances the processing to S302.

[0033] In S302, the camera controller 203 determines whether the shooting mode of the camera unit 200 is moving image shooting mode or still image shooting mode, and if it is moving image shooting mode, the process proceeds to S303, and if it is still image shooting mode, the process proceeds to S304.

[0034] In S303, the camera controller 203 performs a moving image shooting process, and the process proceeds to S305. The moving image shooting process in S303 will be described in detail later with reference to FIG.

[0035] In S304, the camera controller 203 performs a still image shooting process, and the process proceeds to S305. Details of the still image shooting process in S304 will be described later with reference to FIG.

[0036] In S305, the camera controller 203 determines whether the image capturing process has been stopped, and if it has not been stopped, the process proceeds to S306, and if it has been stopped, the image capturing process ends. The image capturing process is stopped when the power supply to the camera unit 200 is turned off, when a setting process by the camera user is performed, when a playback process for checking captured images and videos is performed, or when an operation other than image capturing is performed.

[0037] In S306, the camera controller 203 determines whether or not the shooting mode has been changed by an operation input to the operation unit 208. If the shooting mode has been changed, the camera controller 203 returns to S301, performs initialization processing, and then performs shooting processing in the changed shooting mode. On the other hand, if the shooting mode has not been changed, the camera controller 203 returns to S302, and continues to perform the processing S302 to S306 in the current shooting mode.

[0038] Next, the moving image shooting process performed in S303 of FIG. 3 will be described with reference to the flowchart of FIG.

[0039] In S401, the camera controller 203 performs an image capturing operation to obtain an image capturing signal by the image capturing unit 201, and advances the process to S402.

[0040] In S402, the camera controller 203 determines whether or not the moving image recording switch is on, and if it is on, proceeds to S403, and if it is not on, proceeds to S404.

[0041] In S403, since the moving image recording switch of the camera controller 203 is on, the camera controller 203 performs an operation of recording the imaging signal obtained in S401 as a moving image in the recording unit 206.

[0042] In S404, the camera controller 203 performs focus detection processing using the focus control unit 202, and the process proceeds to S405. The focus detection processing is processing in which the camera controller 203 and the focus detection unit 202 acquire defocus information and reliability information by image plane phase difference AF. Details will be described later using the flowchart in FIG.

[0043] In S405, the camera controller 203 determines whether the recording mode in the moving image shooting process is the review mode or not, and if the review mode is set, the process proceeds to S407, and if the review mode is not set, the process proceeds to S406.

[0044] Here, the review mode is a mode specialized for recording videos to introduce products (goods) for video distribution, etc., and in this embodiment, the method of focus detection processing described below is switched by switching the review mode on and off.

[0045] S406 is a process when the review mode is not selected in S405, and the camera controller 203 performs conventional face priority AF in response to the result of the focus detection process in S404. Details of face priority AF will be described later using the flowchart in FIG.

[0046] In S407, the camera controller 203 receives the result of the focus detection process in S404 and performs AF process for review mode. The AF process for review mode is AF process dedicated to the review mode, and details will be described later using the flowchart in FIG.

[0047] After completing the processes of S406 and S407, the camera controller 203 ends the moving image shooting process.

[0048] Next, the still image shooting process performed in S304 of FIG. 3 will be described with reference to the flowchart of FIG.

[0049] In S501, the camera controller 203 determines whether or not SW1 provided on the operation unit 208 has been turned on. If SW1 is on, the process proceeds to S502. If SW1 is off, the still image shooting process ends.

[0050] S502 is a focus detection process, and the camera controller 203 executes the same process as S404 in FIG.

[0051] In S503, the camera controller 203 determines whether to switch the frame selection method. In the imaging device 300 of this embodiment, a selection frame priority mode in which the focus lens is driven using the focus detection result of a focus detection area previously selected by the user, and a face frame priority mode in which the focus lens is driven using the focus detection result of the focus detection frame at the detection position of a person's face detected can be selected. If the selection frame priority mode is set, the process proceeds to S504 and the focus lens is driven. If the face frame priority mode is set, the process proceeds to S505 and face priority AF is performed. The face priority AF process in S505 is the same process as S406 in FIG. 4.

[0052] In S506, the camera controller 203 determines whether or not SW2 provided on the operation unit 208 is turned on. If SW2 is on, the process proceeds to S507, where a still image is recorded by performing imaging processing, and the still image shooting process ends. If SW2 is off, the still image shooting process ends without recording a still image.

[0053] Next, the focus detection process in S404 in FIG. 4 will be described with reference to FIG.

[0054] First, in S601, the camera controller 203 sets a plurality of focus detection areas of arbitrary ranges within the image capturing unit 201, and advances the process to S602.

[0055] In S602, the camera controller 203 acquires a pair of image signals (image A and image B) for focus detection from the imaging unit 201 for the focus detection area set in S601, and proceeds to the process of S603.

[0056] In S603, the camera controller 203 performs row averaging processing in the vertical direction on the pair of signals acquired in S602, and proceeds to the process of S604. The processing in S603 can reduce the influence of noise on the image signal.

[0057] In S604, the camera controller 203 performs filtering to extract signal components in a predetermined frequency band from the signal obtained by vertical row averaging in S603, and proceeds to S605. In this embodiment, a low-pass filter that extracts low-frequency components of the signal and a high-pass filter that extracts high-frequency components are used, but three or more types of filters, such as a mid-pass filter that can extract frequency components intermediate between the low-pass and high-pass filters, may also be used.

[0058] In S605, the camera controller 203 calculates the amount of correlation from the signal that has been subjected to the filter processing in S604, and advances the process to S606.

[0059] In S606, the camera controller 203 calculates the amount of correlation change from the amount of correlation calculated in S605, and advances the process to S607.

[0060] In S607, the camera controller 203 calculates the amount of image shift from the amount of correlation change calculated in S606, and advances the process to S608.

[0061] In S608, the camera controller 203 multiplies the image shift amount by a conversion coefficient to convert it into a defocus amount, and proceeds to the process of S609. This conversion coefficient is stored in a storage area (not shown) built into the focus detection unit 202 according to the zoom lens position, the aperture value, and the image height on the imaging surface.

[0062] In S609, the camera controller 203 evaluates the reliability, which indicates how reliable the defocus amount calculated in S608 is, and proceeds to S610. The reliability is determined by estimating the standard deviation of the defocus amount based on each output value calculated in the processing of S605 or S606, and setting a stepwise threshold value for the standard deviation. However, the method of determining the reliability is not limited to this method, and other methods may be used.

[0063] In S610, the camera controller 203 determines whether or not processing has been completed for all focus detection areas set in S601. If processing has not been completed for all focus detection areas, the process returns to S602 and processing is performed for the next focus detection area. If it is determined in S610 that processing has been completed for all focus detection areas, the focus detection process ends.

[0064] Next, a description will be given of the AF processing in S406 and S407 in Fig. 4. Before describing the processing flowchart, a scene in which the review mode is used will be described with reference to Fig. 7.

[0065] As explained in the Background Art section, Figures 7(a), (b), and (c) show typical scenes in a video introducing a product, and each has the following meaning: (a) A scene in which only the main person is photographed (b) A scene where the product is presented in front of the camera (c) Scenes in which the product is used In this embodiment, as an easy-to-understand example, a scene introducing cosmetics will be described. Reference numeral 701 indicates an introducer introducing a product. Reference numeral 702 indicates the product being introduced. In this embodiment, reference numeral 703 indicates the cosmetics and 704 indicates a hand mirror. The object to be focused on differs for each scene. In (a), the introducer is speaking, so it is thought that one would like to focus on the introducer 701. In (b), one would like to emphasize the product, so it is thought that one would like to focus on the product 702. In (c), one would like to emphasize the change that occurs when makeup is applied, so it is thought that one would like to focus on the introducer 701.

[0066] Next, the face priority AF process in S406 in FIG. 4 will be described with reference to the flowchart in FIG.

[0067] When the camera controller 203 starts face priority AF in S406 in Fig. 4, the process proceeds to S801 in Fig. 8, where face detection processing is performed. In the face detection processing, the subject detection unit 204 detects the position of a face on the imaging surface using a template matching technique based on the imaging signal output from the imaging unit 201.

[0068] In S802, the camera controller 203 determines whether or not a face was detected in S801. If a face was detected, the process proceeds to S803, and if a face was not detected, the process proceeds to S808.

[0069] In S803, the camera controller 203 performs an eye detection process. In the eye detection process, the subject detection unit 204 detects the position of the eye on the imaging surface using a method similar to that of S801. Note that the method of the detection process in S801 and S803 is not limited to template matching, and other methods such as a particle filter or machine learning may be used.

[0070] In S804, the camera controller 203 determines whether or not an eye has been detected in the eye detection process in S803.

[0071] If an eye is detected in S804, the process proceeds to S805. Then, the subject selection unit 205 determines the focus position indicated by the defocus amount in the focus detection area closest to the detected eye position on the imaging plane among the focus detection areas set in S601 as the target position of the focus lens position. Then, the camera controller 203 drives the focus lens to the target position in S806 and ends the face priority AF process.

[0072] If no pupil is detected in S804, the process proceeds to S807. Then, the subject selection unit 205 sets the focus position indicated by the defocus amount of the focus detection area that overlaps with the detected face detection area on the imaging plane among the focus detection areas set in S601 as the target position of the focus lens. Then, the camera controller 203 drives the focus lens to the target position in S806 and ends the face priority AF process.

[0073] If a face cannot be detected in S802, the process proceeds to S808. Then, the subject selection unit 205 sets the focus position indicated by the closest defocus amount from among the multiple focus detection areas set in S601 as the target position of the focus lens. Then, the camera controller 203 drives the focus lens to the target position in S806 and ends the face priority AF process.

[0074] Here, when selecting a focus detection area with the closest defocus amount in S808, a region close to the central image height may be prioritized, or the focus detection area may be limited to a region close to the center. Even if a face or an eye cannot be detected, if a prominent imaging area similar to a face can be determined on the imaging plane based on color information of the imaging signal output from the imaging unit 201, a focus detection area overlapping the imaging area may be prioritized.

[0075] Next, how the AF operation is performed when a video introducing a product is shot using the face priority AF processing flow described with reference to FIG. 8 will be described with reference to FIG.

[0076] In FIG. 9(a), the imaging device 300 captures an introducer 701 and a product 702 (703, 704). A thick dashed line 902 indicates a focus position (a position in the depth direction of an image) calculated based on the defocus amount of the introducer 701's face (or eyes), and this focus position is hereinafter defined as a reference point (reference position). A thick dashed line 903 indicates a focus position (a position in the depth direction of an image) calculated based on the defocus amount of the product 702 (703, 704), and this focus position is hereinafter defined as a focus point (focus position). A dashed line 904 indicates a focus position after AF processing, and is located at the same position as the thick dashed line 902 as a result of AF processing in the face-priority AF processing flow of S406. Numerals 905 and 906 indicate the close end and infinity end of the depth of field, which are determined by the aperture diameter of the aperture 102 and the allowable circle of confusion diameter based on the pixel size of the imaging unit 201. Since a subject existing between 905 and 906 is within the depth of field, it can be said that the subject is in focus.

[0077] In the case of FIG. 9(a), the reference point 902 is within the depth of field, so the face (eyes) of the introducer 701 is in focus, but the attention point 903 is outside the depth of field, so the product 702 is out of focus.

[0078] Next, the review mode AF process will be described with reference to the flowchart in FIG. 10 and FIG.

[0079] In S1001, the camera controller 203 performs a reference point determination process. The reference point is a focus position calculated based on the defocus amount of the face (eyes) area of ​​the introducer 701, as described in FIG. 9(a). Details of the reference point determination process will be described later with reference to the flowchart of FIG.

[0080] In S1002, the camera controller 203 determines whether or not the reference point was determined in S1001. If the reference point was determined, the process proceeds to S1003, and if the reference point was not determined, the process proceeds to S1007.

[0081] In S1003, the camera controller 203 performs a focus point determination process. The focus point is a focus position calculated based on the defocus amount of the area of ​​the product 702 (703, 704) as described in FIG. 9A. The focus point determination process will be described in detail later with reference to the flowchart in FIG. 13.

[0082] In S1004, the camera controller 203 uses the focus position difference detection unit 209 to evaluate the difference (defocus amount difference) between the focus position of the reference point determined in S1001 and the focus position of the point of interest determined in S1003. If the defocus amount difference between the reference point and the point of interest is greater than a first defocus amount threshold described below, the process proceeds to S1005, and if the defocus amount difference between the reference point and the point of interest is equal to or smaller than the first defocus amount threshold, the process proceeds to S1006. Here, the first defocus amount threshold is a threshold determined by the depth of field based on the aperture diameter of the aperture 102 and the shooting distance.

[0083] In S1005, the subject selection unit 205 sets the target position of the focus lens to the point of interest.

[0084] On the other hand, in S1006, the subject selection unit 205 sets the target position of the focus lens as the reference point. Here, a further explanation will be given with reference to FIG.

[0085] In Fig. 11, 1101 indicates the defocus amount difference between the reference point and the point of interest. 1102 is a first defocus amount threshold. The situation in which the process proceeds to S1005 in Fig. 10 is a situation in which the introducer 701 brings the product 702 closer to the imaging device 901, and assumes the scene in Fig. 11(a). At this time, the defocus amount difference 1101 becomes larger than the first defocus amount threshold 1102. Therefore, as in the situation shown in Fig. 7(b), it is considered that there is a desire to focus on the product 702, and therefore in S1005, the target position of the focus lens is set to the point of interest.

[0086] On the other hand, the situation in which the process proceeds to S1006 is one in which the product 702 and the introducer 701 are close to each other, as shown in Fig. 11(b). At this time, the defocus amount difference 1101 is equal to or smaller than the first defocus amount threshold 1102. Therefore, as shown in Fig. 7(c), it is considered that there is a desire to focus on the introducer 701, and therefore in S1006, the target position of the focus lens is set to the reference point.

[0087] 7(a), when only the introducer 701 is shown, the focus point is the focus position of the area of ​​the introducer 701, so it is possible to focus on the introducer 701 by adjusting the first defocus amount threshold. The first defocus amount threshold is a threshold determined by the depth of field due to the aperture diameter of the aperture 102 and the shooting distance, but may be determined by an instruction from the user via the operation unit 208.

[0088] In S1007, the subject selection unit 205 sets the target position of the focus lens to a focus position based on the closest defocus amount. In this case, since the reference point could not be determined in S1001, for example, the closest defocus amount is set as the target position.

[0089] In S1008, the camera controller 203 drives the focus lens in accordance with the target position of the focus lens determined in S1005, S1006, and S1007, and ends the review mode AF processing.

[0090] Next, the reference point determination process will be described with reference to the flowchart of FIG.

[0091] In S1201, the camera controller 203 executes face detection processing. The method of the face detection processing is the same as that in S801 of FIG.

[0092] In S1202, the camera controller 203 determines whether or not the same face as the face selected as the reference point previously was detected in S1201, and if the same face was detected, the process proceeds to S1203, and if not, the process proceeds to S1210. The determination of whether or not it is the same face can be performed using an image matching method or the like, but is not limited to this method and can be performed by any method that can confirm the match of faces.

[0093] In S1203, the camera controller 203 sets the face of the same person as the face selected as the reference point previously as the main face. Note that the main face is the face that becomes the main subject of shooting in the scene and becomes the target position of focus control when one or more faces are detected.

[0094] In S1204, the camera controller 203 performs an eye detection process on the main face.

[0095] In S1205, the camera controller 203 determines whether or not the pupil of the main face was detected in S1204, and if the pupil was detected, the process proceeds to S1206, and if the pupil was not detected, the process proceeds to S1207.

[0096] In S1206, the subject selecting unit 205 sets the focus position determined by the defocus of the focus detection area of ​​the pupil position detected in S1204 as a reference point.

[0097] In S1207, the subject selection unit 205 sets the focus position determined by the defocus within the face detection range as a reference point.

[0098] In S1208, the camera controller 203 temporarily stores the reference point set by the subject selection unit 205 in a storage area (not shown) built into the subject selection unit 205 so that it can be referenced in the processing described later.

[0099] In S1209, the camera controller 203 temporarily stores the position information of the main face selected as the reference point by the subject selection unit 205 in a storage area (not shown) built into the subject selection unit 205, and ends the process.

[0100] If a face identical to the face previously set as the reference point is not detected in S1202, the process proceeds to S1210. Then, the camera controller 203 determines whether the imaging operation immediately before the immediately preceding imaging operation S401 was performed within a first time from the present, and whether the main face was saved in S1209 with the imaging operation immediately before. If saved, the process proceeds to S1211, and the subject selection unit 205 determines the previously saved reference point as the final reference point. Then, in S1212, the camera controller 203 temporarily saves the reference point in a storage area (not shown) built into the subject selection unit 205, and ends the process.

[0101] On the other hand, if the main face has not been saved in S1210, the process proceeds to S1213, where the camera controller 203 determines whether or not one or more faces have been detected in S1201. If one or more faces have been detected, the process proceeds to S1214, where the subject selection unit 205 updates the setting to the face closest to the central image height as the main face. This is a process in which the subject selection unit 205 switches the main face because the person who was the main face for the first time or more has not been detected by the subject detection unit 204.

[0102] Thereafter, the process proceeds to S1204, and the same processes as those from S1204 onwards are carried out.

[0103] If no face is detected in S1213, the process proceeds to S1215, and the subject selection unit 205 ends the reference point determination process without being able to determine a reference point.

[0104] Next, the focus point determination process will be described with reference to the flowchart of FIG.

[0105] In S1301, the camera controller 203 determines whether or not a point of interest has been designated by the user. Possible methods for the user to designate the point of interest include operating the operation unit 208, such as touching the screen of a touch panel (not shown) to designate the target, or designating coordinates on the screen using a dial (not shown). However, the present embodiment is not limited to these methods, and any known method may be used.

[0106] If a user designation has been made in S1301, the process proceeds to S1302, where the subject selection unit 205 sets the focus position indicated by the defocus amount of the focus detection area including the user-designated coordinates as the point of interest, and ends the process.

[0107] If no user designation is made in S1301, the process proceeds to S1303, where the subject selection unit 205 sets the focus position indicating the closest defocus amount to the imaging device 300 as the focus point, and ends the process. At this time, the range in which the subject selection unit 205 searches for the closest defocus amount to the imaging device 300 may be the entire shooting screen, or may be limited to a certain range of the shooting screen.

[0108] Next, the display process will be described with reference to the flowchart in FIG.

[0109] In S1401, the display control unit 210 initializes display image data to be displayed on the display unit 207. Note that the display image data is stored in a storage area (not shown) built into the display unit 207 and is readable and writable.

[0110] In S1402, the display control unit 210 converts the imaging signal obtained from the imaging unit 201 into a format corresponding to the display image data, and performs a data synthesis process so that the display unit 207 can display the converted image data as display image data.

[0111] In S1403, the display control unit 210 performs a shooting information synthesis process, which is a characteristic operation of this embodiment, on the display image data. Details of the shooting information synthesis process will be described with reference to FIG.

[0112] In S1404, the display control unit 210 performs display on the display unit 207 based on the display image data combined with the shooting information, and ends the display process.

[0113] <Image capture information synthesis process of the imaging device> Next, the photographic information synthesis process will be described with reference to the flowchart of FIG.

[0114] In S1501, the camera controller 203 evaluates the type of AF processing that has been executed up to that point. The AF processing includes AF for review mode in S407, face priority AF in S406 and S505, and AF based on the selection frame in S504, and these types are evaluated. If it is face priority AF, the process proceeds to S1502. If it is AF based on the selection frame in S504, the process proceeds to S1507. If it is AF for review mode, the process proceeds to S1508.

[0115] In S1502, the camera controller 203 evaluates the target position of the focus lens. If the target position of the focus lens is the pupil, the process proceeds to S1503, and a frame indicating the AF control target is synthesized at the pupil detection position on the imaging plane for the display image data. The synthesized image will be described with reference to FIG. 16(a).

[0116] 16(a), 1601 indicates the entire display image. Here, the introducer 701 is photographed alone, and since the focus lens position is being adjusted so that his or her pupil is in focus, a frame 1602 is synthesized corresponding to the imaging area of ​​the pupil.

[0117] If the target position of the focus lens is a face, the process proceeds to S1505, and a frame indicating an AF control target is synthesized at the face detection position on the imaging plane for the display image data. The synthesized image will be described with reference to FIG. 16(b).

[0118] In FIG. 16(b), introducer 701 is photographed alone, and since the focus lens position is being adjusted so that his or her face is brought into focus, a frame 1701 is synthesized corresponding to the imaging area of ​​the face.

[0119] If the target position of the focus lens is the closest subject, the process proceeds to S1506, and a frame indicating an AF control target is synthesized at the closest subject position on the imaging plane for the display image data. The synthesized image will be described with reference to FIG. 16(c).

[0120] In FIG. 16(c), an introducer 701 and a product 702 are shown, and since the focus lens position is being adjusted so that the closest product 702 comes into focus, frames 1801 to 1804 are synthesized in accordance with the image capturing area of ​​the product.

[0121] In S1507, the camera controller 203 synthesizes a frame indicating an AF control target at the selection frame position with respect to the display image data. The synthesized image will be described with reference to FIG.

[0122] In FIG. 16(d), introducer 701 is photographed alone, and AF is adjusted to a position on the imaging plane selected by the user, so a frame 1901 corresponding to that position is synthesized.

[0123] In S1508, since the camera controller 203 has determined that the AF is for review mode in S1501, the camera controller 203 evaluates the target position of the focus lens. If the target position of the focus lens is the point of interest, the process proceeds to S1509, where a first display, which will be described later, is composited with the display image data. If the target position of the focus lens is the reference point, the process proceeds to S1510, where a second display, which will be described later, is composited with the display image data. If the target position of the focus lens is the closest subject, the process proceeds to S1511, where a third display, which will be described later, is composited with the display image data.

[0124] In S1504, the camera controller 203 combines text information such as the shooting mode and the shutter time with the entire display image 1601, and ends the shooting information combination process.

[0125] Here, the first display will be described with reference to FIG. 17(a), and the second display will be described with reference to FIG. 17(b).

[0126] In FIG. 17(a), 2001 is a frame adjacent to the contour (peripheral portion) of the entire display image 1601. In FIG. 17(b), 2101 is a frame adjacent to the contour of the entire display image 1601. The frame 2001 is an indication indicating (distinguishing) that the product 701 is an object of AF control, and the frame 2101 is an indication indicating (distinguishing) that the introducer 701 is an object of AF control. The frame 2001 and the frame 2101 have different colors when displayed on the display unit 207. The third indication is an indication indicating that the closest subject is an object of AF control, and so is assumed here to be the same as FIG. 16(c).

[0127] 17(a) and (b), an introducer 701 and a product 702 are shown, but a frame line 2001 which is a first display and a frame line 2101 which is a second display are displayed so as not to overlap the introducer 701 and the product 702. In this embodiment, consideration is given to the fact that the frame line 2001 which is a first display indicating the AF control target and the frame line 2101 which is a second display do not overlap the introducer 701 and the product 702. This makes it possible to ensure the visibility of the image.

[0128] <Modification of the shooting information synthesis process> The first display and the second display may have different display forms.

[0129] FIG. 18(a) shows another display form in the first display, and FIG. 18(b) shows another display form in the second display.

[0130] 18(a) shows a frame 2201 indicating that the AF control target is the product 702, and in Fig. 18(b) shows a frame 2301 indicating that the AF control target is the introducer 701. As shown in Fig. 18(a) and Fig. 18(b), the frame displays 2201 and 2301 indicating the AF control target may be differentiated in size according to the AF control target while not overlapping the introducer 701 or product 702, which are the AF control targets.

[0131] Furthermore, FIG. 19(a) shows another display form in the first display, and FIG. 19(b) shows another display form in the second display. In FIG. 19(a), a frame 2401 shown in a solid line indicating that the AF control target is the product 702 is shown, and in FIG. 19(b), a frame 2501 shown in a dashed line indicating that the AF control target is the introducer 701 is shown. As shown in FIG. 19(a) and (b), the frame displays 2401 and 2501 indicating the AF control target may be differentiated by the type of line according to the AF control target while not overlapping the introducer 701 and the product 702. Note that the frame displays 2401 and 2501 may be displayed in a form in which one of the frames is flashed as a method of differentiating the type of line to be displayed.

[0132] Furthermore, FIG. 20(a) shows another display form in the first display, and FIG. 20(b) shows another display form in the second display. In FIG. 20(a), a rectangular frame 2601 is shown indicating that the AF control target is the product 702, and in FIG. 20(b), a rectangular frame 2701 with rounded corners is shown indicating that the AF control target is the introducer 701. The frame 2601 is shown in the periphery so as to be adjacent to the outline of the entire display image 1601. On the other hand, the frame 2701 is shown slightly apart from the outline of the entire display image 1601 on the inside. As shown in FIG. 20(a) and (b), the frame displays 2601 and 2701 indicating the AF control target may be differentiated in terms of the shape of the frame and the display position according to the AF control target while not overlapping the introducer 701 and the product 702. Furthermore, Fig. 21(a) shows another display form in the first display, and Fig. 21(b) shows another display form in the second display. In Fig. 21(a), 2801 shows an area for displaying an image signal obtained by the imaging unit 201 (hereinafter referred to as an imaged image display area), and the display control unit 210 performs a synthesis process of the display image data so that the displayed area is smaller than the entire display image 1601.

[0133] Such a synthesis process is effective when the aspect ratio of the captured image display area is different from the aspect ratio of the effective display area of ​​the display unit 207. For example, this process is effective when the display area of ​​the display unit 207 is provided with a vertical:horizontal ratio of 3:2 or 4:3 for still image display, but the display control unit 210 sets the captured image display area to 16:9, which is used in HDTVs and the like.

[0134] In order to explain the operation of the imaging device in such a display form, FIGS. 21(a) and (b) show a captured image display area 2801 having a shorter vertical length than the entire display image 1601.

[0135] 21(a) illustrating the first display, frame lines 2802 and 2803 are displayed in an area of ​​the entire display image 1601 excluding a captured image display area 2801 (an area outside the captured image display area, hereinafter referred to as a specific display area). Also, in FIG. 21(b) illustrating the second display, frame lines 2901 and 2902 are displayed in the specific display area.

[0136] Here, as a characteristic operation of this modified example, the display control unit 210 makes the color of the frame lines 2901 and 2902 of the second display shown in Fig. 21(b) different from the color of the frame lines 2802 and 2803 of the first display shown in Fig. 21(a). When the above-mentioned specific display area exists in the display unit 207, as shown in Figs. 21(a) and (b), the frame displays 2802, 2803, 2901, and 2902 indicating the AF control targets may be differentiated in frame color according to the AF control target while not overlapping the introducer 701 and the product 702.

[0137] Furthermore, Fig. 22(a) shows another display form in the first display, and Fig. 22(b) shows another display form in the second display. In Fig. 22(a) explaining the first display, frame lines 3001 and 3002 shown in thick solid lines are displayed in a specific display area excluding the captured image display area 2801 of the entire display image 1601. In Fig. 22(b) explaining the second display, frame lines 3101 and 3102 shown in thick dashed lines are displayed in the above-mentioned specific display area.

[0138] Here, as a characteristic operation of this modified example, the display control unit 210 changes the line type of the frame lines 3001 and 3002 of the first display shown in Fig. 22(a) to a line type different from that of the frame lines 3101 and 3102 of the second display shown in Fig. 22(b). As shown in Figs. 22(a) and (b), the frame displays 3001, 3002, 3101, and 3102 indicating the AF control target may be differentiated in line type according to the AF control target while not overlapping the introducer 701 and the product 702.

[0139] Furthermore, Fig. 23(a) shows another display form in the first display, and Fig. 23(b) shows another display form in the second display. In Fig. 23(a) explaining the first display, frame lines 3201 and 3202 shown as long thick lines are displayed in a specific display area excluding the captured image display area 2801 of the entire display image 1601. In Fig. 23(b) explaining the second display, frame lines 3301 and 3302 shown as short thick lines are displayed in a specific display area excluding the captured image display area 2801 of the entire display image 1601.

[0140] Here, as a characteristic operation of this modified example, the display control unit 210 makes the length of the lines of the frame lines 3301 and 3302 of the second display shown in Fig. 23(b) different from the length of the lines of the frame lines 3201 and 3202 of the first display shown in Fig. 23(a). As shown in Fig. 23(a) and (b), the frame displays 3201, 3202, 3301, and 3302 indicating the AF control targets may be differentiated in line length according to the AF control target while not overlapping the introducer 701 and the product 702.

[0141] Furthermore, Fig. 24(a) shows another display form in the first display, and Fig. 24(b) shows another display form in the second display. In Fig. 24(a) explaining the first display, a diamond-shaped mark 3401 is displayed in a specific display area excluding the captured image display area 2801 of the entire display image 1601. In Fig. 24(b) explaining the second display, a star-shaped mark 3501 is displayed in a specific display area excluding the captured image display area 2801 of the entire display image 1601.

[0142] Here, as a characteristic operation of this modified example, the display control unit 210 makes the shape of the mark 3501, which is the second display shown in Fig. 24(b), different from the shape of the mark 3401, which is the first display shown in Fig. 24(a). As shown in Figs. 24(a) and (b), the marks 3401 and 3501 indicating the AF control target may be differentiated in shape according to the AF control target while not overlapping with the introducer 701 and the product 702. Furthermore, the difference may be expressed not only by figures such as marks with different shapes, but also by characters.

[0143] Second Embodiment Next, a second embodiment will be described. As shown in Fig. 25, the overall configuration of the imaging device in this embodiment is obtained by adding a second display unit 211 to the overall configuration in Fig. 1. The second display unit 211 is not a screen but a lighting member such as an LED.

[0144] The photographing process, video photographing process, focus detection process, still image photographing process, face priority AF process and display process in this embodiment are respectively the same as those in Figures 3, 4, 5, 6, 8 and 14. The photographing information synthesis process differs from that in the first embodiment, and its flowchart is shown in Figure 26.

[0145] In FIG. 26, steps S3701 to S3708 are the same as steps S1501 to S1508 in FIG. 15, respectively, so the description thereof will be omitted.

[0146] In S3709, the camera controller 203 turns on the second display unit 211, and in S3710, turns off the second display unit 211. This is to display on the second display unit 211 the difference in the target position of the focus lens determined in the review mode AF processing.

[0147] The second display unit 211 may be lit by blinking a predetermined light emission pattern. The blinking pattern of the second display unit 211 may be changed according to the difference in the target position of the focus lens. The intensity of the emitted illuminance or the color of the emitted light of the second display unit 211 may be changed according to the difference in the target position of the focus lens. A plurality of light emitting units may be provided as the second display unit 211, each with a different light emitting direction (radiation direction), and it may be possible to select which of the light emitting units to light up or blink (blink).

[0148] (Third embodiment) Next, a third embodiment will be described. The overall configuration of the imaging device in this embodiment is the same as that in Fig. 1. The shooting process, video shooting process, focus detection process, face priority AF process, still image shooting process and display process in this embodiment are the same as those in Figs. 3, 4, 6, 8, 5 and 14, respectively. The shooting information synthesis process differs from that in the first embodiment, and its flowchart is shown in Fig. 27.

[0149] In FIG. 27, steps S3801 to S3807 are the same as steps S1501 to S1507 in FIG. 15, respectively, so the description thereof will be omitted.

[0150] In S3808, the camera controller 203 evaluates the target position of the focus lens. If the target position is the point of interest, the process proceeds to S3809. If the target position is the reference point, the process proceeds to S3812. If the target position is the closest point, the process proceeds to S3815.

[0151] In S3809, the camera controller 203 determines whether or not the image is in focus. If it is determined that the image is in focus, the process proceeds to S3810, and if not, the process proceeds to S3811.

[0152] In S3810, the camera controller 203 synthesizes a fourth display with the display image data. The fourth display is to be synthesized with a frame 2001 in FIG.

[0153] In S3811, the camera controller 203 synthesizes a fifth display with the display image data. The fifth display is to be synthesized with a frame 3901 in FIG. 28(a).

[0154] In S3812, the camera controller 203 also determines whether or not the image is in focus. If it is determined that the image is in focus, the process proceeds to S3813, and if not, the process proceeds to S3814.

[0155] In S3813, the sixth display is synthesized with the display image data. Here, the sixth display is synthesized with the frame 2101 in FIG.

[0156] In S3814, the seventh display is composited with the display image data. Here, the seventh display is composited with the frame line 4001 in FIG. 28(b).

[0157] In S3815, the eighth display is synthesized with the display image data. The eighth display is the same as that shown in Fig. 16(c). The switching between the fourth to seventh displays is performed to indicate whether the focus lens is moving to the reference point or the point of interest in review mode AF, and whether the focus is achieved on either of them.

[0158] (Fourth embodiment) Next, a fourth embodiment will be described. The overall configuration of the imaging device in this embodiment is the same as that in Fig. 1. The shooting process, video shooting process, focus detection process, face priority AF process, still image shooting process and display process in this embodiment are the same as those in Figs. 3, 4, 6, 8, 5 and 14, respectively. The shooting information synthesis process differs from that in the first embodiment, and its flowchart is shown in Fig. 29.

[0159] In FIG. 29, steps S4101 to S4107 are the same as steps S1501 to S1507 in FIG. 15, respectively, so the description will be omitted.

[0160] In S4108, the camera controller 203 evaluates the target position of the focus lens. If the target position of the focus lens is the point of interest, the process proceeds to S4109. If the target position is the reference point, the process proceeds to S4112. If the target position is the closest point, the process proceeds to S4115.

[0161] In S4109, the camera controller 203 determines whether or not the shooting distance is within the first distance. If the shooting distance is within the first distance, the process proceeds to S4110, and if not, the process proceeds to S4111.

[0162] In S4110, the camera controller 203 synthesizes a ninth display with the display image data. The ninth display is to be synthesized with a figure 3401 in FIG. 24(a).

[0163] In S4111, the camera controller 203 synthesizes a tenth display with the display image data. The tenth display is formed by synthesizing the frame lines 2802 and 2803 in FIG.

[0164] In S4112, the camera controller 203 also determines whether the shooting distance is within the first distance. If the shooting distance is within the first distance, the process proceeds to S4113, and if not, the process proceeds to S4114.

[0165] In S4113, the camera controller 203 synthesizes an eleventh display with the display image data. Here, the eleventh display is assumed to be a composite of the figure 3501 in FIG. 24(b).

[0166] In S4114, the camera controller 203 synthesizes a twelfth display with the display image data. Here, the twelfth display is assumed to be a combination of the frame lines 2901 and 2902 in FIG. 21(b).

[0167] In S4115, a thirteenth display is synthesized with the display image data. The thirteenth display is the same as that shown in Fig. 16(c). The switch from the ninth display to the twelfth display is performed to indicate whether the focus lens is to be moved to the reference point or the point of interest in review mode AF, and also to indicate the shooting distance.

[0168] The disclosure of this specification includes the following imaging device, control method, program, and storage medium.

[0169] (Item 1) An imaging means for imaging a subject; a subject detection means for detecting a subject from an image acquired by the imaging means; a focus adjustment means for adjusting the focus of the optical system on the detected object; a control means for controlling a display means to display the image and for controlling the display means to display a display for identifying the subject focused on by the focus adjustment means at a position not overlapping the subject; An imaging device comprising:

[0170] (Item 2) 2. The imaging device according to item 1, wherein the subject detection means detects a human face.

[0171] (Item 3) 3. The imaging device according to item 2, wherein the subject detection means detects the eyes of a person.

[0172] (Item 4) 4. The imaging device according to item 2 or 3, wherein the focus adjustment means sets the position of the person's face in the image in the depth direction to a reference position.

[0173] (Item 5) 5. The imaging device according to item 4, wherein the subject detection means detects an article.

[0174] (Item 6) 6. The imaging device according to item 5, wherein the focus adjustment means sets the position of the article in the depth direction in the image to a focus position.

[0175] (Item 7) 7. The imaging device according to item 6, wherein the focus adjustment means adjusts the focus on the position of interest when the distance between the reference position and the position of interest is greater than a threshold value.

[0176] (Item 8) 8. The imaging device according to item 7, wherein the focus adjustment means adjusts the focus to the reference position when the distance between the reference position and the position of interest is equal to or less than the threshold value.

[0177] (Item 9) 3. The imaging device according to item 2, wherein the focus adjustment means adjusts the focus on the closest subject when the subject detection means is unable to detect a human face.

[0178] (Item 10) 10. The imaging device according to any one of items 1 to 9, wherein the control means displays a display for identifying the focused subject in a peripheral portion of a display area of ​​the display means.

[0179] (Item 11) 10. The imaging device according to any one of items 1 to 9, wherein the control means displays a display for identifying the focused subject outside a display area of ​​the display means.

[0180] (Item 12) 12. The imaging device according to item 10 or 11, characterized in that the control means changes at least one of the color, shape, position, size, and character of the display for identifying the subject depending on the subject on which the focus is focused.

[0181] (Item 13) 7. The imaging device according to item 6, wherein the control means changes a display for distinguishing the subject depending on a difference in distance between the reference position and the position of interest.

[0182] (Item 14) 14. The imaging device according to any one of items 1 to 13, further comprising a light emitting means for identifying a subject on which the focus adjustment means is to focus.

[0183] (Item 15) 15. The imaging device according to item 14, wherein the control means varies the intensity, color, blinking, and radiation direction of the light emitted by the light emitting means depending on the subject to be focused on.

[0184] (Item 16) A method for controlling an imaging device including an imaging means for imaging a subject, an object detection means for detecting the subject from an image acquired by the imaging means, and a focus adjustment means for focusing an optical system on the detected subject, comprising: A control method for an imaging device, comprising a control step of causing a display means to display the image, and causing the display means to display an indication for identifying a subject focused on by the focus adjustment means, in a position not overlapping the subject.

[0185] (Item 17) Item 17. A program for causing a computer to execute the control method according to item 16.

[0186] (Item 18) A computer-readable storage medium storing a program for causing a computer to execute the control method according to item 16.

[0187] (Other embodiments) The present invention can also be realized by a process in which a program for realizing one or more functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) for realizing one or more functions.

[0188] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0189] 101: lens group, 102: aperture, 108: electrical contact unit, 201: imaging section, 201a: imaging element, 207: display section, 1601: entire display image, 2801: captured image display area

Claims

1. An imaging means for imaging a subject; a subject detection means for detecting a subject from an image acquired by the imaging means; a focus adjustment means for adjusting the focus of the optical system on the detected object; a control means for controlling a display means to display the image and for controlling the display means to display a display for identifying the subject focused on by the focus adjustment means at a position not overlapping the subject; An imaging device comprising:

2. 2. The image pickup apparatus according to claim 1, wherein the subject detection means detects a human face.

3. 3. The image pickup apparatus according to claim 2, wherein said subject detection means detects the eyes of a person.

4. 3. The imaging apparatus according to claim 2, wherein the focus adjustment means sets a position of the person's face in the image in the depth direction as a reference position.

5. 5. The imaging apparatus according to claim 4, wherein the subject detection means detects an article.

6. 6. The imaging device according to claim 5, wherein the focus adjustment means sets a position of the article in the image in a depth direction to a focus position.

7. 7. The imaging apparatus according to claim 6, wherein the focus adjustment means adjusts the focus to the position of interest when a distance between the reference position and the position of interest is greater than a threshold value.

8. 8. The imaging apparatus according to claim 7, wherein the focus adjustment means adjusts the focus to the reference position when the distance between the reference position and the position of interest is equal to or less than the threshold value.

9. 3. The image pickup apparatus according to claim 2, wherein said focus adjustment means adjusts the focus to the nearest subject when the subject detection means fails to detect a human face.

10. 2. The imaging apparatus according to claim 1, wherein the control means displays a display for identifying the focused subject in a peripheral portion of a display area of ​​the display means.

11. 2. The imaging apparatus according to claim 1, wherein the control means displays a display for identifying the focused subject outside a display area of ​​the display means.

12. 12. The imaging apparatus according to claim 10, wherein the control means changes at least one of the color, shape, position, size, and text of a display for identifying the subject according to the focused subject.

13. 7. The imaging apparatus according to claim 6, wherein the control means changes a display for distinguishing the subject according to a difference in distance between the reference position and the position of interest.

14. 2. The imaging apparatus according to claim 1, further comprising a light emitting means for identifying a subject on which the focus adjustment means is to focus.

15. 15. The imaging apparatus according to claim 14, wherein the control means changes the intensity, color, blinking and radiation direction of the light emitted by the light emitting means in accordance with the subject to be focused on.

16. A method for controlling an imaging device including an imaging means for imaging a subject, an object detection means for detecting the subject from an image acquired by the imaging means, and a focus adjustment means for focusing an optical system on the detected subject, comprising: A control method for an imaging device, comprising a control step of causing a display means to display the image, and causing the display means to display an indication for identifying a subject focused on by the focus adjustment means, in a position not overlapping the subject.

17. A program for causing a computer to execute the control method according to claim 16.

18. A computer-readable storage medium storing a program for causing a computer to execute the control method according to claim 16.

Images