Control device, imaging device, control method, and program
The control device uses area-specific focus detection and subject determination methods to ensure the intended subject is in focus, addressing the issue of unintended focusing on animals or vehicles.
Patent Information
- Application Number
- JP2022046411
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-03-23
- Publication Date
- 2024-12-09
- Estimated Expiration
- 2042-03-23
AI Technical Summary
Existing control devices may inadvertently focus on unintended subjects, such as animals or vehicles, instead of the intended human subjects during photography.
A control device that includes an acquisition unit to set focus detection areas and a determining unit to differentiate between subjects inside and outside these areas, using specific methods to determine the main subject based on their position, movement, and type, ensuring focus on the intended subject.
Enables the control device to accurately focus on the subject intended by the user, enhancing the photography experience by avoiding unwanted subjects.
Smart Images

Figure 0007596326000001 
Figure 0007596326000002 
Figure 0007596326000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a control device for determining a main subject to be focused. [Background technology]
[0002] Conventionally, a configuration is known in which a main subject determined as a target to be focused on is continuously focused on in real time. Patent Document 1 proposes a configuration in which if a face of a person with an evaluation value of a certain level or more is found, the person is determined as the main subject, and if a face of a person with an evaluation value of a certain level or more is not found, an unspecified subject is determined as the main subject. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2012-138665 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, with the configuration of Patent Document 1, when the user is waiting for a subject such as an animal or vehicle approaching the focus frame that he or she has set, a human subject that the user does not intend may be determined as the main subject.
[0005] An object of the present invention is to provide a control device capable of focusing on a subject intended by a user. [Means for solving the problem]
[0006] A control device according to one aspect of the present invention is a control device for controlling an imaging device that acquires image data, the control device including: an acquisition unit that acquires an area used for focus detection that is set in the image data; From the multiple detected subjects, The main subject to be focused on of and a determination unit that determines A method for determining a main subject from among a plurality of subjects is made different depending on whether a plurality of subjects is detected inside a region or only outside the region.It is characterized by: Effect of the Invention
[0007] According to the present invention, it is possible to provide a control device capable of focusing on a subject intended by a user. [Brief description of the drawings]
[0008] [Figure 1] 1 is a diagram illustrating the configuration of a digital camera that is an example of an imaging apparatus according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating a configuration of an imaging element. [Diagram 3] 10 is a flowchart showing the process performed by the system control circuit when the digital camera is set to a still image shooting mode; [Figure 4] 13 is a flowchart showing a main subject determination process. [Diagram 5] FIG. 1 is an explanatory diagram of an AF frame. [Figure 6] FIG. 4 is an explanatory diagram of a method for determining a main subject. [Figure 7] 11 is a flowchart showing a process of determining a main subject within an AF frame. [Figure 8] 13 is a flowchart showing a process of determining a main subject outside the AF frame. [Figure 9] FIG. 11 is an explanatory diagram of a method for determining a candidate subject. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to refer to the same components, and duplicated descriptions will be omitted. <Camera configuration> FIG. 1(a) is a diagram showing the configuration of a digital camera 100, which is an example of an imaging device according to an embodiment of the present invention. The digital camera 100 has a system control circuit 50 that functions as a control device for controlling the entire digital camera 100. As shown in FIG. 1(b), the system control circuit 50 includes an acquisition unit 50a and a determination unit 50b. The acquisition unit 50a acquires an area (focus frame) used for focus detection set on image data acquired by the digital camera 100. The determination unit 50b determines one of a first subject determined from at least one subject detected inside the area and a second subject determined from at least one subject detected outside the area as a main subject to be focused on (AF target). The determination unit 50b determines the first subject and the second subject in different ways. Note that AF (autofocus) refers to setting a subject area selected by a user or a subject area automatically set by the digital camera 100 as a focus detection area and automatically detecting a focus position.
[0010] The digital camera 100 also has a photographing lens 10, a shutter 12, an image sensor 14, an A / D converter 16, and a timing generation circuit 18. The shutter 12 has an aperture function. The image sensor 14 converts an optical image into an electrical signal. The A / D converter 16 converts an analog signal output from the image sensor 14 into a digital signal. The timing generation circuit 18 supplies a clock signal and a control signal to the image sensor 14 and the A / D converter 16.
[0011] The image sensor 14 is composed of a C-MOS sensor and its peripheral circuits. In the image sensor 14, one photoelectric conversion element is arranged on each of a plurality of light receiving pixels. The image sensor 14 is configured so that all pixels can output independently. In addition, some of the pixels are focus detection pixels, and the image sensor 14 can perform AF (image sensor phase difference AF) of an image sensor phase difference detection method. Specifically, as shown in FIG. 2, the image sensor 14 includes a plurality of image sensing pixels 250 that each receive a light beam passing through the entire area of an exit pupil of the photographing optical system to generate an optical image. In addition, the image sensor 14 includes a plurality of focus detection pixels 251 that each receive a light beam passing through a different exit pupil area of the photographing optical system. The plurality of focus detection pixels 251 can receive a light beam passing through the entire area of the exit pupil of the photographing optical system as a whole. For example, in the image sensor 14, of the 2 rows x 2 columns of pixels, a pair of diagonally arranged G pixels are left as imaging pixels, and the R and B pixels are replaced with focus detection pixels.
[0012] The system control circuit 50 performs focus detection processing by the phase difference AF method using image pickup signals from focus detection pixels embedded in the image sensor 14. Specifically, the system control circuit 50 performs focus detection based on the amount of misalignment between a pair of images formed at the focus detection pixels by light beams passing through a pair of pupil regions of the imaging optical system.
[0013] In this embodiment, the image plane phase difference AF is realized by replacing some of the image pickup pixels with focus detection pixels, but the present invention may realize focus detection by other methods, such as phase difference focus detection using a dedicated focus detection sensor or contrast focus detection.
[0014] The digital camera 100 also has an image processing circuit 20 , a memory control circuit 22 , an image display unit 28 , a memory 30 , a non-volatile memory 31 , and a compression / decompression circuit 32 .
[0015] The image processing circuit 20 performs processes such as pixel interpolation, color conversion, noise removal, and edge enhancement on the data from the A / D converter 16 or the data from the memory control circuit 22 .
[0016] The image processing circuit 20 detects the face area of a person by performing a pattern matching process to identify an area in the image that matches the feature data (shape of the contour of the face). The image processing circuit 20 may perform the pattern matching process using a plurality of feature data, or may perform the pattern matching process using feature data of a part of the shape of the face, in order to increase the chances of detecting a face or to improve the detection accuracy. The image processing circuit 20 may perform the pattern matching process by changing the size of the feature data in order to perform face detection regardless of the size of the face. The image processing circuit 20 detects organ areas such as the pupils, nose, and mouth of the face by performing a pattern matching process to identify an area in the area detected by face detection that matches the feature data (shape data of organs). The image processing circuit 20 also performs a process of calculating the reliability indicating the likelihood of the results of face detection and organ detection.
[0017] The image processing circuit 20 may also perform face detection or organ detection using deep learning. The image processing circuit 20 may perform detection processing using one learning model selected by the system control circuit 50 from multiple learning models stored in the non-volatile memory 31, or may perform multiple detection processing by switching between multiple learning models.
[0018] Moreover, the image processing circuit 20 performs a tracking process between images. The image processing circuit 20 generates feature data of the detected subject and stores it in the memory 30. The image processing circuit 20 searches for an area that matches the feature data from the image generated at the next timing based on the feature data stored in the memory 30, and performs a tracking process with the matching area as the subject area. As a method for searching for an area that matches the feature data, the image processing circuit 20 may use a method of cutting out an image for each area and setting an area with little difference from the feature data as the subject area, or a method using the degree of matching of histograms, color data, etc.
[0019] When multiple subjects are detected, the system control circuit 50 sets the subject area selected by the user or the area of the main subject determined by the determination unit 50b as the focus detection area. When the subject is no longer detected, the system control circuit 50 sets the subject area detected by tracking processing by the image processing circuit 20 as the focus detection area. If the same subject is detected within a certain period of time, the system control circuit 50 switches to focus detection processing, and if tracking is no longer possible, sets a different subject area as the focus detection area.
[0020] Furthermore, the image processing circuit 20 performs a predetermined calculation process using the image data in order to calculate a white balance (WB) evaluation value for performing auto white balance processing (AWB processing).
[0021] Furthermore, the image processing circuit 20 performs a predetermined arithmetic process using the image data to calculate an AE evaluation value and an EF evaluation value for performing an automatic exposure control (AE) process and a strobe exposure control (EF) process. The system control circuit 50 controls the exposure control unit 40 according to an algorithm based on the AE evaluation value and the EF evaluation value.
[0022] The memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the memory 30, and the compression / decompression circuit 32. Data from the A / D converter 16 is written into the memory 30 via the image processing circuit 20 and the memory control circuit 22, or via the memory control circuit 22.
[0023] Image display unit 28 is configured with a TFT, LCD, or the like, and acquires and displays image data for display written in memory 30 via memory control circuit 22. By sequentially displaying image data on image display unit 28, it is possible to realize an electronic viewfinder function. Also, image display unit 28 can arbitrarily turn the display ON / OFF according to instructions from system control circuit 50, and when the display is turned OFF, it is possible to reduce power consumption of digital camera 100.
[0024] The memory 30 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images. This allows a large amount of images to be written to the memory 30 at high speed even when continuous shooting is performed to continuously shoot a plurality of still images. The memory 30 can also be used as an area for temporarily storing characteristic data for authentication and as a working area for the system control circuit 50.
[0025] The non-volatile memory 31 is composed of a Flash ROM or the like. The system control circuit 50 sequentially reads and executes the program codes written in the non-volatile memory 31. The non-volatile memory 31 also includes an area for storing face feature data for authentication as dictionary data, an area for storing system information, and an area for storing user setting information.
[0026] A compression / decompression circuit 32 reads the image stored in the memory 30 and performs compression or decompression processing using adaptive discrete cosine transform (ADCT) or the like.
[0027] The digital camera 100 also has an exposure control unit 40, a focus control unit 42, a zoom control unit 44, and a flash 48. The exposure control unit 40 controls the shutter 12 and also has a flash dimming function by working in conjunction with the flash 48. The focus control unit 42 controls the focusing of the photographing lens 10. The zoom control unit 44 controls the zooming of the photographing lens 10. The flash 48 has a flash dimming function. The system control circuit 50 controls the exposure control unit 40 and the focus control unit 42 based on the results of calculations performed by the image processing circuit 20 on the image data.
[0028] The digital camera 100 also has a mode dial switch 60, a shutter switch 62, a display changeover switch 66, an operation unit 70, and a zoom switch 72. The mode dial switch 60 is used to set the digital camera 100 to a power off mode, an automatic shooting mode, a shooting mode, a panoramic shooting mode, a video shooting mode, a playback mode, a PC connection mode, and the like. When the first shutter switch SW1 is turned ON during the operation of the shutter switch 62, an AF process, an AE process, an AWB process, and the like are started. When the second shutter switch SW2 is turned ON after the operation of the shutter switch 62 is completed, a series of shooting processes are started. The display changeover switch 66 switches the display of the image display unit 28. The operation unit 70 is composed of various buttons, a touch panel, a rotary dial, and the like. The zoom switch 72 is used by the user to instruct a change in the magnification of the image.
[0029] The digital camera 100 also includes a power supply unit 86, an interface 90, a connector 92, an optical viewfinder 104, a communication unit 110, a connection unit 112, and a gyro sensor 115. The power supply unit 86 includes a primary alkaline battery, a secondary battery such as a Li-ion battery, and an AC adapter. The interface 90 is used to communicate with a recording medium such as a memory card or a hard disk. The connector 92 is used to connect with a recording medium such as a memory card or a hard disk. The communication unit 110 has various communication functions such as USB, IEEE1394, LAN, and wireless communication. The connection unit 112 is used to connect the digital camera 100 to other devices. The gyro sensor 115 detects the amount of movement of the digital camera 100 in the yawing direction and the pitching direction.
[0030] The recording medium 200 is configured to be detachable from the digital camera 100 , and includes a recording unit 202 configured from a semiconductor memory, a magnetic disk, or the like, an interface 204 with the digital camera 100 , and a connector 206 for connecting to the digital camera 100 . <Still image shooting operation> FIG. 3 is a flow chart showing the processing by the system control circuit 50 when the digital camera 100 is set in the still image shooting mode. In step S301, the system control circuit 50 determines whether or not the live view start process has been completed. The live view start process is a process in which the timing generation circuit 18 supplies a clock signal and a control signal for live view to the image sensor 14 and the A / D converter 16. If it is determined that the live view start process has been completed, the process proceeds to step S302, and if it is determined that the live view start process has not been completed, the process of this step is repeated.
[0031] In step S302, the system control circuit 50 starts live view processing. The live view processing is a process in which a live view image generated by the image processing circuit 20 using data captured by the image sensor 14 is temporarily stored in the memory 30 and displayed on the image display unit 28. By continuously generating and displaying the live view image, the user can use the image display unit 28 to check the live view image captured in real time.
[0032] In step S303, the system control circuit 50 determines whether or not the digital camera 100 continues in the still image shooting mode. If it is determined that the digital camera 100 continues in the still image shooting mode, the process proceeds to step S304, and if it is determined that the digital camera 100 does not continue in the still image shooting mode, the process ends.
[0033] In step S304, the system control circuit 50 determines whether the object tracking setting is ON. If it is determined that the object tracking setting is ON, the process proceeds to step S306, and if it is determined that the object tracking setting is not ON, the process proceeds to step S305.
[0034] In step S305, the system control circuit 50 determines that there is no main subject so as not to use specific subject information for AF.
[0035] In step S306, system control circuit 50 determines the main subject on which to focus using a main subject determination process described below.
[0036] In step S307, the system control circuit 50 determines whether the first shutter switch SW1 is ON or not. If it is determined that the first shutter switch SW1 is ON, the process proceeds to step S308, and if it is determined that the first shutter switch SW1 is not ON, the process returns to step S304.
[0037] In step S308, system control circuit 50 determines whether or not the main subject has been determined. If it is determined that the subject has been determined, the process proceeds to step S310, and if not, the process proceeds to step S309.
[0038] In step S309, the system control circuit 50 performs AF on the center position of the focus frame (AF frame). In this embodiment, the AF position where AF is performed is the center position of the AF frame, but it may be any position within the AF frame. For example, the AF position may be an area within the AF frame that is determined to be closest to the image sensor 14 in the depth direction, or an area within the AF frame that is prominent in color information or brightness information.
[0039] In step S310, system control circuit 50 executes AF on the main subject.
[0040] In step S311, the system control circuit 50 determines whether the second shutter switch SW2 is ON. If it is determined that the second shutter switch SW2 is ON, the process proceeds to step S312, and if it is determined that the second shutter switch SW2 is not ON, the process proceeds to step S313.
[0041] In step S312, the system control circuit 50 executes a photographing process.
[0042] In step S313, the system control circuit 50 determines whether the AF setting is a servo AF setting. The servo AF setting is a setting in which AF is continuously performed on the main subject that is the AF target. If it is determined that the AF setting is a servo AF setting, the process proceeds to step S314, and if it is determined that the AF setting is not a servo AF setting, the process returns to step S311.
[0043] In step S314, the system control circuit 50 executes a main subject search process. The main subject search process is a process for searching for the position of the main subject in the latest live view image by performing a tracking process between live view images or by correlating the subject detection result in the latest live view image with the current main subject information. <Main subject determination process> FIG. 4 is a flowchart showing the main subject determination process executed in step S306 of FIG.
[0044] In step S401, the system control circuit 50 determines whether the AF setting set by the user is the spot AF setting. If it is determined that the AF setting is the spot AF setting, the process proceeds to step S402, and if it is determined that the AF setting is not the spot AF setting, the process proceeds to step S405.
[0045] FIG. 5 is an explanatory diagram of an AF frame. In the spot AF setting of FIG. 5(a), the position of the AF frame 501 can be set arbitrarily by the user, and pinpoint AF is performed at the AF position. In the one-point AF setting of FIG. 5(b), the position of the AF frame 502 can be set arbitrarily by the user, and AF is performed near the AF frame 502. In the zone point AF setting of FIG. 5(c), the position and size of the AF frame 503 can be set arbitrarily by the user, and AF is performed at the main subject position within or near the AF frame. In the full range AF setting of FIG. 5(d), the AF frame 504 is the entire screen, and the AF position is determined from the entire screen.
[0046] In step S402, the system control circuit 50 determines whether or not a subject has been detected within the AF frame by the image processing circuit 20. If it is determined that a subject has been detected within the AF frame, the process proceeds to step S403, and if it is determined that a subject has not been detected within the AF frame, the process proceeds to step S404.
[0047] In step S403, the system control circuit 50 determines the subject detected within the AF frame as the main subject.
[0048] In step S404, system control circuit 50 determines that there is no main subject.
[0049] In step S405, the system control circuit 50 determines whether the AF frame setting is the full-range AF setting. If it is determined that the AF frame setting is the full-range AF setting, the process proceeds to step S406. If it is determined that the AF frame setting is not the full-range AF setting, the process proceeds to step S407.
[0050] In step S406, the system control circuit 50 executes a process for determining a main subject within the AF frame, which will be described later.
[0051] In step S407, the system control circuit 50 determines the main subject (first subject) within the AF frame as the main subject.
[0052] In step S408, the system control circuit 50 determines whether or not a subject has been detected within the AF frame. If it is determined that a subject has been detected within the AF frame, the process proceeds to step S409, and if it is determined that a subject has not been detected within the AF frame, the process proceeds to step S416.
[0053] In step S409, the system control circuit 50 determines the main subject using a main subject determination process within the AF frame, which will be described later.
[0054] In step S410, the system control circuit 50 determines whether or not a subject has been detected outside the AF frame. If it is determined that a subject has been detected outside the AF frame, the process proceeds to step S411. If it is determined that a subject has not been detected outside the AF frame, the process proceeds to step S415.
[0055] In step S411, the system control circuit 50 executes a process for determining a main subject outside the AF frame, which will be described later.
[0056] In step S412, the system control circuit 50 determines whether or not a main subject (second subject) outside the AF frame has been determined in step S411. If it is determined that a main subject outside the AF frame has been determined, the process proceeds to step S413, and if not, the process proceeds to step S415.
[0057] In step S413, the system control circuit 50 determines whether the distance from the main subject outside the AF frame to the digital camera 100 is closer than the distance from the main subject inside the AF frame to the digital camera 100. The distance from the subject to the digital camera 100 may be calculated using a defocus map indicating the defocus amount for each pixel generated based on the focus detection pixels of the image sensor 14, or may be calculated using a dedicated focus detection sensor other than the image sensor 14. In addition, for the main subject outside the AF frame and the main subject inside the AF frame, the subject closer to the digital camera 100 may be estimated using the detected size of the subject, the size of the subject's part, and size information obtained by normalizing the size of the subject. For example, as shown in FIG. 6, the larger of the size information of a person's face 602 as the main subject inside the AF frame 601 and the normalized information of a dog's face 603 as the main subject outside the AF frame 601 may be determined as the subject closer to the digital camera 100. If it is determined that the distance from the main subject outside the AF frame to the digital camera 100 is closer than the distance from the main subject inside the AF frame to the digital camera 100, proceed to step S414; if not, proceed to step S415.
[0058] In step S414, the system control circuit 50 determines the main subject outside the AF frame as the main subject.
[0059] In step S415, the system control circuit 50 determines the main subject within the AF frame as the main subject.
[0060] In step S416, the system control circuit 50 determines whether a subject is detected outside the AF frame. If it is determined that a subject is detected outside the AF frame, the process proceeds to step S417; if it is determined otherwise, the process proceeds to step S420.
[0061] In step S417, the system control circuit 50 executes a main subject determination process outside the AF frame, which will be described later.
[0062] In step S418, the system control circuit 50 determines whether the main subject outside the AF frame is determined in step S417. If it is determined that the main subject outside the AF frame is determined, the process proceeds to step S419; if it is determined otherwise, the process proceeds to step S420.
[0063] In step S419, the system control circuit 50 determines the main subject outside the AF frame as the main subject.
[0064] In step S420, the system control circuit 50 determines that there is no main subject. <Main subject determination process within the AF frame> FIG. 7 is a flowchart showing a main subject determination process within the AF frame that preferentially determines the main subject within the AF frame for a predetermined type of subject, which is executed in steps S406 and S409 of FIG. 4.
[0065] In step S701, the system control circuit 50 determines whether a person is detected within the AF frame. If it is determined that a person is detected, the process proceeds to step S702; if it is determined otherwise, the process proceeds to step S705.
[0066] In step S702, the system control circuit 50 determines whether there are a plurality of persons detected in step S701. If it is determined that there are a plurality of persons, the process proceeds to step S703; if it is determined otherwise, the process proceeds to step S704.
[0067] In step S703, the system control circuit 50 determines the main subject in the AF frame from among multiple people using the position and size of the person's face. Specifically, the system control circuit 50 determines the person with the largest information obtained by multiplying the position weight and size weight as the main subject in the AF frame. For example, the position weight may be set so that the weight increases as the center position of the face is closer to the center of the AF frame. For example, the size weight may be set so that the weight increases as the face size of the subject increases. Note that the main subject may be determined using a weight that increases as the face faces forward.
[0068] In step S704, the system control circuit 50 determines the person detected in step S701 as the main subject within the AF frame.
[0069] In step S705, the system control circuit 50 determines whether or not an animal such as a dog or a cat has been detected within the AF frame. If it is determined that an animal has been detected, the process proceeds to step S706, and if it is determined that an animal has not been detected, the process proceeds to step S711.
[0070] In step S706, the system control circuit 50 determines whether or not a vehicle such as an automobile has been detected within the AF frame. If it is determined that a vehicle has been detected, the process proceeds to step S707. If it is determined that a vehicle has not been detected, the process proceeds to step S708.
[0071] In step S707, the system control circuit 50 determines the main subject within the AF frame using the positions of the subjects, such as animals and vehicles, and the sizes normalized for each subject type. For example, size normalization is performed so that the subject regions have the same area when the distances of subjects, such as animals and vehicles, to the image sensor 14 are the same. Specifically, the system control circuit 50 determines the subject with the largest information obtained by multiplying the position weight and size weight as the main subject within the AF frame.
[0072] In step S708, the system control circuit 50 determines whether or not a plurality of animals were detected in step S705. If it is determined that a plurality of animals were detected, the process proceeds to step S709, and if it is determined that a plurality of animals were not detected, the process proceeds to step S710.
[0073] In step S709, the system control circuit 50 determines the main subject within the AF frame from among multiple animals using the positions and sizes of the animals. Specifically, the system control circuit 50 determines the animal that has the largest information obtained by multiplying the position weight and size weight as the main subject within the AF frame.
[0074] In step S710, the system control circuit 50 determines the animal detected in step S705 as the main subject within the AF frame.
[0075] In step S711, the system control circuit 50 determines whether or not a vehicle such as an automobile has been detected within the AF frame. If it is determined that a vehicle has been detected, the process proceeds to step S712, and if it is determined that a vehicle has not been detected, the process proceeds to step S715.
[0076] In step S712, the system control circuit 50 determines whether or not a plurality of vehicles are detected in step S711. If it is determined that a plurality of vehicles are detected, the process proceeds to step S713, and if it is determined that a plurality of vehicles are not detected, the process proceeds to step S714.
[0077] In step S713, the system control circuit 50 determines a main subject within the AF frame from among the multiple vehicles using the positions and sizes of the vehicles. Specifically, the system control circuit 50 determines the vehicle that has the largest information obtained by multiplying the position weight and size weight as the main subject within the AF frame.
[0078] In step S714, the system control circuit 50 determines the vehicle detected in step S711 as the main subject within the AF frame.
[0079] In step S715, the system control circuit 50 determines that there is no main subject within the AF frame. <Determination Process of Main Subject Outside AF Frame> FIG. 8 shows step S41 of FIG. 4 1 and step S41 7 and is a flowchart showing a determination process of a main subject outside the AF frame for determining a main subject outside the AF frame based on the distance between the subject and the AF frame, which is executed in step S41.
[0080] In step S801, the system control circuit 50 determines the subject closest to the AF frame among the subjects outside the AF frame as the candidate subject (first candidate subject) for the main subject outside the AF frame. The candidate subject is determined regardless of the subject type such as a person, an animal, and a vehicle. FIG. 9 is an explanatory diagram of a method for determining the candidate subject. Among the distances 912 between the boundary of the AF frame 901 and the subject area 902 and the distance 913 between the boundary of the AF frame 901 and the subject area 903, the subject in the closer subject area is determined as the candidate subject. In FIG. 9, since the distance 913 is shorter, the subject in the subject area 903 is determined as the candidate subject.
[0081] In step S802, the system control circuit 50 determines whether the candidate subject is moving. For example, the system control circuit 50 periodically monitors the position of the candidate subject area and determines that the candidate subject is moving when the position of the current area has changed by a predetermined distance or more with respect to the past position. If it is determined that the candidate subject is moving, the process proceeds to step S803, and if it is determined otherwise, the process proceeds to step S806.
[0082] In step S803, the system control circuit 50 determines whether the movement direction of the candidate subject is toward the AF frame. For example, the system control circuit 50 can determine whether the movement direction of the candidate subject is toward the AF frame using a learning model of deep learning that can determine the direction of the subject, such as the face direction of a person or animal or the direction of the tip of a vehicle. In addition, if the position of the subject area is closer to the AF frame than the position of the subject area detected in the past, the movement direction of the candidate subject may be determined to be toward the AF frame. If it is determined that the movement direction of the candidate subject is toward the AF frame, the process proceeds to step S804, and if it is determined that the movement direction is not toward the AF frame, the process proceeds to step S806.
[0083] In step S804, the system control circuit 50 determines whether the distance between the candidate subject and the AF frame is closer than a predetermined distance. The predetermined distance may be, for example, a length obtained by multiplying the diagonal distance of the subject area by a certain ratio, or may be the movement amount of the candidate subject per unit time. The predetermined distance may also be determined according to the panning direction and panning amount of the digital camera 100 using the angular velocity information of the gyro sensor 115. If it is determined that the distance between the candidate subject and the AF frame is closer than the predetermined distance, the process proceeds to step S805, and if it is determined that the distance is not closer than the predetermined distance, the process proceeds to step S806.
[0084] In step S805, the system control circuit 50 determines the candidate subject as the main subject outside the AF frame.
[0085] In step S806, the system control circuit 50 determines whether or not another subject has been detected outside the AF frame. If it is determined that another subject has been detected, the process proceeds to step S808, and if it is determined that another subject has not been detected, the process proceeds to step S807.
[0086] In step S807, the system control circuit 50 determines that there is no main subject outside the AF frame.
[0087] In step S808, the system control circuit 50 determines the subject that is next closest to the AF frame after the first candidate subject among the subjects outside the AF frame as a candidate subject (second candidate subject).
[0088] As described above, according to the configuration of this embodiment, by changing the method for determining the main subject to be targeted for AF between inside and outside the AF frame, it is possible to focus on the subject intended by the user depending on the scene.
[0089] In this embodiment, an example has been described in which the main subject determination process is used when digital camera 100 is shooting a still image, but the main subject determination process may also be used while the digital camera is waiting to shoot a moving image or while shooting a moving image. [Other Examples] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0090] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]
[0091] 50 System control circuit (control device) 50a Acquisition Department 50b Decision section 100 Imaging device
Claims
1. A control device for controlling an imaging device for acquiring image data, an acquisition unit that acquires an area used for focus detection set in the image data; a determination unit that determines a main subject to be focused on from among the plurality of detected subjects; The control device is characterized in that the determination unit uses different methods for determining a main subject from multiple subjects depending on whether multiple subjects are detected inside the area or only outside the area.
2. The control device described in Claim 1, characterized in that the determination unit uses different judgment methods for determining a main subject from multiple types of subjects when multiple types of subjects are detected inside the area and when multiple types of subjects are detected only outside the area.
3. 3. The control device according to claim 1, wherein, when a plurality of subjects are detected within the area, the determination unit determines the main subject by giving priority to a subject of a predetermined type.
4. The control device according to claim 3, characterized in that, when a plurality of subjects of the predetermined type are detected within the area, the determination unit determines a main subject based on at least one of the size and position of each of the plurality of subjects of the predetermined type.
5. 5 . The control device according to claim 1 , wherein, when a plurality of subjects are detected only outside the region, the determination unit determines a main subject based on a distance between the subject and the region.
6. The control device according to claim 5 , wherein the determination unit determines a main subject based on a moving direction of the subjects when a plurality of subjects are detected only outside the area.
7. A control device according to any one of claims 1 to 6; and an imaging element.
8. 1. A control method for controlling an imaging device that acquires image data, comprising: an acquisition step of acquiring an area used for focus detection set in the image data; a determining step of determining a main subject to be focused on from among the plurality of detected subjects; A control method characterized in that, in the determination step, a judgment method for determining a main subject from among multiple subjects is made different depending on whether multiple subjects are detected inside the area or only outside the area.
9. The control method described in Claim 8, characterized in that in the determination step, the judgment method for determining a main subject from multiple types of subjects is made different depending on whether multiple types of subjects are detected inside the area or only outside the area.
10. A program for causing a computer to execute the control method according to claim 8 or 9.
Citation Information
Patent Citations
Imaging device
JP2005189533A
Image processing apparatus, selection method of main subject, and program
JP2012138665A
Focusing device
JP2013140270A
Imaging apparatus
JP2018189854A
Focusing device, imaging apparatus, focusing method, and program
JP2021175133A
