Focus control device, imaging device, focus control method, and program

The focus control device enhances focus precision and speed by setting focus target areas, detecting overlapping regions, and using machine learning to ensure accurate focus on intended objects in imaging devices.

JP2024163767APending Publication Date: 2024-11-22FUJIFILM CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023079640
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Existing focus control technologies in imaging devices struggle with speed and precision when targeting specific objects, leading to inefficient and imprecise focus adjustments.

Method used

A focus control device and method that utilizes a processor to set a focus target area, determine a search area, detect an object area within the search area, and perform focus control based on overlapping areas between the focus target and object areas, using image signals and machine learning for enhanced accuracy.

Benefits of technology

Enables high-speed and high-precision focus control on intended objects by accurately identifying overlapping areas and adjusting focus based on image signals, ensuring precise focus on the user's target.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024163767000001_ABST
    Figure 2024163767000001_ABST
Patent Text Reader

Abstract

To provide a focus control device, an imaging device, a focus control method, and a program that make it possible to perform focus control with high accuracy at high speed on an object which a user wants to be focused on.SOLUTION: A focus control device comprises a processor and a memory. The processor acquires an image signal outputted from an imaging element, sets a target region of focusing in an imaging region on the basis of output information from an operation device that is operated on by a user, determines a search region on the basis of the target region of focusing, detects an object region including a specific object from within the search region, detects an overlapping region where the target region of focusing and the object region overlap, and exercises focus control on the basis of the image signal in the overlapping region.SELECTED DRAWING: Figure 9
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The technology disclosed herein relates to a focus control device, an imaging device, a focus control method, and a program. [Background technology]

[0002] Patent Document 1 discloses a control method for an imaging device having a signal generating means for obtaining an image signal from an imaging element that captures an image via an imaging optical system, the control method for an imaging device comprising: an arbitrary area setting step for setting an arbitrary area within the image signal; a focus detection step for detecting a defocus amount from a calculated area obtained by dividing an area including the image signal outside the arbitrary area into multiple areas; a subject area identification step for identifying a subject area in which a subject exists from the image signal; and a focus area selection step for selecting a focus area from the arbitrary area and the subject area.

[0003] Patent Document 2 discloses an imaging device having imaging means having imaging pixels provided in a first region of an imaging area that photoelectrically convert light from a photographing lens to generate an image of a subject, and focus detection pixels provided in a second region narrower than the first region of the imaging area that receive light that passes through a partial region of the exit pupil of the photographing lens, phase difference detection means that detects the phase difference between two image signals based on signals from the focus detection pixels, subject detection means that detects a first subject region of the subject based on a signal from the imaging means, and control means that performs focus control using a signal from the phase difference detection means in a second subject region that is different from the first subject region detected by the subject detection means and is estimated to be a part of the subject.

[0004] Patent Document 3 discloses a focus adjustment device that has multiple AF areas, detects the amount of defocus in each AF area, and creates a depth map by converting the amount of defocus into a lens position equivalent to distance in each of the body range and outer range. When the depth map is created, it extracts as a crossing candidate an area on the close side that is greater than the average in the body range by a predetermined value or more. It identifies an area corresponding to an unwanted object based on the candidates, and controls focus adjustment based on a distance value corresponding to an area obtained by excluding the area corresponding to the unwanted object from the main object area.

[0005] Patent document 4 discloses an imaging device that, if any of the focus detection areas, which have a focus distance within the depth of field of a determined focus distance, include an area of ​​a specific subject, displays an indication that all focus detection areas including the area of ​​the specific subject are in focus. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2022-170554 A [Patent Document 2] JP 2013-054256 A [Patent Document 3] JP 2022-137760 A [Patent Document 4] JP 2013-242407 A Summary of the Invention [Problem to be solved by the invention]

[0007] The technology disclosed herein aims to provide a focus control device, an imaging device, a focus control method, and a program that enable high-speed and high-precision focus control on an object intended by a user to be focused on. [Means for solving the problem]

[0008] In order to achieve the above-mentioned objective, the focus control device of the present disclosure includes a processor and a memory, and the processor acquires an image signal output from an imaging element, sets a focus target area within the imaging area based on output information from an operation device that accepts user operations, determines a search area based on the focus target area, detects an object area including a specific object from within the search area, detects an overlap area where the focus target area and the object area overlap, and performs focus control based on the image signal within the overlap area.

[0009] It is preferable that the focusing target region is made up of a plurality of blocks, and the processor detects one or more blocks among the plurality of blocks that overlap with the object region as an overlapping region.

[0010] The processor preferably detects, as the overlap region, one or more blocks among the plurality of blocks whose overlap rate with the object region is equal to or greater than a threshold value.

[0011] The processor preferably varies the threshold depending on the particular object type.

[0012] The processor may detect, as an overlap region, a region where an overlap rate between the focus target region and the object region is equal to or greater than a threshold.

[0013] When the overlap rate is less than the threshold, the processor preferably performs focus control based on the image signal of the focus target area.

[0014] Preferably, the processor determines the search region based on a longer side of the region to be focused.

[0015] The region to be focused is preferably rectangular.

[0016] If the focus target area is not comprised of a plurality of blocks, the processor preferably divides the focus target area into a number of blocks corresponding to the type of particular object.

[0017] It is preferable that the processor obtains a defocus amount for non-focus control based on an image signal in a region outside the overlap region and within the search region.

[0018] Preferably, the processor highlights the overlapping area on the display device by changing the color, shape or line style of a border of the overlapping area.

[0019] Preferably, the processor detects the object region by inputting image signals within the search region into a machine-learned model.

[0020] When the search region determined based on the focus target region becomes smaller than the specified size, the processor preferably sets the size of the search region to the specified size.

[0021] When the detected object region is a specific part, the processor preferably changes the size of the search region depending on the type or size of the part.

[0022] An imaging device according to the present disclosure includes the above-described focus control device, an imaging element, and an operation device.

[0023] The focus control method of the present disclosure includes a processor acquiring an image signal output from an imaging element, setting a focus target area within an imaging area based on output information from an operation device that accepts user operations, determining a search area based on the focus target area, detecting an object area including a specific object from within the search area, detecting an overlap area where the focus target area and the object area overlap, and performing focus control based on the image signal within the overlap area.

[0024] The program disclosed herein causes a processor to execute processes including acquiring an image signal output from an imaging element, setting a focus target area within an imaging area based on output information from an operating device that accepts user operations, determining a search area based on the focus target area, detecting an object area including a specific object from within the search area, detecting an overlap area where the focus target area and the object area overlap, and performing focus control based on an image signal within the overlap area. [Brief description of the drawings]

[0025] [Figure 1] FIG. 2 is a diagram illustrating an example of the internal configuration of an imaging device. [Diagram 2] FIG. 2 is a diagram illustrating an example of a configuration of an imaging pixel. [Diagram 3] FIG. 2 is a diagram illustrating an example of a configuration of a phase difference detection pixel. [Figure 4] FIG. 2 is a diagram illustrating an example of a pixel array of an image sensor. [Diagram 5] 2 is a block diagram showing an example of a functional configuration of a processor; [Figure 6] FIG. 4 is a diagram showing an example of an AF area. [Figure 7] FIG. 13 is a diagram illustrating an example of a search region. [Figure 8] 13 is a flowchart illustrating an example of an object region detection process. [Figure 9] FIG. 13 is a diagram illustrating an example of an overlapping region. [Figure 10] 13 is a flowchart illustrating an example of an overlapping region detection process. [Figure 11] FIG. 4 is a diagram showing an example of an image displayed on a display. [Figure 12] 10 is a flowchart illustrating an example of a focus position detection process. [Figure 13] 4 is a flowchart showing the flow of an entire process executed by the imaging device. [Figure 14] 11A and 11B are diagrams illustrating an example of a peripheral region for acquiring a defocus amount for non-focus control; [Figure 15]FIG. 13 is a diagram illustrating a process of limiting the size of a search region to a minimum size. [Figure 16] FIG. 13 illustrates a process for expanding a search area. [Figure 17] 13 is a flowchart showing an example of a search region optimization process. [Figure 18] FIG. 13 is a diagram showing an example of an object region when the object is an airplane. [Figure 19] FIG. 13 is a diagram illustrating an overlap rate for a plurality of object regions. [Figure 20] 1 is a diagram defining the coordinates of an object region and an AF area. [Figure 21] 10 is a flowchart showing an example of a process for determining the positional relationship between an object area and an AF area. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] An example of an embodiment of the technology of the present disclosure will be described with reference to the accompanying drawings.

[0027] First, the terms used in the following description will be explained.

[0028] In the following explanation, "IC" is an abbreviation for "Integrated Circuit". "CPU" is an abbreviation for "Central Processing Unit". "ROM" is an abbreviation for "Read Only Memory". "RAM" is an abbreviation for "Random Access Memory". "CMOS" is an abbreviation for "Complementary Metal Oxide Semiconductor".

[0029] "FPGA" is an abbreviation for "Field Programmable Gate Array". "PLD" is an abbreviation for "Programmable Logic Device". "ASIC" is an abbreviation for "Application Specific Integrated Circuit". "OVF" is an abbreviation for "Optical View Finder". "EVF" is an abbreviation for "Electronic View Finder". "CNN" is an abbreviation for "Convolutional Neural Network". "AF" is an abbreviation for "Auto Focus". "R-CNN" is an abbreviation for "Regions with Convolutional Neural Networks".

[0030] The technology of the present disclosure will be described by taking a digital camera with interchangeable lenses as an example of an embodiment of an imaging device. Note that the technology of the present disclosure is not limited to the digital camera with interchangeable lenses, and can also be applied to a digital camera with an integrated lens.

[0031] 1 shows an example of the configuration of an imaging device 10. The imaging device 10 is a digital camera with interchangeable lenses. The imaging device 10 is composed of a main body 11 and an imaging lens 12 that is replaceably attached to the main body 11. The imaging lens 12 is attached to the front side of the main body 11 via a camera side mount 11A and a lens side mount 12A.

[0032] The main body 11 is provided with an operation device 13 that includes a dial, a release button, a touch panel, etc. and accepts operations by a user. The operation modes of the imaging device 10 include, for example, a still image capturing mode, a video capturing mode, and an image display mode. The operation device 13 is operated by a user when setting an operation mode. The operation device 13 is also operated by a user when starting to capture a still image or a video. The operation device 13 is also operated by a user when specifying an AF area to be focused on from within the imaging area. The AF area is an example of a "focus target area" according to the technology of the present disclosure.

[0033] The main body 11 is also provided with a finder 14. Here, the finder 14 is a hybrid finder (registered trademark). The hybrid finder refers to a finder in which, for example, an optical view finder (hereinafter, referred to as "OVF") and an electronic view finder (hereinafter, referred to as "EVF") are selectively used. The user can observe an optical image or a live view image of a subject projected by the finder 14 through a finder eyepiece (not shown).

[0034] A display 15 is provided on the rear side of the main body 11. Images based on image signals obtained by imaging, various menu screens, and the like are displayed on the display 15. The user can also observe a live view image displayed on the display 15 instead of the viewfinder 14. The display 15 is an example of a "display device" according to the technology of the present disclosure.

[0035] The main body 11 and the imaging lens 12 are electrically connected by electrical contacts 11B provided on the camera side mount 11A coming into contact with electrical contacts 12B provided on the lens side mount 12A.

[0036] The imaging lens 12 includes an objective lens 30, a focus lens 31, a rear end lens 32, and an aperture 33. The respective components are arranged along the optical axis A of the imaging lens 12 in the following order from the objective side: objective lens 30, aperture 33, focus lens 31, and rear end lens 32. The objective lens 30, focus lens 31, and rear end lens 32 constitute an imaging optical system. The type, number, and arrangement order of the lenses that constitute the imaging optical system are not limited to the example shown in FIG.

[0037] The imaging lens 12 also has a lens drive control unit 34. The lens drive control unit 34 is composed of, for example, a CPU, a RAM, and a ROM. The lens drive control unit 34 is electrically connected to a processor 40 in the main body 11 via an electrical contact 12B and an electrical contact 11B.

[0038] The lens drive control unit 34 drives the focus lens 31 and the aperture 33 based on a control signal transmitted from the processor 40. The lens drive control unit 34 controls the drive of the focus lens 31 based on a focus control control signal transmitted from the processor 40 in order to adjust the focus position of the imaging lens 12. The processor 40 detects the focus position using a phase difference method. The focus position is represented by a defocus amount.

[0039] The diaphragm 33 has an aperture whose diameter is variable around the optical axis A. The lens drive control unit 34 controls the drive of the diaphragm 33 based on a control signal for adjusting the diaphragm transmitted from the processor 40 in order to adjust the amount of light incident on the light receiving surface 20A of the image sensor 20.

[0040] Also provided inside the main body 11 are an image sensor 20, a processor 40, and a memory 42. The operations of the image sensor 20, the memory 42, the operation device 13, the viewfinder 14, and the display 15 are controlled by the processor 40.

[0041] The processor 40 is configured by, for example, a CPU. In this case, the processor 40 executes various processes based on a program 43 stored in the memory 42. The processor 40 may be configured by a collection of multiple IC chips. The memory 42 stores a machine-learned model LM that has been subjected to machine learning for object region detection. The processor 40 and the memory 42 configure a focus control device.

[0042] The imaging sensor 20 is, for example, a CMOS image sensor. The imaging sensor 20 is disposed such that its optical axis A is perpendicular to the light receiving surface 20A and is located at the center of the light receiving surface 20A. Light that has passed through the imaging lens 12 is incident on the light receiving surface 20A. A plurality of pixels that generate signals by performing photoelectric conversion are formed on the light receiving surface 20A. The imaging sensor 20 photoelectrically converts the light incident on each pixel to generate and output an image signal D. The imaging sensor 20 is an example of an "imaging element" according to the technology of the present disclosure.

[0043] A color filter array in a Bayer pattern is arranged on the light receiving surface of the image sensor 20, and a color filter of any one of R (red), G (green), and B (blue) is arranged to face each pixel. Note that some of the pixels arranged on the light receiving surface of the image sensor 20 may be phase difference detection pixels for detecting a phase difference related to focus control.

[0044] Fig. 2 shows an example of the configuration of the imaging pixel N. Fig. 3 shows an example of the configuration of the phase difference detection pixels P1 and P2. Each of the phase difference detection pixels P1 and P2 receives one of the light beams split in the X direction with the principal ray as the center. Hereinafter, the direction perpendicular to the X direction is referred to as the Y direction. The X direction corresponds to the horizontal direction, and the Y direction corresponds to the vertical direction.

[0045] 2, the imaging pixel N includes a photodiode PD as a photoelectric conversion element, a color filter CF, and a microlens ML. The color filter CF is disposed between the photodiode PD and the microlens ML.

[0046] The color filter CF is a filter that transmits light of any one of the colors R, G, and B. The microlens ML collects the light flux LF incident from the exit pupil EP of the imaging lens 12 onto approximately the center of the photodiode PD via the color filter CF.

[0047] 3, each of the phase difference detection pixels P1 and P2 includes a photodiode PD, a light-shielding layer SF, and a microlens ML. Similar to the imaging pixel N, the microlens ML focuses a light beam LF incident from an exit pupil EP of the imaging lens 12 onto approximately the center of the photodiode PD.

[0048] The light-shielding layer SF is formed of a metal film or the like, and is disposed between the photodiode PD and the microlens ML. The light-shielding layer SF blocks a part of the light flux LF that is incident on the photodiode PD via the microlens ML.

[0049] In the phase difference detection pixel P1, the light-shielding layer SF blocks the negative side in the X direction with respect to the center of the photodiode PD. That is, in the phase difference detection pixel P1, the light-shielding layer SF allows the light flux LF from the negative-side exit pupil EP1 to be incident on the photodiode PD, and blocks the light flux LF from the positive-side exit pupil EP2 in the X direction.

[0050] In the phase difference detection pixel P2, the light shielding layer SF shields the positive side in the X direction with respect to the center of the photodiode PD as a reference. That is, in the phase difference detection pixel P2, the light shielding layer SF allows the light flux LF from the positive side exit pupil EP2 to be incident on the photodiode PD, and shields the light flux LF from the negative side exit pupil EP1 in the X direction.

[0051] That is, the phase difference detection pixel P1 and the phase difference detection pixel P2 have different light blocking positions in the X direction. The phase difference detection direction by the phase difference detection pixels P1 and P2 is the X direction (that is, the horizontal direction).

[0052] Fig. 4 shows an example of a pixel array of the image sensor 20. In Fig. 4, "R" represents an imaging pixel N provided with an R color filter CF. "G" represents an imaging pixel N provided with a G color filter CF. "B" represents an imaging pixel N provided with a B color filter CF. Note that the color array of the color filters CF is not limited to the Bayer array, and may be another color array.

[0053] Rows RL including the phase difference detection pixels P1 and P2 are arranged in the Y direction for every 10 pixels. In each row RL, a pair of phase difference detection pixels P1 and P2 and one imaging pixel N are repeatedly arranged in the Y direction. The arrangement pattern of the phase difference detection pixels P1 and P2 is not limited to the example shown in FIG. 4. For example, it may be a pattern in which a plurality of phase difference detection pixels are arranged on one microlens ML as shown in FIG. 5 attached to JP 2018-56703 A.

[0054] Fig. 5 shows an example of the functional configuration of the processor 40. The processor 40 realizes various functional units by executing processes according to a program 43 stored in the memory 42. As shown in Fig. 5, for example, the processor 40 realizes a main control unit 50, an imaging control unit 51, an image processing unit 52, a display control unit 53, an AF area setting unit 54, a search region determination unit 55, an object region detection unit 56, an overlap region detection unit 57, and a focus position detection unit 58.

[0055] The main control unit 50 performs overall control of the operation of the imaging device 10 based on output information from the operation device 13. The imaging control unit 51 controls the imaging sensor 20 to execute imaging processing for causing the imaging sensor 20 to perform an imaging operation. The imaging control unit 51 drives the imaging sensor 20 in a still image imaging mode or a video imaging mode.

[0056] The imaging sensor 20 outputs an image signal D including an imaging signal SN generated by the imaging pixel N and a phase difference detection signal SP generated by the phase difference detection pixels P1 and P2. The imaging sensor 20 outputs the image signal D to an image processing unit 52. The imaging sensor 20 also outputs the image signal D to a focus position detection unit 58.

[0057] The image processing unit 52 acquires the image signal D output from the imaging sensor 20, and performs image processing such as demosaic processing on the acquired image signal D.

[0058] The display control unit 53 causes the display 15 to display an image represented by the image signal D that has been subjected to image processing by the image processing unit 52. Furthermore, the display control unit 53 causes the display 15 to display a live view image based on the image signal D periodically input from the image processing unit 52 during imaging preparation operations before still image capture or video capture. Furthermore, the display control unit 53 causes the display 15 to display an AF area RA specified by the user using the operation device 13, an overlap area RD detected by the overlap area detection unit 57, and the like. For example, the operation device 13 is a touch panel provided on the display surface of the display 15, and the user can specify the AF area RA by touching the touch panel with a finger.

[0059] The AF area setting unit 54 sets a rectangular AF area RA within the imaging area based on output information from the operation device 13. For example, the AF area RA is composed of a plurality of blocks. The user can specify the position, number, arrangement direction, etc. of the blocks by operating the operation device 13.

[0060] The search area determination unit 55 determines a search area RB in which to search for a specific object, based on the AF area RA set by the AF area setting unit 54. The search area determination unit 55 determines the search area RB so as to include the AF area RA within the imaging area. For example, the search area determination unit 55 determines the search area RB based on the longer side of the AF area RA. The search area RB is rectangular. Note that the user can use the operation device 13 to specify the type of specific object to be detected (such as a human face, a bird, an airplane, or a car).

[0061] The object region detection unit 56 detects an object region RC including a specific object from within the search region RB determined by the search region determination unit 55. Specifically, the object region detection unit 56 detects the object region RC by cutting out a portion corresponding to the search region RB from the image represented by the image signal D and inputting the cut-out image to the machine-learned model LM. In other words, the object region detection unit 56 detects the object region RC by inputting the image signal D within the search region RB to the machine-learned model LM. Note that the object region detection unit 56 may input only the imaging signal SN included in the image signal D within the search region RB to the machine-learned model LM.

[0062] The overlap region detection unit 57 detects an overlap region RD where the AF area RA and the object region RC overlap. Specifically, the overlap region detection unit 57 calculates an overlap rate with the object region RC for each of a plurality of blocks constituting the AF area RA, and detects one or a plurality of blocks whose overlap rate is equal to or greater than a threshold as the overlap region RD.

[0063] The focus position detection unit 58 acquires a defocus amount for focus control based on the image signal D in the overlap region RD detected by the overlap region detection unit 57. Specifically, the focus position detection unit 58 acquires a defocus amount for focus control based on the phase difference detection signal SP included in the image signal D in the overlap region RD. More specifically, the focus position detection unit 58 calculates the defocus amount by performing a correlation calculation based on the phase difference detection signal SP output from the multiple phase difference detection pixels P1 and the phase difference detection signal SP output from the multiple phase difference detection pixels P2.

[0064] The main control unit 50 drives the focus lens 31 via the lens drive control unit 34 based on the defocus amount for focus control acquired by the focus position detection unit 58. As a result, the object detected by the object area detection unit 56 becomes in focus.

[0065] Fig. 6 shows an example of an AF area RA. In the example shown in Fig. 6, an obstacle OB appears in the image represented by the image signal D, and the user specifies the AF area RA so as to avoid the obstacle OB by operating the operation device 13. In the example shown in Fig. 6, the obstacle OB is a fence extending in the Y direction, and the user specifies an AF area RA having a shape extending in the Y direction.

[0066] 6, the AF area RA is composed of a plurality of rectangular blocks B1 to B5. Each of the plurality of blocks B1 to B5 has the same shape and size. Since the number of phase difference detection pixels P1, P2 included in a block varies, the reliability of the calculated defocus amount varies depending on the shape and size of the block. In this embodiment, since the shape and size of each block are the same, it is possible to reduce the variation in the reliability of the defocus amount calculated from each block.

[0067] The user can specify the position of the AF area RA and the number of blocks in the X and Y directions by operating the operation device 13. This allows the user to set the AF area RA to an appropriate position, shape (e.g., aspect ratio), and size so as to avoid an obstacle OB. The AF area setting unit 54 sets the AF area RA within the imaging region based on information such as the position and number of blocks of the AF area RA specified by the user.

[0068] Fig. 7 shows an example of a search region RB. As shown in Fig. 7, when a plurality of blocks B1 to B5 constituting an AF area RA are arranged in the Y direction and the AF area RA extends in the Y direction, the search region determination unit 55 determines the search region RB as a rectangular region whose two sides contact both ends of the AF area RA in the Y direction (i.e., the long side direction). That is, the search region determination unit 55 determines the search region RB based on the long side of the AF area RA.

[0069] 7, the search area RB is determined to be in contact with blocks B1 and B5 located at the ends of the AF area RA in the Y direction. The search area RB is a rectangular area having sides parallel to the X direction and sides parallel to the Y direction, and it is preferable that the ratio of the number of pixels in the X direction to the number of pixels in the Y direction is 1:1 (i.e., the aspect ratio is 1:1). This is because it is preferable that the aspect ratio of the image input to the trained model LM is 1:1.

[0070] FIG. 8 shows an example of the object region detection process by the object region detection unit 56. The trained model LM is configured by a neural network having an input layer, an intermediate layer, and an output layer. The intermediate layer is configured by a plurality of neurons. The number of intermediate layers and the number of neurons in each intermediate layer can be changed as appropriate. The trained model LM may be an R-CNN.

[0071] The trained model LM is a model that has been trained by machine learning using a plurality of images in which a specific object is captured as training data to detect an object region including the specific object from within the image. The trained model LM may be a model that has been trained by machine learning in a computer external to the imaging device 10.

[0072] The object region detection unit 56 inputs an image (hereinafter referred to as a cut-out image) obtained by cutting out a portion corresponding to the search region RB from the image represented by the image signal D to the machine-learned model LM. The machine-learned model LM detects an object region RC including a specific object OJ from the cut-out image, and outputs information representing the object region RC on the cut-out image. The object region detection unit 56 outputs the information representing the object region RC output from the machine-learned model LM to the overlapping region detection unit 57.

[0073] Fig. 9 shows an example of overlap region RD. In the example shown in Fig. 9, among a plurality of blocks B1 to B5 constituting AF area RA, blocks B2 to B4 overlap with object region RC. Therefore, in the example shown in Fig. 9, overlap region detection section 57 detects blocks B2 to B4 as overlap region RD.

[0074] 10 shows an example of overlap region detection processing by overlap region detection unit 57. In overlap region detection processing, first, overlap region detection unit 57 selects one block from the multiple blocks that make up AF area RA (step S10). Next, overlap region detection unit 57 calculates the overlap rate between the selected block and object region RC (step S11). Here, the overlap rate refers to the rate at which the object region RC overlaps with the block.

[0075] Next, the overlap region detection unit 57 determines whether the calculated overlap rate is equal to or greater than a threshold (step S12). If the overlap rate is equal to or greater than the threshold (step S12: YES), the overlap region detection unit 57 selects the block as an overlap region RD (step S13). On the other hand, if the overlap rate is less than the threshold (step S12: NO), the overlap region detection unit 57 shifts the process to step S14.

[0076] In step S14, the overlapped area detection unit 57 determines whether or not the block is the final block. If the block is not the final block (step S14: NO), the overlapped area detection unit 57 selects a block for which the overlap rate has not been calculated from among the multiple blocks constituting the AF area RA (step S15).

[0077] After step S15, the overlapped area detection unit 57 returns the process to step S11. The overlapped area detection unit 57 repeats steps S11 to S15, and when it is determined in step S14 that the block is the last block, it ends the overlapped area detection process. The overlapped area RD includes one or more blocks selected in step S13.

[0078] FIG. 11 shows an example of an image displayed on the display 15 by the display control unit 53. The main control unit 50 displays the AF area RA and overlapping region RD in the image represented by the image signal D via the display control unit 53. The main control unit 50 highlights the overlapping region RD by changing the color, shape, or line type of the frame of the overlapping region RD. In the example shown in FIG. 11, the main control unit 50 highlights the overlapping region RD by making the frame of the overlapping region RD a thick line and changing the colors of the AF area RA and the overlapping region RD. Note that the overlapping region RD may be displayed without displaying the AF area RA.

[0079] 12 shows an example of the focus position detection process by the focus position detection unit 58. In the focus position detection process, first, the focus position detection unit 58 selects one block included in the overlap region RD (step S20). The focus position detection unit 58 calculates the defocus amount for the selected block (step S21). In step S21, the focus position detection unit 58 calculates the defocus amount by performing a correlation calculation based on the phase difference detection signal SP included in the image signal D in the block.

[0080] Next, the focus position detection unit 58 judges whether or not it is the final block (step S22). If it is not the final block (step S22: NO), the focus position detection unit 58 selects a block that is included in the overlap region RD and for which the defocus amount has not been calculated (step S23). After step S23, the focus position detection unit 58 returns the process to step S21. The focus position detection unit 58 repeats steps S21 to S23, and if it is determined in step S22 that it is the final block, it transitions the process to step S24.

[0081] In step S24, the in-focus position detection unit 58 calculates the average value of the multiple defocus amounts calculated in step S21. Then, the in-focus position detection unit 58 acquires the calculated average value as the defocus amount for focus control (step S25).

[0082] Fig. 13 shows the flow of the entire process executed by the imaging device 10. Fig. 13 shows an example of the case where a live view image is displayed during imaging preparation operation in still image imaging mode.

[0083] First, the main control unit 50 determines whether or not an instruction to start preparation for imaging has been issued by the user operating the operation device 13 (step S30). If an instruction to start preparation for imaging has been issued (step S30: YES), the main control unit 50 controls the imaging control unit 51 to cause the imaging sensor 20 to perform an imaging operation (step S31).

[0084] The image processing unit 52 acquires the image signal D output from the imaging sensor 20 and performs image processing on the image signal D (step S32). The display control unit 53 causes the display 15 to display an image represented by the image signal D after the image processing (step S33).

[0085] Next, the main control unit 50 determines whether or not the user has performed an operation to specify the AF area RA using the operation device 13 (hereinafter, referred to as an AF area specifying operation) (step S34). If the AF area specifying operation has not been performed (step S34: NO), the main control unit 50 shifts the process to step S43.

[0086] If an AF area designation operation has been performed (step S34: YES), the AF area setting unit 54 sets an AF area RA within the imaging area (step S35) based on output information from the operation device 13. The search area determination unit 55 determines a search area RB based on the set AF area RA (step S36).

[0087] Next, the object region detection unit 56 detects the object region RC by performing the above-mentioned object region detection process (step S37). The main control unit 50 determines whether or not the object region RC has been detected by the object region detection unit 56 (step S38).

[0088] If the object region RC is detected (step S38: YES), the overlap region detection unit 57 performs the above-mentioned overlap region detection process to detect the overlap region RD (step S39). Then, the focus position detection unit 58 performs the above-mentioned focus position detection process to obtain a defocus amount for focus control (step S40).

[0089] If the object region RC is not detected (step S38: NO), the focus position detection unit 58 acquires the defocus amount for focus control from the entire AF area RA (step S41). Note that if the overlap region RD is not detected in step S39, the focus position detection unit 58 may acquire the defocus amount for focus control from the entire AF area RA.

[0090] After step S40 or step S41, the main controller 50 drives the focus lens 31 based on the acquired defocus amount for focus control (step S42).

[0091] Next, the main control unit 50 judges whether or not an image capture instruction has been issued by the user operating the operation device 13 (step S43). If no operation instruction has been issued (step S43: NO), the main control unit 50 returns the process to step S31. The processes of steps S31 to S43 are repeatedly executed until the main control unit 50 judges in step S43 that an image capture instruction has been issued.

[0092] If an image capture instruction is received (step S43: YES), the main control unit 50 performs a still image capture process in which the image sensor 20 performs an image capture operation and the image signal D that has been image processed by the image processing unit 52 is recorded in the memory 42 as a still image (step S21).

[0093] In the technology disclosed herein, object region detection is performed from a search region RB determined based on an AF area RA specified by a user, so that an object region RC including an object intended by the user to be focused on can be detected quickly. In addition, in the technology disclosed herein, focus control is performed based on an image signal D in an overlap region RD where the AF area RA and the object region RC overlap, so that focus control can be performed with high accuracy on an object intended by the user to be focused on. In other words, according to the technology disclosed herein, focus control can be performed with high accuracy on an object intended by the user to be focused on.

[0094] [Variations] Various modifications of the above embodiment will be described below.

[0095] In the above embodiment, the user can specify the position, number, arrangement direction, etc. of the blocks that make up the AF area RA using the operation device 13, but it is also possible to specify only the position, shape (e.g., aspect ratio), and size of the AF area RA. In this way, when the AF area RA specified by the user is not composed of multiple blocks, the AF area setting unit 54 may divide the AF area RA specified by the user into multiple blocks. In this case, it is preferable that the AF area setting unit 54 sets each block to the same shape and size.

[0096] Furthermore, when the AF area RA specified by the user is not composed of a plurality of blocks, the AF area setting unit 54 may divide the AF area RA into a number of blocks according to the type of a specific object to be detected. Depth information required for focus control differs depending on the type of object. For this reason, when the object is an object that requires a lot of depth information, such as a bird, the number of block divisions is increased. On the other hand, when the object is an object that does not require much depth information, such as a car, the number of block divisions is decreased. The smaller the number of block divisions, the faster the focus control can be performed, and the more accurate the focus control can be performed for an object such as a car that moves at high speed. In this way, by adjusting the number of block divisions, the accuracy and speed of focus control can be balanced.

[0097] Furthermore, if the AF area RA specified by the user is not composed of multiple blocks, the AF area setting unit 54 may set the AF area RA without dividing it into multiple blocks. In this case, the overlap area detection unit 57 detects an area where the overlap rate between the AF area RA and the object area RC is equal to or greater than a threshold as the overlap area RD, and the focus position detection unit 58 obtains a defocus amount for focus control based on the image signal D in the overlap area RD. Note that, if the overlap rate between the AF area RA and the object area RC is less than the threshold, the focus position detection unit 58 may obtain a defocus amount for focus control based on the image signal D of the AF area RA.

[0098] In the above embodiment, the focus position detection unit 58 acquires the average value of the defocus amount of each block included in the overlap region RD as the defocus amount for focus control. Alternatively, the focus position detection unit 58 may acquire the weighted average value of the defocus amount of each block, weighted by the overlap rate of each block with the object region RC, as the defocus amount for focus control. For example, the weight is increased as the overlap rate increases. Also, the weighted average value of the defocus amount of each block, weighted by the type of part of the object located in each block, may be acquired as the defocus amount for focus control. For example, the weight is increased as the part is more important as a focus target.

[0099] In the above embodiment, the in-focus position detection unit 58 acquires the defocus amount for focus control from the overlap region RD, but may acquire the defocus amount for non-focus control based on the image signal D of an area outside the overlap region RD and within the search region RB (hereinafter referred to as the peripheral area). For example, as shown in FIG. 14, the in-focus position detection unit 58 divides the peripheral area RE into blocks, and acquires the defocus amount for non-focus control from the defocus amount calculated from each block. It is preferable that each block of the peripheral area RE has the same shape and size as each block of the AF area RA. Note that the defocus amount for non-focus control is a defocus amount used for reference, not for focus control.

[0100] In this way, by obtaining a defocus amount for non-focus control from the peripheral region RE in addition to the defocus amount for focus control, when a specific object enters the search region RB from outside the search region RB, the in-focus position can be predicted in a short time, and focus control can be performed faster.

[0101] In the above embodiment, the search region determination unit 55 determines the search region RB based on the long side of the AF area RA, so as shown in FIG. 15(A), when the set AF area RA is small, the search region RB becomes small. If the search region RB is too small, the object region detection unit 56 may not be able to detect the object region RC. For this reason, as shown in FIG. 15(B), the search region determination unit 55 determines the search region RB based on the long side of the AF area RA, so as shown in FIG. 15(A), when the search region RB determined based on the AF area RA becomes smaller than the specified size, it is preferable to set the size of the search region RB to the specified size. FIG. 15(B) shows the search region RB expanded to the specified size. For example, the specified size is the minimum image size that can be input to the trained model LM. For example, the specified size is an image size of 320 pixels by 320 pixels in the X direction and the Y direction. For example, when the AF area RA is 200 pixels×100 pixels, the search region determination section 55 sets the search region RB to 320 pixels×320 pixels.

[0102] Furthermore, when the size of the search region RB determined by the search region determination unit 55 is smaller than a specified size (e.g., 320 pixels x 320 pixels), the object region detection unit 56 may enlarge the cut-out image cut out from the search region RB to a minimum size and then input it to the trained model LM. Also, a lower limit of the size of the cut-out image to be enlarged may be specified. For example, the lower limit of the size of the cut-out image to be enlarged is set to 200 pixels x 200 pixels.

[0103] Also, the AF area RA may be set so that multiple blocks are dispersed within the imaging area. In this case, the search region determination unit 55 determines a search region RB for each block. If the search regions RB of each block are close to each other, the search region determination unit 55 may integrate the multiple search regions RB into one search region RB.

[0104] Furthermore, the search region determination unit 55 may optimize the size of the search region RB using the past detection history of the object region RC by the object region detection unit 56. Even if the object region RC is detected, if the size of the object OJ included in the object region RC is too small relative to the search region RB, the detection performance is likely to deteriorate and the detection is likely to become unstable. Also, if the object OJ is so large that it protrudes from the search region RB, the detection performance is likely to deteriorate and the detection is likely to become unstable.

[0105] For example, as shown in Fig. 16, when the object OJ included in the object region RC is a human eye, a face larger than the eye may extend outside the search region RB, making detection unstable. In this case, the search region determination unit 55 preferably expands the search region RB to include the face when determining the search region RB next time. In this way, when the detected object region RC is a specific part, the search region determination unit 55 preferably changes the size of the search region RB according to the type or size of the part.

[0106] 17 shows an example of the optimization process of the search region RB by the search region determination unit 55. In the optimization process, first, the search region determination unit 55 determines whether or not the detection of the object region RC by the object region detection unit 56 is unstable (step S50). For example, if the object OJ is relatively too small or too large compared to the search region RB, it determines that the detection is unstable. If the detection is not unstable (step S50: NO), the search region determination unit 55 ends the optimization process.

[0107] If the detection is unstable (step S50: YES), the search region determination unit 55 judges whether the object OJ included in the object region RC is the smallest part (step S51). The smallest part is the smallest part in the object OJ (for example, a human pupil). If the object OJ is the smallest part (step S51: YES), the search region determination unit 55 judges whether the smallest part is larger than A% of the search region RB (step S52). If the smallest part is larger than A% of the search region RB, the search region determination unit 55 expands the search region RB (step S53) and ends the optimization process. If the smallest part is not larger than A% of the search region RB, the search region determination unit 55 ends the optimization process.

[0108] If the object OJ is not the smallest part (step S51: NO), the search region determination unit 55 judges whether the object OJ is the largest part (step S54). The largest part is the largest part of the object OJ (for example, the body of a bird). If the object OJ is the largest part (step S54: YES), the search region determination unit 55 judges whether the largest part is smaller than B% of the search region RB (step S55). If the largest part is smaller than B% of the search region RB, the search region determination unit 55 reduces the search region RB (step S56) and ends the optimization process. If the largest part is not smaller than B% of the search region RB, the search region determination unit 55 ends the optimization process.

[0109] In addition, the search region determination unit 55 determines the enlargement and reduction ratios of the search region RB based on the detection stability (for example, the detection success rate, such as successful detection four times in the past 10 frames) and the history of the size of the object OJ relative to the search region RB.

[0110] According to the above optimization process, for example, if a human pupil is detected as the smallest part and the smallest part is approximately 30% in size of the search area RB, since the human head is approximately 10 times the size of the pupil, the search area RB is expanded to approximately 10 times the size of the pupil.

[0111] Furthermore, according to the optimization process, for example, if the bird's body is detected as the largest part and the size of that largest part is about 5% of the search area RB, the size of that largest part is too small for stable detection, so the search area RB is reduced so that the largest part is about 10% of the search area RB.

[0112] In the above embodiment, the overlap region detection unit 57 detects one or more blocks whose overlap rate is equal to or greater than a threshold as the overlap region RD. The overlap region detection unit 57 may change the threshold depending on the type of object. For example, as shown in FIG. 18, when the object OJ is an airplane, there is a large amount of blank space in the object region RC where the object OJ does not exist, so it is preferable to set the threshold high. As a result, only blocks with a high overlap rate with the object OJ are detected as the overlap region RD, improving the accuracy of focus control.

[0113] In the above embodiment, the overlap rate is defined as the ratio of the object region RC to the block, but the overlap rate may be defined as the ratio of the AF area RA to the object region RC. For example, as shown in FIG. 19, when a plurality of object regions RC1 to RC3 are detected by the object region detection unit 56, the overlap rates of the object regions RC1 to RC3 are different from each other. The object region RC1 is a region including the bird's pupil. The object region RC1 is completely included in the AF area RA, so the overlap rate is high. The object region RC2 is a region including the bird's face. The object region RC2 is only partially overlapped with the AF area RA, so the overlap rate is low. The object region RC3 is a region including the bird's body. The object region RC3 is only partially overlapped with the AF area RA, so the overlap rate is low.

[0114] The positional relationship between the object area RC and the AF area RA can be obtained by setting the coordinates of the object area RC and the AF area RA as shown in FIG. 20 and making a determination based on the flowchart in FIG.

[0115] As shown in Fig. 20, the minimum and maximum coordinates of the object region RC in the X direction are defined as Cxmin and Cxmax, respectively. The minimum and maximum coordinates of the object region RC in the Y direction are defined as Cymin and Cymax, respectively. The minimum and maximum coordinates of the AF area RA in the X direction are defined as Axmin and Axmax, respectively. The minimum and maximum coordinates of the AF area RA in the Y direction are defined as Aymin and Aymax, respectively.

[0116] In the flowchart shown in FIG. 21, first, it is determined whether or not condition 1 is satisfied (step S60). If condition 1 is satisfied (step S60: YES), it is determined that the object region RC is included in the AF area RA (step S61). If condition 1 is not satisfied (step S60: NO), it is determined whether or not condition 2 is satisfied (step S62). If condition 2 is satisfied (step S62: YES), it is determined that the AF area RA is included in the object region RC (step S63). If condition 2 is not satisfied (step S62: NO), it is determined whether or not condition 3 is satisfied (step S64). If condition 3 is satisfied (step S64: YES), it is determined that the object region RC is partially overlapped with the AF area RA (step S65). If condition 3 is not satisfied (step S64: NO), it is determined that the object region RC is not overlapped with the AF area RA (step S66).

[0117] It is preferable for the overlapping region detection unit 57 to reduce the threshold value when it is determined that the object region RC overlaps partially with the AF area RA and the object region RC includes a part of high importance such as an eye. It is also preferable for the overlapping region detection unit 57 to reduce the threshold value when it is determined that the object region RC overlaps partially with the AF area RA and the object region RC includes the entire object such as the body.

[0118] In addition, in the above embodiment, the display control unit 53 displays an image on the display 15, but instead of or together with the display 15, the display control unit 53 may display an image on the finder 14. In this case, the focus control device may be configured to enable the user to specify the AF area RA via the eye-gaze input device. The finder 14 is an example of a "display device" according to the technology of the present disclosure. The eye-gaze input device is an example of an "operation device" according to the technology of the present disclosure.

[0119] The technology disclosed herein is not limited to digital cameras, but can also be applied to electronic devices such as smartphones and tablet terminals that have an imaging function.

[0120] In the above embodiment, the hardware structure of the control unit, with processor 40 being an example, may be any of the following various processors. The above various processors include a CPU, which is a general-purpose processor that functions by executing software (programs), as well as a processor such as an FPGA, whose circuit configuration can be changed after manufacture. FPGAs include dedicated electric circuits, which are processors having a circuit configuration designed specifically for executing specific processing, such as PLDs or ASICs.

[0121] The control unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple control units may be configured with one processor.

[0122] There are several possible examples of configuring multiple control units with one processor. A first example is a form in which one processor is configured with a combination of one or more CPUs and software, as typified by computers such as clients and servers, and this processor functions as multiple control units. A second example is a form in which a processor is used that realizes the functions of the entire system including multiple control units with one IC chip, as typified by system on chip (SOC). In this way, the control unit can be configured as a hardware structure using one or more of the various processors described above.

[0123] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0124] The program may also be stored in a non-transitory computer-readable storage medium.

[0125] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0126] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference.

[0127] The above explanation makes it possible to understand the following techniques. [Additional note 1] A processor and a memory, The processor, Acquire the image signal output from the imaging element, setting a focusing target area within the imaging area based on output information from an operation device that accepts an operation by a user; determining a search region based on the focus target region; Detecting an object region including a specific object from within the search region; detecting an overlapping region where the focus target region and the object region overlap; performing focus control based on the image signal within the overlapping region; Focus control device. [Additional note 2] the focusing target area is composed of a plurality of blocks, The processor detects one or more blocks among the plurality of blocks that overlap with the object region as the overlap region. Item 1. A focus control device according to claim 1. [Additional note 3] The processor detects, as the overlap region, one or more blocks among the plurality of blocks, which have an overlap rate with the object region equal to or greater than a threshold. 3. A focus control device according to claim 2. [Additional note 4] The processor varies the threshold value depending on the type of the particular object. 4. The focus control device according to claim 3. [Additional note 5] The processor detects, as the overlap region, a region in which an overlap rate between the focus target region and the object region is equal to or greater than a threshold. Item 1. A focus control device according to claim 1. [Additional note 6] When the overlap rate is less than a threshold, the processor performs focus control based on an image signal of the focusing target area. 6. The focus control device according to claim 5. [Additional note 7] The processor determines the search region based on a long side of the focus target region. 7. A focus control device according to claim 1, wherein the focus control device is a focus control device having a focus control mechanism. [Additional note 8] The focusing target area is rectangular. 8. The focus control device according to claim 7. [Additional note 9] When the focus target area is not composed of a plurality of blocks, the processor divides the focus target area into a number of blocks corresponding to the type of the specific object. 5. A focus control device according to claim 2, wherein the focus control device is a focus control device having a focus control mechanism. [Additional Note 10] The processor acquires a defocus amount for non-focus control based on the image signal in a region outside the overlap region and within the search region. 10. A focus control device according to claim 1, wherein the focus control device is a focus control device having a focus control mechanism. [Additional Note 11] the processor highlights the overlapping region on a display device by changing a frame color, a frame shape, or a frame line type of the overlapping region. 11. A focus control device according to claim 1. [Additional Note 12] The processor detects the object region by inputting an image signal within the search region to a machine-learned model. 12. A focus control device according to claim 1. [Additional Note 13] When the search region determined based on the focusing target region is smaller than a specified size, the processor sets the size of the search region to the specified size. 13. A focus control device according to claim 12. [Additional Note 14] When the detected object region is a specific region, the processor changes the size of the search region according to a type or a size of the specific region. A focus control device according to any one of claims 1 to 13. [Additional Note 15] A focus control device according to any one of claims 1 to 14, The imaging element; The operating device; An imaging device comprising: [Explanation of symbols]

[0128] 10. Imaging device 11 Main unit 11A Camera side mount 11B Electrical contacts 12 Imaging lens 12A Lens side mount 12B Electrical contact 13 Operating device 14 Finder 15 Display 20 Image sensor 20A light receiving surface 30 Objective Lens 31 Focus Lens 32 Rear lens 34 Lens drive control unit 40 processors 42 Memory 43 Programs 50 Main control unit 51 Imaging control unit 52 Image processing section 53 Display control unit 54 Area setting section 55 Search area determination unit 56 Object region detection unit 57 Overlapping Area Detection Section 58 Focus position detection section A optical axis B1~B5 Block CF Color Filter D Image signal EP,EP1,EP2 Exit pupil LF Luminous Flux LM pre-trained model ML Micro Lens N Imaging pixels OB Obstacles OJ object P1, P2 Phase difference detection pixels PD Photodiode RA AF Area RB Search Area RC,RC1~RC3 Object region RD duplicate area RE surrounding area RL line SF light shielding layer SN Image signal SP Phase difference detection signal

Claims

1. A processor and a memory, The processor, Acquire the image signal output from the imaging element, setting a focusing target area within the imaging area based on output information from an operation device that accepts an operation by a user; determining a search region based on the focus target region; Detecting an object region including a specific object from within the search region; detecting an overlapping region where the focus target region and the object region overlap; performing focus control based on the image signal within the overlapping region; Focus control device.

2. the focusing target area is composed of a plurality of blocks, The processor detects one or more blocks among the plurality of blocks that overlap with the object region as the overlap region. The focus control device according to claim 1 .

3. The processor detects, as the overlap region, one or more blocks among the plurality of blocks, which have an overlap rate with the object region equal to or greater than a threshold. The focus control device according to claim 2 .

4. The processor varies the threshold value depending on the type of the particular object. The focus control device according to claim 3 .

5. The processor detects, as the overlap region, a region in which an overlap rate between the focus target region and the object region is equal to or greater than a threshold. The focus control device according to claim 1 .

6. When the overlap rate is less than a threshold, the processor performs focus control based on an image signal of the focusing target area. The focus control device according to claim 5 .

7. The processor determines the search region based on a long side of the focus target region. The focus control device according to claim 1 .

8. The focusing target area is rectangular. The focus control device according to claim 7.

9. When the focus target area is not composed of a plurality of blocks, the processor divides the focus target area into a number of blocks corresponding to the type of the specific object. The focus control device according to claim 2 .

10. The processor acquires a defocus amount for non-focus control based on the image signal in a region outside the overlap region and within the search region. The focus control device according to claim 1 .

11. the processor highlights the overlapping region on a display device by changing a frame color, a frame shape, or a frame line type of the overlapping region. The focus control device according to claim 1 .

12. The processor detects the object region by inputting an image signal within the search region to a machine-learned model. The focus control device according to claim 1 .

13. When the search region determined based on the focusing target region is smaller than a specified size, the processor sets the size of the search region to the specified size. The focus control device according to claim 1 .

14. When the detected object region is a specific region, the processor changes the size of the search region according to a type or a size of the specific region. The focus control device according to claim 1 .

15. A focus control device according to any one of claims 1 to 14, The imaging element; The operating device; An imaging device comprising:

16. The processor: Obtaining an image signal output from the imaging element; setting a focusing target area within an imaging area based on output information from an operation device that accepts an operation by a user; determining a search region based on the focus target region; Detecting an object region including a specific object from within the search region; detecting an overlap region where the focus target region and the object region overlap; performing focus control based on the image signal within the overlapping region; A focus control method comprising:

17. Obtaining an image signal output from the imaging element; setting a focusing target area within an imaging area based on output information from an operation device that accepts an operation by a user; determining a search region based on the focus target region; Detecting an object region including a specific object from within the search region; detecting an overlap region where the focus target region and the object region overlap; performing focus control based on the image signal within the overlapping region; A program that causes a processor to execute a process including the steps of:

Citation Information

Patent Citations

  • Image pickup device

    JP2013054256A

  • Imaging device and control method of the same

    JP2013242407A

  • Focus adjustment device and focus adjustment method

    JP2022137760A

  • Imaging apparatus and method for controlling the same

    JP2022170554A