Control device, imaging device, control method, and program

The control device optimizes focus detection in imaging devices by adjusting exposure conditions based on baseline length, addressing inaccuracies in conventional methods and enhancing focus detection speed and precision.

JP7612334B2Active Publication Date: 2025-01-14CANON KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2020027947
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-02-21
Publication Date
2025-01-14
Estimated Expiration
2040-02-21

AI Technical Summary

Technical Problem

Conventional focus detection methods in imaging devices, such as phase difference AF, do not adequately consider the baseline length, aperture diameter (F value), and exposure settings, leading to potential inaccuracies and delays in focus detection.

Method used

A control device that performs focus detection based on pixel signals from different pupil regions, incorporating exposure time, sensitivity, and aperture value, while adjusting exposure conditions based on baseline length to optimize focus detection accuracy.

Benefits of technology

Enables quick and accurate focus detection by optimizing exposure settings according to baseline length, improving focus detection accuracy and reducing exposure changes for better visibility and precision.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007612334000003
    Figure 0007612334000003
  • Figure 0007612334000004
    Figure 0007612334000004
  • Figure 0007612334000005
    Figure 0007612334000005
Patent Text Reader

Abstract

To provide a controller which can detect a focus quickly with high accuracy.SOLUTION: Provided is a controller (121) for detecting a focus on the basis of a pixel signal obtained by photoelectrically converting the light passing through mutually different pupil areas of an imaging optical system. The controller comprises: an exposure control unit (121a) for exercising exposure control on the basis of an exposure control value that includes an exposure time, imaging sensitivity and aperture value: and an exposure condition acquisition unit (121b) for acquiring an exposure condition for focus detection on the basis of information based on a base line length. The exposure condition is an exposure condition that constitute a first exposure target value in information based on a first base line length and an exposure condition that constitutes a second exposure target value different from the first exposure target value in information based on a second base line length, and the exposure control unit exercises exposure control so that th exposure condition is established.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging device. [Background technology]

[0002] Phase-difference focus detection (Phase-difference AF) is known as an autofocus detection (AF) method for imaging devices. Phase-difference AF is a type of AF often used in digital still cameras, and some of them use an image sensor as a focus detection sensor. Patent Document 1 discloses an image sensor in which some pixels are used as focus detection pixels for performing focus detection by a pupil splitting method. In such a focus detection method, the baseline length of a pair of pupil-split focus detection pixels affects the focus detection accuracy.

[0003] Furthermore, in general, when focus detection is performed, it is necessary to set the exposure conditions (target exposure value) that provide proper exposure. Therefore, if the exposure is not suitable for focus detection, the exposure conditions are set to proper exposure conditions by a photometry means, and focus detection is performed. Patent Document 2 discloses an imaging device that changes the setting of exposure conditions and whether or not to use photometry depending on the reliability of the focus detection result immediately before the release button is half-pressed, so that the focus detection can be quickly transitioned to when the release button is half-pressed to perform focus detection. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-52009 A [Patent Document 2] JP 2013-25132 A Summary of the Invention [Problem to be solved by the invention]

[0005] The focus detection accuracy of phase-difference AF is determined by various factors such as the baseline length determined by the aperture diameter (F-number) of the imaging optical system, the contrast of the subject, or the amount of signal acquired by the exposure setting. The baseline length changes according to the aperture diameter (F-number) of the imaging optical system. In general, the larger the F-number, the smaller the baseline length becomes, and the lower the focus detection accuracy becomes. However, in the conventional technology, the presence or absence of exposure metering and the target exposure value do not take into account the baseline length that affects the focus detection accuracy of phase-difference AF, and the emphasis is placed on acquiring a certain amount of signal by exposure metering. For this reason, even if the situation is such that focus detection is possible if the baseline length is taken into account, there is a possibility that quick and highly accurate focus detection cannot be performed.

[0006] SUMMARY OF THE PRESENT EMBODIMENTS An object of the present invention is to provide a control device, an imaging device, a control method, and a program that are capable of performing quick and highly accurate focus detection. [Means for solving the problem]

[0007] A control device according to one aspect of the present invention is a control device that performs focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, and includes an exposure control unit that performs exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value, and an exposure condition acquisition unit that acquires exposure conditions for the focus detection based on information based on a base line length, the information based on the base line length is information regarding the aperture value and the image height, the exposure condition is an exposure condition that results in a first exposure target value when based on information based on a first base line length, and is an exposure condition that results in a second exposure target value that is different from the first exposure target value when based on information based on a second base line length, the first exposure target value and the second exposure target value are exposure target values ​​for the focus detection, The exposure control unit performs the exposure control so as to satisfy the exposure condition, the first base line length is shorter than the second base line length, the first exposure target value is higher than the second exposure target value, and the information based on the first base line length is ,before The first exposure target value is a value for acquiring a captured image based on the pixel signal. The first Higher than the exposure target value of 3.

[0008] A control device according to another aspect of the present invention is a control device that performs focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, and includes an exposure control unit that performs exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value, a focus adjustment unit that performs focus adjustment control of the imaging optical system, and an exposure change determination unit that determines whether or not to implement the exposure control based on at least current luminance information and information based on a baseline length during the focus adjustment control by the focus adjustment unit, the information based on the base line length is information regarding a conversion coefficient for converting an image shift amount into a defocus amount, The exposure change determination unit has a first exposure determination condition in information based on a first base line length and a second exposure determination condition different from the first exposure determination condition in information based on a second base line length, and the exposure control unit performs the exposure control when the exposure change determination unit determines to perform the exposure control, and the first base line length is shorter than the second base line length and the first exposure determination condition is shorter than the second exposure determination condition. The allowable range of the difference between the current luminance information and the optimum exposure for focus detection is small. This is the judgment condition. Books A control device as another aspect of the invention is a control device that performs focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, and has an exposure control unit that performs exposure control based on exposure control values ​​including exposure time, imaging sensitivity, and aperture value, a focus adjustment unit that performs focus adjustment control of the imaging optical system, and an exposure change determination unit that determines whether or not to perform the exposure control based on at least current luminance information and a lens ID during the focus adjustment control by the focus adjustment unit, wherein the exposure change determination unit sets a larger allowable range for the difference between the current luminance information and the appropriate exposure in the case of a lens in which it is easy to obtain a baseline length than in the case of a lens in which it is difficult to obtain a baseline length, and the exposure control unit performs the exposure control when the exposure change determination unit determines that the exposure control should be performed.

[0009] Other objects and features of the present invention will be described in the following embodiments. Effect of the Invention

[0010] According to the present invention, it is possible to provide a control device, an imaging device, a control method, and a program that are capable of performing quick and highly accurate focus detection. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a block diagram of an imaging device in each embodiment. [Diagram 2] FIG. 2 is a diagram showing a pixel arrangement in each embodiment. [Diagram 3] FIG. 2 is a diagram showing a pixel structure in each embodiment. [Figure 4] 4A and 4B are explanatory diagrams of an image sensor and a pupil division function in each embodiment. [Diagram 5] 4A and 4B are explanatory diagrams of an image sensor and a pupil division function in each embodiment. [Figure 6] 5 is a diagram showing the relationship between a defocus amount and an image shift amount in each embodiment. [Figure 7] 5 is a flowchart showing a focus adjustment process in the first embodiment. [Figure 8] FIG. 4 is a diagram showing a target exposure value in the first embodiment. [Figure 9] 10 is a flowchart showing a focus adjustment process in the second embodiment. [Figure 10] 13 is a timing chart according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0013] In addition, each embodiment has a specific and specific configuration to facilitate understanding and explanation of the invention, but the present invention is not limited to such a specific configuration. For example, the following describes an embodiment in which the present invention is applied to a single-lens reflex digital camera with interchangeable lenses, but the present invention is also applicable to digital cameras and video cameras that do not have interchangeable lenses. In addition, the present invention can be embodied in any electronic device equipped with a camera, such as a mobile phone, a personal computer (such as a laptop, tablet, or desktop type), or a game console.

[0014] (First embodiment) First, a schematic configuration of an image capture device according to a first embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram of an image capture device 100 according to this embodiment. The image capture device 100 is a digital camera system equipped with a camera body and an interchangeable lens (image capture optical system or image forming optical system) that is detachable from the camera body. However, this embodiment is not limited to this, and can also be applied to an image capture device in which the camera body and the lens are integrally configured.

[0015] The first lens group 101 is disposed at the front (on the subject side) of the multiple lens groups constituting the photographing lens (image pickup optical system), and is held in the lens barrel in a state in which it can advance and retreat in the direction of the optical axis OA (optical axis direction). The aperture / shutter (aperture) 102 adjusts the amount of light during photography by adjusting its aperture diameter, and also functions as a shutter for adjusting exposure time during still image photography. The second lens group 103 advances and retreats in the optical axis direction together with the aperture / shutter 102, and has a zoom function for performing a magnification change operation in conjunction with the advance and retreat operation of the first lens group 101. The third lens group 105 is a focus lens group that performs focus adjustment (focus operation) by advancing and retreating in the optical axis direction. The optical low-pass filter 106 is an optical element for reducing false colors and moire in the photographed image.

[0016] The image sensor 107 performs photoelectric conversion of the subject image (optical image) via the image sensor, and is configured with a two-dimensional photosensor such as a CMOS sensor or a CCD sensor and its peripheral circuits, and is disposed on the imaging surface of the image sensor. As the image sensor 107, for example, a two-dimensional single-chip color sensor is used in which a primary color mosaic filter in a Bayer array is formed on-chip on a light receiving pixel having m pixels in the horizontal direction and n pixels in the vertical direction.

[0017] The zoom actuator 111 rotates (drives) a cam barrel (not shown) to move the first lens group 101 to the second lens group 103 along the optical axis direction, thereby performing a magnification change operation. The aperture / shutter actuator 112 controls the aperture / shutter 102 to adjust the amount of light (amount of light for shooting) and also controls the exposure time when shooting a still image. The focus actuator 114 moves the third lens group 105 along the optical axis direction to perform focus adjustment.

[0018] The electronic flash 115 is an illumination device used to illuminate a subject. As the electronic flash 115, a flashlight illumination device equipped with a xenon tube or an illumination device equipped with a continuous-light emitting LED (light-emitting diode) is used. The AF auxiliary light means 116 projects an image of a mask having a predetermined aperture pattern onto the subject via a projection lens. This can improve focus detection capability for dark subjects or low-contrast subjects.

[0019] The CPU 121 is a control device (control means) that controls various aspects of the imaging device 100. The CPU 121 includes an arithmetic unit, a ROM, a RAM, an A / D converter, a D / A converter, and a communication interface circuit. The CPU 121 reads out and executes a specific program stored in the ROM to drive various circuits of the imaging device 100 and control a series of operations such as focus detection (AF), shooting, image processing, and recording. The communication interface circuit is capable of communication using not only cables such as USB and wired LAN, but also wireless technologies such as wireless LAN.

[0020] The CPU 121 is a control device that performs focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of the imaging optical system. The CPU 121 has an exposure control unit 121a, an exposure condition acquisition unit 121b, a focus adjustment unit 121c, and an exposure change determination unit 121d. The exposure control unit 121a performs exposure control based on exposure control values ​​including exposure time, imaging sensitivity, and aperture value. The exposure condition acquisition unit 121b acquires exposure conditions for focus detection based on information based on the base length. The focus adjustment unit 121c controls the focus drive circuit 126 to perform focus adjustment (focus control) of the imaging optical system.

[0021] The CPU 121 stores in its internal memory coefficients (correction value calculation coefficients) for calculating a correction value Kgain required for calculating a defocus amount. A plurality of correction value calculation coefficients are prepared for each of a focus state corresponding to the position of the third lens group 105, a zoom state corresponding to the positions of the first lens group 101 to the second lens group 103, an F-number of the imaging optical system, a set pupil distance of the imaging element, and a pixel size. When performing focus adjustment, the CPU 121 selects an optimal correction value calculation coefficient according to a combination of the focus adjustment state (focus state, zoom state) and aperture value (F-number) of the imaging optical system, the set pupil distance of the imaging element, and the pixel size. Then, the CPU 121 calculates a correction value based on the selected correction value calculation coefficient and the image height of the imaging element.

[0022] In this embodiment, the correction value calculation coefficients are stored in an internal memory of the CPU 121, but the present invention is not limited to this. The correction value calculation coefficients may be stored in a memory provided outside the CPU 121. In addition, in an interchangeable lens type imaging device, an interchangeable lens having an imaging optical system may have a non-volatile memory, and the correction value calculation coefficients may be stored in the memory. In this case, the correction value calculation coefficients may be transmitted to the imaging device according to the focus adjustment state of the imaging optical system.

[0023] An electronic flash control circuit 122 controls the illumination of the electronic flash 115 in synchronization with a photographing operation. An assist light driving circuit 123 controls the illumination of the AF assist light means 116 in synchronization with a focus detection operation. An image sensor driving circuit 124 controls imaging operations such as vertical and horizontal scanning of the image sensor 107, and performs A / D conversion of the acquired image signal and transmits it to the CPU 121. The A / D conversion circuit may be provided within the image sensor 107. An image processing circuit 125 performs processes such as γ (gamma) conversion, color interpolation, and JPEG (Joint Photographic Experts Group) compression of image data output from the image sensor 107.

[0024] A focus driving circuit 126 drives the focus actuator 114 based on the focus detection result to move the third lens group 105 along the optical axis direction, thereby performing focus adjustment. An aperture / shutter driving circuit 128 drives the aperture / shutter actuator 112 to control the aperture diameter of the aperture / shutter 102. A zoom driving circuit 129 drives the zoom actuator 111 in response to the zoom operation of the photographer.

[0025] The display 131 is configured to include, for example, an LCD (liquid crystal display device). The display 131 displays information about the shooting mode of the imaging device 100, a preview image before shooting, a confirmation image after shooting, or a focus state display image at the time of focus detection. The operation unit (operation switch group) 132 is configured to include, for example, a power switch, a release (shooting trigger) switch, a zoom operation switch, and a shooting mode selection switch. The release switch has two switch stages: a half-pressed state (SW1 is ON) and a fully pressed state (SW2 is ON). The recording medium 133 is, for example, a flash memory that is detachable from the imaging device 100, and records the shot image (image data). The operation unit 132 may also include a touch panel or the like, and be operable using the touch panel.

[0026] Next, the pixel array and pixel structure of the image sensor 107 in this embodiment will be described with reference to Fig. 2 and Fig. 3. Fig. 2 is a diagram showing the pixel array of the image sensor 107. Fig. 3 is a diagram showing the pixel structure of the image sensor 107, with Fig. 3(a) showing a plan view of pixel 200G of the image sensor 107 (as viewed from the +z direction) and Fig. 3(b) showing a cross-sectional view of line aa in Fig. 3(a) (as viewed from the -y direction).

[0027] 2 shows a pixel array (array of imaging pixels) of the image sensor (two-dimensional CMOS sensor) 107 in an area of ​​4 columns x 4 rows. In this embodiment, each imaging pixel (pixels 200R, 200G, 200B) is composed of two sub-pixels 201, 202 (two focus detection pixels). For this reason, the sub-pixel array is shown in an area of ​​8 columns x 4 rows in FIG.

[0028] As shown in FIG. 2, in the pixel group 200 of 2 columns x 2 rows, the pixels 200R, 200G, and 200B are arranged in a Bayer array. That is, in the pixel group 200, the pixel 200R having the spectral sensitivity of R (red) is arranged at the upper left, the pixel 200G having the spectral sensitivity of G (green) is arranged at the upper right and lower left, and the pixel 200B having the spectral sensitivity of B (blue) is arranged at the lower right. Each of the pixels 200R, 200G, and 200B (each imaging pixel) is composed of sub-pixels 201 (first focus detection pixel) and sub-pixels 202 (second focus detection pixel) arranged in 2 columns x 1 row. The sub-pixel 201 is a pixel that receives a light flux that has passed through a first pupil partial region of the imaging optical system. The sub-pixel 202 is a pixel that receives a light flux that has passed through a second pupil partial region of the imaging optical system. The sub-pixels 201 constitute a first pixel group, and the sub-pixels 202 constitute a second pixel group. The image sensor 107 is configured by arranging a large number of 4 columns×4 rows of image pixels (8 columns×4 rows of sub-pixels) on its surface, and outputs an image signal (sub-pixel signal or focus detection signal).

[0029] As shown in Fig. 3(b), the pixel 200G of this embodiment is provided with a microlens 305 for converging incident light on the light receiving surface side of the pixel. A plurality of microlenses 305 are arranged two-dimensionally, and are disposed at positions a predetermined distance away from the light receiving surface in the z-axis direction (direction of the optical axis OA). The pixel 200G also has N H Division (2 divisions), N in y direction V A divided (single-division) photoelectric conversion unit 301 and photoelectric conversion unit 302 are formed. The photoelectric conversion unit 301 and photoelectric conversion unit 302 correspond to the sub-pixels 201 and 202, respectively. In this manner, the image sensor 107 has a plurality of photoelectric conversion units for one microlens, and the microlenses are arranged two-dimensionally. The photoelectric conversion unit 301 and photoelectric conversion unit 302 are each configured as a photodiode with a pin structure in which an intrinsic layer is sandwiched between a p-type layer and an n-type layer. If necessary, the intrinsic layer may be omitted and configured as a pn junction photodiode.

[0030] In pixel 200G (each pixel), a G (green) color filter 306 is provided between microlens 305 and photoelectric conversion unit 301 and photoelectric conversion unit 302. Similarly, in pixels 200R and 200B (each pixel), R (red) and B (blue) color filters 306 are provided between microlens 305 and photoelectric conversion unit 301 and photoelectric conversion unit 302, respectively. If necessary, the spectral transmittance of color filter 306 can be changed for each subpixel, or color filters may be omitted.

[0031] As shown in FIG. 3, light incident on pixel 200G (200R, 200B) is collected by microlens 305, dispersed by G color filter 306 (R, B color filter 306), and then received by photoelectric conversion unit 301 and photoelectric conversion unit 302. In photoelectric conversion unit 301 and photoelectric conversion unit 302, pairs of electrons and holes are generated according to the amount of received light, and after they are separated by a depletion layer, negatively charged electrons are accumulated in the n-type layer. Meanwhile, holes are discharged to the outside of image sensor 107 through a p-type layer connected to a constant voltage source (not shown). Electrons accumulated in the n-type layers of photoelectric conversion unit 301 and photoelectric conversion unit 302 are transferred to a capacitance unit (FD) through a transfer gate based on scanning control by image sensor drive circuit 124, and converted into a voltage signal.

[0032] Next, the pupil division function of the image sensor 107 will be described with reference to Fig. 4. Fig. 4 is an explanatory diagram of the pupil division function of the image sensor 107, showing pupil division in one pixel section. Fig. 4 shows a cross-sectional view of the aa cross section of the pixel structure shown in Fig. 3(a) seen from the +y side, and the exit pupil plane of the imaging optical system. In Fig. 4, the x-axis and y-axis of the cross-sectional view are inverted with respect to the x-axis and y-axis of Fig. 3, respectively, to correspond to the coordinate axes of the exit pupil plane.

[0033] In FIG. 4, a pupil partial region (first pupil partial region) 501 of a subpixel (first focus detection pixel) 201 is in a substantially conjugate relationship with a light receiving surface of a photoelectric conversion unit 301 whose center of gravity is decentered in the -x direction via a microlens 305. Therefore, the pupil partial region 501 represents a pupil region that can receive light by the subpixel 201. The center of gravity of the pupil partial region 501 of the subpixel 201 is decentered on the +X side on the pupil plane. Moreover, a pupil partial region (second pupil partial region) 502 of a subpixel (second focus detection pixel) 202 is in a substantially conjugate relationship with a light receiving surface of a photoelectric conversion unit 302 whose center of gravity is decentered in the +x direction via a microlens 305. Therefore, the pupil partial region 502 represents a pupil region that can receive light by the subpixel 202. The center of gravity of the pupil partial region 502 of the subpixel 202 is decentered on the -X side on the pupil plane. The pupil region 500 is a pupil region that can receive light in the entire pixel 200G when all the photoelectric conversion units 301, 302 (sub-pixels 201, 202) are combined.

[0034] The difference between the center of gravity of the pupil partial region 501 of the subpixel 201 and the center of gravity of the pupil partial region 502 of the subpixel 202 corresponds to the base line length. The longer the base line length, the higher the performance of separating a pair of signals. Here, the larger the aperture diameter, the longer the base line length, and therefore the smaller the F-number, the higher the focus detection accuracy. On the other hand, the smaller the aperture diameter, the shorter the base line length, and therefore the larger the F-number, the lower the focus detection accuracy.

[0035] Next, the correspondence between the image sensor 107 and pupil division will be described with reference to Fig. 5. Fig. 5 is an explanatory diagram of the image sensor 107 and the pupil division function. Light beams that have passed through different pupil partial regions 501 and 502 of the pupil region of the imaging optical system are incident on the imaging surface 800 of the image sensor 107 at different angles to each pixel of the image sensor 107, and are received by sub-pixels 201 and 202 divided into 2 x 1. In this embodiment, an example in which the pupil region is pupil-divided into two in the horizontal direction is described, but the present invention is not limited to this, and pupil division may be performed in the vertical direction as necessary.

[0036] In this embodiment, the image sensor 107 has a first focus detection pixel that receives a light beam passing through a first pupil partial region of the image sensor (photographing lens). The image sensor 107 also has a second focus detection pixel that receives a light beam passing through a second pupil partial region different from the first pupil partial region of the image sensor. The image sensor 107 also has a plurality of imaging pixels arranged to receive a light beam passing through a pupil region that is a combination of the first and second pupil partial regions of the image sensor. In this embodiment, each imaging pixel (pixel 200) is composed of a first focus detection pixel (sub-pixel 201) and a second focus detection pixel (sub-pixel 202). If necessary, the imaging pixel, the first focus detection pixel, and the second focus detection pixel may each be composed of different pixels. In this case, the first focus detection pixel and the second focus detection pixel are arranged partially (discretely) in a part of the image sensor array.

[0037] In this embodiment, the imaging device 100 performs focus detection by collecting light receiving signals from the first focus detection pixel (sub-pixel 201) of each pixel of the image sensor 107 to generate a first focus detection signal, and collecting light receiving signals from the second focus detection pixel (sub-pixel 202) of each pixel to generate a second focus detection signal. The imaging device 100 also adds (sums up) the signals from the first focus detection pixel and the second focus detection pixel for each pixel of the image sensor 107 to generate an imaging signal (captured image) with a resolution of the effective pixel number N.

[0038] Next, the relationship between the defocus amount and the image shift amount of the first focus detection signal acquired from the sub-pixel 201 of the image sensor 107 and the second focus detection signal acquired from the sub-pixel 202 will be described with reference to Fig. 6. Fig. 6 is a relationship diagram between the defocus amount and the image shift amount. In Fig. 6, the image sensor 107 is disposed on an imaging plane 800, and similarly to Figs. 4 and 5, the exit pupil of the imaging optical system is divided into two pupil partial regions 501 and 502.

[0039] The defocus amount d is defined as |d|, the distance from the imaging position of the subject to the imaging plane 800, a front-focus state where the imaging position is closer to the subject than the imaging plane 800, a negative sign (d<0), and a back-focus state where the imaging position is on the opposite side of the subject than the imaging plane 800, a positive sign (d>0). In a focused state where the imaging position of the subject is on the imaging plane 800 (focused position), the defocus amount d=0 is established. In FIG. 6, a subject 801 in a focused state (d=0) and a subject 802 in a front-focus state (d<0) are shown. The front-focus state (d<0) and the back-focus state (d>0) are collectively referred to as a defocus state (|d|>0).

[0040] In the front focus state (d<0), the light beam from the subject 802 that passes through the pupil partial region 501 (or the pupil partial region 502) is once focused. After that, the light beam spreads to a width Γ1 (Γ2) centered on the center of gravity position G1 (G2) of the light beam, and becomes a blurred image on the imaging surface 800. The blurred image is received by the sub-pixel 201 (sub-pixel 202) constituting each pixel arranged on the image sensor 107, and a first focus detection signal (second focus detection signal) is generated. Therefore, the first focus detection signal (second focus detection signal) is recorded at the center of gravity position G1 (G2) on the imaging surface 800 as a subject image in which the subject 802 is blurred to a width Γ1 (Γ2). The blur width Γ1 (Γ2) of the subject image increases approximately in proportion to the increase in the magnitude |d| of the defocus amount d. Similarly, the magnitude |p| of the image shift amount p (= the difference G1-G2 in the center of gravity positions of the light beams) of the subject image between the first focus detection signal and the second focus detection signal also increases roughly in proportion to the increase in the magnitude |d| of the defocus amount d. The same is true for the back-focus state (d>0), but the direction of the image shift of the subject image between the first focus detection signal and the second focus detection signal is opposite to that in the front-focus state.

[0041] Therefore, in this embodiment, it is possible to calculate the defocus amount d based on the conversion coefficient K for converting the image shift amount p obtained in advance into the defocus amount d, and the image shift amount p of the subject image between the first focus detection signal and the second focus detection signal. Then, when the defocus amount d=0, the focus is achieved.

[0042] The conversion coefficient K is proportional to the inverse of the baseline length, so it is information based on the baseline length. When calculating the image shift amount p, it is affected by the variation error due to the S / N of the acquired signal. If the variation error of the image shift amount p is constant, the smaller the conversion coefficient K, the smaller the variation. In other words, under conditions where the F-number is small and the baseline length is long, the focus detection variation is smaller and the focusing accuracy is high. However, the focus detection accuracy of phase difference AF is not determined only by the baseline length, but is also affected by the contrast of the subject and the amount of signal acquired by the exposure setting. In particular, if the S / N of the signal is increased by acquiring a large signal, the variation error when calculating the image shift amount p is reduced. Therefore, under conditions where the F-number is small and the baseline length is long, the signal amount may be small, but under conditions where the F-number is large and the baseline length is short, it is preferable that the signal amount is large. Such a tendency is more noticeable for low-contrast subjects, which are difficult to improve the focus detection accuracy.

[0043] Next, the flow of focus adjustment processing during live view in this embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the focus adjustment processing in this embodiment. Each step in Fig. 7 is mainly executed by the CPU 121.

[0044] The focus adjustment process starts when the release button is half-pressed during live view. First, in step S701, the CPU 121 acquires the focus detection result. If the CPU 121 acquires the focus detection result during standby, the result immediately before the release button was half-pressed may be used. Note that the focus adjustment process is not limited to being started in response to the release button being half-pressed, and may be started by pressing a button to which an AF function is assigned.

[0045] Next, in step S702, CPU 121 determines whether or not the focus detection result acquired in step S701 is reliable (whether or not it is reliable). If it is determined that the focus detection result is reliable, the process proceeds to step S707. In step S707, CPU 121 performs lens drive (focus control) based on the focus detection result. On the other hand, if it is determined in step S702 that the focus detection result is unreliable, the process proceeds to step S703. In step S703, CPU 121 acquires luminance information by photometry.

[0046] Next, in step S704, the CPU 121 (exposure condition acquisition unit 121a) acquires the AF exposure conditions (exposure conditions suitable for AF). As described above, the focus detection accuracy of phase difference AF depends on the base line length. For this reason, the imaging device 100 of this embodiment has a condition setting table that sets the exposure conditions (exposure target value) suitable for AF according to the F-number, as shown in FIG. 8. FIG. 8 is a diagram showing general exposure conditions (exposure target value) normalized as suitable exposure (image) and suitable exposure conditions for AF as suitable exposure (AF). In FIG. 8, the horizontal axis indicates the F-number, and the vertical axis indicates the exposure ratio. In this embodiment, the S / N ratio of the signal is increased by obtaining a larger signal than before in a range darker than F2.8, which is the F-number at which it is difficult to obtain a base line length.

[0047] Next, in step S705, the CPU 121 (exposure control unit 121a) sets AF exposure conditions (exposure conditions that realize an exposure target value suitable for AF). In this embodiment, the exposure conditions are exposure time, imaging sensitivity, and aperture value (F value), but are not limited to these. The CPU 121 determines the exposure conditions by a program diagram prepared in advance based on the brightness information acquired in step S703 and the AF exposure conditions acquired in step S704. Table 1 shows, as an example, a comparison in which a conventional suitable exposure (image) is an exposure time of 1 / 350, an imaging sensitivity of 100, and an aperture value of F5.6 for a lens with an open F5.6. As shown in FIG. 8, the AF exposure conditions (AF exposure target value) in this embodiment are 1.4 times the suitable exposure (image) at F5.6, so the suitable exposure (AF) condition is a state in which the exposure time is 1.4 times longer. Note that in Table 1, adjustment is made with the exposure conditions, but adjustment may be made with the imaging sensitivity.

[0048] [Table 1]

[0049] Next, in step S706, CPU 121 acquires a focus detection result based on the AF exposure condition (AF exposure target value) set in step S705. If a reliable focus detection result is acquired, in step S707 CPU 121 performs lens drive (focus control) based on the focus detection result acquired in step S706. On the other hand, if a reliable focus detection result is not acquired, in step S707 CPU 121 performs lens drive as a search.

[0050] If the subject brightness changes during the lens drive in step S707, the CPU 121 (exposure control unit 121a) may perform exposure control by photometry during the focus adjustment process. In this case, it is preferable to perform exposure control suitable for AF.

[0051] As described above, in this embodiment, the exposure condition acquisition unit 121b acquires the exposure conditions for focus detection based on information based on the base line length. The exposure conditions are exposure conditions that result in a first exposure target value based on information based on the first base line length, and exposure conditions that result in a second exposure target value different from the first exposure target value based on information based on the second base line length. The exposure control unit 121a then performs exposure control so as to obtain the exposure conditions acquired by the exposure condition acquisition unit 121b.

[0052] Preferably, the first base line length is shorter than the second base line length, and the first exposure target value is higher than the second exposure target value (i.e., the more difficult it is to obtain a base line length based on information based on the base line length, the higher the exposure of the exposure condition suitable for focus detection). Also preferably, the exposure condition acquisition unit 121b acquires the exposure condition based on information based on the contrast of the subject. Also preferably, the exposure control unit 121a performs exposure control based on a change in subject brightness while the focus adjustment unit 121c is performing focus adjustment. Also preferably, the information based on the base line length is a value proportional to the base line length or a value proportional to the reciprocal of the base line length. Also preferably, the information based on the base line length is an aperture value (F value), an image height, or a lens ID.

[0053] According to this embodiment, highly accurate focus detection can be performed by setting exposure conditions (exposure target value) based on information based on the baseline length. In this embodiment, since there is a correlation between the baseline length and Fno (aperture value), the focusing accuracy can be improved by changing the exposure conditions according to Fno as information based on the baseline length. The focusing accuracy of phase difference AF also depends on the contrast of the subject. For this reason, for example, when the contrast is high, the conventional suitable exposure (image) conditions may be used, and when the contrast is low, the suitable exposure conditions for AF may be used. For calculating the contrast of the subject, there is a method of looking at the luminance change in the imaging signal or the spatial frequency components of the subject.

[0054] Second Embodiment Next, a second embodiment of the present invention will be described. In an imaging device equipped with an electronic display device such as a rear LCD or an electronic viewfinder, an electric signal received by an imaging element is displayed on the electronic display device. The electric signal may also serve as a signal for image plane phase difference AF. For this reason, if the exposure setting is changed when the focus adjustment process is started by half-pressing the release button, the electronic display device may become brighter or darker, impairing visibility. In this embodiment, the condition (exposure judgment condition) for judging whether exposure control needs to be performed is changed based on the value of the conversion coefficient K as information based on the baseline length, thereby realizing highly accurate phase difference AF with good visibility.

[0055] The visibility issue caused by the exposure setting being changed when the focus adjustment process starts can be improved by reducing the frequency of exposure changes. For example, even if the exposure just before the start of the focus adjustment process is two stops lower than the optimum, the exposure change can be omitted and the focus adjustment process can be started if distance measurement is possible, thereby avoiding the deterioration of visibility.

[0056] As mentioned above, the baseline length has a large effect on the distance measurement performance of phase-difference AF. If the baseline length is long, distance measurement is possible even with low exposure. On the other hand, if the baseline length is not long, distance measurement may not be possible if the exposure remains low.

[0057] Therefore, in this embodiment, the condition (exposure determination condition) for determining whether or not exposure control should be performed is changed based on the value of the conversion coefficient K as information based on the base line length, thereby achieving highly accurate AF with good visibility. More specifically, the smaller the value of the conversion coefficient K, the more accurate phase difference AF with good visibility is achieved by allowing distance measurement at exposure lower than the optimum.

[0058] The flow of focus adjustment processing during live view in this embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the focus adjustment processing in this embodiment. Each step in Fig. 9 is mainly executed by the CPU 121.

[0059] During live view, when the release button is half-pressed or the like, the focus adjustment process starts. First, in step S901, the CPU 121 acquires the focus detection result. If the CPU 121 has acquired the focus detection result during standby, the result immediately before the release button is half-pressed may be used. Note that the focus adjustment process is not limited to starting in response to a half-press of the release button, and may also start by pressing a button to which the AF function is assigned.

[0060] Subsequently, in step S902, the CPU 121 determines whether the focus detection result obtained in step S901 is reliable (whether it is reliable). If it is determined that the focus detection result is reliable, the process proceeds to step S907. In step S907, the CPU 121 performs lens driving (focus control) based on the focus detection result. On the other hand, if it is determined in step S902 that the focus detection result is not reliable, the process proceeds to step S903. In step S903, the CPU 121 acquires luminance information by photometry.

[0061] Subsequently, in step S904, the CPU 121 acquires the exposure control determination condition (the determination condition for whether to change the exposure). In the present embodiment, the exposure control determination condition is changed based on the conversion coefficient K. The CPU 121 acquires, for example, the conditions shown in Table 2, and acquires the condition for whether to perform exposure change based on the relationship between the conversion coefficient K and the threshold value Thr0. When the conversion coefficient K is small (K < Thr0), since it is a condition where the baseline length can be taken long, even if the difference between the current luminance information and the appropriate exposure (AF) is large, it is allowed. On the other hand, when the conversion coefficient K is large (K ≧ Thr0), since it is a condition where the baseline length cannot be taken long, the allowable width of the difference between the current luminance information and the appropriate exposure (AF) is reduced.

[0062]

Table 2

[0063] Next, in step S905, CPU 121 (exposure change determination unit 121d) determines whether or not to change the exposure. That is, CPU 121 determines whether or not to change the exposure based on the luminance information acquired in step S903 and the conversion coefficient K and exposure control determination condition acquired in step S904. If CPU 121 determines not to change the exposure, the process proceeds to step S907, where it drives the lens (search drive) while maintaining the exposure. On the other hand, if CPU 121 determines to change the exposure, the process proceeds to step S906. In step S906, CPU 121 performs exposure control to change the exposure to an appropriate exposure (AF). Then, in step S907, CPU 121 drives the lens.

[0064] As described above, the exposure change determination unit 121d determines whether or not exposure control should be performed based on at least the current brightness information and the information based on the base line length during focus adjustment by the focus adjustment unit 121c. The exposure change determination unit 121d has a first exposure determination condition based on the information based on the first base line length, and a second exposure determination condition different from the first exposure determination condition based on the information based on the second base line length. When the exposure change determination unit 121d determines that exposure control should be performed, the exposure control unit 121a performs exposure control. Preferably, the first base line length is shorter than the second base line length, and the first exposure determination condition is a determination condition for matching the exposure condition to a more suitable exposure condition for focus detection than the second exposure determination condition.

[0065] According to this embodiment, by performing the focus detection process as described above, unnecessary exposure changes can be reduced, and highly accurate phase difference AF with good visibility can be realized. In addition, considering that the depth of field changes depending on the aperture value, the threshold value Thr0 may be changed based on the aperture value. In addition, the exposure conditions include the exposure time (tv), the imaging sensitivity (ISO), and the aperture value (Fno), and even if each exposure condition is changed, the exposure is maintained unless the exposure is changed. For example, Tv=1 / 240, ISO=100, Fno=2.0 and Tv=1 / 60, ISO=100, Fno=4.0 are the same exposure target value.

[0066] The imaging device 100 of this embodiment uses information based on the base line length to set the presence or absence of photometry and exposure conditions (exposure target value), thereby enabling quick and highly accurate focus detection. The information based on the base line length is Fno in the first embodiment and conversion coefficient K in this embodiment, but is not limited to these, and for example, the determination may be made based on the base line length itself. Also, image height and lens ID can be used as information based on the base line length. Although the base line length is determined by the relationship between the imaging optical system and the imaging element, the higher the image height is, the more difficult it is to obtain the base line length due to the influence of pupil shift, so the presence or absence of photometry and the setting of the exposure condition may be changed depending on the image height. Also, in the case of an interchangeable lens system, since some lenses have a base line length that is easy to obtain and others that are difficult to obtain, the presence or absence of photometry and the setting of the exposure condition may be changed using the lens ID as information based on the base line length.

[0067] (Third embodiment) Next, a third embodiment of the present invention will be described. In the first and second embodiments, a so-called one-shot mode in which the user half-presses the release button or the like to execute focus detection has been described. However, the present invention is not limited to one-shot, as it realizes quick and highly accurate AF by considering the baseline length in exposure control during AF. The present invention is also applicable to each mode provided in the imaging device during continuous shooting, video standby, video recording, etc. In this embodiment, an example of applying the present invention during continuous shooting will be described.

[0068] Fig. 10 is an example of a timing chart during continuous shooting. In Fig. 10, a high-resolution first image is used to record a still image. A lower-resolution second image than the first image is displayed on an electronic display device such as a rear LCD or an electronic viewfinder, and is used as a focus detection image for focus detection (focus adjustment processing).

[0069] It is preferable that the first image used for recording is exposed at an appropriate exposure (image), and the second image used for focus detection is exposed at an appropriate exposure (AF). In this embodiment, similar to the first embodiment, AF is performed at the target exposure value shown in FIG. 5 using Fno as information based on the base line length. Therefore, when continuous shooting is performed under conditions brighter than F2.8, the target exposure values ​​of the first image and the second image are the same. On the other hand, when stopping down below F2.8, the exposure of the second image is higher than that of the first image.

[0070] As shown in Fig. 10, when the accumulation of the second image for focus detection is sandwiched between the first images used for recording, the second image can be set to an appropriate exposure (AF) to enable highly accurate focus detection even during continuous shooting. Depending on the mode, the first image may serve as both a still image for recording and an image for focus detection. In this case, it is preferable to give priority to the exposure of the image for recording and expose it at an appropriate exposure (image). As for movies, frequent exposure changes during movie recording may degrade the quality, so there is also a method of setting the exposure to an appropriate exposure (AF) during movie standby and setting the exposure to an appropriate exposure (image) during movie recording.

[0071] The image capture device 100 of each embodiment uses information based on the baseline length to set whether or not to perform photometry and the target exposure value, thereby enabling quick and highly accurate focus detection. Note that the present invention is applicable to all products capable of performing phase difference AF, and is also applicable to distance measurement sensors using a phase difference structure other than image capture devices.

[0072] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0073] According to each embodiment, it is possible to set whether or not to perform photometry and the target exposure value using information based on the baseline length. Therefore, according to each embodiment, it is possible to provide a control device, an image capture device, a control method, and a program that are capable of rapid and highly accurate focus detection.

[0074] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0075] 121 CPU (control unit) 121a Exposure control section 121b Exposure condition acquisition section

Claims

1. A control device that performs focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, an exposure control unit that performs exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value; an exposure condition acquisition unit that acquires an exposure condition for the focus detection based on information based on a base line length, the information based on the base line length is information regarding the aperture value and the image height, the exposure condition is an exposure condition that results in a first exposure target value when based on information based on a first base line length, and is an exposure condition that results in a second exposure target value that is different from the first exposure target value when based on information based on a second base line length, the first exposure target value and the second exposure target value are exposure target values ​​for the focus detection, the exposure control unit performs the exposure control so as to satisfy the exposure condition; the first base length is shorter than the second base length; the first exposure target value is higher than the second exposure target value; The control device, characterized in that, in the information based on the first baseline length, the first exposure target value is higher than a third exposure target value for acquiring a captured image based on the pixel signal.

2. The control device according to claim 1 , wherein the exposure condition acquisition unit acquires the exposure condition on the basis of information based on a contrast of a subject.

3. The imaging optical system further includes a focus adjustment unit that performs focus adjustment control of the imaging optical system, 3. The control device according to claim 1, wherein the exposure control section performs the exposure control based on a change in subject luminance while the focus adjustment section is performing the focus adjustment control.

4. A control device that performs focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, an exposure control unit that performs exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value; a focus adjustment unit that performs focus adjustment control of the imaging optical system; and an exposure change determination unit that determines whether or not the exposure control needs to be performed based on at least current luminance information and information based on a base line length when the focus adjustment unit performs the focus adjustment control, the information based on the base line length is information regarding a conversion coefficient for converting an image shift amount into a defocus amount, the exposure change determination unit has a first exposure determination condition in information based on a first base line length, and a second exposure determination condition different from the first exposure determination condition in information based on a second base line length; the exposure control unit performs the exposure control when the exposure change determination unit determines that the exposure control is to be performed; the first base length is shorter than the second base length; A control device according to claim 1, wherein the first exposure determination condition is a determination condition having a smaller allowable range for the difference between the current brightness information and the optimum exposure for focus detection than the second exposure determination condition.

5. 5. The control device according to claim 1, wherein the information based on the baseline length is a value proportional to the baseline length or a value proportional to the reciprocal of the baseline length.

6. A control device that performs focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, an exposure control unit that performs exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value; a focus adjustment unit that performs focus adjustment control of the imaging optical system; and an exposure change determination unit that determines whether or not the exposure control needs to be performed based on at least current luminance information and a lens ID during the focus adjustment control by the focus adjustment unit, the exposure change determination unit sets a larger allowable range for a difference between the current luminance information and an appropriate exposure in the case of a lens for which a baseline length is easily obtained than in the case of a lens for which a baseline length is difficult to obtain; The control device, wherein the exposure control unit performs the exposure control when the exposure change determination unit determines that the exposure control is to be performed.

7. an image sensor that performs photoelectric conversion on light passing through different pupil regions of an image pickup optical system and outputs pixel signals; 7. An imaging apparatus comprising: the control device according to claim 1, which performs focus detection based on the pixel signal.

8. A control method for performing focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, comprising: an exposure control step of performing exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value; and acquiring an exposure condition for the focus detection based on information on a base line length, the information based on the base line length is information regarding the aperture value and the image height, the exposure condition is an exposure condition that results in a first exposure target value when based on information based on a first base line length, and is an exposure condition that results in a second exposure target value that is different from the first exposure target value when based on information based on a second base line length, the first exposure target value and the second exposure target value are exposure target values ​​for the focus detection, In the exposure control step, the exposure control is performed so as to satisfy the exposure condition. the first base length is shorter than the second base length; the first exposure target value is higher than the second exposure target value; A control method according to claim 1, wherein, in the information based on the first baseline length, the first exposure target value is higher than a third exposure target value for acquiring an image based on the pixel signal.

9. A control method for performing focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, comprising: an exposure control step of performing exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value; a focus adjustment step of performing focus adjustment control of the imaging optical system; and a determination step of determining whether or not the exposure control needs to be performed based on at least current luminance information and information based on a baseline length during the focus adjustment control, the information based on the base line length is information regarding a conversion coefficient for converting an image shift amount into a defocus amount, In the determination step, the necessity of implementation is determined according to a first exposure determination condition for the information based on a first base line length, and the necessity of implementation is determined according to a second exposure determination condition different from the first exposure determination condition for the information based on a second base line length; When it is determined in the determination step that the exposure control is to be performed, the exposure control is performed in the exposure control step; the first base length is shorter than the second base length; A control method according to claim 1, wherein the first exposure determination condition is a determination condition having a smaller tolerance for the difference between the current brightness information and the optimum exposure for focus detection than the second exposure determination condition.

10. A control method for performing focus detection based on pixel signals obtained by photoelectrically converting light passing through different pupil regions of an imaging optical system, comprising: an exposure control step of performing exposure control based on exposure control values ​​including an exposure time, an imaging sensitivity, and an aperture value; a focus adjustment step of performing focus adjustment control of the imaging optical system; and an exposure change determination step of determining whether or not the exposure control needs to be performed based on at least current luminance information and a lens ID during the focus adjustment control by the focus adjustment step, In the exposure change determination step, a width for allowing a difference between the current luminance information and the appropriate exposure is set larger in the case of a lens for which a baseline length is easily obtained than in the case of a lens for which a baseline length is difficult to obtain; a step of controlling exposure by performing the exposure control when it is determined in the step of determining whether the exposure change is to be performed;

11. A program causing a computer to execute the control method according to any one of claims 8 to 10.

Citation Information

Patent Citations

  • Focus detection device, focus detection method and imaging apparatus

    JP2008052009A

  • Digital camera and recording medium

    JP2008134312A

  • Imaging apparatus

    JP2012247722A

  • Focus adjustment device and imaging apparatus

    JP2013025132A

  • Imaging device and control method of the same

    JP2015068959A