Imaging device

Abstract

There is a demand for improved focus detection accuracy in cameras that use the movement amount of an image stabilization lens to correct the defocus amount calculated based on signals from focus detection pixels. [Solution] The imaging device includes an imaging unit having a first pixel 11 that outputs a first signal based on charges accumulated by photoelectrically converting a first light beam that has passed through a first region of the optical system, and a second pixel 12 that outputs a second signal based on charges accumulated by photoelectrically converting a second light beam that has passed through a second region of the optical system; a moving unit that moves the imaging unit; and a detection unit that detects the focus position of the optical system based on distance information of the first pixel and the second pixel from the optical axis of the optical system, calculated based on position information of the imaging unit moved by the moving unit during the charge accumulation time of the first pixel and the second pixel, and the first signal and the second signal output from the imaging unit.

Description

[Technical field]

[0001] The present invention relates to an imaging device. [Background technology]

[0002] A camera is known that has an image stabilization unit that corrects camera shake by moving an image sensor or an image stabilization lens, and corrects the defocus amount calculated based on signals from focus detection pixels using the amount of movement of the image sensor or the image stabilization lens (Patent Document 1). There has been a demand for improving the accuracy of focus detection. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2015-200847 Summary of the Invention

[0004] According to a first aspect, an imaging device includes: are disposed in the first region and the second region of the imaging surface, optical system The first pupil area of General The transmitted light is photoelectrically converted and a signal based on the accumulated charge is output. Multiple 1st Pixels and a plurality of second pixels that are arranged in each of the first region and the second region and output a signal based on electric charges accumulated by photoelectrically converting light that has passed through a second pupil region of the optical system. An imaging unit; A moving unit that moves the imaging unit; A detection unit that detects the focus of the optical system. a charge accumulation time of the first pixel and the second pixel in the first region is different from a charge accumulation time of the first pixel and the second pixel in the second region, and the detection unit selects position information of the imaging unit corresponding to the charge accumulation time of the first pixel and the second pixel in a selected region of the first region and the second region from a plurality of pieces of position information, and performs focus detection of the optical system based on the selected position information of the imaging unit, distance information of the first pixel and the second pixel from the optical axis of the optical system during the charge accumulation time of the first pixel and the second pixel in the selected region, and signals output from the first pixel and the second pixel. . According to a second aspect, an imaging device includes an imaging unit including a plurality of first pixels arranged in a first region and a second region of an imaging surface, the first pixels outputting signals based on charges accumulated by photoelectrically converting light passing through a first pupil region of an optical system, and a plurality of second pixels arranged in the first region and the second region, the second pixels outputting signals based on charges accumulated by photoelectrically converting light passing through a second pupil region of the optical system, a moving unit moving the imaging unit, and a detection unit performing focus detection of the optical system, wherein a charge accumulation time of the first pixels and the second pixels in the first region is different from a charge accumulation time of the first pixels and the second pixels in the second region, the detection unit selecting position information of the imaging unit corresponding to the charge accumulation time of the first pixels and the second pixels in a selected region of the first region and the second region from a plurality of position information, and performing focus detection of the optical system based on the selected position information of the imaging unit, distance information of the selected region from the optical axis of the optical system during the charge accumulation time of the first pixels and the second pixels in the selected region, and signals output from the first pixels and the second pixels. [Brief description of the drawings]

[0005] [Figure 1] 1 is a diagram illustrating an example of a configuration of an imaging device according to a first embodiment. [Diagram 2] 2 is a diagram showing a focus detection area on an imaging surface of an image sensor according to the first embodiment. FIG. [Diagram 3] 2 is a diagram showing an example of pixel arrangement in a focus detection area of ​​the image sensor according to the first embodiment. FIG. [Figure 4]1 is a diagram illustrating an example of a pixel configuration of an image sensor according to a first embodiment. [Diagram 5] 2A to 2C are diagrams for explaining image blur correction by the imaging device according to the first embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of processing in the imaging device according to the first embodiment. [Figure 7] FIG. 2 is a diagram showing a small region within an imaging element according to the first embodiment. [Figure 8] 13 is a diagram showing an example of the configuration of focus detection pixels of an image sensor according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] (First embodiment) 1 is a diagram showing an example of the configuration of a camera 1, which is an example of an imaging device according to a first embodiment. The camera 1 is made up of a camera body 2 and an interchangeable lens 3. In this specification, the camera 1 having the camera body 2 and the interchangeable lens 3 is also called a camera system.

[0007] The camera body 2 is provided with a body side mount section 201 to which the interchangeable lens 3 is attached. The interchangeable lens 3 is provided with a lens side mount section 301 which is attached to the camera body 2. The interchangeable lens 3 is detachably attached to the camera body 2 by the lens side mount section 301 and the body side mount section 201. The lens side mount section 301 and the body side mount section 201 are provided with a lens side connection section 302 and a body side connection section 202 each having a group of communication terminals. The lens side connection section 302 and the body side connection section 202 are each provided with a plurality of terminals such as a terminal for a clock signal, a terminal for a data signal, and a terminal for power supply.

[0008] When the interchangeable lens 3 is attached to the camera body 2, multiple terminals provided on the body side connection unit 202 are electrically connected to multiple terminals provided on the corresponding lens side connection unit 302. This enables power to be supplied from the camera body 2 to the interchangeable lens 3 and communication between the camera body 2 and the interchangeable lens 3.

[0009] Light from a subject is incident in the positive direction of the Z axis in Figure 1. Also, as shown in the coordinate axes in Figure 1, the direction towards the viewer on the paper perpendicular to the Z axis is the positive X axis, and the direction downward on the paper perpendicular to the Z and X axes is the positive Y axis. In the following figures, the coordinate axes may be shown so that the orientation of each figure can be understood based on the coordinate axes in Figure 1.

[0010] The interchangeable lens 3 includes a photographing optical system (imaging optical system) 31, a lens control unit 32, and a lens memory 33. The photographing optical system 31 includes a plurality of lenses including a zoom lens (variable magnification lens) 31a that changes the focal length and a focus lens (focus adjustment lens) 31b, and an aperture 31c, and forms a subject image on an imaging surface 22a of an imaging element 22 of the camera body 2. The imaging surface 22a of the imaging element 22 is a surface on which a photoelectric conversion unit (described later) is disposed, or a surface on which a microlens is disposed.

[0011] The lens control unit 32 is configured with a processor such as a CPU, FPGA, or ASIC, and a memory such as a ROM or RAM, and controls each part of the interchangeable lens 3 based on a control program. The lens control unit 32 controls the driving of the zoom lens 31a, the focus lens 31b, and the aperture 31c based on a signal output from the body control unit 210 of the camera body 2. When a signal related to the moving direction and the moving amount of the focus lens 31b is input from the body control unit 210, the lens control unit 32 moves the focus lens 31b along the optical axis OA1 based on the signal to adjust the focal position of the photographing optical system 31. In addition, the lens control unit 32 controls the position of the zoom lens 31a and the opening diameter of the aperture 31c based on the signal output from the body control unit 210 of the camera body 2.

[0012] The lens memory 33 is composed of a non-volatile storage medium or the like. Information related to the interchangeable lens 3 is stored (recorded) in the lens memory 33 as lens information. The lens information includes data on the optical characteristics (exit pupil distance and F-number) of the photographing optical system 31. The exit pupil distance is the distance between the exit pupil of the photographing optical system 31 and the imaging plane of the photographing optical system 31. The lens information may be stored in an internal memory of the lens control unit 32.

[0013] Writing data to the lens memory 33 and reading data from the lens memory 33 are controlled by the lens control unit 32. After the interchangeable lens 3 is attached to the camera body 2, the lens control unit 32 transmits lens information to the body control unit 210 via the communication terminals of the lens side connection unit 302 and the body side connection unit 202. The lens control unit 32 also transmits to the body control unit 210 information relating to the position of the zoom lens 31a, information relating to the position of the focus lens 31b, information on the aperture value (F value) of the aperture 31c, and the like.

[0014] Next, we will explain in more detail the configuration of the camera body 2. The camera body 2 comprises an image sensor 22, a body memory 23, a display unit 24, an operation unit 25, a shake detection unit 26, a position detection unit 27, an anti-shake control unit 28, and a body control unit 210. The camera body 2 also comprises a power source, a memory card, etc., but explanations thereof will be omitted.

[0015] The imaging element 22 is a solid-state imaging element such as a CMOS image sensor. The imaging element 22 may be a CCD image sensor. The imaging element 22 receives a light beam that has passed through the photographing optical system 31 and captures an image of a subject. The imaging element 22 has a plurality of pixels, each having a photoelectric conversion unit, arranged two-dimensionally (for example, in row and column directions, X and Y directions). The photoelectric conversion unit is formed of, for example, a photodiode (PD). The imaging element 22 photoelectrically converts the received light to generate a signal, and outputs the generated signal to the body control unit 210.

[0016] As described later, the image sensor 22 has a plurality of image capturing pixels that output signals (captured image signals) used for image generation, and a plurality of focus detection pixels (AF pixels) that output signals (focus detection signals) used for focus detection. Note that the image sensor 22 may have a plurality of photoelectric conversion units within a pixel and may have pixels that output captured image signals and focus detection signals. Furthermore, the imaging element 22 is driven and moved by the vibration isolation control unit 28 for vibration correction (shake correction), and moves along a plane (XY plane) perpendicular to the optical axis OA1.

[0017] The body memory 23 is composed of a non-volatile storage medium, etc. Image data, control programs, etc. are recorded in the body memory 23. Writing data to the body memory 23 and reading data from the body memory 23 are controlled by the body control unit 210. The display unit 24 displays an image based on image data, an image showing a focus detection area (AF area) such as an AF frame, information related to shooting such as shutter speed and aperture value (F value), and a menu screen, etc. The operation unit 25 includes various setting switches such as a release button, a power switch, and switches for switching between various modes, and outputs operation signals corresponding to the respective operations to the body control unit 210.

[0018] Shake detection unit 26 is configured with an angular velocity sensor (gyro sensor) or an acceleration sensor, and detects shake (shake) applied to camera 1 due to hand shake by a user holding camera 1. Shake detection unit 26 generates a signal (shake signal) according to the amount of shake of camera 1, and outputs the generated shake signal to vibration isolation control unit 28.

[0019] The position detection unit 27 is configured with an optical sensor or a magnetic sensor, and detects the position of the image sensor 22 moving along a plane (XY plane) perpendicular to the optical axis OA1. The position detection unit 27 detects the position of the image sensor 22 at a predetermined period, and repeatedly generates information (position information) related to the position of the image sensor 22. The position detection unit 27 sequentially outputs the generated position information to the vibration prevention control unit 28. This position information includes information indicating the position of the image sensor 22 in the X-axis direction shown in FIG. 1, information indicating the position of the image sensor 22 in the Y-axis direction, and information indicating the rotation (tilt) of the image sensor 22 about the optical axis OA1. The information indicating the tilt of the image sensor 22 is information indicating the rotation angle of the image sensor 22 in a plane (XY plane) perpendicular to the optical axis OA1 of the photographing optical system 31.

[0020] The anti-shake control unit 28 performs anti-shake correction so as to cancel out the image blur of the subject image caused by the shake of the camera 1 based on the shake signal output from the shake detection unit 26. The anti-shake control unit 28 calculates the amount of shake of the camera 1 using the shake signal, and calculates (determines) the amount of movement of the image sensor 22 to cancel out the image blur caused by the amount of shake based on the calculated amount of shake of the camera 1. The amount of movement of the image sensor 22 includes the amount of movement in the X-axis direction, the amount of movement in the Y-axis direction, and the amount of rotational movement around the optical axis OA1, which are required to move the image sensor 22 from the current position of the image sensor 22 to cancel out the image blur. The anti-shake control unit 28 performs drive control of the image sensor 22 according to the calculated amount of movement, and adjusts the position of the image sensor 22. The anti-shake control unit 28 shifts (shifts) and rotates (rolls) the image sensor 22 in the up, down, left, and right directions on a plane perpendicular to the optical axis OA1 of the photographing optical system 31 according to the amount of shake of the camera 1. In this way, in camera 1, the position of imaging element 22 is adjusted in accordance with the amount of shake of camera 1, thereby correcting image shake of the subject image.

[0021] Furthermore, the anti-shake control unit 28 stores the position information of the image sensor 22 output from the position detection unit 27 in an internal memory of the anti-shake control unit 28. A plurality of pieces of position information detected periodically are stored in the internal memory of the anti-shake control unit 28. The anti-shake control unit 28 reads out the plurality of pieces of position information stored in the internal memory at a predetermined period and outputs the same to the body control unit 210. As described above, the vibration prevention control unit 28 determines the amount of movement of the image sensor 22 using both the shake signal from the shake detection unit 26 and the position information from the position detection unit 27, and controls the position of the image sensor 22 based on the determined amount of movement of the image sensor 22.

[0022] The body control unit 210 is configured with a processor such as a CPU, FPGA, or ASIC, and a memory such as a ROM or RAM, and controls each unit of the camera 1 based on a control program. The body control unit 210 has an imaging control unit 211, an image data generation unit 212, an area selection unit 213, and a focus detection unit 214.

[0023] The imaging control unit 211 supplies the imaging element 22 with a signal for controlling the accumulation operation (imaging) of the imaging element 22 to control the accumulation operation of the imaging element 22. When displaying a through image (live view image) of a subject on the display unit 24 or when capturing a moving image, the imaging control unit 211 makes the imaging element 22 repeatedly capture an image of the subject at a predetermined frame interval and output a captured image signal and a focus detection signal. The imaging control unit 211 performs a so-called rolling shutter readout control in which the pixels of the imaging element 22 are sequentially selected in the column direction by row and signals are read out from the selected pixels. In the imaging element 22, an operation of accumulating charges generated by photoelectrically converting light incident on the photoelectric conversion unit of each pixel (accumulation operation) and an operation of reading out signals based on the accumulated charges from the pixels (readout operation) are performed for each row or for each plurality of rows from the top row to the bottom row. The start and end times of the accumulation operations for each row are shifted in time in the column direction but overlap each other. The start and end times of the readout operation for each row, which is performed following the accumulation operation, are also overlapped, although there is a time lag in the column direction.

[0024] The image data generating unit 212 generates image data by performing various image processing on the captured image signal output from the image sensor 22. The image processing includes known image processing such as tone conversion processing and color interpolation processing. The generated image data is recorded in a memory card (not shown).

[0025] FIG. 2 is a diagram showing a focus detection area 100 set on the imaging surface 22a of the image sensor 22 according to the first embodiment. A plurality of focus detection pixels are arranged in the focus detection area 100. As shown in FIG. 2, a plurality of focus detection areas 100 arranged in a matrix in the row direction (X direction) and column direction (Y direction) are provided on the imaging surface 22a of the image sensor 22. Each focus detection area 100 corresponds to a plurality of AF areas selectable by the camera 1 or a user. In FIG. 2, the plurality of focus detection areas 100 are arranged discretely with spaces between them, but it is not necessary to arrange all the focus detection areas 100 discretely. For example, the focus detection areas arranged in the row direction may be continuous, or all the focus detection areas may be arranged without spaces between them.

[0026] The area selection unit 213 selects (sets) at least one of the multiple focus detection areas 100 set on the imaging surface 22a of the image sensor 22 shown in FIG. 2. The area of ​​each focus detection area 100 corresponds to an AF frame (range) displayed on the display unit 24. The area selection unit 213 determines, as a focus detection area for focus detection, the focus detection area 100 corresponding to the area in the AF frame selected by the user by operating the operation unit 25 from the multiple AF frames displayed on the display unit 24, or the focus detection area 100 automatically selected by the camera 1. As will be described later, the defocus amount is calculated using focus detection signals of multiple focus detection pixels in the focus detection area 100 selected by the area selection unit 213. The deviation between the position of the subject image formed by the photographing optical system 31 and the position of the imaging surface 22a of the imaging element 22 in the camera body 2 corresponds to the amount of defocus.

[0027] As shown in FIG. 2, the focus detection areas 100 are distributed in two dimensions (row and column directions), and the distances of the focus detection areas 100 from the center of the imaging surface 22a of the imaging element 22 are different. That is, when the center of the imaging element 22 is on the optical axis OA1, the focus detection areas 100 are provided at various image heights. Before the imaging element 22 moves (before image blur correction), the focus detection area 100a at the center of the imaging element 22 is located on the optical axis OA1 of the photographing optical system 31, and its image height is approximately zero. The image height H of the focus detection area 100 becomes higher (larger) as the distance from the optical axis OA1 of the photographing optical system 31 becomes longer. In FIG. 2, as an example of a focus detection area 100 with a high image height H, the focus detection areas located at the left and right ends of the same row as the central focus detection area 100a are denoted by reference characters 100b and 100c.

[0028] Furthermore, because the focus detection area 100 has a predetermined area, strictly speaking the image height differs for each pixel position within one focus detection area 100, but in this embodiment, multiple pixels arranged in the same focus detection area 100 are treated as having a constant image height H, and the value of the image height H at the center position of the focus detection area 100 is set as the image height value of the entire focus detection area 100. In the central focus detection area 100a, the entire area has an image height of zero, and in the above-mentioned focus detection areas 100b and 100c, the entire area has a predetermined image height H. The pixels arranged in the focus detection area 100 of the image sensor 22 will be described below with reference to Figs. 3 and 4.

[0029] 3 is a diagram showing an example of pixel arrangement in one focus detection area 100 of the image sensor 22 according to the first embodiment. In the focus detection area 100 of the image sensor 22, a plurality of imaging pixels 13, a first focus detection pixel 11, and a second focus detection pixel 12 are arranged.

[0030] Each imaging pixel 13 is provided with one of three color filters 51 having different spectral characteristics of R (red), G (green), and B (blue). The R color filter 51 transmits mainly light in the red wavelength range, the G color filter 51 transmits mainly light in the green wavelength range, and the B color filter 51 transmits mainly light in the blue wavelength range. The pixels have different spectral characteristics depending on the color filter 51 arranged. As a result, the imaging pixels 13 include a pixel 13r (hereinafter referred to as an R pixel) having a red (R) spectral characteristic, a pixel 13g (hereinafter referred to as a G pixel) having a green (G) spectral characteristic, and a pixel 13b (hereinafter referred to as a B pixel) having a blue (B) spectral characteristic. The R pixel, the G pixel, and the B pixel are arranged according to a Bayer array.

[0031] The first focus detection pixel 11 and the second focus detection pixel 12 are arranged by replacing some of the R, G, and B imaging pixels 13 arranged in the Bayer array as described above. The first focus detection pixel 11 and the second focus detection pixel 12 are provided with a color filter 51 and a light-shielding film (light-shielding portion) 43. The first focus detection pixel 11 and the second focus detection pixel 12 are arranged with a G color filter as the color filter 51. The first focus detection pixel 11 and the second focus detection pixel 12 have different positions of the light-shielding portion 43. In the example shown in FIG. 3, the first focus detection pixel 11 has a light-shielding portion arranged on the left side of the pixel light-receiving portion, and the second focus detection pixel 12 has a light-shielding portion arranged on the right side of the pixel light-receiving portion. Note that a color filter having a white (W) spectral characteristic, or a B (blue) or R (red) color filter may be arranged in the first focus detection pixel 11 and the second focus detection pixel 12 as the color filter 51. Alternatively, the first focus detection pixel 11 and the second focus detection pixel 12 may be provided with only the light-shielding film 43, without arranging the color filter 51.

[0032] 3, the image sensor 22 has a first pixel group row 401 in which R pixels 13r and G pixels 13g are alternately arranged in the row direction (left-right direction), and a second pixel group row 402 in which G pixels 13g and B pixels 13b are alternately arranged in the row direction. Furthermore, the image sensor 22 has a third pixel group row 403 in which G pixels 13g, first focus detection pixels 11, and second focus detection pixels 12 are arranged in the row direction. Note that the number and arrangement of pixels arranged in the image sensor 22 are not limited to the example shown in the figure. As shown in Figure 3, within one focus detection area 100, four rows, namely, a first pixel group row 401, a second pixel group row 402, a first pixel group row 401, and a third pixel group row 403, are arranged in a set in the column direction, and this set of four rows, namely, the first pixel group row 401 to the third pixel group row 403, are repeatedly arranged side by side in the column direction.

[0033] The number of sets of rows repeated in the column direction is not limited to four. It is sufficient that the number of sets of rows includes at least one third pixel group row 403, and for example, eight rows, i.e., four first pixel group rows 401, three second pixel group rows 402, and one third pixel group row 403, may be arranged in a set in the column direction, including the first pixel group row 401, the second pixel group row 402, the first pixel group row 401, the second pixel group row 402, the first pixel group row 401, and the third pixel group row 403. Alternatively, a set of 12 rows, including six first pixel group rows 401, five second pixel group rows 402, and one third pixel group row 403, may be arranged so as to be repeated in the column direction.

[0034] In the example shown in FIG. 3, the G pixel 13g, the first focus detection pixel 11, and the second focus detection pixel 12 are arranged in one row as the focus detection pixel row (third pixel group row 403) in which two types of focus detection pixels are arranged, but this is not limited thereto. For example, the G pixel 13g and the first focus detection pixel 11 may be arranged in one row, and the G pixel 13g and the second focus detection pixel 12 may be arranged in a different row. In other words, the row in which the first focus detection pixel 11 having a light-shielding portion on the left side of the pixel light receiving portion is arranged and the row in which the second focus detection pixel 12 having a light-shielding portion on the right side of the pixel light receiving portion are arranged may be different rows. In this case, it is preferable to arrange a row set including one row in which the first focus detection pixel 11 is arranged and a row set including one row in which the second focus detection pixel 12 is arranged in the column direction. Specifically, a 12-row set of six first pixel group rows 401, five second pixel group rows 402, and one row in which the first focus detection pixels 11 are arranged, and a 12-row set of six first pixel group rows 401, five second pixel group rows 402, and one row in which the second focus detection pixels 12 are arranged, may be arranged so that a total of 24 row sets are repeated in the column direction.

[0035] Fig. 4 is a diagram for explaining signals generated by the image sensor 22 according to the first embodiment. Fig. 4 shows one first focus detection pixel 11 (Fig. 4(a)), one second focus detection pixel 12 (Fig. 4(b)), and one imaging pixel 13 (Fig. 4(c)) among the pixels provided in the image sensor 22.

[0036] The imaging pixel 13 has a microlens 44, a color filter 51, and a photoelectric conversion unit (light receiving unit, PD) 42 that receives light flux transmitted (passed) through the microlens 44 and the color filter 51. The first and second focus detection pixels 11, 12 each have the microlens 44, the color filter 51, a light shielding unit 43 that shields a portion of the light flux transmitted through the microlens 44 and the color filter 51, and a photoelectric conversion unit (light receiving unit, PD) 42 onto which the light flux that has passed through the microlens 44 and the color filter 51 and has not been shielded by the light shielding unit 43 is incident.

[0037] The light beam that passes through a first pupil region, which is one of the two equal parts of the exit pupil of the photographing optical system 31, is indicated by a solid arrow as a first light beam 61, and the light beam that passes through the other equal part of the second region, which is the other of the two equal parts, is indicated by a dashed arrow as a second light beam 62. In FIG. 4A, the first focus detection pixel 11 is provided with a left light shielding portion 43L that shields the second light beam 62 of the first and second light beams 61 and 62. The left light shielding portion 43L is located between the color filter 51 and the photoelectric conversion portion 42, and is provided on the photoelectric conversion portion 42. As shown in FIG. 4A, since the first focus detection pixel 11 is provided with the left light shielding portion 43L, only the first light beam 61 that has passed through a first pupil region of the exit pupil of the photographing optical system 31 is incident on the photoelectric conversion portion 42. The photoelectric conversion portion 42 of the first focus detection pixel 11 receives the first light beam 61. The first focus detection pixel 11 photoelectrically converts the first light beam 61 in the photoelectric conversion portion 42 to accumulate electric charges, and outputs a first focus detection signal Sig1 based on the amount of accumulated electric charges. The left light shielding portion 43L may be provided at a position intermediate between the color filter 51 and the photoelectric conversion portion 42, instead of on the photoelectric conversion portion .

[0038] In FIG. 4B, the second focus detection pixel 12 is provided with a right-side light shielding portion 43R that shields the first light flux 61. The right-side light shielding portion 43R is located between the color filter 51 and the photoelectric conversion portion 42, and is provided on the photoelectric conversion portion 42. As shown in FIG. 4B, since the first focus detection pixel 11 is provided with the right-side light shielding portion 43R, only the second light flux 62 that has passed through a second pupil region of the exit pupil of the photographing optical system 31 is incident on the photoelectric conversion portion 42. The photoelectric conversion portion 42 of the second focus detection pixel 12 receives the second light flux 62. The second focus detection pixel 12 photoelectrically converts the second light flux 62 in the photoelectric conversion portion 42 to accumulate electric charges, and outputs a second focus detection signal Sig2 based on the amount of accumulated electric charges. The right light shielding portion 43R may be provided at a position intermediate between the color filter 51 and the photoelectric conversion portion 42, instead of on the photoelectric conversion portion .

[0039] 4(c), the photoelectric conversion unit 42 of the imaging pixel 13 that does not include a light-shielding unit receives the first and second light beams 61, 62. As described above, the color filter 51 of the imaging pixel 13 is provided with one of R (red), G (green), and B (blue). The imaging pixel 13 photoelectrically converts the first and second light beams 61, 62 to accumulate electric charges, and outputs an image signal based on the amount of accumulated electric charges.

[0040] Returning to FIG. 1, the focus detection unit 214 performs processing required for automatic focus adjustment (AF) of the photographing optical system 31. The focus detection unit 214 performs processing to calculate a defocus amount and a processing to calculate a movement amount (drive amount) for moving the focus lens 31b to form an image of the subject light flux that has passed through the photographing optical system 31 on the imaging surface 22a based on the defocus amount. The focus detection unit 214 calculates the defocus amount by a pupil division type phase difference detection method using the first and second focus detection signals Sig1 and Sig2 output from the first and second focus detection pixels 11 and 12 in the focus detection area 100 selected by the area selection unit 213. The focus detection unit 214 also calculates the movement amount of the focus lens 31b based on the calculated defocus amount.

[0041] To explain the calculation process of the defocus amount in more detail, the focus detection unit 214 calculates the image shift amount Δ by performing a correlation operation between the first focus detection signal Sig1 and the second focus detection signal Sig2. The focus detection unit 214 converts this image shift amount Δ into a defocus amount based on a predetermined conversion formula. The conversion formula for converting the image shift amount Δ into the defocus amount Def can be expressed as follows using a conversion coefficient (conversion factor) K: Def = K × Δ … (1)

[0042] As described above, the vibration reduction control unit 28 outputs position information of the image sensor 22 detected by the position detection unit 27 to the body control unit 210. As will be described later, the focus detection unit 214 of the body control unit 210 determines a conversion coefficient K taking into account the image height from the optical axis OA1 of the selected focus detection area 100 based on the position information output from the vibration reduction control unit 28. The focus detection unit 214 converts the image shift amount Δ into a defocus amount Def based on the determined conversion coefficient K and the above formula (1).

[0043] The focus detection unit 214 judges whether the defocus amount is within a predetermined tolerance. If the defocus amount is within the tolerance, the focus detection unit 214 judges that the focus is achieved. On the other hand, if the defocus amount exceeds the tolerance, the focus detection unit 214 judges that the focus is not achieved, and calculates the movement amount of the focus lens 31b to the in-focus position based on the calculated defocus amount Def. Then, the focus detection unit 214 transmits the movement amount of the focus lens 31b and a signal instructing lens drive to the lens control unit 32 of the interchangeable lens 3. The lens control unit 32, which has received the instruction from the focus detection unit 214, moves the focus lens 31b according to the movement amount, thereby automatically performing focus adjustment.

[0044] Fig. 5 is a diagram for explaining image blur correction by the camera 1 according to the first embodiment. Fig. 5(a) shows an example in which the position of a subject image has changed due to camera shake applied in the horizontal direction (X-axis direction). In Fig. 5(a), subject image 71a indicated by a dotted line shows the subject image before camera 1 shake occurs, and imaging surface 22a1 indicated by a dotted line shows (the position of) the imaging surface of image sensor 22 before movement (before correction). Before camera 1 shake occurs, subject image 71a is located at the center of imaging surface 22a1.

[0045] The subject image 71b indicated by the solid line shows the subject image when the camera 1 is shaken, and is located to the right (+X direction) of the center of the imaging surface 22a1. When the camera 1 is shaken by hand shake, the vibration prevention control unit 28 moves the imaging element 22 so as to cancel the image shake. When the image shake shown in FIG. 5(a) occurs, the vibration prevention control unit 28 moves the imaging element 22 in the +X direction as indicated by the arrow 75 along a plane (XY plane) perpendicular to the optical axis OA1 according to the amount of shake of the camera 1, as described above. The imaging surface 22a2 indicated by the solid line shows the position of the imaging surface of the imaging element 22 after the movement (after correction). The imaging element 22 (the imaging surface of the imaging element 22) is driven and controlled by the vibration prevention control unit 28 to move from the position indicated by the dotted line to the position indicated by the solid line. On the imaging surface 22a2 after the movement, the subject image 71b is located at the center of the imaging surface 22a2.

[0046] FIG. 5(b) shows another example of the change in the position of the subject image, in which the subject image rotates around the Z axis due to camera shake. In FIG. 5(b), the subject image 71a shown by the dotted line indicates the subject image before the camera 1 shakes, and the imaging surface 22a1 shown by the dotted line indicates the imaging surface of the imaging element 22 before movement. Moreover, the subject image 71c shown by the solid line indicates the subject image when the camera 1 shakes, and the imaging surface 22a3 shown by the solid line indicates the imaging surface of the imaging element 22 after movement. In the example shown in FIG. 5(b), the image stabilization control unit 28 corrects the image shake by rotating the imaging element 22 as shown by the arrow 76 so as to cancel the rotational shake in the roll direction of the camera 1.

[0047] As described above, the vibration reduction control unit 28 moves the image sensor 22 so as to cancel out the shake of the camera 1. When the image sensor 22 is moved by the shift amount (x, y), the center of the imaging surface 22a moves by the shift amount (x, y), and each focus detection area 100 moves by the shift amount (x, y). The central focus detection area 100a and the focus detection areas 100b and 100c shown in FIG. 2 also move by the shift amount (x, y). In this way, the movement of the image sensor 22 changes the relative positional relationship between the optical axis OA1 of the photographing optical system 31 and the center of the image sensor 22, and the image height of each focus detection area 100 changes.

[0048] When the image height of the focus detection area 100 changes due to the movement of the image sensor 22, the angle of incidence of the light beam that has passed through the photographing optical system 31 onto the first and second focus detection pixels in the focus detection area 100 changes, and the amount of charge accumulated in each of the first and second focus detection pixels changes. In addition, the first and second focus detection pixels generate first and second focus detection signals based on the amount of charge accumulated during a period in which the charge accumulation operation is performed (charge accumulation period). Therefore, the amount of charge accumulated in the first and second focus detection pixels changes depending on the position of the image sensor 22 during the charge accumulation period, and the magnitude of the image shift amount calculated using the first and second focus detection signals changes. Taking the central focus detection area 100a as an example, if the image sensor 22 moves due to shake correction and the focus detection area 100a is not located on the optical axis OA1, if the value of the conversion coefficient K, which assumes that the focus detection area 100a is located on the optical axis OA1, is used directly in the conversion formula for converting the above-mentioned image shift amount Δ into a defocus amount Def, the accuracy of the calculated defocus amount will be reduced.

[0049] Therefore, the focus detection unit 214 according to the present embodiment changes the value of the conversion coefficient K used to calculate the defocus amount according to the position of the image sensor 22 during the charge accumulation period in which the charge is accumulated. In this case, the focus detection unit 214 sets (corrects) the above-mentioned conversion coefficient K so that the value increases as the position of the focus detection area 100 used for focus detection during the charge accumulation period moves away from the optical axis OA1. In other words, the above-mentioned conversion coefficient K is set so that the value increases as the image height of the focus detection area 100 during the charge accumulation period increases with the movement of the image sensor 22. This makes it possible to suppress a decrease in focus detection accuracy when the center of the image sensor 22 and the optical axis OA1 of the photographing optical system 31 are misaligned due to image blur correction. The process performed by the focus detection unit 214 will be described below.

[0050] The focus detection unit 214 selects the position information detected by the position detection unit 27 during the charge accumulation period of the focus detection area 100 selected by the area selection unit 213 from among the position information of the image sensor 22 acquired via the vibration prevention control unit 28. As described above, in the image sensor 22, the charge accumulation operation of the pixels is performed while scanning each row from the top row to the bottom row. The charge accumulation period of the focus detection area 100 is a period during which the charge accumulation operation is performed in the pixel row including the pixel arranged in the focus detection area 100. In this way, the focus detection unit 214 selects the position information indicating the position of the image sensor 22 during the charge accumulation period of the focus detection area 100 selected by the area selection unit 213 from among the multiple pieces of position information detected by the position detection unit 27.

[0051] The focus detection unit 214 calculates a conversion coefficient K used to calculate the defocus amount based on the position information of the selected image sensor 22. For each focus detection area 100, the correspondence between the angle of incidence of the light beam passing through the photographing optical system 31 on the focus detection pixel and the conversion coefficient K is obtained in advance by simulation, experiment, or the like, and is stored in the internal memory of the body control unit 210 as a data table or a formula. The focus detection unit 214 calculates the image height H of the focus detection area 100 selected by the area selection unit 213 based on the position information of the selected image sensor 22, and calculates the angle of incidence of the light beam on the focus detection pixel of the focus detection area 100 using the calculated image height H. The focus detection unit 214 determines the conversion coefficient K used to calculate the defocus amount by referring to the above-mentioned correspondence relationship for the focus detection area 100 selected by the area selection unit 213 based on the calculated angle of incidence. As described above, in this embodiment, the value of the conversion coefficient K used to calculate the defocus amount is changed based on position information regarding the position of the image sensor 22 during the charge accumulation period. Therefore, it is possible to suppress a decrease in the accuracy of focus detection when image blur correction is performed.

[0052] The method of determining the conversion coefficient K is not limited to the above method. The focus detection unit 214 may determine the conversion coefficient K by referring to the correspondence between the position of the image sensor 22 and the conversion coefficient K. In this case, the correspondence between the position of the image sensor 22 and the conversion coefficient K is obtained in advance for each focus detection area 100 by an experiment or the like, and is stored in the internal memory of the body control unit 210 as a data table or the like. The focus detection unit 214 grasps the position of the image sensor 22 from the position information of the selected image sensor 22, and refers to the above correspondence for the focus detection area 100 selected by the area selection unit 213 to determine the conversion coefficient K used to calculate the defocus amount.

[0053] Fig. 6 is a diagram showing an example of processing in the camera 1 according to the first embodiment. In Fig. 6, multiple horizontal axes are a common time axis. In Fig. 6, the same time axis shows a V signal (also called a vertical synchronization signal) of the image sensor 22 (Fig. 6(a)), a detection process of the position of the image sensor 22 (Fig. 6(b)), a charge accumulation process by the image sensor 22 (Fig. 6(c)), a communication process of position information (Fig. 6(d)), an AF process (Figs. 6(e) and (f)), lens control by the lens control unit 32 (Fig. 6(g)), and the position of the focus lens 31b (Fig. 6(h)).

[0054] A V signal (vertical synchronization signal) is generated by a pulse generating circuit or the like in the image sensor 22 based on the frame rate of shooting. The V signal is a signal generated for each frame, and is generated at time intervals according to the frame rate. In Fig. 6, the position detection process, the charge accumulation process, the communication process of the position information, the AF process, and the lens control are each performed in synchronization with the V signal.

[0055] 6(b), solid arrows A1 to A15 indicate the timing at which position detection unit 27 detects the position of image sensor 22 while processing frames N to (N+3) and generates position information of image sensor 22. Position detection unit 27 performs position detection at regular intervals (Δt) shorter than one frame, and acquires multiple pieces of position information during one frame.

[0056] The charge accumulation process of the image sensor 22 is shown in Fig. 6(c). In the example shown in Fig. 6(c), charge accumulation is performed sequentially in the first, second, and third small regions 81, 82, and 83 in the image sensor 22 shown in Fig. 7. The first to third small regions 81 to 83 divide the imaging surface 22a into three in the vertical direction, and divide it into an upper region (small region 81), a middle region (small region 82), and a lower region (small region 83). As shown in Fig. 7, each of the first to third small regions 81 to 83 includes a plurality of focus detection regions 100.

[0057] FIG. 6(c) shows a schematic diagram of processing for each frame from the start of charge accumulation in the pixels in the top row to the end of charge accumulation in the pixels in the bottom row in each of the first to third small regions 81 to 83. Charge accumulation for each frame is performed within the parallelogram region in FIG. 6(c). That is, the time when the first row (the top line of the first small region 81) accumulates charge is shifted from the time when the last row (the bottom line of the third small region 83) accumulates charge (also called a rolling shutter). The image sensor 22 accumulates charge in the image sensor 22 based on the V signal to repeatedly capture a subject image for each frame, and outputs captured image signals of the imaging pixels in the first to third small regions 81 to 83 and focus detection signals (first and second focus detection signals) of the focus detection pixels.

[0058] In the following, an example of performing AF processing using a focus detection signal output from a focus detection area 100d (see FIG. 7) located in the vertically central row of the first small area 81 out of the multiple focus detection areas 100 in the first small area 81 will be described. The AF processing is shown in FIG. 6(e) and FIG. 6(f). The periods from time t1 to time t6, from time t6 to time t12, and from time t12 to time t18 are periods during which charge accumulation processing is performed while sequentially scanning (rolling shutter) from the top row to the bottom row of the first small area 81 in the Nth frame, the (N+1)th frame, and the (N+2)th frame, respectively. In addition, the periods from time t2 to time t5, from time t7 to time t11, and from time t13 to time t17 are periods during which charge accumulation processing is performed in the focus detection area 100d of the central row of the first small area 81 in the Nth frame, the (N+1)th frame, and the (N+2)th frame, respectively.

[0059] 6(d), in the period from time t3 to time t4, the vibration reduction control unit 28 outputs position information (four pieces of arrows A1 to A4) of the image sensor 22 generated at intervals of Δt between time t0 and time t3 to the body control unit 210. The body control unit 210 stores the four pieces of position information output by the vibration reduction control unit 28 in an internal memory.

[0060] As shown in Figure 6 (e), during the period from time t5 to time t8, the focus detection unit 214 performs correlation calculation processing on a pair of focus detection signals output from the focus detection area 100d in the Nth frame that has been subjected to charge accumulation processing, i.e., a pair of signal sequences based on the charges accumulated in the first and second focus detection pixels of the focus detection area 100d during the period from time t2 to time t5. In the period from time t9 to time t10, the vibration reduction control unit 28 outputs position information (four arrows A5 to A8) of the image sensor 22 generated at intervals of Δt between time t3 and time t8 to the body control unit 210. The body control unit 210 stores in an internal memory the four pieces of position information (four arrows A5 to A8) output by the vibration reduction control unit 28, in addition to the four pieces of position information (four arrows A1 to A4) that have already been stored.

[0061] As shown in FIG. 6(f), in the period from time t11 to time t14, the focus detection unit 214 calculates the image shift amount Δ based on the correlation calculation result (the correlation calculation result in the Nth frame shown at times t5 to t8 in FIG. 6(e)) using the signal output from the focus detection area 100d by the charge accumulation process in the Nth frame. In addition, the focus detection unit 214 selects the position information detected when charge accumulation is performed in the focus detection area 100d in the Nth frame from among the multiple pieces of position information (eight pieces of information indicated by arrows A1 to A8) of the image sensor 22 stored in the internal memory. Since the focus detection area 100d to be described is located in the center of the center row of the first small area 81 (see FIG. 7), the focus detection unit 214 selects the position information detected at the time closest to the center time of the period from time t2 to time t5 in which charge accumulation is performed in the focus detection area 100d. In the case of the example shown in FIG. 6, the focus detection unit 214 selects the position information detected at timing A3 closest to the center time of the period from time t2 to time t5. This allows the focus detection section 214 to determine the distance (image height) of the focus detection area 100d from the optical axis OA1 during the Nth frame accumulation. That is, the focus detection section 214 determines the distance (image height) of the focus detection area 100d from the optical axis OA1 during the Nth frame accumulation based on information on the position of the focus detection area 100d on the imaging surface 22a (the distance from the center of the imaging surface 22a) and position information of the image sensor 22 at the time charge accumulation is performed in the focus detection area 100d.

[0062] The focus detection unit 214 also determines a conversion coefficient K for converting the image shift amount Δ, calculated using the signal output from the focus detection area 100d in the Nth frame, into a defocus amount, based on the distance (image height H) from the optical axis OA1 of the focus detection area 100d during the Nth frame accumulation described above, based on the determined conversion coefficient K. The focus detection unit 214 also converts the image shift amount into a defocus amount using the above conversion formula. The body control unit 210 also calculates the movement amount of the focus lens 31b based on the calculated defocus amount. The focus detection unit 214 transmits a signal instructing the drive of the focus lens 31b and information on the calculated movement amount of the focus lens 31b to the lens control unit 32. The process of determining the conversion coefficient K and the process of calculating the movement amount of the focus lens 31b are included in the AF process of FIG. 6(f).

[0063] As shown in Figure 6 (g), during the period from time t14 to time t15, the lens control unit 32 of the interchangeable lens 3 starts moving the focus lens 31b and performs focus adjustment based on the amount of movement of the focus lens 31b calculated by the focus detection unit 214 during the period from time t11 to time t14.

[0064] Following the above processing of the Nth frame, processing of the (N+1)th frame is performed. Accumulation of the (N+1)th frame is performed from time t6, and charge accumulation processing is performed in the focus detection area 100d of the center row of the first small area 81 in the (N+1)th frame from time t7 to time t11. As described above, in the period from time t9 to time t10, the vibration reduction control unit 28 outputs four pieces of position information (arrows A5 to A8, see FIG. 6(b)) to the body control unit 210. The body control unit 210 stores the four pieces of position information output by the vibration reduction control unit 28 in an internal memory. During the period from time t11 to time t16 (see Figure 6 (e)), the focus detection unit 214 performs correlation calculation processing on a pair of focus detection signals output from the focus detection area 100d by the charge accumulation processing in the (N+1) frame, i.e., a pair of signal sequences based on the charges accumulated in the first and second focus detection pixels of the focus detection area 100d during the period from time t7 to time t11.

[0065] During the period from time t17 to time t19 (see FIG. 6(f)), the focus detection unit 214 calculates the image shift amount Δ based on the correlation calculation result using the signal output from the focus detection area 100d by the charge accumulation process in the (N+1)th frame. The focus detection unit 214 also selects the position information detected when charge accumulation is performed in the focus detection area 100d in the (N+1)th frame from among the multiple position information stored in the internal memory. As in the Nth frame, the focus detection area 100d is located in the center of the center row of the first small area 81 (see FIG. 7), so it selects the position information detected at the timing A7 closest to the center time of the period from time t7 to time t11 when charge accumulation is performed in the focus detection area 100d. As a result, the focus detection unit 214 obtains the distance (image height) from the optical axis OA1 of the focus detection area 100d during the (N+1)th frame accumulation.

[0066] Then, the focus detection unit 214 determines a conversion coefficient K for converting the image shift amount calculated using the signal output from the focus detection area 100d in the (N+1)th frame during the period from time t17 to time t19 into a defocus amount based on the distance (image height) from the optical axis OA1 of the focus detection area 100d at the time of accumulating the (N+1)th frame. The focus detection unit 214 determines the conversion coefficient K based on the selected position information, and converts the image shift amount into a defocus amount based on the determined conversion coefficient K. The body control unit 210 also calculates the movement amount of the focus lens 31b based on the calculated defocus amount. The focus detection unit 214 transmits a signal instructing to drive the focus lens 31b and information on the calculated movement amount of the focus lens 31b to the lens control unit 32.

[0067] During the period from time t19 to time t20 (see FIG. 6(g)), the lens control unit 32 starts moving the focus lens 31b and performs focus adjustment based on the amount of movement of the focus lens 31b calculated by the focus detection unit 214 during the period from time t17 to time t19.

[0068] As described above, the camera 1 according to the present embodiment records the position information of the image sensor 22 at a predetermined time interval shorter than one frame interval (FIG. 6(b)), and selects the position information detected at the time closest to the time when the charge accumulation of the focus detection area 100 where focus detection is performed is performed according to the position of the focus detection area 100 where focus detection is performed on the imaging surface 22a. In the example shown in FIG. 6, the focus detection unit 214 selects the position information detected at the timing A3 closest to the center time of the period from time t2 to time t5 in the processing of the Nth frame. From the selected position information of the image sensor 22 and the position information of the focus detection area 100d where focus detection is performed on the imaging surface 22a (the distance from the center of the imaging surface 22a to the focus detection area 100d), the focus detection unit 214 calculates the distance (image height H) of the focus detection area 100d from the optical axis OA1 at the time of accumulation of the Nth frame. The conversion coefficient K is calculated based on the distance (image height H) of the target focus detection area 100d from the optical axis OA1 at the time of accumulation. A correlation calculation process (FIG. 6(e)) is performed on the signal based on the accumulated charge to calculate the amount of image shift, and the calculated image shift amount is converted into a defocus amount using a conversion coefficient K obtained based on the image height H at the time of charge accumulation (FIG. 6(f)), and the focus lens 31b is driven (FIG. 6(g)).

[0069] To repeat, camera 1 records position information from time t3 to time t4 for the focus detection signal of the Nth frame based on the charge accumulated from time t2 to time t5, performs correlation calculation processing from time t5 to time t8, performs defocus conversion from time t11 to time t14, and starts driving focus lens 31b from time t14 to time t15. Furthermore, camera 1 records position information from time t9 to time t10 for the focus detection signal of the (N+1)th frame based on the charge accumulated from time t7 to time t11, performs correlation calculation processing from time t11 to time t16, performs defocus conversion from time t17 to time t19, and starts moving focus lens 31b from time t19 to time t20.

[0070] 6, an example of performing AF processing using a focus detection signal output from a focus detection area 100d (see FIG. 7) in the center of the first small area 81, which is an upper area of ​​the three areas obtained by vertically dividing the imaging surface 22a, has been described, but AF processing can also be performed in the same manner when using a focus detection signal output from other focus detection areas 100 such as a focus detection area 100e in the center of the second small area 82, which is a middle area, or a focus detection area 100f in the center of the third small area 83, which is a lower area. When performing AF processing in the focus detection area 100e in the center of the second small area 82, position information generated by detecting the position of the arrow A4 in the Nth frame is selected to determine the distance (image height H) from the optical axis OA1 at the time of charge accumulation in the focus detection area 100e, and the determined conversion coefficient K is used to calculate the defocus amount. In addition, in calculating the defocus amount using the signal output from the focus detection area 100e in the subsequent (N+1)th frame, the position information generated by detecting the position of the arrow A8 is selected to determine the conversion coefficient K, and the defocus amount is calculated using the determined conversion coefficient K.

[0071] When AF processing is performed in the focus detection area 100f at the center of the third small area 83, in the Nth frame, the position information generated by the position detection of the arrow A5 is selected to obtain the distance (image height) from the optical axis OA1 at the time of charge accumulation in the focus detection area 100e to determine the conversion coefficient K, and the defocus amount is calculated using the determined conversion coefficient K. Note that the position information of the arrow A5 is received between times t9 and t10 (FIG. 6(d)), so the correlation calculation (FIG. 6(e)) thereafter is performed between times t11 and t16, the defocus amount calculation (FIG. 6(f)) is performed between times t17 and t19, and the lens control (FIG. 6(g)) is performed between times t19 and t20. When the defocus amount is calculated using the signal output from the focus detection area 100f in the subsequent (N+1)th frame, the position information generated by the position detection of the arrow A9 is selected to determine the conversion coefficient K, and the defocus amount is calculated using the determined conversion coefficient K.

[0072] Note that even when calculating the defocus amount using a signal output from a focus detection area other than the center of the first to third small areas 81 to 83, for example, a focus detection area 100 in the upper left or lower right corner, the focus detection section 214 selects position information detected at the timing closest to the center time of the charge accumulation period in the focus detection area 100 other than the center. Using the position of the target focus detection area 100 in the imaging surface 22a (the distance from the center of the imaging surface 22a to the target focus detection area 100) and the position information of the selected image sensor 22, the distance (image height H) from the optical axis OA1 at the time of charge accumulation of the target focus detection area 100 is obtained to determine the conversion coefficient K. Then, the defocus amount is calculated based on the determined conversion coefficient K.

[0073] In this way, the focus detection section 214 according to this embodiment obtains the distance (image height H) from the optical axis OA1 at the time of charge accumulation in the target focus detection area 100 based on position information of the image sensor 22 detected during the charge accumulation period of the focus detection area 100 used for focus detection, and changes the conversion coefficient K used to calculate the defocus amount. Therefore, when the image sensor 22 is moved for image blur correction, the focus detection section 214 can determine the conversion coefficient K suitable for calculating the defocus amount in consideration of the position of the image sensor 22 during the charge accumulation period, and can suppress a decrease in focus detection accuracy.

[0074] The above-described embodiment can be summarized as follows. (1) The imaging device (camera 1) includes an imaging section (image sensor 22) having a first pixel (first focus detection pixel 11) that outputs a first signal based on electric charges accumulated by photoelectrically converting a first light flux that has passed through a first region of an optical system (photographic optical system 31), and a second pixel (second focus detection pixel 12) that outputs a second signal based on electric charges accumulated by photoelectrically converting a second light flux that has passed through a second region, a movement control section (anti-shake control section 28) that moves the imaging section and outputs position information regarding the position of the imaging section, and a detection section (body control section 210) that detects the focus state of the optical system based on the position information output by the movement control section and the first and second signals output by the imaging section. In this embodiment, the camera 1 calculates the defocus amount using the position information of the image sensor 22 and the first and second focus detection signals. For this reason, the camera 1 can change the conversion coefficient K used to calculate the defocus amount according to the position of the image sensor 22, thereby suppressing a decrease in focus detection accuracy.

[0075] (2) The detection unit (body control unit 210) calculates the amount of image shift between the image formed by the first light beam and the image formed by the second light beam based on the first signal and the second signal. The detection unit obtains the distance (image height) from the optical axis OA1 at the time of charge accumulation in the target focus detection area based on position information of the image sensor, determines a conversion coefficient K for converting the amount of image shift into a defocus amount, and converts the amount of image shift into a defocus amount based on the determined conversion coefficient K. In this way, the camera 1 can change the conversion coefficient used to calculate the defocus amount based on position information of the image sensor 22. This makes it possible to suppress a decrease in the accuracy of the calculated defocus amount.

[0076] The following modifications are also within the scope of the present invention, and one or more of the modifications may be combined with the above-described embodiment.

[0077] (Variation 1) In the above embodiment, an example has been described in which one piece of position information detected at a time closest to the center time of the period in which charge accumulation is performed in the focus detection area 100 is selected to determine the conversion coefficient K. However, it is also possible to select multiple pieces of position information detected during the period in which charge accumulation is performed in the focus detection area 100 and determine the conversion coefficient K using each piece of position information.

[0078] 6(b) as the position of the imaging element 22 at the time of charge accumulation of the Nth frame to determine the conversion coefficient K. Also, the average position of the positions indicated by each of the four pieces of position information generated by position detection of the arrows A2 to A5 may be used as the position of the imaging element 22 at the time of charge accumulation of the Nth frame to determine the conversion coefficient K.

[0079] Furthermore, a plurality of pieces of position information may be interpolated to calculate the position of the image sensor 22 at the center time of the charge accumulation period of each frame, and the conversion coefficient K may be determined based on the calculated position of the image sensor 22.

[0080] In addition, the conversion coefficient K may be determined using multiple pieces of position information detected during a period in which charge accumulation is performed in the focus detection area 100 (for example, four pieces of position information generated by detecting the positions of arrows A2 to A5 in FIG. 6(b)) and position information acquired before and after this period (for example, two pieces of position information generated by detecting the positions of arrows A1 and A6). If no position information is detected within the period during which charge accumulation is performed in the focus detection area 100, the conversion coefficient K may be determined using position information acquired at a time close to this period.

[0081] (Variation 2) In the above embodiment, an example has been described in which the present invention is applied to a camera 1 that performs readout control using a rolling shutter method. However, the present invention can also be applied to a camera 1 that performs readout control using a global shutter method. In that case, the conversion coefficient K can be determined using the same position information for all focus detection areas of the image sensor.

[0082] (Variation 3) The body control unit 210 may switch the cycle of position detection of the image sensor 22 by the position detection unit 27 according to the charge accumulation period (corresponding to the shutter speed) of the image sensor 22. It is preferable that the body control unit 210 shortens the interval of position detection by the position detection unit 27 as the charge accumulation period becomes shorter.

[0083] (Variation 4) In the above-described embodiment and modified example, an example has been described in which shake correction is performed by moving the position of the image sensor 22. However, an image shake correction lens may be mounted in the photographing optical system 31, and shake correction may be performed by adjusting the position of the image shake correction lens.

[0084] In this case, the photographing optical system 31 of the interchangeable lens 3 has an image stabilization lens (also called an anti-vibration lens) that moves along a plane perpendicular to the optical axis of the optical system. When the image stabilization lens is driven to move, the position of the optical axis OA1 in the image sensor 22 changes. The change in the position of the optical axis OA1 caused by moving the image stabilization lens is equivalent to the change in the image height of the target focus detection area 100 caused by moving the image sensor 22 described above. Therefore, the interchangeable lens 3 has a lens position detection unit that detects the position of the image stabilization lens. The lens position detection unit is composed of an optical sensor or a magnetic sensor, etc., and detects the position of the image stabilization lens at a predetermined cycle and repeatedly generates information regarding the position of the image stabilization lens (lens position information). The lens position detection unit sequentially outputs the generated lens position information to the lens control unit 32.

[0085] The lens control unit 32 stores the lens position information repeatedly output from the lens position detection unit in an internal memory of the lens control unit 32. The lens control unit 32 reads out a plurality of pieces of lens position information stored in the internal memory at a predetermined cycle and outputs the information to the body control unit 210.

[0086] The body control unit 210 calculates the amount of shake of the camera 1 using the shake signal, and controls the position of the image shake correction lens based on the amount of shake of the camera 1. Specifically, the body control unit 210 determines the amount of movement of the image shake correction lens based on the amount of shake of the camera 1, and transmits the determined amount of movement of the image shake correction lens and a signal instructing lens drive to the lens control unit 32. When the lens control unit 32 receives the amount of movement of the image shake correction lens and a signal instructing lens drive from the body control unit 210, it controls the image shake correction lens based on the signal. The body control unit 210 controls the image shake correction lens to move (shift) along a plane perpendicular to the optical axis OA1 of the photographing optical system 31 according to the amount of shake of the camera 1. In this way, in the camera 1 according to this modified example, the position of the image shake correction lens is adjusted according to the amount of shake of the camera 1, thereby correcting the image shake of the subject image.

[0087] When the position of the image stabilization lens changes, the angle of incidence of light from the subject to the focus detection area 100 (the first and second focus detection pixels 11, 12) changes. Therefore, the focus detection unit 214 according to this modification changes the conversion coefficient K used to calculate the defocus amount according to the position of the image stabilization lens. The process performed by the focus detection unit 214 will be described below.

[0088] The focus detection unit 214 of the body control unit 210 selects, from among a plurality of pieces of lens position information acquired from the lens control unit 32, position information indicating the position of the image stabilization lens when charge is accumulated in the focus detection area 100 selected by the area selection unit 213. The correspondence relationship between the position of the image stabilization lens of the photographing optical system 31 and the conversion coefficient K is obtained in advance for each focus detection area 100 by simulation, experiment, or the like, and is stored in the memory of the camera 1 as a data table or a formula. The focus detection unit 214 calculates the position of the image stabilization lens based on the selected position information. Then, the focus detection unit 214 determines the conversion coefficient K used to calculate the defocus amount by referring to the above-mentioned correspondence relationship stored in the memory based on the information of the focus detection area 100 and the information on the position of the image stabilization lens.

[0089] As described above, the focus detection unit 214 determines the conversion coefficient K used to calculate the defocus amount using lens position information of the image stabilization lens detected during a period in which charge accumulation is performed in the focus detection area 100 where focus detection is performed, and calculates the defocus amount using the determined conversion coefficient K. For this reason, it is possible to prevent a decrease in the accuracy of focus detection when image stabilization is performed.

[0090] (Variation 5) The body control unit 210 may be configured to control both the position of the image sensor 22 and the position of the image stabilization lens, or may be capable of switching between control of the position of the image sensor 22 and control of the position of the image stabilization lens. A mode in which the position of the image sensor 22 is adjusted in response to the shake of the camera 1 and a mode in which the position of the image stabilization lens is adjusted in response to the shake of the camera 1 may be selectable by the user's operation of the operation unit 25, etc.

[0091] (Variation 6) In the above-described embodiment and modified example, the conversion coefficient K used to calculate the defocus amount is changed according to the position of the image sensor 22 and the position of the image stabilization lens. However, the defocus amount may be corrected according to the position of the image sensor 22 and the position of the image stabilization lens. Furthermore, the focus detection pixel pairs used for focus detection may be switched depending on the position of the image sensor 22 or the position of the image stabilization lens.

[0092] FIG. 8 is a diagram showing a configuration of a modified example of focus detection pixels of the image sensor 22. In addition to the imaging pixels, a plurality of types of focus detection pixel pairs having different positions of light-shielding parts are arranged in each focus detection area 100 of the image sensor 22 according to this modified example, first to third focus detection pixel pairs in the example shown in FIG. 8. FIG. 8 is a cross-sectional view of three types of focus detection pixel pairs arranged in a focus detection area 100c having a high image height and located to the right of the central focus detection area 100a in FIG. 2. FIG. 8(a) shows an example of a cross section of the first and second focus detection pixels 11a and 12a constituting the first focus detection pixel pair, and FIG. 8(b) shows an example of a cross section of the first and second focus detection pixels 11b and 12b constituting the second focus detection pixel pair. FIG. 8(c) shows an example of a cross section of the first and second focus detection pixels 11c and 12c constituting the third focus detection pixel pair. In the drawings, the same reference numerals are used to designate parts that are the same as or equivalent to those in the above-described embodiment.

[0093] In FIG. 8A, the right end of the light-shielding portion 43L of the first focus detection pixel 11a is shifted by a predetermined amount d1 in the right direction relative to the optical axis of the microlens 44. Hereinafter, the amount by which the light-shielding portion 43 (light-shielding portions 43L and 43R) is shifted from the optical axis of the microlens 44 will be referred to as the shift amount. The right end of the light-shielding portion 43L of the first focus detection pixel 11a is located to the right of the optical axis OA2 of the microlens 44 by the shift amount d1. The left end of the light-shielding portion 43R of the second focus detection pixel 12a is shifted by the same amount d1 in the same direction as the shift direction of the first focus detection pixel 11a with respect to the optical axis OA2 of the microlens 44. That is, the left end of the light-shielding portion 43R of the second focus detection pixel 12a is located to the right of the optical axis OA2 of the microlens 44 by the shift amount d1.

[0094] The second and third focus detection pixel pairs and the first focus detection pixel pair have different amounts of deviation. The amount of deviation d2 of the first and second focus detection pixels 11b, 12b constituting the second focus detection pixel pair is larger than the amount of deviation d1 of the first and second focus detection pixels 11a, 12a constituting the first AF image pair. The amount of deviation d3 of the first and second focus detection pixels 11c, 12c constituting the third focus detection pixel pair is larger than the amount of deviation d2 of the first and second focus detection pixels 11b, 12b constituting the second focus detection pixel pair. In other words, d1 <d2<d3である。

[0095] Note that the first to third focus detection pixel pairs arranged in a focus detection region 100b with a higher image height and away to the left of the central focus detection region 100a are given similar deviation amounts d1 to d3 in the opposite direction to the deviation direction shown in Fig. 8. Also, the deviation amounts of the first to third focus detection pixel pairs in each focus detection region 100 become larger for focus detection regions with higher image heights.

[0096] In this manner, in this modified example, the first to third focus detection pixel pairs have different positions of the light shielding parts, and therefore can perform pupil division in response to different angles of incidence. When the image height of the focus detection area 100 used for focus detection increases when image blur correction is performed, the angle of incidence of the light beam to the focus detection pixels of the focus detection area 100 increases. Therefore, when the image height of the focus detection area 100 used for focus detection increases, the focus detection unit 214 selects a focus detection pixel pair having a relatively large amount of deviation described above from among the multiple types of focus detection pixel pairs of the focus detection area 100. The focus detection unit 214 calculates the defocus amount using the first and second focus detection signals output from the selected focus detection pixel pairs (first and second focus detection pixels). This makes it possible to ensure the amount of light received by the photoelectric conversion unit 42 of each focus detection pixel pair, and to prevent a decrease in focus detection accuracy when image blur correction is performed.

[0097] (Variation 7) In the above embodiment, a case has been described in which a primary color (RGB) color filter is used in the imaging element 22, but a complementary color (CMY) color filter may also be used.

[0098] (Variation 8) In the above-described embodiment, the case where image blur caused by camera shake is corrected is described, but the explanation regarding image blur correction and focus detection also applies to the case where image blur caused by shake occurring in a tripod attached to camera 1 is corrected.

[0099] (Variation 9) The imaging devices described in the above-mentioned embodiments and modifications may be applied to cameras, smartphones, tablets, cameras built into PCs, in-vehicle cameras, cameras mounted on unmanned aerial vehicles (drones, radio-controlled aircraft, etc.), and the like.

[0100] Although various embodiments and modifications have been described above, the present invention is not limited to these. Other embodiments that are conceivable within the scope of the technical idea of ​​the present invention are also included within the scope of the present invention.

[0101] The disclosures of the following priority applications are incorporated herein by reference: Japan Patent Application No. 2018-137266 (filed July 20, 2018) [Explanation of symbols]

[0102] 1...camera (camera system), 2...camera body, 3...interchangeable lens, 11...focus detection pixel, 12...focus detection pixel, 13...imaging pixel, 22...imaging element, 23...body memory, 26...shake detection unit, 27...position detection unit, 31...imaging optical system, 31a...zoom lens, 31b...focus lens, 31c...aperture, 32...lens control unit, 33...lens memory, 210...body control unit, 211...imaging control unit, 212...image data generation unit, 213...area selection unit, 214...focus detection unit

Claims

1. An imaging unit including: a plurality of first pixels arranged in a first region and a second region of an imaging surface, each of which outputs a signal based on electric charges accumulated by photoelectrically converting light that has passed through a first pupil region of an optical system; and a plurality of second pixels arranged in the first region and the second region, each of which outputs a signal based on electric charges accumulated by photoelectrically converting light that has passed through a second pupil region of the optical system; A moving unit that moves the imaging unit; a detection unit that detects the focus of the optical system, a charge accumulation time of the first pixel and the second pixel in the first region is different from a charge accumulation time of the first pixel and the second pixel in the second region, the detection unit selects from a plurality of pieces of position information position information of the imaging unit corresponding to a charge accumulation time of the first pixel and the second pixel of a selected region of the first region and the second region, and performs focus detection of the optical system based on the selected position information of the imaging unit, distance information of the first pixel and the second pixel from the optical axis of the optical system during the charge accumulation time of the first pixel and the second pixel of the selected region, and signals output from the first pixel and the second pixel. Imaging device.

2. 2. The imaging device according to claim 1, The detection unit calculates distance information of the first pixel and the second pixel from the optical axis of the optical system based on position information of the imaging unit during the charge accumulation time of the first pixel and the second pixel in the selected area, and performs focus detection of the optical system.

3. 3. The imaging device according to claim 1, The detection unit determines a coefficient for converting an image shift amount based on signals output from the first pixel and the second pixel into a defocus amount based on distance information of the first pixel and the second pixel from the optical axis of the optical system during a charge accumulation time of the first pixel and the second pixel in the selected area.

4. 3. The imaging device according to claim 1, The detection unit determines a coefficient for converting an image shift amount based on signals output from the first pixel and the second pixel into a defocus amount based on positional information of the imaging unit during the charge accumulation time of the first pixel and the second pixel in the selected area.

5. 5. The imaging device according to claim 4, a storage unit that stores information regarding a position of the imaging unit and the coefficients; The detection unit determines the coefficient based on position information of the imaging unit and information stored in the storage unit.

6. An imaging unit including: a plurality of first pixels arranged in a first region and a second region of an imaging surface, each of which outputs a signal based on electric charges accumulated by photoelectrically converting light that has passed through a first pupil region of an optical system; and a plurality of second pixels arranged in the first region and the second region, each of which outputs a signal based on electric charges accumulated by photoelectrically converting light that has passed through a second pupil region of the optical system; A moving unit that moves the imaging unit; a detection unit that detects the focus of the optical system, a charge accumulation time of the first pixel and the second pixel in the first region is different from a charge accumulation time of the first pixel and the second pixel in the second region, The detection unit selects from a plurality of pieces of position information of the imaging unit position information corresponding to the charge accumulation time of the first pixel and the second pixel of a selected region among the first region and the second region, and performs focus detection of the optical system based on the selected position information of the imaging unit, distance information of the selected region from the optical axis of the optical system during the charge accumulation time of the first pixel and the second pixel of the selected region, and signals output from the first pixel and the second pixel.

7. 7. The imaging device according to claim 6, The detection section calculates the distance information based on position information of the selected imaging section, and performs focus detection of the optical system.

Images