Imaging device and imaging sensor

Abstract

To perform focusing control using a pixel signal of an appropriate phase difference pixel according to an optical characteristic of an imaging lens.SOLUTION: In an imaging device, a pixel region where a plurality of pixels are arranged and light enters through an imaging lens, has: a first phase difference pixel group F1 including a plurality of phase difference pixels in which a first side of a photoelectric conversion element is light-shielded with a light-shielding layer; and a second phase difference pixel group F2 including a plurality of phase difference pixels in which a second side of the photoelectric conversion element is light-shielded with the light-shielding layer in a first side region. The first phase difference pixel group includes first A pixels 1AL, C, R, and first B pixels 1BL, C, R in which a light-shielding area of the photoelectric conversion element by the light-shielding layer is smaller than that of the first A pixel. A control part obtains information on an optical characteristic of the imaging lens from the imaging lens, performs addition read-out processing with weighting at least for a pixel signal of the first A pixel or a pixel signal of the first B pixel according to the obtained optical characteristic, and performs addition read-out processing with weighting by a predetermined value if the information on the optical characteristic from the imaging lens cannot be obtained.SELECTED DRAWING: Figure 16

Description

[Technical field]

[0001] The technology disclosed herein relates to an imaging device and an imaging sensor. [Background technology]

[0002] There are two types of auto focus detection methods for image capture devices: contrast detection and phase difference detection. In the phase difference detection method, a light beam that passes through the exit pupil of an imaging lens is divided into two beams, and the two beams are received by a pair of phase difference pixels (also called focus detection pixels).

[0003] Japanese Patent Application Laid-Open No. 2011-101325 discloses an imaging device having multiple types of phase difference pixels with different light receiving distributions in addition to multiple imaging pixels. When multiple pixels are thinned and read out, the imaging device described in Japanese Patent Application Laid-Open No. 2011-101325 can select one thinning readout mode from multiple thinning readout modes with different thinning phases when thinning out and reading out multiple pixels. Of the multiple types of phase difference pixels, only the signal of one type of phase difference pixel is read out according to the selected thinning readout mode. Summary of the Invention [Problem to be solved by the invention]

[0004] One embodiment of the technique of the present disclosure provides an imaging device and an imaging sensor that enable focus control to be performed using pixel signals of appropriate phase difference pixels according to optical characteristics of an imaging lens. [Means for solving the problem]

[0005] In order to achieve the above object, an imaging device of the present disclosure includes a pixel region in which a plurality of pixels are arranged and in which light is incident via an imaging lens, and a control unit that controls reading of pixel signals from the pixel region, in which phase difference pixels including a photoelectric conversion element and a light shielding layer that shields a portion of light incident on the photoelectric conversion element are arranged along a first direction in the pixel region, and when one side of the first direction is defined as a first side and the other side is defined as a second side, the pixel region includes a first side region on the first side, a light shielding layer on the first side, and a phase difference pixel on the first side. and a second phase difference pixel group including a plurality of phase difference pixels whose second sides of photoelectric conversion elements are shielded by a light shielding layer, wherein the first phase difference pixel group includes a 1A pixel and a 1B pixel having a smaller light shielding area of ​​its photoelectric conversion element by the light shielding layer than that of the 1A pixel, and the control unit performs an additive readout process in which at least one of the pixel signal of the 1A pixel and the pixel signal of the 1B pixel is weighted in accordance with the optical characteristics of the imaging lens.

[0006] It is preferable that the second phase difference pixel group includes a 2A pixel and a 2B pixel having a larger light-shielding area of ​​a photoelectric conversion element by a light-shielding layer than that of the 2A pixel, and the control unit performs an additive readout process in which a weight is assigned to either the set of the 1A pixel and the 2A pixel or the set of the 1B pixel and the 2B pixel according to the optical characteristics of the imaging lens.

[0007] The pixel region has an Ath pixel line including a 1A pixel and having a plurality of pixels arranged in a first direction, and a Bth pixel line including a 1B pixel and having a plurality of pixels arranged in the first direction, the Ath pixel line and the Bth pixel line being arranged in a second direction intersecting the first direction, and it is preferable that the control unit performs an additive readout process in which either the Ath pixel line or the Bth pixel line is weighted according to the optical characteristics of the imaging lens.

[0008] The first phase difference pixel group is also included in a central region located in the center of the pixel region in the first direction, and it is preferable that, in the Ath pixel line, the light-shielding area of ​​the 1Ath pixel included in the first side region is larger than the light-shielding area of ​​the 1Ath pixel included in the central region, and, in the Bth pixel line, the light-shielding area of ​​the 1Bth pixel included in the first side region is equal to the light-shielding area of ​​the 1Bth pixel included in the central region.

[0009] It is preferable that the light blocking area of ​​the plurality of 1A pixels included in the Ath pixel line decreases from the first side region toward the central region.

[0010] It is preferable that the Ath pixel line and the Bth pixel line are adjacent to each other in the second direction.

[0011] In the pixel region, phase difference pixels included in the first phase difference pixel group are formed in a second side region on the second side, and in the A pixel line, it is preferable that a light-shielding area of ​​the 1A pixel included in the second side region is smaller than a light-shielding area of ​​the 1A pixel included in the first side region.

[0012] The optical characteristic is preferably the angle of incidence of light with respect to the pixel region, the focal length of the imaging lens, or the zoom magnification of the imaging lens.

[0013] It is preferable that the imaging lens has a variable focal length, and the control unit changes the weight when the focal length is changed and the change stops.

[0014] It is preferable that the control unit obtains optical characteristics from the imaging lens and determines the weights based on the obtained optical characteristics.

[0015] When the control unit is unable to acquire optical characteristics from the imaging lens, it is preferable that the control unit determines the weights based on the amount of exposure of light to the 1A pixel and the 1B pixel.

[0016] The second phase difference pixel group includes a 2A pixel and a 2B pixel having a light blocking area equal to that of the 1B pixel, and the control unit may set a weight for the set of the 1A pixel and the 2A pixel to zero when the optical characteristics of the imaging lens cannot be acquired.

[0017] It is preferable that the pixel region includes a gate line extending in a first direction and selecting a photoelectric conversion element that reads out a pixel signal, and a signal line extending in a second direction intersecting the first direction and through which a pixel signal is output from the photoelectric conversion element.

[0018] The addition readout process preferably includes a thinning readout process in which pixel signals weighted to zero are thinned out by setting the weight to zero, and pixel signals weighted other than zero are read out.

[0019] The image sensor disclosed herein includes a pixel region in which a plurality of pixels are arranged, and in the pixel region, phase difference pixels including a photoelectric conversion element and a light shielding layer that blocks a portion of light incident on the photoelectric conversion element are arranged along a first direction. When one side of the first direction is defined as a first side and the other side is defined as a second side, the pixel region has, in a first side region of the first side, a first phase difference pixel group including a plurality of phase difference pixels whose first sides of their photoelectric conversion elements are shielded by the light shielding layer, and a second phase difference pixel group including a plurality of phase difference pixels whose second sides of their photoelectric conversion elements are shielded by the light shielding layer, and the first phase difference pixel group includes a 1A pixel and a 1B pixel having a smaller light shielding area of ​​the photoelectric conversion element by the light shielding layer than the 1A pixel, and the second phase difference pixel group includes a 2A pixel and a 2B pixel having a larger light shielding area of ​​the photoelectric conversion element by the light shielding layer than the 2A pixel.

[0020] The pixel region includes an imaging pixel having a color filter and a photoelectric conversion element, and it is preferable that pixel 1A and pixel 2A are arranged with three or less imaging pixels therebetween, and pixel 1B and pixel 2B are arranged with three or less imaging pixels therebetween.

[0021] The pixel region has an A-th pixel line including a 1A pixel and including a plurality of pixels arranged in a first direction, and a B-th pixel line including a 1B pixel and including a plurality of pixels arranged in the first direction, and it is preferable that the A-th pixel line and the B-th pixel line are arranged in a second direction intersecting the first direction.

[0022] The first phase difference pixel group and the second phase difference pixel group are also arranged in a second side region on a second side of the pixel region, and in the second side region, it is preferable that the light-shielding area of ​​the 1A pixel is smaller than the light-shielding area of ​​the 1B pixel, and in the second side region, the light-shielding area of ​​the 2A pixel is larger than the light-shielding area of ​​the 2B pixel.

[0023] In the first side region, it is preferable that the first phase difference pixel group includes a 1C pixel having a smaller light-shielding area of ​​the photoelectric conversion element by the light-shielding layer than the 1B pixel, and in the first side region, the second phase difference pixel group includes a 2C pixel having a larger light-shielding area of ​​the photoelectric conversion element by the light-shielding layer than the 2B pixel.

[0024] It is preferable that the pixel region includes a gate line extending in a first direction and selecting a photoelectric conversion element that reads out a pixel signal, and a signal line extending in a second direction intersecting the first direction and through which a pixel signal is output from the photoelectric conversion element. [Brief description of the drawings]

[0025] [Figure 1] FIG. 2 is a schematic perspective view showing the front side of the imaging device. [Diagram 2] FIG. 2 is a schematic perspective view showing the rear side of the imaging device. [Diagram 3] FIG. 2 is a schematic diagram showing the internal configuration of the imaging device. [Figure 4] FIG. 4 is a diagram showing an example of lens information. [Diagram 5] FIG. 4 is a schematic diagram illustrating a chief ray angle. [Figure 6] FIG. 2 is a diagram illustrating an example of the configuration of an image sensor. [Figure 7] FIG. 13 is a diagram illustrating an example of addition reading. [Figure 8]FIG. 13 is a diagram showing the relationship between additive readout modes and weights. [Figure 9] FIG. 2 is a diagram showing types of pixels included in a pixel region. [Figure 10] FIG. 2 is a diagram showing a configuration of an imaging pixel. [Figure 11] FIG. 2 is a diagram illustrating a configuration of a phase difference pixel. [Figure 12] 10A and 10B are diagrams illustrating types of phase difference pixels included in each region of a pixel region. [Figure 13] FIG. 13 is a diagram illustrating a configuration of a phase difference pixel included in an A-th pixel row. [Figure 14] 13 is a diagram showing a configuration of a phase difference pixel included in a B-th pixel line. FIG. [Figure 15] FIG. 13 is a diagram illustrating a configuration of a phase difference pixel included in a C-th pixel row. [Figure 16] FIG. 2 is a diagram showing an overall configuration of a phase difference pixel included in a pixel region. [Figure 17] 5 is a flowchart showing a procedure of a process executed by a main control unit. [Figure 18] 11A and 11B are diagrams illustrating a procedure for selecting an additive readout mode based on lens information. [Figure 19] FIG. 13 is a diagram illustrating a fifth additive readout mode. [Figure 20] FIG. 13 is a diagram illustrating a sixth additive readout mode. [Figure 21] FIG. 13 is a diagram illustrating a table in which peripheral chief ray angles are associated; [Figure 22] 13 is a flowchart illustrating a weight change process according to the fourth embodiment. [Figure 23] 11A and 11B are diagrams illustrating a difference in the amount of exposure of a phase difference pixel caused by a difference in optical characteristics; [Figure 24] 13 is a flowchart illustrating a weight determination process according to the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] An example of an embodiment of the technology of the present disclosure will be described with reference to the accompanying drawings.

[0027] First, the terms used in the following description will be explained.

[0028] In the following explanation, "CPU" is an abbreviation for "Central Processing Unit". "ROM" is an abbreviation for "Read Only Memory". "RAM" is an abbreviation for "Random Access Memory". "CMOS" is an abbreviation for "Complementary Metal Oxide Semiconductor". "FPGA" is an abbreviation for "Field-Programmable Gate Array". "PLD" is an abbreviation for "Programmable Logic Device". "ASIC" is an abbreviation for "Application Specific Integrated Circuit".

[0029] In this disclosure, in the description of the present specification, "parallel" refers to parallelism in the sense of including a generally acceptable tolerance in the technical field to which the technology of the present disclosure belongs, in addition to completely parallelism. In this disclosure, "equal" refers to substantially equality in the sense of including a generally acceptable tolerance in the technical field to which the technology of the present disclosure belongs, in addition to completely equality.

[0030] [First embodiment] The technology of the present disclosure will be described using a digital camera with interchangeable lenses as an example of a first embodiment of an imaging device.

[0031] 1, the imaging device 10 is a digital camera with interchangeable lenses. The imaging device 10 includes a main body 11 and an imaging lens 12 that is replaceably attached to the main body 11.

[0032] A camera-side mount 11A is provided on a front surface 11C of the main body 11. A lens-side mount 12A is provided on the rear end side of the imaging lens 12. The imaging lens 12 is connected to the main body 11 by attaching the lens-side mount 12A to the camera-side mount 11A.

[0033] In this embodiment, the imaging lens 12 is a single-focus lens with a fixed focal length. A plurality of types of imaging lenses 12 with different focal lengths can be attached to the body 11.

[0034] The main body 11 is provided with an imaging sensor 20. The light receiving surface 20A of the imaging sensor 20 is exposed from an opening of the camera-side mount 11A. When the imaging lens 12 is attached to the main body 11, a light beam from a subject passes through the imaging lens 12 and is imaged on the light receiving surface 20A of the imaging sensor 20. The imaging sensor 20 captures an image of the light beam imaged on the light receiving surface 20A and generates an imaging signal.

[0035] A dial 13 and a release button 14 are provided on the top surface of the main body 11. The dial 13 is operated when setting an operation mode, etc. The operation modes of the imaging device 10 include, for example, a still image capturing mode and a video capturing mode. The release button 14 is operated when starting imaging in the still image capturing mode or the video capturing mode.

[0036] 2, a display 15 and instruction keys 16 are provided on a rear surface 11D of the main body 11. The display 15 displays images based on image data obtained by imaging, various menu screens, and the like.

[0037] The instruction keys 16 accept various instructions. Here, "various instructions" refers to, for example, an instruction to display a menu screen from which various menus can be selected, an instruction to select one or more menus, an instruction to confirm the selected content, an instruction to erase the selected content, an autofocus mode, a manual focus mode, frame-by-frame advance, and various other instructions. In addition, the main body 11 is provided with a power switch, etc.

[0038] 3 shows the internal configuration of the imaging device 10 with the imaging lens 12 attached to the main body 11. The main body 11 and the imaging lens 12 are electrically connected by electrical contacts 11B provided on the camera-side mount 11A coming into contact with electrical contacts 12B provided on the lens-side mount 12A.

[0039] The imaging lens 12 includes an objective lens 30, a focus lens 31, a rear end lens 32, and an aperture 33. The respective components are arranged along an optical axis OP of the imaging lens 12 in the following order from the objective side: objective lens 30, aperture 33, focus lens 31, and rear end lens 32. The objective lens 30, focus lens 31, and rear end lens 32 constitute an imaging optical system. The type, number, and arrangement order of the lenses that constitute the imaging optical system are not limited to the example shown in FIG.

[0040] The imaging lens 12 also has a lens drive control unit 34 and a memory 35. The lens drive control unit 34 is composed of a CPU, RAM, ROM, etc. The lens drive control unit 34 is electrically connected to a main control unit 40 in the main body 11 via an electrical contact 12B and an electrical contact 11B.

[0041] The lens drive control unit 34 drives the focus lens 31 and the aperture 33 based on a control signal transmitted from the main control unit 40. The lens drive control unit 34 controls the drive of the focus lens 31 based on a control signal for focus control transmitted from the main control unit 40 in order to adjust the focus position of the imaging lens 12. The main control unit 40 performs focus control by a phase difference method.

[0042] The diaphragm 33 has an aperture whose diameter is variable around the optical axis OP. The lens drive control unit 34 controls the drive of the diaphragm 33 based on a control signal for adjusting the diaphragm transmitted from the main control unit 40 in order to adjust the amount of light incident on the light receiving surface 20A of the image sensor 20.

[0043] The memory 35 is a non-volatile memory such as a flash memory. The memory 35 stores lens information 35A relating to the optical characteristics of the imaging lens 12. This lens information 35A is information that differs for each type of imaging lens 12. The lens information 35A includes information relating to the angle of incidence of the chief ray with respect to the light receiving surface 20A of the imaging sensor 20 (hereinafter referred to as the chief ray angle).

[0044] The main body 11 has an image sensor 20, a main control unit 40, an image processing unit 41, an operation unit 42, and a display 15. The operations of the image sensor 20, the image processing unit 41, the operation unit 42, and the display 15 are controlled by the main control unit 40. The main control unit 40 is composed of a CPU, a RAM, a ROM, etc.

[0045] The imaging sensor 20 is, for example, a CMOS image sensor. The imaging sensor 20 is disposed such that its optical axis OP is perpendicular to the light receiving surface 20A and is located at the center of the light receiving surface 20A. A light flux LF that has passed through an exit pupil EP of the imaging lens 12 is incident on the light receiving surface 20A. A plurality of pixels that generate pixel signals by performing photoelectric conversion are formed on the light receiving surface 20A. The imaging sensor 20 performs photoelectric conversion on the light incident on each pixel to generate an imaging signal composed of pixel signals of each pixel.

[0046] The image processing unit 41 generates image data in a predetermined file format (for example, JPEG format) by performing various image processing on the imaging signal. The display 15 displays images based on the image data generated by the image processing unit 41. The images include still images, videos, and live view images. The live view images are images displayed in real time on the display 15 by sequentially outputting the image data generated by the image processing unit 41 to the display 15.

[0047] The image data generated by the image processing unit 41 can be stored in an internal memory (not shown) built into the main body 11, or in a storage medium (such as a memory card) that is detachable from the main body 11.

[0048] The operation unit 42 includes the above-mentioned dial 13, release button 14, and instruction keys 16 (see FIGS. 1 and 2). The main control unit 40 controls each unit in the main body 11 and the lens drive control unit 34 in the imaging lens 12 in response to the operation of the operation unit 42.

[0049] Furthermore, when the imaging lens 12 is connected to the body 11, the main controller 40 acquires the lens information 35A stored in the memory 35 via the lens drive controller 34. In this embodiment, the main controller 40 performs focusing control by the phase difference method based on the chief ray angle information included in the lens information 35A.

[0050] 4 is an example of lens information 35A stored in memory 35. In the lens information 35A, the chief ray angle θ is recorded as a numerical value indicating the relationship with the image height H. In addition to the chief ray angle θ, the lens information 35A may also include an upper ray angle and a lower ray angle, etc. This information is specific to the imaging lens 12, and is obtained from design data of the imaging optical system.

[0051] Fig. 5 is a schematic diagram for explaining the chief ray angle θ. As shown in Fig. 5, the chief ray angle θ is the angle between the chief ray PR passing through the center of the exit pupil EP and the normal to the light receiving surface 20A at the image point IP. The image height H represents the distance from the optical axis OP to the image point IP.

[0052] The chief ray angle θ is "0" when the image point IP coincides with the center of the light receiving surface 20A (i.e., when H=0). The chief ray angle θ increases as the image point IP moves away from the center of the light receiving surface 20A (i.e., as the image height H increases). Note that the symbol UR in FIG. 5 indicates an upper ray, and the symbol LR indicates a lower ray.

[0053] 6 shows an example of the configuration of an image sensor 20. The image sensor 20 has a pixel region 21, a vertical scanning circuit 22, a line memory 23, a horizontal scanning circuit 24, and an output amplifier 25. In the pixel region 21, a plurality of pixels 26 are arranged in a two-dimensional matrix along the X direction and the Y direction. The pixels 26 include photoelectric conversion elements 27 that convert incident light into signal charges and accumulate the charges. The photoelectric conversion elements 27 are formed of photodiodes. The pixels 26 also include an amplifier that converts the signal charges into a voltage signal (hereinafter referred to as a pixel signal), a reset switch, and the like. The pixels 26 output a pixel signal S according to the amount of incident light.

[0054] Here, the Y direction is perpendicular to the X direction. The X direction is an example of a "first direction" according to the technology of the present disclosure. The Y direction is an example of a "second direction" according to the technology of the present disclosure.

[0055] A plurality of gate lines 22A extending in the X direction are connected to the vertical scanning circuit 22. A plurality of signal lines 23A extending in the Y direction are connected to the line memory 23. The plurality of gate lines 22A and the plurality of signal lines 23A intersect with each other in the pixel region 21. Each pixel 26 is provided at a location where the gate line 22A and the signal line 23A intersect. Each pixel 26 is connected to the signal line 23A via a transistor 28 serving as a switch. A gate electrode of the transistor 28 is connected to the gate line 22A.

[0056] The pixels 26 in the pixel region 21 are selected row by row by a selection signal provided to a gate line 22A from the vertical scanning circuit 22. When the selection signal is provided to the gate line 22A by the vertical scanning circuit 22, a pixel signal S is output to a signal line 23A from each pixel 26 connected to the gate line 22A. Hereinafter, a plurality of pixels 26 aligned in the X direction may be simply referred to as a "row."

[0057] The line memory 23 stores pixel signals S output from one row of pixels 26. The line memory 23 is composed of a capacitor or the like. The line memory 23 is connected to a horizontal output line 24A via a transistor 29 serving as a switch. The output amplifier 25 is connected to an end of the horizontal output line 24A. The horizontal scanning circuit 24 performs horizontal scanning to sequentially select the transistors 29, thereby sequentially outputting one row of pixel signals S stored in the line memory 23 to the horizontal output line 24A. The pixel signals S output to the horizontal output line 24A are output to an external image processing unit 41 as an imaging signal via the output amplifier 25.

[0058] The operations of the vertical scanning circuit 22, the line memory 23, and the horizontal scanning circuit 24 are controlled by a main control unit 40. The main control unit 40 controls the vertical scanning circuit 22 to enable the reading of pixel signals S by a "sequential readout method" or an "addition readout method." The sequential readout method is a method in which the pixel signals S are read out row by row by selecting the gate lines 22A in sequence in the Y direction.

[0059] The additive readout method is a method in which pixel signals S for multiple rows are added and read out according to the weights by assigning weights to each of the multiple gate lines 22A. Note that additive readout also includes thinning readout, in which the weight for at least one gate line 22A is set to zero, and the pixel signals S included in the rows with the weight set to zero are not read (i.e., thinned out).

[0060] The image sensor 20 may include an A / D converter to output a digitized image signal. The main control unit 40 is an example of a "control unit" according to the technology of the present disclosure. The image sensor 20 may include a control unit for controlling the vertical scanning circuit 22, the line memory 23, and the horizontal scanning circuit 24 in addition to the main control unit 40.

[0061] Fig. 7 shows an example of additive readout. Fig. 7 shows an example in which the signal amount of the image pickup signal is reduced to 1 / 4 by performing additive readout with weighting for every four rows in the Y direction. In this example, a "1 / 4 pixel thinning readout" is described, in which pixel signal S is read from one row out of four rows.

[0062] 7, the addresses (hereinafter referred to as row addresses) of the gate lines 22A are 0, 1, 2, 3, ... in order. In this example, the main control unit 40 sets a weight of "0" or "1" to each row address. The weight of a row with a row address of 4n is W0, the weight of a row with a row address of 4n+1 is W1, the weight of a row with a row address of 4n+2 is W2, and the weight of a row with a row address of 4n+3 is W3. Here, n is a natural number including 0 (i.e., n=0, 1, 2, 3, ...).

[0063] In this example, the main control unit 40 sets W0=1, W1=0, W2=0, and W3=0. Then, the vertical scanning circuit 22 performs additive reading on row addresses 4n to 4n+3 as a set based on the set weights W0 to W3. When performing additive reading, the vertical scanning circuit 22 provides a selection signal to rows with a weight of "1" to turn on the transistors 28, and does not provide a selection signal to rows with a weight of "0" to turn off the transistors 28. As a result, pixel signals S are read out only from the row with row address 4n among the row addresses 4n to 4n+3. Therefore, in this example, pixel signals S are output to the signal line 23A for every four rows in the order of row addresses 0, 4, 8, . . .

[0064] The main control unit 40 can execute one of four additive readout modes by changing the weights W0 to W3. Fig. 8 shows the weights W0 to W3 corresponding to the first additive readout mode M1, the second additive readout mode M2, the third additive readout mode M3, and the fourth additive readout mode M4. The first additive readout mode M1 corresponds to the readout method shown in Fig. 7, and the readout row address from which the pixel signal S is read out is "4n".

[0065] The second additive read mode M2 ​​is executed by setting the weight W1 to "1" and the other weights W0, W2, and W3 to "0", and the read row address is "4n+1". The third additive read mode M3 is executed by setting the weight W2 to "1" and the other weights W0, W1, and W3 to "0", and the read row address is "4n+2". The fourth additive read mode M4 is executed by setting the weight W3 to "1" and the other weights W0, W1, and W2 to "0", and the read row address is "4n+3".

[0066] Fig. 9 shows the types of pixels 26 (see Fig. 6) included in the pixel region 21. The symbols R, G, and B in Fig. 9 represent the colors of color filters provided in the pixels 26. The pixels 26 provided with these color filters are pixels used for imaging to generate an image, and therefore will be referred to as imaging pixels N hereinafter.

[0067] The color arrangement of the color filters shown in Fig. 9 is a so-called Bayer arrangement. In the Bayer arrangement, G (green) color filters are arranged in two diagonal pixels of the four 2 x 2 pixels, and R (red) and B (blue) color filters are arranged in the other two pixels. Note that the color arrangement of the color filters is not limited to the Bayer arrangement, and may be other color arrangements.

[0068] 9 indicates a phase difference pixel. A color filter is not provided in the phase difference pixel F. Although described in detail later, the phase difference pixel F receives one of the light beams split in the X direction with the principal ray as the center.

[0069] The phase difference pixels F are arranged in the pixel region 21 by replacing some of the imaging pixels N in the Bayer array. For example, the phase difference pixels F are arranged every three pixels (i.e., every two pixels) in the X direction. The phase difference pixels F are divided into a first phase difference pixel group F1 and a second phase difference pixel group F2. The first phase difference pixel group F1 is composed of phase difference pixels F that receive one of the light beams split in the X direction around the principal ray. The second phase difference pixel group F2 is composed of phase difference pixels F that receive the other of the light beams split in the X direction around the principal ray.

[0070] Further, the first phase difference pixel group F1 and the second phase difference pixel group F2 are divided into a plurality of types of phase difference pixels F having different light receiving characteristics according to the optical characteristics of the imaging lens 12. In Fig. 9, an A-th pixel line LA in which phase difference pixels F corresponding to the first optical characteristic are arranged, a B-th pixel line LB in which phase difference pixels F corresponding to the second optical characteristic are arranged, and a C-th pixel line LC in which phase difference pixels F corresponding to the third optical characteristic are arranged are provided. In this example, the A-th pixel line LA, the B-th pixel line LB, and the C-th pixel line LC are arranged adjacent to each other in this order in the Y direction.

[0071] For example, the A-th pixel line LA is arranged in a row with row address 4n, the B-th pixel line LB is arranged in a row with row address 4n+1, and the C-th pixel line LC is arranged in a row with row address 4n+2. In this example, there are multiple A-th pixel lines LA, multiple B-th pixel lines LB, and multiple C-th pixel lines LC. Fig. 9 shows two sets of the A-th pixel line LA, the B-th pixel line LB, and the C-th pixel line LC arranged at positions separated by m rows in the Y direction.

[0072] The Ath pixel line LA, the Bth pixel line LB, and the Cth pixel line LC are selectively read out by the aforementioned additive readout mode (see FIG. 9). Specifically, the Ath pixel line LA is read out by the first additive readout mode M1. The Bth pixel line LB is read out by the second additive readout mode M2. The Cth pixel line LC is read out by the third additive readout mode M3. That is, by selecting an additive readout mode, it is possible to read out a pixel line including a phase difference pixel F corresponding to the optical characteristics of the imaging lens 12.

[0073] 10 shows the configuration of an imaging pixel N. The imaging pixel N includes a photoelectric conversion element 27, a color filter CF, and a microlens ML. The color filter CF is disposed between the photoelectric conversion element 27 and the microlens ML. The color filter CF is a filter that transmits light of any one of the colors R, G, and B.

[0074] The microlens ML focuses the light beam incident from the exit pupil EP onto the photoelectric conversion element 27 via the color filter CF. The larger the image height H, the more the microlens ML is disposed at a position shifted from the center of the photoelectric conversion element 27. Specifically, with the position of H=0 as a reference, the microlens ML located on one side in the X direction (hereinafter referred to as the first side) is disposed at a position shifted from the center of the photoelectric conversion element 27 to the other side in the X direction (hereinafter referred to as the second side). Conversely, with the position of H=0 as a reference, the microlens ML located on the second side in the X direction is disposed at a position shifted from the center of the photoelectric conversion element 27 to the first side.

[0075] Since the chief ray angle θ, which is the angle of incidence of the chief ray PR of the light beam entering from the exit pupil EP, increases as the image height H increases, by shifting the microlens ML as described above, it is possible to make the chief ray PR incident on approximately the center of the photoelectric conversion element 27. Similarly, in the Y direction, the microlens ML is disposed at a position shifted from the center of the photoelectric conversion element 27 as the image height H increases. In this way, by shifting the microlens ML, it is possible to improve the reduction in the amount of received light in the peripheral region of the pixel region 21 (see FIG. 6).

[0076] Fig. 11 illustrates a configuration of the phase difference pixel F. Specifically, Fig. 11 illustrates a configuration of the phase difference pixel F included in the first phase difference pixel group F1 and the second phase difference pixel group F2 in a central region located at the center in the X direction of the pixel region 21.

[0077] The phase difference pixel F includes a photoelectric conversion element 27, a light blocking layer SF, and a microlens ML. The microlens ML is disposed at the same position as the imaging pixel N. That is, the greater the image height H, the more the microlens ML is disposed at a position shifted from the center of the photoelectric conversion element 27. The phase difference pixel F shown in FIG. 11 is located in the central region of the pixel region 21 (that is, the image height H is approximately 0), and therefore the amount of shift of the microlens ML from the center of the photoelectric conversion element 27 is approximately 0.

[0078] The light-shielding layer SF is formed of a metal film or the like, and is disposed between the photoelectric conversion element 27 and the microlens ML. The light-shielding layer SF blocks a part of the light flux LF incident on the photoelectric conversion element 27 via the microlens ML.

[0079] In the central part of the pixel region 21, since the chief ray angle θ is approximately 0, the phase difference pixels F included in the first phase difference pixel group F1 and the phase difference pixels F included in the second phase difference pixel group F2 have a symmetrical structure with respect to the X direction.

[0080] In the phase difference pixel F included in the first phase difference pixel group F1, the light shielding layer SF shields the first side with reference to the center of the photoelectric conversion element 27. That is, in the phase difference pixel F included in the first phase difference pixel group F1, the light shielding layer SF allows a light flux from an exit pupil EP1 on the first side to be incident on the photoelectric conversion element 27, and shields a light flux from an exit pupil EP2 on the second side.

[0081] In the phase difference pixel F included in the second phase difference pixel group F2, the light shielding layer SF shields the second side with reference to the center of the photoelectric conversion element 27. That is, in the phase difference pixel F included in the second phase difference pixel group F2, the light shielding layer SF allows a light flux from an exit pupil EP2 on the second side to be incident on the photoelectric conversion element 27, and shields a light flux from an exit pupil EP1 on the first side.

[0082] 12 shows the types of phase difference pixels F included in each region of the pixel region 21. First, in a central region located at the center of the pixel region 21 in the X direction, the first phase difference pixel group F1 includes a 1A pixel 1AC, a 1B pixel 1BC, and a 1C pixel 1CC, and the second phase difference pixel group F2 includes a 2A pixel 2AC, a 2B pixel 2BC, and a 2C pixel 2CC. The 1A pixel 1AC and the 2A pixel 2AC are arranged on an A-th pixel line LA. The 1B pixel 1BC and the 2B pixel 2BC are arranged on a B-th pixel line LB. The 1C pixel 1CC and the 2C pixel 2CC are arranged on a C-th pixel line LC.

[0083] In a first side region located on a first side in the X direction of the pixel region 21, the first phase difference pixel group F1 includes a first A pixel 1AL, a first B pixel 1BL, and a first C pixel 1CL, and the second phase difference pixel group F2 includes a second A pixel 2AL, a second B pixel 2BL, and a second C pixel 2CL. The first A pixel 1AL and the second A pixel 2AL are arranged on an A pixel line LA. The first B pixel 1BL and the second B pixel 2BL are arranged on a B pixel line LB. The first C pixel 1CL and the second C pixel 2CL are arranged on a C pixel line LC.

[0084] In a second side region located on the second side in the X direction of the pixel region 21, the first phase difference pixel group F1 includes a 1A pixel 1AR, a 1B pixel 1BR, and a 1C pixel 1CR, and the second phase difference pixel group F2 includes a 2A pixel 2AR, a 2B pixel 2BR, and a 2C pixel 2CR. The 1A pixel 1AR and the 2A pixel 2AR are arranged on an A-th pixel line LA. The 1B pixel 1BR and the 2B pixel 2BR are arranged on a B-th pixel line LB. The 1C pixel 1CR and the 2C pixel 2CR are arranged on a C-th pixel line LC.

[0085] For example, the first side region and the second side region are peripheral regions located around the pixel region 21. The first side region and the second side region are provided at positions symmetrical in the X direction with respect to the central region. For example, the first side region and the second side region are provided at a position where the image height H is "1".

[0086] 13 shows a configuration of the phase difference pixel F included in the A-th pixel line LA. In the following description, the area of ​​the photoelectric conversion element 27 that is shielded from light by the light shielding layer SF is referred to as a light shielding area.

[0087] The A-th pixel line LA includes a phase difference pixel F corresponding to the first optical characteristic. The first optical characteristic is characterized in that the chief ray angle in the peripheral region of the pixel region 21 (hereinafter referred to as the peripheral chief ray angle) is 0. That is, in the first optical characteristic, the chief ray angle θ does not depend on the image height H, and all the chief rays PR are parallel to the optical axis OP. Note that the peripheral chief ray angle is the chief ray angle in the first side region and the second side region, and is, for example, the chief ray angle corresponding to H=1. Hereinafter, the peripheral chief ray angle of the first optical characteristic is referred to as the first peripheral chief ray angle θ1.

[0088] The 1A pixel 1AC and the 2A pixel 2AC included in the central region have the same configuration as the pair of phase difference pixels F shown in Fig. 11. The 1A pixel 1AC and the 2A pixel 2AC have a symmetrical structure with respect to the X direction. Therefore, the light-shielding area S1AC of the 1A pixel 1AC is equal to the light-shielding area S2AC of the 2A pixel 2AC.

[0089] In the 1A pixel 1AL and the 2A pixel 2AL included in the first side region, similarly to the above-mentioned imaging pixel N, the microlens ML is disposed at a position shifted toward the central region (second side) from the center of the photoelectric conversion element 27. In the first optical characteristic, since θ1=0, the chief ray PR is incident on a position shifted from the center of the photoelectric conversion element 27 by a distance corresponding to the amount of shift of the microlens ML.

[0090] In the 1A pixel 1AL, the light-shielding layer SF is disposed on a first side from the incident position of the principal ray PR of the photoelectric conversion element 27 so as to block the light beam from the exit pupil EP2. In the 2A pixel 2AL, the light-shielding layer SF is disposed on a second side from the incident position of the principal ray PR of the photoelectric conversion element 27 so as to block the light beam from the exit pupil EP1.

[0091] Therefore, the light-shielded area S1AL of the 1A pixel 1AL is larger than the light-shielded area S1AC of the 1A pixel 1AC included in the central region, whereas the light-shielded area S2AL of the 2A pixel 2AL is smaller than the light-shielded area S2AC of the 2A pixel 2AC included in the central region.

[0092] The 1A pixel 1AR included in the second side region has a structure symmetrical in the X direction with the 2A pixel 2AL included in the first side region. The 2A pixel 2AR included in the second side region has a structure symmetrical in the X direction with the 1A pixel 1AL included in the first side region. Therefore, the light-shielding area S1AR of the 1A pixel 1AR is smaller than the light-shielding area S1AC of the 1A pixel 1AC included in the central region. On the other hand, the light-shielding area S2AR of the 2A pixel 2AR is larger than the light-shielding area S2AC of the 2A pixel 2AC included in the central region.

[0093] 14 shows a configuration of a phase difference pixel F included in the B-th pixel line LB. The B-th pixel line LB includes a phase difference pixel F corresponding to a second optical characteristic. The second optical characteristic has a feature that the peripheral chief ray angle is greater than 0. Hereinafter, the peripheral chief ray angle of the second optical characteristic is referred to as a second peripheral chief ray angle θ2.

[0094] The 1B pixel 1BC and the 2B pixel 2BC included in the central region have the same configuration as the 1A pixel 1AC and the 2A pixel 2AC included in the central region of the A pixel line LA. The 1B pixel 1BC and the 2B pixel 2BC have a symmetrical structure with respect to the X direction. Therefore, the light-shielding area S1BC of the 1B pixel 1BC is equal to the light-shielding area S2BC of the 2B pixel 2BC.

[0095] In the 1B pixel 1BL and the 2B pixel 2BL included in the first side region, the microlens ML is disposed at a position shifted toward the central region (second side) from the center of the photoelectric conversion element 27. With the second optical characteristic, in the first side region, the main ray PR is incident on approximately the center of the photoelectric conversion element 27.

[0096] In the 1B pixel 1BL, the light shielding layer SF is disposed on a first side from the incident position of the principal ray PR of the photoelectric conversion element 27 so as to shield the light beam from the exit pupil EP2. In the 2B pixel 2BL, the light shielding layer SF is disposed on a second side from the incident position of the principal ray PR of the photoelectric conversion element 27 so as to shield the light beam from the exit pupil EP1.

[0097] Therefore, the light-shielded area S1BL of the 1B pixel 1BL is equal to the light-shielded area S1BC of the 1B pixel 1BC included in the central region, and the light-shielded area S2BL of the 2B pixel 2BL is equal to the light-shielded area S2BC of the 2B pixel 2BC included in the central region.

[0098] The 1B pixel 1BR included in the second side region has a structure symmetrical in the X direction with the 2B pixel 2BL included in the first side region. The 2B pixel 2BR included in the second side region has a structure symmetrical in the X direction with the 1B pixel 1BL included in the first side region. Therefore, the light-shielding area S1BR of the 1B pixel 1BR is equal to the light-shielding area S1BC of the 1B pixel 1BC included in the central region. In addition, the light-shielding area S2BR of the 2B pixel 2BR is equal to the light-shielding area S2BC of the 2B pixel 2BC included in the central region.

[0099] 15 shows the configuration of the phase difference pixel F included in the Cth pixel line LC. The Cth pixel line LC includes a phase difference pixel F corresponding to a third optical characteristic. The third optical characteristic has a feature that the peripheral chief ray angle is larger than that of the second optical characteristic. Hereinafter, the peripheral chief ray angle of the third optical characteristic is referred to as a third peripheral chief ray angle θ3.

[0100] The 1C pixel 1CC and the 2C pixel 2CC included in the central region have the same configuration as the 1B pixel 1BC and the 2B pixel 2BC included in the central region of the B pixel line LB. The 1C pixel 1CC and the 2C pixel 2CC have a symmetrical structure with respect to the X direction. Therefore, the light-shielding area S1CC of the 1C pixel 1CC is equal to the light-shielding area S2CC of the 2C pixel 2CC.

[0101] In the first C pixel 1CL and the second C pixel 2CL included in the first side region, the microlens ML is disposed at a position shifted toward the central region (second side) from the center of the photoelectric conversion element 27. In the third optical characteristic, θ3>θ2, and therefore, in the first side region, the main ray PR is incident on the first side relative to the center of the photoelectric conversion element 27.

[0102] In the 1C pixel 1CL, the light shielding layer SF is disposed on a first side from the incident position of the principal ray PR of the photoelectric conversion element 27 so as to shield the light beam from the exit pupil EP2. In the 2C pixel 2CL, the light shielding layer SF is disposed on a second side from the incident position of the principal ray PR of the photoelectric conversion element 27 so as to shield the light beam from the exit pupil EP1.

[0103] Therefore, the light-shielded area S1CL of the 1C pixel 1CL is smaller than the light-shielded area S1CC of the 1C pixel 1CC included in the central region, whereas the light-shielded area S2CL of the 2C pixel 2CL is larger than the light-shielded area S2CC of the 2C pixel 2CC included in the central region.

[0104] The first C pixel 1CR included in the second side region has a symmetric structure with respect to the X direction with the second C pixel 2CL included in the first side region. The second C pixel 2CR included in the second side region has a symmetric structure with respect to the X direction with the first C pixel 1CL included in the first side region. Therefore, the light-shielding area S1CR of the first C pixel 1CR is larger than the light-shielding area S1CC of the first C pixel 1CC included in the central region. Also, the light-shielding area S2CR of the second C pixel 2CR is smaller than the light-shielding area S2CC of the second C pixel 2CC included in the central region.

[0105] From the above relationships, when comparing the light-shielding areas, for the A pixel line LA, the relationships of "S1AL > S1AC > S1AR" and "S2AL < S2AC < S2AR" are obtained. For the B pixel line LB, the relationships of "S1BL = S1BC = S1BR" and "S2BL = S2BC = S2BR" are obtained. For the C pixel line LC, the relationships of "S1CL < S1CC < S1CR" and "S2CL > S2CC > S2CR" are obtained.

[0106] Also, for the first side region, the relationships of "S1AL > S1BL > S1CL" and "S2AL < S2BL < S2CL" are obtained. For the central region, the relationships of "S1AC = S1BC = S1CC" and "S2AC = S2BC = S2CC" are obtained. For the second side region, the relationships of "S1AR < S1BR < S1CR" and "S2AR > S2BR > S2CR" are obtained.

[0107] FIG. 16 shows the overall configuration of the retardation pixel F included in the pixel region 21. As shown in FIG. 16, in the pixel region 21, a plurality of sets of the A pixel line LA, the B pixel line LB, and the C pixel line LC are provided in the Y direction. Note that it is sufficient if at least one set of the A pixel line LA, the B pixel line LB, and the C pixel line LC is provided in the pixel region 21.

[0108] In the above description, the configuration of the phase difference pixels F provided in the central region, the first side region, and the second side region has been described, but similar phase difference pixels F are also provided along each pixel line between the central region and the first side region, and between the central region and the second side region. In these phase difference pixels F, a light shielding layer SF is formed so as to receive a light beam from the exit pupil EP1 or the exit pupil EP2 according to the optical characteristics corresponding to the pixel line.

[0109] The light-shielding areas of the multiple 1A pixels arranged in the A-th pixel line LA decrease from the first side toward the second side. Note that the light-shielding areas of the multiple 1A pixels arranged in the A-th pixel line LA do not all need to be different, and some of the 1A pixels may have the same light-shielding area.

[0110] The light-shielding areas of the multiple 2A pixels arranged in the A-th pixel line LA increase from the first side toward the second side. Note that the light-shielding areas of the multiple 2A pixels arranged in the A-th pixel line LA do not all need to be different, and some of the 2A pixels may have the same light-shielding area.

[0111] The light-shielding areas of the plurality of 1B pixels arranged in the B-th pixel line LB are all equal to each other, and similarly, the light-shielding areas of the plurality of 2B pixels arranged in the B-th pixel line LB are all equal to each other.

[0112] The light-shielding areas of the multiple 1C pixels arranged in the C-th pixel line LC increase from the first side toward the second side. Note that the light-shielding areas of the multiple 1C pixels arranged in the C-th pixel line LC do not all need to be different, and some of the 1C pixels may have the same light-shielding area.

[0113] The light-shielding areas of the multiple 2C pixels arranged in the C-th pixel line LC decrease from the first side toward the second side. Note that the light-shielding areas of the multiple 2C pixels arranged in the C-th pixel line LC do not all need to be different, and some of the 2C pixels may have the same light-shielding area.

[0114] Next, a description will be given of the operation of the imaging device 10. Fig. 17 is a flow chart showing an example of the flow of processing executed by the main control unit 40.

[0115] First, in step S10, the main controller 40 acquires lens information 35A (see FIG. 4) from the imaging lens 12 attached to the body 11. For example, the main controller 40 acquires the lens information 35A when the power switch is turned on with the imaging lens 12 attached to the body 11. The lens information 35A includes chief ray angle information as an optical characteristic of the imaging lens 12.

[0116] In step S11, when an operation mode is selected by the dial 13, the main control unit 40 determines whether or not the selected operation mode is a moving image capture mode. If the selected operation mode is the moving image capture mode (step S11: YES), the main control unit 40 shifts the process to step S12. If the selected operation mode is not the moving image capture mode, i.e., the still image capture mode (step S11: NO), the main control unit 40 shifts the process to step S13.

[0117] In step S12, the main control unit 40 selects the additive readout mode (see FIG. 8) based on the lens information 35A acquired in step S10. The selection of the additive readout mode corresponds to the determination of weights W1 to W3 for the multiple pixel signals S to be subjected to additive readout.

[0118] Specifically, as shown in FIG. 18, the main controller 40 acquires a peripheral chief ray angle θp (for example, a chief ray angle θ corresponding to H=1) by referring to the lens information 35A. The main controller 40 selects an additive readout mode corresponding to a pixel line corresponding to a peripheral chief ray angle closest to the peripheral chief ray angle θp acquired from the lens information 35A among the first peripheral chief ray angle θ1, the second peripheral chief ray angle θ2, and the third peripheral chief ray angle θ3. For example, when the peripheral chief ray angle θp included in the lens information 35A is closest to the second peripheral chief ray angle θ2, the main controller 40 selects the second additive readout mode M2 ​​corresponding to the B-th pixel line LB. The second additive readout mode M2 ​​is selected by setting W1=1, W0=W2=W3=0.

[0119] When the autofocus mode is selected by the command key 16, the main control unit 40 selects one of the first additive readout mode M1, the second additive readout mode M2, or the third additive readout mode M3. On the other hand, when the manual focus mode is selected by the command key 16, the main control unit 40 selects the fourth additive readout mode M4.

[0120] Returning to FIG. 17, in step S13, the main control unit 40 selects a sequential readout mode in which the pixel signals S are read out in a sequential readout manner.

[0121] In the next step S14, the main control unit 40 determines whether or not an image capture start instruction has been issued by operating the release button 14. If an image capture start instruction has been issued (step S14: YES), the main control unit 40 transitions the process to step S15.

[0122] In step S15, the main controller 40 causes the image sensor 20 to perform an image capturing operation based on the mode selected in step S12 or step S13. When the moving image capturing mode is selected, the main controller 40 controls the reading of pixel signals S from the pixel area 21 based on the additive readout mode selected in step S12. As a result, pixel signals S are read out from the pixel area 21 in sequence from the rows whose weight is set to "1", i.e., the rows corresponding to the pixel line selected in step S12.

[0123] For example, in step S12, when the second additive readout mode M2 ​​corresponding to the B-th pixel line LB is selected, the pixel signal S is selectively read out from the row at the row address 4n+1 that includes the B-th pixel line LB. The pixel signal S read out from the imaging pixel N and the pixel signal S read out from the phase difference pixel F are input to the image processing unit 41 as imaging signals.

[0124] In addition, when the fourth additive readout mode M4 is selected in step S12, the pixel signal S is read out from the row of row address 4n+3 that does not include the phase difference pixel F, so that only the pixel signal S read out from the imaging pixel N is input to the image processing unit 41.

[0125] In step S16, image processing is performed by the image processing unit 41. The image processing unit 41 generates image data representing the subject image by performing demosaic processing or the like based on the pixel signals S read out from the imaging pixels N. Note that, since the image processing unit 41 cannot obtain pixel signals for imaging from the phase difference pixels F, it obtains pixel values ​​corresponding to the positions of the phase difference pixels F in the image data by performing complementation processing based on pixel values ​​in the vicinity of the pixel values.

[0126] Furthermore, in step S16, the main controller 40 performs focusing control by the phase difference method based on the pixel signals S read out from the phase difference pixels F. Specifically, the main controller 40 adjusts the position of the focus lens 31 so as to reduce the phase difference between the image of the pixel signals S obtained from the phase difference pixels F included in the first phase difference pixel group F1 and the image of the pixel signals S obtained from the phase difference pixels F included in the second phase difference pixel group F2. For example, when the B-th pixel line LB is selected, focusing control is performed based on the phase difference between the pixel signals S of the 1B pixel 1BL, the 1B pixel 1BC, and the 1B pixel 1BR and the pixel signals S of the 2B pixel 2BL, the 2B pixel 2BC, and the 2B pixel 2BR.

[0127] In the video imaging mode, the main control unit 40 repeats the processes of steps S15 and S16, and ends the imaging operation when an instruction to end imaging is received. As a result, video data in which the signal amount of the imaging signal is reduced to 1 / 4 is generated by the image processing unit 41.

[0128] Furthermore, in step S15, if the still image imaging mode is selected, the readout of pixel signals S from the pixel region 21 is controlled based on the sequential readout mode. As a result, pixel signals S are read out from all pixels in the pixel region 21 and input to the image processing unit 41. In this case, in step S16, the image processing unit 41 generates still image data. Note that in the still image imaging mode, live view image display and focus control may be performed by reading out pixel signals S in an additive readout mode similar to that in the video imaging mode during a preparation operation performed in response to half-pressing the release button 14.

[0129] As described above, according to the imaging device 10 of the first embodiment, focusing control can be performed using pixel signals of appropriate phase difference pixels according to the optical characteristics of the imaging lens.

[0130] [Second embodiment] Next, a second embodiment of the present disclosure will be described. In the second embodiment, the main control unit 40 enables reading in a fifth additive readout mode M5 and a sixth additive readout mode M6 in addition to the additive readout modes described in the first embodiment. The other configurations of the imaging device of the second embodiment are similar to those of the imaging device 10 of the first embodiment.

[0131] 19 is a diagram for explaining the fifth additive readout mode M5. The fifth additive readout mode M5 is a so-called two-pixel additive readout method in which two rows of the gate lines 22A are set and two pixel signals S are added and read out in sequence. The main control unit 40 makes it possible to set weights for the A-th pixel line LA, the B-th pixel line LB, and the C-th pixel line LC. The main control unit 40 performs additive readout based on the weights, as in the first embodiment.

[0132] The weight for the Ath pixel line LA is Wa, the weight for the Bth pixel line LB is Wb, and the weight for the Cth pixel line LC is Wc. In the fifth binning readout mode M5, the main control unit 40 performs binning readout of the Ath pixel line LA and the Bth pixel line LB as a set, with Wa=1, Wb=1, and Wc=0. In this case, the pixel signal S from the Ath pixel line LA and the pixel signal S from the Bth pixel line LB are binned and averaged at a ratio of 1:1.

[0133] The main controller 40 selects the fifth additive readout mode M5 when the value of the peripheral chief ray angle θp included in the lens information 35A is between the first peripheral chief ray angle θ1 and the second peripheral chief ray angle θ2. In the fifth additive readout mode M5, for example, the pixel signal S of the 1A pixel 1AL and the pixel signal S of the 1B pixel 1BL are added together to obtain a pixel signal corresponding to the fourth peripheral chief ray angle θ4 expressed by the following formula (1). θ4 = (θ1 + θ2) / 2 (1)

[0134] In this way, by using the fifth additive readout mode M5, appropriate focusing control can be performed even when an imaging lens 12 having a peripheral chief ray angle θp between the first peripheral chief ray angle θ1 and the second peripheral chief ray angle θ2 is attached to the main body 11.

[0135] 20 is a diagram illustrating the sixth additive readout mode M6. The sixth additive readout mode M6 is a two-pixel additive readout method like the fifth additive readout mode M5, but the rows that are set are different from those in the fifth additive readout mode M5.

[0136] In the sixth binning mode M6, the main controller 40 performs binning on the Bth pixel line LB and the Cth pixel line LC as a set, with Wa = 0, Wb = 1, and Wc = 1. In this case, the pixel signal S from the Bth pixel line LB and the pixel signal S from the Cth pixel line LC are averaged at a ratio of 1:1.

[0137] The main controller 40 selects the sixth additive readout mode M6 when the value of the peripheral chief ray angle θp included in the lens information 35A is between the second peripheral chief ray angle θ2 and the third peripheral chief ray angle θ3. In the sixth additive readout mode M6, for example, the pixel signal S of the 1B pixel 1BL and the pixel signal S of the 1C pixel 1CL are added together to obtain a pixel signal corresponding to the fifth peripheral chief ray angle θ5 expressed by the following formula (2). θ5=(θ2+θ3) / 2 (2)

[0138] In this way, by using the sixth additive readout mode M6, appropriate focusing control can be performed even when an imaging lens 12 having a peripheral chief ray angle θp between the second peripheral chief ray angle θ2 and the third peripheral chief ray angle θ3 is attached to the main body 11.

[0139] In the fifth additive readout mode M5 and the sixth additive readout mode M6, two pixel signals are added at a ratio of 1:1, but it is also possible to add them at other ratios such as 1:2. An imaging device that can perform pixel addition at a ratio other than 1:1 in this way is known from, for example, JP 2015-128215 A.

[0140] For example, in the fifth additive readout mode M5, by setting Wa=1 and Wb=2, a pixel signal corresponding to the sixth peripheral chief ray angle θ6 expressed by the following equation (3) can be obtained from the 1A pixel 1AL and the 1B pixel 1BL. θ6 = (θ1 + 2 × θ2) / 3 (3)

[0141] In this way, by changing the ratio of the weights Wa, Wb, and Wc in the fifth additive readout mode M5 and the sixth additive readout mode M6, it is possible to perform focusing control that appropriately corresponds to various peripheral chief ray angles θp.

[0142] In each of the above embodiments, three types of pixel lines, the A pixel line LA, the B pixel line LB, and the C pixel line LC, are provided as pixel lines including the phase difference pixels F, but four or more types of pixel lines may be provided. Also, it is sufficient that at least two types of pixel lines including the phase difference pixels F are provided.

[0143] In each of the above embodiments, the phase difference pixel F included in the first phase difference pixel group F1 and the phase difference pixel F included in the second phase difference pixel group F2 are arranged to sandwich two imaging pixels N in the X direction, but they may be adjacent to each other. In addition, it is preferable that the phase difference pixel F included in the first phase difference pixel group F1 and the phase difference pixel F included in the second phase difference pixel group F2 are arranged to sandwich three or less imaging pixels N therebetween.

[0144] In each of the above embodiments, the phase difference pixels F corresponding to the first optical characteristic, the phase difference pixels F corresponding to the second optical characteristic, and the phase difference pixels F corresponding to the third optical characteristic are respectively arranged on the A-th pixel line LA, the B-th pixel line LB, and the C-th pixel line LC. The phase difference pixels F corresponding to these multiple optical characteristics may be arranged in a mixed manner on one pixel line.

[0145] Furthermore, in each of the above embodiments, the pixel line including the phase difference pixel F extends in the X direction, but may be configured to extend in the Y direction. In this case, the above-mentioned additive readout may be performed along the X direction instead of the Y direction. A configuration for performing additive readout in the X direction (horizontal direction) in this manner is known, for example, from JP2015-128215A.

[0146] In addition, in each of the above embodiments, addition is performed on two adjacent pixels in the additive readout mode, but additive readout may also be performed on two pixels arranged with at least one pixel between them in the X direction or Y direction. A configuration for performing additive readout on two distant pixels in this manner is known, for example, from JP 2015-128215 A.

[0147] Furthermore, in each of the above embodiments, the main control unit 40 selects the additive readout mode based on the peripheral chief ray angle, which is the chief ray angle in the peripheral region of the pixel region 21. However, the additive readout mode may also be selected based on the chief ray angle incident on a region other than the peripheral region of the pixel region 21.

[0148] [Third embodiment] Next, a third embodiment of the present disclosure will be described. In the first embodiment, the main controller 40 selects the additive readout mode based on chief ray angle information included in the lens information 35A acquired from the imaging lens 12. In the third embodiment, the main controller 40 selects the additive readout mode based on the focal length of the imaging lens 12. Other configurations of the imaging device of the third embodiment are similar to those of the imaging device 10 of the first embodiment.

[0149] In the third embodiment, the lens information 35A stored in the memory 35 of the imaging lens 12 includes information on the focal length specific to the imaging lens 12. The main control unit 40 stores a table TB that associates the focal length with the peripheral chief ray angle θp, for example, as shown in Fig. 21. In general, the peripheral chief ray angle θp approaches 0 as the focal length becomes longer. Note that the main control unit 40 may store the relationship between the focal length and the peripheral chief ray angle θp using a function instead of the table TB.

[0150] The main controller 40 acquires the lens information 35A from the imaging lens 12 attached to the body 11, and then acquires the peripheral chief ray angle θp corresponding to the focal length included in the lens information 35A by referring to the table TB. Then, the main controller 40 selects the additive readout mode based on the acquired peripheral chief ray angle θp in the same manner as in the first embodiment (see FIG. 18).

[0151] According to this embodiment, even when the imaging lens 12 in which the lens information 35A does not include chief ray information is attached to the body 11, focus control can be performed using pixel signals of appropriate phase difference pixels. [Fourth embodiment] Next, a fourth embodiment of the present disclosure will be described. In each of the above embodiments, the imaging lens 12 is a fixed focal length lens, but in the fourth embodiment, the imaging lens 12 is a zoom lens whose focal length is variable. The imaging device of the fourth embodiment may be an integrated digital camera in which the imaging lens 12 and the main body 11 are inseparably connected. Other configurations of the imaging device of the fourth embodiment are similar to those of the imaging device 10 of the first embodiment.

[0152] In the imaging device of the fourth embodiment, the focal length (i.e., the zoom magnification) can be changed by operating a zoom ring (not shown) provided on the imaging lens 12 or the instruction keys 16. In the fourth embodiment, similar to the third embodiment, the main controller 40 holds the relationship between the focal length and the peripheral chief ray angle θp. The main controller 40 selects the additive readout mode in the same manner as the third embodiment, depending on the change in focal length caused by zoom operation.

[0153] In addition, when a zoom operation is performed during video capture, if the additive readout mode is always changed in conjunction with the zoom operation, a video image that gives a sense of discomfort to the user may be generated. For this reason, it is preferable to select the additive readout mode (i.e., change the weight) when the focal length is changed by a zoom operation and the change in the focal length is stopped.

[0154] The main control unit 40 performs the weight change process, for example, in the procedure shown in Fig. 22. First, in step S20, the main control unit 40 determines whether or not moving image capture has started. When the main control unit 40 determines that moving image capture has started (step S20: YES), the process proceeds to step S21.

[0155] In step S21, the main control unit 40 determines whether or not the focal length has been changed by a zoom operation. If the main control unit 40 determines that the focal length has been changed (step S21: YES), the process proceeds to step S22. In step S22, the main control unit 40 determines whether or not the change in focal length has stopped. If the main control unit 40 determines that the change in focal length has stopped (step S22: YES), the process proceeds to step S23. In step S23, the main control unit 40 changes the additive readout mode by selecting a weight according to the focal length at the time when the change in focal length stopped.

[0156] In the next step S24, the main control unit 40 determines whether or not the moving image capture has stopped. If the main control unit 40 determines that the moving image capture has not stopped (step S24: NO), the process returns to step S21. That is, if the moving image capture has not stopped, the main control unit 40 repeatedly executes steps S21 to S24. Then, if the main control unit 40 determines that the moving image capture has stopped (step S24: YES), the change process ends.

[0157] The change process of this embodiment is not limited to being performed during moving image capture, but can also be performed during display of a live view image that is performed in preparation for still image capture.

[0158] [Fifth embodiment] Next, a fifth embodiment of the present disclosure will be described. In the fifth embodiment, even if it is not possible to acquire lens information 35A (i.e., optical characteristics) from the imaging lens 12, it is possible to select a pixel line including a phase difference pixel F suitable for the optical characteristics of the imaging lens 12. The other configurations of the imaging device of the fifth embodiment are similar to those of the imaging device 10 of the first embodiment.

[0159] In the fifth embodiment, when the main control unit 40 cannot acquire optical characteristics from the imaging lens 12, the main control unit 40 determines the weight of the additive readout based on the light exposure amount of the phase difference pixel F included in the first phase difference pixel group F1 and the phase difference pixel F included in the second phase difference pixel group F2.

[0160] Fig. 23 shows the difference in exposure amount between the 1A pixel 1AL and the 2A pixel 2AL, and the 1B pixel 1BL and the 2B pixel 1BL for the optical characteristics of a certain imaging lens 12. Fig. 23 shows the chief ray PR when the imaging lens 12 having the second optical characteristic shown in Fig. 14 is attached to the body 11.

[0161] The first A pixel 1AL and the second A pixel 2AL are phase difference pixels F arranged on the A pixel line LA, and correspond to the peripheral chief ray angle θ1 of the first optical characteristic (see FIG. 13). Therefore, when the chief ray PR of the second optical characteristic is incident on the first A pixel 1AL and the second A pixel 2AL, the peripheral chief ray angle θp of the incident light differs from the corresponding peripheral chief ray angle θ1, and thus a difference occurs in the amount of exposure between the two. Here, the amount of exposure corresponds to the magnitude of the pixel signal S.

[0162] Specifically, in the first A pixel 1AL, the light shielding layer SF blocks the light beam from the exit pupil EP2 and a part of the light beam from the exit pupil EP1, so the exposure amount is lower than the appropriate value. In contrast, in the second A pixel 2AL, the light shielding layer SF blocks only a part of the light beam from the exit pupil EP1, so the light amount is higher than the appropriate value. Therefore, an exposure amount difference Δ occurs between the first A pixel 1AL, which is the phase difference pixel F included in the first phase difference pixel group F1, and the second A pixel 2AL, which is the phase difference pixel F included in the second phase difference pixel group F2.

[0163] The first B pixel 1BL and the second B pixel 2BL are phase difference pixels F arranged on the A pixel line LA, and correspond to the peripheral chief ray angle θ2 of the second optical characteristic (see FIG. 14). Therefore, when the chief ray PR of the second optical characteristic is incident on the first A pixel 1AL and the second A pixel 2AL, the peripheral chief ray angle θp of the incident light coincides with the corresponding peripheral chief ray angle θ1, so that the exposure amount difference Δ becomes 0. Therefore, no exposure amount difference Δ occurs between the first B pixel 1BL, which is the phase difference pixel F included in the first phase difference pixel group F1, and the second B pixel 2BL, which is the phase difference pixel F included in the second phase difference pixel group F2.

[0164] In this way, the main control unit 40 determines the weight of the additive readout based on the exposure amount difference Δ between the phase difference pixel F included in the first phase difference pixel group F1 and the phase difference pixel F included in the second phase difference pixel group F2 so as to select the pixel line with the smallest exposure amount difference Δ.

[0165] The main control unit 40 performs the weight determination process, for example, in the procedure shown in Fig. 24. First, in step S30, the main control unit 40 determines whether or not it is possible to acquire lens information 35A from the imaging lens 12 when the imaging lens 12 is attached to the body 11. If it is possible to acquire lens information 35A (step S30: YES), the main control unit 40 ends the weight determination process and determines the weight in the procedure shown in the first embodiment.

[0166] When the main controller 40 is unable to acquire the lens information 35A (step S30: NO), the process proceeds to step S31. In step S31, the main controller 40 acquires pixel signals S from the phase difference pixels F included in the first phase difference pixel group F1 and the second phase difference pixel group F2 in the first side region, for example. At this time, it is preferable that the imaging sensor 20 captures images under a uniform amount of light.

[0167] In the next step S32, the main controller 40 obtains an exposure amount difference Δ between the phase difference pixel F included in the first phase difference pixel group F1 and the phase difference pixel F included in the second phase difference pixel group F2. The main controller 40 obtains, for example, an exposure amount difference Δ between the 1A pixel 1AL and the 2A pixel 2AL, an exposure amount difference Δ between the 1B pixel 1BL and the 2B pixel 2BL, and an exposure amount difference Δ between the 1C pixel 1CL and the 2C pixel 2CL.

[0168] In the next step S33, the main control unit 40 determines weights for additive readout so as to select a pixel line including a pair of phase difference pixels F with the smallest exposure amount difference Δ among the exposure amount differences Δ calculated in step S32. For example, when the exposure amount difference Δ between the 1B pixel 1BL and the 2B pixel 2BL is the smallest, the weights are determined as W1=1, W0=W2=W3=0 so as to select the B pixel line LB (see FIG. 8). As a result, the second additive readout mode M2 ​​is selected.

[0169] With the above, the main control unit 40 ends the weight determination process. After that, when moving image capture is started, the main control unit 40 reads out the pixel signals S using the additive readout mode determined in step S33.

[0170] In the third embodiment, when the optical characteristics of the imaging lens 12 cannot be acquired, the weights are determined based on the exposure amount of the phase difference pixel F, but a default weight may be selected. For example, when the optical characteristics of the imaging lens 12 cannot be acquired, the main control unit 40 determines the weights as W1=1, W0=W2=W3=0 so as to select the B-th pixel line LB including the 1B pixel 1BL and the 2B pixel 2BL having the same light blocking area (aperture amount) (see FIG. 8). As a result, the second additive readout mode M2 ​​is selected.

[0171] The 1B pixel 1BL and the 2B pixel 2BL have the same light-shielding area, and are therefore most suitable for cases where the optical characteristics of the imaging lens 12 are unknown. This makes it possible to deal with situations where the optical characteristics of the imaging lens 12 cannot be acquired and imaging for determining weights cannot be performed.

[0172] In each of the above embodiments, the microlens ML is shifted from the center of the photoelectric conversion element 27 in accordance with the image height H, but in the technology of the present disclosure, it is not essential to shift the microlens ML.

[0173] In each of the above embodiments, the hardware structure of the control unit, with the main control unit 40 being an example, may use various processors as shown below. The above various processors include a CPU, which is a general-purpose processor that functions by executing software (programs), as well as a PLD, which is a processor such as an FPGA whose circuit configuration can be changed after manufacture, or a dedicated electric circuit, which is a processor having a circuit configuration designed specifically for executing specific processing such as an ASIC.

[0174] The control unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple control units may be configured with a single processor.

[0175] As an example of configuring multiple control units with one processor, first, there is a form in which one processor is configured with a combination of one or more CPUs and software, as typified by computers such as clients and servers, and this processor functions as multiple control units. Second, there is a form in which a processor is used that realizes the functions of the entire system including multiple control units with one IC chip, as typified by System On Chip (SOC). In this way, the control unit can be configured as a hardware structure using one or more of the various processors mentioned above.

[0176] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.

[0177] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0178] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference.

Claims

1. a pixel region in which a plurality of pixels are arranged and into which light is incident via an imaging lens; A control unit that controls reading of pixel signals from the pixel area, In the pixel region, a phase difference pixel including a photoelectric conversion element and a light shielding layer that blocks a part of light incident on the photoelectric conversion element is arranged along a first direction, In the case where one side of the first direction is defined as a first side and the other side is defined as a second side, The pixel region includes, in a first side region on the first side, a first phase difference pixel group including a plurality of the phase difference pixels in which the first side of the photoelectric conversion element is shielded by the light shielding layer, and a second phase difference pixel group including a plurality of the phase difference pixels in which the second side of the photoelectric conversion element is shielded by the light shielding layer, the first phase difference pixel group includes a first A pixel and a first B pixel having a smaller light blocking area of ​​the photoelectric conversion element by the light blocking layer than that of the first A pixel, the control unit acquires information on optical characteristics of the imaging lens from the imaging lens, and performs an addition readout process in which at least one of the pixel signal of the first A pixel and the pixel signal of the first B pixel is weighted according to the acquired optical characteristics.

1. An imaging device, comprising: When the control unit cannot acquire the information on the optical characteristics from the imaging lens, the control unit performs the addition and reading process with the weight set to a default value. Imaging device.

2. the second phase difference pixel group includes a second A pixel and a second B pixel having a larger light blocking area of ​​the photoelectric conversion element by the light blocking layer than the second A pixel, the control unit performs an addition readout process in which a weight is applied to either one of the set of the first A pixel and the second A pixel and the set of the first B pixel and the second B pixel according to the acquired optical characteristic. The imaging device according to claim 1 .

3. The pixel region is an A-th pixel line including the first A-th pixel and including a plurality of pixels arranged in the first direction; a Bth pixel line including the first B pixel and including a plurality of pixels arranged in the first direction; The A pixel line and the B pixel line are arranged in a second direction intersecting the first direction, the control unit performs an addition readout process in which a weight is applied to either the A pixel line or the B pixel line in accordance with the acquired optical characteristic. The imaging device according to claim 1 .

4. the first phase difference pixel group is also included in a central region located at the center of the pixel region in the first direction, In the A pixel line, a light-shielding area of ​​the first A pixel included in the first side region is larger than a light-shielding area of ​​the first A pixel included in the central region, In the B pixel line, a light-shielding area of ​​the first B pixel included in the first side region is equal to a light-shielding area of ​​the first B pixel included in the central region. The imaging device according to claim 3 .

5. a light-shielding area of ​​the first A pixels included in the A pixel line decreases from the first side region toward the central region; The imaging device according to claim 4.

6. the A pixel line and the B pixel line are adjacent to each other in the second direction; The imaging device according to claim 3 .

7. In the pixel region, the phase difference pixels included in the first phase difference pixel group are formed in a second side region on the second side, In the A pixel line, a light-shielding area of ​​the first A pixel included in the second side region is smaller than a light-shielding area of ​​the first A pixel included in the first side region. The imaging device according to claim 3 .

8. the optical characteristic is an incident angle of the light with respect to the pixel region, a focal length of the imaging lens, or a zoom magnification of the imaging lens; The imaging device according to claim 1 .

9. The imaging lens has a variable focal length, The control unit changes the weight when the focal length is changed and the change stops. The imaging device according to claim 8.

10. The pixel region is a gate line extending in the first direction and selecting the photoelectric conversion element from which the pixel signal is read out; a signal line extending in a second direction intersecting the first direction and through which a pixel signal is output from the photoelectric conversion element; The imaging device according to claim 1 .

11. The addition readout process includes a thinning-out readout process in which the weights are set to zero, thereby thinning out pixel signals whose weights are set to zero, and reading out pixel signals whose weights are not zero. The imaging device according to claim 1 .

Images